Calculating Demand Forecast Accuracy

Calculating demand forecast accuracy is the process of determining the accuracy of forecasts made regarding customer demand for a product.

Importance of forecasts

Understanding and predicting customer demand is vital to manufacturers and distributors to avoid stock-outs and maintain adequate inventory levels. While forecasts are never perfect, they are necessary to prepare for actual demand. In order to maintain an optimized inventory and effective supply chain, accurate demand forecasts are imperative.

Calculating the accuracy of supply chain forecasts

Forecast accuracy in the supply chain is typically measured using the Mean Absolute Percent Error or MAPE. Statistically MAPE is defined as the average of percentage errors.

Most practitioners, however, define and use the MAPE as the Mean Absolute Deviation divided by Average Sales, which is just a volume weighted MAPE, also referred to as the MAD/Mean ratio. This is the same as dividing the sum of the absolute deviations by the total sales of all products. This calculation ${\displaystyle \sum {(|A-F|)} \over \sum {A}}$, where ${\displaystyle A}$ is the actual value and ${\displaystyle F}$ the forecast, is also known as WAPE, Weighted Absolute Percent Error.

Another interesting option is the weighted ${\displaystyle MAPE={\frac {\sum (w\cdot |A-F|)}{\sum (w\cdot A)}}}$. The advantage of this measure is that could weight errors, so you can define how to weight for your relevant business, ex gross profit or ABC. The only problem is that for seasonal products you will create an undefined result when sales = 0 and that is not symmetrical, that means that you can be much more inaccurate if sales are higher than if they are lower than the forecast. So sMAPE is also used to correct this, it is known as symmetric Mean Absolute Percentage Error.

Last but not least, for intermittent demand patterns none of the above are really useful. So you can consider MASE (Mean Absolute Scaled Error) as a good KPI to use in those situations, the problem is that is not as intuitive as the ones mentioned before. You can find an interesting discussion here: http://datascienceassn.org/sites/default/files/Another%20Look%20at%20Measures%20of%20Forecast%20Accuracy.pdf

Calculating forecast error

The forecast error needs to be calculated using actual sales as a base. There are several forms of forecast error calculation methods used, namely Mean Percent Error, Root Mean Squared Error, Tracking Signal and Forecast Bias.

References

Connect with defaultLogic
What We've Done
Led Digital Marketing Efforts of Top 500 e-Retailers.
Worked with Top Brands at Leading Agencies.
Successfully Managed Over \$50 million in Digital Ad Spend.
Developed Strategies and Processes that Enabled Brands to Grow During an Economic Downturn.