IDEAS home Printed from https://ideas.repec.org/p/wpa/wuwpgt/0412004.html
   My bibliography  Save this paper

Rule-Based Forecasting: Development and Validation of an Expert Systems Approach to Combining Time Series Extrapolations

Author

Listed:
  • Fred Collopy

    (Case Western Reserve University)

  • JS Armstrong

    (The Wharton School - University of Pennsylvania)

Abstract

This paper examines the feasibility of rule -based forecasting, a procedure that applies forecasting expertise and domain knowledge to produce forecasts according to features of the data. We developed a rule base to make annual extrapolation forecasts for economic and demographic time series. The development of the rule base drew upon protocol analyses of five experts on forecasting methods. This rule base, consisting of 99 rules, combined forecasts from four extrapolation methods (the random walk, regression, Brown's linear exponential smoothing, and Holt's exponential smoothing) according to rules using 18 features of time series. For one-year ahead ex ante forecasts of 90 annual series, the median absolute percentage error (MdAPE) for rule- based forecasting was 13% less than that from equally-weighted combined forecasts. For six-year ahead ex ante forecasts, rule-based forecasting had a MdAPE that was 42% less. The improvement in accuracy of the rule - based forecasts over equally-weighted combined forecasts was statistically significant. Rule-based forecasting was more accurate than equal-weights combining in situations involving significant trends, low uncertainty, stability, and good domain expertise.

Suggested Citation

  • Fred Collopy & JS Armstrong, 2004. "Rule-Based Forecasting: Development and Validation of an Expert Systems Approach to Combining Time Series Extrapolations," General Economics and Teaching 0412004, University Library of Munich, Germany.
    • Handle: RePEc:wpa:wuwpgt:0412004
    Note: Type of Document - pdf; pages: 26
    as

    Download full text from publisher

    File URL: https://econwpa.ub.uni-muenchen.de/econ-wp/get/papers/0412/0412004.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. JS Armstrong & Fred Collopy, 2004. "Causal Forces: Structuring Knowledge for Time-series Extrapolation," General Economics and Teaching 0412003, University Library of Munich, Germany.
    2. Fildes, Robert & Lusk, Edward J, 1984. "The choice of a forecasting model," Omega, Elsevier, vol. 12(5), pages 427-435.
    3. Scott Armstrong, J., 1988. "Research needs in forecasting," International Journal of Forecasting, Elsevier, vol. 4(3), pages 449-465.
    4. Robert Carbone & JS Armstrong, 2004. "Evaluation of Extrapolative Forecasting Methods: Results of a Survey of Academicians and Practitioners," General Economics and Teaching 0412008, University Library of Munich, Germany.
    5. Robert Carbone & Spyros Makridakis, 1986. "Forecasting When Pattern Changes Occur Beyond the Historical Data," Management Science, INFORMS, vol. 32(3), pages 257-271, March.
    6. Armstrong, J. Scott & Collopy, Fred, 1992. "Error measures for generalizing about forecasting methods: Empirical comparisons," International Journal of Forecasting, Elsevier, vol. 8(1), pages 69-80, June.
    7. Sanders, NR & Ritzman, LP, 1990. "Improving short-term forecasts," Omega, Elsevier, vol. 18(4), pages 365-373.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Vokurka, Robert J. & Flores, Benito E. & Pearce, Stephen L., 1996. "Automatic feature identification and graphical support in rule-based forecasting: a comparison," International Journal of Forecasting, Elsevier, vol. 12(4), pages 495-512, December.
    2. Armstrong, J. Scott & Collopy, Fred & Yokum, J. Thomas, 2005. "Decomposition by causal forces: a procedure for forecasting complex time series," International Journal of Forecasting, Elsevier, vol. 21(1), pages 25-36.
    3. E. Andrew Boyd & Ioana C. Bilegan, 2003. "Revenue Management and E-Commerce," Management Science, INFORMS, vol. 49(10), pages 1363-1386, October.
    4. Armstrong, J. Scott & Brodie, Roderick J., 1999. "Forecasting for Marketing," MPRA Paper 81690, University Library of Munich, Germany.
    5. Yuehjen Shao & Yue-Fa Lin & Soe-Tsyr Yuan, 1999. "Integrated application of time series multiple-interventions analysis and knowledge-based reasoning," Journal of Applied Statistics, Taylor & Francis Journals, vol. 26(6), pages 755-766.
    6. JS Armstrong & Robert Fildes, 2004. "Correspondence On the Selection of Error Measures for Comparisons Among Forecasting Methods," General Economics and Teaching 0412002, University Library of Munich, Germany.
    7. Witt, Stephen F. & Witt, Christine A., 1995. "Forecasting tourism demand: A review of empirical research," International Journal of Forecasting, Elsevier, vol. 11(3), pages 447-475, September.
    8. Weatherford, Larry R. & Kimes, Sheryl E., 2003. "A comparison of forecasting methods for hotel revenue management," International Journal of Forecasting, Elsevier, vol. 19(3), pages 401-415.
    9. Fildes, Robert, 2006. "The forecasting journals and their contribution to forecasting research: Citation analysis and expert opinion," International Journal of Forecasting, Elsevier, vol. 22(3), pages 415-432.
    10. Webby, Richard & O'Connor, Marcus, 1996. "Judgemental and statistical time series forecasting: a review of the literature," International Journal of Forecasting, Elsevier, vol. 12(1), pages 91-118, March.
    11. Winklhofer, Heidi & Diamantopoulos, Adamantios & Witt, Stephen F., 1996. "Forecasting practice: A review of the empirical literature and an agenda for future research," International Journal of Forecasting, Elsevier, vol. 12(2), pages 193-221, June.
    12. Lindh, Thomas & Malmberg, Bo, 2007. "Demographically based global income forecasts up to the year 2050," International Journal of Forecasting, Elsevier, vol. 23(4), pages 553-567.
    13. Madden, Gary & Tan, Joachim, 2007. "Forecasting telecommunications data with linear models," Telecommunications Policy, Elsevier, vol. 31(1), pages 31-44, February.
    14. Armstrong, J. Scott & Green, Kesten C. & Graefe, Andreas, 2015. "Golden rule of forecasting: Be conservative," Journal of Business Research, Elsevier, vol. 68(8), pages 1717-1731.
    15. Kumar, V. & Sunder, Sarang & Sharma, Amalesh, 2015. "Leveraging Distribution to Maximize Firm Performance in Emerging Markets," Journal of Retailing, Elsevier, vol. 91(4), pages 627-643.
    16. Hu, Xincheng & Banks, Jonathan & Wu, Linping & Liu, Wei Victor, 2020. "Numerical modeling of a coaxial borehole heat exchanger to exploit geothermal energy from abandoned petroleum wells in Hinton, Alberta," Renewable Energy, Elsevier, vol. 148(C), pages 1110-1123.
    17. Garcia-Ferrer, Antonio & Bujosa-Brun, Marcos, 2000. "Forecasting OECD industrial turning points using unobserved components models with business survey data," International Journal of Forecasting, Elsevier, vol. 16(2), pages 207-227.
    18. Ariana Chang & Tian‐Shyug Lee & Hsiu‐Mei Lee, 2024. "Applying sustainable development goals in financial forecasting using machine learning techniques," Corporate Social Responsibility and Environmental Management, John Wiley & Sons, vol. 31(3), pages 2277-2289, May.
    19. Massimo Guidolin & Manuela Pedio, 2019. "Forecasting and Trading Monetary Policy Effects on the Riskless Yield Curve with Regime Switching Nelson†Siegel Models," Working Papers 639, IGIER (Innocenzo Gasparini Institute for Economic Research), Bocconi University.
    20. Kourentzes, Nikolaos & Athanasopoulos, George, 2021. "Elucidate structure in intermittent demand series," European Journal of Operational Research, Elsevier, vol. 288(1), pages 141-152.

    More about this item

    Keywords

    Rule-based forecasting; time series;

    JEL classification:

    • A - General Economics and Teaching

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:wpa:wuwpgt:0412004. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: EconWPA (email available below). General contact details of provider: https://econwpa.ub.uni-muenchen.de .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.