IDEAS home Printed from https://ideas.repec.org/a/eee/jpolmo/v14y1992i4p465-495.html
   My bibliography  Save this article

Parameter constancy, mean square forecast errors, and measuring forecast performance: An exposition, extensions, and illustration

Author

Listed:
  • Ericsson, Neil R.

Abstract

Parameter constancy and a model's mean square forecast error are two commonly used measures of forecast performance. By explicit consideration of the information sets involved, this paper clarifies the roles that each plays in analyzing a model's forecast accuracy. Both criteria are necessary for \"good\" forecast performance, but neither (nor both) is sufficient. Further, these criteria fit into a general taxonomy of model evaluation statistics, and the information set corresponding to a model's mean square forecast error leads to a new test statistic, forecast-model encompassing. Two models of U.K. money demand illustrate the various measures of forecast accuracy.
(This abstract was borrowed from another version of this item.)

Suggested Citation

  • Ericsson, Neil R., 1992. "Parameter constancy, mean square forecast errors, and measuring forecast performance: An exposition, extensions, and illustration," Journal of Policy Modeling, Elsevier, vol. 14(4), pages 465-495, August.
    • Handle: RePEc:eee:jpolmo:v:14:y:1992:i:4:p:465-495
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/0161-8938(92)90017-7
    Download Restriction: Full text for ScienceDirect subscribers only
    ---><---

    As the access to this document is restricted, you may want to look for a different version below or search for a different version of it.

    Other versions of this item:

    References listed on IDEAS

    as
    1. Davidson, Russell & MacKinnon, James G, 1981. "Several Tests for Model Specification in the Presence of Alternative Hypotheses," Econometrica, Econometric Society, vol. 49(3), pages 781-793, May.
    2. Neil R. Ericsson & David F. Hendry, 1985. "Conditional econometric modelling : an application to new house prices in the United Kingdom," International Finance Discussion Papers 254, Board of Governors of the Federal Reserve System (U.S.).
    3. Hali J. Edison, 1983. "The rise and fall of sterling: testing alternative models of exchange rate determination," International Finance Discussion Papers 224, Board of Governors of the Federal Reserve System (U.S.).
    4. Edison, Hali J & Klovland, Jan Tore, 1987. "A Quantitative Reassessment of the Purchasing Power Parity Hypothesis: Evidence from Norway and the United Kingdom," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 2(4), pages 309-333, October.
    5. Yock Y. Chong & David F. Hendry, 1986. "Econometric Evaluation of Linear Macro-Economic Models," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 53(4), pages 671-690.
    6. Swamy, P. A. V. B. & Tinsley, P. A., 1980. "Linear prediction and estimation methods for regression models with stationary stochastic coefficients," Journal of Econometrics, Elsevier, vol. 12(2), pages 103-142, February.
    7. Goldfeld, Stephen M. & Sichel, Daniel E., 1990. "The demand for money," Handbook of Monetary Economics, in: B. M. Friedman & F. H. Hahn (ed.), Handbook of Monetary Economics, edition 1, volume 1, chapter 8, pages 299-356, Elsevier.
    8. Granger, Clive W. J. & Deutsch, Melinda, 1992. "Comments on the evaluation of policy models," Journal of Policy Modeling, Elsevier, vol. 14(4), pages 497-516, August.
    9. Hendry, David F. & Richard, Jean-Francois, 1982. "On the formulation of empirical models in dynamic econometrics," Journal of Econometrics, Elsevier, vol. 20(1), pages 3-33, October.
    10. Mizon, Grayham E & Richard, Jean-Francois, 1986. "The Encompassing Principle and Its Application to Testing Non-nested Hypotheses," Econometrica, Econometric Society, vol. 54(3), pages 657-678, May.
    11. Dufour, Jean-Marie, 1982. "Recursive stability analysis of linear regression relationships: An exploratory methodology," Journal of Econometrics, Elsevier, vol. 19(1), pages 31-76, May.
    12. Sargan, J D, 1980. "Some Approximations to the Distribution of Econometric Criteria Which are Asymptotically Distributed as Chi-Squared," Econometrica, Econometric Society, vol. 48(5), pages 1107-1138, July.
    13. Engle, Robert & Granger, Clive, 2015. "Co-integration and error correction: Representation, estimation, and testing," Applied Econometrics, Russian Presidential Academy of National Economy and Public Administration (RANEPA), vol. 39(3), pages 106-135.
    14. White, Halbert, 1980. "A Heteroskedasticity-Consistent Covariance Matrix Estimator and a Direct Test for Heteroskedasticity," Econometrica, Econometric Society, vol. 48(4), pages 817-838, May.
    15. Hendry, David F. & Ericsson, Neil R., 1991. "Modeling the demand for narrow money in the United Kingdom and the United States," European Economic Review, Elsevier, vol. 35(4), pages 833-881, May.
    16. Pagan, Adrian, 1989. "On the role of simulation in the statistical evaluation of econometric models," Journal of Econometrics, Elsevier, vol. 40(1), pages 125-139, January.
    17. Fisher, Franklin M, 1970. "Tests of Equality Between Sets of Coefficients in Two Linear Regressions: An Expository Note," Econometrica, Econometric Society, vol. 38(2), pages 361-366, March.
    18. Ericsson, Neil R. & Campos, Julia & Tran, Hong-Anh, 1990. "Pc-Give and David Hendry'S Econometric Methodology," Brazilian Review of Econometrics, Sociedade Brasileira de Econometria - SBE, vol. 10(1), April.
    19. Jarque, Carlos M. & Bera, Anil K., 1980. "Efficient tests for normality, homoscedasticity and serial independence of regression residuals," Economics Letters, Elsevier, vol. 6(3), pages 255-259.
    20. Jan F. Kiviet, 1986. "On the Rigour of Some Misspecification Tests for Modelling Dynamic Relationships," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 53(2), pages 241-261.
    21. Engle, Robert F, 1982. "Autoregressive Conditional Heteroscedasticity with Estimates of the Variance of United Kingdom Inflation," Econometrica, Econometric Society, vol. 50(4), pages 987-1007, July.
    22. M. H. Pesaran, 1974. "On the General Problem of Model Selection," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 41(2), pages 153-171.
    23. Diebold, Francis X., 1989. "Forecast combination and encompassing: Reconciling two divergent literatures," International Journal of Forecasting, Elsevier, vol. 5(4), pages 589-592.
    24. Chow, Gregory C., 1984. "Random and changing coefficient models," Handbook of Econometrics, in: Z. Griliches† & M. D. Intriligator (ed.), Handbook of Econometrics, edition 1, volume 2, chapter 21, pages 1213-1245, Elsevier.
    25. Fair, Ray C., 1986. "Evaluating the predictive accuracy of models," Handbook of Econometrics, in: Z. Griliches† & M. D. Intriligator (ed.), Handbook of Econometrics, edition 1, volume 3, chapter 33, pages 1979-1995, Elsevier.
    26. Julia Campos & Neil R. Ericsson, 1988. "Econometric modeling of consumers' expenditure in Venezuela," International Finance Discussion Papers 325, Board of Governors of the Federal Reserve System (U.S.).
    27. Garry J. Schinasi & P. A. V. B. Swamy, 1986. "Should fixed coefficients be reestimated every period for extrapolation?," International Finance Discussion Papers 287, Board of Governors of the Federal Reserve System (U.S.).
    28. Meese, Richard A. & Rogoff, Kenneth, 1983. "Empirical exchange rate models of the seventies : Do they fit out of sample?," Journal of International Economics, Elsevier, vol. 14(1-2), pages 3-24, February.
    29. Spanos,Aris, 1986. "Statistical Foundations of Econometric Modelling," Cambridge Books, Cambridge University Press, number 9780521269124, January.
    30. Godfrey, Leslie G, 1978. "Testing against General Autoregressive and Moving Average Error Models When the Regressors Include Lagged Dependent Variables," Econometrica, Econometric Society, vol. 46(6), pages 1293-1301, November.
    31. Schinasi, Garry J. & Swamy, P. A. V. B., 1989. "The out-of-sample forecasting performance of exchange rate models when coefficients are allowed to change," Journal of International Money and Finance, Elsevier, vol. 8(3), pages 375-390, September.
    32. Nicholls, D F & Pagan, A R, 1983. "Heteroscedasticity in Models with Lagged Dependent Variables," Econometrica, Econometric Society, vol. 51(4), pages 1233-1242, July.
    33. Clemen, Robert T., 1989. "Combining forecasts: A review and annotated bibliography," International Journal of Forecasting, Elsevier, vol. 5(4), pages 559-583.
    34. Stephen M. Goldfeld, 1973. "The Demand for Money Revisited," Brookings Papers on Economic Activity, Economic Studies Program, The Brookings Institution, vol. 4(3), pages 577-646.
    35. Hendry, David F, 1988. "The Encompassing Implications of Feedback versus Feedforward Mechanisms in Econometrics," Oxford Economic Papers, Oxford University Press, vol. 40(1), pages 132-149, March.
    36. Dufour, Jean-Marie, 1980. "Dummy variables and predictive tests for structural change," Economics Letters, Elsevier, vol. 6(3), pages 241-247.
    37. Granger, Clive W J, 1986. "Developments in the Study of Cointegrated Economic Variables," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 48(3), pages 213-228, August.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Hendry, David F. & Ericsson, Neil R., 1991. "Modeling the demand for narrow money in the United Kingdom and the United States," European Economic Review, Elsevier, vol. 35(4), pages 833-881, May.
    2. Adrian C. Darnell, 1994. "A Dictionary Of Econometrics," Books, Edward Elgar Publishing, number 118.
    3. Sunil Sharma & Neil R. Ericsson, 1998. "Broad money demand and financial liberalization in Greece," Empirical Economics, Springer, vol. 23(3), pages 417-436.
    4. Hendry, David F & Ericsson, Neil R, 1991. "An Econometric Analysis of U.K. Money Demand in 'Monetary Trends in the United States and the United Kingdom' by Milton Friedman and Anna Schwartz," American Economic Review, American Economic Association, vol. 81(1), pages 8-38, March.
    5. Neil R. Ericsson, 1987. "Monte Carlo methodology and the finite sample properties of statistics for testing nested and non-nested hypotheses," International Finance Discussion Papers 317, Board of Governors of the Federal Reserve System (U.S.).
    6. Ericsson, Neil R & Hendry, David F & Mizon, Grayham E, 1998. "Exogeneity, Cointegration, and Economic Policy Analysis," Journal of Business & Economic Statistics, American Statistical Association, vol. 16(4), pages 370-387, October.
    7. Neil R. Ericsson & David F. Hendry & Hong-Anh Tran, 1993. "Cointegration, seasonality, encompassing, and the demand for money in the United Kingdom," International Finance Discussion Papers 457, Board of Governors of the Federal Reserve System (U.S.).
    8. Neil R. Ericsson & Steven B. Kamin, 1993. "Dollarization in Argentina," International Finance Discussion Papers 460, Board of Governors of the Federal Reserve System (U.S.).
    9. Julia Campos & Neil R. Ericsson & David F. Hendry, 2005. "General-to-specific modeling: an overview and selected bibliography," International Finance Discussion Papers 838, Board of Governors of the Federal Reserve System (U.S.).
    10. de Brouwer, Gordon & Ericsson, Neil R, 1998. "Modeling Inflation in Australia," Journal of Business & Economic Statistics, American Statistical Association, vol. 16(4), pages 433-449, October.
    11. Neil R. Ericsson & David F. Hendry, 1985. "Conditional econometric modelling : an application to new house prices in the United Kingdom," International Finance Discussion Papers 254, Board of Governors of the Federal Reserve System (U.S.).
    12. MacKinnon, James G, 1992. "Model Specification Tests and Artificial Regressions," Journal of Economic Literature, American Economic Association, vol. 30(1), pages 102-146, March.
    13. Bierens, H.J. & Broersma, L., 1991. "The relation between unemployment and interest rate : some international evidence," Serie Research Memoranda 0112, VU University Amsterdam, Faculty of Economics, Business Administration and Econometrics.
    14. Ericsson, Neil R., 1992. "Cointegration, exogeneity, and policy analysis: An overview," Journal of Policy Modeling, Elsevier, vol. 14(3), pages 251-280, June.
    15. Charles G. Renfro, 2009. "The Practice of Econometric Theory," Advanced Studies in Theoretical and Applied Econometrics, Springer, number 978-3-540-75571-5.
    16. Neil R. Ericsson, David F. Hendry & Kevin M. Prestiwch, "undated". "The UK Demand for Broad Money over the Long run," Economics Papers W29, Economics Group, Nuffield College, University of Oxford.
    17. Jim Granato & William West, 1994. "Words And Deeds: Symbolic Politics And Decision Making At The Federal Reserve," Economics and Politics, Wiley Blackwell, vol. 6(3), pages 233-255, November.
    18. Ericsson, Neil R. & Campos, Julia & Tran, Hong-Anh, 1990. "Pc-Give and David Hendry'S Econometric Methodology," Brazilian Review of Econometrics, Sociedade Brasileira de Econometria - SBE, vol. 10(1), April.
    19. Broersma, L., 1991. "The relation between unemployment and interest rate : application of an ARX approach," Serie Research Memoranda 0057, VU University Amsterdam, Faculty of Economics, Business Administration and Econometrics.
    20. Neil R. Ericsson & David F. Hendry & Kevin M. Prestwich, 1998. "The Demand for Broad Money in the United Kingdom, 1878–1993," Scandinavian Journal of Economics, Wiley Blackwell, vol. 100(1), pages 289-324, March.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:jpolmo:v:14:y:1992:i:4:p:465-495. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/inca/505735 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.