This file is part of IDEAS, which uses RePEc data


[ Papers | Articles | Software | Books | Chapters | Authors | Institutions | JEL Classification | NEP reports | Search | New papers by email | Author registration | Rankings | Volunteers | FAQ | Blog | Help! ]

Approximately Normal Tests for Equal Predictive Accuracy in Nested Models

Author info | Abstract | Publisher info | Download info | Related research | Statistics
Author Info
Kenneth D. West
Todd Clark

Additional information is available for the following registered author(s):

Abstract

Forecast evaluation often compares a parsimonious null model to a larger model that nests the null model. Under the null that the parsimonious model generates the data, the larger model introduces noise into its forecasts by estimating parameters whose population values are zero. We observe that the mean squared prediction error (MSPE) from the parsimonious model is therefore expected to be smaller than that of the larger model. We describe how to adjust MSPEs to account for this noise. We propose applying standard methods (West (1996)) to test whether the adjusted mean squared error difference is zero. We refer to nonstandard limiting distributions derived in Clark and McCracken (2001, 2005a) to argue that use of standard normal critical values will yield actual sizes close to, but a little less than, nominal size. Simulation evidence supports our recommended procedure.

Download Info
To download:

If you experience problems downloading a file, check if you have the proper application to view it first. Information about this may be contained in the File-Format links below. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.

File URL: http://www.nber.org/papers/t0326.pdf
File Format: application/pdf
File Function:
Download Restriction: Access to the full text is generally limited to series subscribers, however if the top level domain of the client browser is in a developing country or transition economy free access is provided. More information about subscriptions and free access is available at http://www.nber.org/wwphelp.html.

As the access to this document is restricted, you may want to look for a different version under "Related research" (further below) or search for a different version of it.

Publisher Info
Paper provided by National Bureau of Economic Research, Inc in its series NBER Technical Working Papers with number 0326.

Download reference. The following formats are available: HTML (with abstract), plain text (with abstract), BibTeX, RIS (EndNote, RefMan, ProCite), ReDIF
Length:
Date of creation: Aug 2006
Date of revision:
Handle: RePEc:nbr:nberte:0326

Note: AP EFG TWP
Contact details of provider:
Postal: National Bureau of Economic Research, 1050 Massachusetts Avenue Cambridge, MA 02138, U.S.A.
Phone: 617-868-3900
Email:
Web page: http://www.nber.org
More information through EDIRC

For technical questions regarding this item, or to correct its listing, contact: ().

Related research
Keywords:

Other versions of this item:

Find related papers by JEL classification:
C22 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Time-Series Models; Dynamic Quantile Regressions
C53 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Forecasting and Other Model Applications
E17 - Macroeconomics and Monetary Economics - - General Aggregative Models - - - Forecasting and Simulation
F37 - International Economics - - International Finance - - - International Finance Forecasting and Simulation

This paper has been announced in the following NEP Reports:

References listed on IDEAS
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
  1. Clark, Todd E. & McCracken, Michael W., 2001. "Tests of equal forecast accuracy and encompassing for nested models," Journal of Econometrics, Elsevier, vol. 105(1), pages 85-110, November. [Downloadable!] (restricted)
    Other versions:
  2. Newey, Whitney K & West, Kenneth D, 1987. "A Simple, Positive Semi-definite, Heteroskedasticity and Autocorrelation Consistent Covariance Matrix," Econometrica, Econometric Society, vol. 55(3), pages 703-08, May. [Downloadable!] (restricted)
    Other versions:
  3. Faust, Jon & Rogers, John H & Wright, Jonathan H, 2005. "News and Noise in G-7 GDP Announcements," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 37(3), pages 403-19, June.
    Other versions:
  4. Raffaella Giacomini & Halbert White, 2004. "Tests of Conditional Predictive Ability," University of California at San Diego, Economics Working Paper Series 2003-09, Department of Economics, UC San Diego. [Downloadable!]
    Other versions:
  5. McCracken, Michael W., 2007. "Asymptotics for out of sample tests of Granger causality," Journal of Econometrics, Elsevier, vol. 140(2), pages 719-752, October. [Downloadable!] (restricted)
  6. M. Hashem Pesaran & Allan Timmermann, 1995. "Predictability of Stock Returns: Robustness and Economic Significance," University of California at San Diego, Economics Working Paper Series 95-19, Department of Economics, UC San Diego.
    Other versions:
  7. Francis X. Diebold & Canlin Li, 2004. "Forecasting the Term Structure of Government Bond Yields," CFS Working Paper Series 2004/09, Center for Financial Studies. [Downloadable!]
    Other versions:
  8. Kilian, Lutz, 1999. "Exchange Rates and Monetary Fundamentals: What Do We Learn from Long-Horizon Regressions?," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 14(5), pages 491-510, Sept.-Oct. [Downloadable!]
  9. Mark W. Watson & James H. Stock, 2004. "Combination forecasts of output growth in a seven-country data set," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 23(6), pages 405-430. [Downloadable!]
  10. John Y. Campbell & Samuel B. Thompson, 2005. "Predicting the Equity Premium Out of Sample: Can Anything Beat the Historical Average?," Harvard Institute of Economic Research Working Papers 2084, Harvard - Institute of Economic Research. [Downloadable!]
    Other versions:
  11. repec:cup:macdyn:v:5:y:2001:i:4:p:598-620 is not listed on IDEAS
  12. Tauchen, George, 2001. "The bias of tests for a risk premium in forward exchange rates," Journal of Empirical Finance, Elsevier, vol. 8(5), pages 695-704, December. [Downloadable!] (restricted)
  13. repec:taf:emetrv:v:24:y:2005:i:4:p:369-404 is not listed on IDEAS
  14. West, Kenneth D., 2006. "Forecast Evaluation," Handbook of Economic Forecasting, Elsevier. [Downloadable!] (restricted)
  15. Andrew Ang & Monika Piazzesi & Min Wei, 2003. "What does the yield curve tell us about GDP growth?," Proceedings, Federal Reserve Bank of San Francisco, issue Mar. [Downloadable!]
    Other versions:
  16. Ing, Ching-Kang, 2003. "Multistep Prediction In Autoregressive Processes," Econometric Theory, Cambridge University Press, vol. 19(02), pages 254-279, April. [Downloadable!]
  17. Amit Goyal & Ivo Welch, 2002. "Predicting the Equity Premium With Dividend Ratios," NBER Working Papers 8788, National Bureau of Economic Research, Inc. [Downloadable!] (restricted)
  18. Fama, Eugene F. & French, Kenneth R., 1988. "Dividend yields and expected stock returns," Journal of Financial Economics, Elsevier, vol. 22(1), pages 3-25, October. [Downloadable!] (restricted)
  19. Campbell, John Y., 2001. "Why long horizons? A study of power against persistent alternatives," Journal of Empirical Finance, Elsevier, vol. 8(5), pages 459-491, December. [Downloadable!] (restricted)
    Other versions:
  20. Chong, Yock Y & Hendry, David F, 1986. "Econometric Evaluation of Linear Macro-Economic Models," Review of Economic Studies, Blackwell Publishing, vol. 53(4), pages 671-90, August. [Downloadable!] (restricted)
  21. Todd E. Clark & Michael W. McCracken, 2003. "The predictive content of the output gap for inflation : resolving in-sample and out-of-sample evidence," Research Working Paper RWP 03-06, Federal Reserve Bank of Kansas City. [Downloadable!]
    Other versions:
  22. Norman Swanson & Valentina Corradi, 2006. "Nonparametric Bootstrap Procedures for Predictive Inference Based on Recursive Estimation Schemes," Departmental Working Papers 200618, Rutgers University, Department of Economics. [Downloadable!]
    Other versions:
  23. Lutz Kilian & Atsushi Inoue, 2002. "In-Sample or out-of-sample tests of predictability: which one should we use?," Working Paper Series 195, European Central Bank. [Downloadable!]
    Other versions:
  24. Orphanides, Athanasios & van Norden, Simon, 2005. "The Reliability of Inflation Forecasts Based on Output Gap Estimates in Real Time," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 37(3), pages 583-601, June.
    Other versions:
  25. Clark, Todd E. & West, Kenneth D., 2006. "Using out-of-sample mean squared prediction errors to test the martingale difference hypothesis," Journal of Econometrics, Elsevier, vol. 135(1-2), pages 155-186. [Downloadable!] (restricted)
    Other versions:
  26. West, Kenneth D, 2001. "Tests for Forecast Encompassing When Forecasts Depend on Estimated Regression Parameters," Journal of Business & Economic Statistics, American Statistical Association, vol. 19(1), pages 29-33, January.
  27. Robert F. Stambaugh, 1999. "Predictive Regressions," NBER Technical Working Papers 0240, National Bureau of Economic Research, Inc. [Downloadable!] (restricted)
    Other versions:
  28. Marcellino, Massimiliano & Stock, James H. & Watson, Mark W., 2003. "Macroeconomic forecasting in the Euro area: Country specific versus area-wide information," European Economic Review, Elsevier, vol. 47(1), pages 1-18, February. [Downloadable!] (restricted)
    Other versions:
  29. Mark, Nelson C, 1995. "Exchange Rates and Fundamentals: Evidence on Long-Horizon Predictability," American Economic Review, American Economic Association, vol. 85(1), pages 201-18, March.
  30. Harvey, David I & Leybourne, Stephen J & Newbold, Paul, 1998. "Tests for Forecast Encompassing," Journal of Business & Economic Statistics, American Statistical Association, vol. 16(2), pages 254-59, April.
  31. West, Kenneth D, 1996. "Asymptotic Inference about Predictive Ability," Econometrica, Econometric Society, vol. 64(5), pages 1067-84, September. [Downloadable!] (restricted)
    Other versions:
  32. James H. Stock & Mark W. Watson, 2003. "Forecasting Output and Inflation: The Role of Asset Prices," Journal of Economic Literature, American Economic Association, vol. 41(3), pages 788-829, September.
    Other versions:
  33. Shintani, Mototsugu, 2005. "Nonlinear Forecasting Analysis Using Diffusion Indexes: An Application to Japan," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 37(3), pages 517-38, June.
    Other versions:
  34. Stock, James H & Watson, Mark W, 2002. "Macroeconomic Forecasting Using Diffusion Indexes," Journal of Business & Economic Statistics, American Statistical Association, vol. 20(2), pages 147-62, April.
  35. Michael Cooper & Roberto C. Gutierrez, Jr. & Bill Marcum, 2005. "On the Predictability of Stock Returns in Real Time," Journal of Business, University of Chicago Press, vol. 78(2), pages 469-500, March. [Downloadable!]
  36. Ashley, R & Granger, C W J & Schmalensee, R, 1980. "Advertising and Aggregate Consumption: An Analysis of Causality," Econometrica, Econometric Society, vol. 48(5), pages 1149-67, July. [Downloadable!] (restricted)
  37. Marcellino, Massimiliano & Stock, James H & Watson, Mark W, 2005. "A Comparison of Direct and Iterated Multistep AR Methods for Forecasting Macroeconomic Time Series," CEPR Discussion Papers 4976, C.E.P.R. Discussion Papers. [Downloadable!] (restricted)
    Other versions:
  38. Norman R. Swanson, 2000. "An Out of Sample Test for Granger Causality," Econometric Society World Congress 2000 Contributed Papers 0362, Econometric Society. [Downloadable!]
  39. Nelson, Charles R & Kim, Myung J, 1993. " Predictable Stock Returns: The Role of Small Sample Bias," Journal of Finance, American Finance Association, vol. 48(2), pages 641-61, June. [Downloadable!] (restricted)
  40. Diebold, Francis X & Mariano, Roberto S, 1995. "Comparing Predictive Accuracy," Journal of Business & Economic Statistics, American Statistical Association, vol. 13(3), pages 253-63, July.
    Other versions:
Full references

Cited by:
(explanations, Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.)
This item has more than 25 citations. To prevent cluttering this page, these citations are listed on a separate page.
Statistics
Access and download statistics

Did you know? IDEAS is not the only service displaying RePEc data. Choose on RePEc which service fits your needs best.

This page was last updated on 2009-10-31.

This information is provided to you by IDEAS at the Department of Economics, College of Liberal Arts and Sciences, University of Connecticut using RePEc data on a server sponsored by the Society for Economic Dynamics.