IDEAS home Printed from https://ideas.repec.org/p/chb/bcchwp/435.html
   My bibliography  Save this paper

Hidden Predictability in Economics: The Case of the Chilean Exchange Rate

Author

Listed:
  • Pablo Pincheira B.

Abstract

In this paper we give arguments in support of conducting inference when models are evaluated by their ability to predict out of sample. It is argued that simple decision rules based upon direct comparisons of out-of-sample Mean Squared Prediction Errors (MSPE) may be equivalent to carrying out inference with a confidence level of only 50%. In addition, following McCracken (2007) and Clark and West (2006), we provide evidence via Monte Carlo simulations, of the non-normality of the asymptotic distribution of the difference of MSPE when models are nested. This means that when comparing predictive ability against a random walk, this simple model may outperform an alternative and true data-generating process. This anomaly is called “hidden predictability” meaning that the true predictability of a time series may be hidden behind a veil of parameter uncertainty affecting the true model. “Hidden Predictability” may be detected with some recently developed tests. We illustrate the detection of this type of predictability providing examples from two previous papers that explore the ability to predict Chilean exchange rate returns

Suggested Citation

  • Pablo Pincheira B., 2007. "Hidden Predictability in Economics: The Case of the Chilean Exchange Rate," Working Papers Central Bank of Chile 435, Central Bank of Chile.
  • Handle: RePEc:chb:bcchwp:435
    as

    Download full text from publisher

    File URL: https://www.bcentral.cl/documents/33528/133326/DTBC_435.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Whitney K. Newey & Kenneth D. West, 1994. "Automatic Lag Selection in Covariance Matrix Estimation," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 61(4), pages 631-653.
    2. Clark, Todd E. & West, Kenneth D., 2006. "Using out-of-sample mean squared prediction errors to test the martingale difference hypothesis," Journal of Econometrics, Elsevier, vol. 135(1-2), pages 155-186.
    3. Pablo Pincheira, 2006. "Shrinkage Based Tests of the Martingale Difference Hypothesis," Working Papers Central Bank of Chile 376, Central Bank of Chile.
    4. West, Kenneth D, 1996. "Asymptotic Inference about Predictive Ability," Econometrica, Econometric Society, vol. 64(5), pages 1067-1084, September.
    5. Diebold, Francis X & Mariano, Roberto S, 2002. "Comparing Predictive Accuracy," Journal of Business & Economic Statistics, American Statistical Association, vol. 20(1), pages 134-144, January.
    6. McCracken, Michael W., 2007. "Asymptotics for out of sample tests of Granger causality," Journal of Econometrics, Elsevier, vol. 140(2), pages 719-752, October.
    7. Clark, Todd E. & West, Kenneth D., 2007. "Approximately normal tests for equal predictive accuracy in nested models," Journal of Econometrics, Elsevier, vol. 138(1), pages 291-311, May.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Pablo Pincheira & Jorge Selaive, 2011. "External imbalance, valuation adjustments and real Exchange rate: evidence of predictability in an emerging economy," Revista de Analisis Economico – Economic Analysis Review, Universidad Alberto Hurtado/School of Economics and Business, vol. 26(1), pages 107-125, Junio.
    2. Pablo Pincheira B., 2008. "Predictibilidad Encubierta en Economía: El Caso del Tipo de Cambio Nominal Chileno," Notas de Investigación Journal Economía Chilena (The Chilean Economy), Central Bank of Chile, vol. 11(1), pages 137-142, April.
    3. Clark, Todd & McCracken, Michael, 2013. "Advances in Forecast Evaluation," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 2, chapter 0, pages 1107-1201, Elsevier.
    4. Pablo Pincheira Brown & Nicolás Hardy, 2024. "Correlation‐based tests of predictability," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 43(6), pages 1835-1858, September.
    5. Pablo Pincheira Brown, 2022. "A Power Booster Factor for Out-of-Sample Tests of Predictability," Revista Economía, Fondo Editorial - Pontificia Universidad Católica del Perú, vol. 45(89), pages 150-183.
    6. Pablo Pincheira, 2008. "Combining Tests of Predictive Ability Theory and Evidence for Chilean and Canadian Exchange Rates," Working Papers Central Bank of Chile 459, Central Bank of Chile.
    7. Pincheira, Pablo & Hardy, Nicolás & Muñoz, Felipe, 2021. ""Go wild for a while!": A new asymptotically Normal test for forecast evaluation in nested models," MPRA Paper 105368, University Library of Munich, Germany.
    8. Pablo Pincheira & Nicolás Hardy & Felipe Muñoz, 2021. "“Go Wild for a While!”: A New Test for Forecast Evaluation in Nested Models," Mathematics, MDPI, vol. 9(18), pages 1-28, September.
    9. Rossi, Barbara, 2013. "Advances in Forecasting under Instability," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 2, chapter 0, pages 1203-1324, Elsevier.
    10. Kenneth S. Rogoff & Vania Stavrakeva, 2008. "The Continuing Puzzle of Short Horizon Exchange Rate Forecasting," NBER Working Papers 14071, National Bureau of Economic Research, Inc.
    11. Firmin Doko Tchatoka & Qazi Haque, 2023. "On bootstrapping tests of equal forecast accuracy for nested models," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 42(7), pages 1844-1864, November.
    12. Richard A. Ashley & Kwok Ping Tsang, 2014. "Credible Granger-Causality Inference with Modest Sample Lengths: A Cross-Sample Validation Approach," Econometrics, MDPI, vol. 2(1), pages 1-20, March.
    13. Kirstin Hubrich & Kenneth D. West, 2010. "Forecast evaluation of small nested model sets," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 25(4), pages 574-594.
    14. Brooks, Chris & Burke, Simon P. & Stanescu, Silvia, 2016. "Finite sample weighting of recursive forecast errors," International Journal of Forecasting, Elsevier, vol. 32(2), pages 458-474.
    15. Rudan Wang & Bruce Morley & Javier Ordóñez, 2016. "The Taylor Rule, Wealth Effects and the Exchange Rate," Review of International Economics, Wiley Blackwell, vol. 24(2), pages 282-301, May.
    16. Pincheira, Pablo M. & West, Kenneth D., 2016. "A comparison of some out-of-sample tests of predictability in iterated multi-step-ahead forecasts," Research in Economics, Elsevier, vol. 70(2), pages 304-319.
    17. Ferrara, Laurent & Marcellino, Massimiliano & Mogliani, Matteo, 2015. "Macroeconomic forecasting during the Great Recession: The return of non-linearity?," International Journal of Forecasting, Elsevier, vol. 31(3), pages 664-679.
    18. Raffaella Giacomini & Barbara Rossi, 2013. "Forecasting in macroeconomics," Chapters, in: Nigar Hashimzade & Michael A. Thornton (ed.), Handbook of Research Methods and Applications in Empirical Macroeconomics, chapter 17, pages 381-408, Edward Elgar Publishing.
    19. Busetti, Fabio & Marcucci, Juri, 2013. "Comparing forecast accuracy: A Monte Carlo investigation," International Journal of Forecasting, Elsevier, vol. 29(1), pages 13-27.
    20. Molodtsova, Tanya & Papell, David H., 2009. "Out-of-sample exchange rate predictability with Taylor rule fundamentals," Journal of International Economics, Elsevier, vol. 77(2), pages 167-180, April.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:chb:bcchwp:435. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Alvaro Castillo (email available below). General contact details of provider: https://edirc.repec.org/data/bccgvcl.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.