IDEAS home Printed from https://ideas.repec.org/p/azt/cemmap/13-12.html
   My bibliography  Save this paper

Model comparisons in unstable environments

Author

Listed:
  • Raffaella Giacomini
  • Barbara Rossi

Abstract

The goal of this paper is to develop formal tests to evaluate the relative in-sample performance of two competing, misspecified non-nested models in the presence of possible data instability. Compared to previous approaches to model selection, which are based on measures of global performance, we focus on the local relative performance of the models. We propose three tests that are based on different measures of local performance and that correspond to different null and alternative hypotheses. The empirical application provides insights into the time variation in the performance of a representative DSGE model of the European economy relative to that of VARs.

Suggested Citation

  • Raffaella Giacomini & Barbara Rossi, 2012. "Model comparisons in unstable environments," CeMMAP working papers 13/12, Institute for Fiscal Studies.
    • Handle: RePEc:azt:cemmap:13/12
    DOI: 10.1920/wp.cem.2012.1312
    as

    Download full text from publisher

    File URL: https://www.cemmap.ac.uk/wp-content/uploads/2020/08/CWP1312.pdf
    Download Restriction: no
    File URL: https://libkey.io/10.1920/wp.cem.2012.1312?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Wei Biao Wu & Zhibiao Zhao, 2007. "Inference of trends in time series," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 69(3), pages 391-410, June.
    2. Rossi, Barbara, 2005. "Optimal Tests For Nested Model Selection With Underlying Parameter Instability," Econometric Theory, Cambridge University Press, vol. 21(5), pages 962-990, October.
    3. Graham Elliott & Ulrich K. Muller, 2006. "Efficient Tests for General Persistent Time Variation in Regression Coefficients," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 73(4), pages 907-940.
    4. Andrews, Donald W K & Ploberger, Werner, 1994. "Optimal Tests When a Nuisance Parameter Is Present Only under the Alternative," Econometrica, Econometric Society, vol. 62(6), pages 1383-1414, November.
    5. Vuong, Quang H, 1989. "Likelihood Ratio Tests for Model Selection and Non-nested Hypotheses," Econometrica, Econometric Society, vol. 57(2), pages 307-333, March.
    6. Andrews, Donald W K, 1993. "Tests for Parameter Instability and Structural Change with Unknown Change Point," Econometrica, Econometric Society, vol. 61(4), pages 821-856, July.
    7. Zhongjun Qu & Pierre Perron, 2007. "Estimating and Testing Structural Changes in Multivariate Regressions," Econometrica, Econometric Society, vol. 75(2), pages 459-502, March.
    8. Wooldridge, Jeffrey M. & White, Halbert, 1988. "Some Invariance Principles and Central Limit Theorems for Dependent Heterogeneous Processes," Econometric Theory, Cambridge University Press, vol. 4(2), pages 210-230, August.
    9. Cavaliere, Giuseppe & Taylor, A.M. Robert, 2005. "Stationarity Tests Under Time-Varying Second Moments," Econometric Theory, Cambridge University Press, vol. 21(6), pages 1112-1129, December.
    10. Frank Smets & Raf Wouters, 2003. "An Estimated Dynamic Stochastic General Equilibrium Model of the Euro Area," Journal of the European Economic Association, MIT Press, vol. 1(5), pages 1123-1175, September.
    11. Douglas Rivers & Quang Vuong, 2002. "Model selection tests for nonlinear dynamic models," Econometrics Journal, Royal Economic Society, vol. 5(1), pages 1-39, June.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Raffaella Giacomini & Barbara Rossi, 2016. "Model Comparisons In Unstable Environments," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 57(2), pages 369-392, May.
    2. Armand, Alex & Carneiro, Pedro & Locatelli, Andrea & Mihreteab, Selam & Keating, Joseph, 2017. "Do public health interventions crowd out private health investments? Malaria control policies in Eritrea," Labour Economics, Elsevier, vol. 45(C), pages 107-115.
    3. Rossi, Barbara, 2013. "Advances in Forecasting under Instability," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 2, chapter 0, pages 1203-1324, Elsevier.
    4. Alaa Abi Morshed & Elena Andreou & Otilia Boldea, 2018. "Structural Break Tests Robust to Regression Misspecification," Econometrics, MDPI, vol. 6(2), pages 1-39, May.
    5. Pierre Perron & Yohei Yamamoto, 2022. "Structural change tests under heteroskedasticity: Joint estimation versus two‐steps methods," Journal of Time Series Analysis, Wiley Blackwell, vol. 43(3), pages 389-411, May.
    6. Abhimanyu Gupta & Myung Hwan Seo, 2023. "Robust Inference on Infinite and Growing Dimensional Time‐Series Regression," Econometrica, Econometric Society, vol. 91(4), pages 1333-1361, July.
    7. Alessandro Casini & Pierre Perron, 2018. "Structural Breaks in Time Series," Boston University - Department of Economics - Working Papers Series WP2019-02, Boston University - Department of Economics.
    8. Yin, Anwen, 2015. "Forecasting and model averaging with structural breaks," ISU General Staff Papers 201501010800005727, Iowa State University, Department of Economics.
    9. Alessandro Casini, 2018. "Tests for Forecast Instability and Forecast Failure under a Continuous Record Asymptotic Framework," Papers 1803.10883, arXiv.org, revised Dec 2018.
    10. Eiji Kurozumi & Yohei Yamamoto, 2015. "Confidence sets for the break date based on optimal tests," Econometrics Journal, Royal Economic Society, vol. 18(3), pages 412-435, October.
    11. Francesco Calvori & Drew Creal & Siem Jan Koopman & Andre Lucas, 2014. "Testing for Parameter Instability in Competing Modeling Frameworks," Tinbergen Institute Discussion Papers 14-010/IV/DSF71, Tinbergen Institute.
    12. Fu, Zhonghao & Hong, Yongmiao, 2019. "A model-free consistent test for structural change in regression possibly with endogeneity," Journal of Econometrics, Elsevier, vol. 211(1), pages 206-242.
    13. Leandro M. Magnusson & Sophocles Mavroeidis, 2014. "Identification Using Stability Restrictions," Econometrica, Econometric Society, vol. 82(5), pages 1799-1851, September.
    14. Hyeongwoo Kim & Ying Lin & Henry Thompson, 2021. "Exchange Rate Pass-Through to Consumer Prices: The Increasing Role of Energy Prices," Open Economies Review, Springer, vol. 32(2), pages 395-415, April.
    15. Hidalgo, Javier & Schafgans, Marcia, 2017. "Inference and testing breaks in large dynamic panels with strong cross sectional dependence," Journal of Econometrics, Elsevier, vol. 196(2), pages 259-274.
    16. P. Byrne, Joseph & Cao, Shuo & Korobilis, Dimitris, 2015. "Term Structure Dynamics, Macro-Finance Factors and Model Uncertainty," SIRE Discussion Papers 2015-71, Scottish Institute for Research in Economics (SIRE).
    17. Otilia Boldea & Alastair R. Hall, 2013. "Testing structural stability in macroeconometric models," Chapters, in: Nigar Hashimzade & Michael A. Thornton (ed.), Handbook of Research Methods and Applications in Empirical Macroeconomics, chapter 9, pages 206-228, Edward Elgar Publishing.
    18. Rossi, Barbara, 2006. "Are Exchange Rates Really Random Walks? Some Evidence Robust To Parameter Instability," Macroeconomic Dynamics, Cambridge University Press, vol. 10(1), pages 20-38, February.
    19. Smith, Simon C. & Timmermann, Allan & Zhu, Yinchu, 2019. "Variable selection in panel models with breaks," Journal of Econometrics, Elsevier, vol. 212(1), pages 323-344.
    20. Geweke, J. & Joel Horowitz & Pesaran, M.H., 2006. "Econometrics: A Bird’s Eye View," Cambridge Working Papers in Economics 0655, Faculty of Economics, University of Cambridge.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:azt:cemmap:13/12. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Dermot Watson (email available below). General contact details of provider: https://edirc.repec.org/data/ifsssuk.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.