IDEAS home Printed from https://ideas.repec.org/p/tin/wpaper/20140010.html
   My bibliography  Save this paper

Testing for Parameter Instability in Competing Modeling Frameworks

Author

Listed:
  • Francesco Calvori

    (Department of Statistics 'G. Parenti', University of Florence, Italy)

  • Drew Creal

    (Booth School of Business, University of Chicago)

  • Siem Jan Koopman

    (VU University Amsterdam)

  • Andre Lucas

    (VU University Amsterdam)

Abstract

We develop a new parameter stability test against the alternative of observation driven generalized autoregressive score dynamics. The new test generalizes the ARCH-LM test of Engle (1982) to settings beyond time-varying volatility and exploits any autocorrelation in the likelihood scores under the alternative. We compare the test's performance with that of alternative tests developed for competing time-varying parameter frameworks, such as structural breaks and observation driven parameter dynamics. The new test has higher and more stable power against alternatives with frequent regime switches or with non-local parameter driven time-variation. For parameter driven time variation close to the null or for infrequent structural changes, the test of Muller and Petalas (2010) performs best overall. We apply all tests empirically to a panel of losses given default over the period 1982--2010 and find significant evidence of parameter variation in the underlying beta distribution.

Suggested Citation

  • Francesco Calvori & Drew Creal & Siem Jan Koopman & Andre Lucas, 2014. "Testing for Parameter Instability in Competing Modeling Frameworks," Tinbergen Institute Discussion Papers 14-010/IV/DSF71, Tinbergen Institute.
    • Handle: RePEc:tin:wpaper:20140010
    as

    Download full text from publisher

    File URL: https://papers.tinbergen.nl/14010.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Drew Creal & Bernd Schwaab & Siem Jan Koopman & Andr� Lucas, 2014. "Observation-Driven Mixed-Measurement Dynamic Factor Models with an Application to Credit Risk," The Review of Economics and Statistics, MIT Press, vol. 96(5), pages 898-915, December.
    2. Fabrizio Cipollini & Robert F. Engle & Giampiero M. Gallo, 2013. "Semiparametric Vector Mem," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 28(7), pages 1067-1086, November.
    3. Lee, John H. H., 1991. "A Lagrange multiplier test for GARCH models," Economics Letters, Elsevier, vol. 37(3), pages 265-271, November.
    4. Creal, Drew & Koopman, Siem Jan & Lucas, André, 2011. "A Dynamic Multivariate Heavy-Tailed Model for Time-Varying Volatilities and Correlations," Journal of Business & Economic Statistics, American Statistical Association, vol. 29(4), pages 552-563.
    5. J. Durbin & S. J. Koopman, 2000. "Time series analysis of non‐Gaussian observations based on state space models from both classical and Bayesian perspectives," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 62(1), pages 3-56.
    6. Dong Hwan Oh & Andrew J. Patton, 2018. "Time-Varying Systemic Risk: Evidence From a Dynamic Copula Model of CDS Spreads," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 36(2), pages 181-195, April.
    7. Harvey,Andrew C., 2013. "Dynamic Models for Volatility and Heavy Tails," Cambridge Books, Cambridge University Press, number 9781107630024.
    8. Richard A. Davis, 2003. "Observation-driven models for Poisson counts," Biometrika, Biometrika Trust, vol. 90(4), pages 777-790, December.
    9. Hamilton, James D, 1989. "A New Approach to the Economic Analysis of Nonstationary Time Series and the Business Cycle," Econometrica, Econometric Society, vol. 57(2), pages 357-384, March.
    10. Zhongjun Qu & Pierre Perron, 2007. "Estimating and Testing Structural Changes in Multivariate Regressions," Econometrica, Econometric Society, vol. 75(2), pages 459-502, March.
    11. Bollerslev, Tim, 1986. "Generalized autoregressive conditional heteroskedasticity," Journal of Econometrics, Elsevier, vol. 31(3), pages 307-327, April.
    12. Engle, Robert F. & Gallo, Giampiero M., 2006. "A multiple indicators model for volatility using intra-daily data," Journal of Econometrics, Elsevier, vol. 131(1-2), pages 3-27.
    13. Bruce E. Hansen, 2001. "The New Econometrics of Structural Change: Dating Breaks in U.S. Labour Productivity," Journal of Economic Perspectives, American Economic Association, vol. 15(4), pages 117-128, Fall.
    14. Graham Elliott & Ulrich K. Muller, 2006. "Efficient Tests for General Persistent Time Variation in Regression Coefficients," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 73(4), pages 907-940.
    15. Andrews, Donald W K & Ploberger, Werner, 1994. "Optimal Tests When a Nuisance Parameter Is Present Only under the Alternative," Econometrica, Econometric Society, vol. 62(6), pages 1383-1414, November.
    16. Vogelsang, Timothy J & Perron, Pierre, 1998. "Additional Tests for a Unit Root Allowing for a Break in the Trend Function at an Unknown Time," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 39(4), pages 1073-1100, November.
    17. BAUWENS, Luc & VEREDAS, David, 1999. "The stochastic conditional duration model: a latent factor model for the analysis of financial durations," LIDAM Discussion Papers CORE 1999058, Université catholique de Louvain, Center for Operations Research and Econometrics (CORE).
    18. Jushan Bai & Pierre Perron, 2003. "Computation and analysis of multiple structural change models," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 18(1), pages 1-22.
    19. Drew Creal & Siem Jan Koopman & André Lucas, 2013. "Generalized Autoregressive Score Models With Applications," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 28(5), pages 777-795, August.
    20. Durbin, James & Koopman, Siem Jan, 2012. "Time Series Analysis by State Space Methods," OUP Catalogue, Oxford University Press, edition 2, number 9780199641178.
    21. Engle, Robert F, 1982. "Autoregressive Conditional Heteroscedasticity with Estimates of the Variance of United Kingdom Inflation," Econometrica, Econometric Society, vol. 50(4), pages 987-1007, July.
    22. Bauwens, Luc & Veredas, David, 2004. "The stochastic conditional duration model: a latent variable model for the analysis of financial durations," Journal of Econometrics, Elsevier, vol. 119(2), pages 381-412, April.
    23. Siem Jan Koopman & André Lucas & Marcel Scharth, 2016. "Predicting Time-Varying Parameters with Parameter-Driven and Observation-Driven Models," The Review of Economics and Statistics, MIT Press, vol. 98(1), pages 97-110, March.
    24. Andrews, Donald W K, 1991. "Heteroskedasticity and Autocorrelation Consistent Covariance Matrix Estimation," Econometrica, Econometric Society, vol. 59(3), pages 817-858, May.
    25. Andrews, Donald W K, 1993. "Tests for Parameter Instability and Structural Change with Unknown Change Point," Econometrica, Econometric Society, vol. 61(4), pages 821-856, July.
    26. Christian M. Hafner & Hans Manner, 2012. "Dynamic stochastic copula models: estimation, inference and applications," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 27(2), pages 269-295, March.
    27. Andrew J. Patton, 2006. "Modelling Asymmetric Exchange Rate Dependence," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 47(2), pages 527-556, May.
    28. Shephard, Neil (ed.), 2005. "Stochastic Volatility: Selected Readings," OUP Catalogue, Oxford University Press, number 9780199257201.
    29. Ploberger, Werner & Kramer, Walter & Kontrus, Karl, 1989. "A new test for structural stability in the linear regression model," Journal of Econometrics, Elsevier, vol. 40(2), pages 307-318, February.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Emilian DOBRESCU, 2017. "Modelling an Emergent Economy and Parameter Instability Problem," Journal for Economic Forecasting, Institute for Economic Forecasting, vol. 0(2), pages 5-28, June.
    2. Harvey, Andrew & Thiele, Stephen, 2016. "Testing against changing correlation," Journal of Empirical Finance, Elsevier, vol. 38(PB), pages 575-589.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Siem Jan Koopman & André Lucas & Marcel Scharth, 2016. "Predicting Time-Varying Parameters with Parameter-Driven and Observation-Driven Models," The Review of Economics and Statistics, MIT Press, vol. 98(1), pages 97-110, March.
    2. Francisco Blasques & Siem Jan Koopman & André Lucas, 2014. "Information Theoretic Optimality of Observation Driven Time Series Models," Tinbergen Institute Discussion Papers 14-046/III, Tinbergen Institute.
    3. Harvey,Andrew C., 2013. "Dynamic Models for Volatility and Heavy Tails," Cambridge Books, Cambridge University Press, number 9781107034723, September.
    4. Marco Bazzi & Francisco Blasques & Siem Jan Koopman & Andre Lucas, 2017. "Time-Varying Transition Probabilities for Markov Regime Switching Models," Journal of Time Series Analysis, Wiley Blackwell, vol. 38(3), pages 458-478, May.
    5. Mauro Bernardi & Leopoldo Catania, 2015. "Switching-GAS Copula Models With Application to Systemic Risk," Papers 1504.03733, arXiv.org, revised Jan 2016.
    6. Blasques, Francisco & Koopman, Siem Jan & Łasak, Katarzyna & Lucas, André, 2016. "In-sample confidence bands and out-of-sample forecast bands for time-varying parameters in observation-driven models," International Journal of Forecasting, Elsevier, vol. 32(3), pages 875-887.
    7. Bernardi, Mauro & Catania, Leopoldo, 2018. "Portfolio optimisation under flexible dynamic dependence modelling," Journal of Empirical Finance, Elsevier, vol. 48(C), pages 1-18.
    8. Lucas, André & Opschoor, Anne & Schaumburg, Julia, 2016. "Accounting for missing values in score-driven time-varying parameter models," Economics Letters, Elsevier, vol. 148(C), pages 96-98.
    9. Fu, Zhonghao & Hong, Yongmiao, 2019. "A model-free consistent test for structural change in regression possibly with endogeneity," Journal of Econometrics, Elsevier, vol. 211(1), pages 206-242.
    10. Blasques, Francisco & Ji, Jiangyu & Lucas, André, 2016. "Semiparametric score driven volatility models," Computational Statistics & Data Analysis, Elsevier, vol. 100(C), pages 58-69.
    11. Carlo Campajola & Domenico Di Gangi & Fabrizio Lillo & Daniele Tantari, 2020. "Modelling time-varying interactions in complex systems: the Score Driven Kinetic Ising Model," Papers 2007.15545, arXiv.org, revised Aug 2021.
    12. Drew Creal & Siem Jan Koopman & André Lucas & Marcin Zamojski, 2015. "Generalized Autoregressive Method of Moments," Tinbergen Institute Discussion Papers 15-138/III, Tinbergen Institute, revised 06 Jul 2018.
    13. Petropoulos, Fotios & Apiletti, Daniele & Assimakopoulos, Vassilios & Babai, Mohamed Zied & Barrow, Devon K. & Ben Taieb, Souhaib & Bergmeir, Christoph & Bessa, Ricardo J. & Bijak, Jakub & Boylan, Joh, 2022. "Forecasting: theory and practice," International Journal of Forecasting, Elsevier, vol. 38(3), pages 705-871.
      • Fotios Petropoulos & Daniele Apiletti & Vassilios Assimakopoulos & Mohamed Zied Babai & Devon K. Barrow & Souhaib Ben Taieb & Christoph Bergmeir & Ricardo J. Bessa & Jakub Bijak & John E. Boylan & Jet, 2020. "Forecasting: theory and practice," Papers 2012.03854, arXiv.org, revised Jan 2022.
    14. Drew Creal & Siem Jan Koopman & André Lucas, 2008. "A General Framework for Observation Driven Time-Varying Parameter Models," Tinbergen Institute Discussion Papers 08-108/4, Tinbergen Institute.
    15. Djennad, Abdelmajid & Rigby, Robert & Stasinopoulos, Dimitrios & Voudouris, Vlasios & Eilers, Paul, 2015. "Beyond location and dispersion models: The Generalized Structural Time Series Model with Applications," MPRA Paper 62807, University Library of Munich, Germany.
    16. Trojan, Sebastian, 2014. "Modeling Intraday Stochastic Volatility and Conditional Duration Contemporaneously with Regime Shifts," Economics Working Paper Series 1425, University of St. Gallen, School of Economics and Political Science.
    17. Francisco Blasques & Siem Jan Koopman & Katarzyna Lasak & André Lucas, 2015. "In-Sample Bounds for Time-Varying Parameters of Observation Driven Models," Tinbergen Institute Discussion Papers 15-027/III, Tinbergen Institute, revised 07 Sep 2015.
    18. Vêlayoudom Marimoutou & Manel Soury, 2015. "Energy Markets and CO2 Emissions: Analysis by Stochastic Copula Autoregressive Model," AMSE Working Papers 1520, Aix-Marseille School of Economics, France.
    19. Cerrato, Mario & Crosby, John & Kim, Minjoo & Zhao, Yang, 2015. "US Monetary and Fiscal Policies - Conflict or Cooperation?," SIRE Discussion Papers 2015-78, Scottish Institute for Research in Economics (SIRE).
    20. Janus, Paweł & Koopman, Siem Jan & Lucas, André, 2014. "Long memory dynamics for multivariate dependence under heavy tails," Journal of Empirical Finance, Elsevier, vol. 29(C), pages 187-206.

    More about this item

    Keywords

    time-varying parameters; observation driven models; parameter driven models; structural breaks; generalized autoregressive score model; regime switching; credit risk;
    All these keywords.

    JEL classification:

    • C12 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Hypothesis Testing: General
    • C52 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Model Evaluation, Validation, and Selection
    • C22 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Time-Series Models; Dynamic Quantile Regressions; Dynamic Treatment Effect Models; Diffusion Processes

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:tin:wpaper:20140010. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Tinbergen Office +31 (0)10-4088900 (email available below). General contact details of provider: https://edirc.repec.org/data/tinbenl.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.