IDEAS home Printed from https://ideas.repec.org/p/bos/wpaper/wp2015-015.html
   My bibliography  Save this paper

Combining Long Memory and Level Shifts in Modeling and Forecasting the Volatility of Asset Returns

Author

Listed:
  • Rasmus T. Varneskov

    (Aarhus University and CREATES)

  • Pierre Perron

    (Boston University)

Abstract

We propose a parametric state space model of asset return volatility with an accompanying estimation and forecasting framework that allows for ARFIMA dynamics, random level shifts and measurement errors. The Kalman filter is used to construct the state-augmented likelihood function and subsequently to generate forecasts, which are mean- and path-corrected. We apply our model to eight daily volatility series constructed from both high-frequency and daily returns. Full sample parameter estimates reveal that random level shifts are present in all series. Genuine long memory is present in high-frequency measures of volatility whereas there is little remaining dynamics in the volatility measures constructed using daily returns. From extensive forecast evaluations, we find that our ARFIMA model with random level shifts consistently belongs to the 10% Model Confidence Set across a variety of forecast horizons, asset classes, and volatility measures. The gains in forecast accuracy can be very pronounced, especially at longer horizons.

Suggested Citation

  • Rasmus T. Varneskov & Pierre Perron, 2015. "Combining Long Memory and Level Shifts in Modeling and Forecasting the Volatility of Asset Returns," Boston University - Department of Economics - Working Papers Series wp2015-015, Boston University - Department of Economics.
  • Handle: RePEc:bos:wpaper:wp2015-015
    as

    Download full text from publisher

    File URL: http://people.bu.edu/perron/papers/VP-paper.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Nour Meddahi, 2003. "ARMA representation of integrated and realized variances," Econometrics Journal, Royal Economic Society, vol. 6(2), pages 335-356, December.
    2. Lobato, Ignacio N & Savin, N E, 1998. "Real and Spurious Long-Memory Properties of Stock-Market Data," Journal of Business & Economic Statistics, American Statistical Association, vol. 16(3), pages 261-268, July.
    3. Tatsuma Wada & Pierre Perron, 2006. "State Space Model with Mixtures of Normals: Specifications and Applications to International Data," Boston University - Department of Economics - Working Papers Series WP2006-029, Boston University - Department of Economics.
    4. Lu, Yang K. & Perron, Pierre, 2010. "Modeling and forecasting stock return volatility using a random level shift model," Journal of Empirical Finance, Elsevier, vol. 17(1), pages 138-156, January.
    5. Torben G. Andersen & Tim Bollerslev & Francis X. Diebold, 2007. "Roughing It Up: Including Jump Components in the Measurement, Modeling, and Forecasting of Return Volatility," The Review of Economics and Statistics, MIT Press, vol. 89(4), pages 701-720, November.
    6. Andersen, Torben G & Bollerslev, Tim, 1997. "Heterogeneous Information Arrivals and Return Volatility Dynamics: Uncovering the Long-Run in High Frequency Returns," Journal of Finance, American Finance Association, vol. 52(3), pages 975-1005, July.
    7. Granger, Clive W. J. & Hyung, Namwon, 2004. "Occasional structural breaks and long memory with an application to the S&P 500 absolute stock returns," Journal of Empirical Finance, Elsevier, vol. 11(3), pages 399-421, June.
    8. Koopman, Siem Jan & Jungbacker, Borus & Hol, Eugenie, 2005. "Forecasting daily variability of the S&P 100 stock index using historical, realised and implied volatility measurements," Journal of Empirical Finance, Elsevier, vol. 12(3), pages 445-475, June.
    9. Hansen, Peter Reinhard & Lunde, Asger, 2006. "Consistent ranking of volatility models," Journal of Econometrics, Elsevier, vol. 131(1-2), pages 97-121.
    10. Torben G. Andersen & Tim Bollerslev & Francis X. Diebold & Heiko Ebens, 2000. "The Distribution of Stock Return Volatility," NBER Working Papers 7933, National Bureau of Economic Research, Inc.
    11. Smith, Aaron, 2005. "Level Shifts and the Illusion of Long Memory in Economic Time Series," Journal of Business & Economic Statistics, American Statistical Association, vol. 23, pages 321-335, July.
    12. Martin, Vance L. & Wilkins, Nigel P., 1999. "Indirect estimation of ARFIMA and VARFIMA models," Journal of Econometrics, Elsevier, vol. 93(1), pages 149-175, November.
    13. Roxana Chiriac & Valeri Voev, 2011. "Modelling and forecasting multivariate realized volatility," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 26(6), pages 922-947, September.
    14. Grassi, Stefano & Santucci de Magistris, Paolo, 2014. "When long memory meets the Kalman filter: A comparative study," Computational Statistics & Data Analysis, Elsevier, vol. 76(C), pages 301-319.
    15. Varneskov, Rasmus & Voev, Valeri, 2013. "The role of realized ex-post covariance measures and dynamic model choice on the quality of covariance forecasts," Journal of Empirical Finance, Elsevier, vol. 20(C), pages 83-95.
    16. Harvey, Andrew C & Shephard, Neil, 1996. "Estimation of an Asymmetric Stochastic Volatility Model for Asset Returns," Journal of Business & Economic Statistics, American Statistical Association, vol. 14(4), pages 429-434, October.
    17. Sun, Yixiao & Phillips, Peter C. B., 2003. "Nonlinear log-periodogram regression for perturbed fractional processes," Journal of Econometrics, Elsevier, vol. 115(2), pages 355-389, August.
    18. Diebold, Francis X. & Inoue, Atsushi, 2001. "Long memory and regime switching," Journal of Econometrics, Elsevier, vol. 105(1), pages 131-159, November.
    19. Perron, Pierre & Qu, Zhongjun, 2010. "Long-Memory and Level Shifts in the Volatility of Stock Market Return Indices," Journal of Business & Economic Statistics, American Statistical Association, vol. 28(2), pages 275-290.
    20. Qu, Zhongjun, 2011. "A Test Against Spurious Long Memory," Journal of Business & Economic Statistics, American Statistical Association, vol. 29(3), pages 423-438.
    21. Perron, Pierre, 1989. "The Great Crash, the Oil Price Shock, and the Unit Root Hypothesis," Econometrica, Econometric Society, vol. 57(6), pages 1361-1401, November.
    22. Fulvio Corsi, 2009. "A Simple Approximate Long-Memory Model of Realized Volatility," Journal of Financial Econometrics, Oxford University Press, vol. 7(2), pages 174-196, Spring.
    23. Doornik Jurgen A & Ooms Marius, 2004. "Inference and Forecasting for ARFIMA Models With an Application to US and UK Inflation," Studies in Nonlinear Dynamics & Econometrics, De Gruyter, vol. 8(2), pages 1-25, May.
    24. Xu, Jiawen & Perron, Pierre, 2014. "Forecasting return volatility: Level shifts with varying jump probability and mean reversion," International Journal of Forecasting, Elsevier, vol. 30(3), pages 449-463.
    25. Deo, Rohit S. & Hurvich, Clifford M., 2001. "On The Log Periodogram Regression Estimator Of The Memory Parameter In Long Memory Stochastic Volatility Models," Econometric Theory, Cambridge University Press, vol. 17(4), pages 686-710, August.
    26. Ole E. Barndorff‐Nielsen & Neil Shephard, 2002. "Econometric analysis of realized volatility and its use in estimating stochastic volatility models," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 64(2), pages 253-280, May.
    27. Hansen, Peter R. & Lunde, Asger, 2014. "Estimating The Persistence And The Autocorrelation Function Of A Time Series That Is Measured With Error," Econometric Theory, Cambridge University Press, vol. 30(1), pages 60-93, February.
    28. Mccloskey, Adam & Perron, Pierre, 2013. "Memory Parameter Estimation In The Presence Of Level Shifts And Deterministic Trends," Econometric Theory, Cambridge University Press, vol. 29(6), pages 1196-1237, December.
    29. Hamilton, James D, 1989. "A New Approach to the Economic Analysis of Nonstationary Time Series and the Business Cycle," Econometrica, Econometric Society, vol. 57(2), pages 357-384, March.
    30. Clifford M. Hurvich & Eric Moulines & Philippe Soulier, 2005. "Estimating Long Memory in Volatility," Econometrica, Econometric Society, vol. 73(4), pages 1283-1328, July.
    31. Tsay, Wen-Jen & Härdle, Wolfgang Karl, 2007. "A generalized ARFIMA process with Markov-switching fractional differencing parameter," SFB 649 Discussion Papers 2007-022, Humboldt University Berlin, Collaborative Research Center 649: Economic Risk.
    32. F. M. Bandi & J. R. Russell, 2008. "Microstructure Noise, Realized Variance, and Optimal Sampling," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 75(2), pages 339-369.
    33. Zhongjun Qu & Pierre Perron, 2013. "A stochastic volatility model with random level shifts and its applications to S&P 500 and NASDAQ return indices," Econometrics Journal, Royal Economic Society, vol. 16(3), pages 309-339, October.
    34. Morten Ørregaard Nielsen, 2015. "Asymptotics for the Conditional-Sum-of-Squares Estimator in Multivariate Fractional Time-Series Models," Journal of Time Series Analysis, Wiley Blackwell, vol. 36(2), pages 154-188, March.
    35. Adam McCloskey & Jonathan B. Hill, 2017. "Parameter Estimation Robust to Low-Frequency Contamination," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 35(4), pages 598-610, October.
    36. Nunes, Luis C. & Newbold, Paul & Chung-Ming Kuan, 1996. "Spurious number of breaks," Economics Letters, Elsevier, vol. 50(2), pages 175-178, February.
    37. Baillie, Richard T., 1996. "Long memory processes and fractional integration in econometrics," Journal of Econometrics, Elsevier, vol. 73(1), pages 5-59, July.
    38. Shin S. Ikeda, 2015. "Two-Scale Realized Kernels: A Univariate Case," Journal of Financial Econometrics, Oxford University Press, vol. 13(1), pages 126-165.
    39. Lobato, Ignacio N & Savin, N E, 1998. "Real and Spurious Long-Memory Properties of Stock-Market Data: Reply," Journal of Business & Economic Statistics, American Statistical Association, vol. 16(3), pages 280-283, July.
    40. Patton, Andrew J., 2011. "Volatility forecast comparison using imperfect volatility proxies," Journal of Econometrics, Elsevier, vol. 160(1), pages 246-256, January.
    41. Vasco J. Gabriel & Luis F. Martins, 2004. "On the forecasting ability of ARFIMA models when infrequent breaks occur," Econometrics Journal, Royal Economic Society, vol. 7(2), pages 455-475, December.
    42. Pierre Perron & Zhongjun Qu, 2007. "An Analytical Evaluation of the Log-periodogram Estimate in the Presence of Level Shifts," Boston University - Department of Economics - Working Papers Series wp2007-044, Boston University - Department of Economics.
    43. Chen, Chung & Tiao, George C, 1990. "Random Level-Shift Time Series Models, ARIMA Approximations, and Level-Shift Detection," Journal of Business & Economic Statistics, American Statistical Association, vol. 8(1), pages 83-97, January.
    44. Perron, Pierre, 1990. "Testing for a Unit Root in a Time Series with a Changing Mean," Journal of Business & Economic Statistics, American Statistical Association, vol. 8(2), pages 153-162, April.
    45. Iliyan GEORGIEV, 2002. "Functional Weak Limit Theory for Rare Outlying Events," Economics Working Papers ECO2002/22, European University Institute.
    46. Nunes, Luis C. & Kuan, Chung-Ming & Newbold, Paul, 1995. "Spurious Break," Econometric Theory, Cambridge University Press, vol. 11(4), pages 736-749, August.
    47. Engle, Robert F, 1982. "Autoregressive Conditional Heteroscedasticity with Estimates of the Variance of United Kingdom Inflation," Econometrica, Econometric Society, vol. 50(4), pages 987-1007, July.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Andersen, Torben G. & Varneskov, Rasmus T., 2022. "Testing for parameter instability and structural change in persistent predictive regressions," Journal of Econometrics, Elsevier, vol. 231(2), pages 361-386.
    2. Sibbertsen, Philipp & Leschinski, Christian & Busch, Marie, 2018. "A multivariate test against spurious long memory," Journal of Econometrics, Elsevier, vol. 203(1), pages 33-49.
    3. Kruse, Robinson, 2015. "A modified test against spurious long memory," Economics Letters, Elsevier, vol. 135(C), pages 34-38.
    4. Chen, Xiaoyi & Feng, JianFen & Wang, Tianyi, 2023. "Pricing VIX futures: A framework with random level shifts," Finance Research Letters, Elsevier, vol. 52(C).
    5. Niels Haldrup & Robinson Kruse & Timo Teräsvirta & Rasmus T. Varneskov, 2013. "Unit roots, non-linearities and structural breaks," Chapters, in: Nigar Hashimzade & Michael A. Thornton (ed.), Handbook of Research Methods and Applications in Empirical Macroeconomics, chapter 4, pages 61-94, Edward Elgar Publishing.
    6. Christensen, Bent Jesper & Varneskov, Rasmus Tangsgaard, 2017. "Medium band least squares estimation of fractional cointegration in the presence of low-frequency contamination," Journal of Econometrics, Elsevier, vol. 197(2), pages 218-244.
    7. Alessio Brini & Giacomo Toscano, 2024. "SpotV2Net: Multivariate Intraday Spot Volatility Forecasting via Vol-of-Vol-Informed Graph Attention Networks," Papers 2401.06249, arXiv.org, revised Aug 2024.
    8. Abderrazak Ben Maatoug & Rim Lamouchi & Russell Davidson & Ibrahim Fatnassi, 2018. "Modelling Foreign Exchange Realized Volatility Using High Frequency Data: Long Memory versus Structural Breaks," Central European Journal of Economic Modelling and Econometrics, Central European Journal of Economic Modelling and Econometrics, vol. 10(1), pages 1-25, March.
    9. Luo, Deqing & Pang, Tao & Xu, Jiawen, 2021. "Forecasting U.S. Yield Curve Using the Dynamic Nelson–Siegel Model with Random Level Shift Parameters," Economic Modelling, Elsevier, vol. 94(C), pages 340-350.
    10. Davide Delle Monache & Stefano Grassi & Paolo Santucci de Magistris, 2017. "Does the ARFIMA really shift?," CREATES Research Papers 2017-16, Department of Economics and Business Economics, Aarhus University.
    11. Gabriel Rodríguez & Junior A. Ojeda Cunya & José Carlos Gonzáles Tanaka, 2019. "An empirical note about estimation and forecasting Latin American Forex returns volatility: the role of long memory and random level shifts components," Portuguese Economic Journal, Springer;Instituto Superior de Economia e Gestao, vol. 18(2), pages 107-123, June.
    12. Jiawen Xu & Pierre Perron, 2015. "Forecasting in the presence of in and out of sample breaks," Boston University - Department of Economics - Working Papers Series wp2015-012, Boston University - Department of Economics.
    13. Mauricio Zevallos, 2019. "A Note on Forecasting Daily Peruvian Stock Market VolatilityRisk Using Intraday Returns," Revista Economía, Fondo Editorial - Pontificia Universidad Católica del Perú, vol. 42(84), pages 94-101.
    14. Andersen, Torben G. & Varneskov, Rasmus T., 2021. "Consistent inference for predictive regressions in persistent economic systems," Journal of Econometrics, Elsevier, vol. 224(1), pages 215-244.
    15. Lahmiri, Salim & Bekiros, Stelios, 2020. "Nonlinear analysis of Casablanca Stock Exchange, Dow Jones and S&P500 industrial sectors with a comparison," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 539(C).
    16. Pierre Perron & Wendong Shi, 2020. "Temporal Aggregation and Long Memory for Asset Price Volatility," JRFM, MDPI, vol. 13(8), pages 1-18, August.
    17. Less, Vivien & Sibbertsen, Philipp, 2022. "Estimation and Testing in a Perturbed Multivariate Long Memory Framework," Hannover Economic Papers (HEP) dp-704, Leibniz Universität Hannover, Wirtschaftswissenschaftliche Fakultät.
    18. Ye Li & Pierre Perron & Jiawen Xu, 2017. "Modelling exchange rate volatility with random level shifts," Applied Economics, Taylor & Francis Journals, vol. 49(26), pages 2579-2589, June.
    19. Agie Wandala Putra & Jatna Supriatna & Raldi Hendro Koestoer & Tri Edhi Budhi Soesilo, 2021. "Differences in Local Rice Price Volatility, Climate, and Macroeconomic Determinants in the Indonesian Market," Sustainability, MDPI, vol. 13(8), pages 1-21, April.
    20. Jiawen Xu & Pierre Perron, 2023. "Forecasting in the presence of in-sample and out-of-sample breaks," Empirical Economics, Springer, vol. 64(6), pages 3001-3035, June.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Rodríguez, Gabriel, 2017. "Modeling Latin-American stock and Forex markets volatility: Empirical application of a model with random level shifts and genuine long memory," The North American Journal of Economics and Finance, Elsevier, vol. 42(C), pages 393-420.
    2. Gabriel Rodríguez, 2016. "Modeling Latin-American Stock and Forex Markets Volatility: Empirical Application of a Model with Random Level Shifts and Genuine Long Memory [Modelando la volatilidad de los mercados bursátiles y cam," Documentos de Trabajo / Working Papers 2016-416, Departamento de Economía - Pontificia Universidad Católica del Perú.
    3. Xu, Jiawen & Perron, Pierre, 2014. "Forecasting return volatility: Level shifts with varying jump probability and mean reversion," International Journal of Forecasting, Elsevier, vol. 30(3), pages 449-463.
    4. Lu, Yang K. & Perron, Pierre, 2010. "Modeling and forecasting stock return volatility using a random level shift model," Journal of Empirical Finance, Elsevier, vol. 17(1), pages 138-156, January.
    5. Perron, Pierre & Qu, Zhongjun, 2010. "Long-Memory and Level Shifts in the Volatility of Stock Market Return Indices," Journal of Business & Economic Statistics, American Statistical Association, vol. 28(2), pages 275-290.
    6. Christensen, Bent Jesper & Varneskov, Rasmus Tangsgaard, 2017. "Medium band least squares estimation of fractional cointegration in the presence of low-frequency contamination," Journal of Econometrics, Elsevier, vol. 197(2), pages 218-244.
    7. Javier Haulde & Morten Ørregaard Nielsen, 2022. "Fractional integration and cointegration," CREATES Research Papers 2022-02, Department of Economics and Business Economics, Aarhus University.
    8. Marie Busch & Philipp Sibbertsen, 2018. "An Overview of Modified Semiparametric Memory Estimation Methods," Econometrics, MDPI, vol. 6(1), pages 1-21, March.
    9. Mccloskey, Adam & Perron, Pierre, 2013. "Memory Parameter Estimation In The Presence Of Level Shifts And Deterministic Trends," Econometric Theory, Cambridge University Press, vol. 29(6), pages 1196-1237, December.
    10. Wenger, Kai & Leschinski, Christian & Sibbertsen, Philipp, 2017. "The Memory of Volatility," Hannover Economic Papers (HEP) dp-601, Leibniz Universität Hannover, Wirtschaftswissenschaftliche Fakultät.
    11. Abderrazak Ben Maatoug & Rim Lamouchi & Russell Davidson & Ibrahim Fatnassi, 2018. "Modelling Foreign Exchange Realized Volatility Using High Frequency Data: Long Memory versus Structural Breaks," Central European Journal of Economic Modelling and Econometrics, Central European Journal of Economic Modelling and Econometrics, vol. 10(1), pages 1-25, March.
    12. Gabriel Rodríguez, 2015. "Modeling Latin-American Stock Markets Volatility: Varying Probabilities and Mean Reversion in a Random Level Shifts Model," Documentos de Trabajo / Working Papers 2015-403, Departamento de Economía - Pontificia Universidad Católica del Perú.
    13. Sibbertsen, Philipp & Leschinski, Christian & Busch, Marie, 2018. "A multivariate test against spurious long memory," Journal of Econometrics, Elsevier, vol. 203(1), pages 33-49.
    14. Renzo Pardo Figueroa & Gabriel Rodríguez, 2014. "Distinguishing between True and Spurious Long Memory in the Volatility of Stock Market Returns in Latin America," Documentos de Trabajo / Working Papers 2014-395, Departamento de Economía - Pontificia Universidad Católica del Perú.
    15. Gabriel Rodríguez & Roxana Tramontana Tocto, 2015. "Application of a Short Memory Model With Random Level Shifts to the Volatility of Latin American Stock Market Returns," Latin American Journal of Economics-formerly Cuadernos de Economía, Instituto de Economía. Pontificia Universidad Católica de Chile., vol. 52(2), pages 185-211, November.
    16. Andrés Herrera Aramburú & Gabriel Rodríguez, 2016. "Volatility of stock market and exchange rate returns in Peru: Long memory or short memory with level shifts?," International Journal of Monetary Economics and Finance, Inderscience Enterprises Ltd, vol. 9(1), pages 45-66.
    17. McAleer, Michael & Medeiros, Marcelo C., 2008. "A multiple regime smooth transition Heterogeneous Autoregressive model for long memory and asymmetries," Journal of Econometrics, Elsevier, vol. 147(1), pages 104-119, November.
    18. Gabriel Rodríguez & José Carlos Gonzáles Tanaka, 2016. "An Empirical Application of a Random Level Shifts Model with Time-Varying Probability and Mean Reversion to the Volatility of Latin-American Forex Markets Returns [Una aplicación empírica de un modelo," Documentos de Trabajo / Working Papers 2016-415, Departamento de Economía - Pontificia Universidad Católica del Perú.
    19. Ata Assaf & Luis Alberiko Gil-Alana & Khaled Mokni, 2022. "True or spurious long memory in the cryptocurrency markets: evidence from a multivariate test and other Whittle estimation methods," Empirical Economics, Springer, vol. 63(3), pages 1543-1570, September.
    20. Kunal Saha & Vinodh Madhavan & Chandrashekhar G. R. & David McMillan, 2020. "Pitfalls in long memory research," Cogent Economics & Finance, Taylor & Francis Journals, vol. 8(1), pages 1733280-173, January.

    More about this item

    Keywords

    Forecasting; Kalman Filter; Long Memory Processes; State Space Modeling; Stochastic Volatility; Structural Change;
    All these keywords.

    JEL classification:

    • C13 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Estimation: General
    • C22 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Time-Series Models; Dynamic Quantile Regressions; Dynamic Treatment Effect Models; Diffusion Processes
    • C53 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Forecasting and Prediction Models; Simulation Methods

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bos:wpaper:wp2015-015. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Program Coordinator (email available below). General contact details of provider: https://edirc.repec.org/data/decbuus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.