IDEAS home Printed from https://ideas.repec.org/p/bno/worpap/2015_12.html
   My bibliography  Save this paper

Dynamic predictive density combinations for large data sets in economics and finance

Author

Listed:
  • Roberto Casarin

    (University Ca’ Foscari of Venice)

  • Stefano Grassi

    (University of Kent)

  • Francesco Ravazzolo

    (Norges Bank (Central Bank of Norway) and Centre for Applied Macro and Petroleum economics at BI Norwegian Business School)

  • Herman K. van Dijk

    (Econometric Institute Erasmus University Rotterdam, Econometrics Department VU University Amsterdam and Tinbergen Institute)

Abstract

A Bayesian nonparametric predictive model is introduced to construct time-varying weighted combinations of a large set of predictive densities. A clustering mechanism allocates these densities into a smaller number of mutually exclusive subsets. Using properties of the Aitchinson’s geometry of the simplex, combination weights are defined with a probabilistic interpretation. The classpreserving property of the logistic-normal distribution is used to define a compositional dynamic factor model for the weight dynamics with latent factors defined on a reduced dimension simplex. Groups of predictive models with combination weights are updated with parallel clustering and sequential Monte Carlo filters. The procedure is applied to predict Standard & Poor’s 500 index using more than 7000 predictive densities based on US individual stocks and finds substantial forecast and economic gains. Similar forecast gains are obtained in point and density forecasting of US real GDP, Inflation, Treasury Bill yield and employment using a large data set.

Suggested Citation

  • Roberto Casarin & Stefano Grassi & Francesco Ravazzolo & Herman K. van Dijk, 2015. "Dynamic predictive density combinations for large data sets in economics and finance," Working Paper 2015/12, Norges Bank.
  • Handle: RePEc:bno:worpap:2015_12
    as

    Download full text from publisher

    File URL: http://www.norges-bank.no/en/Published/Papers/Working-Papers/2015/122015/
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Hyunyoung Choi & Hal Varian, 2012. "Predicting the Present with Google Trends," The Economic Record, The Economic Society of Australia, vol. 88(s1), pages 2-9, June.
    2. Ravazzolo Francesco & Vahey Shaun P., 2014. "Forecast densities for economic aggregates from disaggregate ensembles," Studies in Nonlinear Dynamics & Econometrics, De Gruyter, vol. 18(4), pages 367-381, September.
    3. Marta Banbura & Domenico Giannone & Lucrezia Reichlin, 2010. "Large Bayesian vector auto regressions," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 25(1), pages 71-92.
    4. Kapetanios, G. & Mitchell, J. & Price, S. & Fawcett, N., 2015. "Generalised density forecast combinations," Journal of Econometrics, Elsevier, vol. 188(1), pages 150-165.
    5. Christian Kascha & Francesco Ravazzolo, 2010. "Combining inflation density forecasts," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 29(1-2), pages 231-250.
    6. Del Negro, Marco & Hasegawa, Raiden B. & Schorfheide, Frank, 2016. "Dynamic prediction pools: An investigation of financial frictions and forecasting performance," Journal of Econometrics, Elsevier, vol. 192(2), pages 391-405.
    7. Billio, Monica & Casarin, Roberto & Ravazzolo, Francesco & van Dijk, Herman K., 2013. "Time-varying combinations of predictive densities using nonlinear filtering," Journal of Econometrics, Elsevier, vol. 177(2), pages 213-232.
    8. Clark, Todd E. & McCracken, Michael W., 2015. "Nested forecast model comparisons: A new approach to testing equal accuracy," Journal of Econometrics, Elsevier, vol. 186(1), pages 160-177.
    9. Stock, James H. & Watson, Mark W., 2014. "Estimating turning points using large data sets," Journal of Econometrics, Elsevier, vol. 178(P2), pages 368-381.
    10. Jan J. J. Groen & Richard Paap & Francesco Ravazzolo, 2013. "Real-Time Inflation Forecasting in a Changing World," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 31(1), pages 29-44, January.
    11. Geweke, John & Keane, Michael, 2007. "Smoothly mixing regressions," Journal of Econometrics, Elsevier, vol. 138(1), pages 252-290, May.
    12. Amisano, Gianni & Giacomini, Raffaella, 2007. "Comparing Density Forecasts via Weighted Likelihood Ratio Tests," Journal of Business & Economic Statistics, American Statistical Association, vol. 25, pages 177-190, April.
    13. Conflitti, Cristina & De Mol, Christine & Giannone, Domenico, 2015. "Optimal combination of survey forecasts," International Journal of Forecasting, Elsevier, vol. 31(4), pages 1096-1103.
    14. Watson, Mark W. & Stock, James H., 2014. "Estimating turning points using large data sets," Scholarly Articles 33192198, Harvard University Department of Economics.
    15. Knut Are Aastveit & Francesco Ravazzolo & Herman K. van Dijk, 2018. "Combined Density Nowcasting in an Uncertain Economic Environment," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 36(1), pages 131-145, January.
    16. Stock, James H. & Watson, Mark W., 1999. "Forecasting inflation," Journal of Monetary Economics, Elsevier, vol. 44(2), pages 293-335, October.
    17. Bassetti, Federico & Casarin, Roberto & Leisen, Fabrizio, 2014. "Beta-product dependent Pitman–Yor processes for Bayesian inference," Journal of Econometrics, Elsevier, vol. 180(1), pages 49-72.
    18. Koop, Gary & Korobilis, Dimitris, 2013. "Large time-varying parameter VARs," Journal of Econometrics, Elsevier, vol. 177(2), pages 185-198.
    19. Villani, Mattias & Kohn, Robert & Giordani, Paolo, 2009. "Regression density estimation using smooth adaptive Gaussian mixtures," Journal of Econometrics, Elsevier, vol. 153(2), pages 155-173, December.
    20. Aldrich, Eric M. & Fernández-Villaverde, Jesús & Ronald Gallant, A. & Rubio-Ramírez, Juan F., 2011. "Tapping the supercomputer under your desk: Solving dynamic equilibrium models with graphics processors," Journal of Economic Dynamics and Control, Elsevier, vol. 35(3), pages 386-393, March.
    21. Mathur, Sudhanshu & Morozov, Sergei, 2009. "Massively Parallel Computation Using Graphics Processors with Application to Optimal Experimentation in Dynamic Control," MPRA Paper 16721, University Library of Munich, Germany.
    22. James H. Stock & Mark W. Watson, 2005. "Implications of Dynamic Factor Models for VAR Analysis," NBER Working Papers 11467, National Bureau of Economic Research, Inc.
    23. Sally A. Wood, 2002. "Bayesian mixture of splines for spatially adaptive nonparametric regression," Biometrika, Biometrika Trust, vol. 89(3), pages 513-528, August.
    24. Marcellino, Massimiliano & Stock, James H. & Watson, Mark W., 2006. "A comparison of direct and iterated multistep AR methods for forecasting macroeconomic time series," Journal of Econometrics, Elsevier, vol. 135(1-2), pages 499-526.
    25. Dr. James Mitchell, 2005. "Evaluating, comparing and combining density forecasts using the KLIC with an application to the Bank of England and NIESR ÔfanÕ charts of inflation," National Institute of Economic and Social Research (NIESR) Discussion Papers 253, National Institute of Economic and Social Research.
    26. Sergei Morozov & Sudhanshu Mathur, 2012. "Massively Parallel Computation Using Graphics Processors with Application to Optimal Experimentation in Dynamic Control," Computational Economics, Springer;Society for Computational Economics, vol. 40(2), pages 151-182, August.
    27. Diebold, Francis X & Mariano, Roberto S, 2002. "Comparing Predictive Accuracy," Journal of Business & Economic Statistics, American Statistical Association, vol. 20(1), pages 134-144, January.
    28. Knut Are Aastveit & Karsten R. Gerdrup & Anne Sofie Jore & Leif Anders Thorsrud, 2014. "Nowcasting GDP in Real Time: A Density Combination Approach," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 32(1), pages 48-68, January.
    29. Koop, Gary & Korobilis, Dimitris, 2010. "Bayesian Multivariate Time Series Methods for Empirical Macroeconomics," Foundations and Trends(R) in Econometrics, now publishers, vol. 3(4), pages 267-358, July.
    30. Marta Banbura & Domenico Giannone & Lucrezia Reichlin, 2010. "Large Bayesian vector auto regressions," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 25(1), pages 71-92.
    31. James Mitchell & Stephen G. Hall, 2005. "Evaluating, Comparing and Combining Density Forecasts Using the KLIC with an Application to the Bank of England and NIESR ‘Fan’ Charts of Inflation," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 67(s1), pages 995-1033, December.
    32. Waggoner, Daniel F. & Zha, Tao, 2012. "Confronting model misspecification in macroeconomics," Journal of Econometrics, Elsevier, vol. 171(2), pages 167-184.
    33. Mark W. Watson & James H. Stock, 2004. "Combination forecasts of output growth in a seven-country data set," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 23(6), pages 405-430.
    34. Stock J.H. & Watson M.W., 2002. "Forecasting Using Principal Components From a Large Number of Predictors," Journal of the American Statistical Association, American Statistical Association, vol. 97, pages 1167-1179, December.
    35. Billheimer D. & Guttorp P. & Fagan W.F., 2001. "Statistical Interpretation of Species Composition," Journal of the American Statistical Association, American Statistical Association, vol. 96, pages 1205-1214, December.
    36. Matt Dziubinski & Stefano Grassi, 2014. "Heterogeneous Computing in Economics: A Simplified Approach," Computational Economics, Springer;Society for Computational Economics, vol. 43(4), pages 485-495, April.
    37. Andrews, Donald W K & Monahan, J Christopher, 1992. "An Improved Heteroskedasticity and Autocorrelation Consistent Covariance Matrix Estimator," Econometrica, Econometric Society, vol. 60(4), pages 953-966, July.
    38. Casarin, Roberto & Grassi, Stefano & Ravazzolo, Francesco & van Dijk, Herman K., 2015. "Parallel Sequential Monte Carlo for Efficient Density Combination: The DeCo MATLAB Toolbox," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 68(i03).
    39. Aldrich, EM, 2014. "GPU Computing in Economics," Santa Cruz Department of Economics, Working Paper Series qt8p12748g, Department of Economics, UC Santa Cruz.
    40. Gneiting, Tilmann & Raftery, Adrian E., 2007. "Strictly Proper Scoring Rules, Prediction, and Estimation," Journal of the American Statistical Association, American Statistical Association, vol. 102, pages 359-378, March.
    41. repec:ulb:ulbeco:2013/13388 is not listed on IDEAS
    42. James H. Stock & Mark W. Watson, 2012. "Disentangling the Channels of the 2007-09 Recession," Brookings Papers on Economic Activity, Economic Studies Program, The Brookings Institution, vol. 43(1 (Spring), pages 81-156.
    43. Dr. James Mitchell, 2005. "Evaluating, comparing and combining density forecasts using the KLIC with an application to the Bank of England and NIESR ÔfanÕ charts of inflation," National Institute of Economic and Social Research (NIESR) Discussion Papers 253, National Institute of Economic and Social Research.
    44. James H. Stock & Mark W. Watson, 2012. "Disentangling the Channels of the 2007-09 Recession," Brookings Papers on Economic Activity, Economic Studies Program, The Brookings Institution, vol. 44(1 (Spring), pages 81-156.
    45. Hall, Stephen G. & Mitchell, James, 2007. "Combining density forecasts," International Journal of Forecasting, Elsevier, vol. 23(1), pages 1-13.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Monica Billio & Roberto Casarin & Enrica De Cian & Malcolm Mistry & Anthony Osuntuyi, 2020. "The impact of Climate on Economic and Financial Cycles: A Markov-switching Panel Approach," Papers 2012.14693, arXiv.org.
    2. Casarin, Roberto & Grassi, Stefano & Ravazzolo, Francesco & van Dijk, Herman K., 2015. "Parallel Sequential Monte Carlo for Efficient Density Combination: The DeCo MATLAB Toolbox," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 68(i03).
    3. Ferrari, Davide & Ravazzolo, Francesco & Vespignani, Joaquin, 2021. "Forecasting energy commodity prices: A large global dataset sparse approach," Energy Economics, Elsevier, vol. 98(C).
    4. Leopoldo Catania, 2016. "Dynamic Adaptive Mixture Models," Papers 1603.01308, arXiv.org, revised Jan 2023.
    5. Roberto Casarin & Fausto Corradin & Francesco Ravazzolo & Nguyen Domenico Sartore, 2020. "A Scoring Rule for Factor and Autoregressive Models Under Misspecification," Advances in Decision Sciences, Asia University, Taiwan, vol. 24(2), pages 66-103, June.
    6. repec:bny:wpaper:0083 is not listed on IDEAS
    7. Roberto Casarin & Stefano Grassi & Francesco Ravazzolo & Herman K. van Dijk, 2019. "Forecast density combinations with dynamic learning for large data sets in economics and finance," Working Paper 2019/7, Norges Bank.
    8. Roberto Casarin & Fausto Corradin & Francesco Ravazzolo & Nguyen Domenico Sartore & Wing-Keung Wong, 2020. "A Scoring Rule for Factor and Autoregressive Models Under Misspecification," Advances in Decision Sciences, Asia University, Taiwan, vol. 24(2), pages 66-103, June.
    9. Nalan Baştürk & Roberto Casarin & Francesco Ravazzolo & Herman K. Van Dijk, 2016. "Computational Complexity and Parallelization in Bayesian Econometric Analysis," Econometrics, MDPI, vol. 4(1), pages 1-3, February.
    10. Roberto Casarin & Giulia Mantoan & Francesco Ravazzolo, 2016. "Bayesian Calibration of Generalized Pools of Predictive Distributions," Econometrics, MDPI, vol. 4(1), pages 1-24, March.
    11. Nalan Basturk & Stefano Grassi & Lennart Hoogerheide & Herman K. van Dijk, 2016. "Time-varying Combinations of Bayesian Dynamic Models and Equity Momentum Strategies," Tinbergen Institute Discussion Papers 16-099/III, Tinbergen Institute.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Roberto Casarin & Stefano Grassi & Francesco Ravazzolo & Herman K. van Dijk, 2020. "A Bayesian Dynamic Compositional Model for Large Density Combinations in Finance," Working Paper series 20-27, Rimini Centre for Economic Analysis.
    2. Federico Bassetti & Roberto Casarin & Francesco Ravazzolo, 2019. "Density Forecasting," BEMPS - Bozen Economics & Management Paper Series BEMPS59, Faculty of Economics and Management at the Free University of Bozen.
    3. Roberto Casarin & Fausto Corradin & Francesco Ravazzolo & Nguyen Domenico Sartore & Wing-Keung Wong, 2020. "A Scoring Rule for Factor and Autoregressive Models Under Misspecification," Advances in Decision Sciences, Asia University, Taiwan, vol. 24(2), pages 66-103, June.
    4. Barbara Rossi, 2019. "Forecasting in the presence of instabilities: How do we know whether models predict well and how to improve them," Economics Working Papers 1711, Department of Economics and Business, Universitat Pompeu Fabra, revised Jul 2021.
    5. Roberto Casarin & Stefano Grassi & Francesco Ravazzolo & Herman K. van Dijk, 2019. "Forecast density combinations with dynamic learning for large data sets in economics and finance," Working Paper 2019/7, Norges Bank.
    6. Casarin, Roberto & Grassi, Stefano & Ravazzolo, Francesco & van Dijk, Herman K., 2023. "A flexible predictive density combination for large financial data sets in regular and crisis periods," Journal of Econometrics, Elsevier, vol. 237(2).
    7. repec:bny:wpaper:0037 is not listed on IDEAS
    8. Knut Are Aastveit & Francesco Ravazzolo & Herman K. van Dijk, 2018. "Combined Density Nowcasting in an Uncertain Economic Environment," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 36(1), pages 131-145, January.
    9. Davide Pettenuzzo & Francesco Ravazzolo, 2016. "Optimal Portfolio Choice Under Decision‐Based Model Combinations," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 31(7), pages 1312-1332, November.
    10. Knut Are Aastveit & James Mitchell & Francesco Ravazzolo & Herman van Dijk, 2018. "The Evolution of Forecast Density Combinations in Economics," Tinbergen Institute Discussion Papers 18-069/III, Tinbergen Institute.
    11. repec:bny:wpaper:0021 is not listed on IDEAS
    12. Berg, Tim O. & Henzel, Steffen R., 2015. "Point and density forecasts for the euro area using Bayesian VARs," International Journal of Forecasting, Elsevier, vol. 31(4), pages 1067-1095.
    13. repec:bny:wpaper:0029 is not listed on IDEAS
    14. McAlinn, Kenichiro & West, Mike, 2019. "Dynamic Bayesian predictive synthesis in time series forecasting," Journal of Econometrics, Elsevier, vol. 210(1), pages 155-169.
    15. Petropoulos, Fotios & Apiletti, Daniele & Assimakopoulos, Vassilios & Babai, Mohamed Zied & Barrow, Devon K. & Ben Taieb, Souhaib & Bergmeir, Christoph & Bessa, Ricardo J. & Bijak, Jakub & Boylan, Joh, 2022. "Forecasting: theory and practice," International Journal of Forecasting, Elsevier, vol. 38(3), pages 705-871.
      • Fotios Petropoulos & Daniele Apiletti & Vassilios Assimakopoulos & Mohamed Zied Babai & Devon K. Barrow & Souhaib Ben Taieb & Christoph Bergmeir & Ricardo J. Bessa & Jakub Bijak & John E. Boylan & Jet, 2020. "Forecasting: theory and practice," Papers 2012.03854, arXiv.org, revised Jan 2022.
    16. Billio, Monica & Casarin, Roberto & Ravazzolo, Francesco & van Dijk, Herman K., 2013. "Time-varying combinations of predictive densities using nonlinear filtering," Journal of Econometrics, Elsevier, vol. 177(2), pages 213-232.
    17. Anne Opschoor & Dick van Dijk & Michel van der Wel, 2014. "Improving Density Forecasts and Value-at-Risk Estimates by Combining Densities," Tinbergen Institute Discussion Papers 14-090/III, Tinbergen Institute.
    18. Gael M. Martin & David T. Frazier & Ruben Loaiza-Maya & Florian Huber & Gary Koop & John Maheu & Didier Nibbering & Anastasios Panagiotelis, 2023. "Bayesian Forecasting in the 21st Century: A Modern Review," Monash Econometrics and Business Statistics Working Papers 1/23, Monash University, Department of Econometrics and Business Statistics.
    19. repec:bny:wpaper:0073 is not listed on IDEAS
    20. Tommaso Proietti & Martyna Marczak & Gianluigi Mazzi, 2017. "Euromind‐ D : A Density Estimate of Monthly Gross Domestic Product for the Euro Area," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 32(3), pages 683-703, April.
    21. Marcus P. A. Cobb, 2020. "Aggregate density forecasting from disaggregate components using Bayesian VARs," Empirical Economics, Springer, vol. 58(1), pages 287-312, January.
    22. Tony Chernis & Taylor Webley, 2022. "Nowcasting Canadian GDP with Density Combinations," Discussion Papers 2022-12, Bank of Canada.
    23. Fabio Busetti, 2017. "Quantile Aggregation of Density Forecasts," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 79(4), pages 495-512, August.
    24. Martin, Gael M. & Frazier, David T. & Maneesoonthorn, Worapree & Loaiza-Maya, Rubén & Huber, Florian & Koop, Gary & Maheu, John & Nibbering, Didier & Panagiotelis, Anastasios, 2024. "Bayesian forecasting in economics and finance: A modern review," International Journal of Forecasting, Elsevier, vol. 40(2), pages 811-839.

    More about this item

    Keywords

    Density Combination; Large Set of Predictive Densities; Compositional Factor Models; Nonlinear State Space; Bayesian Inference; GPU Computing;
    All these keywords.

    JEL classification:

    • C11 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Bayesian Analysis: General
    • C15 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Statistical Simulation Methods: General
    • C53 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Forecasting and Prediction Models; Simulation Methods
    • E37 - Macroeconomics and Monetary Economics - - Prices, Business Fluctuations, and Cycles - - - Forecasting and Simulation: Models and Applications

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bno:worpap:2015_12. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: the person in charge (email available below). General contact details of provider: https://edirc.repec.org/data/nbgovno.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.