IDEAS home Printed from https://ideas.repec.org/p/arx/papers/1912.03100.html
   My bibliography  Save this paper

Triple the gamma -- A unifying shrinkage prior for variance and variable selection in sparse state space and TVP models

Author

Listed:
  • Annalisa Cadonna
  • Sylvia Fruhwirth-Schnatter
  • Peter Knaus

Abstract

Time-varying parameter (TVP) models are very flexible in capturing gradual changes in the effect of a predictor on the outcome variable. However, in particular when the number of predictors is large, there is a known risk of overfitting and poor predictive performance, since the effect of some predictors is constant over time. We propose a prior for variance shrinkage in TVP models, called triple gamma. The triple gamma prior encompasses a number of priors that have been suggested previously, such as the Bayesian lasso, the double gamma prior and the Horseshoe prior. We present the desirable properties of such a prior and its relationship to Bayesian Model Averaging for variance selection. The features of the triple gamma prior are then illustrated in the context of time varying parameter vector autoregressive models, both for simulated datasets and for a series of macroeconomics variables in the Euro Area.

Suggested Citation

  • Annalisa Cadonna & Sylvia Fruhwirth-Schnatter & Peter Knaus, 2019. "Triple the gamma -- A unifying shrinkage prior for variance and variable selection in sparse state space and TVP models," Papers 1912.03100, arXiv.org.
  • Handle: RePEc:arx:papers:1912.03100
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/1912.03100
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Cottet, Remy & Kohn, Robert J. & Nott, David J., 2008. "Variable Selection and Model Averaging in Semiparametric Overdispersed Generalized Linear Models," Journal of the American Statistical Association, American Statistical Association, vol. 103, pages 661-671, June.
    2. Bitto, Angela & Frühwirth-Schnatter, Sylvia, 2019. "Achieving shrinkage in a time-varying parameter model framework," Journal of Econometrics, Elsevier, vol. 210(1), pages 75-97.
    3. P. J. Brown & M. Vannucci & T. Fearn, 2002. "Bayes model averaging with selection of regressors," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 64(3), pages 519-536, August.
    4. Park, Trevor & Casella, George, 2008. "The Bayesian Lasso," Journal of the American Statistical Association, American Statistical Association, vol. 103, pages 681-686, June.
    5. Martin Feldkircher & Luis Gruber & Florian Huber & Gregor Kastner, 2017. "Sophisticated and small versus simple and sizeable: When does it pay off to introduce drifting coefficients in Bayesian VARs?," Papers 1711.00564, arXiv.org, revised Mar 2024.
    6. Nicholas G. Polson & James G. Scott, 2012. "Local shrinkage rules, Lévy processes and regularized regression," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 74(2), pages 287-311, March.
    7. Miguel A.G. Belmonte & Gary Koop & Dimitris Korobilis, 2014. "Hierarchical Shrinkage in Time‐Varying Parameter Models," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 33(1), pages 80-94, January.
    8. Carlos M. Carvalho & Nicholas G. Polson & James G. Scott, 2010. "The horseshoe estimator for sparse signals," Biometrika, Biometrika Trust, vol. 97(2), pages 465-480.
    9. Jacquier, Eric & Polson, Nicholas G & Rossi, Peter E, 2002. "Bayesian Analysis of Stochastic Volatility Models," Journal of Business & Economic Statistics, American Statistical Association, vol. 20(1), pages 69-87, January.
    10. Jacquier, Eric & Polson, Nicholas G & Rossi, Peter E, 1994. "Bayesian Analysis of Stochastic Volatility Models: Comments: Reply," Journal of Business & Economic Statistics, American Statistical Association, vol. 12(4), pages 413-417, October.
    11. Richard Kleijn & Herman K. van Dijk, 2006. "Bayes model averaging of cyclical decompositions in economic time series," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 21(2), pages 191-212.
    12. Frühwirth-Schnatter, Sylvia & Wagner, Helga, 2010. "Stochastic model specification search for Gaussian and partial non-Gaussian state space models," Journal of Econometrics, Elsevier, vol. 154(1), pages 85-100, January.
    13. Joshua C. C. Chan & Eric Eisenstat, 2018. "Bayesian model comparison for time‐varying parameter VARs with stochastic volatility," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 33(4), pages 509-532, June.
    14. repec:cup:cbooks:9780521835954 is not listed on IDEAS
    15. Jouchi Nakajima, 2011. "Time-Varying Parameter VAR Model with Stochastic Volatility: An Overview of Methodology and Empirical Applications," Monetary and Economic Studies, Institute for Monetary and Economic Studies, Bank of Japan, vol. 29, pages 107-142, November.
    16. Xavier Sala-I-Martin & Gernot Doppelhofer & Ronald I. Miller, 2004. "Determinants of Long-Term Growth: A Bayesian Averaging of Classical Estimates (BACE) Approach," American Economic Review, American Economic Association, vol. 94(4), pages 813-835, September.
    17. Koop, Gary & Korobilis, Dimitris, 2013. "Large time-varying parameter VARs," Journal of Econometrics, Elsevier, vol. 177(2), pages 185-198.
    18. Giorgio E. Primiceri, 2005. "Time Varying Structural Vector Autoregressions and Monetary Policy," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 72(3), pages 821-852.
    19. Eric Eisenstat & Joshua C. C. Chan & Rodney W. Strachan, 2016. "Stochastic Model Specification Search for Time-Varying Parameter VARs," Econometric Reviews, Taylor & Francis Journals, vol. 35(8-10), pages 1638-1665, December.
    20. Marco Del Negro & Giorgio E. Primiceri, 2015. "Time Varying Structural Vector Autoregressions and Monetary Policy: A Corrigendum," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 82(4), pages 1342-1345.
    21. Gary Koop & Simon Potter, 2004. "Forecasting in dynamic factor models using Bayesian model averaging," Econometrics Journal, Royal Economic Society, vol. 7(2), pages 550-565, December.
    22. Scheipl, Fabian & Kneib, Thomas, 2009. "Locally adaptive Bayesian P-splines with a Normal-Exponential-Gamma prior," Computational Statistics & Data Analysis, Elsevier, vol. 53(10), pages 3533-3552, August.
    23. Carriero, Andrea & Clark, Todd E. & Marcellino, Massimiliano, 2019. "Large Bayesian vector autoregressions with stochastic volatility and non-conjugate priors," Journal of Econometrics, Elsevier, vol. 212(1), pages 137-154.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Michael Pfarrhofer, 2024. "Forecasts with Bayesian vector autoregressions under real time conditions," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 43(3), pages 771-801, April.
    2. Yong Song & Tomasz Wo'zniak, 2020. "Markov Switching," Papers 2002.03598, arXiv.org.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Sylvia Fruhwirth-Schnatter & Peter Knaus, 2022. "Sparse Bayesian State-Space and Time-Varying Parameter Models," Papers 2207.12147, arXiv.org.
    2. Hauzenberger, Niko, 2021. "Flexible Mixture Priors for Large Time-varying Parameter Models," Econometrics and Statistics, Elsevier, vol. 20(C), pages 87-108.
    3. Annalisa Cadonna & Sylvia Frühwirth-Schnatter & Peter Knaus, 2020. "Triple the Gamma—A Unifying Shrinkage Prior for Variance and Variable Selection in Sparse State Space and TVP Models," Econometrics, MDPI, vol. 8(2), pages 1-36, May.
    4. Bitto, Angela & Frühwirth-Schnatter, Sylvia, 2019. "Achieving shrinkage in a time-varying parameter model framework," Journal of Econometrics, Elsevier, vol. 210(1), pages 75-97.
    5. Pfarrhofer, Michael, 2023. "Measuring International Uncertainty Using Global Vector Autoregressions with Drifting Parameters," Macroeconomic Dynamics, Cambridge University Press, vol. 27(3), pages 770-793, April.
    6. Niko Hauzenberger, 2020. "Flexible Mixture Priors for Large Time-varying Parameter Models," Papers 2006.10088, arXiv.org, revised Nov 2020.
    7. Joshua C.C. Chan & Rodney W. Strachan, 2023. "Bayesian State Space Models In Macroeconometrics," Journal of Economic Surveys, Wiley Blackwell, vol. 37(1), pages 58-75, February.
    8. Niaz Bashiri Behmiri & Maryam Ahmadi & Juha-Pekka Junttila & Matteo Manera, 2021. "Financial Stress and Basis in Energy Markets," The Energy Journal, , vol. 42(5), pages 67-88, September.
    9. Legrand, Romain, 2018. "Time-Varying Vector Autoregressions: Efficient Estimation, Random Inertia and Random Mean," MPRA Paper 88925, University Library of Munich, Germany.
    10. Reusens Peter & Croux Christophe, 2017. "Detecting time variation in the price puzzle: a less informative prior choice for time varying parameter VAR models," Studies in Nonlinear Dynamics & Econometrics, De Gruyter, vol. 21(4), pages 1-18, September.
    11. Gael M. Martin & David T. Frazier & Ruben Loaiza-Maya & Florian Huber & Gary Koop & John Maheu & Didier Nibbering & Anastasios Panagiotelis, 2023. "Bayesian Forecasting in the 21st Century: A Modern Review," Monash Econometrics and Business Statistics Working Papers 1/23, Monash University, Department of Econometrics and Business Statistics.
    12. Marta Banbura & Andries van Vlodrop, 2018. "Forecasting with Bayesian Vector Autoregressions with Time Variation in the Mean," Tinbergen Institute Discussion Papers 18-025/IV, Tinbergen Institute.
    13. Michael Pfarrhofer, 2024. "Forecasts with Bayesian vector autoregressions under real time conditions," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 43(3), pages 771-801, April.
    14. Yu Bai & Andrea Carriero & Todd E. Clark & Massimiliano Marcellino, 2022. "Macroeconomic forecasting in a multi‐country context," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 37(6), pages 1230-1255, September.
    15. Peter Knaus & Sylvia Fruhwirth-Schnatter, 2023. "The Dynamic Triple Gamma Prior as a Shrinkage Process Prior for Time-Varying Parameter Models," Papers 2312.10487, arXiv.org.
    16. Zheng, Tingguo & Ye, Shiqi & Hong, Yongmiao, 2023. "Fast estimation of a large TVP-VAR model with score-driven volatilities," Journal of Economic Dynamics and Control, Elsevier, vol. 157(C).
    17. Belomestny, Denis & Krymova, Ekaterina & Polbin, Andrey, 2021. "Bayesian TVP-VARX models with time invariant long-run multipliers," Economic Modelling, Elsevier, vol. 101(C).
    18. Gregor Kastner & Florian Huber, 2020. "Sparse Bayesian vector autoregressions in huge dimensions," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 39(7), pages 1142-1165, November.
    19. Chan, Joshua C.C. & Eisenstat, Eric & Strachan, Rodney W., 2020. "Reducing the state space dimension in a large TVP-VAR," Journal of Econometrics, Elsevier, vol. 218(1), pages 105-118.
    20. Luis Gruber & Gregor Kastner, 2022. "Forecasting macroeconomic data with Bayesian VARs: Sparse or dense? It depends!," Papers 2206.04902, arXiv.org, revised Nov 2024.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:1912.03100. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.