IDEAS home Printed from https://ideas.repec.org/p/tin/wpaper/20150042.html
   My bibliography  Save this paper

The R-package MitISEM: Efficient and Robust Simulation Procedures for Bayesian Inference

Author

Listed:
  • Nalan Basturk

    (Maastricht University , the Netherlands)

  • Stefano Grassi

    (University of Kent, United Kingdom)

  • Lennart Hoogerheide

    (VU University Amsterdam, the Netherlands)

  • Anne Opschoor

    (VU University Amsterdam, the Netherlands)

  • Herman K. van Dijk

    (Erasmus University Rotterdam, the Netherlands)

Abstract

This paper presents the R-package MitISEM (mixture of t by importance sampling weighted expectation maximization) which provides an automatic and flexible two-stage method to approximate a non-elliptical target density kernel -- typically a posterior density kernel -- using an adaptive mixture of Student- t densities as approximating density. In the first stage a mixture of Student- t densities is fitted to the target using an expectation maximization (EM) algorithm where each step of the optimization procedure is weighted using importance sampling. In the second stage this mixture density is a candidate density for efficient and robust application of importance sampling or the Metropolis-Hastings (MH) method to estimate properties of the target distribution. The package enables Bayesian inference and prediction on model parameters and probabilities, in particular, for models where densities have multi-modal or other non-elliptical shapes like curved ridges. These shapes occur in research topics in several scientific fields. For instance, analysis of DNA data in bio-informatics, obtaining loans in the banking sector by heterogeneous groups in financial economics and analysis of education's effect on earned income in labor economics. The package MitISEM provides also an extended algorithm, 'sequential MitISEM', which substantially decreases computation time when the target density has to be approximated for increasing data samples.

Suggested Citation

  • Nalan Basturk & Stefano Grassi & Lennart Hoogerheide & Anne Opschoor & Herman K. van Dijk, 2015. "The R-package MitISEM: Efficient and Robust Simulation Procedures for Bayesian Inference," Tinbergen Institute Discussion Papers 15-042/III, Tinbergen Institute, revised 04 Jul 2017.
  • Handle: RePEc:tin:wpaper:20150042
    as

    Download full text from publisher

    File URL: https://papers.tinbergen.nl/15042.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Geweke, John, 1989. "Bayesian Inference in Econometric Models Using Monte Carlo Integration," Econometrica, Econometric Society, vol. 57(6), pages 1317-1339, November.
    2. Ausin, Maria Concepcion & Galeano, Pedro, 2007. "Bayesian estimation of the Gaussian mixture GARCH model," Computational Statistics & Data Analysis, Elsevier, vol. 51(5), pages 2636-2652, February.
    3. Koop,Gary & Poirier,Dale J. & Tobias,Justin L., 2007. "Bayesian Econometric Methods," Cambridge Books, Cambridge University Press, number 9780521671736, June.
    4. Charles S. Bos & Ronald J. Mahieu & Herman K. Van Dijk, 2000. "Daily exchange rate behaviour and hedging of currency risk," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 15(6), pages 671-696.
    5. Hoogerheide, Lennart & Opschoor, Anne & van Dijk, Herman K., 2012. "A class of adaptive importance sampling weighted EM algorithms for efficient and robust posterior and predictive simulation," Journal of Econometrics, Elsevier, vol. 171(2), pages 101-120.
    6. Kleibergen, Frank & van Dijk, Herman K., 1998. "Bayesian Simultaneous Equations Analysis Using Reduced Rank Structures," Econometric Theory, Cambridge University Press, vol. 14(6), pages 701-743, December.
    7. Ardia, David & Hoogerheide, Lennart F. & van Dijk, Herman K., 2009. "Adaptive Mixture of Student-t Distributions as a Flexible Candidate Distribution for Efficient Simulation: The R Package AdMit," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 29(i03).
    8. Chan,Joshua & Koop,Gary & Poirier,Dale J. & Tobias,Justin L., 2019. "Bayesian Econometric Methods," Cambridge Books, Cambridge University Press, number 9781108437493, September.
    9. Arnold Zellner & Tomohiro Ando & Nalan Baştük & Lennart Hoogerheide & Herman K. van Dijk, 2014. "Bayesian Analysis of Instrumental Variable Models: Acceptance-Rejection within Direct Monte Carlo," Econometric Reviews, Taylor & Francis Journals, vol. 33(1-4), pages 3-35, June.
    10. Ardia, David & Hoogerheide, Lennart F. & van Dijk, Herman K., 2008. "AdMit: Adaptive Mixtures of Student-t Distributions," DQE Working Papers 10, Department of Quantitative Economics, University of Freiburg/Fribourg Switzerland, revised 07 Jan 2009.
    11. Hoogerheide, Lennart F. & Kaashoek, Johan F. & van Dijk, Herman K., 2007. "On the shape of posterior densities and credible sets in instrumental variable regression models with reduced rank: An application of flexible sampling methods using neural networks," Journal of Econometrics, Elsevier, vol. 139(1), pages 154-180, July.
    12. Kloek, Tuen & van Dijk, Herman K, 1978. "Bayesian Estimates of Equation System Parameters: An Application of Integration by Monte Carlo," Econometrica, Econometric Society, vol. 46(1), pages 1-19, January.
    13. Jana Eklund & Sune Karlsson, 2007. "Forecast Combination and Model Averaging Using Predictive Measures," Econometric Reviews, Taylor & Francis Journals, vol. 26(2-4), pages 329-363.
    14. Bowden,Roger J. & Turkington,Darrell A., 1990. "Instrumental Variables," Cambridge Books, Cambridge University Press, number 9780521385824, September.
    15. van Dijk, H. K. & Hop, J. P. & Louter, A. S., 1986. "An Algorithm For The Computation Of Posterior Moments And Densities Using Simple Importance Sampling," Econometric Institute Archives 272354, Erasmus University Rotterdam.
    16. Chan,Joshua & Koop,Gary & Poirier,Dale J. & Tobias,Justin L., 2019. "Bayesian Econometric Methods," Cambridge Books, Cambridge University Press, number 9781108423380, September.
    17. Martin, Andrew D. & Quinn, Kevin M. & Park, Jong Hee, 2011. "MCMCpack: Markov Chain Monte Carlo in R," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 42(i09).
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Baştürk, N. & Borowska, A. & Grassi, S. & Hoogerheide, L. & van Dijk, H.K., 2019. "Forecast density combinations of dynamic models and data driven portfolio strategies," Journal of Econometrics, Elsevier, vol. 210(1), pages 170-186.
    2. Ivan Mendieta-Munoz & Mengheng Li, 2019. "The Multivariate Simultaneous Unobserved Compenents Model and Identification via Heteroskedasticity," Working Paper Series, Department of Economics, University of Utah 2019_06, University of Utah, Department of Economics.
    3. Dellaportas, Petros & Tsionas, Mike G., 2019. "Importance sampling from posterior distributions using copula-like approximations," Journal of Econometrics, Elsevier, vol. 210(1), pages 45-57.
    4. Geweke, John & Durham, Garland, 2019. "Sequentially adaptive Bayesian learning algorithms for inference and optimization," Journal of Econometrics, Elsevier, vol. 210(1), pages 4-25.
    5. Nalan Basturk & Stefano Grassi & Lennart Hoogerheide & Herman K. van Dijk, 2016. "Time-varying Combinations of Bayesian Dynamic Models and Equity Momentum Strategies," Tinbergen Institute Discussion Papers 16-099/III, Tinbergen Institute.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Nalan Basturk & Cem Cakmakli & S. Pinar Ceyhan & Herman K. van Dijk, 2013. "Historical Developments in Bayesian Econometrics after Cowles Foundation Monographs 10, 14," Tinbergen Institute Discussion Papers 13-191/III, Tinbergen Institute.
    2. Nalan Basturk & Cem Cakmakli & S. Pinar Ceyhan & Herman K. van Dijk, 2014. "On the Rise of Bayesian Econometrics after Cowles Foundation Monographs 10, 14," Tinbergen Institute Discussion Papers 14-085/III, Tinbergen Institute, revised 04 Sep 2014.
    3. Nalan Basturk & Lennart Hoogerheide & Anne Opschoor & Herman K. van Dijk, 2012. "The R Package MitISEM: Mixture of Student-t Distributions using Importance Sampling Weighted Expectation Maximization for Efficient and Robust Simulation," Tinbergen Institute Discussion Papers 12-096/III, Tinbergen Institute.
    4. Nalan Baştürk & Stefano Grassi & Lennart Hoogerheide & Herman K. Van Dijk, 2016. "Parallelization Experience with Four Canonical Econometric Models Using ParMitISEM," Econometrics, MDPI, vol. 4(1), pages 1-20, March.
    5. Ardia, David & Baştürk, Nalan & Hoogerheide, Lennart & van Dijk, Herman K., 2012. "A comparative study of Monte Carlo methods for efficient evaluation of marginal likelihood," Computational Statistics & Data Analysis, Elsevier, vol. 56(11), pages 3398-3414.
    6. Dellaportas, Petros & Tsionas, Mike G., 2019. "Importance sampling from posterior distributions using copula-like approximations," Journal of Econometrics, Elsevier, vol. 210(1), pages 45-57.
    7. Ardia, David & Hoogerheide, Lennart F., 2010. "Efficient Bayesian estimation and combination of GARCH-type models," MPRA Paper 22919, University Library of Munich, Germany.
    8. Geweke, John & Durham, Garland, 2019. "Sequentially adaptive Bayesian learning algorithms for inference and optimization," Journal of Econometrics, Elsevier, vol. 210(1), pages 4-25.
    9. Lennart Hoogerheide & Herman K. van Dijk, 2008. "Possibly Ill-behaved Posteriors in Econometric Models," Tinbergen Institute Discussion Papers 08-036/4, Tinbergen Institute, revised 18 Apr 2008.
    10. David Ardia & Lennart Hoogerheide & Herman K. van Dijk, 2009. "To Bridge, to Warp or to Wrap? A Comparative Study of Monte Carlo Methods for Efficient Evaluation of Marginal Likelihoods," Tinbergen Institute Discussion Papers 09-017/4, Tinbergen Institute.
    11. Hoogerheide, Lennart & van Dijk, Herman K., 2010. "Bayesian forecasting of Value at Risk and Expected Shortfall using adaptive importance sampling," International Journal of Forecasting, Elsevier, vol. 26(2), pages 231-247, April.
    12. Maksym, Obrizan, 2010. "A Bayesian Model of Sample Selection with a Discrete Outcome Variable," MPRA Paper 28577, University Library of Munich, Germany.
    13. Lennart Hoogerheide & Anne Opschoor & Herman K. van Dijk, 2011. "A Class of Adaptive EM-based Importance Sampling Algorithms for Efficient and Robust Posterior and Predictive Simulation," Tinbergen Institute Discussion Papers 11-004/4, Tinbergen Institute.
    14. Hoogerheide, Lennart & Opschoor, Anne & van Dijk, Herman K., 2012. "A class of adaptive importance sampling weighted EM algorithms for efficient and robust posterior and predictive simulation," Journal of Econometrics, Elsevier, vol. 171(2), pages 101-120.
    15. Ardia, David & Hoogerheide, Lennart F. & van Dijk, Herman K., 2009. "Adaptive Mixture of Student-t Distributions as a Flexible Candidate Distribution for Efficient Simulation: The R Package AdMit," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 29(i03).
    16. Ardia, David & Hoogerheide, Lennart F. & van Dijk, Herman K., 2009. "Adaptive Mixture of Student-t Distributions as a Flexible Candidate Distribution for Efficient Simulation: The R Package AdMit," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 29(i03).
    17. Hoogerheide, Lennart F. & Kaashoek, Johan F. & van Dijk, Herman K., 2007. "On the shape of posterior densities and credible sets in instrumental variable regression models with reduced rank: An application of flexible sampling methods using neural networks," Journal of Econometrics, Elsevier, vol. 139(1), pages 154-180, July.
    18. Agbeyegbe, Terence D., 2020. "Bayesian analysis of output gap in Barbados," Latin American Journal of Central Banking (previously Monetaria), Elsevier, vol. 1(1).
    19. van Dijk Herman K., 2024. "Challenges and Opportunities for Twenty First Century Bayesian Econometricians: A Personal View," Studies in Nonlinear Dynamics & Econometrics, De Gruyter, vol. 28(2), pages 155-176, April.
    20. Adnan Haider Bukhari & Safdar Ullah Khan, 2008. "A Small Open Economy DSGE Model for Pakistan," The Pakistan Development Review, Pakistan Institute of Development Economics, vol. 47(4), pages 963-1008.

    More about this item

    Keywords

    finite mixtures; Student-t densities; importance sampling; MCMC; Metropolis-Hastings algorithm; expectation maximization; Bayesian inference; R-software;
    All these keywords.

    JEL classification:

    • C01 - Mathematical and Quantitative Methods - - General - - - Econometrics
    • C11 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Bayesian Analysis: General
    • C87 - Mathematical and Quantitative Methods - - Data Collection and Data Estimation Methodology; Computer Programs - - - Econometric Software

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:tin:wpaper:20150042. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Tinbergen Office +31 (0)10-4088900 (email available below). General contact details of provider: https://edirc.repec.org/data/tinbenl.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.