IDEAS home Printed from https://ideas.repec.org/p/ems/eureir/10090.html
   My bibliography  Save this paper

Note on neural network sampling for Bayesian inference of mixture processes

Author

Listed:
  • Hoogerheide, L.F.
  • van Dijk, H.K.

Abstract

In this paper we show some further experiments with neural network sampling, a class of sampling methods that make use of neural network approximations to (posterior) densities, introduced by Hoogerheide et al. (2007). We consider a method where a mixture of Student's t densities, which can be interpreted as a neural network function, is used as a candidate density in importance sampling or the Metropolis-Hastings algorithm. It is applied to an illustrative 2-regime mixture model for the US real GNP growth rate. We explain the non-elliptical shapes of the posterior distribution, and show that the proposed method outperforms Gibbs sampling with data augmentation and the griddy Gibbs sampler.

Suggested Citation

  • Hoogerheide, L.F. & van Dijk, H.K., 2007. "Note on neural network sampling for Bayesian inference of mixture processes," Econometric Institute Research Papers EI 2007-15, Erasmus University Rotterdam, Erasmus School of Economics (ESE), Econometric Institute.
    • Handle: RePEc:ems:eureir:10090
    as

    Download full text from publisher

    File URL: https://repub.eur.nl/pub/10090/EI200715.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Geweke, John & Keane, Michael, 2007. "Smoothly mixing regressions," Journal of Econometrics, Elsevier, vol. 138(1), pages 252-290, May.
    2. Bauwens, Luc & Bos, Charles S. & van Dijk, Herman K. & van Oest, Rutger D., 2004. "Adaptive radial-based direction sampling: some flexible and robust Monte Carlo integration methods," Journal of Econometrics, Elsevier, vol. 123(2), pages 201-225, December.
    3. Hoogerheide, Lennart F. & Kaashoek, Johan F. & van Dijk, Herman K., 2007. "On the shape of posterior densities and credible sets in instrumental variable regression models with reduced rank: An application of flexible sampling methods using neural networks," Journal of Econometrics, Elsevier, vol. 139(1), pages 154-180, July.
    4. Geweke, John, 2007. "Interpretation and inference in mixture models: Simple MCMC works," Computational Statistics & Data Analysis, Elsevier, vol. 51(7), pages 3529-3550, April.
    5. Kloek, Tuen & van Dijk, Herman K, 1978. "Bayesian Estimates of Equation System Parameters: An Application of Integration by Monte Carlo," Econometrica, Econometric Society, vol. 46(1), pages 1-19, January.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Lennart Hoogerheide & Anne Opschoor & Herman K. van Dijk, 2011. "A Class of Adaptive EM-based Importance Sampling Algorithms for Efficient and Robust Posterior and Predictive Simulation," Tinbergen Institute Discussion Papers 11-004/4, Tinbergen Institute.
    2. Ardia, David & Hoogerheide, Lennart F. & van Dijk, Herman K., 2009. "Adaptive Mixture of Student-t Distributions as a Flexible Candidate Distribution for Efficient Simulation: The R Package AdMit," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 29(i03).
    3. Hoogerheide, Lennart & Opschoor, Anne & van Dijk, Herman K., 2012. "A class of adaptive importance sampling weighted EM algorithms for efficient and robust posterior and predictive simulation," Journal of Econometrics, Elsevier, vol. 171(2), pages 101-120.
    4. Ardia, David & Hoogerheide, Lennart F. & van Dijk, Herman K., 2009. "Adaptive Mixture of Student-t Distributions as a Flexible Candidate Distribution for Efficient Simulation: The R Package AdMit," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 29(i03).
    5. Lennart Hoogerheide & Herman K. van Dijk, 2008. "Possibly Ill-behaved Posteriors in Econometric Models," Tinbergen Institute Discussion Papers 08-036/4, Tinbergen Institute, revised 18 Apr 2008.
    6. Hoogerheide, L.F. & van Dijk, H.K. & van Oest, R.D., 2007. "Simulation based bayesian econometric inference: principles and some recent computational advances," Econometric Institute Research Papers EI 2007-03, Erasmus University Rotterdam, Erasmus School of Economics (ESE), Econometric Institute.
    7. Dellaportas, Petros & Tsionas, Mike G., 2019. "Importance sampling from posterior distributions using copula-like approximations," Journal of Econometrics, Elsevier, vol. 210(1), pages 45-57.
    8. David Ardia & Lennart Hoogerheide & Herman K. van Dijk, 2009. "To Bridge, to Warp or to Wrap? A Comparative Study of Monte Carlo Methods for Efficient Evaluation of Marginal Likelihoods," Tinbergen Institute Discussion Papers 09-017/4, Tinbergen Institute.
    9. Ardia, David & Hoogerheide, Lennart F., 2010. "Efficient Bayesian estimation and combination of GARCH-type models," MPRA Paper 22919, University Library of Munich, Germany.
    10. Ardia, David & Baştürk, Nalan & Hoogerheide, Lennart & van Dijk, Herman K., 2012. "A comparative study of Monte Carlo methods for efficient evaluation of marginal likelihood," Computational Statistics & Data Analysis, Elsevier, vol. 56(11), pages 3398-3414.
    11. repec:jss:jstsof:29:i03 is not listed on IDEAS
    12. Jensen, Mark J. & Maheu, John M., 2010. "Bayesian semiparametric stochastic volatility modeling," Journal of Econometrics, Elsevier, vol. 157(2), pages 306-316, August.
    13. Tsionas, Mike G., 2019. "Multi-objective optimization using statistical models," European Journal of Operational Research, Elsevier, vol. 276(1), pages 364-378.
    14. Baştürk, Nalan & Grassi, Stefano & Hoogerheide, Lennart & Opschoor, Anne & van Dijk, Herman K., 2017. "The R Package MitISEM: Efficient and Robust Simulation Procedures for Bayesian Inference," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 79(i01).
    15. Keane, Michael & Stavrunova, Olena, 2016. "Adverse selection, moral hazard and the demand for Medigap insurance," Journal of Econometrics, Elsevier, vol. 190(1), pages 62-78.
    16. Hoogerheide, Lennart & van Dijk, Herman K., 2010. "Bayesian forecasting of Value at Risk and Expected Shortfall using adaptive importance sampling," International Journal of Forecasting, Elsevier, vol. 26(2), pages 231-247, April.
    17. Burda Martin & Maheu John M., 2013. "Bayesian adaptively updated Hamiltonian Monte Carlo with an application to high-dimensional BEKK GARCH models," Studies in Nonlinear Dynamics & Econometrics, De Gruyter, vol. 17(4), pages 345-372, September.
    18. de Pooter, M.D. & Ravazzolo, F. & Segers, R. & van Dijk, H.K., 2008. "Bayesian near-boundary analysis in basic macroeconomic time series models," Econometric Institute Research Papers EI 2008-13, Erasmus University Rotterdam, Erasmus School of Economics (ESE), Econometric Institute.
    19. Rodney Strachan & Herman K. van Dijk, "undated". "Bayesian Model Averaging in Vector Autoregressive Processes with an Investigation of Stability of the US Great Ratios and Risk of a Liquidity Trap in the USA, UK and Japan," MRG Discussion Paper Series 1407, School of Economics, University of Queensland, Australia.
    20. Nalan Baştürk & Stefano Grassi & Lennart Hoogerheide & Herman K. Van Dijk, 2016. "Parallelization Experience with Four Canonical Econometric Models Using ParMitISEM," Econometrics, MDPI, vol. 4(1), pages 1-20, March.
    21. Villani, Mattias & Kohn, Robert & Giordani, Paolo, 2007. "Nonparametric Regression Density Estimation Using Smoothly Varying Normal Mixtures," Working Paper Series 211, Sveriges Riksbank (Central Bank of Sweden).

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:ems:eureir:10090. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: RePub (email available below). General contact details of provider: https://edirc.repec.org/data/feeurnl.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.