IDEAS home Printed from https://ideas.repec.org/p/ems/eureir/1722.html
   My bibliography  Save this paper

Adaptive radial-based direction sampling; Some flexible and robust Monte Carlo integration methods

Author

Listed:
  • Bauwens, L.
  • Bos, C.S.
  • van Dijk, H.K.
  • van Oest, R.D.

Abstract

Adaptive radial-based direction sampling (ARDS) algorithms are specified for Bayesian analysis of models with nonelliptical, possibly, multimodal target distributions. A key step is a radial-based transformation to directions and distances. After the transformations a Metropolis-Hastings method or, alternatively, an importance sampling method is applied to evaluate generated directions. Next, distances are generated from the exact target distribution by means of the numerical inverse transformation method. An adaptive procedure is applied to update the initial location and covariance matrix in order to sample directions in an efficient way. Tested on a set of canonical mixture models that feature multimodality, strong correlation, and skewness, the ARDS algorithms compare favourably with the standard Metropolis-Hastings and importance samplers in terms of flexibility and robustness. The empirical examples include a regression model with scale contamination and a mixture model for economic growth of the USA.

Suggested Citation

  • Bauwens, L. & Bos, C.S. & van Dijk, H.K. & van Oest, R.D., 2003. "Adaptive radial-based direction sampling; Some flexible and robust Monte Carlo integration methods," Econometric Institute Research Papers EI 2003-22, Erasmus University Rotterdam, Erasmus School of Economics (ESE), Econometric Institute.
    • Handle: RePEc:ems:eureir:1722
    as

    Download full text from publisher

    File URL: https://repub.eur.nl/pub/1722/feweco20030806161348.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Kleibergen, Frank & van Dijk, Herman K., 1994. "On the Shape of the Likelihood/Posterior in Cointegration Models," Econometric Theory, Cambridge University Press, vol. 10(3-4), pages 514-551, August.
    2. Hop, J Peter & Van Dijk, Herman K, 1992. "SISAM and MIXIN: Two Algorithms for the Computation of Posterior Moments and Densities Using Monte Carlo Integration," Computer Science in Economics & Management, Kluwer;Society for Computational Economics, vol. 5(3), pages 183-220, August.
    3. Van Dijk, Herman K. & Kloek, Teun & Boender, C. Guus E., 1985. "Posterior moments computed by mixed integration," Journal of Econometrics, Elsevier, vol. 29(1-2), pages 3-18.
    4. John Geweke, 1999. "Using Simulation Methods for Bayesian Econometric Models," Computing in Economics and Finance 1999 832, Society for Computational Economics.
    5. Kleibergen, Frank & van Dijk, Herman K., 1998. "Bayesian Simultaneous Equations Analysis Using Reduced Rank Structures," Econometric Theory, Cambridge University Press, vol. 14(6), pages 701-743, December.
    6. Koop, Gary & Dijk, Herman K. Van, 2000. "Testing for integration using evolving trend and seasonals models: A Bayesian approach," Journal of Econometrics, Elsevier, vol. 97(2), pages 261-291, August.
    7. Bauwens, L. & Bos, C.S. & van Dijk, H.K. & van Oest, R.D., 2002. "Adaptive polar sampling, a class of flexibel and robust Monte Carlo integration methods," Econometric Institute Research Papers EI 2002-27, Erasmus University Rotterdam, Erasmus School of Economics (ESE), Econometric Institute.
    8. van Dijk, H. K. & Kloek, T., 1980. "Further experience in Bayesian analysis using Monte Carlo integration," Journal of Econometrics, Elsevier, vol. 14(3), pages 307-328, December.
    9. Geweke, John, 1989. "Bayesian Inference in Econometric Models Using Monte Carlo Integration," Econometrica, Econometric Society, vol. 57(6), pages 1317-1339, November.
    10. Luc Bauwens & Charles S. Bos & Herman K. van Dijk & Rutger D. van Oest, 2002. "Adaptive Polar Sampling," Computing in Economics and Finance 2002 307, Society for Computational Economics.
    11. Roberts, G. O. & Gilks, W. R., 1994. "Convergence of Adaptive Direction Sampling," Journal of Multivariate Analysis, Elsevier, vol. 49(2), pages 287-298, May.
    12. Fruhwirth-Schnatter S., 2001. "Markov Chain Monte Carlo Estimation of Classical and Dynamic Switching and Mixture Models," Journal of the American Statistical Association, American Statistical Association, vol. 96, pages 194-209, March.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. L. Bauwens & J.V.K. Rombouts, 2007. "Bayesian inference for the mixed conditional heteroskedasticity model," Econometrics Journal, Royal Economic Society, vol. 10(2), pages 408-425, July.
    2. Hoogerheide, Lennart F. & Kaashoek, Johan F. & van Dijk, Herman K., 2007. "On the shape of posterior densities and credible sets in instrumental variable regression models with reduced rank: An application of flexible sampling methods using neural networks," Journal of Econometrics, Elsevier, vol. 139(1), pages 154-180, July.
    3. Tsionas, Mike G., 2019. "Multi-objective optimization using statistical models," European Journal of Operational Research, Elsevier, vol. 276(1), pages 364-378.
    4. Burda Martin & Maheu John M., 2013. "Bayesian adaptively updated Hamiltonian Monte Carlo with an application to high-dimensional BEKK GARCH models," Studies in Nonlinear Dynamics & Econometrics, De Gruyter, vol. 17(4), pages 345-372, September.
    5. Hoogerheide, L.F. & Kaashoek, J.F. & van Dijk, H.K., 2004. "Neural network based approximations to posterior densities: a class of flexible sampling methods with applications to reduced rank models," Econometric Institute Research Papers EI 2004-19, Erasmus University Rotterdam, Erasmus School of Economics (ESE), Econometric Institute.
    6. Bauwens, L. & Bos, C.S. & van Dijk, H.K. & van Oest, R.D., 2003. "Explaining Adaptive Radial-Based Direction Sampling," Econometric Institute Research Papers EI 2003-37, Erasmus University Rotterdam, Erasmus School of Economics (ESE), Econometric Institute.
    7. Hoogerheide, L.F. & van Dijk, H.K. & van Oest, R.D., 2007. "Simulation based bayesian econometric inference: principles and some recent computational advances," Econometric Institute Research Papers EI 2007-03, Erasmus University Rotterdam, Erasmus School of Economics (ESE), Econometric Institute.
    8. Waggoner, Daniel F. & Wu, Hongwei & Zha, Tao, 2016. "Striated Metropolis–Hastings sampler for high-dimensional models," Journal of Econometrics, Elsevier, vol. 192(2), pages 406-420.
    9. McCausland, William J., 2008. "On Bayesian analysis and computation for functions with monotonicity and curvature restrictions," Journal of Econometrics, Elsevier, vol. 142(1), pages 484-507, January.
    10. Ardia, David & Baştürk, Nalan & Hoogerheide, Lennart & van Dijk, Herman K., 2012. "A comparative study of Monte Carlo methods for efficient evaluation of marginal likelihood," Computational Statistics & Data Analysis, Elsevier, vol. 56(11), pages 3398-3414.
    11. Rodney Strachan & Herman K. van Dijk, "undated". "Bayesian Model Averaging in Vector Autoregressive Processes with an Investigation of Stability of the US Great Ratios and Risk of a Liquidity Trap in the USA, UK and Japan," MRG Discussion Paper Series 1407, School of Economics, University of Queensland, Australia.
    12. Dellaportas, Petros & Tsionas, Mike G., 2019. "Importance sampling from posterior distributions using copula-like approximations," Journal of Econometrics, Elsevier, vol. 210(1), pages 45-57.
    13. Hoogerheide, L.F. & van Dijk, H.K., 2007. "Note on neural network sampling for Bayesian inference of mixture processes," Econometric Institute Research Papers EI 2007-15, Erasmus University Rotterdam, Erasmus School of Economics (ESE), Econometric Institute.
    14. David Ardia & Lennart Hoogerheide & Herman K. van Dijk, 2009. "To Bridge, to Warp or to Wrap? A Comparative Study of Monte Carlo Methods for Efficient Evaluation of Marginal Likelihoods," Tinbergen Institute Discussion Papers 09-017/4, Tinbergen Institute.
    15. Martin Burda & John Maheu, 2011. "Bayesian Adaptive Hamiltonian Monte Carlo with an Application to High-Dimensional BEKK GARCH Models," Working Papers tecipa-438, University of Toronto, Department of Economics.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Lennart F. Hoogerheide & Johan F. Kaashoek, 2004. "Functional Approximations to Likelihoods/Posterior Densities: A Neural Network Approach to Efficient Sampling," Computing in Economics and Finance 2004 74, Society for Computational Economics.
    2. Luc Bauwens & Charles S. Bos & Herman K. van Dijk, 1999. "Adaptive Polar Sampling with an Application to a Bayes Measure of Value-at-Risk," Tinbergen Institute Discussion Papers 99-082/4, Tinbergen Institute.
    3. de Pooter, M.D. & Ravazzolo, F. & Segers, R. & van Dijk, H.K., 2008. "Bayesian near-boundary analysis in basic macroeconomic time series models," Econometric Institute Research Papers EI 2008-13, Erasmus University Rotterdam, Erasmus School of Economics (ESE), Econometric Institute.
    4. Hoogerheide, Lennart F. & Kaashoek, Johan F. & van Dijk, Herman K., 2007. "On the shape of posterior densities and credible sets in instrumental variable regression models with reduced rank: An application of flexible sampling methods using neural networks," Journal of Econometrics, Elsevier, vol. 139(1), pages 154-180, July.
    5. Hoogerheide, L.F. & van Dijk, H.K. & van Oest, R.D., 2007. "Simulation based bayesian econometric inference: principles and some recent computational advances," Econometric Institute Research Papers EI 2007-03, Erasmus University Rotterdam, Erasmus School of Economics (ESE), Econometric Institute.
    6. de Pooter, M.D. & Segers, R. & van Dijk, H.K., 2006. "Gibbs sampling in econometric practice," Econometric Institute Research Papers EI 2006-13, Erasmus University Rotterdam, Erasmus School of Economics (ESE), Econometric Institute.
    7. Hoogerheide, L.F. & Kaashoek, J.F. & van Dijk, H.K., 2002. "Functional approximations to posterior densities: a neural network approach to efficient sampling," Econometric Institute Research Papers EI 2002-48, Erasmus University Rotterdam, Erasmus School of Economics (ESE), Econometric Institute.
    8. Ardia, David & Baştürk, Nalan & Hoogerheide, Lennart & van Dijk, Herman K., 2012. "A comparative study of Monte Carlo methods for efficient evaluation of marginal likelihood," Computational Statistics & Data Analysis, Elsevier, vol. 56(11), pages 3398-3414.
    9. Nalan Basturk & Cem Cakmakli & S. Pinar Ceyhan & Herman K. van Dijk, 2014. "On the Rise of Bayesian Econometrics after Cowles Foundation Monographs 10, 14," Tinbergen Institute Discussion Papers 14-085/III, Tinbergen Institute, revised 04 Sep 2014.
    10. van Dijk, H.K., 2002. "On Bayesian structural inference in a simultaneous equation model," Econometric Institute Research Papers EI 2002-10, Erasmus University Rotterdam, Erasmus School of Economics (ESE), Econometric Institute.
    11. Lennart Hoogerheide & Herman K. van Dijk, 2008. "Possibly Ill-behaved Posteriors in Econometric Models," Tinbergen Institute Discussion Papers 08-036/4, Tinbergen Institute, revised 18 Apr 2008.
    12. Michiel D. de Pooter & René Segers & Herman K. van Dijk, 2006. "On the Practice of Bayesian Inference in Basic Economic Time Series Models using Gibbs Sampling," Tinbergen Institute Discussion Papers 06-076/4, Tinbergen Institute.
    13. Dellaportas, Petros & Tsionas, Mike G., 2019. "Importance sampling from posterior distributions using copula-like approximations," Journal of Econometrics, Elsevier, vol. 210(1), pages 45-57.
    14. Nalan Basturk & Cem Cakmakli & S. Pinar Ceyhan & Herman K. van Dijk, 2013. "Historical Developments in Bayesian Econometrics after Cowles Foundation Monographs 10, 14," Tinbergen Institute Discussion Papers 13-191/III, Tinbergen Institute.
    15. Villani, Mattias, 2006. "Bayesian point estimation of the cointegration space," Journal of Econometrics, Elsevier, vol. 134(2), pages 645-664, October.
    16. Richard Kleijn & Herman K. van Dijk, 2006. "Bayes model averaging of cyclical decompositions in economic time series," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 21(2), pages 191-212.
    17. Gary Koop & Rodney Strachan & Herman van Dijk & Mattias Villani, 2004. "Bayesian Approaches to Cointegration," Discussion Papers in Economics 04/27, Division of Economics, School of Business, University of Leicester.
    18. Denis Fougère & Thierry Kamionka, 2003. "Bayesian inference for the mover-stayer model in continuous time with an application to labour market transition data," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 18(6), pages 697-723.
    19. Gael Martin, 2001. "Bayesian Analysis Of A Fractional Cointegration Model," Econometric Reviews, Taylor & Francis Journals, vol. 20(2), pages 217-234.
    20. Hoogerheide, Lennart & Opschoor, Anne & van Dijk, Herman K., 2012. "A class of adaptive importance sampling weighted EM algorithms for efficient and robust posterior and predictive simulation," Journal of Econometrics, Elsevier, vol. 171(2), pages 101-120.

    More about this item

    Keywords

    Markov chain Monte Carlo; importance sampling; radial coordinates;
    All these keywords.

    JEL classification:

    • C11 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Bayesian Analysis: General
    • C15 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Statistical Simulation Methods: General
    • C63 - Mathematical and Quantitative Methods - - Mathematical Methods; Programming Models; Mathematical and Simulation Modeling - - - Computational Techniques

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:ems:eureir:1722. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: RePub (email available below). General contact details of provider: https://edirc.repec.org/data/feeurnl.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.