IDEAS home Printed from https://ideas.repec.org/a/eee/csdana/v77y2014icp54-69.html
   My bibliography  Save this article

On the use of marginal posteriors in marginal likelihood estimation via importance sampling

Author

Listed:
  • Perrakis, Konstantinos
  • Ntzoufras, Ioannis
  • Tsionas, Efthymios G.

Abstract

The efficiency of a marginal likelihood estimator where the product of the marginal posterior distributions is used as an importance sampling function is investigated. The approach is generally applicable to multi-block parameter vector settings, does not require additional Markov Chain Monte Carlo (MCMC) sampling and is not dependent on the type of MCMC scheme used to sample from the posterior. The proposed approach is applied to normal regression models, finite normal mixtures and longitudinal Poisson models, and leads to accurate marginal likelihood estimates.

Suggested Citation

  • Perrakis, Konstantinos & Ntzoufras, Ioannis & Tsionas, Efthymios G., 2014. "On the use of marginal posteriors in marginal likelihood estimation via importance sampling," Computational Statistics & Data Analysis, Elsevier, vol. 77(C), pages 54-69.
    • Handle: RePEc:eee:csdana:v:77:y:2014:i:c:p:54-69
    DOI: 10.1016/j.csda.2014.03.004
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0167947314000814
    Download Restriction: Full text for ScienceDirect subscribers only.
    File URL: https://libkey.io/10.1016/j.csda.2014.03.004?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Pierre Del Moral & Arnaud Doucet & Ajay Jasra, 2006. "Sequential Monte Carlo samplers," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 68(3), pages 411-436, June.
    2. Oh, Man-Suk, 1999. "Estimation of posterior density functions from a posterior sample," Computational Statistics & Data Analysis, Elsevier, vol. 29(4), pages 411-427, February.
    3. Ioannis Ntzoufras & Athanassios Katsis & Dimitris Karlis, 2005. "Bayesian Assessment of the Distribution of Insurance Claim Counts Using Reversible Jump MCMC," North American Actuarial Journal, Taylor & Francis Journals, vol. 9(3), pages 90-108.
    4. Ghosh, Joyee & Clyde, Merlise A., 2011. "Rao–Blackwellization for Bayesian Variable Selection and Model Averaging in Linear and Binary Regression: A Novel Data Augmentation Approach," Journal of the American Statistical Association, American Statistical Association, vol. 106(495), pages 1041-1052.
    5. Robert, Christian P. & Mengersen, Kerrie L., 1999. "Reparameterisation Issues in Mixture Modelling and their bearing on MCMC algorithms," Computational Statistics & Data Analysis, Elsevier, vol. 29(3), pages 325-343, January.
    6. Fernandez, Carmen & Ley, Eduardo & Steel, Mark F. J., 2001. "Benchmark priors for Bayesian model averaging," Journal of Econometrics, Elsevier, vol. 100(2), pages 381-427, February.
    7. Håvard Rue & Sara Martino & Nicolas Chopin, 2009. "Approximate Bayesian inference for latent Gaussian models by using integrated nested Laplace approximations," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 71(2), pages 319-392, April.
    8. Chib, Siddhartha & Greenberg, Edward & Winkelmann, Rainer, 1998. "Posterior simulation and Bayes factors in panel count data models," Journal of Econometrics, Elsevier, vol. 86(1), pages 33-54, June.
    9. Ardia, David & Baştürk, Nalan & Hoogerheide, Lennart & van Dijk, Herman K., 2012. "A comparative study of Monte Carlo methods for efficient evaluation of marginal likelihood," Computational Statistics & Data Analysis, Elsevier, vol. 56(11), pages 3398-3414.
    10. Chib S. & Jeliazkov I., 2001. "Marginal Likelihood From the Metropolis-Hastings Output," Journal of the American Statistical Association, American Statistical Association, vol. 96, pages 270-281, March.
    11. repec:dau:papers:123456789/6069 is not listed on IDEAS
    12. Geweke, John, 2007. "Interpretation and inference in mixture models: Simple MCMC works," Computational Statistics & Data Analysis, Elsevier, vol. 51(7), pages 3529-3550, April.
    13. N. Friel & A. N. Pettitt, 2008. "Marginal likelihood estimation via power posteriors," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 70(3), pages 589-607, July.
    14. Newey, Whitney & West, Kenneth, 2014. "A simple, positive semi-definite, heteroscedasticity and autocorrelation consistent covariance matrix," Applied Econometrics, Russian Presidential Academy of National Economy and Public Administration (RANEPA), vol. 33(1), pages 125-132.
    15. Ming‐Hui Chen, 2005. "Computing marginal likelihoods from a single MCMC output," Statistica Neerlandica, Netherlands Society for Statistics and Operations Research, vol. 59(1), pages 16-29, February.
    16. repec:dau:papers:123456789/3692 is not listed on IDEAS
    17. Nial Friel & Jason Wyse, 2012. "Estimating the evidence – a review," Statistica Neerlandica, Netherlands Society for Statistics and Operations Research, vol. 66(3), pages 288-308, August.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Lütkepohl, Helmut & Woźniak, Tomasz, 2020. "Bayesian inference for structural vector autoregressions identified by Markov-switching heteroskedasticity," Journal of Economic Dynamics and Control, Elsevier, vol. 113(C).
    2. Hajargasht, Gholamreza & Rao, D.S. Prasada, 2019. "Multilateral index number systems for international price comparisons: Properties, existence and uniqueness," Journal of Mathematical Economics, Elsevier, vol. 83(C), pages 36-47.
    3. Tsionas, Mike G., 2020. "Bounded rationality and thick frontiers in stochastic frontier analysis," European Journal of Operational Research, Elsevier, vol. 284(2), pages 762-768.
    4. Michael L. Polemis & Mike G. Tsionas, 2023. "The environmental consequences of blockchain technology: A Bayesian quantile cointegration analysis for Bitcoin," International Journal of Finance & Economics, John Wiley & Sons, Ltd., vol. 28(2), pages 1602-1621, April.
    5. Jean-Paul Fox & Joris Mulder & Sandip Sinharay, 2017. "Bayes Factor Covariance Testing in Item Response Models," Psychometrika, Springer;The Psychometric Society, vol. 82(4), pages 979-1006, December.
    6. Junrong Liu & Robin C. Sickles & E. G. Tsionas, 2017. "Bayesian Treatments for Panel Data Stochastic Frontier Models with Time Varying Heterogeneity," Econometrics, MDPI, vol. 5(3), pages 1-21, July.
    7. Konrad Klotzke & Jean-Paul Fox, 2019. "Modeling Dependence Structures for Response Times in a Bayesian Framework," Psychometrika, Springer;The Psychometric Society, vol. 84(3), pages 649-672, September.
    8. Patel, Pankaj C. & Tsionas, Mike & Oghazi, Pejvak & Izquierdo, Vanessa, 2022. "No entrepreneur steps in the same river twice: Limited learning advantage for serial entrepreneurs," Journal of Business Research, Elsevier, vol. 142(C), pages 1038-1052.
    9. Tsionas, Mike & Patel, Pankaj C. & Guedes, Maria João, 2022. "Endogenous efficiency of the dynamic profit maximization in the intertemporal production models of venture behavior," International Journal of Production Economics, Elsevier, vol. 246(C).
    10. Tsionas, Mike G., 2021. "Bayesian analysis of static and dynamic Hurst parameters under stochastic volatility," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 567(C).
    11. Atkinson, Scott E. & Primont, Daniel & Tsionas, Mike G., 2018. "Statistical inference in efficient production with bad inputs and outputs using latent prices and optimal directions," Journal of Econometrics, Elsevier, vol. 204(2), pages 131-146.
    12. Ashok K. Mishra & Mike G. Tsionas, 2020. "A Minimax Regret Approach to Decision Making Under Uncertainty," Journal of Agricultural Economics, Wiley Blackwell, vol. 71(3), pages 698-718, September.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Joshua C. C. Chan & Liana Jacobi & Dan Zhu, 2022. "An automated prior robustness analysis in Bayesian model comparison," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 37(3), pages 583-602, April.
    2. Hajargasht, Gholamreza & Rao, D.S. Prasada, 2019. "Multilateral index number systems for international price comparisons: Properties, existence and uniqueness," Journal of Mathematical Economics, Elsevier, vol. 83(C), pages 36-47.
    3. Gael M. Martin & David T. Frazier & Christian P. Robert, 2020. "Computing Bayes: Bayesian Computation from 1763 to the 21st Century," Monash Econometrics and Business Statistics Working Papers 14/20, Monash University, Department of Econometrics and Business Statistics.
    4. Bauwens, Luc & Dufays, Arnaud & Rombouts, Jeroen V.K., 2014. "Marginal likelihood for Markov-switching and change-point GARCH models," Journal of Econometrics, Elsevier, vol. 178(P3), pages 508-522.
    5. Dimitris Korobilis & Kenichi Shimizu, 2022. "Bayesian Approaches to Shrinkage and Sparse Estimation," Foundations and Trends(R) in Econometrics, now publishers, vol. 11(4), pages 230-354, June.
    6. repec:dau:papers:123456789/5724 is not listed on IDEAS
    7. Reichl Johannes, 2020. "Estimating marginal likelihoods from the posterior draws through a geometric identity," Monte Carlo Methods and Applications, De Gruyter, vol. 26(3), pages 205-221, September.
    8. Joshua C. C. Chan & Eric Eisenstat, 2015. "Marginal Likelihood Estimation with the Cross-Entropy Method," Econometric Reviews, Taylor & Francis Journals, vol. 34(3), pages 256-285, March.
    9. Ardia, David & Baştürk, Nalan & Hoogerheide, Lennart & van Dijk, Herman K., 2012. "A comparative study of Monte Carlo methods for efficient evaluation of marginal likelihood," Computational Statistics & Data Analysis, Elsevier, vol. 56(11), pages 3398-3414.
    10. Li Ma, 2015. "Scalable Bayesian Model Averaging Through Local Information Propagation," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 110(510), pages 795-809, June.
    11. Hubin, Aliaksandr & Storvik, Geir, 2018. "Mode jumping MCMC for Bayesian variable selection in GLMM," Computational Statistics & Data Analysis, Elsevier, vol. 127(C), pages 281-297.
    12. Heaps, Sarah E. & Boys, Richard J. & Farrow, Malcolm, 2014. "Computation of marginal likelihoods with data-dependent support for latent variables," Computational Statistics & Data Analysis, Elsevier, vol. 71(C), pages 392-401.
    13. Ehlers, Ricardo S., 2012. "Computational tools for comparing asymmetric GARCH models via Bayes factors," Mathematics and Computers in Simulation (MATCOM), Elsevier, vol. 82(5), pages 858-867.
    14. Mathias Drton & Martyn Plummer, 2017. "A Bayesian information criterion for singular models," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 79(2), pages 323-380, March.
    15. Ardia, David & Hoogerheide, Lennart F., 2010. "Efficient Bayesian estimation and combination of GARCH-type models," MPRA Paper 22919, University Library of Munich, Germany.
    16. Masaru Chiba, 2023. "Robust and efficient specification tests in Markov-switching autoregressive models," Statistical Inference for Stochastic Processes, Springer, vol. 26(1), pages 99-137, April.
    17. Jeong Eun Lee & Christian Robert, 2013. "Imortance Sampling Schemes for Evidence Approximation in Mixture Models," Working Papers 2013-42, Center for Research in Economics and Statistics.
    18. Will Penny & Biswa Sengupta, 2016. "Annealed Importance Sampling for Neural Mass Models," PLOS Computational Biology, Public Library of Science, vol. 12(3), pages 1-25, March.
    19. Joshua C. C. Chan, 2018. "Specification tests for time-varying parameter models with stochastic volatility," Econometric Reviews, Taylor & Francis Journals, vol. 37(8), pages 807-823, September.
    20. Vitoratou, Silia & Ntzoufras, Ioannis & Moustaki, Irini, 2016. "Explaining the behavior of joint and marginal Monte Carlo estimators in latent variable models with independence assumptions," LSE Research Online Documents on Economics 57685, London School of Economics and Political Science, LSE Library.
    21. Gael M. Martin & David T. Frazier & Ruben Loaiza-Maya & Florian Huber & Gary Koop & John Maheu & Didier Nibbering & Anastasios Panagiotelis, 2023. "Bayesian Forecasting in the 21st Century: A Modern Review," Monash Econometrics and Business Statistics Working Papers 1/23, Monash University, Department of Econometrics and Business Statistics.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:csdana:v:77:y:2014:i:c:p:54-69. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/csda .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.