IDEAS home Printed from https://ideas.repec.org/p/tse/wpaper/29078.html
   My bibliography  Save this paper

On some recent advances in high dimensional Bayesian Statistics

Author

Listed:
  • Chopin, Nicolas
  • Gadat, Sébastien
  • Guedj, Benjamin
  • Guyader, Arnaud
  • Vernet, Elodie

Abstract

This paper proposes to review some recent developments in Bayesian statistics for high dimensional data. After giving some brief motivations in a short introduction, we describe new advances in the understanding of Bayes posterior computation as well as theoretical contributions in non parametric and high dimensional Bayesian approaches. From an applied point of view, we describe the so-called SQMC particle method to compute posterior Bayesian law, and provide a nonparametric analysis of the widespread ABC method. On the theoretical side, we describe some recent advances in Bayesian consistency for a nonparametric hidden Markov model as well as new PAC-Bayesian results for different models of high dimensional regression.

Suggested Citation

  • Chopin, Nicolas & Gadat, Sébastien & Guedj, Benjamin & Guyader, Arnaud & Vernet, Elodie, 2015. "On some recent advances in high dimensional Bayesian Statistics," TSE Working Papers 15-557, Toulouse School of Economics (TSE).
    • Handle: RePEc:tse:wpaper:29078
    as

    Download full text from publisher

    File URL: http://perso.math.univ-toulouse.fr/gadat/files/2012/04/bayescomp.pdf
    File Function: Full text
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Jianqing Fan & Tsz Ho Yim, 2004. "A crossvalidation method for estimating conditional densities," Biometrika, Biometrika Trust, vol. 91(4), pages 819-834, December.
    2. repec:dau:papers:123456789/14578 is not listed on IDEAS
    3. Ming Gao Gu & Hong‐Tu Zhu, 2001. "Maximum likelihood estimation for spatial models by Markov chain Monte Carlo stochastic approximation," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 63(2), pages 339-355.
    4. Alquier Pierre & Li Xiaoyin & Wintenberger Olivier, 2014. "Prediction of time series by statistical learning: general losses and fast rates," Dependence Modeling, De Gruyter, vol. 1(2013), pages 65-93, January.
    5. repec:dau:papers:123456789/1906 is not listed on IDEAS
    6. Joyce Paul & Marjoram Paul, 2008. "Approximately Sufficient Statistics and Bayesian Computation," Statistical Applications in Genetics and Molecular Biology, De Gruyter, vol. 7(1), pages 1-18, August.
    7. repec:dau:papers:123456789/8332 is not listed on IDEAS
    8. C. Yau & O. Papaspiliopoulos & G. O. Roberts & C. Holmes, 2011. "Bayesian non‐parametric hidden Markov models with applications in genomics," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 73(1), pages 37-57, January.
    9. Gadat, Sébastien & Klein, Thierry & Marteau, Clément, 2014. "Classification with the nearest neighbor rule in general finite dimensional spaces," TSE Working Papers 14-540, Toulouse School of Economics (TSE).
    10. Peter Hall & Jeff Racine & Qi Li, 2004. "Cross-Validation and the Estimation of Conditional Probability Densities," Journal of the American Statistical Association, American Statistical Association, vol. 99, pages 1015-1026, December.
    11. repec:dau:papers:123456789/6334 is not listed on IDEAS
    12. Bashtannyk, David M. & Hyndman, Rob J., 2001. "Bandwidth selection for kernel conditional density estimation," Computational Statistics & Data Analysis, Elsevier, vol. 36(3), pages 279-298, May.
    13. repec:dau:papers:123456789/5724 is not listed on IDEAS
    14. Mathieu Gerber & Nicolas Chopin, 2015. "Sequential quasi Monte Carlo," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 77(3), pages 509-579, June.
    15. Blum, Michael G. B., 2010. "Approximate Bayesian Computation: A Nonparametric Perspective," Journal of the American Statistical Association, American Statistical Association, vol. 105(491), pages 1178-1187.
    16. Mark A. Beaumont & Jean-Marie Cornuet & Jean-Michel Marin & Christian P. Robert, 2009. "Adaptive approximate Bayesian computation," Biometrika, Biometrika Trust, vol. 96(4), pages 983-990.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Creel, Michael & Kristensen, Dennis, 2016. "On selection of statistics for approximate Bayesian computing (or the method of simulated moments)," Computational Statistics & Data Analysis, Elsevier, vol. 100(C), pages 99-114.
    2. Ichimura, Tsuyoshi & Fukuda, Daisuke, 2010. "A fast algorithm for computing least-squares cross-validations for nonparametric conditional kernel density functions," Computational Statistics & Data Analysis, Elsevier, vol. 54(12), pages 3404-3410, December.
    3. Geenens, Gery & Dunn, Richard, 2022. "A nonparametric copula approach to conditional Value-at-Risk," Econometrics and Statistics, Elsevier, vol. 21(C), pages 19-37.
    4. Liang, Han-Ying & Peng, Liang, 2010. "Asymptotic normality and Berry-Esseen results for conditional density estimator with censored and dependent data," Journal of Multivariate Analysis, Elsevier, vol. 101(5), pages 1043-1054, May.
    5. Gery Geenens & Richard Dunn, 2017. "A nonparametric copula approach to conditional Value-at-Risk," Papers 1712.05527, arXiv.org, revised Oct 2019.
    6. Frazier, David T. & Maneesoonthorn, Worapree & Martin, Gael M. & McCabe, Brendan P.M., 2019. "Approximate Bayesian forecasting," International Journal of Forecasting, Elsevier, vol. 35(2), pages 521-539.
    7. Gael M. Martin & David T. Frazier & Christian P. Robert, 2020. "Computing Bayes: Bayesian Computation from 1763 to the 21st Century," Monash Econometrics and Business Statistics Working Papers 14/20, Monash University, Department of Econometrics and Business Statistics.
    8. Gael M. Martin & David T. Frazier & Christian P. Robert, 2021. "Approximating Bayes in the 21st Century," Monash Econometrics and Business Statistics Working Papers 24/21, Monash University, Department of Econometrics and Business Statistics.
    9. Mikael Sunnåker & Alberto Giovanni Busetto & Elina Numminen & Jukka Corander & Matthieu Foll & Christophe Dessimoz, 2013. "Approximate Bayesian Computation," PLOS Computational Biology, Public Library of Science, vol. 9(1), pages 1-10, January.
    10. Wang, Xiao-Feng & Ye, Deping, 2015. "Conditional density estimation in measurement error problems," Journal of Multivariate Analysis, Elsevier, vol. 133(C), pages 38-50.
    11. Kateřina Konečná & Ivanka Horová, 2019. "Maximum likelihood method for bandwidth selection in kernel conditional density estimate," Computational Statistics, Springer, vol. 34(4), pages 1871-1887, December.
    12. Golchi, Shirin & Campbell, David A., 2016. "Sequentially Constrained Monte Carlo," Computational Statistics & Data Analysis, Elsevier, vol. 97(C), pages 98-113.
    13. Obbey Elamin & Len Gill & Martyn Andrews, 2020. "Insights from kernel conditional-probability estimates into female labour force participation decision in the UK," Empirical Economics, Springer, vol. 58(6), pages 2981-3006, June.
    14. Wen, Kuangyu & Wu, Ximing, 2017. "Smoothed kernel conditional density estimation," Economics Letters, Elsevier, vol. 152(C), pages 112-116.
    15. Liang, Han-Ying & Liu, Ai-Ai, 2013. "Kernel estimation of conditional density with truncated, censored and dependent data," Journal of Multivariate Analysis, Elsevier, vol. 120(C), pages 40-58.
    16. Jooyoung Jeon & James W. Taylor, 2012. "Using Conditional Kernel Density Estimation for Wind Power Density Forecasting," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 107(497), pages 66-79, March.
    17. Otneim, Håkon & Tjøstheim, Dag, 2016. "Non-parametric estimation of conditional densities: A new method," Discussion Papers 2016/22, Norwegian School of Economics, Department of Business and Management Science.
    18. D.T. Frazier & G.M. Martin & C.P. Robert & J. Rousseau, 2016. "Asymptotic Properties of Approximate Bayesian Computation," Monash Econometrics and Business Statistics Working Papers 18/16, Monash University, Department of Econometrics and Business Statistics.
    19. Pierre-Olivier Goffard & Patrick Laub, 2021. "Approximate Bayesian Computations to fit and compare insurance loss models," Working Papers hal-02891046, HAL.
    20. Faugeras, Olivier P., 2009. "A quantile-copula approach to conditional density estimation," Journal of Multivariate Analysis, Elsevier, vol. 100(9), pages 2083-2099, October.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:tse:wpaper:29078. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: the person in charge (email available below). General contact details of provider: https://edirc.repec.org/data/tsetofr.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.