IDEAS home Printed from https://ideas.repec.org/a/spr/metcap/v24y2022i1d10.1007_s11009-020-09841-7.html
   My bibliography  Save this article

Batch Size Selection for Variance Estimators in MCMC

Author

Listed:
  • Ying Liu

    (University of California)

  • Dootika Vats

    (Indian Institute of Technology Kanpur)

  • James M. Flegal

    (University of California)

Abstract

We consider batch size selection for a general class of multivariate batch means variance estimators, which are computationally viable for high-dimensional Markov chain Monte Carlo simulations. We derive the asymptotic mean squared error for this class of estimators. Further, we propose a parametric technique for estimating optimal batch sizes and discuss practical issues regarding the estimating process. Vector auto-regressive, Bayesian logistic regression, and Bayesian dynamic space-time examples illustrate the quality of the estimation procedure where the proposed optimal batch sizes outperform current batch size selection methods.

Suggested Citation

  • Ying Liu & Dootika Vats & James M. Flegal, 2022. "Batch Size Selection for Variance Estimators in MCMC," Methodology and Computing in Applied Probability, Springer, vol. 24(1), pages 65-93, March.
    • Handle: RePEc:spr:metcap:v:24:y:2022:i:1:d:10.1007_s11009-020-09841-7
    DOI: 10.1007/s11009-020-09841-7
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11009-020-09841-7
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s11009-020-09841-7?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Jones, Galin L. & Haran, Murali & Caffo, Brian S. & Neath, Ronald, 2006. "Fixed-Width Output Analysis for Markov Chain Monte Carlo," Journal of the American Statistical Association, American Statistical Association, vol. 101, pages 1537-1547, December.
    2. Halim Damerdji, 1991. "Strong Consistency and Other Properties of the Spectral Variance Estimator," Management Science, INFORMS, vol. 37(11), pages 1424-1440, November.
    3. Andrews, Donald W K, 1991. "Heteroskedasticity and Autocorrelation Consistent Covariance Matrix Estimation," Econometrica, Econometric Society, vol. 59(3), pages 817-858, May.
    4. Politis, Dimitris N., 2011. "Higher-Order Accurate, Positive Semidefinite Estimation Of Large-Sample Covariance And Spectral Density Matrices," Econometric Theory, Cambridge University Press, vol. 27(4), pages 703-744, August.
    5. Kin Wai Chan & Chun Yip Yau, 2017. "Automatic Optimal Batch Size Selection for Recursive Estimators of Time-Average Covariance Matrix," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 112(519), pages 1076-1089, July.
    6. Andrew Finley & Sudipto Banerjee & Alan Gelfand, 2012. "Bayesian dynamic modeling for large space-time datasets using Gaussian predictive processes," Journal of Geographical Systems, Springer, vol. 14(1), pages 29-47, January.
    7. Halim Damerdji, 1995. "Mean-Square Consistency of the Variance Estimator in Steady-State Simulation Output Analysis," Operations Research, INFORMS, vol. 43(2), pages 282-291, April.
    8. Politis, Dimitris N. & Romano, Joseph P., 1999. "Multivariate Density Estimation with General Flat-Top Kernels of Infinite Order," Journal of Multivariate Analysis, Elsevier, vol. 68(1), pages 1-25, January.
    9. Newey, Whitney & West, Kenneth, 2014. "A simple, positive semi-definite, heteroscedasticity and autocorrelation consistent covariance matrix," Applied Econometrics, Russian Presidential Academy of National Economy and Public Administration (RANEPA), vol. 33(1), pages 125-132.
    10. Wheyming Tina Song & Bruce W. Schmeiser, 1995. "Optimal Mean-Squared-Error Batch Sizes," Management Science, INFORMS, vol. 41(1), pages 110-123, January.
    11. Dootika Vats & James M Flegal & Galin L Jones, 2019. "Multivariate output analysis for Markov chain Monte Carlo," Biometrika, Biometrika Trust, vol. 106(2), pages 321-337.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Kin Wai Chan & Chun Yip Yau, 2017. "High-order Corrected Estimator of Asymptotic Variance with Optimal Bandwidth," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 44(4), pages 866-898, December.
    2. Gregory Rice & Han Lin Shang, 2017. "A Plug-in Bandwidth Selection Procedure for Long-Run Covariance Estimation with Stationary Functional Time Series," Journal of Time Series Analysis, Wiley Blackwell, vol. 38(4), pages 591-609, July.
    3. La Vecchia, Davide & Moor, Alban & Scaillet, Olivier, 2023. "A higher-order correct fast moving-average bootstrap for dependent data," Journal of Econometrics, Elsevier, vol. 235(1), pages 65-81.
    4. Federico Belotti & Alessandro Casini & Leopoldo Catania & Stefano Grassi & Pierre Perron, 2023. "Simultaneous bandwidths determination for DK-HAC estimators and long-run variance estimation in nonparametric settings," Econometric Reviews, Taylor & Francis Journals, vol. 42(3), pages 281-306, February.
    5. Hirukawa, Masayuki, 2023. "Robust Covariance Matrix Estimation in Time Series: A Review," Econometrics and Statistics, Elsevier, vol. 27(C), pages 36-61.
    6. Casini, Alessandro, 2023. "Theory of evolutionary spectra for heteroskedasticity and autocorrelation robust inference in possibly misspecified and nonstationary models," Journal of Econometrics, Elsevier, vol. 235(2), pages 372-392.
    7. Min Seong Kim, 2021. "Robust Inference for Diffusion-Index Forecasts with Cross-Sectionally Dependent Data," Working papers 2021-04, University of Connecticut, Department of Economics.
    8. Chakraborty, Saptarshi & Bhattacharya, Suman K. & Khare, Kshitij, 2022. "Estimating accuracy of the MCMC variance estimator: Asymptotic normality for batch means estimators," Statistics & Probability Letters, Elsevier, vol. 183(C).
    9. Rasmus Tangsgaard Varneskov, 2011. "Generalized Flat-Top Realized Kernel Estimation of Ex-Post Variation of Asset Prices Contaminated by Noise," CREATES Research Papers 2011-31, Department of Economics and Business Economics, Aarhus University.
    10. Christos Alexopoulos & Nilay Tanık Argon & David Goldsman & Gamze Tokol & James R. Wilson, 2007. "Overlapping Variance Estimators for Simulation," Operations Research, INFORMS, vol. 55(6), pages 1090-1103, December.
    11. Kim, Min Seong & Sun, Yixiao, 2013. "Heteroskedasticity and spatiotemporal dependence robust inference for linear panel models with fixed effects," Journal of Econometrics, Elsevier, vol. 177(1), pages 85-108.
    12. Zhenhao Gong & Min Seong Kim, 2024. "Improved inference for interactive fixed effects model under cross-sectional dependence," Empirical Economics, Springer, vol. 67(2), pages 727-760, August.
    13. Preinerstorfer, David & Pötscher, Benedikt M., 2016. "On Size And Power Of Heteroskedasticity And Autocorrelation Robust Tests," Econometric Theory, Cambridge University Press, vol. 32(2), pages 261-358, April.
    14. Casini, Alessandro & Perron, Pierre, 2024. "Prewhitened long-run variance estimation robust to nonstationarity," Journal of Econometrics, Elsevier, vol. 242(1).
    15. Cho, Guedae & Kim, MinKyoung & Koo, Won W., 2003. "Relative Agricultural Price Changes In Different Time Horizons," 2003 Annual meeting, July 27-30, Montreal, Canada 22249, American Agricultural Economics Association (New Name 2008: Agricultural and Applied Economics Association).
    16. Marcelo Fernandes & Breno Neri, 2010. "Nonparametric Entropy-Based Tests of Independence Between Stochastic Processes," Econometric Reviews, Taylor & Francis Journals, vol. 29(3), pages 276-306.
    17. Cavit Pakel & Neil Shephard & Kevin Sheppard, 2009. "Nuisance parameters, composite likelihoods and a panel of GARCH models," Economics Papers 2009-W12, Economics Group, Nuffield College, University of Oxford.
    18. Paulo M. D. C. Parente & Richard J. Smith, 2021. "Quasi‐maximum likelihood and the kernel block bootstrap for nonlinear dynamic models," Journal of Time Series Analysis, Wiley Blackwell, vol. 42(4), pages 377-405, July.
    19. Hansen, Lars Peter & Heaton, John & Luttmer, Erzo G J, 1995. "Econometric Evaluation of Asset Pricing Models," The Review of Financial Studies, Society for Financial Studies, vol. 8(2), pages 237-274.
    20. Mehdi Abid & Rafaa Mraihi, 2015. "Energy Consumption and Industrial Production: Evidence from Tunisia at Both Aggregated and Disaggregated Levels," Journal of the Knowledge Economy, Springer;Portland International Center for Management of Engineering and Technology (PICMET), vol. 6(4), pages 1123-1137, December.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:metcap:v:24:y:2022:i:1:d:10.1007_s11009-020-09841-7. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.