IDEAS home Printed from https://ideas.repec.org/a/bla/istatr/v83y2015i2p228-238.html
   My bibliography  Save this article

Assessing Variability of Complex Descriptive Statistics in Monte Carlo Studies Using Resampling Methods

Author

Listed:
  • Dennis D. Boos
  • Jason A. Osborne

Abstract

type="main" xml:id="insr12087-abs-0001"> Good statistical practice dictates that summaries in Monte Carlo studies should always be accompanied by standard errors. Those standard errors are easy to provide for summaries that are sample means over the replications of the Monte Carlo output: for example, bias estimates, power estimates for tests and mean squared error estimates. But often more complex summaries are of interest: medians (often displayed in boxplots), sample variances, ratios of sample variances and non-normality measures such as skewness and kurtosis. In principle, standard errors for most of these latter summaries may be derived from the Delta Method, but that extra step is often a barrier for standard errors to be provided. Here, we highlight the simplicity of using the jackknife and bootstrap to compute these standard errors, even when the summaries are somewhat complicated. © 2014 The Authors. International Statistical Review © 2014 International Statistical Institute

Suggested Citation

  • Dennis D. Boos & Jason A. Osborne, 2015. "Assessing Variability of Complex Descriptive Statistics in Monte Carlo Studies Using Resampling Methods," International Statistical Review, International Statistical Institute, vol. 83(2), pages 228-238, August.
    • Handle: RePEc:bla:istatr:v:83:y:2015:i:2:p:228-238
    as

    Download full text from publisher

    File URL: http://hdl.handle.net/10.1111/insr.12087
    Download Restriction: Access to full text is restricted to subscribers.
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Bao, Yong, 2009. "Finite-Sample Moments Of The Coefficient Of Variation," Econometric Theory, Cambridge University Press, vol. 25(1), pages 291-297, February.
    2. Tobias Niebuhr & Jens-Peter Kreiss, 2014. "Asymptotics for Autocovariances and Integrated Periodograms for Linear Processes Observed at Lower Frequencies," International Statistical Review, International Statistical Institute, vol. 82(1), pages 123-140, April.
    3. Hong Zhu, 2014. "Non-parametric Analysis of Gap Times for Multiple Event Data: An Overview," International Statistical Review, International Statistical Institute, vol. 82(1), pages 106-122, April.
    4. Jay M. Ver Hoef, 2012. "Who Invented the Delta Method?," The American Statistician, Taylor & Francis Journals, vol. 66(2), pages 124-127, May.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Aurélien Saussay & Misato Sato, 2018. "The Impacts of Energy Prices on Industrial Foreign Investment Location: Evidence from Global Firm Level Data," Working Papers hal-03475473, HAL.
    2. Aurélien Saussay, 2019. "Dynamic heterogeneity: rational habits and the heterogeneity of household responses to gasoline prices," Post-Print hal-03632598, HAL.
    3. Prakash Gorroochurn, 2020. "Who Invented the Delta Method, Really?," The Mathematical Intelligencer, Springer, vol. 42(3), pages 46-49, September.
    4. Rahma Abid & Célestin C. Kokonendji & Afif Masmoudi, 2020. "Geometric Tweedie regression models for continuous and semicontinuous data with variation phenomenon," AStA Advances in Statistical Analysis, Springer;German Statistical Society, vol. 104(1), pages 33-58, March.
    5. Ernest Lo & Dan Vatnik & Andrea Benedetti & Robert Bourbeau, 2016. "Variance models of the last age interval and their impact on life expectancy at subnational scales," Demographic Research, Max Planck Institute for Demographic Research, Rostock, Germany, vol. 35(15), pages 399-454.
    6. Peter L. Boveng & Jay M. Ver Hoef & David E. Withrow & Josh M. London, 2018. "A Bayesian Analysis of Abundance, Trend, and Population Viability for Harbor Seals in Iliamna Lake, Alaska," Risk Analysis, John Wiley & Sons, vol. 38(9), pages 1988-2009, September.
    7. Sourav Das & Suhasini Subba Rao & Junho Yang, 2021. "Spectral methods for small sample time series: A complete periodogram approach," Journal of Time Series Analysis, Wiley Blackwell, vol. 42(5-6), pages 597-621, September.
    8. Rudan Wang & Bruce Morley & Javier Ordóñez, 2016. "The Taylor Rule, Wealth Effects and the Exchange Rate," Review of International Economics, Wiley Blackwell, vol. 24(2), pages 282-301, May.
    9. Matt Higham & Jay Ver Hoef & Lisa Madsen & Andy Aderman, 2021. "Adjusting a finite population block kriging estimator for imperfect detection," Environmetrics, John Wiley & Sons, Ltd., vol. 32(1), February.
    10. Julian Ramirez-Villegas & Andrew J. Challinor, 2016. "Towards a genotypic adaptation strategy for Indian groundnut cultivation using an ensemble of crop simulations," Climatic Change, Springer, vol. 138(1), pages 223-238, September.
    11. Spouge, John L., 2019. "An accurate approximation for the expected site frequency spectrum in a Galton–Watson process under an infinite sites mutation model," Theoretical Population Biology, Elsevier, vol. 127(C), pages 7-15.
    12. Li, Yi & Mathur, Maya B & Yoshida, Kazuki, 2022. "R package regmedint: extension of regression-based causal mediation analysis with effect measure modification by covariates," OSF Preprints d4brv, Center for Open Science.
    13. Robert B. Nielsen & Martin C. Seay, 2014. "Complex Samples and Regression-Based Inference: Considerations for Consumer Researchers," Journal of Consumer Affairs, Wiley Blackwell, vol. 48(3), pages 603-619, October.
    14. Umed Temurshoev, 2015. "Uncertainty treatment in input-output analysis," Working Papers 2015-004, Universidad Loyola Andalucía, Department of Economics.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bla:istatr:v:83:y:2015:i:2:p:228-238. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: https://edirc.repec.org/data/isiiinl.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.