IDEAS home Printed from https://ideas.repec.org/a/vrs/stintr/v21y2020i2p35-60n5.html
   My bibliography  Save this article

On the choice of the number of Monte Carlo iterations and bootstrap replicates in Empirical Best Prediction

Author

Listed:
  • Chwila Adam

    (University of Economics in Katowice, Katowice, Poland)

  • Żądło Tomasz

    (University of Economics in Katowice, Katowice, Poland)

Abstract

Empirical Best Predictors (EBPs) are widely used for small area estimation purposes. In the case of longitudinal surveys, this class of predictors can be used to predict any given population or subpopulation characteristic for any time period, including future periods. Generally, the value of an EBP is computed by means of Monte Carlo algorithms, while its MSE is usually estimated using the parametric bootstrap method. Model-based simulation studies of the properties of the predictors require numerous repetitions of the random generation of population data. This leads to a question about the dependence between the number of iterations in all the procedures and the stability of the results. The aim of the paper is to show this dependence and to propose methods of choosing the appropriate number of iterations in practice, using a set of real economic longitudinal data available at the United States Census Bureau website.

Suggested Citation

  • Chwila Adam & Żądło Tomasz, 2020. "On the choice of the number of Monte Carlo iterations and bootstrap replicates in Empirical Best Prediction," Statistics in Transition New Series, Polish Statistical Association, vol. 21(2), pages 35-60, June.
    • Handle: RePEc:vrs:stintr:v:21:y:2020:i:2:p:35-60:n:5
    DOI: 10.21307/stattrans-2020-013
    as

    Download full text from publisher

    File URL: https://doi.org/10.21307/stattrans-2020-013
    Download Restriction: no
    File URL: https://libkey.io/10.21307/stattrans-2020-013?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Berg, Emily & Chandra, Hukum, 2014. "Small area prediction for a unit-level lognormal model," Computational Statistics & Data Analysis, Elsevier, vol. 78(C), pages 159-175.
    2. Nikos Tzavidis & Li‐Chun Zhang & Angela Luna & Timo Schmid & Natalia Rojas‐Perilla, 2018. "From start to finish: a framework for the production of small area official statistics," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 181(4), pages 927-979, October.
    3. Miguel Boubeta & María José Lombardía & Domingo Morales, 2016. "Empirical best prediction under area-level Poisson mixed models," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 25(3), pages 548-569, September.
    4. Boubeta, Miguel & Lombardía, María José & Morales, Domingo, 2017. "Poisson mixed models for studying the poverty in small areas," Computational Statistics & Data Analysis, Elsevier, vol. 107(C), pages 32-47.
    5. Rudolf Beran, 1997. "Diagnosing Bootstrap Success," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 49(1), pages 1-24, March.
    6. Guadarrama, María & Molina, Isabel & Rao, J.N.K., 2018. "Small area estimation of general parameters under complex sampling designs," Computational Statistics & Data Analysis, Elsevier, vol. 121(C), pages 20-40.
    7. Mamadou S. Diallo & J. N. K. Rao, 2018. "Small area estimation of complex parameters under unit‐level models with skew‐normal errors," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 45(4), pages 1092-1116, December.
    8. Sumonkanti Das & Stephen Haslett, 2019. "A Comparison of Methods for Poverty Estimation in Developing Countries," International Statistical Review, International Statistical Institute, vol. 87(2), pages 368-392, August.
    9. Donald W. K. Andrews & Moshe Buchinsky, 2000. "A Three-Step Method for Choosing the Number of Bootstrap Repetitions," Econometrica, Econometric Society, vol. 68(1), pages 23-52, January.
    10. Peter Hall & Tapabrata Maiti, 2006. "On parametric bootstrap methods for small area prediction," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 68(2), pages 221-238, April.
    11. Donald W.K. Andrews & Moshe Buchinsky, 1997. "On the Number of Bootstrap Repetitions for Bootstrap Standard Errors, Confidence Intervals, and Tests," Cowles Foundation Discussion Papers 1141R, Cowles Foundation for Research in Economics, Yale University.
    12. Andrews, Donald W. K. & Buchinsky, Moshe, 2001. "Evaluation of a three-step method for choosing the number of bootstrap repetitions," Journal of Econometrics, Elsevier, vol. 103(1-2), pages 345-386, July.
    13. Jiming Jiang & P. Lahiri, 2001. "Empirical Best Prediction for Small Area Inference with Binary Data," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 53(2), pages 217-243, June.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Adam Chwila & Tomasz Żądło, 2020. "On the choice of the number of Monte Carlo iterations and bootstrap replicates in Empirical Best Prediction," Statistics in Transition New Series, Polish Statistical Association, vol. 21(2), pages 35-60, June.
    2. Isabel Molina & Paul Corral & Minh Nguyen, 2022. "Estimation of poverty and inequality in small areas: review and discussion," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 31(4), pages 1143-1166, December.
    3. Tomáš Hobza & Domingo Morales & Laureano Santamaría, 2018. "Small area estimation of poverty proportions under unit-level temporal binomial-logit mixed models," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 27(2), pages 270-294, June.
    4. Flores-Agreda, Daniel & Cantoni, Eva, 2019. "Bootstrap estimation of uncertainty in prediction for generalized linear mixed models," Computational Statistics & Data Analysis, Elsevier, vol. 130(C), pages 1-17.
    5. Masaki,Takaaki & Newhouse,David Locke & Silwal,Ani Rudra & Bedada,Adane & Engstrom,Ryan, 2020. "Small Area Estimation of Non-Monetary Poverty with Geospatial Data," Policy Research Working Paper Series 9383, The World Bank.
    6. Domingo Morales & Joscha Krause & Jan Pablo Burgard, 2022. "On the Use of Aggregate Survey Data for Estimating Regional Major Depressive Disorder Prevalence," Psychometrika, Springer;The Psychometric Society, vol. 87(1), pages 344-368, March.
    7. Joscha Krause & Jan Pablo Burgard & Domingo Morales, 2022. "$$\ell _2$$ ℓ 2 -penalized approximate likelihood inference in logit mixed models for regional prevalence estimation under covariate rank-deficiency," Metrika: International Journal for Theoretical and Applied Statistics, Springer, vol. 85(4), pages 459-489, May.
    8. Patrick Krennmair & Timo Schmid, 2022. "Flexible domain prediction using mixed effects random forests," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 71(5), pages 1865-1894, November.
    9. María Dolores Esteban & María José Lombardía & Esther López-Vizcaíno & Domingo Morales & Agustín Pérez, 2020. "Small area estimation of proportions under area-level compositional mixed models," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 29(3), pages 793-818, September.
    10. Jasmin Kantarevic & Boris Kralj, 2016. "Physician Payment Contracts in the Presence of Moral Hazard and Adverse Selection: The Theory and Its Application in Ontario," Health Economics, John Wiley & Sons, Ltd., vol. 25(10), pages 1326-1340, October.
    11. Molina Isabel, 2020. "Discussion of “Small area estimation: its evolution in five decades”, by Malay Ghosh," Statistics in Transition New Series, Polish Statistical Association, vol. 21(4), pages 40-44, August.
    12. Domingo Morales & María del Mar Rueda & Dolores Esteban, 2018. "Model-Assisted Estimation of Small Area Poverty Measures: An Application within the Valencia Region in Spain," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 138(3), pages 873-900, August.
    13. Burridge, Peter & Robert Taylor, A. M., 2004. "Bootstrapping the HEGY seasonal unit root tests," Journal of Econometrics, Elsevier, vol. 123(1), pages 67-87, November.
    14. Jasmin Kantarevic & Boris Kralj, 2013. "Link Between Pay For Performance Incentives And Physician Payment Mechanisms: Evidence From The Diabetes Management Incentive In Ontario," Health Economics, John Wiley & Sons, Ltd., vol. 22(12), pages 1417-1439, December.
    15. Guilherme Resende Oliveira & Benjamin Miranda Tabak & José Guilherme de Lara Resende & Daniel Oliveira Cajueiro, 2012. "Determinantes da Estrutura de Capital das Empresas Brasileiras: uma abordagem em regressão quantílica," Working Papers Series 272, Central Bank of Brazil, Research Department.
    16. John C. Ham & Xianghong Li & Patricia B. Reagan, 2004. "Propensity Score Matching, a Distance-Based Measure of Migration, and the Wage Growth of Young Men," Working Papers 2004_3, York University, Department of Economics.
    17. Cavaliere, Giuseppe & Nielsen, Heino Bohn & Pedersen, Rasmus Søndergaard & Rahbek, Anders, 2022. "Bootstrap inference on the boundary of the parameter space, with application to conditional volatility models," Journal of Econometrics, Elsevier, vol. 227(1), pages 241-263.
    18. Katarzyna Reluga & María‐José Lombardía & Stefan Sperlich, 2023. "Simultaneous inference for linear mixed model parameters with an application to small area estimation," International Statistical Review, International Statistical Institute, vol. 91(2), pages 193-217, August.
    19. Ham, John C. & Li, Xianghong & Reagan, Patricia B., 2011. "Matching and semi-parametric IV estimation, a distance-based measure of migration, and the wages of young men," Journal of Econometrics, Elsevier, vol. 161(2), pages 208-227, April.
    20. María Dolores Esteban & María José Lombardía & Esther López‐Vizcaíno & Domingo Morales & Agustín Pérez, 2022. "Empirical best prediction of small area bivariate parameters," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 49(4), pages 1699-1727, December.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:vrs:stintr:v:21:y:2020:i:2:p:35-60:n:5. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Peter Golla (email available below). General contact details of provider: https://stat.gov.pl/en/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.