IDEAS home Printed from https://ideas.repec.org/a/eee/jmvana/v121y2013icp33-49.html
   My bibliography  Save this article

Optimal generalized truncated sequential Monte Carlo test

Author

Listed:
  • Silva, Ivair R.
  • Assunção, Renato M.

Abstract

When it is not possible to obtain the analytical null distribution of a test statistic U, Monte Carlo hypothesis tests can be used to perform the test. Monte Carlo tests are commonly used in a wide variety of applications, including spatial statistics, and biostatistics. Conventional Monte Carlo tests require the simulation of m independent copies from U under the null hypothesis, what is computationally intensive for large data sets. Truncated sequential Monte Carlo designs can be performed to reduce computational effort in such situations. Different truncated sequential procedures have been proposed. They work under restrictive assumptions on the distribution of U aiming to bound the power loss and to reduce execution time. Since the use of Monte Carlo tests are based on the situations where the null distribution of U is unknown, their results are not valid for the general case of any test statistic. In this paper, we derive an optimal scheme for truncated sequential Monte Carlo hypothesis tests. This scheme minimizes the expected number of simulations under any alternative hypothesis, and bounds the power loss in arbitrarily small values. The first advantage from this scheme is that the results concerning the power and the expected time are valid for any test statistic. Also, we present practical examples of optimal procedures for which the expected number of simulations are reduced by 60% in comparison with some of the best procedures in the literature.

Suggested Citation

  • Silva, Ivair R. & Assunção, Renato M., 2013. "Optimal generalized truncated sequential Monte Carlo test," Journal of Multivariate Analysis, Elsevier, vol. 121(C), pages 33-49.
    • Handle: RePEc:eee:jmvana:v:121:y:2013:i:c:p:33-49
    DOI: 10.1016/j.jmva.2013.06.003
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0047259X13001152
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.jmva.2013.06.003?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Martin Kulldorff, 2001. "Prospective time periodic geographical disease surveillance using a scan statistic," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 164(1), pages 61-72.
    2. Gandy, Axel, 2009. "Sequential Implementation of Monte Carlo Tests With Uniformly Bounded Resampling Risk," Journal of the American Statistical Association, American Statistical Association, vol. 104(488), pages 1504-1511.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Hahn, Georg, 2020. "On the expected runtime of multiple testing algorithms with bounded error," Statistics & Probability Letters, Elsevier, vol. 165(C).
    2. Dong Ding & Axel Gandy & Georg Hahn, 2020. "A simple method for implementing Monte Carlo tests," Computational Statistics, Springer, vol. 35(3), pages 1373-1392, September.
    3. Silva, Ivair R., 2017. "Confidence intervals through sequential Monte Carlo," Computational Statistics & Data Analysis, Elsevier, vol. 105(C), pages 112-124.
    4. Axel Gandy & Georg Hahn & Dong Ding, 2020. "Implementing Monte Carlo tests with p‐value buckets," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 47(3), pages 950-967, September.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Dong Ding & Axel Gandy & Georg Hahn, 2020. "A simple method for implementing Monte Carlo tests," Computational Statistics, Springer, vol. 35(3), pages 1373-1392, September.
    2. Sami Ullah & Hanita Daud & Sarat C. Dass & Hadi Fanaee-T & Husnul Kausarian & Alamgir, 2020. "Space-Time Clustering Characteristics of Tuberculosis in Khyber Pakhtunkhwa Province, Pakistan, 2015–2019," IJERPH, MDPI, vol. 17(4), pages 1-10, February.
    3. Costa, Marcelo Azevedo & Ruiz-Cárdenas, Ramiro & Mineti, Leandro Brioschi & Prates, Marcos Oliveira, 2021. "Dynamic time scan forecasting for multi-step wind speed prediction," Renewable Energy, Elsevier, vol. 177(C), pages 584-595.
    4. Yingqi Zhao & Donglin Zeng & Amy H. Herring & Amy Ising & Anna Waller & David Richardson & Michael R. Kosorok, 2011. "Detecting Disease Outbreaks Using Local Spatiotemporal Methods," Biometrics, The International Biometric Society, vol. 67(4), pages 1508-1517, December.
    5. Linus Schiöler & Marianne Fris�n, 2012. "Multivariate outbreak detection," Journal of Applied Statistics, Taylor & Francis Journals, vol. 39(2), pages 223-242, April.
    6. Hadeel AlQadi & Majid Bani-Yaghoub & Sindhu Balakumar & Siqi Wu & Alex Francisco, 2021. "Assessment of Retrospective COVID-19 Spatial Clusters with Respect to Demographic Factors: Case Study of Kansas City, Missouri, United States," IJERPH, MDPI, vol. 18(21), pages 1-15, November.
    7. Ibrahim Musa & Hyun Woo Park & Lkhagvadorj Munkhdalai & Keun Ho Ryu, 2018. "Global Research on Syndromic Surveillance from 1993 to 2017: Bibliometric Analysis and Visualization," Sustainability, MDPI, vol. 10(10), pages 1-20, September.
    8. Frisén, Marianne, 2008. "Introduction to financial surveillance," Research Reports 2008:1, University of Gothenburg, Statistical Research Unit, School of Business, Economics and Law.
    9. James, Nicholas A. & Matteson, David S., 2015. "ecp: An R Package for Nonparametric Multiple Change Point Analysis of Multivariate Data," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 62(i07).
    10. Jingnan Zhang & Yicheng Kang & Yang Yang & Peihua Qiu, 2015. "Statistical monitoring of the hand, foot and mouth disease in China," Biometrics, The International Biometric Society, vol. 71(3), pages 841-850, September.
    11. M. R. Martines & R. V. Ferreira & R. H. Toppa & L. M. Assunção & M. R. Desjardins & E. M. Delmelle, 2021. "Detecting space–time clusters of COVID-19 in Brazil: mortality, inequality, socioeconomic vulnerability, and the relative risk of the disease in Brazilian municipalities," Journal of Geographical Systems, Springer, vol. 23(1), pages 7-36, January.
    12. Sami Ullah & Hanita Daud & Sarat C Dass & Hadi Fanaee-T & Alamgir Khalil, 2018. "An Eigenspace approach for detecting multiple space-time disease clusters: Application to measles hotspots detection in Khyber-Pakhtunkhwa, Pakistan," PLOS ONE, Public Library of Science, vol. 13(6), pages 1-13, June.
    13. Sevvandi Kandanaarachchi & Rob J Hyndman & Kate Smith-Miles, 2020. "Early classification of spatio-temporal events using partial information," PLOS ONE, Public Library of Science, vol. 15(8), pages 1-39, August.
    14. Assuno, Renato & Correa, Thais, 2009. "Surveillance to detect emerging space-time clusters," Computational Statistics & Data Analysis, Elsevier, vol. 53(8), pages 2817-2830, June.
    15. Lele Deng & Yajun Han & Jinlong Wang & Haican Liu & Guilian Li & Dayan Wang & Guangxue He, 2023. "Epidemiological Characteristics of Notifiable Respiratory Infectious Diseases in Mainland China from 2010 to 2018," IJERPH, MDPI, vol. 20(5), pages 1-16, February.
    16. Suparna Das & Jenevieve Opoku & Adam Allston & Michael Kharfen, 2018. "Detecting spatial clusters of HIV and hepatitis coinfections," PLOS ONE, Public Library of Science, vol. 13(9), pages 1-13, September.
    17. de Lima, Max Sousa & Duczmal, Luiz Henrique, 2014. "Adaptive likelihood ratio approaches for the detection of space–time disease clusters," Computational Statistics & Data Analysis, Elsevier, vol. 77(C), pages 352-370.
    18. Nicolai Meinshausen & Peter Bühlmann, 2010. "Stability selection," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 72(4), pages 417-473, September.
    19. Schiöler, Linus, 2009. "Explorative analysis of spatial patterns of influenza incidences in Sweden 1999—2008," Research Reports 2008:5, University of Gothenburg, Statistical Research Unit, School of Business, Economics and Law.
    20. Thais Paiva & Renato Assunção & Taynãna Simões, 2015. "Prospective space–time surveillance with cumulative surfaces for geographical identification of the emerging cluster," Computational Statistics, Springer, vol. 30(2), pages 419-440, June.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:jmvana:v:121:y:2013:i:c:p:33-49. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/622892/description#description .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.