IDEAS home Printed from https://ideas.repec.org/a/spr/compst/v31y2016i4d10.1007_s00180-016-0656-4.html
   My bibliography  Save this article

Preliminary tests when comparing means

Author

Listed:
  • I. Parra-Frutos

    (University of Murcia)

Abstract

The aim of this paper is to find a procedure to test equal means that is robust at the significance level. A simulation study is conducted to compare the performance of different strategies, including unconditionally applying the bootstrap ANOVA and twelve adaptive tests that take in pre-testing normality, homoscedasticity and skewness. Various final tests of equal means have been considered, like the ANOVA, bootstrap ANOVA, Welch, Brown–Forsythe and bootstrap James test. Our simulation results reveal that the usual adaptive test used by applied researchers (based on testing normality and homoscedasticity to choose from the ANOVA, Welch and Kruskal–Wallis tests) performs poorly. The simulation results show that preliminary tests may improve the performance of a test, and that this depends on the pre-tests chosen. In particular, we find that using decisions on normality to select the right homoscedasticity test and then choosing between the Brown–Forsythe test and the bootstrap ANOVA leads to controlling the Type I error rate in all of the settings studied.

Suggested Citation

  • I. Parra-Frutos, 2016. "Preliminary tests when comparing means," Computational Statistics, Springer, vol. 31(4), pages 1607-1631, December.
    • Handle: RePEc:spr:compst:v:31:y:2016:i:4:d:10.1007_s00180-016-0656-4
    DOI: 10.1007/s00180-016-0656-4
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s00180-016-0656-4
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s00180-016-0656-4?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. I. Parra-Frutos, 2013. "Testing homogeneity of variances with unequal sample sizes," Computational Statistics, Springer, vol. 28(3), pages 1269-1297, June.
    2. Lim, Tjen-Sien & Loh, Wei-Yin, 1996. "A comparison of tests of equality of variances," Computational Statistics & Data Analysis, Elsevier, vol. 22(3), pages 287-301, July.
    3. W. G. S. Hines & R. J. O'Hara Hines, 2000. "Increased Power with Modified Forms of the Levene (Med) Test for Heterogeneity of Variance," Biometrics, The International Biometric Society, vol. 56(2), pages 451-454, June.
    4. Kimihiro Noguchi & Yulia Gel, 2010. "Combination of Levene-type tests and a finite-intersection method for testing equality of variances against ordered alternatives," Journal of Nonparametric Statistics, Taylor & Francis Journals, vol. 22(7), pages 897-913.
    5. Dieter Rasch & Klaus Kubinger & Karl Moder, 2011. "The two-sample t test: pre-testing its assumptions does not pay off," Statistical Papers, Springer, vol. 52(1), pages 219-231, February.
    6. Cahoy, Dexter O., 2010. "A bootstrap test for equality of variances," Computational Statistics & Data Analysis, Elsevier, vol. 54(10), pages 2306-2316, October.
    7. Isabel Parra-Frutos, 2009. "The behaviour of the modified Levene’s test when data are not normally distributed," Computational Statistics, Springer, vol. 24(4), pages 671-693, December.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. I. Parra-Frutos, 2013. "Testing homogeneity of variances with unequal sample sizes," Computational Statistics, Springer, vol. 28(3), pages 1269-1297, June.
    2. Philip Pallmann & Ludwig Hothorn & Gemechis Djira, 2014. "A Levene-type test of homogeneity of variances against ordered alternatives," Computational Statistics, Springer, vol. 29(6), pages 1593-1608, December.
    3. Ryan C. Erps & Kimihiro Noguchi, 2020. "A Robust Test for Checking the Homogeneity of Variability Measures and Its Application to the Analysis of Implicit Attitudes," Journal of Educational and Behavioral Statistics, , vol. 45(4), pages 403-425, August.
    4. M. Dolores Jiménez-Gamero & Marina Valdora & Daniela Rodríguez, 2025. "Testing homoscedasticity of a large number of populations," Statistical Papers, Springer, vol. 66(2), pages 1-32, February.
    5. Ramos-Guajardo, Ana Belén & Lubiano, María Asunción, 2012. "K-sample tests for equality of variances of random fuzzy sets," Computational Statistics & Data Analysis, Elsevier, vol. 56(4), pages 956-966.
    6. Cahoy, Dexter O., 2010. "A bootstrap test for equality of variances," Computational Statistics & Data Analysis, Elsevier, vol. 54(10), pages 2306-2316, October.
    7. Leonie Kuen & Fiona Schürmann & Daniel Westmattelmann & Sophie Hartwig & Shay Tzafrir & Gerhard Schewe, 2023. "Trust transfer effects and associated risks in telemedicine adoption," Electronic Markets, Springer;IIM University of St. Gallen, vol. 33(1), pages 1-22, December.
    8. Mendez, Guillermo & Lohr, Sharon, 2011. "Estimating residual variance in random forest regression," Computational Statistics & Data Analysis, Elsevier, vol. 55(11), pages 2937-2950, November.
    9. Joep Burger & Jacqueline Beuningen, 2020. "Measuring well-being dispersion on discrete rating scales," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 149(3), pages 749-773, June.
    10. Ghasemi, M.-R. & Ignatius, Joshua & Emrouznejad, Ali, 2014. "A bi-objective weighted model for improving the discrimination power in MCDEA," European Journal of Operational Research, Elsevier, vol. 233(3), pages 640-650.
    11. David Curtis, 2024. "Welch’s t test is more sensitive to real world violations of distributional assumptions than student’s t test but logistic regression is more robust than either," Statistical Papers, Springer, vol. 65(6), pages 3981-3989, August.
    12. David Soave & Lei Sun, 2017. "A generalized Levene's scale test for variance heterogeneity in the presence of sample correlation and group uncertainty," Biometrics, The International Biometric Society, vol. 73(3), pages 960-971, September.
    13. Thorpe, David P. & Holland, Burt, 2000. "Some multiple comparison procedures for variances from non-normal populations," Computational Statistics & Data Analysis, Elsevier, vol. 35(2), pages 171-199, December.
    14. Jean-Marie Dufour & Emmanuel Flachaire & Lynda Khalaf, 2019. "Permutation Tests for Comparing Inequality Measures," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 37(3), pages 457-470, July.
    15. Nikishova, Anna & Comi, Giovanni E. & Hoekstra, Alfons G., 2020. "Sensitivity analysis based dimension reduction of multiscale models," Mathematics and Computers in Simulation (MATCOM), Elsevier, vol. 170(C), pages 205-220.
    16. Herbert Buning & Michael Rietz, 2008. "Adaptive bootstrap tests and its competitors in the c-sample scale problem," Journal of Applied Statistics, Taylor & Francis Journals, vol. 35(8), pages 853-866.
    17. Dominika Polko-Zając, 2019. "On Permutation Location–Scale Tests," Statistics in Transition New Series, Polish Statistical Association, vol. 20(4), pages 153-166, December.
    18. Liu, Xuhua & Xu, Xingzhong, 2010. "A new generalized p-value approach for testing the homogeneity of variances," Statistics & Probability Letters, Elsevier, vol. 80(19-20), pages 1486-1491, October.
    19. Polko-Zając Dominika, 2019. "On Permutation Location–Scale Tests," Statistics in Transition New Series, Statistics Poland, vol. 20(4), pages 153-166, December.
    20. Cooray, Arusha & Paradiso, Antonio & Truglia, Francesco Giovanni, 2013. "Do countries belonging to the same region suggest the same growth enhancing variables? Evidence from selected South Asian countries," Economic Modelling, Elsevier, vol. 33(C), pages 772-779.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:compst:v:31:y:2016:i:4:d:10.1007_s00180-016-0656-4. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.