IDEAS home Printed from https://ideas.repec.org/a/jss/jstsof/v064i09.html
   My bibliography  Save this article

nparcomp: An R Software Package for Nonparametric Multiple Comparisons and Simultaneous Confidence Intervals

Author

Listed:
  • Konietschke, Frank
  • Placzek, Marius
  • Schaarschmidt, Frank
  • Hothorn, Ludwig A.

Abstract

One-way layouts, i.e., a single factor with several levels and multiple observations at each level, frequently arise in various fields. Usually not only a global hypothesis is of interest but also multiple comparisons between the different treatment levels. In most practical situations, the distribution of observed data is unknown and there may exist a number of atypical measurements and outliers. Hence, use of parametric and semiparametric procedures that impose restrictive distributional assumptions on observed samples becomes questionable. This, in turn, emphasizes the demand on statistical procedures that enable us to accurately and reliably analyze one-way layouts with minimal conditions on available data. Nonparametric methods offer such a possibility and thus become of particular practical importance. In this article, we introduce a new R package nparcomp which provides an easy and user-friendly access to rank-based methods for the analysis of unbalanced one-way layouts. It provides procedures performing multiple comparisons and computing simultaneous confidence intervals for the estimated effects which can be easily visualized. The special case of two samples, the nonparametric Behrens-Fisher problem, is included. We illustrate the implemented procedures by examples from biology and medicine.

Suggested Citation

  • Konietschke, Frank & Placzek, Marius & Schaarschmidt, Frank & Hothorn, Ludwig A., 2015. "nparcomp: An R Software Package for Nonparametric Multiple Comparisons and Simultaneous Confidence Intervals," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 64(i09).
  • Handle: RePEc:jss:jstsof:v:064:i09
    DOI: http://hdl.handle.net/10.18637/jss.v064.i09
    as

    Download full text from publisher

    File URL: https://www.jstatsoft.org/index.php/jss/article/view/v064i09/v64i09.pdf
    Download Restriction: no

    File URL: https://www.jstatsoft.org/index.php/jss/article/downloadSuppFile/v064i09/nparcomp_2.6.tar.gz
    Download Restriction: no

    File URL: https://www.jstatsoft.org/index.php/jss/article/downloadSuppFile/v064i09/v64i09.R
    Download Restriction: no

    File URL: https://libkey.io/http://hdl.handle.net/10.18637/jss.v064.i09?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Bretz, Frank, 2006. "An extension of the Williams trend test to general unbalanced linear models," Computational Statistics & Data Analysis, Elsevier, vol. 50(7), pages 1735-1748, April.
    2. Browne, Richard H., 2010. "The t-Test p Value and Its Relationship to the Effect Size and P(X>Y)," The American Statistician, American Statistical Association, vol. 64(1), pages 30-33.
    3. Konietschke Frank & Bösiger Sandra & Brunner Edgar & Hothorn Ludwig A., 2013. "Are Multiple Contrast Tests Superior to the ANOVA?," The International Journal of Biostatistics, De Gruyter, vol. 9(1), pages 63-73, August.
    4. Neubert, Karin & Brunner, Edgar, 2007. "A studentized permutation test for the non-parametric Behrens-Fisher problem," Computational Statistics & Data Analysis, Elsevier, vol. 51(10), pages 5192-5204, June.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Pizarro, E. & Galleguillos, M. & Barría, P. & Callejas, R., 2022. "Irrigation management or climate change ? Which is more important to cope with water shortage in the production of table grape in a Mediterranean context," Agricultural Water Management, Elsevier, vol. 263(C).
    2. Juliette Richetin & Giulio Costantini & Marco Perugini & Felix Schönbrodt, 2015. "Should We Stop Looking for a Better Scoring Algorithm for Handling Implicit Association Test Data? Test of the Role of Errors, Extreme Latencies Treatment, Scoring Formula, and Practice Trials on Reli," PLOS ONE, Public Library of Science, vol. 10(6), pages 1-23, June.
    3. Halinski, Rosana & Garibaldi, Lucas Alejandro & dos Santos, Charles Fernando & Acosta, André Luis & Guidi, Daniel Dornelles & Blochtein, Betina, 2020. "Forest fragments and natural vegetation patches within crop fields contribute to higher oilseed rape yields in Brazil," Agricultural Systems, Elsevier, vol. 180(C).
    4. Kandianos Emmanouil Sakalidis & Stein Gerrit Paul Menting & Florentina Johanna Hettinga, 2023. "The Role of Cognition and Social Factors in Competition: How Do People with Intellectual Disabilities Respond to Opponents?," IJERPH, MDPI, vol. 20(3), pages 1-14, February.
    5. Jae Hyun Kim & Shinyeong Park & Seung Ho Kim & Eun Ju Lee, 2021. "Long-Term Land Cover Changes in the Western Part of the Korean Demilitarized Zone," Land, MDPI, vol. 10(7), pages 1-18, July.
    6. Laurent Augusto & Antra Boča, 2022. "Tree functional traits, forest biomass, and tree species diversity interact with site properties to drive forest soil carbon," Nature Communications, Nature, vol. 13(1), pages 1-12, December.
    7. Claudia Kedor & Helma Freitag & Lil Meyer-Arndt & Kirsten Wittke & Leif G. Hanitsch & Thomas Zoller & Fridolin Steinbeis & Milan Haffke & Gordon Rudolf & Bettina Heidecker & Thomas Bobbert & Joachim S, 2022. "A prospective observational study of post-COVID-19 chronic fatigue syndrome following the first pandemic wave in Germany and biomarkers associated with symptom severity," Nature Communications, Nature, vol. 13(1), pages 1-13, December.
    8. Celia M. Gagliardi & Marc E. Normandin & Alexandra T. Keinath & Joshua B. Julian & Matthew R. Lopez & Manuel-Miguel Ramos-Alvarez & Russell A. Epstein & Isabel A. Muzzio, 2024. "Distinct neural mechanisms for heading retrieval and context recognition in the hippocampus during spatial reorientation," Nature Communications, Nature, vol. 15(1), pages 1-22, December.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Philip Pallmann & Ludwig Hothorn & Gemechis Djira, 2014. "A Levene-type test of homogeneity of variances against ordered alternatives," Computational Statistics, Springer, vol. 29(6), pages 1593-1608, December.
    2. Philip Pallmann & Ludwig A. Hothorn, 2016. "Analysis of means: a generalized approach using R," Journal of Applied Statistics, Taylor & Francis Journals, vol. 43(8), pages 1541-1560, June.
    3. Marinho Bertanha & Eunyi Chung, 2023. "Permutation Tests at Nonparametric Rates," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 118(544), pages 2833-2846, October.
    4. Hasler Mario, 2013. "Multiple Contrasts for Repeated Measures," The International Journal of Biostatistics, De Gruyter, vol. 9(1), pages 49-61, July.
    5. Mario Hasler, 2016. "Heteroscedasticity: multiple degrees of freedom vs. sandwich estimation," Statistical Papers, Springer, vol. 57(1), pages 55-68, March.
    6. Hothorn Ludwig A & Sill Martin & Schaarschmidt Frank, 2010. "Evaluation of Incidence Rates in Pre-Clinical Studies Using a Williams-Type Procedure," The International Journal of Biostatistics, De Gruyter, vol. 6(1), pages 1-19, April.
    7. Purevdorj Tuvaandorj, 2021. "Robust Permutation Tests in Linear Instrumental Variables Regression," Papers 2111.13774, arXiv.org, revised Jul 2024.
    8. Stefano Bonnini & Getnet Melak Assegie & Kamila Trzcinska, 2024. "Review about the Permutation Approach in Hypothesis Testing," Mathematics, MDPI, vol. 12(17), pages 1-29, August.
    9. Chung, EunYi & Romano, Joseph P., 2016. "Multivariate and multiple permutation tests," Journal of Econometrics, Elsevier, vol. 193(1), pages 76-91.
    10. Gunawardana, Asanka & Konietschke, Frank, 2019. "Nonparametric multiple contrast tests for general multivariate factorial designs," Journal of Multivariate Analysis, Elsevier, vol. 173(C), pages 165-180.
    11. Dennis Dobler & Markus Pauly, 2018. "Bootstrap- and permutation-based inference for the Mann–Whitney effect for right-censored and tied data," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 27(3), pages 639-658, September.
    12. Kristaps Lesinskis & Inese Mavlutova & Aivars Spilbergs & Janis Hermanis, 2023. "Digital Transformation in Entrepreneurship Education: The Use of a Digital Tool KABADA and Entrepreneurial Intention of Generation Z," Sustainability, MDPI, vol. 15(13), pages 1-20, June.
    13. Juwon Seo, 2018. "Randomization Tests for Equality in Dependence Structure," Papers 1811.02105, arXiv.org.
    14. Marko Hofmann & Silja Meyer-Nieberg, 2018. "Time to dispense with the p-value in OR?," Central European Journal of Operations Research, Springer;Slovak Society for Operations Research;Hungarian Operational Research Society;Czech Society for Operations Research;Österr. Gesellschaft für Operations Research (ÖGOR);Slovenian Society Informatika - Section for Operational Research;Croatian Operational Research Society, vol. 26(1), pages 193-214, March.
    15. Kitsche, A. & Hothorn, L.A. & Schaarschmidt, F., 2012. "The use of historical controls in estimating simultaneous confidence intervals for comparisons against a concurrent control," Computational Statistics & Data Analysis, Elsevier, vol. 56(12), pages 3865-3875.
    16. Hasler Mario & Hothorn Ludwig A, 2011. "A Dunnett-Type Procedure for Multiple Endpoints," The International Journal of Biostatistics, De Gruyter, vol. 7(1), pages 1-15, January.
    17. Eleni Verykouki & Christos T. Nakas, 2023. "Adaptations on the Use of p -Values for Statistical Inference: An Interpretation of Messages from Recent Public Discussions," Stats, MDPI, vol. 6(2), pages 1-13, April.
    18. repec:sip:wpaper:12-026 is not listed on IDEAS
    19. Yang, Shuai & Wang, Yizhe & Li, Zhen & Chen, Chiyin & Yu, Ziyue, 2022. "Time-of-day effects on (un)healthy product purchases: Insights from diverse consumer behavior data," Journal of Business Research, Elsevier, vol. 152(C), pages 447-460.
    20. Quessy, Jean-François & Éthier, François, 2012. "Cramér–von Mises and characteristic function tests for the two and k-sample problems with dependent data," Computational Statistics & Data Analysis, Elsevier, vol. 56(6), pages 2097-2111.
    21. Bogomolov, Marina & Davidov, Ori, 2019. "Order restricted univariate and multivariate inference with adjustment for covariates in partially linear models," Computational Statistics & Data Analysis, Elsevier, vol. 133(C), pages 20-27.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:jss:jstsof:v:064:i09. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Christopher F. Baum (email available below). General contact details of provider: http://www.jstatsoft.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.