IDEAS home Printed from https://ideas.repec.org/a/spr/aistmt/v72y2020i4d10.1007_s10463-019-00717-3.html
   My bibliography  Save this article

Nonparametric MANOVA in meaningful effects

Author

Listed:
  • Dennis Dobler

    (Vrije Universiteit Amsterdam)

  • Sarah Friedrich

    (University of Copenhagen)

  • Markus Pauly

    (Technical University of Dortmund)

Abstract

Multivariate analysis of variance (MANOVA) is a powerful and versatile method to infer and quantify main and interaction effects in metric multivariate multi-factor data. It is, however, neither robust against change in units nor meaningful for ordinal data. Thus, we propose a novel nonparametric MANOVA. Contrary to existing rank-based procedures, we infer hypotheses formulated in terms of meaningful Mann–Whitney-type effects in lieu of distribution functions. The tests are based on a quadratic form in multivariate rank effect estimators, and critical values are obtained by bootstrap techniques. The newly developed procedures provide asymptotically exact and consistent inference for general models such as the nonparametric Behrens–Fisher problem and multivariate one-, two-, and higher-way crossed layouts. Computer simulations in small samples confirm the reliability of the developed method for ordinal and metric data with covariance heterogeneity. Finally, an analysis of a real data example illustrates the applicability and correct interpretation of the results.

Suggested Citation

  • Dennis Dobler & Sarah Friedrich & Markus Pauly, 2020. "Nonparametric MANOVA in meaningful effects," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 72(4), pages 997-1022, August.
  • Handle: RePEc:spr:aistmt:v:72:y:2020:i:4:d:10.1007_s10463-019-00717-3
    DOI: 10.1007/s10463-019-00717-3
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s10463-019-00717-3
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.

    File URL: https://libkey.io/10.1007/s10463-019-00717-3?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Davidson, Russell & Flachaire, Emmanuel, 2008. "The wild bootstrap, tamed at last," Journal of Econometrics, Elsevier, vol. 146(1), pages 162-169, September.
    2. Bathke, Arne C. & Harrar, Solomon W. & Madden, Laurence V., 2008. "How to compare small multivariate samples using nonparametric tests," Computational Statistics & Data Analysis, Elsevier, vol. 52(11), pages 4951-4965, July.
    3. Solomon Harrar & Arne Bathke, 2012. "Erratum to: A modified two-factor multivariate analysis of variance: asymptotics and small sample approximations," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 64(5), pages 1087-1087, October.
    4. Gao, Xin & Alvo, Mayer, 2005. "A Unified Nonparametric Approach for Unbalanced Factorial Designs," Journal of the American Statistical Association, American Statistical Association, vol. 100, pages 926-941, September.
    5. Solomon Harrar & Arne Bathke, 2012. "A modified two-factor multivariate analysis of variance: asymptotics and small sample approximations," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 64(1), pages 135-165, February.
    6. Friedrich, Sarah & Konietschke, Frank & Pauly, Markus, 2017. "A wild bootstrap approach for nonparametric repeated measurements," Computational Statistics & Data Analysis, Elsevier, vol. 113(C), pages 38-52.
    7. Friedrich, Sarah & Pauly, Markus, 2018. "MATS: Inference for potentially singular and heteroscedastic MANOVA," Journal of Multivariate Analysis, Elsevier, vol. 165(C), pages 166-179.
    8. Edgar Brunner & Frank Konietschke & Markus Pauly & Madan L. Puri, 2017. "Rank-based procedures in factorial designs: hypotheses about non-parametric treatment effects," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 79(5), pages 1463-1485, November.
    9. Jan De Neve & Olivier Thas, 2015. "A Regression Framework for Rank Tests Based on the Probabilistic Index Model," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 110(511), pages 1276-1283, September.
    10. Harrar, Solomon W. & Bathke, Arne C., 2008. "Nonparametric methods for unbalanced multivariate data and many factor levels," Journal of Multivariate Analysis, Elsevier, vol. 99(8), pages 1635-1664, September.
    11. Edgar Brunner & Madan Puri, 2001. "Nonparametric methods in factorial designs," Statistical Papers, Springer, vol. 42(1), pages 1-52, January.
    12. B.M. Brown & T.P. Hettmansperger, 2002. "Kruskal–Wallis, Multiple Comparisons and Efron Dice," Australian & New Zealand Journal of Statistics, Australian Statistical Publishing Association Inc., vol. 44(4), pages 427-438, December.
    13. Umlauft, Maria & Placzek, Marius & Konietschke, Frank & Pauly, Markus, 2019. "Wild bootstrapping rank-based procedures: Multiple testing in nonparametric factorial repeated measures designs," Journal of Multivariate Analysis, Elsevier, vol. 171(C), pages 176-192.
    14. Olivier Thas & Jan De Neve & Lieven Clement & Jean-Pierre Ottoy, 2012. "Probabilistic index models," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 74(4), pages 623-671, September.
    15. Konietschke, Frank & Bathke, Arne C. & Harrar, Solomon W. & Pauly, Markus, 2015. "Parametric and nonparametric bootstrap methods for general MANOVA," Journal of Multivariate Analysis, Elsevier, vol. 140(C), pages 291-301.
    16. Munzel, Ullrich, 1999. "Linear rank score statistics when ties are present," Statistics & Probability Letters, Elsevier, vol. 41(4), pages 389-395, February.
    17. Burchett, Woodrow W. & Ellis, Amanda R. & Harrar, Solomon W. & Bathke, Arne C., 2017. "Nonparametric Inference for Multivariate Data: The R Package npmv," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 76(i04).
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Schmid, Lena & Gerharz, Alexander & Groll, Andreas & Pauly, Markus, 2023. "Tree-based ensembles for multi-output regression: Comparing multivariate approaches with separate univariate ones," Computational Statistics & Data Analysis, Elsevier, vol. 179(C).
    2. Edgar Brunner & Frank Konietschke & Arne C. Bathke & Markus Pauly, 2021. "Ranks and Pseudo‐ranks—Surprising Results of Certain Rank Tests in Unbalanced Designs," International Statistical Review, International Statistical Institute, vol. 89(2), pages 349-366, August.
    3. Harrar, Solomon W. & Kong, Xiaoli, 2022. "Recent developments in high-dimensional inference for multivariate data: Parametric, semiparametric and nonparametric approaches," Journal of Multivariate Analysis, Elsevier, vol. 188(C).
    4. Baumeister, Marléne & Ditzhaus, Marc & Pauly, Markus, 2024. "Quantile-based MANOVA: A new tool for inferring multivariate data in factorial designs," Journal of Multivariate Analysis, Elsevier, vol. 199(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Friedrich, Sarah & Pauly, Markus, 2018. "MATS: Inference for potentially singular and heteroscedastic MANOVA," Journal of Multivariate Analysis, Elsevier, vol. 165(C), pages 166-179.
    2. Gunawardana, Asanka & Konietschke, Frank, 2019. "Nonparametric multiple contrast tests for general multivariate factorial designs," Journal of Multivariate Analysis, Elsevier, vol. 173(C), pages 165-180.
    3. Debajit Chatterjee & Uttam Bandyopadhyay, 2019. "Testing in nonparametric ANCOVA model based on ridit reliability functional," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 71(2), pages 327-364, April.
    4. Edgar Brunner & Frank Konietschke & Arne C. Bathke & Markus Pauly, 2021. "Ranks and Pseudo‐ranks—Surprising Results of Certain Rank Tests in Unbalanced Designs," International Statistical Review, International Statistical Institute, vol. 89(2), pages 349-366, August.
    5. Edgar Brunner & Frank Konietschke & Markus Pauly & Madan L. Puri, 2017. "Rank-based procedures in factorial designs: hypotheses about non-parametric treatment effects," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 79(5), pages 1463-1485, November.
    6. Harrar, Solomon W. & Kong, Xiaoli, 2022. "Recent developments in high-dimensional inference for multivariate data: Parametric, semiparametric and nonparametric approaches," Journal of Multivariate Analysis, Elsevier, vol. 188(C).
    7. Zimmermann, Georg & Pauly, Markus & Bathke, Arne C., 2020. "Multivariate analysis of covariance with potentially singular covariance matrices and non-normal responses," Journal of Multivariate Analysis, Elsevier, vol. 177(C).
    8. Umlauft, Maria & Placzek, Marius & Konietschke, Frank & Pauly, Markus, 2019. "Wild bootstrapping rank-based procedures: Multiple testing in nonparametric factorial repeated measures designs," Journal of Multivariate Analysis, Elsevier, vol. 171(C), pages 176-192.
    9. Konietschke, Frank & Bathke, Arne C. & Harrar, Solomon W. & Pauly, Markus, 2015. "Parametric and nonparametric bootstrap methods for general MANOVA," Journal of Multivariate Analysis, Elsevier, vol. 140(C), pages 291-301.
    10. Rosa Arboretti & Riccardo Ceccato & Livio Corain & Fabrizio Ronchi & Luigi Salmaso, 2018. "Multivariate small sample tests for two-way designs with applications to industrial statistics," Statistical Papers, Springer, vol. 59(4), pages 1483-1503, December.
    11. Hasler Mario, 2014. "Multiple Contrast Tests for Multiple Endpoints in the Presence of Heteroscedasticity," The International Journal of Biostatistics, De Gruyter, vol. 10(1), pages 17-28, May.
    12. Baumeister, Marléne & Ditzhaus, Marc & Pauly, Markus, 2024. "Quantile-based MANOVA: A new tool for inferring multivariate data in factorial designs," Journal of Multivariate Analysis, Elsevier, vol. 199(C).
    13. Bathke, Arne C. & Harrar, Solomon W. & Madden, Laurence V., 2008. "How to compare small multivariate samples using nonparametric tests," Computational Statistics & Data Analysis, Elsevier, vol. 52(11), pages 4951-4965, July.
    14. Friedrich, Sarah & Konietschke, Frank & Pauly, Markus, 2017. "A wild bootstrap approach for nonparametric repeated measurements," Computational Statistics & Data Analysis, Elsevier, vol. 113(C), pages 38-52.
    15. Xu, Li-Wen, 2015. "Parametric bootstrap approaches for two-way MANOVA with unequal cell sizes and unequal cell covariance matrices," Journal of Multivariate Analysis, Elsevier, vol. 133(C), pages 291-303.
    16. Stefano Bonnini & Getnet Melak Assegie & Kamila Trzcinska, 2024. "Review about the Permutation Approach in Hypothesis Testing," Mathematics, MDPI, vol. 12(17), pages 1-29, August.
    17. Rauf Ahmad, M. & Werner, C. & Brunner, E., 2008. "Analysis of high-dimensional repeated measures designs: The one sample case," Computational Statistics & Data Analysis, Elsevier, vol. 53(2), pages 416-427, December.
    18. Amorim, G. & Thas, O. & Vermeulen, K. & Vansteelandt, S. & De Neve, J., 2018. "Small sample inference for probabilistic index models," Computational Statistics & Data Analysis, Elsevier, vol. 121(C), pages 137-148.
    19. Fan, Chunpeng & Zhang, Donghui, 2014. "Wald-type rank tests: A GEE approach," Computational Statistics & Data Analysis, Elsevier, vol. 74(C), pages 1-16.
    20. Konietschke, F. & Bathke, A.C. & Hothorn, L.A. & Brunner, E., 2010. "Testing and estimation of purely nonparametric effects in repeated measures designs," Computational Statistics & Data Analysis, Elsevier, vol. 54(8), pages 1895-1905, August.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:aistmt:v:72:y:2020:i:4:d:10.1007_s10463-019-00717-3. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.