IDEAS home Printed from https://ideas.repec.org/a/spr/metrik/v83y2020i2d10.1007_s00184-019-00729-2.html
   My bibliography  Save this article

The Behrens–Fisher problem with covariates and baseline adjustments

Author

Listed:
  • Cong Cao

    (The University of Texas at Dallas)

  • Markus Pauly

    (Technical University Dortmund)

  • Frank Konietschke

    (Charité—Universitätsmedizin Berlin, Corporate Member of Freie Universität Berlin, Humboldt-Universität zu Berlin
    Berlin Institute of Health, Institute of Biometry and Clinical Epidemiology)

Abstract

The Welch–Satterthwaite t test is one of the most prominent and often used statistical inference methods in applications. The approach is, however, not flexible with respect to adjustments for baseline values or other covariates, which may impact the response variable. Existing analysis of covariance models are typically based on the assumption of equal variances across the groups. This assumption is hard to justify in real data applications and the methods tend not to control the type-1 error rate satisfactorily under variance heteroscedasticity. In the present paper, we tackle this problem and develop unbiased variance estimators of group specific variances, and especially of the variance of the estimated adjusted treatment effect in a general analysis of covariance model. These results are used to generalize the Welch–Satterthwaite t test to covariates adjustments. Extensive simulation studies show that the method accurately controls the nominal type-1 error rate, even for very small sample sizes, moderately skewed distributions and under variance heteroscedasticity. A real data set motivates and illustrates the application of the proposed methods.

Suggested Citation

  • Cong Cao & Markus Pauly & Frank Konietschke, 2020. "The Behrens–Fisher problem with covariates and baseline adjustments," Metrika: International Journal for Theoretical and Applied Statistics, Springer, vol. 83(2), pages 197-215, February.
  • Handle: RePEc:spr:metrik:v:83:y:2020:i:2:d:10.1007_s00184-019-00729-2
    DOI: 10.1007/s00184-019-00729-2
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s00184-019-00729-2
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.

    File URL: https://libkey.io/10.1007/s00184-019-00729-2?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Guido W. Imbens & Michal Kolesár, 2016. "Robust Standard Errors in Small Samples: Some Practical Advice," The Review of Economics and Statistics, MIT Press, vol. 98(4), pages 701-712, October.
    2. A. Colin Cameron & Jonah B. Gelbach & Douglas L. Miller, 2008. "Bootstrap-Based Improvements for Inference with Clustered Errors," The Review of Economics and Statistics, MIT Press, vol. 90(3), pages 414-427, August.
    3. Graeme D. Ruxton, 2006. "The unequal variance t-test is an underused alternative to Student's t-test and the Mann--Whitney U test," Behavioral Ecology, International Society for Behavioral Ecology, vol. 17(4), pages 688-690, July.
    4. Emmanuel Flachaire, 2002. "Bootstrapping heteroskedasticity consistent covariance matrix estimator," Computational Statistics, Springer, vol. 17(4), pages 501-506, December.
    5. White, Halbert, 1980. "A Heteroskedasticity-Consistent Covariance Matrix Estimator and a Direct Test for Heteroskedasticity," Econometrica, Econometric Society, vol. 48(4), pages 817-838, May.
    6. MacKinnon, James G. & White, Halbert, 1985. "Some heteroskedasticity-consistent covariance matrix estimators with improved finite sample properties," Journal of Econometrics, Elsevier, vol. 29(3), pages 305-325, September.
    7. Jan Beyersmann & Susanna Di Termini & Markus Pauly, 2013. "Weak Convergence of the Wild Bootstrap for the Aalen–Johansen Estimator of the Cumulative Incidence Function of a Competing Risk," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 40(3), pages 387-402, September.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. MacKinnon, James G. & Nielsen, Morten Ørregaard & Webb, Matthew D., 2023. "Cluster-robust inference: A guide to empirical practice," Journal of Econometrics, Elsevier, vol. 232(2), pages 272-299.
    2. MacKinnon, James G. & Nielsen, Morten Ørregaard & Webb, Matthew D., 2023. "Testing for the appropriate level of clustering in linear regression models," Journal of Econometrics, Elsevier, vol. 235(2), pages 2027-2056.
    3. Antoine A. Djogbenou & James G. MacKinnon & Morten Ø. Nielsen, 2017. "Validity Of Wild Bootstrap Inference With Clustered Errors," Working Paper 1383, Economics Department, Queen's University.
    4. Jeffrey D. Michler & Anna Josephson, 2022. "Recent developments in inference: practicalities for applied economics," Chapters, in: A Modern Guide to Food Economics, chapter 11, pages 235-268, Edward Elgar Publishing.
    5. Djogbenou, Antoine A. & MacKinnon, James G. & Nielsen, Morten Ørregaard, 2019. "Asymptotic theory and wild bootstrap inference with clustered errors," Journal of Econometrics, Elsevier, vol. 212(2), pages 393-412.
    6. James G. MacKinnon & Matthew D. Webb, 2020. "When and How to Deal with Clustered Errors in Regression Models," Working Paper 1421, Economics Department, Queen's University.
    7. James G. MacKinnon & Morten Ørregaard Nielsen & Matthew D. Webb, 2023. "Fast and reliable jackknife and bootstrap methods for cluster‐robust inference," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 38(5), pages 671-694, August.
    8. James G. MacKinnon, 2019. "How cluster‐robust inference is changing applied econometrics," Canadian Journal of Economics/Revue canadienne d'économique, John Wiley & Sons, vol. 52(3), pages 851-881, August.
    9. Pötscher, Benedikt M. & Preinerstorfer, David, 2021. "Valid Heteroskedasticity Robust Testing," MPRA Paper 107420, University Library of Munich, Germany.
    10. A. Colin Cameron & Douglas L. Miller, 2010. "Robust Inference with Clustered Data," Working Papers 106, University of California, Davis, Department of Economics.
    11. Pötscher, Benedikt M. & Preinerstorfer, David, 2023. "How Reliable Are Bootstrap-Based Heteroskedasticity Robust Tests?," Econometric Theory, Cambridge University Press, vol. 39(4), pages 789-847, August.
    12. Hansen, Bruce E. & Lee, Seojeong, 2019. "Asymptotic theory for clustered samples," Journal of Econometrics, Elsevier, vol. 210(2), pages 268-290.
    13. Weidner, Martin & Zylkin, Thomas, 2021. "Bias and consistency in three-way gravity models," Journal of International Economics, Elsevier, vol. 132(C).
    14. A. Colin Cameron & Jonah B. Gelbach & Douglas L. Miller, 2008. "Bootstrap-Based Improvements for Inference with Clustered Errors," The Review of Economics and Statistics, MIT Press, vol. 90(3), pages 414-427, August.
    15. Packalen, Mikko & Wirjanto, Tony S., 2012. "Inference about clustering and parametric assumptions in covariance matrix estimation," Computational Statistics & Data Analysis, Elsevier, vol. 56(1), pages 1-14, January.
    16. Kenneth W. Clements & H. Y. Izan & Yihui Lan, 2009. "A Stochastic Measure of International Competitiveness," International Review of Finance, International Review of Finance Ltd., vol. 9(1‐2), pages 51-81, March.
    17. James G. MacKinnon & Morten {O}rregaard Nielsen & Matthew D. Webb, 2024. "Jackknife inference with two-way clustering," Papers 2406.08880, arXiv.org.
    18. Bruno Ferman & Cristine Pinto, 2019. "Inference in Differences-in-Differences with Few Treated Groups and Heteroskedasticity," The Review of Economics and Statistics, MIT Press, vol. 101(3), pages 452-467, July.
    19. A. Colin Cameron & Douglas L. Miller, 2015. "A Practitioner’s Guide to Cluster-Robust Inference," Journal of Human Resources, University of Wisconsin Press, vol. 50(2), pages 317-372.
    20. James G. MacKinnon & Morten Ørregaard Nielsen & Matthew D. Webb, 2023. "Leverage, influence, and the jackknife in clustered regression models: Reliable inference using summclust," Stata Journal, StataCorp LP, vol. 23(4), pages 942-982, December.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:metrik:v:83:y:2020:i:2:d:10.1007_s00184-019-00729-2. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.