IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2007.07065.html
   My bibliography  Save this paper

A More Robust t-Test

Author

Listed:
  • Ulrich K. Mueller

Abstract

Standard inference about a scalar parameter estimated via GMM amounts to applying a t-test to a particular set of observations. If the number of observations is not very large, then moderately heavy tails can lead to poor behavior of the t-test. This is a particular problem under clustering, since the number of observations then corresponds to the number of clusters, and heterogeneity in cluster sizes induces a form of heavy tails. This paper combines extreme value theory for the smallest and largest observations with a normal approximation for the average of the remaining observations to construct a more robust alternative to the t-test. The new test is found to control size much more successfully in small samples compared to existing methods. Analytical results in the canonical inference for the mean problem demonstrate that the new test provides a refinement over the full sample t-test under more than two but less than three moments, while the bootstrapped t-test does not.

Suggested Citation

  • Ulrich K. Mueller, 2020. "A More Robust t-Test," Papers 2007.07065, arXiv.org.
  • Handle: RePEc:arx:papers:2007.07065
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/2007.07065
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Graham Elliott & Ulrich K. Müller & Mark W. Watson, 2015. "Nearly Optimal Tests When a Nuisance Parameter Is Present Under the Null Hypothesis," Econometrica, Econometric Society, vol. 83, pages 771-811, March.
    2. Hansen, Lars Peter, 1982. "Large Sample Properties of Generalized Method of Moments Estimators," Econometrica, Econometric Society, vol. 50(4), pages 1029-1054, July.
    3. Guido W. Imbens & Michal Kolesár, 2016. "Robust Standard Errors in Small Samples: Some Practical Advice," The Review of Economics and Statistics, MIT Press, vol. 98(4), pages 701-712, October.
    4. A. Colin Cameron & Jonah B. Gelbach & Douglas L. Miller, 2008. "Bootstrap-Based Improvements for Inference with Clustered Errors," The Review of Economics and Statistics, MIT Press, vol. 90(3), pages 414-427, August.
    5. White, Halbert, 1980. "A Heteroskedasticity-Consistent Covariance Matrix Estimator and a Direct Test for Heteroskedasticity," Econometrica, Econometric Society, vol. 48(4), pages 817-838, May.
    6. Ulrich K. Müller & Yulong Wang, 2017. "Fixed- Asymptotic Inference About Tail Properties," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 112(519), pages 1334-1343, July.
    7. Karl H. Schlag, 2007. "How to Attain Minimax Risk with Applications to Distribution-Free Nonparametric Estimation and Testing," Economics Working Papers ECO2007/04, European University Institute.
    8. Peng, Liang, 2001. "Estimating the mean of a heavy tailed distribution," Statistics & Probability Letters, Elsevier, vol. 52(3), pages 255-264, April.
    9. Gossner, Olivier & Schlag, Karl H., 2013. "Finite-sample exact tests for linear regressions with bounded dependent variables," Journal of Econometrics, Elsevier, vol. 177(1), pages 75-84.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Ulrich K. Müller, 2020. "A More Robust t-Test," Working Papers 2020-32, Princeton University. Economics Department..
    2. Hansen, Bruce E. & Lee, Seojeong, 2019. "Asymptotic theory for clustered samples," Journal of Econometrics, Elsevier, vol. 210(2), pages 268-290.
    3. Jungbin Hwang, 2017. "Simple and Trustworthy Cluster-Robust GMM Inference," Working papers 2017-19, University of Connecticut, Department of Economics, revised Aug 2020.
    4. MacKinnon, James G. & Nielsen, Morten Ørregaard & Webb, Matthew D., 2023. "Cluster-robust inference: A guide to empirical practice," Journal of Econometrics, Elsevier, vol. 232(2), pages 272-299.
    5. MacKinnon, James G. & Nielsen, Morten Ørregaard & Webb, Matthew D., 2023. "Testing for the appropriate level of clustering in linear regression models," Journal of Econometrics, Elsevier, vol. 235(2), pages 2027-2056.
    6. Bruno Ferman & Cristine Pinto, 2019. "Inference in Differences-in-Differences with Few Treated Groups and Heteroskedasticity," The Review of Economics and Statistics, MIT Press, vol. 101(3), pages 452-467, July.
    7. Antoine A. Djogbenou & James G. MacKinnon & Morten Ø. Nielsen, 2017. "Validity Of Wild Bootstrap Inference With Clustered Errors," Working Paper 1383, Economics Department, Queen's University.
    8. Tobias Pfaff & Johannes Hirata, 2013. "Testing the Easterlin Hypothesis with Panel Data: The Dynamic Relationship between Life Satisfaction and Economic Growth in Germany and the UK," SOEPpapers on Multidisciplinary Panel Data Research 554, DIW Berlin, The German Socio-Economic Panel (SOEP).
    9. Pfaff, Tobias & Hirata, Johannes, 2013. "Testing the Easterlin hypothesis with panel data: The dynamic relationship between life satisfaction and economic growth in Germany and in the UK," CIW Discussion Papers 4/2013, University of Münster, Center for Interdisciplinary Economics (CIW).
    10. Jeffrey D. Michler & Anna Josephson, 2022. "Recent developments in inference: practicalities for applied economics," Chapters, in: A Modern Guide to Food Economics, chapter 11, pages 235-268, Edward Elgar Publishing.
    11. Cong Cao & Markus Pauly & Frank Konietschke, 2020. "The Behrens–Fisher problem with covariates and baseline adjustments," Metrika: International Journal for Theoretical and Applied Statistics, Springer, vol. 83(2), pages 197-215, February.
    12. James G. MacKinnon, 2012. "Thirty Years Of Heteroskedasticity-robust Inference," Working Paper 1268, Economics Department, Queen's University.
    13. Slawa Rokicki & Jessica Cohen & Gunther Fink & Joshua Salomon & Mary Beth Landrum, 2018. "Inference with difference-in-differences with a small number of groups: a review, simulation study and empirical application using SHARE data," CHaRMS Working Papers 18-01, Centre for HeAlth Research at the Management School (CHaRMS).
    14. Hwang, Jungbin, 2021. "Simple and trustworthy cluster-robust GMM inference," Journal of Econometrics, Elsevier, vol. 222(2), pages 993-1023.
    15. Djogbenou, Antoine A. & MacKinnon, James G. & Nielsen, Morten Ørregaard, 2019. "Asymptotic theory and wild bootstrap inference with clustered errors," Journal of Econometrics, Elsevier, vol. 212(2), pages 393-412.
    16. Pfaff, Tobias & Hirata, Johannes, 2013. "Testing the Easterlin hypothesis with panel data: The dynamic relationship between life satisfaction and economic growth in Germany and in the UK," VfS Annual Conference 2013 (Duesseldorf): Competition Policy and Regulation in a Global Economic Order 79965, Verein für Socialpolitik / German Economic Association.
    17. repec:fgv:eesptd:411 is not listed on IDEAS
    18. Timothy Conley & Silvia Gonçalves & Christian Hansen, 2018. "Inference with Dependent Data in Accounting and Finance Applications," Journal of Accounting Research, Wiley Blackwell, vol. 56(4), pages 1139-1203, September.
    19. Konstantinos Metaxoglou, 2021. "Canadian Journal of Economics: A historic overview," Canadian Journal of Economics/Revue canadienne d'économique, John Wiley & Sons, vol. 54(3), pages 1418-1453, November.
    20. James G. MacKinnon & Matthew D. Webb, 2020. "When and How to Deal with Clustered Errors in Regression Models," Working Paper 1421, Economics Department, Queen's University.
    21. Jongmoo Jay Choi & Hoje Jo & Jimi Kim & Moo Sung Kim, 2018. "Business Groups and Corporate Social Responsibility," Journal of Business Ethics, Springer, vol. 153(4), pages 931-954, December.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2007.07065. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.