IDEAS home Printed from https://ideas.repec.org/p/arx/papers/1911.04696.html
   My bibliography  Save this paper

Extended MinP Tests for Global and Multiple testing

Author

Listed:
  • Zeng-Hua Lu

Abstract

Empirical economic studies often involve multiple propositions or hypotheses, with researchers aiming to assess both the collective and individual evidence against these propositions or hypotheses. To rigorously assess this evidence, practitioners frequently employ tests with quadratic test statistics, such as $F$-tests and Wald tests, or tests based on minimum/maximum type test statistics. This paper introduces a combination test that merges these two classes of tests using the minimum $p$-value principle. The proposed test capitalizes on the global power advantages of both constituent tests while retaining the benefits of the stepdown procedure from minimum/maximum type tests.

Suggested Citation

  • Zeng-Hua Lu, 2019. "Extended MinP Tests for Global and Multiple testing," Papers 1911.04696, arXiv.org, revised Aug 2024.
    • Handle: RePEc:arx:papers:1911.04696
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/1911.04696
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. John A. List & Azeem M. Shaikh & Yang Xu, 2019. "Multiple hypothesis testing in experimental economics," Experimental Economics, Springer;Economic Science Association, vol. 22(4), pages 773-793, December.
    2. Joseph P. Romano & Michael Wolf, 2005. "Stepwise Multiple Testing as Formalized Data Snooping," Econometrica, Econometric Society, vol. 73(4), pages 1237-1282, July.
    3. Romano, Joseph P. & Shaikh, Azeem M. & Wolf, Michael, 2008. "Formalized Data Snooping Based On Generalized Error Rates," Econometric Theory, Cambridge University Press, vol. 24(2), pages 404-447, April.
    4. Richard M. Bittman & Joseph P. Romano & Carlos Vallarino & Michael Wolf, 2009. "Optimal testing of multiple hypotheses with common effect direction," Biometrika, Biometrika Trust, vol. 96(2), pages 399-410.
    5. Gary Charness & Uri Gneezy, 2009. "Incentives to Exercise," Econometrica, Econometric Society, vol. 77(3), pages 909-931, May.
    6. Todd Clark & Michael McCracken, 2012. "Reality Checks and Comparisons of Nested Predictive Models," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 30(1), pages 53-66.
    7. Romano Joseph P. & Shaikh Azeem & Wolf Michael, 2011. "Consonance and the Closure Method in Multiple Testing," The International Journal of Biostatistics, De Gruyter, vol. 7(1), pages 1-25, February.
    8. Joseph P. Romano & Michael Wolf, 2005. "Exact and Approximate Stepdown Methods for Multiple Hypothesis Testing," Journal of the American Statistical Association, American Statistical Association, vol. 100, pages 94-108, March.
    9. Zeng-Hua Lu, 2016. "Extended MaxT Tests of One-Sided Hypotheses," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 111(513), pages 423-437, March.
    10. Chung, EunYi & Romano, Joseph P., 2016. "Multivariate and multiple permutation tests," Journal of Econometrics, Elsevier, vol. 193(1), pages 76-91.
    11. Halbert White, 2000. "A Reality Check for Data Snooping," Econometrica, Econometric Society, vol. 68(5), pages 1097-1126, September.
    12. Joseph P. Romano & Azeem M. Shaikh & Michael Wolf, 2010. "Hypothesis Testing in Econometrics," Annual Review of Economics, Annual Reviews, vol. 2(1), pages 75-104, September.
    13. Lu, Zeng-Hua, 2013. "Halfline tests for multivariate one-sided alternatives," Computational Statistics & Data Analysis, Elsevier, vol. 57(1), pages 479-490.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Giuseppe Cavaliere & Zeng-Hua Lu & Anders Rahbek & Yuhong Yang, 2021. "MinP Score Tests with an Inequality Constrained Parameter Space," Papers 2107.06089, arXiv.org.
    2. Zeng-Hua Lu, 2016. "Extended MaxT Tests of One-Sided Hypotheses," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 111(513), pages 423-437, March.
    3. Alexandre Belloni & Victor Chernozhukov & Denis Chetverikov & Christian Hansen & Kengo Kato, 2018. "High-dimensional econometrics and regularized GMM," CeMMAP working papers CWP35/18, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    4. John A. List & Azeem M. Shaikh & Atom Vayalinkal, 2023. "Multiple testing with covariate adjustment in experimental economics," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 38(6), pages 920-939, September.
    5. Michele La Rocca & Cira Perna, 2022. "Opening the Black Box: Bootstrapping Sensitivity Measures in Neural Networks for Interpretable Machine Learning," Stats, MDPI, vol. 5(2), pages 1-18, April.
    6. Adriano Koshiyama & Nick Firoozye, 2019. "Avoiding Backtesting Overfitting by Covariance-Penalties: an empirical investigation of the ordinary and total least squares cases," Papers 1905.05023, arXiv.org.
    7. Zeng-Hua Lu & Alec Zuo, 2017. "Child disability, welfare payments, marital status and mothers’ labor supply: Evidence from Australia," Cogent Economics & Finance, Taylor & Francis Journals, vol. 5(1), pages 1339769-133, January.
    8. Christopher J. Bennett, 2009. "p-Value Adjustments for Asymptotic Control of the Generalized Familywise Error Rate," Vanderbilt University Department of Economics Working Papers 0905, Vanderbilt University Department of Economics.
    9. Bajgrowicz, Pierre & Scaillet, Olivier, 2012. "Technical trading revisited: False discoveries, persistence tests, and transaction costs," Journal of Financial Economics, Elsevier, vol. 106(3), pages 473-491.
    10. Alvaro Escribano & Genaro Sucarrat, 2011. "Automated model selection in finance: General-to-speci c modelling of the mean and volatility speci cations," Working Papers 2011-09, Instituto Madrileño de Estudios Avanzados (IMDEA) Ciencias Sociales.
    11. Chowdhury, Shyamal & Hasan, Syed & Sharma, Uttam, 2024. "The Role of Trainee Selection in the Effectiveness of Vocational Training: Evidence from a Randomized Controlled Trial in Nepal," IZA Discussion Papers 16705, Institute of Labor Economics (IZA).
    12. Cortés, Darwin & Maldonado, Darío & Gallego, Juan & Charpak, Nathalie & Tessier, Rejean & Ruiz, Juan Gabriel & Hernandez, José Tiberio & Uriza, Felipe & Pico, Julieth, 2022. "Comparing long-term educational effects of two early childhood health interventions," Journal of Health Economics, Elsevier, vol. 86(C).
    13. Davide Viviano & Kaspar Wuthrich & Paul Niehaus, 2021. "A model of multiple hypothesis testing," Papers 2104.13367, arXiv.org, revised Apr 2024.
    14. Eszter Czibor & David Jimenez‐Gomez & John A. List, 2019. "The Dozen Things Experimental Economists Should Do (More of)," Southern Economic Journal, John Wiley & Sons, vol. 86(2), pages 371-432, October.
    15. Heath, Davidson & Ringgenberg, Matthew C. & Samadi, Mehrdad & Werner, Ingrid M., 2019. "Reusing Natural Experiments," Working Paper Series 2019-21, Ohio State University, Charles A. Dice Center for Research in Financial Economics.
    16. Brennan S Thompson & Matthew D Webb, 2019. "A simple, graphical approach to comparing multiple treatments," The Econometrics Journal, Royal Economic Society, vol. 22(2), pages 188-205.
    17. Romano, Joseph P. & Shaikh, Azeem M. & Wolf, Michael, 2008. "Formalized Data Snooping Based On Generalized Error Rates," Econometric Theory, Cambridge University Press, vol. 24(2), pages 404-447, April.
    18. John A. List & Azeem M. Shaikh & Yang Xu, 2019. "Multiple hypothesis testing in experimental economics," Experimental Economics, Springer;Economic Science Association, vol. 22(4), pages 773-793, December.
    19. Dichtl, Hubert & Drobetz, Wolfgang & Neuhierl, Andreas & Wendt, Viktoria-Sophie, 2021. "Data snooping in equity premium prediction," International Journal of Forecasting, Elsevier, vol. 37(1), pages 72-94.
    20. Azevedo E Castro De Cardim,Joana & Amaro Da Costa Luz Carneiro,Pedro Manuel & Carvalho,Leandro S. & De Walque,Damien B. C. M., 2022. "Early Education, Preferences, and Decision-Making Abilities," Policy Research Working Paper Series 10187, The World Bank.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:1911.04696. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.