IDEAS home Printed from https://ideas.repec.org/p/zur/econwp/254.html
   My bibliography  Save this paper

Multiple testing of one-sided hypotheses: combining Bonferroni and the bootstrap

Author

Listed:
  • Joseph P. Romano
  • Michael Wolf

Abstract

In many multiple testing problems, the individual null hypotheses (i) concern univariate parameters and (ii) are one-sided. In such problems, power gains can be obtained for bootstrap multiple testing procedures in scenarios where some of the parameters are 'deep in the null' by making certain adjustments to the null distribution under which to resample. In this paper, we compare a Bonferroni adjustment that is based on finite-sample considerations with certain 'asymptotic' adjustments previously suggested in the literature.

Suggested Citation

  • Joseph P. Romano & Michael Wolf, 2017. "Multiple testing of one-sided hypotheses: combining Bonferroni and the bootstrap," ECON - Working Papers 254, Department of Economics - University of Zurich.
    • Handle: RePEc:zur:econwp:254
    as

    Download full text from publisher

    File URL: https://www.zora.uzh.ch/id/eprint/138641/1/econwp254.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Joseph P. Romano & Azeem M. Shaikh & Michael Wolf, 2014. "A Practical Two‐Step Method for Testing Moment Inequalities," Econometrica, Econometric Society, vol. 82, pages 1979-2002, September.
    2. Donald W. K. Andrews & Panle Jia Barwick, 2012. "Inference for Parameters Defined by Moment Inequalities: A Recommended Moment Selection Procedure," Econometrica, Econometric Society, vol. 80(6), pages 2805-2826, November.
    3. Joseph P. Romano & Michael Wolf, 2005. "Exact and Approximate Stepdown Methods for Multiple Hypothesis Testing," Journal of the American Statistical Association, American Statistical Association, vol. 100, pages 94-108, March.
    4. Halbert White, 2000. "A Reality Check for Data Snooping," Econometrica, Econometric Society, vol. 68(5), pages 1097-1126, September.
    5. Hansen, Peter Reinhard, 2005. "A Test for Superior Predictive Ability," Journal of Business & Economic Statistics, American Statistical Association, vol. 23, pages 365-380, October.
    6. Hsu, Po-Hsuan & Hsu, Yu-Chin & Kuan, Chung-Ming, 2010. "Testing the predictive ability of technical analysis using a new stepwise test without data snooping bias," Journal of Empirical Finance, Elsevier, vol. 17(3), pages 471-484, June.
    7. Donald W. K. Andrews & Gustavo Soares, 2010. "Inference for Parameters Defined by Moment Inequalities Using Generalized Moment Selection," Econometrica, Econometric Society, vol. 78(1), pages 119-157, January.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Joanna Kostanek & Kamil Karolczak & Wiktor Kuliczkowski & Cezary Watala, 2024. "Bootstrap Method as a Tool for Analyzing Data with Atypical Distributions Deviating from Parametric Assumptions: Critique and Effectiveness Evaluation," Data, MDPI, vol. 9(8), pages 1-20, July.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Chen, Le-Yu & Szroeter, Jerzy, 2014. "Testing multiple inequality hypotheses: A smoothed indicator approach," Journal of Econometrics, Elsevier, vol. 178(P3), pages 678-693.
    2. Zeng-Hua Lu & Alec Zuo, 2017. "Child disability, welfare payments, marital status and mothers’ labor supply: Evidence from Australia," Cogent Economics & Finance, Taylor & Francis Journals, vol. 5(1), pages 1339769-133, January.
    3. Christopher J. Bennett, 2009. "p-Value Adjustments for Asymptotic Control of the Generalized Familywise Error Rate," Vanderbilt University Department of Economics Working Papers 0905, Vanderbilt University Department of Economics.
    4. McCloskey, Adam, 2017. "Bonferroni-based size-correction for nonstandard testing problems," Journal of Econometrics, Elsevier, vol. 200(1), pages 17-35.
    5. Le-Yu Chen & Jerzy Szroeter, 2009. "Hypothesis testing of multiple inequalities: the method of constraint chaining," CeMMAP working papers CWP13/09, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    6. Donald, Stephen G. & Hsu, Yu-Chin, 2011. "A new test for linear inequality constraints when the variance–covariance matrix depends on the unknown parameters," Economics Letters, Elsevier, vol. 113(3), pages 241-243.
    7. Arvanitis, Stelios & Post, Thierry & Potì, Valerio & Karabati, Selcuk, 2021. "Nonparametric tests for Optimal Predictive Ability," International Journal of Forecasting, Elsevier, vol. 37(2), pages 881-898.
    8. Timmermann, Allan & Qu, Ritong & Zhu, Yinchu, 2019. "Do Any Economists Have Superior Forecasting Skills?," CEPR Discussion Papers 14112, C.E.P.R. Discussion Papers.
    9. de Chaisemartin, Clement & D'Haultfoeuille, Xavier, "undated". "Supplement to Fuzzy Differences-in-Differences," Economic Research Papers 270217, University of Warwick - Department of Economics.
    10. Filip Obradovi'c, 2022. "Measuring Diagnostic Test Performance Using Imperfect Reference Tests: A Partial Identification Approach," Papers 2204.00180, arXiv.org, revised Aug 2024.
    11. Hiroaki Kaido & Francesca Molinari & Jörg Stoye, 2019. "Confidence Intervals for Projections of Partially Identified Parameters," Econometrica, Econometric Society, vol. 87(4), pages 1397-1432, July.
    12. Psaradellis, Ioannis & Laws, Jason & Pantelous, Athanasios A. & Sermpinis, Georgios, 2023. "Technical analysis, spread trading, and data snooping control," International Journal of Forecasting, Elsevier, vol. 39(1), pages 178-191.
    13. Dan Anghel, 2013. "How Reliable is the Moving Average Crossover Rule for an Investor on the Romanian Stock Market?," The Review of Finance and Banking, Academia de Studii Economice din Bucuresti, Romania / Facultatea de Finante, Asigurari, Banci si Burse de Valori / Catedra de Finante, vol. 5(2), pages 089-115, December.
    14. Aradillas-López, Andrés & Rosen, Adam M., 2022. "Inference in ordered response games with complete information," Journal of Econometrics, Elsevier, vol. 226(2), pages 451-476.
    15. C de Chaisemartin & X D’HaultfŒuille, 2018. "Fuzzy Differences-in-Differences," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 85(2), pages 999-1028.
    16. Shynkevich, Andrei, 2013. "Time-series momentum as an intra- and inter-industry effect: Implications for market efficiency," Journal of Economics and Business, Elsevier, vol. 69(C), pages 64-85.
    17. Costantini, Mauro & Cuaresma, Jesus Crespo & Hlouskova, Jaroslava, 2014. "Can Macroeconomists Get Rich Forecasting Exchange Rates?," Economics Series 305, Institute for Advanced Studies.
    18. Federico A. Bugni & Ivan A. Canay & Xiaoxia Shi, 2014. "Inference for functions of partially identified parameters in moment inequality models," CeMMAP working papers 22/14, Institute for Fiscal Studies.
    19. Romano, Joseph P. & Shaikh, Azeem M. & Wolf, Michael, 2008. "Formalized Data Snooping Based On Generalized Error Rates," Econometric Theory, Cambridge University Press, vol. 24(2), pages 404-447, April.
    20. Lee, Sokbae & Song, Kyungchul & Whang, Yoon-Jae, 2018. "Testing For A General Class Of Functional Inequalities," Econometric Theory, Cambridge University Press, vol. 34(5), pages 1018-1064, October.

    More about this item

    Keywords

    Bonferroni; multiple hypothesis testing; stepwise method;
    All these keywords.

    JEL classification:

    • C12 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Hypothesis Testing: General
    • C14 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Semiparametric and Nonparametric Methods: General

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:zur:econwp:254. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Severin Oswald (email available below). General contact details of provider: https://edirc.repec.org/data/seizhch.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.