IDEAS home Printed from https://ideas.repec.org/p/mol/ecsdps/esdp11059.html
   My bibliography  Save this paper

FDR Control in the Presence of an Unknown Correlation Structure

Author

Listed:
  • Cerqueti, Roy
  • Costantini, Mauro
  • Lupi, Claudio

Abstract

The false discovery rate (FDR, Benjamini and Hochberg 1995) is a powerful approach to multiple testing. However, the original approach developed by Benjamini and Hochberg (1995) applies only to independent tests. Yekutieli (2008) showed that a modification of the Benjamini-Hochberg (BH) approach can be used in the presence of dependent tests and labelled his procedure as separate subsets BH (ssBH). However, Yekutieli (2008) left the practical specification of the subsets of p values largely unresolved. In this paper we propose a modification of the ssBH procedure based on a selection of the subsets that guarantees that the dependence properties needed to control the FDR are satisfied. We label this new procedure as the separate pairs BH (spBH). An extensive Monte Carlo analysis is presented that compares the properties of the BH and spBH procedures.

Suggested Citation

  • Cerqueti, Roy & Costantini, Mauro & Lupi, Claudio, 2011. "FDR Control in the Presence of an Unknown Correlation Structure," Economics & Statistics Discussion Papers esdp11059, University of Molise, Department of Economics.
    • Handle: RePEc:mol:ecsdps:esdp11059
    as

    Download full text from publisher

    File URL: http://web.unimol.it/progetti/repec/mol/ecsdps/ESDP11059.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Cribari-Neto, Francisco, 2004. "Asymptotic inference under heteroskedasticity of unknown form," Computational Statistics & Data Analysis, Elsevier, vol. 45(2), pages 215-233, March.
    2. Hendry, David F., 1984. "Monte carlo experimentation in econometrics," Handbook of Econometrics, in: Z. Griliches† & M. D. Intriligator (ed.), Handbook of Econometrics, edition 1, volume 2, chapter 16, pages 937-976, Elsevier.
    3. John D. Storey & Jonathan E. Taylor & David Siegmund, 2004. "Strong control, conservative point estimation and simultaneous conservative consistency of false discovery rates: a unified approach," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 66(1), pages 187-205, February.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Cerqueti, Roy & Lupi, Claudio, 2015. "Total positivity for a class of non-exchangeable copulas," Economics & Statistics Discussion Papers esdp15077, University of Molise, Department of Economics.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Annalivia Polselli, 2023. "Robust Inference in Panel Data Models: Some Effects of Heteroskedasticity and Leveraged Data in Small Samples," Papers 2312.17676, arXiv.org.
    2. Benoît Le Maux & Federica Minardy & Charlotte Magalhaes, 2011. "Determinants of Electoral Outcomes: A simple Test of Meltzer and Richard's Hypothesis," Economics Working Paper from Condorcet Center for political Economy at CREM-CNRS 2011-03-ccr, Condorcet Center for political Economy.
    3. Weingarten, Nina & Bach, Leonie & Wang, Wen-Xiu & Roosen, Jutta & Hartmann, Monika, 2023. "Every Step You Take: Nudging Animal Welfare Product Sales in a Virtual Supermarket," 2023 Annual Meeting, July 23-25, Washington D.C. 335733, Agricultural and Applied Economics Association.
    4. Jianqing Fan & Xu Han, 2017. "Estimation of the false discovery proportion with unknown dependence," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 79(4), pages 1143-1164, September.
    5. Shigeyuki Matsui & Hisashi Noma, 2011. "Estimating Effect Sizes of Differentially Expressed Genes for Power and Sample-Size Assessments in Microarray Experiments," Biometrics, The International Biometric Society, vol. 67(4), pages 1225-1235, December.
    6. Lianming Wang & David B. Dunson, 2010. "Semiparametric Bayes Multiple Testing: Applications to Tumor Data," Biometrics, The International Biometric Society, vol. 66(2), pages 493-501, June.
    7. Hanck, Christoph, 2011. "Now, whose schools are really better (or weaker) than Germany's? A multiple testing approach," Economic Modelling, Elsevier, vol. 28(4), pages 1739-1746, July.
    8. Ghosh Debashis, 2012. "Incorporating the Empirical Null Hypothesis into the Benjamini-Hochberg Procedure," Statistical Applications in Genetics and Molecular Biology, De Gruyter, vol. 11(4), pages 1-21, July.
    9. Campos, Julia & Ericsson, Neil R. & Hendry, David F., 1996. "Cointegration tests in the presence of structural breaks," Journal of Econometrics, Elsevier, vol. 70(1), pages 187-220, January.
    10. VAN DIJK, Herman K., 1987. "Some advances in Bayesian estimations methods using Monte Carlo Integration," LIDAM Reprints CORE 783, Université catholique de Louvain, Center for Operations Research and Econometrics (CORE).
    11. Dean Palejev & Mladen Savov, 2021. "On the Convergence of the Benjamini–Hochberg Procedure," Mathematics, MDPI, vol. 9(17), pages 1-19, September.
    12. Cheng, Tsung-Chi, 2012. "On simultaneously identifying outliers and heteroscedasticity without specific form," Computational Statistics & Data Analysis, Elsevier, vol. 56(7), pages 2258-2272.
    13. Moon, H.R. & Perron, B., 2012. "Beyond panel unit root tests: Using multiple testing to determine the nonstationarity properties of individual series in a panel," Journal of Econometrics, Elsevier, vol. 169(1), pages 29-33.
    14. Zeileis, Achim, 2006. "Implementing a class of structural change tests: An econometric computing approach," Computational Statistics & Data Analysis, Elsevier, vol. 50(11), pages 2987-3008, July.
    15. Psaradellis, Ioannis & Laws, Jason & Pantelous, Athanasios A. & Sermpinis, Georgios, 2023. "Technical analysis, spread trading, and data snooping control," International Journal of Forecasting, Elsevier, vol. 39(1), pages 178-191.
    16. Pötscher, Benedikt M. & Preinerstorfer, David, 2023. "How Reliable Are Bootstrap-Based Heteroskedasticity Robust Tests?," Econometric Theory, Cambridge University Press, vol. 39(4), pages 789-847, August.
    17. Karol Szafranek & Aleksandra Hałka, 2019. "Determinants of Low Inflation in an Emerging, Small Open Economy through the Lens of Aggregated and Disaggregated Approach," Emerging Markets Finance and Trade, Taylor & Francis Journals, vol. 55(13), pages 3094-3111, October.
    18. Isaiah Hull & Or Sattath & Eleni Diamanti & Göran Wendin, 2024. "Quantum Technology for Economists," Contributions to Economics, Springer, number 978-3-031-50780-9, October.
    19. Adrian C. Darnell, 1994. "A Dictionary Of Econometrics," Books, Edward Elgar Publishing, number 118.
    20. Thorsten Dickhaus & Jakob Gierl, 2012. "Simultaneous test procedures in terms of p-value copulae," SFB 649 Discussion Papers SFB649DP2012-049, Sonderforschungsbereich 649, Humboldt University, Berlin, Germany.

    More about this item

    Keywords

    Multiple testing; False discovery rate; Copulas;
    All these keywords.

    JEL classification:

    • C10 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - General
    • C12 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Hypothesis Testing: General

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:mol:ecsdps:esdp11059. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Claudio Lupi (email available below). General contact details of provider: https://edirc.repec.org/data/dsmolit.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.