IDEAS home Printed from https://ideas.repec.org/a/eee/csdana/v64y2013icp87-98.html
   My bibliography  Save this article

Simultaneous confidence intervals for comparing margins of multivariate binary data

Author

Listed:
  • Klingenberg, Bernhard
  • Satopää, Ville

Abstract

In many applications two groups are compared simultaneously on several correlated binary variables for a more comprehensive assessment of group differences. Although the response is multivariate, the main interest is in comparing the marginal probabilities between the groups. Estimating the size of these differences under strong error control allows for a better evaluation of effects than can be provided by multiplicity adjusted P-values. Simultaneous confidence intervals for the differences in marginal probabilities are developed through inverting the maximum of correlated Wald, score or quasi-score statistics. Taking advantage of the available correlation information leads to improvements in the joint coverage probability and power compared to straightforward Bonferroni adjustments. Estimating the correlation under the null is also explored. While computationally complex even in small dimensions, it does not result in marked improvements. Based on extensive simulation results, a simple approach that uses univariate score statistics together with their estimated correlation is proposed and recommended. All methods are illustrated using data from a vaccine trial that investigated the incidence of four pre-specified adverse events between two groups and with data from the General Social Survey.

Suggested Citation

  • Klingenberg, Bernhard & Satopää, Ville, 2013. "Simultaneous confidence intervals for comparing margins of multivariate binary data," Computational Statistics & Data Analysis, Elsevier, vol. 64(C), pages 87-98.
    • Handle: RePEc:eee:csdana:v:64:y:2013:i:c:p:87-98
    DOI: 10.1016/j.csda.2013.02.016
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0167947313000728
    Download Restriction: Full text for ScienceDirect subscribers only.
    File URL: https://libkey.io/10.1016/j.csda.2013.02.016?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Bahjat F. Qaqish, 2003. "A family of multivariate binary distributions for simulating correlated binary variables with specified marginal means and correlations," Biometrika, Biometrika Trust, vol. 90(2), pages 455-463, June.
    2. Christian Bressen Pipper & Christian Ritz & Hans Bisgaard, 2012. "A versatile method for confirmatory evaluation of the effects of a covariate in multiple models," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 61(2), pages 315-326, March.
    3. Scott M. Berry & Donald A. Berry, 2004. "Accounting for Multiplicities in Assessing Drug Safety: A Three-Level Hierarchical Mixture Model," Biometrics, The International Biometric Society, vol. 60(2), pages 418-426, June.
    4. Klingenberg, Bernhard, 2012. "Simultaneous score confidence bounds for risk differences in multiple comparisons to a control," Computational Statistics & Data Analysis, Elsevier, vol. 56(5), pages 1079-1089.
    5. Yoav Benjamini & Daniel Yekutieli, 2005. "False Discovery Rate-Adjusted Multiple Confidence Intervals for Selected Parameters," Journal of the American Statistical Association, American Statistical Association, vol. 100, pages 71-81, March.
    6. Alan Agresti & Bernhard Klingenberg, 2005. "Multivariate tests comparing binomial probabilities, with application to safety studies for drugs," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 54(4), pages 691-706, August.
    7. Chafaï, Djalil & Concordet, Didier, 2009. "Confidence Regions for the Multinomial Parameter With Small Sample Size," Journal of the American Statistical Association, American Statistical Association, vol. 104(487), pages 1071-1079.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Guosheng Yin & Yu Shen, 2005. "Adaptive Design and Estimation in Randomized Clinical Trials with Correlated Observations," Biometrics, The International Biometric Society, vol. 61(2), pages 362-369, June.
    2. Brice Ozenne & Esben Budtz-Jørgensen & Sebastian Elgaard Ebert, 2023. "Controlling the familywise error rate when performing multiple comparisons in a linear latent variable model," Computational Statistics, Springer, vol. 38(1), pages 1-23, March.
    3. Schaarschmidt, Frank & Gerhard, Daniel & Vogel, Charlotte, 2017. "Simultaneous confidence intervals for comparisons of several multinomial samples," Computational Statistics & Data Analysis, Elsevier, vol. 106(C), pages 65-76.
    4. Jorge A. Sefair & Oscar Guaje & Andrés L. Medaglia, 2021. "A column-oriented optimization approach for the generation of correlated random vectors," OR Spectrum: Quantitative Approaches in Management, Springer;Gesellschaft für Operations Research e.V., vol. 43(3), pages 777-808, September.
    5. Guillermo Durand & Gilles Blanchard & Pierre Neuvial & Etienne Roquain, 2020. "Post hoc false positive control for structured hypotheses," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 47(4), pages 1114-1148, December.
    6. Y. Fong & J. Wakefield & S. De Rosa & N. Frahm, 2012. "A Robust Bayesian Random Effects Model for Nonlinear Calibration Problems," Biometrics, The International Biometric Society, vol. 68(4), pages 1103-1112, December.
    7. Ruben Dezeure & Peter Bühlmann & Cun-Hui Zhang, 2017. "Rejoinder on: High-dimensional simultaneous inference with the bootstrap," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 26(4), pages 751-758, December.
    8. Qingyun Cai & Hock Peng Chan, 2017. "A Double Application of the Benjamini-Hochberg Procedure for Testing Batched Hypotheses," Methodology and Computing in Applied Probability, Springer, vol. 19(2), pages 429-443, June.
    9. Jelle J Goeman & Aldo Solari, 2024. "On selection and conditioning in multiple testing and selective inference," Biometrika, Biometrika Trust, vol. 111(2), pages 393-416.
    10. Bansal Naveen K., 2007. "Decision theoretic Bayesian hypothesis testing with the selection goal," Statistics & Risk Modeling, De Gruyter, vol. 25(1), pages 19-39, January.
    11. Paul Blanche & Jean‐François Dartigues & Jérémie Riou, 2022. "A closed max‐t test for multiple comparisons of areas under the ROC curve," Biometrics, The International Biometric Society, vol. 78(1), pages 352-363, March.
    12. Eleftheraki, Anastasia G. & Kateri, Maria & Ntzoufras, Ioannis, 2009. "Bayesian analysis of two dependent 22 contingency tables," Computational Statistics & Data Analysis, Elsevier, vol. 53(7), pages 2724-2732, May.
    13. Timothy B. Armstrong & Michal Kolesár & Mikkel Plagborg‐Møller, 2022. "Robust Empirical Bayes Confidence Intervals," Econometrica, Econometric Society, vol. 90(6), pages 2567-2602, November.
    14. Tsung-Shan Tsou & Wan-Chen Chen, 2013. "Estimation of intra-cluster correlation coefficient via the failure of Bartlett’s second identity," Computational Statistics, Springer, vol. 28(4), pages 1681-1698, August.
    15. Sergei Leonov & Bahjat Qaqish, 2020. "Correlated endpoints: simulation, modeling, and extreme correlations," Statistical Papers, Springer, vol. 61(2), pages 741-766, April.
    16. Moysiadis, Theodoros & Fokianos, Konstantinos, 2014. "On binary and categorical time series models with feedback," Journal of Multivariate Analysis, Elsevier, vol. 131(C), pages 209-228.
    17. Hanxin Zhang & Torsten Dahlén & Atif Khan & Gustaf Edgren & Andrey Rzhetsky, 2020. "Measurable health effects associated with the daylight saving time shift," PLOS Computational Biology, Public Library of Science, vol. 16(6), pages 1-13, June.
    18. Andrew Y. Chen & Tom Zimmermann, 2022. "Publication Bias in Asset Pricing Research," Papers 2209.13623, arXiv.org, revised Sep 2023.
    19. Berman, Oded & Krass, Dmitry & Menezes, Mozart B.C., 2013. "Location and reliability problems on a line: Impact of objectives and correlated failures on optimal location patterns," Omega, Elsevier, vol. 41(4), pages 766-779.
    20. B. C. Sutradhar, 2008. "On auto-regression type dynamic mixed models for binary panel data," Metron - International Journal of Statistics, Dipartimento di Statistica, Probabilità e Statistiche Applicate - University of Rome, vol. 0(2), pages 209-221.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:csdana:v:64:y:2013:i:c:p:87-98. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/csda .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.