IDEAS home Printed from https://ideas.repec.org/a/eee/csdana/v64y2013icp87-98.html
   My bibliography  Save this article

Simultaneous confidence intervals for comparing margins of multivariate binary data

Author

Listed:
  • Klingenberg, Bernhard
  • Satopää, Ville

Abstract

In many applications two groups are compared simultaneously on several correlated binary variables for a more comprehensive assessment of group differences. Although the response is multivariate, the main interest is in comparing the marginal probabilities between the groups. Estimating the size of these differences under strong error control allows for a better evaluation of effects than can be provided by multiplicity adjusted P-values. Simultaneous confidence intervals for the differences in marginal probabilities are developed through inverting the maximum of correlated Wald, score or quasi-score statistics. Taking advantage of the available correlation information leads to improvements in the joint coverage probability and power compared to straightforward Bonferroni adjustments. Estimating the correlation under the null is also explored. While computationally complex even in small dimensions, it does not result in marked improvements. Based on extensive simulation results, a simple approach that uses univariate score statistics together with their estimated correlation is proposed and recommended. All methods are illustrated using data from a vaccine trial that investigated the incidence of four pre-specified adverse events between two groups and with data from the General Social Survey.

Suggested Citation

  • Klingenberg, Bernhard & Satopää, Ville, 2013. "Simultaneous confidence intervals for comparing margins of multivariate binary data," Computational Statistics & Data Analysis, Elsevier, vol. 64(C), pages 87-98.
    • Handle: RePEc:eee:csdana:v:64:y:2013:i:c:p:87-98
    DOI: 10.1016/j.csda.2013.02.016
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0167947313000728
    Download Restriction: Full text for ScienceDirect subscribers only.
    File URL: https://libkey.io/10.1016/j.csda.2013.02.016?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Scott M. Berry & Donald A. Berry, 2004. "Accounting for Multiplicities in Assessing Drug Safety: A Three-Level Hierarchical Mixture Model," Biometrics, The International Biometric Society, vol. 60(2), pages 418-426, June.
    2. Klingenberg, Bernhard, 2012. "Simultaneous score confidence bounds for risk differences in multiple comparisons to a control," Computational Statistics & Data Analysis, Elsevier, vol. 56(5), pages 1079-1089.
    3. Yoav Benjamini & Daniel Yekutieli, 2005. "False Discovery Rate-Adjusted Multiple Confidence Intervals for Selected Parameters," Journal of the American Statistical Association, American Statistical Association, vol. 100, pages 71-81, March.
    4. Bahjat F. Qaqish, 2003. "A family of multivariate binary distributions for simulating correlated binary variables with specified marginal means and correlations," Biometrika, Biometrika Trust, vol. 90(2), pages 455-463, June.
    5. Christian Bressen Pipper & Christian Ritz & Hans Bisgaard, 2012. "A versatile method for confirmatory evaluation of the effects of a covariate in multiple models," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 61(2), pages 315-326, March.
    6. Alan Agresti & Bernhard Klingenberg, 2005. "Multivariate tests comparing binomial probabilities, with application to safety studies for drugs," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 54(4), pages 691-706, August.
    7. Chafaï, Djalil & Concordet, Didier, 2009. "Confidence Regions for the Multinomial Parameter With Small Sample Size," Journal of the American Statistical Association, American Statistical Association, vol. 104(487), pages 1071-1079.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Brice Ozenne & Esben Budtz-Jørgensen & Sebastian Elgaard Ebert, 2023. "Controlling the familywise error rate when performing multiple comparisons in a linear latent variable model," Computational Statistics, Springer, vol. 38(1), pages 1-23, March.
    2. Jorge A. Sefair & Oscar Guaje & Andrés L. Medaglia, 2021. "A column-oriented optimization approach for the generation of correlated random vectors," OR Spectrum: Quantitative Approaches in Management, Springer;Gesellschaft für Operations Research e.V., vol. 43(3), pages 777-808, September.
    3. Jelle J Goeman & Aldo Solari, 2024. "On selection and conditioning in multiple testing and selective inference," Biometrika, Biometrika Trust, vol. 111(2), pages 393-416.
    4. Tsung-Shan Tsou & Wan-Chen Chen, 2013. "Estimation of intra-cluster correlation coefficient via the failure of Bartlett’s second identity," Computational Statistics, Springer, vol. 28(4), pages 1681-1698, August.
    5. Moysiadis, Theodoros & Fokianos, Konstantinos, 2014. "On binary and categorical time series models with feedback," Journal of Multivariate Analysis, Elsevier, vol. 131(C), pages 209-228.
    6. Hanxin Zhang & Torsten Dahlén & Atif Khan & Gustaf Edgren & Andrey Rzhetsky, 2020. "Measurable health effects associated with the daylight saving time shift," PLOS Computational Biology, Public Library of Science, vol. 16(6), pages 1-13, June.
    7. Andrew Y. Chen & Tom Zimmermann, 2022. "Publication Bias in Asset Pricing Research," Papers 2209.13623, arXiv.org, revised Sep 2023.
    8. B. C. Sutradhar, 2008. "On auto-regression type dynamic mixed models for binary panel data," Metron - International Journal of Statistics, Dipartimento di Statistica, Probabilità e Statistiche Applicate - University of Rome, vol. 0(2), pages 209-221.
    9. Farrell, Patrick J. & Sutradhar, Brajendra C., 2006. "A non-linear conditional probability model for generating correlated binary data," Statistics & Probability Letters, Elsevier, vol. 76(4), pages 353-361, February.
    10. Marcaccioli, Riccardo & Livan, Giacomo, 2020. "Maximum entropy approach to multivariate time series randomization," LSE Research Online Documents on Economics 115284, London School of Economics and Political Science, LSE Library.
    11. Lennart Bondesson & Daniel Thorburn, 2008. "A List Sequential Sampling Method Suitable for Real‐Time Sampling," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 35(3), pages 466-483, September.
    12. B. Klingenberg & A. Solari & L. Salmaso & F. Pesarin, 2009. "Testing Marginal Homogeneity Against Stochastic Order in Multivariate Ordinal Data," Biometrics, The International Biometric Society, vol. 65(2), pages 452-462, June.
    13. Bickel David R., 2012. "Empirical Bayes Interval Estimates that are Conditionally Equal to Unadjusted Confidence Intervals or to Default Prior Credibility Intervals," Statistical Applications in Genetics and Molecular Biology, De Gruyter, vol. 11(3), pages 1-34, February.
    14. Lee, Donghwan & Lee, Youngjo, 2016. "Extended likelihood approach to multiple testing with directional error control under a hidden Markov random field model," Journal of Multivariate Analysis, Elsevier, vol. 151(C), pages 1-13.
    15. K. J. Kachiashvili & I.A. Prangishvili & J. K. Kachiashvili, 2019. "Constrained Bayesian Methods for Testing Directional Hypotheses Restricted False Discovery Rates," Biostatistics and Biometrics Open Access Journal, Juniper Publishers Inc., vol. 9(3), pages 47-56, March.
    16. Kitsche, A. & Hothorn, L.A. & Schaarschmidt, F., 2012. "The use of historical controls in estimating simultaneous confidence intervals for comparisons against a concurrent control," Computational Statistics & Data Analysis, Elsevier, vol. 56(12), pages 3865-3875.
    17. Yoav Benjamini & Ruth Heller, 2008. "Screening for Partial Conjunction Hypotheses," Biometrics, The International Biometric Society, vol. 64(4), pages 1215-1222, December.
    18. Kari R. Hart & Teng Fei & John J. Hanfelt, 2021. "Scalable and robust latent trajectory class analysis using artificial likelihood," Biometrics, The International Biometric Society, vol. 77(3), pages 1118-1128, September.
    19. Yoav Benjamini, 2010. "Discovering the false discovery rate," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 72(4), pages 405-416, September.
    20. Timothy B. Armstrong & Michal Kolesár & Mikkel Plagborg‐Møller, 2022. "Robust Empirical Bayes Confidence Intervals," Econometrica, Econometric Society, vol. 90(6), pages 2567-2602, November.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:csdana:v:64:y:2013:i:c:p:87-98. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/csda .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.