IDEAS home Printed from https://ideas.repec.org/a/eee/csdana/v179y2023ics0167947322002110.html
   My bibliography  Save this article

Cluster-robust estimators for multivariate mixed-effects meta-regression

Author

Listed:
  • Welz, Thilo
  • Viechtbauer, Wolfgang
  • Pauly, Markus

Abstract

Meta-analyses frequently include trials that report multiple outcomes based on a common set of study participants. These outcomes will generally be correlated. Cluster-robust variance-covariance estimators are a fruitful approach for synthesizing dependent outcomes. However, when the number of studies is small, state-of-the-art robust estimators can yield inflated Type 1 errors. Therefore, two new cluster-robust estimators are presented, in order to improve small sample performance. For both new estimators the idea is to transform the estimated variances of the residuals using only the diagonal entries of the hat matrix. The proposals are asymptotically equivalent to previously suggested cluster-robust estimators such as the bias reduced linearization approach. The methods are applied to a dataset of 81 trials examining overall and disease-free survival in neuroblastoma patients with amplified versus normal MYC-N genes. Furthermore, their performance is compared and contrasted in an extensive simulation study. The focus is on bivariate meta-regression, although the approaches can be applied more generally.

Suggested Citation

  • Welz, Thilo & Viechtbauer, Wolfgang & Pauly, Markus, 2023. "Cluster-robust estimators for multivariate mixed-effects meta-regression," Computational Statistics & Data Analysis, Elsevier, vol. 179(C).
  • Handle: RePEc:eee:csdana:v:179:y:2023:i:c:s0167947322002110
    DOI: 10.1016/j.csda.2022.107631
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0167947322002110
    Download Restriction: Full text for ScienceDirect subscribers only.

    File URL: https://libkey.io/10.1016/j.csda.2022.107631?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Cribari-Neto, Francisco, 2004. "Asymptotic inference under heteroskedasticity of unknown form," Computational Statistics & Data Analysis, Elsevier, vol. 45(2), pages 215-233, March.
    2. Zimmermann, Georg & Pauly, Markus & Bathke, Arne C., 2020. "Multivariate analysis of covariance with potentially singular covariance matrices and non-normal responses," Journal of Multivariate Analysis, Elsevier, vol. 177(C).
    3. Viechtbauer, Wolfgang, 2010. "Conducting Meta-Analyses in R with the metafor Package," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 36(i03).
    4. Elizabeth Tipton & James E. Pustejovsky, 2015. "Small-Sample Adjustments for Tests of Moderators and Model Fit Using Robust Variance Estimation in Meta-Regression," Journal of Educational and Behavioral Statistics, , vol. 40(6), pages 604-634, December.
    5. James E. Pustejovsky & Elizabeth Tipton, 2018. "Small-Sample Methods for Cluster-Robust Variance Estimation and Hypothesis Testing in Fixed Effects Models," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 36(4), pages 672-683, October.
    6. Friedrich, Sarah & Pauly, Markus, 2018. "MATS: Inference for potentially singular and heteroscedastic MANOVA," Journal of Multivariate Analysis, Elsevier, vol. 165(C), pages 166-179.
    7. Friedrich, Sarah & Brunner, Edgar & Pauly, Markus, 2017. "Permuting longitudinal data in spite of the dependencies," Journal of Multivariate Analysis, Elsevier, vol. 153(C), pages 255-265.
    8. Tomasz Burzykowski & Geert Molenberghs & Marc Buyse & Helena Geys & Didier Renard, 2001. "Validation of surrogate end points in multiple randomized clinical trials with failure time end points," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 50(4), pages 405-422.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Zimmermann, Georg & Pauly, Markus & Bathke, Arne C., 2020. "Multivariate analysis of covariance with potentially singular covariance matrices and non-normal responses," Journal of Multivariate Analysis, Elsevier, vol. 177(C).
    2. Latha Velayudhan & Katie McGoohan & Sagnik Bhattacharyya, 2021. "Safety and tolerability of natural and synthetic cannabinoids in adults aged over 50 years: A systematic review and meta-analysis," PLOS Medicine, Public Library of Science, vol. 18(3), pages 1-42, March.
    3. Mikkel Helding Vembye & James Eric Pustejovsky & Therese Deocampo Pigott, 2023. "Power Approximations for Overall Average Effects in Meta-Analysis With Dependent Effect Sizes," Journal of Educational and Behavioral Statistics, , vol. 48(1), pages 70-102, February.
    4. Niklas Döbbeling-Hildebrandt & Klaas Miersch & Tarun M. Khanna & Marion Bachelet & Stephan B. Bruns & Max Callaghan & Ottmar Edenhofer & Christian Flachsland & Piers M. Forster & Matthias Kalkuhl & Ni, 2024. "Systematic review and meta-analysis of ex-post evaluations on the effectiveness of carbon pricing," Nature Communications, Nature, vol. 15(1), pages 1-12, December.
    5. Jeffrey D. Michler & Anna Josephson, 2022. "Recent developments in inference: practicalities for applied economics," Chapters, in: A Modern Guide to Food Economics, chapter 11, pages 235-268, Edward Elgar Publishing.
    6. Baumeister, Marléne & Ditzhaus, Marc & Pauly, Markus, 2024. "Quantile-based MANOVA: A new tool for inferring multivariate data in factorial designs," Journal of Multivariate Analysis, Elsevier, vol. 199(C).
    7. Waheed, Hassam, 2023. "Nudging smokers away from lighting up: A meta-analysis of framing effect in current smokers," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 104(C).
    8. Pustejovsky, James E & Tipton, Elizabeth, 2020. "Meta-Analysis with Robust Variance Estimation: Expanding the Range of Working Models," MetaArXiv vyfcj, Center for Open Science.
    9. John Protzko & Jon Krosnick & Leif Nelson & Brian A. Nosek & Jordan Axt & Matt Berent & Nicholas Buttrick & Matthew DeBell & Charles R. Ebersole & Sebastian Lundmark & Bo MacInnis & Michael O’Donnell , 2024. "RETRACTED ARTICLE: High replicability of newly discovered social-behavioural findings is achievable," Nature Human Behaviour, Nature, vol. 8(2), pages 311-319, February.
    10. Tyler E. Smith & Aaron M. Thompson & Brandy R. Maynard, 2022. "Self‐management interventions for reducing challenging behaviors among school‐age students: A systematic review," Campbell Systematic Reviews, John Wiley & Sons, vol. 18(1), March.
    11. Benoît Le Maux & Federica Minardy & Charlotte Magalhaes, 2011. "Determinants of Electoral Outcomes: A simple Test of Meltzer and Richard's Hypothesis," Economics Working Paper from Condorcet Center for political Economy at CREM-CNRS 2011-03-ccr, Condorcet Center for political Economy.
    12. Friedrich, Sarah & Pauly, Markus, 2018. "MATS: Inference for potentially singular and heteroscedastic MANOVA," Journal of Multivariate Analysis, Elsevier, vol. 165(C), pages 166-179.
    13. Bart Verkuil & Serpil Atasayi & Marc L Molendijk, 2015. "Workplace Bullying and Mental Health: A Meta-Analysis on Cross-Sectional and Longitudinal Data," PLOS ONE, Public Library of Science, vol. 10(8), pages 1-16, August.
    14. Francesca Pilotto & Ingolf Kühn & Rita Adrian & Renate Alber & Audrey Alignier & Christopher Andrews & Jaana Bäck & Luc Barbaro & Deborah Beaumont & Natalie Beenaerts & Sue Benham & David S. Boukal & , 2020. "Meta-analysis of multidecadal biodiversity trends in Europe," Nature Communications, Nature, vol. 11(1), pages 1-11, December.
    15. repec:cup:judgdm:v:15:y:2020:i:6:p:972-988 is not listed on IDEAS
    16. Jonas Schmidt & Tammo H. A. Bijmolt, 2020. "Accurately measuring willingness to pay for consumer goods: a meta-analysis of the hypothetical bias," Journal of the Academy of Marketing Science, Springer, vol. 48(3), pages 499-518, May.
    17. Thomas S. Dee & Emily K. Penner, 2021. "My Brother's Keeper? The Impact of Targeted Educational Supports," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 40(4), pages 1171-1196, September.
    18. repec:ags:aaea22:335733 is not listed on IDEAS
    19. Erin E. Gabriel & Michael J. Daniels & M. Elizabeth Halloran, 2016. "Comparing biomarkers as trial level general surrogates," Biometrics, The International Biometric Society, vol. 72(4), pages 1046-1054, December.
    20. Mario Herberz & Tobias Brosch & Ulf J. J. Hahnel, 2020. "Kilo what? Default units increase value sensitivity in joint evaluations of energy efficiency," Judgment and Decision Making, Society for Judgment and Decision Making, vol. 15(6), pages 972-988, November.
    21. James G. MacKinnon & Morten Ørregaard Nielsen & Matthew D. Webb, 2023. "Fast and reliable jackknife and bootstrap methods for cluster‐robust inference," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 38(5), pages 671-694, August.
    22. Piers Steel & Sjoerd Beugelsdijk & Herman Aguinis, 2021. "The anatomy of an award-winning meta-analysis: Recommendations for authors, reviewers, and readers of meta-analytic reviews," Journal of International Business Studies, Palgrave Macmillan;Academy of International Business, vol. 52(1), pages 23-44, February.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:csdana:v:179:y:2023:i:c:s0167947322002110. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/csda .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.