IDEAS home Printed from https://ideas.repec.org/c/boc/bocode/s458837.html
 

METASTRONG: Stata module for estimating the proportion of true effect sizes above or below a threshold in random-effects meta-analysis

Author

Listed:
  • Ariel Linden

    (Linden Consulting Group, LLC)

Programming Language

Stata

Abstract

metastrong estimates evidence strength for scientifically meaningful effects in meta-analyses under effect heterogeneity (ie, a nonzero estimated variance of the true effect distribution) as proposed by Mathur and VanderWeele (2019; 2020). metastrong reports the estimated proportion of true effect sizes above or below a chosen threshold of a meaningful effect size q, together with confidence intervals derived via the bootstrap. These metrics could help identify if (1) there are few effects of scientifically meaningful size despite a “statistically significant” pooled point estimate, (2) there are some large effects despite an apparently null point estimate, or (3) strong effects in the direction opposite the pooled estimate also regularly occur (and thus, potential effect modifiers should be examined) (Mathur and VanderWeele 2019). By default, metastrong performs estimation using the "calibrated" method (Mathur and VanderWeele 2020) that extends work by Wang and Lee (2019). metastrong first calibrates the effect estimates and then computes the proportion of studies above (or below) q. This method makes no assumptions about the distribution of true effects and performs well in meta-analyses with as few as 10 studies. When the parametric option is specified, metastrong estimates the proportion of studies above (or below) q using the formulae devised by Mathur and VanderWeele (2019). This estimate is then bootstrapped to derive confidence intervals. As with the calibrated method, at least 10 individual studies should be available in the meta-analysis for these estimates to provide valid results. Point estimates produced by metastrong correspond to those produced by the function prop_stronger in the R package MetaUtility as of version 2.0.0. Confidence intervals will likely differ between packages given that Stata and R use different random number seeds for determining which studies to include in each bootstrap repetition.

Suggested Citation

  • Ariel Linden, 2020. "METASTRONG: Stata module for estimating the proportion of true effect sizes above or below a threshold in random-effects meta-analysis," Statistical Software Components S458837, Boston College Department of Economics.
    • Handle: RePEc:boc:bocode:s458837
    Note: This module should be installed from within Stata by typing "ssc install metastrong". The module is made available under terms of the GPL v3 (https://www.gnu.org/licenses/gpl-3.0.txt). Windows users should not attempt to download these files with a web browser.
    as

    Download full text from publisher

    File URL: http://fmwww.bc.edu/repec/bocode/m/metastrong.ado
    File Function: program code
    Download Restriction: no
    File URL: http://fmwww.bc.edu/repec/bocode/m/metastrong_nonpar.ado
    File Function: program code
    Download Restriction: no
    File URL: http://fmwww.bc.edu/repec/bocode/m/metastrong.sthlp
    File Function: help file
    Download Restriction: no
    ---><---

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:boc:bocode:s458837. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    We have no bibliographic references for this item. You can help adding them by using this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Christopher F Baum (email available below). General contact details of provider: https://edirc.repec.org/data/debocus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.