IDEAS home Printed from https://ideas.repec.org/a/sae/jedbes/v39y2014i5p368-393.html
   My bibliography  Save this article

Design-Comparable Effect Sizes in Multiple Baseline Designs

Author

Listed:
  • James E. Pustejovsky
  • Larry V. Hedges
  • William R. Shadish

Abstract

In single-case research, the multiple baseline design is a widely used approach for evaluating the effects of interventions on individuals. Multiple baseline designs involve repeated measurement of outcomes over time and the controlled introduction of a treatment at different times for different individuals. This article outlines a general framework for defining effect sizes in multiple baseline designs that are directly comparable to the standardized mean difference from a between-subjects randomized experiment. The target, design-comparable effect size parameter can be estimated using restricted maximum likelihood together with a small sample correction analogous to Hedges’s g . The approach is demonstrated using hierarchical linear models that include baseline time trends and treatment-by-time interactions. A simulation compares the performance of the proposed estimator to that of an alternative, and an application illustrates the model-fitting process.

Suggested Citation

  • James E. Pustejovsky & Larry V. Hedges & William R. Shadish, 2014. "Design-Comparable Effect Sizes in Multiple Baseline Designs," Journal of Educational and Behavioral Statistics, , vol. 39(5), pages 368-393, October.
  • Handle: RePEc:sae:jedbes:v:39:y:2014:i:5:p:368-393
    DOI: 10.3102/1076998614547577
    as

    Download full text from publisher

    File URL: https://journals.sagepub.com/doi/10.3102/1076998614547577
    Download Restriction: no

    File URL: https://libkey.io/10.3102/1076998614547577?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Yeojin Chung & Sophia Rabe-Hesketh & Vincent Dorie & Andrew Gelman & Jingchen Liu, 2013. "A Nondegenerate Penalized Likelihood Estimator for Variance Parameters in Multilevel Models," Psychometrika, Springer;The Psychometric Society, vol. 78(4), pages 685-709, October.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Jeffrey C. Valentine & Emily E. Tanner‐Smith & James E. Pustejovsky & T. S. Lau, 2016. "Between‐case standardized mean difference effect sizes for single‐case designs: a primer and tutorial using the scdhlm web application," Campbell Systematic Reviews, John Wiley & Sons, vol. 12(1), pages 1-31.
    2. Seang-Hwane Joo & Yan Wang & John Ferron & S. Natasha Beretvas & Mariola Moeyaert & Wim Van Den Noortgate, 2022. "Comparison of Within- and Between-Series Effect Estimates in the Meta-Analysis of Multiple Baseline Studies," Journal of Educational and Behavioral Statistics, , vol. 47(2), pages 131-166, April.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Barakat, Bilal Fouad & Dharamshi, Ameer & Alkema, Leontine & Antoninis, Manos, 2021. "Adjusted Bayesian Completion Rates (ABC) Estimation," SocArXiv at368, Center for Open Science.
    2. Christopher N. Boyer & Dayton M. Lambert & Charles C. Martinez & Joshua G. Maples, 2023. "Beef and pork processing plant labor costs," Agribusiness, John Wiley & Sons, Ltd., vol. 39(3), pages 691-702, July.
    3. Meager, Rachael, 2019. "Understanding the average impact of microcredit expansions: a Bayesian hierarchical analysis of seven randomized experiments," LSE Research Online Documents on Economics 88190, London School of Economics and Political Science, LSE Library.
    4. Ameer Dharamshi & Bilal Barakat & Leontine Alkema & Manos Antoninis, 2022. "A Bayesian model for estimating Sustainable Development Goal indicator 4.1.2: School completion rates," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 71(5), pages 1822-1864, November.
    5. Pittau, Maria Grazia & Farcomeni, Alessio & Zelli, Roberto, 2016. "Has the attitude of US citizens towards redistribution changed over time?," Economic Modelling, Elsevier, vol. 52(PB), pages 714-724.
    6. Bates, Douglas & Mächler, Martin & Bolker, Ben & Walker, Steve, 2015. "Fitting Linear Mixed-Effects Models Using lme4," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 67(i01).
    7. Clifford, Scott & Rainey, Carlisle, 2023. "Estimators for Topic-Sampling Designs," SocArXiv 7ady6, Center for Open Science.
    8. Elisa Mazzotta & Laura Bellinati & Cristina Bertasio & Maria Beatrice Boniotti & Laura Lucchese & Letizia Ceglie & Federico Martignago & Stefania Leopardi & Alda Natale, 2023. "Synanthropic and Wild Animals as Sentinels of Zoonotic Agents: A Study of Leptospira Genotypes Circulating in Northeastern Italy," IJERPH, MDPI, vol. 20(5), pages 1-14, February.
    9. Yeojin Chung & Andrew Gelman & Sophia Rabe-Hesketh & Jingchen Liu & Vincent Dorie, 2015. "Weakly Informative Prior for Point Estimation of Covariance Matrices in Hierarchical Models," Journal of Educational and Behavioral Statistics, , vol. 40(2), pages 136-157, April.
    10. Meager, Rachael, 2022. "Aggregating distributional treatment effects: a Bayesian hierarchical analysis of the microcredit literature," LSE Research Online Documents on Economics 115559, London School of Economics and Political Science, LSE Library.
    11. Lars Lenze & Claudia Klostermann & Markus Lamprecht & Siegfried Nagel, 2021. "Taking Up and Terminating Leisure-Time Physical Activity over the Life Course: The Role of Life Events in the Familial and Occupational Life Domains," IJERPH, MDPI, vol. 18(18), pages 1-15, September.
    12. Steffen Nestler & Edgar Erdfelder, 2023. "Random Effects Multinomial Processing Tree Models: A Maximum Likelihood Approach," Psychometrika, Springer;The Psychometric Society, vol. 88(3), pages 809-829, September.
    13. Rico Krueger & Taha H. Rashidi & Akshay Vij, 2020. "X vs. Y: an analysis of intergenerational differences in transport mode use among young adults," Transportation, Springer, vol. 47(5), pages 2203-2231, October.
    14. Krueger, Rico & Rashidi, Taha H. & Vij, Akshay, 2018. "X vs. Y: An Analysis of Intergenerational Differences in Transport Mode Use Among Young Adults," SocArXiv unezy, Center for Open Science.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:sae:jedbes:v:39:y:2014:i:5:p:368-393. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: SAGE Publications (email available below). General contact details of provider: .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.