IDEAS home Printed from https://ideas.repec.org/a/sae/jedbes/v38y2013i4p323-354.html
   My bibliography  Save this article

Student Mobility, Dosage, and Principal Stratification in School-Based RCTs

Author

Listed:
  • Peter Z. Schochet

    (Mathematica Policy Research, Inc.)

Abstract

In school-based randomized control trials (RCTs), a common design is to follow student cohorts over time. For such designs, education researchers usually focus on the place-based (PB) impact parameter, which is estimated using data collected on all students enrolled in the study schools at each data collection point. A potential problem with this approach, however, is that the PB impact parameter could confound intervention effects on student mobility with more policy-relevant intervention effects on student achievement. Furthermore, the PB parameter pertains to students with different levels of intervention exposure, which complicates the interpretation of the impact findings. To address these issues, this article uses a principal stratification approach to examine the survivor average causal effect (SACE) parameter for original cohort students who would remain in their baseline study schools in either the treatment or control condition. The SACE parameter pertains to those who would receive maximum exposure to the intervention, and thus is a relevant parameter for dosage analyses. A strategy to estimate the SACE parameter is discussed using maximum likelihood (ML) methods for finite mixture models, the expectation-maximization (EM) algorithm, and robust standard errors to adjust for clustering. The estimation approach is demonstrated using data from a recent large-scale, school-based RCT where student mobility was common during the 3-year follow-up period.

Suggested Citation

  • Peter Z. Schochet, 2013. "Student Mobility, Dosage, and Principal Stratification in School-Based RCTs," Journal of Educational and Behavioral Statistics, , vol. 38(4), pages 323-354, August.
  • Handle: RePEc:sae:jedbes:v:38:y:2013:i:4:p:323-354
    DOI: 10.3102/1076998612458322
    as

    Download full text from publisher

    File URL: https://journals.sagepub.com/doi/10.3102/1076998612458322
    Download Restriction: no

    File URL: https://libkey.io/10.3102/1076998612458322?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Hong, Guanglei & Raudenbush, Stephen W., 2006. "Evaluating Kindergarten Retention Policy: A Case Study of Causal Inference for Multilevel Observational Data," Journal of the American Statistical Association, American Statistical Association, vol. 101, pages 901-910, September.
    2. Peter Z. Schochet & John Burghardt, "undated". "Using Propensity Scoring to Estimate Program-Related Subgroup Impacts in Experimental Program Evaluations," Mathematica Policy Research Reports 3a3d011dfc3a4189ac810bd66, Mathematica Policy Research.
    3. Zhang, Junni L. & Rubin, Donald B. & Mealli, Fabrizia, 2009. "Likelihood-Based Analysis of Causal Effects of Job-Training Programs Using Principal Stratification," Journal of the American Statistical Association, American Statistical Association, vol. 104(485), pages 166-176.
    4. Robert Sampson & Patrick Sharkey, 2008. "Neighborhood selection and the social reproduction of concentrated racial inequality," Demography, Springer;Population Association of America (PAA), vol. 45(1), pages 1-29, February.
    5. Hanushek, Eric A. & Kain, John F. & Rivkin, Steven G., 2004. "Disruption versus Tiebout improvement: the costs and benefits of switching schools," Journal of Public Economics, Elsevier, vol. 88(9-10), pages 1721-1746, August.
    6. Peter Z. Schochet, "undated". "Statistical Power for Random Assignment Evaluations of Education Programs," Mathematica Policy Research Reports 6749d31ad72d4acf988f7dce5, Mathematica Policy Research.
    7. Constantine E. Frangakis & Donald B. Rubin, 2002. "Principal Stratification in Causal Inference," Biometrics, The International Biometric Society, vol. 58(1), pages 21-29, March.
    8. repec:mpr:mprres:5863 is not listed on IDEAS
    9. repec:mpr:mprres:5406 is not listed on IDEAS
    10. Imai, Kosuke, 2008. "Sharp bounds on the causal effects in randomized experiments with "truncation-by-death"," Statistics & Probability Letters, Elsevier, vol. 78(2), pages 144-149, February.
    11. Heckman, James J. & Robb, Richard Jr., 1985. "Alternative methods for evaluating the impact of interventions : An overview," Journal of Econometrics, Elsevier, vol. 30(1-2), pages 239-267.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. repec:mpr:mprres:8128 is not listed on IDEAS
    2. Fan Yang & Dylan S. Small, 2016. "Using post-outcome measurement information in censoring-by-death problems," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 78(1), pages 299-318, January.
    3. Avi Feller & Fabrizia Mealli & Luke Miratrix, 2017. "Principal Score Methods: Assumptions, Extensions, and Practical Considerations," Journal of Educational and Behavioral Statistics, , vol. 42(6), pages 726-758, December.
    4. German Blanco & Carlos A. Flores & Alfonso Flores-Lagunes, 2013. "Bounds on Average and Quantile Treatment Effects of Job Corps Training on Wages," Journal of Human Resources, University of Wisconsin Press, vol. 48(3), pages 659-701.
    5. Giovanni Mellace & Roberto Rocci, 2011. "Principal Stratification in sample selection problems with non normal error terms," CEIS Research Paper 194, Tor Vergata University, CEIS, revised 02 May 2011.
    6. Andrea Mercatanti & Fan Li, 2017. "Do debit cards decrease cash demand?: causal inference and sensitivity analysis using principal stratification," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 66(4), pages 759-776, August.
    7. Chiba, Yasutaka, 2012. "A note on bounds for the causal infectiousness effect in vaccine trials," Statistics & Probability Letters, Elsevier, vol. 82(7), pages 1422-1429.
    8. VanderWeele Tyler J, 2011. "Principal Stratification -- Uses and Limitations," The International Journal of Biostatistics, De Gruyter, vol. 7(1), pages 1-14, July.
    9. Huber, Martin & Meier, Jonas & Wallimann, Hannes, 2022. "Business analytics meets artificial intelligence: Assessing the demand effects of discounts on Swiss train tickets," Transportation Research Part B: Methodological, Elsevier, vol. 163(C), pages 22-39.
    10. Gueorgui Kambourov & Iourii Manovskii & Miana Plesca, 2020. "Occupational mobility and the returns to training," Canadian Journal of Economics/Revue canadienne d'économique, John Wiley & Sons, vol. 53(1), pages 174-211, February.
    11. Simon Calmar Andersen & Louise Beuchert & Phillip Heiler & Helena Skyt Nielsen, 2023. "A Guide to Impact Evaluation under Sample Selection and Missing Data: Teacher's Aides and Adolescent Mental Health," Papers 2308.04963, arXiv.org.
    12. James J. Heckman & Rodrigo Pinto, 2018. "Unordered Monotonicity," Econometrica, Econometric Society, vol. 86(1), pages 1-35, January.
    13. Guanglei Hong & Jonah Deutsch & Heather D. Hill, 2015. "Ratio-of-Mediator-Probability Weighting for Causal Mediation Analysis in the Presence of Treatment-by-Mediator Interaction," Journal of Educational and Behavioral Statistics, , vol. 40(3), pages 307-340, June.
    14. Bia, Michela & Flores-Lagunes, Alfonso & Mercatanti, Andrea, 2018. "Evaluation of Language Training Programs in Luxembourg using Principal Stratification," GLO Discussion Paper Series 289, Global Labor Organization (GLO).
    15. Tyler J. VanderWeele, 2010. "Direct and Indirect Effects for Neighborhood-Based Clustered and Longitudinal Data," Sociological Methods & Research, , vol. 38(4), pages 515-544, May.
    16. Shanshan Luo & Wei Li & Yangbo He, 2023. "Causal inference with outcomes truncated by death in multiarm studies," Biometrics, The International Biometric Society, vol. 79(1), pages 502-513, March.
    17. Markus Frölich & Martin Huber, 2014. "Treatment Evaluation With Multiple Outcome Periods Under Endogeneity and Attrition," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 109(508), pages 1697-1711, December.
    18. Hans Fricke & Markus Frölich & Martin Huber & Michael Lechner, 2020. "Endogeneity and non‐response bias in treatment evaluation – nonparametric identification of causal effects by instruments," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 35(5), pages 481-504, August.
    19. John Engberg & Dennis Epple & Jason Imbrogno & Holger Sieg & Ron Zimmer, 2014. "Evaluating Education Programs That Have Lotteried Admission and Selective Attrition," Journal of Labor Economics, University of Chicago Press, vol. 32(1), pages 27-63.
    20. Soojin Park & Gregory J. Palardy, 2020. "Sensitivity Evaluation of Methods for Estimating Complier Average Causal Mediation Effects to Assumptions," Journal of Educational and Behavioral Statistics, , vol. 45(4), pages 475-506, August.
    21. Kosuke Imai & Zhichao Jiang, 2020. "Identification and sensitivity analysis of contagion effects in randomized placebo‐controlled trials," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 183(4), pages 1637-1657, October.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:sae:jedbes:v:38:y:2013:i:4:p:323-354. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: SAGE Publications (email available below). General contact details of provider: .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.