IDEAS home Printed from https://ideas.repec.org/p/mpr/mprres/2798055510274fa9b4fdfa54b5a263d0.html
   My bibliography  Save this paper

Replicating Experimental Impact Estimates with Nonexperimental Methods in the Context of Control Crossover

Author

Listed:
  • Brian Gill
  • Joshua Furgeson
  • Hanley S. Chiang
  • Bing-Ru Teh
  • Joshua Haimson
  • Natalya Verbitsky-Savitz

Abstract

Ideally, nonexperimental methods that aim to replicate the results of rigorous randomized experiments focus on the intent to treat (ITT) experimental impact estimate, the most causally rigorous measure.

Suggested Citation

  • Brian Gill & Joshua Furgeson & Hanley S. Chiang & Bing-Ru Teh & Joshua Haimson & Natalya Verbitsky-Savitz, "undated". "Replicating Experimental Impact Estimates with Nonexperimental Methods in the Context of Control Crossover," Mathematica Policy Research Reports 2798055510274fa9b4fdfa54b, Mathematica Policy Research.
    • Handle: RePEc:mpr:mprres:2798055510274fa9b4fdfa54b5a263d0
    as

    Download full text from publisher

    File URL: https://www.mathematica.org/-/media/publications/pdfs/education/crossover_replication_wp.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. A. Smith, Jeffrey & E. Todd, Petra, 2005. "Does matching overcome LaLonde's critique of nonexperimental estimators?," Journal of Econometrics, Elsevier, vol. 125(1-2), pages 305-353.
    2. repec:mpr:mprres:5572 is not listed on IDEAS
    3. Philip Gleason & Melissa Clark & Christina Clark Tuttle & Emily Dwoyer, "undated". "The Evaluation of Charter School Impacts," Mathematica Policy Research Reports 3066da11915a4b04a77b38848, Mathematica Policy Research.
    4. Tuttle, Christina Clark & Gleason, Philip & Clark, Melissa, 2012. "Using lotteries to evaluate schools of choice: Evidence from a national study of charter schools," Economics of Education Review, Elsevier, vol. 31(2), pages 237-253.
    5. David McKenzie & John Gibson & Steven Stillman, 2010. "How Important Is Selection? Experimental vs. Non-Experimental Measures of the Income Gains from Migration," Journal of the European Economic Association, MIT Press, vol. 8(4), pages 913-945, June.
    6. repec:mpr:mprres:6676 is not listed on IDEAS
    7. Kenneth Fortson & Natalya Verbitsky-Savitz & Emma Kopa & Philip Gleason, 2012. "Using an Experimental Evaluation of Charter Schools to Test Whether Nonexperimental Comparison Group Methods Can Replicate Experimental Impact Estimates," Mathematica Policy Research Reports 27f871b5b7b94f3a80278a593, Mathematica Policy Research.
    8. repec:mpr:mprres:7713 is not listed on IDEAS
    9. repec:mpr:mprres:7293 is not listed on IDEAS
    10. Atila Abdulkadiroğlu & Joshua D. Angrist & Susan M. Dynarski & Thomas J. Kane & Parag A. Pathak, 2011. "Accountability and Flexibility in Public Schools: Evidence from Boston's Charters And Pilots," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 126(2), pages 699-748.
    11. repec:mpr:mprres:6720 is not listed on IDEAS
    12. Kenneth A. Couch & Robert Bifulco, 2012. "Can Nonexperimental Estimates Replicate Estimates Based on Random Assignment in Evaluations of School Choice? A Within‐Study Comparison," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 31(3), pages 729-751, June.
    13. Philip Gleason & Melissa Clark & Christina Clark Tuttle & Emily Dwoyer, 2010. "The Evaluation of Charter School Impacts (Presentation)," Mathematica Policy Research Reports 770e250b2ef343a3b1ec8c932, Mathematica Policy Research.
    14. repec:mpr:mprres:7443 is not listed on IDEAS
    15. Caroline M. Hoxby & Sonali Murarka, 2009. "Charter Schools in New York City: Who Enrolls and How They Affect Their Students' Achievement," NBER Working Papers 14852, National Bureau of Economic Research, Inc.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Joshua Furgeson & Moira McCullough & Clare Wolfendale & Brian Gill, "undated". "The Equity Project Charter School: Impacts on Student Achievement," Mathematica Policy Research Reports 9ed165ddb03646a496128da4d, Mathematica Policy Research.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. repec:mpr:mprres:7927 is not listed on IDEAS
    2. Fortson, Kenneth & Gleason, Philip & Kopa, Emma & Verbitsky-Savitz, Natalya, 2015. "Horseshoes, hand grenades, and treatment effects? Reassessing whether nonexperimental estimators are biased," Economics of Education Review, Elsevier, vol. 44(C), pages 100-113.
    3. Christina Clark Tuttle & Brian Gill & Philip Gleason & Virginia Knechtel & Ira Nichols-Barrer & Alexandra Resch, "undated". "KIPP Middle Schools: Impacts on Achievement and Other Outcomes," Mathematica Policy Research Reports 4e2030d4eef1429395a8dd457, Mathematica Policy Research.
    4. Vivian C. Wong & Peter M. Steiner & Kylie L. Anglin, 2018. "What Can Be Learned From Empirical Evaluations of Nonexperimental Methods?," Evaluation Review, , vol. 42(2), pages 147-175, April.
    5. Philip M. Gleason & Christina Clark Tuttle & Brian Gill & Ira Nichols-Barrer & Bing-ru Teh, 2014. "Do KIPP Schools Boost Student Achievement?," Education Finance and Policy, MIT Press, vol. 9(1), pages 36-58, January.
    6. Susan Dynarski & Daniel Hubbard & Brian Jacob & Silvia Robles, 2018. "Estimating the Effects of a Large For-Profit Charter School Operator," NBER Working Papers 24428, National Bureau of Economic Research, Inc.
    7. Eyles, Andrew & Machin, Stephen & McNally, Sandra, 2017. "Unexpected school reform: Academisation of primary schools in England," Journal of Public Economics, Elsevier, vol. 155(C), pages 108-121.
    8. Vilsa E. Curto & Roland G. Fryer Jr., 2014. "The Potential of Urban Boarding Schools for the Poor: Evidence from SEED," Journal of Labor Economics, University of Chicago Press, vol. 32(1), pages 65-93.
    9. Ben Weidmann & Luke Miratrix, 2021. "Lurking Inferential Monsters? Quantifying Selection Bias In Evaluations Of School Programs," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 40(3), pages 964-986, June.
    10. Joe Regan-Stansfield, 2016. "Do good primary schools perform even better as academies?," Working Papers 141167564, Lancaster University Management School, Economics Department.
    11. Sarah R. Cohodes, 2016. "Teaching to the Student: Charter School Effectiveness in Spite of Perverse Incentives," Education Finance and Policy, MIT Press, vol. 11(1), pages 1-42, Winter.
    12. Fatih Unlu & Douglas Lee Lauen & Sarah Crittenden Fuller & Tiffany Berglund & Elc Estrera, 2021. "Can Quasi‐Experimental Evaluations That Rely On State Longitudinal Data Systems Replicate Experimental Results?," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 40(2), pages 572-613, March.
    13. Regan-Stansfield, Joseph, 2018. "Does greater primary school autonomy improve pupil attainment? Evidence from primary school converter academies in England✰," Economics of Education Review, Elsevier, vol. 63(C), pages 167-179.
    14. Kevin Booker & Brian Gill & Tim Sass & Ron Zimmer, "undated". "Charter High Schools' Effects on Long-Term Attainment and Earnings (Working Paper)," Mathematica Policy Research Reports cfe561a4b1924b7eafb64f918, Mathematica Policy Research.
    15. Clément de Chaisemartin & Luc Behaghel, 2020. "Estimating the Effect of Treatments Allocated by Randomized Waiting Lists," Econometrica, Econometric Society, vol. 88(4), pages 1453-1477, July.
    16. Sorensen, Lucy C. & Holt, Stephen B., 2021. "Sorting it Out: The Effects of Charter Expansion on Teacher and Student Composition at Traditional Public Schools," Economics of Education Review, Elsevier, vol. 82(C).
    17. Carlson, Deven & Lavertu, Stéphane, 2016. "Charter school closure and student achievement: Evidence from Ohio," Journal of Urban Economics, Elsevier, vol. 95(C), pages 31-48.
    18. Caitlin Kearns & Douglas Lee Lauen & Bruce Fuller, 2020. "Competing With Charter Schools: Selection, Retention, and Achievement in Los Angeles Pilot Schools," Evaluation Review, , vol. 44(2-3), pages 111-144, April.
    19. Ron Zimmer & Brian Gill & Jonathon Attridge & Kaitlin Obenauf, 2014. "Charter School Authorizers and Student Achievement," Education Finance and Policy, MIT Press, vol. 9(1), pages 59-85, January.
    20. Roland G. Fryer, Jr, 2016. "The Production of Human Capital in Developed Countries: Evidence from 196 Randomized Field Experiments," NBER Working Papers 22130, National Bureau of Economic Research, Inc.
    21. Lisa Dragoset & Susanne James-Burdumy & Kristin Hallgren & Irma Perez-Johnson & Mariesa Herrmann & Christina Tuttle & Megan Hague Angus & Rebecca Herman & Matthew Murray & Courtney Tanenbaum & Cheryl , 2015. "Usage of Practices Promoted by School Improvement Grants," Mathematica Policy Research Reports 8e99f01663504ef5b9f8357f6, Mathematica Policy Research.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:mpr:mprres:2798055510274fa9b4fdfa54b5a263d0. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Joanne Pfleiderer or Cindy George (email available below). General contact details of provider: https://edirc.repec.org/data/mathius.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.