IDEAS home Printed from https://ideas.repec.org/a/eee/epplan/v97y2023ics0149718923000435.html
   My bibliography  Save this article

Surfacing, as well as testing, “elliptical assumptions” in a theory of change: Principled discovery

Author

Listed:
  • Mark, Melvin M.

Abstract

While the testing of known assumptions in a theory of change is important, so too is the discovery or surfacing of previously unrecognized assumptions. This paper describes and illustrates the surfacing of “elliptical assumptions,” which involve the unknown ingredients that are necessary for a program to be effective. Identifying the ingredients of program success is important for several reasons, which include (a) guiding the development of an improved theory of change, which in turn can guide program improvement, and (b) informing efforts to transfer the program to other settings and populations. However, when an observed pattern, such as differential program effects, points to the existence of a previously unidentified but important ingredient, this might be a just-so story, a seemingly compelling but inaccurate account. Accordingly, the testing of previously unidentified elliptical assumptions is recommended and illustrated.

Suggested Citation

  • Mark, Melvin M., 2023. "Surfacing, as well as testing, “elliptical assumptions” in a theory of change: Principled discovery," Evaluation and Program Planning, Elsevier, vol. 97(C).
    • Handle: RePEc:eee:epplan:v:97:y:2023:i:c:s0149718923000435
    DOI: 10.1016/j.evalprogplan.2023.102266
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0149718923000435
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.evalprogplan.2023.102266?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Matthew M. Chingos & Kenneth A. Couch, 2013. "Class Size and Student Outcomes: Research and Policy Implications," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 32(2), pages 411-438, March.
    2. David Sims, 2008. "A strategic response to class size reduction: Combination classes and student achievement in California," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 27(3), pages 457-478.
    3. Nkwake, Apollo M. & Morrow, Nathan, 2016. "Clarifying concepts and categories of assumptions for use in evaluation," Evaluation and Program Planning, Elsevier, vol. 59(C), pages 97-101.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Nakaima, April & Sridharan, Sanjeev & Gibson, Rachael, 2023. "Towards an evolutionary approach to learning from assumptions: Lessons from the evaluation of Dancing with Parkinson’s," Evaluation and Program Planning, Elsevier, vol. 97(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Christopher Jepsen, 2015. "Class size: Does it matter for student achievement?," IZA World of Labor, Institute of Labor Economics (IZA), pages 190-190, September.
    2. David N. Figlio & Cassandra M.D. Hart & Krzysztof Karbownik, 2020. "Effects of Scaling Up Private School Choice Programs on Public School Students," NBER Working Papers 26758, National Bureau of Economic Research, Inc.
    3. Sridharan, Sanjeev & Nakaima, April, 2023. "Learning from experiences of evaluators implementing theory-driven evaluations in diverse settings: Building on the contributions of John Mayne," Evaluation and Program Planning, Elsevier, vol. 97(C).
    4. Checchi, Daniele & De Paola, Maria, 2018. "The effect of multigrade classes on cognitive and non- cognitive skills. Causal evidence exploiting minimum class size rules in Italy✰," Economics of Education Review, Elsevier, vol. 67(C), pages 235-253.
    5. Joshua D. Angrist, 2022. "Empirical Strategies in Economics: Illuminating the Path From Cause to Effect," Econometrica, Econometric Society, vol. 90(6), pages 2509-2539, November.
    6. Matej Opatrny & Tomas Havranek & Zuzana Irsova & Milan Scasny, 2023. "Publication Bias and Model Uncertainty in Measuring the Effect of Class Size on Achievement," Working Papers IES 2023/19, Charles University Prague, Faculty of Social Sciences, Institute of Economic Studies, revised May 2023.
    7. Fredriksson, Peter & Öckert, Björn & Oosterbeek, Hessel, 2014. "Inside the Black Box of Class Size: Mechanisms, Behavioral Responses, and Social Background," IZA Discussion Papers 8019, Institute of Labor Economics (IZA).
    8. Matthew M. Chingos & Kenneth A. Couch, 2013. "Class Size and Student Outcomes: Research and Policy Implications," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 32(2), pages 411-438, March.
    9. Hui Jin & La-Bhus Fah Jirasavetakul & Baoping Shang, 2019. "Improving the Efficiency and Equity of Public Education Spending: The Case of Moldova," IMF Working Papers 2019/042, International Monetary Fund.
    10. Castro, Juan F. & Rolleston, Caine, 2018. "The contribution of early childhood and schools to cognitive gaps: New evidence from Peru," Economics of Education Review, Elsevier, vol. 64(C), pages 144-164.
    11. Torsten Figueiredo Walter, 2020. "Misallocation in the Public Sector? Cross-Country Evidence from Two Million Primary Schools," STICERD - Economic Organisation and Public Policy Discussion Papers Series 70, Suntory and Toyota International Centres for Economics and Related Disciplines, LSE.
    12. Jaime Thomas, "undated". "Combination Classes and Educational Achievement (Conference Paper)," Mathematica Policy Research Reports 4e18a31395b24c4f986071000, Mathematica Policy Research.
    13. Unkovic, Cait & Sen, Maya & Quinn, Kevin M., 2015. "Does Encouragement Matter in Improving Gender Imbalances in Technical Fields? Evidence from a Randomized Controlled Trial," Working Paper Series rwp15-032, Harvard University, John F. Kennedy School of Government.
    14. Simone Balestra & Uschi Backes-Gellner, 2017. "Heterogeneous effects of pupil-to-teacher ratio policies - A look at class size reduction and teacher aide," Economics of Education Working Paper Series 0130, University of Zurich, Department of Business Administration (IBW).
    15. Agustina Laurito & Johanna Lacoe & Amy Ellen Schwartz & Patrick Sharkey & Ingrid Gould Ellen, "undated". "School Climate and the Impact of Neighborhood Crime on Test Scores," Mathematica Policy Research Reports 22946c6212374659afcb48ce0, Mathematica Policy Research.
    16. Elad Demalach & Noam Zussman, 2017. "The Effect of Vocational Education on Short- and Long-Term Outcomes of Students: Evidence from the Arab Education System in Israel," Bank of Israel Working Papers 2017.11, Bank of Israel.
    17. Cohen, Alison K., 2018. "An instrumental variables approach to assess the effect of class size reduction on student screen time," Social Science & Medicine, Elsevier, vol. 201(C), pages 63-70.
    18. Sims, David P., 2009. "Crowding Peter to educate Paul: Lessons from a class size reduction externality," Economics of Education Review, Elsevier, vol. 28(4), pages 465-473, August.
    19. Joshua D. Angrist & Erich Battistin & Daniela Vuri, 2017. "In a Small Moment: Class Size and Moral Hazard in the Italian Mezzogiorno," American Economic Journal: Applied Economics, American Economic Association, vol. 9(4), pages 216-249, October.
    20. Thomas, Jaime L., 2012. "Combination classes and educational achievement," Economics of Education Review, Elsevier, vol. 31(6), pages 1058-1066.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:epplan:v:97:y:2023:i:c:s0149718923000435. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/evalprogplan .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.