IDEAS home Printed from https://ideas.repec.org/a/eee/epplan/v97y2023ics0149718923000435.html
   My bibliography  Save this article

Surfacing, as well as testing, “elliptical assumptions” in a theory of change: Principled discovery

Author

Listed:
  • Mark, Melvin M.

Abstract

While the testing of known assumptions in a theory of change is important, so too is the discovery or surfacing of previously unrecognized assumptions. This paper describes and illustrates the surfacing of “elliptical assumptions,” which involve the unknown ingredients that are necessary for a program to be effective. Identifying the ingredients of program success is important for several reasons, which include (a) guiding the development of an improved theory of change, which in turn can guide program improvement, and (b) informing efforts to transfer the program to other settings and populations. However, when an observed pattern, such as differential program effects, points to the existence of a previously unidentified but important ingredient, this might be a just-so story, a seemingly compelling but inaccurate account. Accordingly, the testing of previously unidentified elliptical assumptions is recommended and illustrated.

Suggested Citation

  • Mark, Melvin M., 2023. "Surfacing, as well as testing, “elliptical assumptions” in a theory of change: Principled discovery," Evaluation and Program Planning, Elsevier, vol. 97(C).
    • Handle: RePEc:eee:epplan:v:97:y:2023:i:c:s0149718923000435
    DOI: 10.1016/j.evalprogplan.2023.102266
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0149718923000435
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.evalprogplan.2023.102266?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Matthew M. Chingos & Kenneth A. Couch, 2013. "Class Size and Student Outcomes: Research and Policy Implications," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 32(2), pages 411-438, March.
    2. Nkwake, Apollo M. & Morrow, Nathan, 2016. "Clarifying concepts and categories of assumptions for use in evaluation," Evaluation and Program Planning, Elsevier, vol. 59(C), pages 97-101.
    3. David Sims, 2008. "A strategic response to class size reduction: Combination classes and student achievement in California," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 27(3), pages 457-478.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Nakaima, April & Sridharan, Sanjeev & Gibson, Rachael, 2023. "Towards an evolutionary approach to learning from assumptions: Lessons from the evaluation of Dancing with Parkinson’s," Evaluation and Program Planning, Elsevier, vol. 97(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Christopher Jepsen, 2015. "Class size: Does it matter for student achievement?," IZA World of Labor, Institute of Labor Economics (IZA), pages 190-190, September.
    2. David N. Figlio & Cassandra M.D. Hart & Krzysztof Karbownik, 2020. "Effects of Scaling Up Private School Choice Programs on Public School Students," NBER Working Papers 26758, National Bureau of Economic Research, Inc.
    3. Joshua D. Angrist & Erich Battistin & Daniela Vuri, 2017. "In a Small Moment: Class Size and Moral Hazard in the Italian Mezzogiorno," American Economic Journal: Applied Economics, American Economic Association, vol. 9(4), pages 216-249, October.
    4. Thomas, Jaime L., 2012. "Combination classes and educational achievement," Economics of Education Review, Elsevier, vol. 31(6), pages 1058-1066.
    5. Sridharan, Sanjeev & Nakaima, April, 2023. "Learning from experiences of evaluators implementing theory-driven evaluations in diverse settings: Building on the contributions of John Mayne," Evaluation and Program Planning, Elsevier, vol. 97(C).
    6. Reiling, Rune Borgan, 2016. "Does size matter? Educational attainment and cohort size," Journal of Urban Economics, Elsevier, vol. 94(C), pages 73-89.
    7. Checchi, Daniele & De Paola, Maria, 2018. "The effect of multigrade classes on cognitive and non- cognitive skills. Causal evidence exploiting minimum class size rules in Italy✰," Economics of Education Review, Elsevier, vol. 67(C), pages 235-253.
    8. repec:eee:ireced:v:30:y:2019:i:c:p:- is not listed on IDEAS
    9. Joshua D. Angrist, 2022. "Empirical Strategies in Economics: Illuminating the Path From Cause to Effect," Econometrica, Econometric Society, vol. 90(6), pages 2509-2539, November.
    10. Gian Paolo Barbetta & Patrick Chuard-Keller & Giuseppe Sorrenti & Gilberto Turati, 2022. "Good or Bad? Short- versus Long-Term Effects of Multigrading on Child Achievement," Tinbergen Institute Discussion Papers 22-025/V, Tinbergen Institute.
    11. Fredriksson, Peter & Öckert, Björn & Oosterbeek, Hessel, 2014. "Inside the Black Box of Class Size: Mechanisms, Behavioral Responses, and Social Background," IZA Discussion Papers 8019, Institute of Labor Economics (IZA).
    12. Kenzie, Erin S. & Wakeland, Wayne & Jetter, Antonie & Lich, Kristen Hassmiller & Seater, Mellodie & Gunn, Rose & Davis, Melinda M., 2024. "Protocol for an interview-based method for mapping mental models using causal-loop diagramming and realist interviewing," Evaluation and Program Planning, Elsevier, vol. 103(C).
    13. Han, Joseph & Ryu, Keunkwan, 2017. "Effects of class size reduction in upper grades: Evidence from Seoul, Korea," Economics of Education Review, Elsevier, vol. 60(C), pages 68-85.
    14. Chingos, Matthew M., 2012. "The impact of a universal class-size reduction policy: Evidence from Florida's statewide mandate," Economics of Education Review, Elsevier, vol. 31(5), pages 543-562.
    15. Timothy Köhler, 2020. "Socioeconomic Status and Class Size in South African Secondary Schools," Working Papers 01/2020, Stellenbosch University, Department of Economics.
    16. Matthew M. Chingos & Kenneth A. Couch, 2013. "Class Size and Student Outcomes: Research and Policy Implications," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 32(2), pages 411-438, March.
    17. Michael J. Kottelenberg & Steven F. Lehrer, 2014. "Do the Perils of Universal Childcare Depend on the Child’s Age?," CESifo Economic Studies, CESifo Group, vol. 60(2), pages 338-365.
    18. Hui Jin & La-Bhus Fah Jirasavetakul & Baoping Shang, 2019. "Improving the Efficiency and Equity of Public Education Spending: The Case of Moldova," IMF Working Papers 2019/042, International Monetary Fund.
    19. Castro, Juan F. & Rolleston, Caine, 2018. "The contribution of early childhood and schools to cognitive gaps: New evidence from Peru," Economics of Education Review, Elsevier, vol. 64(C), pages 144-164.
    20. Torsten Figueiredo Walter, 2020. "Misallocation in the Public Sector? Cross-Country Evidence from Two Million Primary Schools," STICERD - Economic Organisation and Public Policy Discussion Papers Series 70, Suntory and Toyota International Centres for Economics and Related Disciplines, LSE.
    21. repec:mpr:mprres:7711 is not listed on IDEAS
    22. Elad Demalach & Noam Zussman, 2023. "The Effect Of Vocational Education On Short- And Long-Term Outcomes," Israel Economic Review, Bank of Israel, vol. 21(2), pages 1-56, December.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:epplan:v:97:y:2023:i:c:s0149718923000435. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/evalprogplan .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.