IDEAS home Printed from https://ideas.repec.org/a/eee/epplan/v59y2016icp109-118.html
   My bibliography  Save this article

Interfacing theories of program with theories of evaluation for advancing evaluation practice: Reductionism, systems thinking, and pragmatic synthesis

Author

Listed:
  • Chen, Huey T.

Abstract

Theories of program and theories of evaluation form the foundation of program evaluation theories. Theories of program reflect assumptions on how to conceptualize an intervention program for evaluation purposes, while theories of evaluation reflect assumptions on how to design useful evaluation. These two types of theories are related, but often discussed separately. This paper attempts to use three theoretical perspectives (reductionism, systems thinking, and pragmatic synthesis) to interface them and discuss the implications for evaluation practice. Reductionism proposes that an intervention program can be broken into crucial components for rigorous analyses; systems thinking view an intervention program as dynamic and complex, requiring a holistic examination. In spite of their contributions, reductionism and systems thinking represent the extreme ends of a theoretical spectrum; many real-world programs, however, may fall in the middle. Pragmatic synthesis is being developed to serve these moderate- complexity programs. These three theoretical perspectives have their own strengths and challenges. Knowledge on these three perspectives and their evaluation implications can provide a better guide for designing fruitful evaluations, improving the quality of evaluation practice, informing potential areas for developing cutting-edge evaluation approaches, and contributing to advancing program evaluation toward a mature applied science.

Suggested Citation

  • Chen, Huey T., 2016. "Interfacing theories of program with theories of evaluation for advancing evaluation practice: Reductionism, systems thinking, and pragmatic synthesis," Evaluation and Program Planning, Elsevier, vol. 59(C), pages 109-118.
    • Handle: RePEc:eee:epplan:v:59:y:2016:i:c:p:109-118
    DOI: 10.1016/j.evalprogplan.2016.05.012
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0149718916301008
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.evalprogplan.2016.05.012?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Chen, Huey T., 2010. "The bottom-up approach to integrative validity: A new perspective for program evaluation," Evaluation and Program Planning, Elsevier, vol. 33(3), pages 205-214, August.
    2. Cabrera, Derek & Colosi, Laura & Lobdell, Claire, 2008. "Systems thinking," Evaluation and Program Planning, Elsevier, vol. 31(3), pages 299-310, August.
    3. Mingers, John & White, Leroy, 2010. "A review of the recent contribution of systems thinking to operational research and management science," European Journal of Operational Research, Elsevier, vol. 207(3), pages 1147-1161, December.
    4. Midgley, G., 2006. "Systemic intervention for public health," American Journal of Public Health, American Public Health Association, vol. 96(3), pages 466-472.
    5. Chen, Huey T. & Yip, Fuyuen & Lavonas, Eric J. & Iqbal, Shahed & Turner, Nannette & Cobb, Bobby & Garbe, Paul, 2014. "Using the exhibited generalization approach to evaluate a carbon monoxide alarm ordinance," Evaluation and Program Planning, Elsevier, vol. 47(C), pages 35-44.
    6. Glasgow, R.E. & Lichtenstein, E. & Marcus, A.C., 2003. "Why Don't We See More Translation of Health Promotion Research to Practice? Rethinking the Efficacy-to-Effectiveness Transition," American Journal of Public Health, American Public Health Association, vol. 93(8), pages 1261-1267.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Ann Svensson, 2020. "How to Evaluate Collaboration within Research and Innovation," Journal of International Business Research and Marketing, Inovatus Services Ltd., vol. 5(3), pages 21-25, March.
    2. Omid Ali Kharazmi & Amirali Kharazmi, 2022. "A pathological analysis of challenges related to systems thinking studies in Iran," Systems Research and Behavioral Science, Wiley Blackwell, vol. 39(2), pages 241-257, March.
    3. Goodier, Sarah & Field, Carren & Goodman, Suki, 2018. "The need for theory evaluation in global citizenship programmes: The case of the GCSA programme," Evaluation and Program Planning, Elsevier, vol. 66(C), pages 7-19.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Gerald Midgley & Erik Lindhult, 2021. "A systems perspective on systemic innovation," Systems Research and Behavioral Science, Wiley Blackwell, vol. 38(5), pages 635-670, October.
    2. Céline Bérard & Martin Cloutier L. & Luc Cassivi, 2017. "The effects of using system dynamics-based decision support models: testing policy-makers’ boundaries in a complex situation," Post-Print halshs-01666605, HAL.
    3. Céline Bérard & L.M., Cloutier & Luc Cassivi, 2017. "The effects of using system dynamics-based decision support models: testing policy-makers’ boundaries in a complex situation," Post-Print hal-02128255, HAL.
    4. Chen, Huey T. & Yip, Fuyuen & Lavonas, Eric J. & Iqbal, Shahed & Turner, Nannette & Cobb, Bobby & Garbe, Paul, 2014. "Using the exhibited generalization approach to evaluate a carbon monoxide alarm ordinance," Evaluation and Program Planning, Elsevier, vol. 47(C), pages 35-44.
    5. Smith, Chris M. & Shaw, Duncan, 2019. "The characteristics of problem structuring methods: A literature review," European Journal of Operational Research, Elsevier, vol. 274(2), pages 403-416.
    6. Melinda Craike & Bojana Klepac & Amy Mowle & Therese Riley, 2023. "Theory of systems change: An initial, middle-range theory of public health research impact," Research Evaluation, Oxford University Press, vol. 32(3), pages 603-621.
    7. Archibald, Thomas, 2015. "“They Just Know”: The epistemological politics of “evidence-based” non-formal education," Evaluation and Program Planning, Elsevier, vol. 48(C), pages 137-148.
    8. Trutnevyte, Evelina & Stauffacher, Michael & Scholz, Roland W., 2012. "Linking stakeholder visions with resource allocation scenarios and multi-criteria assessment," European Journal of Operational Research, Elsevier, vol. 219(3), pages 762-772.
    9. Urban, Jennifer Brown & Hargraves, Monica & Trochim, William M., 2014. "Evolutionary Evaluation: Implications for evaluators, researchers, practitioners, funders and the evidence-based program mandate," Evaluation and Program Planning, Elsevier, vol. 45(C), pages 127-139.
    10. Nam C. Nguyen & Ockie J. H. Bosch, 2014. "The Art of Interconnected Thinking: Starting with the Young," Challenges, MDPI, vol. 5(2), pages 1-21, August.
    11. Miguel Afonso Sellitto & Guilherme Schreiber Pereira & Rafael Marques & Daniel Pacheco Lacerda, 2018. "Systemic Understanding of Coopetitive Behaviour in a Latin American Technological Park," Systemic Practice and Action Research, Springer, vol. 31(5), pages 479-494, October.
    12. Wasserman, Deborah L., 2010. "Using a systems orientation and foundational theory to enhance theory-driven human service program evaluations," Evaluation and Program Planning, Elsevier, vol. 33(2), pages 67-80, May.
    13. Ya Li & Zhichang Zhu & Catherine M. Gerard, 2012. "Learning from Conflict Resolution: An Opportunity to Systems Thinking," Systems Research and Behavioral Science, Wiley Blackwell, vol. 29(2), pages 209-220, March.
    14. Lehtonen, Olli & Tykkyläinen, Markku, 2014. "Delphi path simulator for unveiling development opportunities in the forest industries by contrasting forest management practices — The case of North Karelia," Technological Forecasting and Social Change, Elsevier, vol. 84(C), pages 171-185.
    15. Eichhorn Colombo, Konrad W., 2023. "Financial resilience analysis of floating production, storage and offloading plant operated in Norwegian Arctic region: Case study using inter-/transdisciplinary system dynamics modeling and simulatio," Energy, Elsevier, vol. 268(C).
    16. Tabia Henry Akintobi & Payam Sheikhattari & Emma Shaffer & Christina L. Evans & Kathryn L. Braun & Angela U. Sy & Bibiana Mancera & Adriana Campa & Stephania T. Miller & Daniel Sarpong & Rhonda Hollid, 2021. "Community Engagement Practices at Research Centers in U.S. Minority Institutions: Priority Populations and Innovative Approaches to Advancing Health Disparities Research," IJERPH, MDPI, vol. 18(12), pages 1-14, June.
    17. Scholz, Roland W. & Czichos, Reiner & Parycek, Peter & Lampoltshammer, Thomas J., 2020. "Organizational vulnerability of digital threats: A first validation of an assessment method," European Journal of Operational Research, Elsevier, vol. 282(2), pages 627-643.
    18. M. Nassereddine & M. A. Ellakkis & A. Azar & M. D. Nayeri, 2021. "Developing a Multi-methodology for Conflict Resolution: Case of Yemen’s Humanitarian Crisis," Group Decision and Negotiation, Springer, vol. 30(2), pages 301-320, April.
    19. Pearl Anne Ante-Testard & Francois Rerolle & Anna T. Nguyen & Sania Ashraf & Sarker Masud Parvez & Abu Mohammed Naser & Tarik Benmarhnia & Mahbubur Rahman & Stephen P. Luby & Jade Benjamin-Chung & Ben, 2024. "WASH interventions and child diarrhea at the interface of climate and socioeconomic position in Bangladesh," Nature Communications, Nature, vol. 15(1), pages 1-13, December.
    20. Katrien De Cocker & Greet Cardon & Jason A. Bennie & Tracy Kolbe-Alexander & Femke De Meester & Corneel Vandelanotte, 2018. "From Evidence-Based Research to Practice-Based Evidence: Disseminating a Web-Based Computer-Tailored Workplace Sitting Intervention through a Health Promotion Organisation," IJERPH, MDPI, vol. 15(5), pages 1-11, May.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:epplan:v:59:y:2016:i:c:p:109-118. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/evalprogplan .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.