IDEAS home Printed from https://ideas.repec.org/a/eee/epplan/v34y2011i1p69-78.html
   My bibliography  Save this article

Program theory evaluation: Logic analysis

Author

Listed:
  • Brousselle, Astrid
  • Champagne, François

Abstract

Program theory evaluation, which has grown in use over the past 10 years, assesses whether a program is designed in such a way that it can achieve its intended outcomes. This article describes a particular type of program theory evaluation--logic analysis--that allows us to test the plausibility of a program's theory using scientific knowledge. Logic analysis is useful for improving the intervention or finding alternatives for achieving intended outcomes; it influences the choice of type of evaluation to conduct and strengthens the validity of subsequent evaluations. The objective of this article is to present the methodological principles and the roots of this type of program theory evaluation. We illustrate two types of logic analysis with two actual evaluation cases. There are very few published examples of program theory evaluation. This article will provide evaluators with both theoretical and practical information to help them in conceptualizing their evaluations.

Suggested Citation

  • Brousselle, Astrid & Champagne, François, 2011. "Program theory evaluation: Logic analysis," Evaluation and Program Planning, Elsevier, vol. 34(1), pages 69-78, February.
    • Handle: RePEc:eee:epplan:v:34:y:2011:i:1:p:69-78
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0149-7189(10)00045-5
    Download Restriction: Full text for ScienceDirect subscribers only
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Lipsey, Mark W. & Pollard, John A., 1989. "Driving toward theory in program evaluation: More models to choose from," Evaluation and Program Planning, Elsevier, vol. 12(4), pages 317-328, January.
    2. Frenk, Julio, 1992. "Balancing relevance and excellence: Organizational responses to link research with decision making," Social Science & Medicine, Elsevier, vol. 35(11), pages 1397-1404, December.
    3. B Markham & J Lomas, 1995. "Review of the Multi-hospital Arrangements Literature: Benefits, Disadvantages and Lessons for Implementation," Centre for Health Economics and Policy Analysis Working Paper Series 1995-08, Centre for Health Economics and Policy Analysis (CHEPA), McMaster University, Hamilton, Canada.
    4. Davis, Peter & Howden-Chapman, Philippa, 1996. "Translating research findings into health policy," Social Science & Medicine, Elsevier, vol. 43(5), pages 865-872, September.
    5. Chen, Huey-Tsyh & Rossi, Peter H., 1987. "The theory-driven approach to validity," Evaluation and Program Planning, Elsevier, vol. 10(1), pages 95-103, January.
    6. Brousselle, Astrid & Lamothe, Lise & Mercier, Celine & Perreault, Michel, 2007. "Beyond the limitations of best practices: How logic analysis helped reinterpret dual diagnosis guidelines," Evaluation and Program Planning, Elsevier, vol. 30(1), pages 94-104, February.
    7. Daniel Carpenter & Kevin Esterling & David Lazer, 2003. "The Strength of Strong Ties," Rationality and Society, , vol. 15(4), pages 411-440, November.
    8. Renger, Ralph & Hurley, Carolyn, 2006. "From theory to practice: Lessons learned in the application of the ATM approach to developing logic models," Evaluation and Program Planning, Elsevier, vol. 29(2), pages 106-119, May.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Banke-Thomas, Aduragbemi & Nieuwenhuis, Sonja & Ologun, Adesoji & Mortimore, Gordon & Mpakateni, Martin, 2019. "Embedding value-for-money in practice: a case study of a health pooled fund programme implemented in conflict-affected South Sudan," LSE Research Online Documents on Economics 101766, London School of Economics and Political Science, LSE Library.
    2. Volden, Gro Holst, 2018. "Public project success as seen in a broad perspective," Evaluation and Program Planning, Elsevier, vol. 69(C), pages 109-117.
    3. Deane, Kelsey L. & Harré, Niki, 2014. "Program theory-driven evaluation science in a youth development context," Evaluation and Program Planning, Elsevier, vol. 45(C), pages 61-70.
    4. Abdul-Manan, Amir F.N. & Baharuddin, Azizan & Chang, Lee Wei, 2015. "Application of theory-based evaluation for the critical analysis of national biofuel policy: A case study in Malaysia," Evaluation and Program Planning, Elsevier, vol. 52(C), pages 39-49.
    5. Park, Chul Hyun & Welch, Eric W. & Sriraj, P.S., 2016. "An integrative theory-driven framework for evaluating travel training programs," Evaluation and Program Planning, Elsevier, vol. 59(C), pages 7-20.
    6. Desjardins, Émilie & Sultan-Taïeb, Hélène & St-Hilaire, France & Vézina, Nicole & Ledoux, Élise & Naji, Rita & Bélanger, Patricia, 2023. "Implementation process evaluation of an ergonomic train the trainer program: How to learn from mechanisms and the temporal structure of processes?," Evaluation and Program Planning, Elsevier, vol. 97(C).
    7. Hudon, Catherine & Chouinard, Maud-Christine & Brousselle, Astrid & Bisson, Mathieu & Danish, Alya, 2020. "Evaluating complex interventions in real context: Logic analysis of a case management program for frequent users of healthcare services," Evaluation and Program Planning, Elsevier, vol. 79(C).
    8. Nikpay, Fatemeh & Ahmad, Rodina & Yin Kia, Chiam, 2017. "A hybrid method for evaluating enterprise architecture implementation," Evaluation and Program Planning, Elsevier, vol. 60(C), pages 1-16.
    9. Contandriopoulos, Damien & Brousselle, Astrid & Breton, Mylaine & Sangster-Gormley, Esther & Kilpatrick, Kelley & Dubois, Carl-Ardy & Brault, Isabelle & Perroux, Mélanie, 2016. "Nurse practitioners, canaries in the mine of primary care reform," Health Policy, Elsevier, vol. 120(6), pages 682-689.
    10. Tim Benijts, 2014. "A Business Sustainability Model for Government Corporations. A Belgian Case Study," Business Strategy and the Environment, Wiley Blackwell, vol. 23(3), pages 204-216, March.
    11. Hickey, Gráinne & McGilloway, Sinead & O’Brien, Morgan & Leckey, Yvonne & Devlin, Maurice, 2015. "A theory-based evaluation of a community-based funding scheme in a disadvantaged suburban city area," Evaluation and Program Planning, Elsevier, vol. 52(C), pages 61-69.
    12. Meehan, Fiona & Tacconi, Luca & Budiningsih, Kushartati, 2019. "Are national commitments to reducing emissions from forests effective? Lessons from Indonesia," Forest Policy and Economics, Elsevier, vol. 108(C), pages 1-1.
    13. Tremblay, Marie-Claude & Brousselle, Astrid & Richard, Lucie & Beaudet, Nicole, 2013. "Defining, illustrating and reflecting on logic analysis with an example from a professional development program," Evaluation and Program Planning, Elsevier, vol. 40(C), pages 64-73.
    14. Tarik Benmarhnia & Pierre-Alexandre Dionne & Éric Tchouaket & Alvine K. Fansi & Astrid Brousselle, 2017. "Investing in a healthy lifestyle strategy: is it worth it?," International Journal of Public Health, Springer;Swiss School of Public Health (SSPH+), vol. 62(1), pages 3-13, January.
    15. van der Waal, Esther C., 2020. "Local impact of community renewable energy: A case study of an Orcadian community-led wind scheme," Energy Policy, Elsevier, vol. 138(C).
    16. Breton, Mylaine & Smithman, Mélanie Ann & Kreindler, Sara A. & Jbilou, Jalila & Wong, Sabrina T. & Gard Marshall, Emily & Sasseville, Martin & Sutherland, Jason M. & Crooks, Valorie A. & Shaw, Jay & C, 2021. "Designing centralized waiting lists for attachment to a primary care provider: Considerations from a logic analysis," Evaluation and Program Planning, Elsevier, vol. 89(C).
    17. Cartier, Yuri & Benmarhnia, Tarik & Brousselle, Astrid, 2015. "Tool for assessing health and equity impacts of interventions modifying air quality in urban environments," Evaluation and Program Planning, Elsevier, vol. 53(C), pages 1-9.
    18. Dunkley, Ria A. & Franklin, Alex, 2017. "Failing better: The stochastic art of evaluating community-led environmental action programs," Evaluation and Program Planning, Elsevier, vol. 60(C), pages 112-122.
    19. Banke-Thomas, Aduragbemi & Nieuwenhuis, Sonja & Ologun, Adesoji & Mortimore, Gordon & Mpakateni, Martin, 2019. "Embedding value-for-money in practice: A case study of a health pooled fund programme implemented in conflict-affected South Sudan," Evaluation and Program Planning, Elsevier, vol. 77(C).
    20. Gisela Cardoso & Elizabeth Moreira Santos & Yibeltal Kiflie & Kifle Woldemichael & Suzanne Wilson & Wuleta Lemma, 2017. "Strategic analysis of tuberculosis prevention and control actions in Brazil and Ethiopia: one size fits all?," International Journal of Public Health, Springer;Swiss School of Public Health (SSPH+), vol. 62(2), pages 305-315, March.
    21. Harman, Elena & Azzam, Tarek, 2018. "Towards program theory validation: Crowdsourcing the qualitative analysis of participant experiences," Evaluation and Program Planning, Elsevier, vol. 66(C), pages 183-194.
    22. Toby Newstead & Sarah Dawkins & Rob Macklin & Angela Martin, 2020. "The Virtues Project: An Approach to Developing Good Leaders," Journal of Business Ethics, Springer, vol. 167(4), pages 605-622, December.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Kent, Douglas R. & Donaldson, Stewart I. & Wyrick, Phelan A. & Smith, Peggy J., 2000. "Evaluating criminal justice programs designed to reduce crime by targeting repeat gang offenders," Evaluation and Program Planning, Elsevier, vol. 23(1), pages 115-124, February.
    2. Theobald, Sally & Nhlema-Simwaka, Bertha, 2008. "The research, policy and practice interface: Reflections on using applied social research to promote equity in health in Malawi," Social Science & Medicine, Elsevier, vol. 67(5), pages 760-770, September.
    3. Torvatn, Hans, 1999. "Using program theory models in evaluation of industrial modernization programs: three case studies," Evaluation and Program Planning, Elsevier, vol. 22(1), pages 73-82.
    4. Galaz, Victor & Crona, Beatrice & Österblom, Henrik & Olsson, Per & Folke, Carl, 2012. "Polycentric systems and interacting planetary boundaries — Emerging governance of climate change–ocean acidification–marine biodiversity," Ecological Economics, Elsevier, vol. 81(C), pages 21-32.
    5. Eduardo Martínez-Martínez & María Luisa Zaragoza & Elmer Solano & Brenda Figueroa & Patricia Zúñiga & Juan P Laclette, 2012. "Health Research Funding in Mexico: The Need for a Long-Term Agenda," PLOS ONE, Public Library of Science, vol. 7(12), pages 1-11, December.
    6. Currie, Melissa & King, Gillian & Rosenbaum, Peter & Law, Mary & Kertoy, Marilyn & Specht, Jacqueline, 2005. "A model of impacts of research partnerships in health and social services," Evaluation and Program Planning, Elsevier, vol. 28(4), pages 400-412, November.
    7. Benson, Paul R. & Fisher, Gene A. & Diana, Augusto & Simon, Lorna & Gamache, Gail & Tessler, Richard C. & McDermeit, Melissa, 1996. "A state network of family support services: The massachusetts family support demonstration project," Evaluation and Program Planning, Elsevier, vol. 19(1), pages 27-39, February.
    8. Jessie-Lee D. McIsaac & Kimberley J. Hernandez & Sara F.L. Kirk & Janet A. Curran, 2016. "Interventions to Support System-level Implementation of Health Promoting Schools: A Scoping Review," IJERPH, MDPI, vol. 13(2), pages 1-24, February.
    9. Perleth, Matthias & Jakubowski, Elke & Busse, Reinhard, 2001. "What is `best practice' in health care? State of the art and perspectives in improving the effectiveness and efficiency of the European health care systems," Health Policy, Elsevier, vol. 56(3), pages 235-250, June.
    10. Dagenais, Christian & Laurendeau, Marie-Claire & Briand-Lamarche, Mélodie, 2015. "Knowledge brokering in public health: A critical analysis of the results of a qualitative evaluation," Evaluation and Program Planning, Elsevier, vol. 53(C), pages 10-17.
    11. Réjean Landry & Nabil Amara & Mathieu Ouimet, 2007. "Determinants of knowledge transfer: evidence from Canadian university researchers in natural sciences and engineering," The Journal of Technology Transfer, Springer, vol. 32(6), pages 561-592, December.
    12. Howden-Chapman, Philippa & Viggers, Helen & Chapman, Ralph & O’Sullivan, Kimberley & Telfar Barnard, Lucy & Lloyd, Bob, 2012. "Tackling cold housing and fuel poverty in New Zealand: A review of policies, research, and health impacts," Energy Policy, Elsevier, vol. 49(C), pages 134-142.
    13. D'Souza, Carol & Sadana, Ritu, 2006. "Why do case studies on national health research systems matter? Identifying common challenges in low- and middle-income countries," Social Science & Medicine, Elsevier, vol. 62(8), pages 2072-2078, April.
    14. McAneney, H. & McCann, J.F. & Prior, L. & Wilde, J. & Kee, F., 2010. "Translating evidence into practice: A shared priority in public health?," Social Science & Medicine, Elsevier, vol. 70(10), pages 1492-1500, May.
    15. Gordon, Elisa Jill, 2006. "The political contexts of evidence-based medicine: Policymaking for daily hemodialysis," Social Science & Medicine, Elsevier, vol. 62(11), pages 2707-2719, June.
    16. Jan Beyers & Tom Donas, 2014. "Inter-regional networks in Brussels: Analyzing the information exchanges among regional offices," European Union Politics, , vol. 15(4), pages 547-571, December.
    17. Jansen, Maria W.J. & De Vries, Nanne K. & Kok, Gerjo & Van Oers, Hans A.M., 2008. "Collaboration between practice, policy and research in local public health in the Netherlands," Health Policy, Elsevier, vol. 86(2-3), pages 295-307, May.
    18. Cyrenne, Philippe, 1999. "Analysing Shared Service Contracts: The Case of Food Services for Winnipeg Hospitals," MPRA Paper 29619, University Library of Munich, Germany.
    19. Harman, Elena & Azzam, Tarek, 2018. "Towards program theory validation: Crowdsourcing the qualitative analysis of participant experiences," Evaluation and Program Planning, Elsevier, vol. 66(C), pages 183-194.
    20. Saxe, Leonard & Reber, Emily & Hallfors, Denise & Kadushin, Charles & Jones, Delmos & Rindskopf, David & Beveridge, Andrew, 1997. "Think globally, act locally: Assessing the impact of community-based substance abuse prevention," Evaluation and Program Planning, Elsevier, vol. 20(3), pages 357-366, August.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:epplan:v:34:y:2011:i:1:p:69-78. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/evalprogplan .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.