IDEAS home Printed from https://ideas.repec.org/a/sae/evarev/v24y2000i4p407-431.html
   My bibliography  Save this article

Theory-Based Evaluation in Practice

Author

Listed:
  • Johanna D. Birckmayer

    (Poudre Health Services District)

  • Carol Hirschon Weiss

    (Harvard University)

Abstract

Theory-based evaluation (TBE) explores the how and why of program success or failure. Advocates of TBE claim that it produces information unavailable in traditional process and outcome studies. This article examines six published papers of TBEs. It finds that the authors of the papers do not always make explicit the relation of their data to the theory of the program. Nevertheless, it was evident in one or more cases that TBE identified unnecessary program components, located intermediary changes, raised new questions, contributed to a paradigm shift, highlighted the difficulties of taking successful pilot programs to scale, and provided clarity and focus for the evaluation. Interestingly, in none of the studies was the original theory completely right. Lessons for the future of TBE are drawn.

Suggested Citation

  • Johanna D. Birckmayer & Carol Hirschon Weiss, 2000. "Theory-Based Evaluation in Practice," Evaluation Review, , vol. 24(4), pages 407-431, August.
    • Handle: RePEc:sae:evarev:v:24:y:2000:i:4:p:407-431
    DOI: 10.1177/0193841X0002400404
    as

    Download full text from publisher

    File URL: https://journals.sagepub.com/doi/10.1177/0193841X0002400404
    Download Restriction: no
    File URL: https://libkey.io/10.1177/0193841X0002400404?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Chen, Huey-Tsyh & Rossi, Peter H., 1987. "The theory-driven approach to validity," Evaluation and Program Planning, Elsevier, vol. 10(1), pages 95-103, January.
    2. Finney, John W. & Moos, Rudolf H., 1989. "Theory and method in treatment evaluation," Evaluation and Program Planning, Elsevier, vol. 12(4), pages 307-316, January.
    3. McLaughlin, John A. & Jordan, Gretchen B., 1999. "Logic models: a tool for telling your programs performance story," Evaluation and Program Planning, Elsevier, vol. 22(1), pages 65-72.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Ellen Eliason Kisker & Diane Paulsell & John M. Love & Helen Raikes, "undated". "Pathways to Quality and Full Implementation in Early Head Start Programs," Mathematica Policy Research Reports 736a46ebaf784096a693b652a, Mathematica Policy Research.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Taut, Sandy & Santelices, Verónica & Araya, Carolina & Manzi, Jorge, 2010. "Theory underlying a national teacher evaluation program," Evaluation and Program Planning, Elsevier, vol. 33(4), pages 477-486, November.
    2. Tim Benijts, 2014. "A Business Sustainability Model for Government Corporations. A Belgian Case Study," Business Strategy and the Environment, Wiley Blackwell, vol. 23(3), pages 204-216, March.
    3. Wasserman, Deborah L., 2010. "Using a systems orientation and foundational theory to enhance theory-driven human service program evaluations," Evaluation and Program Planning, Elsevier, vol. 33(2), pages 67-80, May.
    4. Peyton, David J. & Scicchitano, Michael, 2017. "Devil is in the details: Using logic models to investigate program process," Evaluation and Program Planning, Elsevier, vol. 65(C), pages 156-162.
    5. Matt Andrews, 2022. "This is How to Think About and Achieve Public Policy Success," CID Working Papers 413, Center for International Development at Harvard University.
    6. Wifo, 2021. "WIFO-Monatsberichte, Heft 10/2021," WIFO Monatsberichte (monthly reports), WIFO, vol. 94(10), October.
    7. Benson, Paul R. & Fisher, Gene A. & Diana, Augusto & Simon, Lorna & Gamache, Gail & Tessler, Richard C. & McDermeit, Melissa, 1996. "A state network of family support services: The massachusetts family support demonstration project," Evaluation and Program Planning, Elsevier, vol. 19(1), pages 27-39, February.
    8. Kent, Douglas R. & Donaldson, Stewart I. & Wyrick, Phelan A. & Smith, Peggy J., 2000. "Evaluating criminal justice programs designed to reduce crime by targeting repeat gang offenders," Evaluation and Program Planning, Elsevier, vol. 23(1), pages 115-124, February.
    9. Sobelson, Robyn K. & Young, Andrea C., 2013. "Evaluation of a federally funded workforce development program: The Centers for Public Health Preparedness," Evaluation and Program Planning, Elsevier, vol. 37(C), pages 50-57.
    10. Wu, Huang & Shen, Jianping & Jones, Jeffrey & Gao, Xingyuan & Zheng, Yunzheng & Krenn, Huilan Y., 2019. "Using logic model and visualization to conduct portfolio evaluation," Evaluation and Program Planning, Elsevier, vol. 74(C), pages 69-75.
    11. Vinícius P. Rodrigues & Daniela C. A. Pigosso & Jakob W. Andersen & Tim C. McAloone, 2018. "Evaluating the Potential Business Benefits of Ecodesign Implementation: A Logic Model Approach," Sustainability, MDPI, vol. 10(6), pages 1-26, June.
    12. Janger, Jürgen & Schubert, Torben & Andries, Petra & Rammer, Christian & Hoskens, Machteld, 2017. "The EU 2020 innovation indicator: A step forward in measuring innovation outputs and outcomes?," Research Policy, Elsevier, vol. 46(1), pages 30-42.
    13. Jürgen Janger & Agnes Kügler, 2018. "Innovationseffizienz. Österreich im internationalen Vergleich," WIFO Studies, WIFO, number 61111, March.
    14. Fangyuan Chang & Andrea Eriksson & Britt Östlund, 2020. "Discrepancies between Expected and Actual Implementation: The Process Evaluation of PERS Integration in Nursing Homes," IJERPH, MDPI, vol. 17(12), pages 1-18, June.
    15. Louise R. Manfredi & Meriel Stokoe & Rebecca Kelly & Seyeon Lee, 2021. "Teaching Sustainable Responsibility through Informal Undergraduate Design Education," Sustainability, MDPI, vol. 13(15), pages 1-13, July.
    16. Laura Kreiling & Ahmed Bounfour, 2020. "A practice-based maturity model for holistic TTO performance management: development and initial use," The Journal of Technology Transfer, Springer, vol. 45(6), pages 1718-1747, December.
    17. Harman, Elena & Azzam, Tarek, 2018. "Towards program theory validation: Crowdsourcing the qualitative analysis of participant experiences," Evaluation and Program Planning, Elsevier, vol. 66(C), pages 183-194.
    18. Robert G. Orwin & L. Joseph Sonnefeld & Roberta Garrison-Mogren & Nancy Gray Smith, 1994. "Pitfalls in Evaluating the Effectiveness of Case Management Programs for Homeless Persons," Evaluation Review, , vol. 18(2), pages 153-207, April.
    19. Hyun-Kyu KANG, 2015. "Development of Guideline for Preliminary Feasibility Study on Government R&D Programs in Korea," Proceedings of International Academic Conferences 2805212, International Institute of Social and Economic Sciences.
    20. Sandra E. Herman, 1997. "Exploring the Link Between Service Quality and Outcomes," Evaluation Review, , vol. 21(3), pages 388-404, June.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:sae:evarev:v:24:y:2000:i:4:p:407-431. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: SAGE Publications (email available below). General contact details of provider: .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.