IDEAS home Printed from https://ideas.repec.org/a/sae/evarev/v38y2014i5p388-419.html
   My bibliography  Save this article

Researching Evaluation Influence

Author

Listed:
  • James Leslie Herbert

Abstract

Background: The impact of an evaluation is an important consideration in designing and carrying out evaluations. Evaluation influence is a way of thinking about the effect that an evaluation can have in the broadest possible terms, which its proponents argue will lead to a systematic body of evidence about influential evaluation practices. Method: This literature review sets out to address three research questions: How have researchers defined evaluation influence; how is this reflected in the research; and what does the research suggest about the utility of evaluation influence as a conceptual framework. Drawing on studies that had cited one of the key evaluation influence articles and conducted original research on some aspect of influence this article reviewed the current state of the literature toward the goal of developing a body of evidence about how to practice influential evaluation. Results: Twenty-eight studies were found that have drawn on evaluation influence, which were categorized into (a) descriptive studies, (b) analytical studies, and (c) hypothesis testing. Conclusion: Despite the prominence of evaluation influence in the literature, there is slow progress toward a persuasive body of literature. Many of the studies reviewed offered vague and inconsistent definitions and have applied influence in an unspecified way in the research. It is hoped that this article will stimulate interest in the systematic study of influence mechanisms, leading to improvements in the potential for evaluation to affect positive social change.

Suggested Citation

  • James Leslie Herbert, 2014. "Researching Evaluation Influence," Evaluation Review, , vol. 38(5), pages 388-419, October.
    • Handle: RePEc:sae:evarev:v:38:y:2014:i:5:p:388-419
    DOI: 10.1177/0193841X14547230
    as

    Download full text from publisher

    File URL: https://journals.sagepub.com/doi/10.1177/0193841X14547230
    Download Restriction: no
    File URL: https://libkey.io/10.1177/0193841X14547230?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Preskill, Hallie, 1994. "Evaluation's role in enhancing organizational learning: A model for practice," Evaluation and Program Planning, Elsevier, vol. 17(3), pages 291-297.
    2. Johnson, R. Burke, 1998. "Toward a theoretical model of evaluation utilization," Evaluation and Program Planning, Elsevier, vol. 21(1), pages 93-110, February.
    3. Birkeland, Sarah & Murphy-Graham, Erin & Weiss, Carol, 2005. "Good reasons for ignoring good evaluation: The case of the drug abuse resistance education (D.A.R.E.) program," Evaluation and Program Planning, Elsevier, vol. 28(3), pages 247-256, August.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Yusa, Anna & Hynie, Michaela & Mitchell, Scott, 2016. "Utilization of internal evaluation results by community mental health organizations: Credibility in different forms," Evaluation and Program Planning, Elsevier, vol. 54(C), pages 11-18.
    2. Gagnon, France & Aubry, Tim & Cousins, J. Bradley & Goh, Swee C. & Elliott, Catherine, 2018. "Validation of the evaluation capacity in organizations questionnaire," Evaluation and Program Planning, Elsevier, vol. 68(C), pages 166-175.
    3. Bourgeois, Isabelle & Hart, Rebecca E. & Townsend, Shannon H. & Gagné, Marc, 2011. "Using hybrid models to support the development of organizational evaluation capacity: A case narrative," Evaluation and Program Planning, Elsevier, vol. 34(3), pages 228-235, August.
    4. Johnson, R. Burke, 1998. "Toward a theoretical model of evaluation utilization," Evaluation and Program Planning, Elsevier, vol. 21(1), pages 93-110, February.
    5. Pirmin Bundi & Philipp Trein, 2022. "Evaluation use and learning in public policy," Policy Sciences, Springer;Society of Policy Sciences, vol. 55(2), pages 283-309, June.
    6. Daigneault, Pierre-Marc, 2014. "Taking stock of four decades of quantitative research on stakeholder participation and evaluation use: A systematic map," Evaluation and Program Planning, Elsevier, vol. 45(C), pages 171-181.
    7. Blaser Mapitsa, Caitlin & Chirau, Takunda J., 2019. "Institutionalising the evaluation function: A South African study of impartiality, use and cost," Evaluation and Program Planning, Elsevier, vol. 75(C), pages 38-42.
    8. Schlaufer, Caroline, 2018. "The contribution of evaluations to the discourse quality of newspaper content," Evaluation and Program Planning, Elsevier, vol. 69(C), pages 157-165.
    9. Heimlich, Joe E., 2010. "Environmental education evaluation: Reinterpreting education as a strategy for meeting mission," Evaluation and Program Planning, Elsevier, vol. 33(2), pages 180-185, May.
    10. Jacob, Steve & Ouvrard, Laurence & Bélanger, Jean-François, 2011. "Participatory evaluation and process use within a social aid organization for at-risk families and youth," Evaluation and Program Planning, Elsevier, vol. 34(2), pages 113-123, May.
    11. Schalock, Robert L. & Bonham, Gordon S., 2003. "Measuring outcomes and managing for results," Evaluation and Program Planning, Elsevier, vol. 26(3), pages 229-235, August.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:sae:evarev:v:38:y:2014:i:5:p:388-419. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: SAGE Publications (email available below). General contact details of provider: .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.