IDEAS home Printed from https://ideas.repec.org/a/eee/epplan/v36y2013i1p64-70.html
   My bibliography  Save this article

Evaluation utilization research—Developing a theory and putting it to use

Author

Listed:
  • Neuman, Ari
  • Shahor, Neria
  • Shina, Ilan
  • Sarid, Anat
  • Saar, Zehava

Abstract

This article presents the findings of a two-stage study that had two key objectives: to develop a theory about evaluation utilization in an educational organization and to apply this theory to promote evaluation utilization within the organization. The first stage involved a theoretical conceptualization using a participatory method of concept mapping. This process identified the modes of evaluation utilization within the organization, produced a representation of the relationship between them and led to a theory. The second stage examined the practical implications of this conceptualization in terms of how different stakeholders in the organization perceive the actual and preferable state of evaluation utilization within the organization (i.e. to what extent is evaluation utilized and to what extent should it be utilized). The participatory process of the study promoted the evaluation utilization by involving stakeholders, thus giving them a sense of ownership and improving communication between the evaluation unit and the stakeholders. In addition, understanding the evaluation needs of the stakeholders in the organization helped generate relevant and realizable evaluation processes. On a practical level, the results are currently shaping the evaluation plan and the place of evaluations within the organization.

Suggested Citation

  • Neuman, Ari & Shahor, Neria & Shina, Ilan & Sarid, Anat & Saar, Zehava, 2013. "Evaluation utilization research—Developing a theory and putting it to use," Evaluation and Program Planning, Elsevier, vol. 36(1), pages 64-70.
    • Handle: RePEc:eee:epplan:v:36:y:2013:i:1:p:64-70
    DOI: 10.1016/j.evalprogplan.2012.06.001
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0149718912000614
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.evalprogplan.2012.06.001?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Greene, Jennifer C., 1988. "Communication of results and utilization in participatory program evaluation," Evaluation and Program Planning, Elsevier, vol. 11(4), pages 341-351, January.
    2. Trochim, William M. K., 1989. "An introduction to concept mapping for planning and evaluation," Evaluation and Program Planning, Elsevier, vol. 12(1), pages 1-16, January.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Brown, Jason D. & Anderson, Landy & Rodgers, Julie, 2014. "Needs of foster parent resource workers," Children and Youth Services Review, Elsevier, vol. 46(C), pages 120-127.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Jabbar, Amina M. & Abelson, Julia, 2011. "Development of a framework for effective community engagement in Ontario, Canada," Health Policy, Elsevier, vol. 101(1), pages 59-69, June.
    2. Goldman, Alyssa W. & Kane, Mary, 2014. "Concept mapping and network analysis: An analytic approach to measure ties among constructs," Evaluation and Program Planning, Elsevier, vol. 47(C), pages 9-17.
    3. Urban, Jennifer Brown & Hargraves, Monica & Trochim, William M., 2014. "Evolutionary Evaluation: Implications for evaluators, researchers, practitioners, funders and the evidence-based program mandate," Evaluation and Program Planning, Elsevier, vol. 45(C), pages 127-139.
    4. Sofia Patsali, 2019. "Opening the black box of university-suppliers' co-invention: some field study evidence," Working Papers of BETA 2019-46, Bureau d'Economie Théorique et Appliquée, UDS, Strasbourg.
    5. Shern, David L. & Trochim, William M. K. & LaComb, Christina A., 1995. "The use of concept mapping for assessing fidelity of model transfer: An example from psychiatric rehabilitation," Evaluation and Program Planning, Elsevier, vol. 18(2), pages 143-153.
    6. Van Holen, Frank & Van Loock, Julie & Belenger, Laurence & Vanderfaeillie, Johan, 2017. "Concept mapping the needs of grandmothers who take care of their grandchildren in formal foster care in Flanders," Children and Youth Services Review, Elsevier, vol. 83(C), pages 159-167.
    7. Poole, Dennis L. & Duvall, Deborah & Wofford, Bethany, 2006. "Concept mapping key elements and performance measures in a state nursing home-to-community transition project," Evaluation and Program Planning, Elsevier, vol. 29(1), pages 10-22, February.
    8. Klenk, Nicole L. & Hickey, Gordon M., 2011. "A virtual and anonymous, deliberative and analytic participation process for planning and evaluation: The Concept Mapping Policy Delphi," International Journal of Forecasting, Elsevier, vol. 27(1), pages 152-165, January.
    9. Rosas, Scott R. & Ridings, John W., 2017. "The use of concept mapping in measurement development and evaluation: Application and future directions," Evaluation and Program Planning, Elsevier, vol. 60(C), pages 265-276.
    10. Brown, Jason D. & Ivanova, Viktoria & Mehta, Nisha & Skrodzki, Donna & Gerrits, Julie, 2013. "Social needs of aboriginal foster parents," Children and Youth Services Review, Elsevier, vol. 35(11), pages 1886-1893.
    11. Shewchuk, Richard M. & O'Connor, Stephen J. & Williams, Eric S. & Savage, Grant T., 2006. "Beyond rankings: Using cognitive mapping to understand what health care journals represent," Social Science & Medicine, Elsevier, vol. 62(5), pages 1192-1204, March.
    12. Marc Paul Verhougstraete & Sydney Brothers & Wayne Litaker & A Denene Blackwood & Rachel Noble, 2015. "Lessons Learned from Implementing a Wet Laboratory Molecular Training Workshop for Beach Water Quality Monitoring," PLOS ONE, Public Library of Science, vol. 10(3), pages 1-13, March.
    13. Papineau, Danielle & Kiely, Margaret C., 1996. "Participatory evaluation in a community organization: Fostering stakeholder empowerment and utilization," Evaluation and Program Planning, Elsevier, vol. 19(1), pages 79-93, February.
    14. Cooksy, Leslie J. & Gill, Paige & Kelly, P. Adam, 2001. "The program logic model as an integrative framework for a multimethod evaluation," Evaluation and Program Planning, Elsevier, vol. 24(2), pages 119-128, May.
    15. Alan Masinter & Mitchell Small & Elizabeth Casman, 2014. "Research prioritization using hypothesis maps," Environment Systems and Decisions, Springer, vol. 34(1), pages 49-59, March.
    16. Kaplan, Deanna M. & deBlois, Madeleine & Dominguez, Violeta & Walsh, Michele E., 2016. "Studying the teaching of kindness: A conceptual model for evaluating kindness education programs in schools," Evaluation and Program Planning, Elsevier, vol. 58(C), pages 160-170.
    17. Kelly, Cheryl M. & Hoehner, Christine M. & Baker, Elizabeth A. & Brennan Ramirez, Laura K. & Brownson, Ross C., 2006. "Promoting physical activity in communities: Approaches for successful evaluation of programs and policies," Evaluation and Program Planning, Elsevier, vol. 29(3), pages 280-292, August.
    18. SHI, Jia & LEE, Ching-Hung & GUO, Xuesong & ZHU, Zhengwei, 2020. "Constructing an integrated stakeholder-based participatory policy evaluation model for urban traffic restriction," Technological Forecasting and Social Change, Elsevier, vol. 151(C).
    19. Frank Van Hoof & Jaap Van Weeghel & Hans Kroon, 2000. "Community Care: Exploring the Priorities of Clients, Mental Health Professionals and Community Providers," International Journal of Social Psychiatry, , vol. 46(3), pages 208-219, September.
    20. Ashlee N. Sawyer & Madison Combs & Viktor Clark & Eric K. Soule & Joseph G. L. Lee & Alison B. Breland, 2023. "Reactions to a Hypothetical Menthol Cigarette Ban among Sexual- and Gender-Minoritized Communities: A Concept Mapping Study," IJERPH, MDPI, vol. 20(5), pages 1-21, February.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:epplan:v:36:y:2013:i:1:p:64-70. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/evalprogplan .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.