IDEAS home Printed from https://ideas.repec.org/a/eee/epplan/v36y2013i1p64-70.html
   My bibliography  Save this article

Evaluation utilization research—Developing a theory and putting it to use

Author

Listed:
  • Neuman, Ari
  • Shahor, Neria
  • Shina, Ilan
  • Sarid, Anat
  • Saar, Zehava

Abstract

This article presents the findings of a two-stage study that had two key objectives: to develop a theory about evaluation utilization in an educational organization and to apply this theory to promote evaluation utilization within the organization. The first stage involved a theoretical conceptualization using a participatory method of concept mapping. This process identified the modes of evaluation utilization within the organization, produced a representation of the relationship between them and led to a theory. The second stage examined the practical implications of this conceptualization in terms of how different stakeholders in the organization perceive the actual and preferable state of evaluation utilization within the organization (i.e. to what extent is evaluation utilized and to what extent should it be utilized). The participatory process of the study promoted the evaluation utilization by involving stakeholders, thus giving them a sense of ownership and improving communication between the evaluation unit and the stakeholders. In addition, understanding the evaluation needs of the stakeholders in the organization helped generate relevant and realizable evaluation processes. On a practical level, the results are currently shaping the evaluation plan and the place of evaluations within the organization.

Suggested Citation

  • Neuman, Ari & Shahor, Neria & Shina, Ilan & Sarid, Anat & Saar, Zehava, 2013. "Evaluation utilization research—Developing a theory and putting it to use," Evaluation and Program Planning, Elsevier, vol. 36(1), pages 64-70.
    • Handle: RePEc:eee:epplan:v:36:y:2013:i:1:p:64-70
    DOI: 10.1016/j.evalprogplan.2012.06.001
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0149718912000614
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.evalprogplan.2012.06.001?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Greene, Jennifer C., 1988. "Communication of results and utilization in participatory program evaluation," Evaluation and Program Planning, Elsevier, vol. 11(4), pages 341-351, January.
    2. Trochim, William M. K., 1989. "An introduction to concept mapping for planning and evaluation," Evaluation and Program Planning, Elsevier, vol. 12(1), pages 1-16, January.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Brown, Jason D. & Anderson, Landy & Rodgers, Julie, 2014. "Needs of foster parent resource workers," Children and Youth Services Review, Elsevier, vol. 46(C), pages 120-127.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Jabbar, Amina M. & Abelson, Julia, 2011. "Development of a framework for effective community engagement in Ontario, Canada," Health Policy, Elsevier, vol. 101(1), pages 59-69, June.
    2. Laura Borge & Stefanie Bröring, 2020. "What affects technology transfer in emerging knowledge areas? A multi-stakeholder concept mapping study in the bioeconomy," The Journal of Technology Transfer, Springer, vol. 45(2), pages 430-460, April.
    3. Mohammed Abdullatif Almulla & Mahdi Mohammed Alamri, 2021. "Using Conceptual Mapping for Learning to Affect Students’ Motivation and Academic Achievement," Sustainability, MDPI, vol. 13(7), pages 1-17, April.
    4. Caroline Schlinkert & Marleen Gillebaart & Jeroen Benjamins & Maartje P. Poelman & Denise de Ridder, 2020. "Snacks and The City: Unexpected Low Sales of an Easy-Access, Tasty, and Healthy Snack at an Urban Snacking Hotspot," IJERPH, MDPI, vol. 17(20), pages 1-17, October.
    5. Goldman, Alyssa W. & Kane, Mary, 2014. "Concept mapping and network analysis: An analytic approach to measure ties among constructs," Evaluation and Program Planning, Elsevier, vol. 47(C), pages 9-17.
    6. Sutherland, Stephanie & Katz, Steven, 2005. "Concept mapping methodology: A catalyst for organizational learning," Evaluation and Program Planning, Elsevier, vol. 28(3), pages 257-269, August.
    7. Urban, Jennifer Brown & Hargraves, Monica & Trochim, William M., 2014. "Evolutionary Evaluation: Implications for evaluators, researchers, practitioners, funders and the evidence-based program mandate," Evaluation and Program Planning, Elsevier, vol. 45(C), pages 127-139.
    8. Sofia Patsali, 2019. "Opening the black box of university-suppliers' co-invention: some field study evidence," Working Papers of BETA 2019-46, Bureau d'Economie Théorique et Appliquée, UDS, Strasbourg.
    9. Dan Durning, 1993. "Participatory policy analysis in a social service agency: A case study," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 12(2), pages 297-322.
    10. Luis Miranda-Gumucio & Ignacio Gil-Pechuán & Daniel Palacios-Marqués, 2013. "An exploratory study of the determinants of switching and loyalty in prepaid cell phone users. An application of concept mapping," Service Business, Springer;Pan-Pacific Business Association, vol. 7(4), pages 603-622, December.
    11. Shern, David L. & Trochim, William M. K. & LaComb, Christina A., 1995. "The use of concept mapping for assessing fidelity of model transfer: An example from psychiatric rehabilitation," Evaluation and Program Planning, Elsevier, vol. 18(2), pages 143-153.
    12. Van Holen, Frank & Van Loock, Julie & Belenger, Laurence & Vanderfaeillie, Johan, 2017. "Concept mapping the needs of grandmothers who take care of their grandchildren in formal foster care in Flanders," Children and Youth Services Review, Elsevier, vol. 83(C), pages 159-167.
    13. Poole, Dennis L. & Duvall, Deborah & Wofford, Bethany, 2006. "Concept mapping key elements and performance measures in a state nursing home-to-community transition project," Evaluation and Program Planning, Elsevier, vol. 29(1), pages 10-22, February.
    14. Klenk, Nicole L. & Hickey, Gordon M., 2011. "A virtual and anonymous, deliberative and analytic participation process for planning and evaluation: The Concept Mapping Policy Delphi," International Journal of Forecasting, Elsevier, vol. 27(1), pages 152-165, January.
    15. Daigneault, Pierre-Marc, 2014. "Taking stock of four decades of quantitative research on stakeholder participation and evaluation use: A systematic map," Evaluation and Program Planning, Elsevier, vol. 45(C), pages 171-181.
    16. Rosas, Scott R. & Ridings, John W., 2017. "The use of concept mapping in measurement development and evaluation: Application and future directions," Evaluation and Program Planning, Elsevier, vol. 60(C), pages 265-276.
    17. Péladeau, Normand & Dagenais, Christian & Ridde, Valéry, 2017. "Concept mapping internal validity: A case of misconceived mapping?," Evaluation and Program Planning, Elsevier, vol. 62(C), pages 56-63.
    18. Erin Lebow-Skelley & Sarah Yelton & Brandi Janssen & Esther Erdei & Melanie A. Pearson, 2020. "Identifying Issues and Priorities in Reporting Back Environmental Health Data," IJERPH, MDPI, vol. 17(18), pages 1-19, September.
    19. Southern, Donna M. & Young, Doris & Dunt, David & Appleby, Natalie J. & Batterham, Roy W., 2002. "Integration of primary health care services: perceptions of Australian general practitioners, non-general practitioner health service providers and consumers at the general practice-primary care inter," Evaluation and Program Planning, Elsevier, vol. 25(1), pages 47-59, February.
    20. Brown, Jason D. & Ivanova, Viktoria & Mehta, Nisha & Skrodzki, Donna & Gerrits, Julie, 2013. "Social needs of aboriginal foster parents," Children and Youth Services Review, Elsevier, vol. 35(11), pages 1886-1893.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:epplan:v:36:y:2013:i:1:p:64-70. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/evalprogplan .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.