IDEAS home Printed from https://ideas.repec.org/a/eee/epplan/v67y2018icp122-128.html
   My bibliography  Save this article

Evaluator competencies in the context of diversity training: The practitioners’ point of view

Author

Listed:
  • Froncek, Benjamin
  • Mazziotta, Agostino
  • Piper, Verena
  • Rohmann, Anette

Abstract

Evaluator competencies have been discussed since the beginnings of program evaluation literature. More recently, the Essential Competencies for Program Evaluators (Ghere et al., 2006; Stevahn, King, Ghere & Minnema, 2005a) have proven to be a useful taxonomy for learning and improving evaluation practice. Evaluation is critical to diversity training activities, and diversity training providers face the challenge of conducting evaluations of their training programs. We explored what competencies are viewed as instrumental to conducting useful evaluations in this specific field of evaluation practice. In an online survey, N = 172 diversity training providers were interviewed via an open answer format about their perceptions of evaluator competencies, with n = 95 diversity training providers contributing statements. The Essential Competencies for Program Evaluators were used to conduct a deductive qualitative content analysis of the statements. While systematic inquiry, reflective practice, and interpersonal competence were well represented, situational analysis and project management were not. Implications are discussed for evaluation capacity building among diversity training providers and for negotiating evaluation projects with evaluation professionals.

Suggested Citation

  • Froncek, Benjamin & Mazziotta, Agostino & Piper, Verena & Rohmann, Anette, 2018. "Evaluator competencies in the context of diversity training: The practitioners’ point of view," Evaluation and Program Planning, Elsevier, vol. 67(C), pages 122-128.
  • Handle: RePEc:eee:epplan:v:67:y:2018:i:c:p:122-128
    DOI: 10.1016/j.evalprogplan.2018.01.004
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0149718917302409
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.evalprogplan.2018.01.004?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Bates, Reid, 2004. "A critical analysis of evaluation practice: the Kirkpatrick model and the principle of beneficence," Evaluation and Program Planning, Elsevier, vol. 27(3), pages 341-347, August.
    2. Appannah, Arti & Meyer, Claudia & Ogrin, Rajna & McMillan, Sally & Barrett, Elizabeth & Browning, Colette, 2017. "Diversity training for the community aged care workers: A conceptual framework for evaluation," Evaluation and Program Planning, Elsevier, vol. 63(C), pages 74-81.
    3. Patton, Michael Quinn & Horton, Douglas, 2008. "Utilization-focused evaluation for agricultural innovation," ILAC Briefs 52533, Institutional Learning and Change (ILAC) Initiative.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Diaz, John & Chaudhary, Anil Kumar & Jayaratne, K.S.U. & Assan, Elsie, 2020. "Expanding evaluator competency research: Exploring competencies for program evaluation using the context of non-formal education," Evaluation and Program Planning, Elsevier, vol. 79(C).
    2. King, Jean A. & Ayoo, Sandra, 2020. "What do we know about evaluator education? A review of peer-reviewed publications (1978–2018)," Evaluation and Program Planning, Elsevier, vol. 79(C).
    3. Connors, Susan C. & Komaie, Goldie & Proctor, Jeff, 2023. "Exploring the value of pro bono evaluation work as a method to build evaluator competencies and strengthen organizational capacity," Evaluation and Program Planning, Elsevier, vol. 100(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Esposito, Giovanna & Freda, Maria Francesca, 2015. "Evaluating training context competence of use: Productive and unproductive models of use," Evaluation and Program Planning, Elsevier, vol. 50(C), pages 77-87.
    2. Lifshitz, Chen Chana, 2017. "Fostering employability among youth at-risk in a multi-cultural context: Insights from a pilot intervention program," Children and Youth Services Review, Elsevier, vol. 76(C), pages 20-34.
    3. Alison Bullock & Zoё Slote Morris & Christine Atwell, 2013. "Exchanging knowledge through healthcare manager placements in research teams," The Service Industries Journal, Taylor & Francis Journals, vol. 33(13-14), pages 1363-1380, October.
    4. Sobelson, Robyn K. & Young, Andrea C., 2013. "Evaluation of a federally funded workforce development program: The Centers for Public Health Preparedness," Evaluation and Program Planning, Elsevier, vol. 37(C), pages 50-57.
    5. Rebecca, E. & Sangarandeniya, Y. M. S. W. V., 2023. "The Impact of Trainee Characteristics, Training Design, and Work Environment on the Transfer of Training: A Study of Executive Level Employees of a Selected Tea Manufacturing Company in Sri Lanka," International Journal of Research and Innovation in Social Science, International Journal of Research and Innovation in Social Science (IJRISS), vol. 7(4), pages 648-656, April.
    6. Kupiec, Tomasz, 2022. "Does evaluation quality matter? Quantitative analysis of the use of evaluation findings in the field of cohesion policy in Poland," Evaluation and Program Planning, Elsevier, vol. 93(C).
    7. Gullickson, Amy M. & King, Jean A. & LaVelle, John M. & Clinton, Janet M., 2019. "The current state of evaluator education: A situation analysis and call to action," Evaluation and Program Planning, Elsevier, vol. 75(C), pages 20-30.
    8. Harman, Elena & Azzam, Tarek, 2018. "Incorporating public values into evaluative criteria: Using crowdsourcing to identify criteria and standards," Evaluation and Program Planning, Elsevier, vol. 71(C), pages 68-82.
    9. Pleasant, Andrew & O’Leary, Catina & Carmona, Richard H., 2020. "Using formative research to tailor a community intervention focused on the prevention of chronic disease," Evaluation and Program Planning, Elsevier, vol. 78(C).
    10. Gagnon, France & Aubry, Tim & Cousins, J. Bradley & Goh, Swee C. & Elliott, Catherine, 2018. "Validation of the evaluation capacity in organizations questionnaire," Evaluation and Program Planning, Elsevier, vol. 68(C), pages 166-175.
    11. Szijarto, Barbara & Milley, Peter & Svensson, Kate & Cousins, J. Bradley, 2018. "On the evaluation of social innovations and social enterprises: Recognizing and integrating two solitudes in the empirical knowledge base," Evaluation and Program Planning, Elsevier, vol. 66(C), pages 20-32.
    12. Neumann, Jan & Robson, Andrew & Sloan, Diane, 2018. "Monitoring and evaluation of strategic change programme implementation—Lessons from a case analysis," Evaluation and Program Planning, Elsevier, vol. 66(C), pages 120-132.
    13. Ninni Singh & Vinit Kumar Gunjan & Amit Kumar Mishra & Ram Krishn Mishra & Nishad Nawaz, 2022. "SeisTutor: A Custom-Tailored Intelligent Tutoring System and Sustainable Education," Sustainability, MDPI, vol. 14(7), pages 1-24, March.
    14. Collins, Mary Elizabeth, 2008. "Evaluating child welfare training in public agencies: Status and prospects," Evaluation and Program Planning, Elsevier, vol. 31(3), pages 241-246, August.
    15. Alemdar, Meltem & Cappelli, Christopher J. & Criswell, Brett A. & Rushton, Gregory T., 2018. "Evaluation of a Noyce program: Development of teacher leaders in STEM education," Evaluation and Program Planning, Elsevier, vol. 71(C), pages 1-11.
    16. Jose Antonio Diego-Mas & Jorge Alcaide-Marzal & Rocio Poveda-Bautista, 2020. "Effects of Using Immersive Media on the Effectiveness of Training to Prevent Ergonomics Risks," IJERPH, MDPI, vol. 17(7), pages 1-18, April.
    17. Bourgeois, Isabelle & Whynot, Jane, 2018. "The influence of evaluation recommendations on instrumental and conceptual uses: A preliminary analysis," Evaluation and Program Planning, Elsevier, vol. 68(C), pages 13-18.
    18. Kalpazidou Schmidt, Evanthia & Graversen, Ebbe Krogh, 2020. "Developing a conceptual evaluation framework for gender equality interventions in research and innovation," Evaluation and Program Planning, Elsevier, vol. 79(C).
    19. Arasanz, Carla & Nylen, Kirk, 2020. "The theory of change of the evaluation support program: Enhancing the role of community organizations in providing an ecology of care for neurological disorders," Evaluation and Program Planning, Elsevier, vol. 80(C).
    20. Schalock, Robert L. & Lee, Tim & Verdugo, Miguel & Swart, Kees & Claes, Claudia & van Loon, Jos & Lee, Chun-Shin, 2014. "An evidence-based approach to organization evaluation and change in human service organizations evaluation and program planning," Evaluation and Program Planning, Elsevier, vol. 45(C), pages 110-118.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:epplan:v:67:y:2018:i:c:p:122-128. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/evalprogplan .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.