IDEAS home Printed from https://ideas.repec.org/a/rbs/ijbrss/v9y2020i5p179-191.html
   My bibliography  Save this article

Examining stakeholder involvement in the evaluation process for program improvement

Author

Listed:
  • Edwin Ochieng Okul

    (The University of Nairobi, KenyaP.O Box 84 -40123, Kisumu, Kenya)

  • Raphael Ondeko Nyonje

    (School of Open, Distance and eLearning, The University of Nairobi, KenyaP.O Box 30197-00100,Nairobi, Kenya)

Abstract

The results of an evaluation should be used for the envisioned goal and the evaluation process and/or outcomes should be used in practice and decision making. This article presents research whose objective was to establish the extent to which stakeholder involvement in evaluations impacts the utilization of evaluation findings for program improvement. Guided by the pragmatic paradigm and supported by the Utilization-Focused Evaluation Model and Knowledge Use Theory, the researchers assumed a descriptive and correlational design using mixed methods. The sample size for this study was 232 project staff from Non-Governmental Organizations (NGOs) in Kisumu Central Sub-County, Kenya. To analyze qualitative data, the open-ended responses from key informant interviews were recorded and coded appropriately for further analysis for themes through content analysis and comparative analysis. Frequencies and percentages were calculated to describe the basic characteristics of the quantitative data. To ensure the validity and reliability of the research instruments, pilot testing was conducted. Cronbach’s alpha at α = 0.908 was attained as the reliability coefficient of the pre-test instruments. Tests of statistical assumptions were carried out before data analysis to avoid invalidation. A hypothesis was tested at the α = .05 level of significance and was rejected. The findings demonstrate that there is a significant relationship between stakeholder involvement in evaluations and the utilization of evaluation results. This research, therefore, reinforces literature and helps to understand the ways in which stakeholder involvement in evaluations influences the utilization of evaluation results. It informs the evaluation field of study, fills gaps in the evaluation use literature, and contributes to the appreciation of factors that predict and enhance the utilization of evaluation results. Key Words: Project Evaluation, Evaluation Utilization, Stakeholder Involvement.

Suggested Citation

  • Edwin Ochieng Okul & Raphael Ondeko Nyonje, 2020. "Examining stakeholder involvement in the evaluation process for program improvement," International Journal of Research in Business and Social Science (2147-4478), Center for the Strategic Studies in Business and Finance, vol. 9(5), pages 179-191, September.
    • Handle: RePEc:rbs:ijbrss:v:9:y:2020:i:5:p:179-191
    DOI: 10.20525/ijrbs.v9i5.835
    as

    Download full text from publisher

    File URL: https://www.ssbfnet.com/ojs/index.php/ijrbs/article/view/835/651
    Download Restriction: no
    File URL: https://doi.org/10.20525/ijrbs.v9i5.835
    Download Restriction: no
    File URL: https://libkey.io/10.20525/ijrbs.v9i5.835?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. José A Nájera & Matiana González-Silva & Pedro L Alonso, 2011. "Some Lessons for the Future from the Global Malaria Eradication Programme (1955–1969)," PLOS Medicine, Public Library of Science, vol. 8(1), pages 1-7, January.
    2. Patton, Michael Quinn & Horton, Douglas, 2008. "Utilization-focused evaluation for agricultural innovation," ILAC Briefs 52533, Institutional Learning and Change (ILAC) Initiative.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Lifshitz, Chen Chana, 2017. "Fostering employability among youth at-risk in a multi-cultural context: Insights from a pilot intervention program," Children and Youth Services Review, Elsevier, vol. 76(C), pages 20-34.
    2. Fahad Al Basir & Teklebirhan Abraha, 2023. "Mathematical Modelling and Optimal Control of Malaria Using Awareness-Based Interventions," Mathematics, MDPI, vol. 11(7), pages 1-25, March.
    3. Kupiec, Tomasz, 2022. "Does evaluation quality matter? Quantitative analysis of the use of evaluation findings in the field of cohesion policy in Poland," Evaluation and Program Planning, Elsevier, vol. 93(C).
    4. Gullickson, Amy M. & King, Jean A. & LaVelle, John M. & Clinton, Janet M., 2019. "The current state of evaluator education: A situation analysis and call to action," Evaluation and Program Planning, Elsevier, vol. 75(C), pages 20-30.
    5. Harman, Elena & Azzam, Tarek, 2018. "Incorporating public values into evaluative criteria: Using crowdsourcing to identify criteria and standards," Evaluation and Program Planning, Elsevier, vol. 71(C), pages 68-82.
    6. Pleasant, Andrew & O’Leary, Catina & Carmona, Richard H., 2020. "Using formative research to tailor a community intervention focused on the prevention of chronic disease," Evaluation and Program Planning, Elsevier, vol. 78(C).
    7. Gagnon, France & Aubry, Tim & Cousins, J. Bradley & Goh, Swee C. & Elliott, Catherine, 2018. "Validation of the evaluation capacity in organizations questionnaire," Evaluation and Program Planning, Elsevier, vol. 68(C), pages 166-175.
    8. Szijarto, Barbara & Milley, Peter & Svensson, Kate & Cousins, J. Bradley, 2018. "On the evaluation of social innovations and social enterprises: Recognizing and integrating two solitudes in the empirical knowledge base," Evaluation and Program Planning, Elsevier, vol. 66(C), pages 20-32.
    9. Neumann, Jan & Robson, Andrew & Sloan, Diane, 2018. "Monitoring and evaluation of strategic change programme implementation—Lessons from a case analysis," Evaluation and Program Planning, Elsevier, vol. 66(C), pages 120-132.
    10. Alemdar, Meltem & Cappelli, Christopher J. & Criswell, Brett A. & Rushton, Gregory T., 2018. "Evaluation of a Noyce program: Development of teacher leaders in STEM education," Evaluation and Program Planning, Elsevier, vol. 71(C), pages 1-11.
    11. Kimberly M. Thompson, 2017. "Modeling and Managing the Risks of Measles and Rubella: A Global Perspective Part II," Risk Analysis, John Wiley & Sons, vol. 37(6), pages 1041-1051, June.
    12. Jamie Guth & Marie Lamy & Nikhil Murali & Patil Pankaj & Yongyuth Yuthavong, 2022. "Meeting malaria elimination targets and remaining challenges: Qualitative research on perceptions of stakeholders in India and Southeast Asia," Asia and the Pacific Policy Studies, Wiley Blackwell, vol. 9(2), pages 178-195, May.
    13. Bourgeois, Isabelle & Whynot, Jane, 2018. "The influence of evaluation recommendations on instrumental and conceptual uses: A preliminary analysis," Evaluation and Program Planning, Elsevier, vol. 68(C), pages 13-18.
    14. Healy, John & Hughes, Jeffrey & Donnelly-Cox, Gemma & Shantz, Amanda, 2024. "A long and winding road: The hard graft of scaling social change in complex systems," Journal of Business Venturing Insights, Elsevier, vol. 21(C).
    15. Kalpazidou Schmidt, Evanthia & Graversen, Ebbe Krogh, 2020. "Developing a conceptual evaluation framework for gender equality interventions in research and innovation," Evaluation and Program Planning, Elsevier, vol. 79(C).
    16. Arasanz, Carla & Nylen, Kirk, 2020. "The theory of change of the evaluation support program: Enhancing the role of community organizations in providing an ecology of care for neurological disorders," Evaluation and Program Planning, Elsevier, vol. 80(C).
    17. Schalock, Robert L. & Lee, Tim & Verdugo, Miguel & Swart, Kees & Claes, Claudia & van Loon, Jos & Lee, Chun-Shin, 2014. "An evidence-based approach to organization evaluation and change in human service organizations evaluation and program planning," Evaluation and Program Planning, Elsevier, vol. 45(C), pages 110-118.
    18. Renger, Ralph & Foltysova, Jirina & Becker, Karin L. & Souvannasacd, Eric, 2015. "The power of the context map: Designing realistic outcome evaluation strategies and other unanticipated benefits," Evaluation and Program Planning, Elsevier, vol. 52(C), pages 118-125.
    19. Rorrer, Audrey S., 2016. "An evaluation capacity building toolkit for principal investigators of undergraduate research experiences: A demonstration of transforming theory into practice," Evaluation and Program Planning, Elsevier, vol. 55(C), pages 103-111.
    20. Abboud, Rida & Claussen, Caroline, 2016. "The use of Outcome Harvesting in learning-oriented and collaborative inquiry approaches to evaluation: An example from Calgary, Alberta," Evaluation and Program Planning, Elsevier, vol. 59(C), pages 47-54.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:rbs:ijbrss:v:9:y:2020:i:5:p:179-191. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Umit Hacioglu (email available below). General contact details of provider: https://edirc.repec.org/data/ssbffea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.