IDEAS home Printed from https://ideas.repec.org/a/eee/epplan/v79y2020ics0149718919303969.html
   My bibliography  Save this article

Evaluation capacity building in the nonformal education context: Challenges and strategies

Author

Listed:
  • Kumar Chaudhary, Anil
  • Diaz, John
  • Jayaratne, K.S.U.
  • Assan, Elsie

Abstract

Policymakers’ demand for increased accountability has compelled organizations to pay more attention to internal evaluation capacity building (ECB). The existing literature about ECB has focused on capacity building experiences and organizational research, with limited attention on challenges that internal evaluation specialists face in building organizational evaluative capacity. To address this knowledge gap, we conducted a Delphi study with evaluation specialists in the United States’ Cooperative Extension Service and developed a consensus on the most pervasive ECB challenges as well as the most useful strategies for overcoming ECB challenges. Challenges identified in this study include limited time and resources, limited understanding of the value of evaluation, evaluation considered as an afterthought, and limited support and buy-in from administrators. Alternatively, strategies found in the study include a shift in an organizational culture where evaluation is appreciated, buy-in and support from administration, clarifying the importance of quality than quantity of evaluations, and a strategic approach to ECB. The challenges identified in this study have persisted for decades, meaning administrators must understand the persistence of these issues and make an earnest investment (financial and human resource) to make noticeable progress. The Delphi approach can be used more often to prioritize ECB efforts.

Suggested Citation

  • Kumar Chaudhary, Anil & Diaz, John & Jayaratne, K.S.U. & Assan, Elsie, 2020. "Evaluation capacity building in the nonformal education context: Challenges and strategies," Evaluation and Program Planning, Elsevier, vol. 79(C).
    • Handle: RePEc:eee:epplan:v:79:y:2020:i:c:s0149718919303969
    DOI: 10.1016/j.evalprogplan.2019.101768
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0149718919303969
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.evalprogplan.2019.101768?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Norton, Sophie & Milat, Andrew & Edwards, Barry & Giffin, Michael, 2016. "Narrative review of strategies by organizations for building evaluation capacity," Evaluation and Program Planning, Elsevier, vol. 58(C), pages 1-19.
    2. Carleton-Hug, Annelise & Hug, J. William, 2010. "Challenges and opportunities for evaluating environmental education programs," Evaluation and Program Planning, Elsevier, vol. 33(2), pages 159-164, May.
    3. Fleming, M. Lynette & Easton, Janice, 2010. "Building environmental educators' evaluation capacity through distance education," Evaluation and Program Planning, Elsevier, vol. 33(2), pages 172-177, May.
    4. Naccarella, Lucio & Pirkis, Jane & Kohn, Fay & Morley, Belinda & Burgess, Philip & Blashki, Grant, 2007. "Building evaluation capacity: Definitional and practical implications from an Australian case study," Evaluation and Program Planning, Elsevier, vol. 30(3), pages 231-236, August.
    5. Stevenson, John F. & Florin, Paul & Mills, Dana Scott & Andrade, Marco, 2002. "Building evaluation capacity in human service organizations: a case study," Evaluation and Program Planning, Elsevier, vol. 25(3), pages 233-243, August.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Merritt, Eileen G. & Stern, Marc J. & Powell, Robert B. & Frensley, Brandon T., 2023. "Benefits of participation in a community of practice focused on evaluation and programmatic improvement for environmental educators," Evaluation and Program Planning, Elsevier, vol. 99(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Tseng, Shu-Hui, 2011. "An assessment scale of ECB: Perspectives from the faculty and staff of technical colleges in Taiwan," Evaluation and Program Planning, Elsevier, vol. 34(2), pages 154-159, May.
    2. Merritt, Eileen G. & Stern, Marc J. & Powell, Robert B. & Frensley, Brandon T., 2023. "Benefits of participation in a community of practice focused on evaluation and programmatic improvement for environmental educators," Evaluation and Program Planning, Elsevier, vol. 99(C).
    3. Crohn, Kara & Birnbaum, Matthew, 2010. "Environmental education evaluation: Time to reflect, time for change," Evaluation and Program Planning, Elsevier, vol. 33(2), pages 155-158, May.
    4. Katerina Kabassi & Anastasia Papadaki & Athanasios Botonis, 2023. "Adapting Recommendations on Environmental Education Programs," Future Internet, MDPI, vol. 15(1), pages 1-12, January.
    5. Norton, Sophie & Milat, Andrew & Edwards, Barry & Giffin, Michael, 2016. "Narrative review of strategies by organizations for building evaluation capacity," Evaluation and Program Planning, Elsevier, vol. 58(C), pages 1-19.
    6. Satterlund, Travis D. & Treiber, Jeanette & Kipke, Robin & Kwon, Nicole & Cassady, Diana, 2013. "Accommodating diverse clients’ needs in evaluation capacity building: A case study of the Tobacco Control Evaluation Center," Evaluation and Program Planning, Elsevier, vol. 36(1), pages 49-55.
    7. Monroe, Martha C., 2010. "Challenges for environmental education evaluation," Evaluation and Program Planning, Elsevier, vol. 33(2), pages 194-196, May.
    8. Allred, Shorna & Stedman, Richard & Heady, Laura & Strong, Karen, 2021. "Incorporating biodiversity in municipal land-use planning: An assessment of technical assistance, policy capacity, and conservation outcomes in New York’s Hudson Valley," Land Use Policy, Elsevier, vol. 104(C).
    9. Andrews, Arlene Bowers, 2004. "Start at the end: empowerment evaluation product planning," Evaluation and Program Planning, Elsevier, vol. 27(3), pages 275-285, August.
    10. Issa Ibrahim Berchin & Ana Regina de Aguiar Dutra & José Baltazar Salgueirinho Osório de Andrade Guerra, 2021. "How do higher education institutions promote sustainable development? A literature review," Sustainable Development, John Wiley & Sons, Ltd., vol. 29(6), pages 1204-1222, November.
    11. Lim, E.A & Manohar, M. & Aziz, Azlizam & Zakaria, M., 2016. "Influencing secondary school STUDENTS’ conservation behavior intention through an interpretive education program on the malayan tapir," Evaluation and Program Planning, Elsevier, vol. 58(C), pages 60-69.
    12. Kirsten M. M. Beyer & Elizabeth F. Heller & Jessica M. Bizub & Amy J. Kistner & Aniko Szabo & Erin E. Shawgo & Corey J. Zetts, 2015. "More than a Pretty Place: Assessing the Impact of Environmental Education on Children’s Knowledge and Attitudes about Outdoor Play in Nature," IJERPH, MDPI, vol. 12(2), pages 1-17, February.
    13. Fleming, M. Lynette & Easton, Janice, 2010. "Building environmental educators' evaluation capacity through distance education," Evaluation and Program Planning, Elsevier, vol. 33(2), pages 172-177, May.
    14. Yu.V. Lyandau & I.A. Kalinina & A.P. Garnov & Y.Yu. Garnova, 2018. "Research of the Russian Companies’ Potential and the Success Factors," European Research Studies Journal, European Research Studies Journal, vol. 0(Special1), pages 250-260.
    15. Shih-Yeh Chen & Shiang-Yao Liu, 2020. "Developing Students’ Action Competence for a Sustainable Future: A Review of Educational Research," Sustainability, MDPI, vol. 12(4), pages 1-14, February.
    16. Rogers, Alison F. & Kelly, Leanne M. & McCoy, Alicia, 2019. "Pathways to becoming an internal evaluator: Perspectives from the Australian non-government sector," Evaluation and Program Planning, Elsevier, vol. 74(C), pages 102-109.
    17. Pedro Mauricio Acosta Castellanos & Araceli Queiruga-Dios & Ascensión Hernández Encinas & Libia Cristina Acosta, 2020. "Environmental Education in Environmental Engineering: Analysis of the Situation in Colombia and Latin America," Sustainability, MDPI, vol. 12(18), pages 1-14, September.
    18. Wong, Sandie, 2009. "Tales from the frontline: The experiences of early childhood practitioners working with an [`]embedded' research team," Evaluation and Program Planning, Elsevier, vol. 32(2), pages 99-108, May.
    19. Bjerke, May Britt & Renger, Ralph, 2017. "Being smart about writing SMART objectives," Evaluation and Program Planning, Elsevier, vol. 61(C), pages 125-127.
    20. Mayer, Duncan J. & Fischer, Robert L., 2023. "Exploring data use in nonprofit organizations," Evaluation and Program Planning, Elsevier, vol. 97(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:epplan:v:79:y:2020:i:c:s0149718919303969. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/evalprogplan .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.