IDEAS home Printed from https://ideas.repec.org/a/eee/epplan/v73y2019icp97-110.html
   My bibliography  Save this article

Dealing with context in logic model development: Reflections from a realist evaluation of a community health worker programme in Nigeria

Author

Listed:
  • Ebenso, Bassey
  • Manzano, Ana
  • Uzochukwu, Benjamin
  • Etiaba, Enyi
  • Huss, Reinhard
  • Ensor, Tim
  • Newell, James
  • Onwujekwe, Obinna
  • Ezumah, Nkoli
  • Hicks, Joe
  • Mirzoev, Tolib

Abstract

Logic models (LMs) have been used in programme evaluation for over four decades. Current debate questions the ability of logic modelling techniques to incorporate contextual factors into logic models. We share experience of developing a logic model within an ongoing realist evaluation which assesses the extent to which, and under what circumstances a community health workers (CHW) programme promotes access to maternity services in Nigeria. The article contributes to logic modelling debate by: i) reflecting on how other scholars captured context during LM development in theory-driven evaluations; and ii) explaining how we explored context during logic model development for realist evaluation of the CHW programme in Nigeria. Data collection methods that informed our logic model development included documents review, email discussions and teleconferences with programme stakeholders and a technical workshop with researchers to clarify programme goals and untangle relationships among programme elements. One of the most important findings is that, rather than being an end in itself, logic model development is an essential step for identifying initial hypotheses for tentative relevant contexts, mechanisms and outcomes (CMOs) and CMO configurations of how programmes produce change. The logic model also informed development of a methodology handbook that is guiding verification and consolidation of underlying programme theories.

Suggested Citation

  • Ebenso, Bassey & Manzano, Ana & Uzochukwu, Benjamin & Etiaba, Enyi & Huss, Reinhard & Ensor, Tim & Newell, James & Onwujekwe, Obinna & Ezumah, Nkoli & Hicks, Joe & Mirzoev, Tolib, 2019. "Dealing with context in logic model development: Reflections from a realist evaluation of a community health worker programme in Nigeria," Evaluation and Program Planning, Elsevier, vol. 73(C), pages 97-110.
  • Handle: RePEc:eee:epplan:v:73:y:2019:i:c:p:97-110
    DOI: 10.1016/j.evalprogplan.2018.12.002
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S014971891830051X
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.evalprogplan.2018.12.002?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Cullen, Patricia & Clapham, Kathleen & Byrne, Jake & Hunter, Kate & Senserrick, Teresa & Keay, Lisa & Ivers, Rebecca, 2016. "The importance of context in logic model construction for a multi-site community-based Aboriginal driver licensing program," Evaluation and Program Planning, Elsevier, vol. 57(C), pages 8-15.
    2. Ziviani, Jenny & Darlington, Yvonne & Feeney, Rachel & Head, Brian, 2011. "From policy to practice: A program logic approach to describing the implementation of early intervention services for children with physical disability," Evaluation and Program Planning, Elsevier, vol. 34(1), pages 60-68, February.
    3. Hill, Janice R. & Thies, Jeanie, 2010. "Program theory and logic model to address the co-occurrence of domestic violence and child maltreatment," Evaluation and Program Planning, Elsevier, vol. 33(4), pages 356-364, November.
    4. Chatterji, Madhabi, 2016. "Causal inferences on the effectiveness of complex social programs: Navigating assumptions, sources of complexity and evaluation design challenges," Evaluation and Program Planning, Elsevier, vol. 59(C), pages 128-140.
    5. Renger, Ralph & Foltysova, Jirina & Becker, Karin L. & Souvannasacd, Eric, 2015. "The power of the context map: Designing realistic outcome evaluation strategies and other unanticipated benefits," Evaluation and Program Planning, Elsevier, vol. 52(C), pages 118-125.
    6. Millar, Annie & Simeone, Ronald S. & Carnevale, John T., 2001. "Logic models: a systems tool for performance management," Evaluation and Program Planning, Elsevier, vol. 24(1), pages 73-81, February.
    7. repec:mpr:mprres:7754 is not listed on IDEAS
    8. Kaplan, Sue A. & Garrett, Katherine E., 2005. "The use of logic models by community-based initiatives," Evaluation and Program Planning, Elsevier, vol. 28(2), pages 167-172, May.
    9. O'Keefe, Christine M. & Head, Richard J., 2011. "Application of logic models in a large scientific research program," Evaluation and Program Planning, Elsevier, vol. 34(3), pages 174-184, August.
    10. Clapham, Kathleen & Manning, Claire & Williams, Kathryn & O’Brien, Ginger & Sutherland, Margaret, 2017. "Using a logic model to evaluate the Kids Together early education inclusion program for children with disabilities and additional needs," Evaluation and Program Planning, Elsevier, vol. 61(C), pages 96-105.
    11. Park, Chul Hyun & Welch, Eric W. & Sriraj, P.S., 2016. "An integrative theory-driven framework for evaluating travel training programs," Evaluation and Program Planning, Elsevier, vol. 59(C), pages 7-20.
    12. Wong, Sandie, 2009. "Tales from the frontline: The experiences of early childhood practitioners working with an [`]embedded' research team," Evaluation and Program Planning, Elsevier, vol. 32(2), pages 99-108, May.
    13. Dana Petersen & Erin Fries Taylor & Deborah Peikes, "undated". "The Logic Model: The Foundation to Implement, Study, and Refine Patient-Centered Medical Home Models (Issue Brief)," Mathematica Policy Research Reports a53cfa0244fd4728acf8ee67d, Mathematica Policy Research.
    14. Sherman, Paul David, 2016. "Using RUFDATA to guide a logic model for a quality assurance process in an undergraduate university program," Evaluation and Program Planning, Elsevier, vol. 55(C), pages 112-119.
    15. McLaughlin, John A. & Jordan, Gretchen B., 1999. "Logic models: a tool for telling your programs performance story," Evaluation and Program Planning, Elsevier, vol. 22(1), pages 65-72.
    16. Newton, Xiaoxia A. & Poon, Rebecca C. & Nunes, Nicole L. & Stone, Elisa M., 2013. "Research on teacher education programs: Logic model approach," Evaluation and Program Planning, Elsevier, vol. 36(1), pages 88-96.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Newton-Levinson, Anna & Higdon, Megan & Sales, Jessica & Gaydos, Laurie & Rochat, Roger, 2020. "Context matters: Using mixed methods timelines to provide an accessible and integrated visual for complex program evaluation data," Evaluation and Program Planning, Elsevier, vol. 80(C).
    2. Ezumah, Nkoli & Manzano, Ana & Ezenwaka, Uchenna & Obi, Uche & Ensor, Tim & Etiaba, Enyi & Onwujekwe, Obinna & Ebenso, Bassey & Uzochukwu, Benjamin & Huss, Reinhard & Mirzoev, Tolib, 2022. "Role of trust in sustaining provision and uptake of maternal and child healthcare: Evidence from a national programme in Nigeria," Social Science & Medicine, Elsevier, vol. 293(C).
    3. Seohyun Lee & Abdul-jabiru Adam, 2021. "Designing a Logic Model for Mobile Maternal Health e-Voucher Programs in Low- and Middle-Income Countries: An Interpretive Review," IJERPH, MDPI, vol. 19(1), pages 1-37, December.
    4. Emond, Tina & Guillaumie, Laurence & de Montigny, Francine, 2021. "Using a logic model to develop an intervention for improving miscarriage care in the emergency department," Evaluation and Program Planning, Elsevier, vol. 85(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Peyton, David J. & Scicchitano, Michael, 2017. "Devil is in the details: Using logic models to investigate program process," Evaluation and Program Planning, Elsevier, vol. 65(C), pages 156-162.
    2. Vinícius P. Rodrigues & Daniela C. A. Pigosso & Jakob W. Andersen & Tim C. McAloone, 2018. "Evaluating the Potential Business Benefits of Ecodesign Implementation: A Logic Model Approach," Sustainability, MDPI, vol. 10(6), pages 1-26, June.
    3. Fielden, Sarah J. & Rusch, Melanie L. & Masinda, Mambo Tabu & Sands, Jim & Frankish, Jim & Evoy, Brian, 2007. "Key considerations for logic model development in research partnerships: A Canadian case study," Evaluation and Program Planning, Elsevier, vol. 30(2), pages 115-124, May.
    4. Park, Chul Hyun & Welch, Eric W. & Sriraj, P.S., 2016. "An integrative theory-driven framework for evaluating travel training programs," Evaluation and Program Planning, Elsevier, vol. 59(C), pages 7-20.
    5. Cullen, Patricia & Clapham, Kathleen & Byrne, Jake & Hunter, Kate & Senserrick, Teresa & Keay, Lisa & Ivers, Rebecca, 2016. "The importance of context in logic model construction for a multi-site community-based Aboriginal driver licensing program," Evaluation and Program Planning, Elsevier, vol. 57(C), pages 8-15.
    6. Sherman, Paul David, 2016. "Using RUFDATA to guide a logic model for a quality assurance process in an undergraduate university program," Evaluation and Program Planning, Elsevier, vol. 55(C), pages 112-119.
    7. Ribeiro, Fernando & Ferreira, Paula & Araújo, Madalena, 2013. "Sustainability assessment of electricity production using a logic models approach," Renewable and Sustainable Energy Reviews, Elsevier, vol. 28(C), pages 215-223.
    8. Wasserman, Deborah L., 2010. "Using a systems orientation and foundational theory to enhance theory-driven human service program evaluations," Evaluation and Program Planning, Elsevier, vol. 33(2), pages 67-80, May.
    9. Wu, Huang & Shen, Jianping & Jones, Jeffrey & Gao, Xingyuan & Zheng, Yunzheng & Krenn, Huilan Y., 2019. "Using logic model and visualization to conduct portfolio evaluation," Evaluation and Program Planning, Elsevier, vol. 74(C), pages 69-75.
    10. O'Keefe, Christine M. & Head, Richard J., 2011. "Application of logic models in a large scientific research program," Evaluation and Program Planning, Elsevier, vol. 34(3), pages 174-184, August.
    11. Fangyuan Chang & Andrea Eriksson & Britt Östlund, 2020. "Discrepancies between Expected and Actual Implementation: The Process Evaluation of PERS Integration in Nursing Homes," IJERPH, MDPI, vol. 17(12), pages 1-18, June.
    12. Kaplan, Sue A. & Garrett, Katherine E., 2005. "The use of logic models by community-based initiatives," Evaluation and Program Planning, Elsevier, vol. 28(2), pages 167-172, May.
    13. Clapham, Kathleen & Manning, Claire & Williams, Kathryn & O’Brien, Ginger & Sutherland, Margaret, 2017. "Using a logic model to evaluate the Kids Together early education inclusion program for children with disabilities and additional needs," Evaluation and Program Planning, Elsevier, vol. 61(C), pages 96-105.
    14. Gervais, Christine & de Montigny, Francine & Lacharité, Carl & Dubeau, Diane, 2015. "The Father Friendly Initiative within Families: Using a logic model to develop program theory for a father support program," Evaluation and Program Planning, Elsevier, vol. 52(C), pages 133-141.
    15. Volden, Gro Holst, 2018. "Public project success as seen in a broad perspective," Evaluation and Program Planning, Elsevier, vol. 69(C), pages 109-117.
    16. Levay, Adrienne V. & Chapman, Gwen E. & Seed, Barbara & Wittman, Hannah, 2018. "It’s just the right thing to do: Conceptualizing a theory of change for a school food and beverage sales environment interv ention and implications for implementation evaluation," Evaluation and Program Planning, Elsevier, vol. 70(C), pages 73-82.
    17. George M Ibrahim & David W Cadotte & Mark Bernstein, 2015. "A Framework for the Monitoring and Evaluation of International Surgical Initiatives in Low- and Middle-Income Countries," PLOS ONE, Public Library of Science, vol. 10(3), pages 1-14, March.
    18. Patterson, Laurie B. & Backhouse, Susan H. & Duffy, Patrick J., 2016. "Anti-doping education for coaches: Qualitative insights from national and international sporting and anti-doping organisations," Sport Management Review, Elsevier, vol. 19(1), pages 35-47.
    19. Scarinci, Isabel C. & Johnson, Rhoda E. & Hardy, Claudia & Marron, John & Partridge, Edward E., 2009. "Planning and implementation of a participatory evaluation strategy: A viable approach in the evaluation of community-based participatory programs addressing cancer disparities," Evaluation and Program Planning, Elsevier, vol. 32(3), pages 221-228, August.
    20. Hill, Janice R. & Thies, Jeanie, 2010. "Program theory and logic model to address the co-occurrence of domestic violence and child maltreatment," Evaluation and Program Planning, Elsevier, vol. 33(4), pages 356-364, November.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:epplan:v:73:y:2019:i:c:p:97-110. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/evalprogplan .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.