IDEAS home Printed from https://ideas.repec.org/a/eee/epplan/v33y2010i3p223-233.html
   My bibliography  Save this article

Evaluation for community-based programs: The integration of logic models and factor analysis

Author

Listed:
  • Helitzer, Deborah
  • Hollis, Christine
  • Hernandez, Brisa Urquieta de
  • Sanders, Margaret
  • Roybal, Suzanne
  • Van Deusen, Ian

Abstract

Purpose To discuss the utility of and value of the use of logic models for program evaluation of community-based programs and more specifically, the integration of logic models and factor analysis to develop and revise a survey as part of an effective evaluation plan.Principal results Diverse stakeholders with varying outlooks used a logic model as a framework to reach agreement on a plan for a state-wide evaluation. This evaluation plan utilized a survey of sixth grade students, administered before and after exposure to a year-long abstinence education program. Components of the logic model were linked to specific survey questions. Exploratory factor analysis was then used to assess whether and how the questions in the survey fit with the constructs of the model; confirmatory factor analysis was used to test the hypothesis that the factors identified in the exploratory analysis were consistently represented in the survey.Major conclusions A logic model is a tool that engages stakeholders to link evaluation instruments more closely to specific program objectives. Thus, stakeholders can more closely assess the extent to which project outcomes have been achieved. In addition, use of factor analysis in the evaluation process can help the stakeholders better understand whether evaluation instruments such as a survey adequately assess program effectiveness. Lastly, a logic model process can help to achieve consensus among diverse stakeholders, by allowing them to focus on objectives that are concrete, measurable, and mutually acceptable.

Suggested Citation

  • Helitzer, Deborah & Hollis, Christine & Hernandez, Brisa Urquieta de & Sanders, Margaret & Roybal, Suzanne & Van Deusen, Ian, 2010. "Evaluation for community-based programs: The integration of logic models and factor analysis," Evaluation and Program Planning, Elsevier, vol. 33(3), pages 223-233, August.
    • Handle: RePEc:eee:epplan:v:33:y:2010:i:3:p:223-233
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0149-7189(09)00084-6
    Download Restriction: Full text for ScienceDirect subscribers only
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Sydney C. Ludvigson & Serena Ng, 2009. "A Factor Analysis of Bond Risk Premia," NBER Working Papers 15188, National Bureau of Economic Research, Inc.
    2. repec:mpr:mprres:5429 is not listed on IDEAS
    3. McLaughlin, John A. & Jordan, Gretchen B., 1999. "Logic models: a tool for telling your programs performance story," Evaluation and Program Planning, Elsevier, vol. 22(1), pages 65-72.
    4. Ompad, D.C. & Ikeda, R.M. & Shah, N. & Fuller, C.M. & Bailey, S. & Morse, E. & Kerndt, P. & Maslow, C. & Wu, Y. & Vlahov, D. & Garfein, R. & Strathdee, S.A., 2005. "Childhood sexual abuse and age at initiation of injection drug use," American Journal of Public Health, American Public Health Association, vol. 95(4), pages 703-709.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Wu, Huang & Shen, Jianping & Jones, Jeffrey & Gao, Xingyuan & Zheng, Yunzheng & Krenn, Huilan Y., 2019. "Using logic model and visualization to conduct portfolio evaluation," Evaluation and Program Planning, Elsevier, vol. 74(C), pages 69-75.
    2. Park, Chul Hyun & Welch, Eric W. & Sriraj, P.S., 2016. "An integrative theory-driven framework for evaluating travel training programs," Evaluation and Program Planning, Elsevier, vol. 59(C), pages 7-20.
    3. Clapham, Kathleen & Manning, Claire & Williams, Kathryn & O’Brien, Ginger & Sutherland, Margaret, 2017. "Using a logic model to evaluate the Kids Together early education inclusion program for children with disabilities and additional needs," Evaluation and Program Planning, Elsevier, vol. 61(C), pages 96-105.
    4. Fletcher-Hildebrand, Shaneice & Williamson, Linzi & Lawson, Karen & Dell, Colleen, 2023. "Remotely and collaboratively evaluating a campus-based therapy dog program during the COVID-19 pandemic," Evaluation and Program Planning, Elsevier, vol. 98(C).
    5. Gervais, Christine & de Montigny, Francine & Lacharité, Carl & Dubeau, Diane, 2015. "The Father Friendly Initiative within Families: Using a logic model to develop program theory for a father support program," Evaluation and Program Planning, Elsevier, vol. 52(C), pages 133-141.
    6. Helitzer, Deborah L. & Sussman, Andrew L. & Hoffman, Richard M. & Getrich, Christina M. & Warner, Teddy D. & Rhyne, Robert L., 2014. "Along the way to developing a theory of the program: A re-examination of the conceptual framework as an organizing strategy," Evaluation and Program Planning, Elsevier, vol. 45(C), pages 157-163.
    7. Ribeiro, Fernando & Ferreira, Paula & Araújo, Madalena, 2013. "Sustainability assessment of electricity production using a logic models approach," Renewable and Sustainable Energy Reviews, Elsevier, vol. 28(C), pages 215-223.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Tim Benijts, 2014. "A Business Sustainability Model for Government Corporations. A Belgian Case Study," Business Strategy and the Environment, Wiley Blackwell, vol. 23(3), pages 204-216, March.
    2. Wasserman, Deborah L., 2010. "Using a systems orientation and foundational theory to enhance theory-driven human service program evaluations," Evaluation and Program Planning, Elsevier, vol. 33(2), pages 67-80, May.
    3. Gonçalves, Sílvia & McCracken, Michael W. & Perron, Benoit, 2017. "Tests of equal accuracy for nested models with estimated factors," Journal of Econometrics, Elsevier, vol. 198(2), pages 231-252.
    4. Peyton, David J. & Scicchitano, Michael, 2017. "Devil is in the details: Using logic models to investigate program process," Evaluation and Program Planning, Elsevier, vol. 65(C), pages 156-162.
    5. Piyachart Phiromswad & Takeshi Yagihashi, 2016. "Empirical identification of factor models," Empirical Economics, Springer, vol. 51(2), pages 621-658, September.
    6. Matt Andrews, 2022. "This is How to Think About and Achieve Public Policy Success," CID Working Papers 413, Center for International Development at Harvard University.
    7. Wifo, 2021. "WIFO-Monatsberichte, Heft 10/2021," WIFO Monatsberichte (monthly reports), WIFO, vol. 94(10), October.
    8. Sobelson, Robyn K. & Young, Andrea C., 2013. "Evaluation of a federally funded workforce development program: The Centers for Public Health Preparedness," Evaluation and Program Planning, Elsevier, vol. 37(C), pages 50-57.
    9. Wu, Huang & Shen, Jianping & Jones, Jeffrey & Gao, Xingyuan & Zheng, Yunzheng & Krenn, Huilan Y., 2019. "Using logic model and visualization to conduct portfolio evaluation," Evaluation and Program Planning, Elsevier, vol. 74(C), pages 69-75.
    10. Vinícius P. Rodrigues & Daniela C. A. Pigosso & Jakob W. Andersen & Tim C. McAloone, 2018. "Evaluating the Potential Business Benefits of Ecodesign Implementation: A Logic Model Approach," Sustainability, MDPI, vol. 10(6), pages 1-26, June.
    11. Laura Nowzohour & Livio Stracca, 2020. "More Than A Feeling: Confidence, Uncertainty, And Macroeconomic Fluctuations," Journal of Economic Surveys, Wiley Blackwell, vol. 34(4), pages 691-726, September.
    12. Janger, Jürgen & Schubert, Torben & Andries, Petra & Rammer, Christian & Hoskens, Machteld, 2017. "The EU 2020 innovation indicator: A step forward in measuring innovation outputs and outcomes?," Research Policy, Elsevier, vol. 46(1), pages 30-42.
    13. Jürgen Janger & Agnes Kügler, 2018. "Innovationseffizienz. Österreich im internationalen Vergleich," WIFO Studies, WIFO, number 61111, January.
    14. Fangyuan Chang & Andrea Eriksson & Britt Östlund, 2020. "Discrepancies between Expected and Actual Implementation: The Process Evaluation of PERS Integration in Nursing Homes," IJERPH, MDPI, vol. 17(12), pages 1-18, June.
    15. Louise R. Manfredi & Meriel Stokoe & Rebecca Kelly & Seyeon Lee, 2021. "Teaching Sustainable Responsibility through Informal Undergraduate Design Education," Sustainability, MDPI, vol. 13(15), pages 1-13, July.
    16. Laura Kreiling & Ahmed Bounfour, 2020. "A practice-based maturity model for holistic TTO performance management: development and initial use," The Journal of Technology Transfer, Springer, vol. 45(6), pages 1718-1747, December.
    17. Xyngis, Georgios, 2017. "Business-cycle variation in macroeconomic uncertainty and the cross-section of expected returns: Evidence for scale-dependent risks," Journal of Empirical Finance, Elsevier, vol. 44(C), pages 43-65.
    18. Hyun-Kyu KANG, 2015. "Development of Guideline for Preliminary Feasibility Study on Government R&D Programs in Korea," Proceedings of International Academic Conferences 2805212, International Institute of Social and Economic Sciences.
    19. Stefano Giglio & Dacheng Xiu, 2017. "Inference on Risk Premia in the Presence of Omitted Factors," NBER Working Papers 23527, National Bureau of Economic Research, Inc.
    20. Carlos Vallejo & David Romero & Arturo Molina, 2017. "Implementation of best manufacturing practices using logic models and system dynamics: project design and project assessment views," Information Systems and e-Business Management, Springer, vol. 15(2), pages 535-575, May.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:epplan:v:33:y:2010:i:3:p:223-233. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/evalprogplan .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.