IDEAS home Printed from https://ideas.repec.org/a/eee/cysrev/v33y2011i11p2273-2281.html
   My bibliography  Save this article

The context of program implementation and evaluation: A pilot study of interorganizational differences to improve child welfare reform efforts

Author

Listed:
  • Crea, Thomas M.
  • Crampton, David S.

Abstract

This article contributes to the growing literature on evaluation and implementation science by examining the interaction between staff perceptions of organizational strength with perceptions and indicators of program fidelity. As part of a pilot project related to the evaluation of the Family to Family initiative, a survey was distributed to employees within two urban child welfare agencies with a total of 410 respondents across both sites, for a combined response rate of 72.2%. Survey results were analyzed both in terms or respondents' perception of their agency as well as in relation to measures of program performance and workload. Multivariate models show that organizational indicators are the most significant and positive predictors of perceived program implementation. Specifically, staff who positively perceived the availability of information within their agency also believed that the programs were well implemented in their agency. These findings suggest that as the value of program changes are articulated within an organization, the implementation of the initiative is perceived to improve.

Suggested Citation

  • Crea, Thomas M. & Crampton, David S., 2011. "The context of program implementation and evaluation: A pilot study of interorganizational differences to improve child welfare reform efforts," Children and Youth Services Review, Elsevier, vol. 33(11), pages 2273-2281.
    • Handle: RePEc:eee:cysrev:v:33:y:2011:i:11:p:2273-2281
    DOI: 10.1016/j.childyouth.2011.07.012
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0190740911002726
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.childyouth.2011.07.012?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Rauktis, Mary E. & McCarthy, Sharon & Krackhardt, David & Cahalane, Helen, 2010. "Innovation in child welfare: The adoption and implementation of Family Group Decision Making in Pennsylvania," Children and Youth Services Review, Elsevier, vol. 32(5), pages 732-739, May.
    2. Rego, Miguel Ángel Santos & Otero, Agustín Godás & Moledo, M del Mar Lorenzo, 2009. "Evaluation of the implementation of a socio-educational program with immigrant families: A case study," Evaluation and Program Planning, Elsevier, vol. 32(1), pages 21-30, February.
    3. Crea, Thomas M. & Crampton, David S. & Abramson-Madden, Anne & Usher, Charles L., 2008. "Variability in the implementation of Team Decisionmaking (TDM): Scope and compliance with the Family to Family practice model," Children and Youth Services Review, Elsevier, vol. 30(11), pages 1221-1232, November.
    4. Kalafat, John & Illback, Robert J. & Sanders, Daniel Jr., 2007. "The relationship between implementation fidelity and educational outcomes in a school-based family support program: Development of a model for evaluating multidimensional full-service programs," Evaluation and Program Planning, Elsevier, vol. 30(2), pages 136-148, May.
    5. Glasgow, R.E. & Lichtenstein, E. & Marcus, A.C., 2003. "Why Don't We See More Translation of Health Promotion Research to Practice? Rethinking the Efficacy-to-Effectiveness Transition," American Journal of Public Health, American Public Health Association, vol. 93(8), pages 1261-1267.
    6. Millett, Lina & Lanier, Paul & Drake, Brett, 2011. "Are economic trends associated with child maltreatment? Preliminary results from the recent recession using state level data," Children and Youth Services Review, Elsevier, vol. 33(7), pages 1280-1287, July.
    7. Tuchman, Ellen & Sarasohn, M. Kim, 2011. "Implementation of an evidence-based modified therapeutic community: Staff and resident perspectives," Evaluation and Program Planning, Elsevier, vol. 34(2), pages 105-112, May.
    8. Webster, Daniel & Needell, Barbara & Wildfire, Judith, 2002. "Data are Your Friends: Child Welfare Agency Self-Evaluation in Los Angeles County with the Family to Family Initiative," Children and Youth Services Review, Elsevier, vol. 24(6-7), pages 471-484.
    9. Crea, Thomas M. & Usher, Charles L. & Wildfire, Judith B., 2009. "Implementation fidelity of Team Decisionmaking," Children and Youth Services Review, Elsevier, vol. 31(1), pages 119-124, January.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Chambers, Ruth M. & Crutchfield, Rashida M. & Goddu Harper, Stephanie G. & Fatemi, Maryam & Rodriguez, Angel Y., 2018. "Family reunification in child welfare practice: A pilot study of parent and staff experiences," Children and Youth Services Review, Elsevier, vol. 91(C), pages 221-231.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Snyder, Elizabeth H. & Lawrence, C. Nicole & Dodge, Kenneth A., 2012. "The impact of system of care support in adherence to wraparound principles in Child and Family Teams in child welfare in North Carolina," Children and Youth Services Review, Elsevier, vol. 34(4), pages 639-647.
    2. Bearman, Sarah Kate & Garland, Ann F. & Schoenwald, Sonja K., 2014. "From practice to evidence in child welfare: Model specification and fidelity measurement of Team Decisionmaking," Children and Youth Services Review, Elsevier, vol. 39(C), pages 153-159.
    3. Crea, Thomas M. & Barth, Richard P. & Chintapalli, Laura K. & Buchanan, Rachel L., 2009. "The implementation and expansion of SAFE: Frontline responses and the transfer of technology to practice," Children and Youth Services Review, Elsevier, vol. 31(8), pages 903-910, August.
    4. Chambers, Ruth M. & Crutchfield, Rashida M. & Goddu Harper, Stephanie G. & Fatemi, Maryam & Rodriguez, Angel Y., 2018. "Family reunification in child welfare practice: A pilot study of parent and staff experiences," Children and Youth Services Review, Elsevier, vol. 91(C), pages 221-231.
    5. Roberts-Gray, Cynthia & Gingiss, Phyllis M. & Boerm, Melynda, 2007. "Evaluating school capacity to implement new programs," Evaluation and Program Planning, Elsevier, vol. 30(3), pages 247-257, August.
    6. Tabia Henry Akintobi & Payam Sheikhattari & Emma Shaffer & Christina L. Evans & Kathryn L. Braun & Angela U. Sy & Bibiana Mancera & Adriana Campa & Stephania T. Miller & Daniel Sarpong & Rhonda Hollid, 2021. "Community Engagement Practices at Research Centers in U.S. Minority Institutions: Priority Populations and Innovative Approaches to Advancing Health Disparities Research," IJERPH, MDPI, vol. 18(12), pages 1-14, June.
    7. Smith, Brenda D. & Kay, Emma Sophia & Womack, Bethany G., 2017. "How can county-level maltreatment report rates better inform child welfare practice?," Children and Youth Services Review, Elsevier, vol. 79(C), pages 341-347.
    8. Katrien De Cocker & Greet Cardon & Jason A. Bennie & Tracy Kolbe-Alexander & Femke De Meester & Corneel Vandelanotte, 2018. "From Evidence-Based Research to Practice-Based Evidence: Disseminating a Web-Based Computer-Tailored Workplace Sitting Intervention through a Health Promotion Organisation," IJERPH, MDPI, vol. 15(5), pages 1-11, May.
    9. Harriet Koorts & Adrian Bauman & Nancy Edwards & William Bellew & Wendy J. Brown & Mitch J. Duncan & David R. Lubans & Andrew J. Milat & Philip J. Morgan & Nicole Nathan & Andrew Searles & Karen Lee &, 2022. "Tensions and Paradoxes of Scaling Up: A Critical Reflection on Physical Activity Promotion," IJERPH, MDPI, vol. 19(21), pages 1-16, November.
    10. Chen, Huey T., 2016. "Interfacing theories of program with theories of evaluation for advancing evaluation practice: Reductionism, systems thinking, and pragmatic synthesis," Evaluation and Program Planning, Elsevier, vol. 59(C), pages 109-118.
    11. Hutto, Brent & Saunders, Ruth P. & Wilcox, Sara & Jake-Schoffman, Danielle E. & Bernhart, John A. & Dunn, Caroline G. & Kaczynski, Andrew T. & James, Katherine L., 2021. "Pathways of influences leading to adoption of the Faith, Activity and Nutrition (FAN) program in a statewide initiative," Evaluation and Program Planning, Elsevier, vol. 87(C).
    12. Glasgow, LaShawn & Adams, Elizabeth & Smith, Lucia Rojas & Renaud, Jeanette, 2020. "Key Insights on Participation Measurement from Real-world Health Care Interventions," Evaluation and Program Planning, Elsevier, vol. 78(C).
    13. Esposito, Tonino & Chabot, Martin & Rothwell, David W. & Trocmé, Nico & Delaye, Ashleigh, 2017. "Out-of-home placement and regional variations in poverty and health and social services spending: A multilevel analysis," Children and Youth Services Review, Elsevier, vol. 72(C), pages 34-43.
    14. Teutsch, Friedrich & Gugglberger, Lisa & Dür, Wolfgang, 2015. "School health promotion providers’ roles in practice and theory: Results from a case study," Health Policy, Elsevier, vol. 119(1), pages 82-87.
    15. Kennedy, Ann Blair & Schenkelberg, Michaela & Moyer, Christina & Pate, Russ & Saunders, Ruth P., 2017. "Process evaluation of a preschool physical activity intervention using web-based delivery," Evaluation and Program Planning, Elsevier, vol. 60(C), pages 24-36.
    16. Escoffery, Cam & Bundy, Lujca & Haardoerfer, Regine & Berg, Carla J. & Savas, Lara S. & Williams, Rebecca S. & Kegler, Michelle C., 2016. "A process evaluation of an intervention to promote home smoking bans among low income households," Evaluation and Program Planning, Elsevier, vol. 55(C), pages 120-125.
    17. Isokuortti, Nanne & Aaltio, Elina, 2020. "Fidelity and influencing factors in the Systemic Practice Model of children's social care in Finland," Children and Youth Services Review, Elsevier, vol. 119(C).
    18. Liliana Tenney & Amy G. Huebschmann & Carol E. Brown & Natalie V. Schwatka & Lee S. Newman, 2022. "Leveraging an Implementation Science Framework to Measure the Impact of Efforts to Scale Out a Total Worker Health ® Intervention to Employers," IJERPH, MDPI, vol. 19(3), pages 1-20, January.
    19. Rauktis, Mary E. & McCarthy, Sharon & Krackhardt, David & Cahalane, Helen, 2010. "Innovation in child welfare: The adoption and implementation of Family Group Decision Making in Pennsylvania," Children and Youth Services Review, Elsevier, vol. 32(5), pages 732-739, May.
    20. Pranpreya Sriwannawit & Ulf Sandström, 2015. "Large-scale bibliometric review of diffusion research," Scientometrics, Springer;Akadémiai Kiadó, vol. 102(2), pages 1615-1645, February.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:cysrev:v:33:y:2011:i:11:p:2273-2281. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/childyouth .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.