IDEAS home Printed from https://ideas.repec.org/a/eee/epplan/v94y2022ics0149718922001045.html
   My bibliography  Save this article

Assessing the fidelity of delivery style of a mental skills training programme for young people experiencing homelessness

Author

Listed:
  • Tidmarsh, Grace
  • Whiting, Richard
  • Thompson, Janice L.
  • Cumming, Jennifer

Abstract

There is a need for positive youth development/strengths-based approaches to support the wellbeing and social inclusion of young people experiencing or at risk of homelessness. My Strengths Training for Life™ (MST4Life™) uses a strengths-based approach with the aim to improve young people’s resilience, self-worth, wellbeing and engagement in education, employment, and training. This mixed methods study assessed the fidelity of delivery style of the MST4Life™ programme, the extent to which frontline service staff can delivery psychologically informed programmes to service users and identified barriers and enablers to delivering with fidelity to the intended style. Observations of programme delivery (two facilitators per session) took place across early, middle, and late phases of the programme across a pilot phase (n = 18) and main study (n = 45). Facilitators also completed self-reflection forms following each session. The mean observation score was 82.2 ± 15.7 %, and facilitator self-report mean adherence score was 89.3 ± 6.2 % which indicate that the programme was delivered with high fidelity. Quantitative data was also analysed using non-parametric statistical test (Mann-Whitney U Test). There was a significant difference between observation scores for deliverers with postgraduate psychology training compared to deliverers without postgraduate psychology training (p = .029). Qualitative data were analysed using inductive thematic analysis. Barriers and enablers included communication, frontline staff support, logistics, and participant behaviours. Overall, this study highlights that despite the challenges of delivering complex community programmes to young people experiencing homelessness, it was possible for frontline service staff to deliver MST4Life™ with high fidelity.

Suggested Citation

  • Tidmarsh, Grace & Whiting, Richard & Thompson, Janice L. & Cumming, Jennifer, 2022. "Assessing the fidelity of delivery style of a mental skills training programme for young people experiencing homelessness," Evaluation and Program Planning, Elsevier, vol. 94(C).
    • Handle: RePEc:eee:epplan:v:94:y:2022:i:c:s0149718922001045
    DOI: 10.1016/j.evalprogplan.2022.102150
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0149718922001045
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.evalprogplan.2022.102150?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Dobson, Douglas & Cook, Thomas J., 1980. "Avoiding type III error in program evaluation : Results from a field experiment," Evaluation and Program Planning, Elsevier, vol. 3(4), pages 269-276, January.
    2. DenYelle Baete Kenyon & Tracey R. McMahon & Anna Simonson & Char Green-Maximo & Ashley Schwab & Melissa Huff & Renee E. Sieving, 2019. "My Journey : Development and Practice-Based Evidence of a Culturally Attuned Teen Pregnancy Prevention Program for Native Youth," IJERPH, MDPI, vol. 16(3), pages 1-24, February.
    3. Cumming, Jennifer & Whiting, Richard & Parry, Benjamin J. & Clarke, Fiona J. & Holland, Mark J.G. & Cooley, Sam J. & Quinton, Mary L., 2022. "The My Strengths Training for Life™ program: Rationale, logic model, and description of a strengths-based intervention for young people experiencing homelessness," Evaluation and Program Planning, Elsevier, vol. 91(C).
    4. Iachini, Aidyn L. & Beets, Michael W. & Ball, Annahita & Lohman, Mary, 2014. "Process evaluation of “Girls on the Run”: Exploring implementation in a physical activity-based positive youth development program," Evaluation and Program Planning, Elsevier, vol. 46(C), pages 1-9.
    5. Parry, Benjamin J. & Quinton, Mary L. & Holland, Mark J.G. & Thompson, Janice L. & Cumming, Jennifer, 2021. "Improving outcomes in young people experiencing homelessness with My Strengths Training for Life™ (MST4Life™): A qualitative realist evaluation," Children and Youth Services Review, Elsevier, vol. 121(C).
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Flierman, Monique & Vriend, Eline & Leemhuis, Aleid G. & Engelbert, Raoul H.H. & Jeukens-Visser, Martine, 2023. "Development and evaluation of a fidelity tool in a post-discharge responsive parenting intervention program for very preterm born children," Evaluation and Program Planning, Elsevier, vol. 99(C).
    2. Mary L. Quinton & Grace Tidmarsh & Benjamin J. Parry & Jennifer Cumming, 2022. "A Kirkpatrick Model Process Evaluation of Reactions and Learning from My Strengths Training for Life™," IJERPH, MDPI, vol. 19(18), pages 1-15, September.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Jennifer Cumming & Fiona J. Clarke & Mark J. G. Holland & Benjamin J. Parry & Mary L. Quinton & Sam J. Cooley, 2022. "A Feasibility Study of the My Strengths Training for Life™ (MST4Life™) Program for Young People Experiencing Homelessness," IJERPH, MDPI, vol. 19(6), pages 1-17, March.
    2. Mary L. Quinton & Grace Tidmarsh & Benjamin J. Parry & Jennifer Cumming, 2022. "A Kirkpatrick Model Process Evaluation of Reactions and Learning from My Strengths Training for Life™," IJERPH, MDPI, vol. 19(18), pages 1-15, September.
    3. Thomas, Rebecca L. & Chiarelli-Helminiak, Christina M. & Ferraj, Brunilda & Barrette, Kyle, 2016. "Building relationships and facilitating immigrant community integration: An evaluation of a Cultural Navigator Program," Evaluation and Program Planning, Elsevier, vol. 55(C), pages 77-84.
    4. Ullrich-French, Sarah & Cole, Amy N. & Montgomery, Anna K., 2016. "Evaluation development for a physical activity positive youth development program for girls," Evaluation and Program Planning, Elsevier, vol. 55(C), pages 67-76.
    5. Sarah Avellar & Diane Paulsell, "undated". "Lessons Learned from the Home Visiting Evidence of Effectiveness Review," Mathematica Policy Research Reports ff3a4a4ffd574ae0805ac5723, Mathematica Policy Research.
    6. Humphreys, David K. & Eisner, Manuel P., 2014. "Do flexible alcohol trading hours reduce violence? A theory-based natural experiment in alcohol policy," Social Science & Medicine, Elsevier, vol. 102(C), pages 1-9.
    7. Kalafat, John & Illback, Robert J. & Sanders, Daniel Jr., 2007. "The relationship between implementation fidelity and educational outcomes in a school-based family support program: Development of a model for evaluating multidimensional full-service programs," Evaluation and Program Planning, Elsevier, vol. 30(2), pages 136-148, May.
    8. Cumming, Jennifer & Whiting, Richard & Parry, Benjamin J. & Clarke, Fiona J. & Holland, Mark J.G. & Cooley, Sam J. & Quinton, Mary L., 2022. "The My Strengths Training for Life™ program: Rationale, logic model, and description of a strengths-based intervention for young people experiencing homelessness," Evaluation and Program Planning, Elsevier, vol. 91(C).
    9. Escribano, Silvia & Espada, José P. & Orgilés, Mireia & Morales, Alexandra, 2016. "Implementation fidelity for promoting the effectiveness of an adolescent sexual health program," Evaluation and Program Planning, Elsevier, vol. 59(C), pages 81-87.
    10. Eva Lantos Rezmovic, 1984. "Assessing Treatment Implementation Amid the Slings and Arrows of Reality," Evaluation Review, , vol. 8(2), pages 187-204, April.
    11. Iachini, A.L. & DeHart, D.D. & McLeer, J. & Hock, R. & Browne, T. & Clone, S., 2015. "Facilitators and barriers to interagency collaboration in mother–child residential substance abuse treatment programs," Children and Youth Services Review, Elsevier, vol. 53(C), pages 176-184.
    12. Akin, Becci A. & Bryson, Stephanie A. & Testa, Mark F. & Blase, Karen A. & McDonald, Tom & Melz, Heidi, 2013. "Usability testing, initial implementation, and formative evaluation of an evidence-based intervention: Lessons from a demonstration project to reduce long-term foster care," Evaluation and Program Planning, Elsevier, vol. 41(C), pages 19-30.
    13. Louise Schinckus & Stephan Van den Broucke & Gerard van der Zanden & Diane Levin-Zamir & Gabriele Mueller & Henna Riemenschneider & Victoria Hayter & Lucy Yardley & Dean Schillinger & Gerardine Doyle , 2021. "To Adapt or Not to Adapt: The Association between Implementation Fidelity and the Effectiveness of Diabetes Self-Management Education," IJERPH, MDPI, vol. 18(8), pages 1-15, April.
    14. Umit Shrestha & Jessica Hanson & Tess Weber & Karen Ingersoll, 2019. "Community Perceptions of Alcohol Exposed Pregnancy Prevention Program for American Indian and Alaska Native Teens," IJERPH, MDPI, vol. 16(10), pages 1-12, May.
    15. repec:wly:camsys:v:7:y:2011:i:1:p:1-38:c is not listed on IDEAS
    16. Loubna Belaid & Magalie Benoit & Navdeep Kaur & Azari Lili & Valery Ridde, 2020. "Population Health Intervention Implementation Among Migrants With Precarious Status in Montreal: Underlying Theory and Key Challenges," SAGE Open, , vol. 10(2), pages 21582440209, May.
    17. Amanda Fernandes & Mònica Ubalde-López & Tiffany C. Yang & Rosemary R. C. McEachan & Rukhsana Rashid & Léa Maitre & Mark J. Nieuwenhuijsen & Martine Vrijheid, 2023. "School-Based Interventions to Support Healthy Indoor and Outdoor Environments for Children: A Systematic Review," IJERPH, MDPI, vol. 20(3), pages 1-24, January.
    18. Fleuren, Margot A.H. & van Dommelen, Paula & Dunnink, Trudy, 2015. "A systematic approach to implementing and evaluating clinical guidelines: The results of fifteen years of Preventive Child Health Care guidelines in the Netherlands," Social Science & Medicine, Elsevier, vol. 136, pages 35-43.
    19. Courtney T. Luecking & Cody D. Neshteruk & Stephanie Mazzucca & Dianne S. Ward, 2021. "Efficacy of an Enhanced Implementation Strategy to Increase Parent Engagement with a Health Promotion Program in Childcare," IJERPH, MDPI, vol. 19(1), pages 1-15, December.
    20. repec:mpr:mprres:7046 is not listed on IDEAS
    21. Gifford, Elizabeth J. & Wells, Rebecca S. & Bai, Yu & Malone, Patrick S., 2015. "Is implementation fidelity associated with improved access to care in a School-based Child and Family Team model?," Evaluation and Program Planning, Elsevier, vol. 49(C), pages 41-49.
    22. Finn-Aage Esbensen & Kristy N. Matsuda & Terrance J. Taylor & Dana Peterson, 2011. "Multimethod Strategy for Assessing Program Fidelity: The National Evaluation of the Revised G.R.E.A.T. Program," Evaluation Review, , vol. 35(1), pages 14-39, February.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:epplan:v:94:y:2022:i:c:s0149718922001045. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/evalprogplan .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.