IDEAS home Printed from https://ideas.repec.org/a/eee/epplan/v55y2016icp27-34.html
   My bibliography  Save this article

Formative evaluation: Developing measures for online family mental health recovery education

Author

Listed:
  • Rue, Lisa A.
  • Estrada, Samantha
  • Floren, Michael
  • MacKinnon, Krista

Abstract

Families facing mental health challenges have very limited access to ongoing support. A formative evaluation of Families Healing Together (FHT), a new online family mental health recovery program was conducted using five waves (N=108) of data. Exploratory factor analysis of the measures identified as important to the program theory found strong reliability evidence (α=.77–.86) for 6 constructs. A poor response rate (25%) did not allow for valid pre and postoutcome evaluation, however we did have enough information to assess the psychometric properties of the new measures. The new evaluation tool accounted for 34% of the variance in Capacity to Support Family Member, and nearly 50% of the variance in Hopefulness toward Recovery. New programs without existing measures require formative evaluation strategies that accurately describe program activities in order to develop outcome measures sensitive to novel aspects of program components. Most outcome measures are developed for individuals with mental health challenges not family members. These new measures may be beneficial to effectively evaluate programs that promote family recovery and wellness.

Suggested Citation

  • Rue, Lisa A. & Estrada, Samantha & Floren, Michael & MacKinnon, Krista, 2016. "Formative evaluation: Developing measures for online family mental health recovery education," Evaluation and Program Planning, Elsevier, vol. 55(C), pages 27-34.
    • Handle: RePEc:eee:epplan:v:55:y:2016:i:c:p:27-34
    DOI: 10.1016/j.evalprogplan.2015.11.004
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0149718915001263
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.evalprogplan.2015.11.004?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Klaas Sijtsma, 2009. "On the Use, the Misuse, and the Very Limited Usefulness of Cronbach’s Alpha," Psychometrika, Springer;The Psychometric Society, vol. 74(1), pages 107-120, March.
    2. Louis Guttman, 1954. "Some necessary conditions for common-factor analysis," Psychometrika, Springer;The Psychometric Society, vol. 19(2), pages 149-161, June.
    3. Gray, Nicola J. & Klein, Jonathan D. & Noyce, Peter R. & Sesselberg, Tracy S. & Cantrill, Judith A., 2005. "Health information-seeking behaviour in adolescence: the place of the internet," Social Science & Medicine, Elsevier, vol. 60(7), pages 1467-1478, April.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. GUO-FITOUSSI, Liang, 2013. "A Comparison of the Finite Sample Properties of Selection Rules of Factor Numbers in Large Datasets," MPRA Paper 50005, University Library of Munich, Germany.
    2. Louis Guttman, 1955. "A generalized simplex for factor analysis," Psychometrika, Springer;The Psychometric Society, vol. 20(3), pages 173-192, September.
    3. Nico Migenda & Ralf Möller & Wolfram Schenck, 2021. "Adaptive dimensionality reduction for neural network-based online principal component analysis," PLOS ONE, Public Library of Science, vol. 16(3), pages 1-32, March.
    4. Anos-Casero, Paloma & Udomsaph, Charles, 2009. "What drives firm productivity growth ?," Policy Research Working Paper Series 4841, The World Bank.
    5. Conzo, Pierluigi & Aassve, Arnstein & Fuochi, Giulia & Mencarini, Letizia, 2017. "The cultural foundations of happiness," Journal of Economic Psychology, Elsevier, vol. 62(C), pages 268-283.
    6. Gerhard Derflinger, 1984. "A loss function for alpha factor analysis," Psychometrika, Springer;The Psychometric Society, vol. 49(3), pages 325-330, September.
    7. Taiki Yoshida & Yohei Otaka & Shin Kitamura & Kazuki Ushizawa & Masashi Kumagai & Yuto Kurihara & Jun Yaeda & Rieko Osu, 2022. "Development and validation of new evaluation scale for measuring stroke patients’ motivation for rehabilitation in rehabilitation wards," PLOS ONE, Public Library of Science, vol. 17(3), pages 1-17, March.
    8. Kate Elizabeth Gannon, Mike Hulme, 2017. "Geoengineering at the ‘edge of the world’: exploring perceptions of ocean fertilization through the Haida Salmon Restoration Corporation," GRI Working Papers 280, Grantham Research Institute on Climate Change and the Environment.
    9. Trucíos, Carlos & Mazzeu, João H.G. & Hotta, Luiz K. & Valls Pereira, Pedro L. & Hallin, Marc, 2021. "Robustness and the general dynamic factor model with infinite-dimensional space: Identification, estimation, and forecasting," International Journal of Forecasting, Elsevier, vol. 37(4), pages 1520-1534.
    10. Yoo, Sun-Young & Vonk, M. Elizabeth, 2012. "The development and initial validation of the Immigrant Parental Stress Inventory (IPSI) in a sample of Korean immigrant parents," Children and Youth Services Review, Elsevier, vol. 34(5), pages 989-998.
    11. Xiaochuan Song, 2022. "Investigating Employees’ Responses to Abusive Supervision," Merits, MDPI, vol. 2(4), pages 1-20, November.
    12. Oscar Claveria & Enric Monte & Salvador Torra, 2017. "A new approach for the quantification of qualitative measures of economic expectations," Quality & Quantity: International Journal of Methodology, Springer, vol. 51(6), pages 2685-2706, November.
    13. Alina Duduciuc, 2014. "Teenagers And The Use Of New Technologies (Ict) For Health Information," Studies and Scientific Researches. Economics Edition, "Vasile Alecsandri" University of Bacau, Faculty of Economic Sciences, issue 20.
    14. Carmen León-Mantero & José Carlos Casas-Rosal & Alexander Maz-Machado & Miguel E Villarraga Rico, 2020. "Analysis of attitudinal components towards statistics among students from different academic degrees," PLOS ONE, Public Library of Science, vol. 15(1), pages 1-13, January.
    15. Kevin Handtke & Lisa Richter-Beuschel & Susanne Bögeholz, 2022. "Self-Efficacy Beliefs of Teaching ESD: A Theory-Driven Instrument and the Effectiveness of ESD in German Teacher Education," Sustainability, MDPI, vol. 14(11), pages 1-32, May.
    16. Horstmann, Felix, 2017. "Measuring the shopper's attitude toward the point of sale display: Scale development and validation," Journal of Retailing and Consumer Services, Elsevier, vol. 36(C), pages 112-123.
    17. Danni Liu & Anouk Dijk & Shanyan Lin & Zhenhong Wang & Maja Deković & Judith Semon Dubas, 2023. "Psychometric Properties of the Chinese Version of the Highly Sensitive Child Scale Across Age Groups, Gender, and Informants," Child Indicators Research, Springer;The International Society of Child Indicators (ISCI), vol. 16(4), pages 1755-1780, August.
    18. Brian K Miller & Kay M Nicols & Silvia Clark & Alison Daniels & Whitney Grant, 2018. "Meta-analysis of coefficient alpha for scores on the Narcissistic Personality Inventory," PLOS ONE, Public Library of Science, vol. 13(12), pages 1-16, December.
    19. Adam Pawlewicz & Wojciech Gotkiewicz & Katarzyna Brodzińska & Katarzyna Pawlewicz & Bartosz Mickiewicz & Paweł Kluczek, 2022. "Organic Farming as an Alternative Maintenance Strategy in the Opinion of Farmers from Natura 2000 Areas," IJERPH, MDPI, vol. 19(7), pages 1-22, March.
    20. Klaas Sijtsma & Jules L. Ellis & Denny Borsboom, 2024. "Recognize the Value of the Sum Score, Psychometrics’ Greatest Accomplishment," Psychometrika, Springer;The Psychometric Society, vol. 89(1), pages 84-117, March.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:epplan:v:55:y:2016:i:c:p:27-34. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/evalprogplan .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.