IDEAS home Printed from https://ideas.repec.org/a/eee/epplan/v55y2016icp27-34.html
   My bibliography  Save this article

Formative evaluation: Developing measures for online family mental health recovery education

Author

Listed:
  • Rue, Lisa A.
  • Estrada, Samantha
  • Floren, Michael
  • MacKinnon, Krista

Abstract

Families facing mental health challenges have very limited access to ongoing support. A formative evaluation of Families Healing Together (FHT), a new online family mental health recovery program was conducted using five waves (N=108) of data. Exploratory factor analysis of the measures identified as important to the program theory found strong reliability evidence (α=.77–.86) for 6 constructs. A poor response rate (25%) did not allow for valid pre and postoutcome evaluation, however we did have enough information to assess the psychometric properties of the new measures. The new evaluation tool accounted for 34% of the variance in Capacity to Support Family Member, and nearly 50% of the variance in Hopefulness toward Recovery. New programs without existing measures require formative evaluation strategies that accurately describe program activities in order to develop outcome measures sensitive to novel aspects of program components. Most outcome measures are developed for individuals with mental health challenges not family members. These new measures may be beneficial to effectively evaluate programs that promote family recovery and wellness.

Suggested Citation

  • Rue, Lisa A. & Estrada, Samantha & Floren, Michael & MacKinnon, Krista, 2016. "Formative evaluation: Developing measures for online family mental health recovery education," Evaluation and Program Planning, Elsevier, vol. 55(C), pages 27-34.
    • Handle: RePEc:eee:epplan:v:55:y:2016:i:c:p:27-34
    DOI: 10.1016/j.evalprogplan.2015.11.004
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0149718915001263
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.evalprogplan.2015.11.004?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Gray, Nicola J. & Klein, Jonathan D. & Noyce, Peter R. & Sesselberg, Tracy S. & Cantrill, Judith A., 2005. "Health information-seeking behaviour in adolescence: the place of the internet," Social Science & Medicine, Elsevier, vol. 60(7), pages 1467-1478, April.
    2. Louis Guttman, 1954. "Some necessary conditions for common-factor analysis," Psychometrika, Springer;The Psychometric Society, vol. 19(2), pages 149-161, June.
    3. Klaas Sijtsma, 2009. "On the Use, the Misuse, and the Very Limited Usefulness of Cronbach’s Alpha," Psychometrika, Springer;The Psychometric Society, vol. 74(1), pages 107-120, March.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Nico Migenda & Ralf Möller & Wolfram Schenck, 2021. "Adaptive dimensionality reduction for neural network-based online principal component analysis," PLOS ONE, Public Library of Science, vol. 16(3), pages 1-32, March.
    2. Anos-Casero, Paloma & Udomsaph, Charles, 2009. "What drives firm productivity growth ?," Policy Research Working Paper Series 4841, The World Bank.
    3. Gerhard Derflinger, 1984. "A loss function for alpha factor analysis," Psychometrika, Springer;The Psychometric Society, vol. 49(3), pages 325-330, September.
    4. Yoo, Sun-Young & Vonk, M. Elizabeth, 2012. "The development and initial validation of the Immigrant Parental Stress Inventory (IPSI) in a sample of Korean immigrant parents," Children and Youth Services Review, Elsevier, vol. 34(5), pages 989-998.
    5. Xiaochuan Song, 2022. "Investigating Employees’ Responses to Abusive Supervision," Merits, MDPI, vol. 2(4), pages 1-20, November.
    6. Alina Duduciuc, 2014. "Teenagers And The Use Of New Technologies (Ict) For Health Information," Studies and Scientific Researches. Economics Edition, "Vasile Alecsandri" University of Bacau, Faculty of Economic Sciences, issue 20.
    7. Carmen León-Mantero & José Carlos Casas-Rosal & Alexander Maz-Machado & Miguel E Villarraga Rico, 2020. "Analysis of attitudinal components towards statistics among students from different academic degrees," PLOS ONE, Public Library of Science, vol. 15(1), pages 1-13, January.
    8. Kevin Handtke & Lisa Richter-Beuschel & Susanne Bögeholz, 2022. "Self-Efficacy Beliefs of Teaching ESD: A Theory-Driven Instrument and the Effectiveness of ESD in German Teacher Education," Sustainability, MDPI, vol. 14(11), pages 1-32, May.
    9. Horstmann, Felix, 2017. "Measuring the shopper's attitude toward the point of sale display: Scale development and validation," Journal of Retailing and Consumer Services, Elsevier, vol. 36(C), pages 112-123.
    10. Brian K Miller & Kay M Nicols & Silvia Clark & Alison Daniels & Whitney Grant, 2018. "Meta-analysis of coefficient alpha for scores on the Narcissistic Personality Inventory," PLOS ONE, Public Library of Science, vol. 13(12), pages 1-16, December.
    11. Adam Pawlewicz & Wojciech Gotkiewicz & Katarzyna Brodzińska & Katarzyna Pawlewicz & Bartosz Mickiewicz & Paweł Kluczek, 2022. "Organic Farming as an Alternative Maintenance Strategy in the Opinion of Farmers from Natura 2000 Areas," IJERPH, MDPI, vol. 19(7), pages 1-22, March.
    12. Klaas Sijtsma & Jules L. Ellis & Denny Borsboom, 2024. "Recognize the Value of the Sum Score, Psychometrics’ Greatest Accomplishment," Psychometrika, Springer;The Psychometric Society, vol. 89(1), pages 84-117, March.
    13. Jaung, Wanggi & Putzel, Louis & Bull, Gary Q. & Kozak, Robert & Markum,, 2016. "Certification of forest watershed services: A Q methodology analysis of opportunities and challenges in Lombok, Indonesia," Ecosystem Services, Elsevier, vol. 22(PA), pages 51-59.
    14. Chun, JongSerl & Kim, Jinyung & Lee, Serim, 2023. "Development of a cyberbullying victimization scale for adolescents in South Korea," Children and Youth Services Review, Elsevier, vol. 144(C).
    15. Philip DuBois, 1960. "An analysis of Guttman's simplex," Psychometrika, Springer;The Psychometric Society, vol. 25(2), pages 173-182, June.
    16. Trucíos, Carlos & Hotta, Luiz K. & Valls Pereira, Pedro L., 2019. "On the robustness of the principal volatility components," Journal of Empirical Finance, Elsevier, vol. 52(C), pages 201-219.
    17. Christina Chiang & Paul K. Wells & Peter Fieger & Divesh S. Sharma, 2021. "An investigation into student satisfaction, approaches to learning and the learning context in Auditing," Accounting and Finance, Accounting and Finance Association of Australia and New Zealand, vol. 61(1), pages 913-936, March.
    18. James Arthur & Stephen R. Earl & Aidan P. Thompson & Joseph W. Ward, 2021. "The Value of Character-Based Judgement in the Professional Domain," Journal of Business Ethics, Springer, vol. 169(2), pages 293-308, March.
    19. Michael Hennessy & Amy Bleakley & Martin Fishbein, 2012. "Measurement Models for Reasoned Action Theory," The ANNALS of the American Academy of Political and Social Science, , vol. 640(1), pages 42-57, March.
    20. Carlos Trucíos & Mauricio Zevallos & Luiz K. Hotta & André A. P. Santos, 2019. "Covariance Prediction in Large Portfolio Allocation," Econometrics, MDPI, vol. 7(2), pages 1-24, May.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:epplan:v:55:y:2016:i:c:p:27-34. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/evalprogplan .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.