IDEAS home Printed from https://ideas.repec.org/a/eee/epplan/v35y2012i1p105-112.html
   My bibliography  Save this article

Using agency data for evidence-based programming: A university–agency collaboration

Author

Listed:
  • Fitch, Dale
  • Grogan-Kaylor, Andrew

Abstract

Agencies providing residential treatment are encouraged, or even mandated, to collect outcomes data and to implement evidence based practices, yet little guidance has been provided on how to do so using agency administrative data that are collected on an ongoing basis. We examined data on Child and Adolescent Functional Assessment Scale (CAFAS) scores for 1608 admissions to a residential treatment center from 2002 through 2008. CAFAS scores were measured every 90 days, providing multiple CAFAS scores for each individual. Results demonstrated that on average residents improved in functioning over time. Sensitive to the evolving needs of residents who had been entering the program, the treatment center made significant program changes in 2006 to attempt to better serve residents through a broad array of specialized programming. Compared to the overall results, the analysis suggested that residents who entered the program since October 2006 appeared to have made larger improvements in their CAFAS scores. Results were derived by employing multilevel models appropriate for estimating growth trajectories with repeated measures data. Conversations with agency staff suggested that using administrative data, and advanced statistical models, were extremely helpful for organizational decision making and evidence-based programming.

Suggested Citation

  • Fitch, Dale & Grogan-Kaylor, Andrew, 2012. "Using agency data for evidence-based programming: A university–agency collaboration," Evaluation and Program Planning, Elsevier, vol. 35(1), pages 105-112.
    • Handle: RePEc:eee:epplan:v:35:y:2012:i:1:p:105-112
    DOI: 10.1016/j.evalprogplan.2011.08.004
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0149718911000735
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.evalprogplan.2011.08.004?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Joshua M. Epstein, 2008. "Why Model?," Journal of Artificial Societies and Social Simulation, Journal of Artificial Societies and Social Simulation, vol. 11(4), pages 1-12.
    2. Hoffmann, F. L. & Leckman, E. & Russo, N. & Knauf, L., 1999. "In it for the long haul: the integration of outcomes assessment, clinical services, and management decision-making," Evaluation and Program Planning, Elsevier, vol. 22(2), pages 211-219, May.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Bastiaanssen, Inge L.W. & Delsing, Marc J.M.H. & Kroes, Gert & Engels, Rutger C.M.E. & Veerman, Jan W., 2014. "Group care worker interventions and child problem behavior in residential youth care: Course and bidirectional associations," Children and Youth Services Review, Elsevier, vol. 39(C), pages 48-56.
    2. Rosanbalm, Katie D. & Snyder, Elizabeth H. & Lawrence, C. Nicole & Coleman, Kanisha & Frey, Joseph J. & van den Ende, Johanna B. & Dodge, Kenneth A., 2016. "Child wellbeing assessment in child welfare: A review of four measures," Children and Youth Services Review, Elsevier, vol. 68(C), pages 1-16.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Jakub Bijak & Jason D. Hilton & Eric Silverman & Viet Dung Cao, 2013. "Reforging the Wedding Ring," Demographic Research, Max Planck Institute for Demographic Research, Rostock, Germany, vol. 29(27), pages 729-766.
    2. Jakobsson, Kristofer & Söderbergh, Bengt & Snowden, Simon & Aleklett, Kjell, 2014. "Bottom-up modeling of oil production: A review of approaches," Energy Policy, Elsevier, vol. 64(C), pages 113-123.
    3. Rixen, Martin & Weigand, Jürgen, 2014. "Agent-based simulation of policy induced diffusion of smart meters," Technological Forecasting and Social Change, Elsevier, vol. 85(C), pages 153-167.
    4. Siegmeier, Torsten & Blumenstein, Benjamin & Möller, Detlev, 2015. "Farm biogas production in organic agriculture: System implications," Agricultural Systems, Elsevier, vol. 139(C), pages 196-209.
    5. Hardt, Lukas & O'Neill, Daniel W., 2017. "Ecological Macroeconomic Models: Assessing Current Developments," Ecological Economics, Elsevier, vol. 134(C), pages 198-211.
    6. Felipe Hernández Crespo, 2014. "Modelos mentales y sistemas multiagentes: Gobernanza de la pesca en el corregimiento de Barú," Revista Economía y Región, Universidad Tecnológica de Bolívar, vol. 8(2), pages 139-156, December.
    7. Borg, Audun & Paulsen Husted, Bjarne & Njå, Ove, 2014. "The concept of validation of numerical models for consequence analysis," Reliability Engineering and System Safety, Elsevier, vol. 125(C), pages 36-45.
    8. Nicholas S. Thompson & Patrick Derr, 2009. "Contra Epstein, Good Explanations Predict," Journal of Artificial Societies and Social Simulation, Journal of Artificial Societies and Social Simulation, vol. 12(1), pages 1-9.
    9. Ozge Dilaver, 2015. "From Participants to Agents: Grounded Simulation as a Mixed-Method Research Design," Journal of Artificial Societies and Social Simulation, Journal of Artificial Societies and Social Simulation, vol. 18(1), pages 1-15.
    10. Wells, Victoria K. & Gregory Smith, Diana & Taheri, Babak & Manika, Danae & McCowlen, Clair, 2016. "An exploration of CSR development in heritage tourism," Annals of Tourism Research, Elsevier, vol. 58(C), pages 1-17.
    11. Rolf Barth & Matthias Meyer & Jan Spitzner, 2012. "Typical Pitfalls of Simulation Modeling - Lessons Learned from Armed Forces and Business," Journal of Artificial Societies and Social Simulation, Journal of Artificial Societies and Social Simulation, vol. 15(2), pages 1-5.
    12. Lang, J.C. & De Sterck, H., 2014. "The Arab Spring: A simple compartmental model for the dynamics of a revolution," Mathematical Social Sciences, Elsevier, vol. 69(C), pages 12-21.
    13. Pawel Sobkowicz, 2009. "Modelling Opinion Formation with Physics Tools: Call for Closer Link with Reality," Journal of Artificial Societies and Social Simulation, Journal of Artificial Societies and Social Simulation, vol. 12(1), pages 1-11.
    14. Schalock, Robert L. & Bonham, Gordon S., 2003. "Measuring outcomes and managing for results," Evaluation and Program Planning, Elsevier, vol. 26(3), pages 229-235, August.
    15. Sobkowicz, Pawel, 2016. "Agent based model of effects of task allocation strategies in flat organizations," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 458(C), pages 17-30.
    16. Alexandre Flávio Silva Andrada, 2014. "Um Estudo Do Discurso Doutrinário De Robert E. Lucas Jr. Método E História Das Ideias Acerca Das Análises De Ciclos Econômicos," Anais do XLI Encontro Nacional de Economia [Proceedings of the 41st Brazilian Economics Meeting] 005, ANPEC - Associação Nacional dos Centros de Pós-Graduação em Economia [Brazilian Association of Graduate Programs in Economics].
    17. Bruce Edmonds, 2010. "Bootstrapping Knowledge About Social Phenomena Using Simulation Models," Journal of Artificial Societies and Social Simulation, Journal of Artificial Societies and Social Simulation, vol. 13(1), pages 1-8.
    18. Ammar Malik & Andrew Crooks & Hilton Root & Melanie Swartz, 2015. "Exploring Creativity and Urban Development with Agent-Based Modeling," Journal of Artificial Societies and Social Simulation, Journal of Artificial Societies and Social Simulation, vol. 18(2), pages 1-12.
    19. Lawlor, Jennifer A. & McGirr, Sara, 2017. "Agent-based modeling as a tool for program design and evaluation," Evaluation and Program Planning, Elsevier, vol. 65(C), pages 131-138.
    20. Sara McPhee-Knowles, 2015. "Growing Food Safety from the Bottom Up: An Agent-Based Model of Food Safety Inspections," Journal of Artificial Societies and Social Simulation, Journal of Artificial Societies and Social Simulation, vol. 18(2), pages 1-9.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:epplan:v:35:y:2012:i:1:p:105-112. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/evalprogplan .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.