IDEAS home Printed from https://ideas.repec.org/a/sae/evarev/v31y2007i1p43-74.html
   My bibliography  Save this article

The Devil Is in the Details

Author

Listed:
  • Allison Gruner Gandhi

    (American Institutes for Research)

  • Erin Murphy-Graham

    (University of California, Berkeley)

  • Anthony Petrosino

    (WestEd)

  • Sara Schwartz Chrismer

    (Harvard Graduate School of Education)

  • Carol H. Weiss

    (Harvard Graduate School of Education)

Abstract

In an effort to promote evidence-based practice, government officials, researchers, and program developers have developed lists of model programs in the prevention field. This article reviews the evidence used by seven best-practice lists to select five model prevention programs. The authors’ examination of this research raises questions about the process used to identify and publicize programs as successful. They found limited evidence showing substantial impact on drug use behavior at posttest, with very few studies showing substantial impact at longer follow-ups. The authors advocate additional long-term follow-up studies and conclude by suggesting changes in the procedures for developing best-practice lists.

Suggested Citation

  • Allison Gruner Gandhi & Erin Murphy-Graham & Anthony Petrosino & Sara Schwartz Chrismer & Carol H. Weiss, 2007. "The Devil Is in the Details," Evaluation Review, , vol. 31(1), pages 43-74, February.
    • Handle: RePEc:sae:evarev:v:31:y:2007:i:1:p:43-74
    DOI: 10.1177/0193841X06287188
    as

    Download full text from publisher

    File URL: https://journals.sagepub.com/doi/10.1177/0193841X06287188
    Download Restriction: no
    File URL: https://libkey.io/10.1177/0193841X06287188?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Carol H. Weiss, 1989. "Congressional committees as users of analysis," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 8(3), pages 411-431.
    2. Ellickson, P.L. & Bell, R.M. & McGuigan, K., 1993. "Preventing adolescent drug use: Long-term results of a junior high program," American Journal of Public Health, American Public Health Association, vol. 83(6), pages 856-861.
    3. Perry, C.L. & Williams, C.L. & Veblen-Mortenson, S. & Toomey, T.L. & Komro, K.A. & Anstine, P.S. & McGovern, P.G. & Finnegan, J.R. & Forster, J.L. & Wagenaar, A.C. & Wolfson, M., 1996. "Project Northland: Outcomes of a communitywide alcohol use prevention program during early adolescence," American Journal of Public Health, American Public Health Association, vol. 86(7), pages 956-965.
    4. Gorman, D.M., 1994. "Preventing adolescent drug use: the effectiveness of Project ALERT," American Journal of Public Health, American Public Health Association, vol. 84(3), pages 500-501.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Dennis M. Gorman & J. Charles Huber Jr, 2009. "The Social Construction of ``Evidence-Based'' Drug Prevention Programs," Evaluation Review, , vol. 33(4), pages 396-414, August.
    2. Gorman, Dennis M. & Conde, Eugenia, 2010. "The making of evidence-based practice: The case of Project ALERT," Children and Youth Services Review, Elsevier, vol. 32(2), pages 214-222, February.
    3. D.M. Gorman, 1998. "The Irrelevance of Evidence in the Development of School-Based Drug Prevention Policy, 1986-1996," Evaluation Review, , vol. 22(1), pages 118-146, February.
    4. Ji Yan & Sally Brocksen, 2013. "Adolescent risk perception, substance use, and educational attainment," Journal of Risk Research, Taylor & Francis Journals, vol. 16(8), pages 1037-1055, September.
    5. Richard F. Catalano & M. Lisa Berglund & Jean A. M. Ryan & Heather S. Lonczak & J. David Hawkins, 2004. "Positive Youth Development in the United States: Research Findings on Evaluations of Positive Youth Development Programs," The ANNALS of the American Academy of Political and Social Science, , vol. 591(1), pages 98-124, January.
    6. David J. Pannell, 2004. "Effectively communicating economics to policy makers," Australian Journal of Agricultural and Resource Economics, Australian Agricultural and Resource Economics Society, vol. 48(3), pages 535-555, September.
    7. Lundin, Martin & Öberg, PerOla, 2012. "Towards reason: political disputes, public attention and the use of expert knowledge in policymaking," Working Paper Series 2012:4, IFAU - Institute for Evaluation of Labour Market and Education Policy.
    8. Eberli, Daniela, 2018. "Tracing the use of evaluations in legislative processes in Swiss cantonal parliaments," Evaluation and Program Planning, Elsevier, vol. 69(C), pages 139-147.
    9. Kimberly S. Compton & Peter Barr & Katherine J. Karriker-Jaffe & Cristina Bares & Fazil Aliev & Brian Mustanski & Danielle Dick & Karen G. Chartier, 2019. "Evaluating Neighborhood, Social, and Genetic Influences on Precursors of Alcohol Use Risk Behavior in African American Adolescents," IJERPH, MDPI, vol. 16(17), pages 1-17, August.
    10. Arthur, Michael W. & Briney, John S. & Hawkins, J. David & Abbott, Robert D. & Brooke-Weiss, Blair L. & Catalano, Richard F., 2007. "Measuring risk and protection in communities using the Communities That Care Youth Survey," Evaluation and Program Planning, Elsevier, vol. 30(2), pages 197-211, May.
    11. E. Sam Overman & Anthony G. Cahill, 1994. "Information, market government, and health policy: A study of health data organizations in the states," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 13(3), pages 435-453.
    12. Giovanni Immordino & Anna Maria C. Menichini & Maria Grazia Romano, 2020. "Taxing and Regulating Vices," Scandinavian Journal of Economics, Wiley Blackwell, vol. 122(2), pages 622-647, April.
    13. Collantes, Gustavo O, 2006. "The California Zero-Emission Vehicle Mandate: A Study of the Policy Process, 1990-2004," Institute of Transportation Studies, Working Paper Series qt9030893m, Institute of Transportation Studies, UC Davis.
    14. Pirmin Bundi & Philipp Trein, 2022. "Evaluation use and learning in public policy," Policy Sciences, Springer;Society of Policy Sciences, vol. 55(2), pages 283-309, June.
    15. Jonathan Lewallen & Sean M. Theriault & Bryan D. Jones, 2016. "Congressional dysfunction: An information processing perspective," Regulation & Governance, John Wiley & Sons, vol. 10(2), pages 179-190, June.
    16. Gorman, D. M., 2002. "Defining and operationalizing `research-based' prevention: a critique (with case studies) of the US Department of Education's Safe, Disciplined and Drug-Free Schools Exemplary Programs," Evaluation and Program Planning, Elsevier, vol. 25(3), pages 295-302, August.
    17. Dana L. Wenter, MPH & Sondra Blackwell, MEd & Kevin C. Davis, MA & Matthew C. Farrelly, PhD, 2002. "American Legacy Foundation, Using Multiple Strategies in Tobacco Use Prevention Education," University of California at San Francisco, Center for Tobacco Control Research and Education qt6bk9b677, Center for Tobacco Control Research and Education, UC San Francisco.
    18. Sechrest, Lee & Sidani, Souraya, 1995. "Quantitative and qualitative methods: : Is There an Alternative?," Evaluation and Program Planning, Elsevier, vol. 18(1), pages 77-87.
    19. Sager, Fritz, 2018. "Policy evaluation and democracy: Do they fit?," Evaluation and Program Planning, Elsevier, vol. 69(C), pages 125-129.
    20. Bundi, Pirmin, 2018. "Parliamentarians’ strategies for policy evaluations," Evaluation and Program Planning, Elsevier, vol. 69(C), pages 130-138.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:sae:evarev:v:31:y:2007:i:1:p:43-74. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: SAGE Publications (email available below). General contact details of provider: .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.