IDEAS home Printed from https://ideas.repec.org/a/sae/anname/v678y2018i1p180-191.html
   My bibliography  Save this article

Evidence-Based Policy in the Real World: A Cautionary View

Author

Listed:
  • Adam Gamoran

Abstract

The evidence movement has attended more to improving the supply of evidence than to increasing demand, so even as rigorous evidence production has increased, the use of evidence remains all too rare. A growing body of research indicates that the quality of relationships between researchers, policy-makers, and intermediaries plays a central role in whether rigorous evidence informs decisions in policy and practice. Creating structures to support such relationships remains a major challenge. Yet even when high-quality evidence is used, the intended benefits may not ensue because of broader challenges in society at large. Consequently, we should temper our expectations for the benefits of evidence-based policymaking, but not give up the effort.

Suggested Citation

  • Adam Gamoran, 2018. "Evidence-Based Policy in the Real World: A Cautionary View," The ANNALS of the American Academy of Political and Social Science, , vol. 678(1), pages 180-191, July.
    • Handle: RePEc:sae:anname:v:678:y:2018:i:1:p:180-191
    DOI: 10.1177/0002716218770138
    as

    Download full text from publisher

    File URL: https://journals.sagepub.com/doi/10.1177/0002716218770138
    Download Restriction: no
    File URL: https://libkey.io/10.1177/0002716218770138?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Michael J. Weiss & Howard S. Bloom & Thomas Brock, 2014. "A Conceptual Framework For Studying The Sources Of Variation In Program Effects," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 33(3), pages 778-808, June.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Larry L. Orr, 2018. "The Role of Evaluation in Building Evidence-Based Policy," The ANNALS of the American Academy of Political and Social Science, , vol. 678(1), pages 51-59, July.
    2. Vivian Tseng & Angela Bednarek & Kristy Faccer, 2022. "How can funders promote the use of research? Three converging views on relational research," Palgrave Communications, Palgrave Macmillan, vol. 9(1), pages 1-11, December.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Benjamin Lu & Eli Ben-Michael & Avi Feller & Luke Miratrix, 2023. "Is It Who You Are or Where You Are? Accounting for Compositional Differences in Cross-Site Treatment Effect Variation," Journal of Educational and Behavioral Statistics, , vol. 48(4), pages 420-453, August.
    2. Elizabeth Tipton & Robert B. Olsen, "undated". "Enhancing the Generalizability of Impact Studies in Education," Mathematica Policy Research Reports 35d5625333dc480aba9765b3b, Mathematica Policy Research.
    3. Xu Qin & Jonah Deutsch & Guanglei Hong, 2021. "Unpacking Complex Mediation Mechanisms And Their Heterogeneity Between Sites In A Job Corps Evaluation," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 40(1), pages 158-190, January.
    4. Christopher Rhoads, 2017. "Coherent Power Analysis in Multilevel Studies Using Parameters From Surveys," Journal of Educational and Behavioral Statistics, , vol. 42(2), pages 166-194, April.
    5. Buhl-Wiggers, Julie & Kerwin, Jason T. & Muñoz-Morales, Juan & Smith, Jeffrey & Thornton, Rebecca, 2024. "Some children left behind: Variation in the effects of an educational intervention," Journal of Econometrics, Elsevier, vol. 243(1).
    6. Sarah Dolfin & Nan Maxwell & Ankita Patnaik, "undated". "WHD Compliance Strategies: Directions for Future Research," Mathematica Policy Research Reports b7a5ca876e0b448f9b9c0850e, Mathematica Policy Research.
    7. Omar Al-Ubaydli & John List & Dana Suskind, 2019. "The science of using science: Towards an understanding of the threats to scaling experiments," Artefactual Field Experiments 00670, The Field Experiments Website.
    8. Esterling, Kevin & Brady, David & Schwitzgebel, Eric, 2021. "The Necessity of Construct and External Validity for Generalized Causal Claims," OSF Preprints 2s8w5, Center for Open Science.
    9. Robert C. Granger, 2018. "The Roles Foundations Are Playing in the Evidence-Based Policy Movement," The ANNALS of the American Academy of Political and Social Science, , vol. 678(1), pages 145-154, July.
    10. Esterling, Kevin M. & Brady, David & Schwitzgebel, Eric, 2023. "The Necessity of Construct and External Validity for Generalized Causal Claims," I4R Discussion Paper Series 18, The Institute for Replication (I4R).
    11. Trang Quynh Nguyen & Benjamin Ackerman & Ian Schmid & Stephen R Cole & Elizabeth A Stuart, 2018. "Sensitivity analyses for effect modifiers not observed in the target population when generalizing treatment effects from a randomized controlled trial: Assumptions, models, effect scales, data scenari," PLOS ONE, Public Library of Science, vol. 13(12), pages 1-17, December.
    12. Rafael Quintana, 2023. "Embracing complexity in social science research," Quality & Quantity: International Journal of Methodology, Springer, vol. 57(1), pages 15-38, February.
    13. Robert Ammerman & Anne Duggan & John List & Lauren Supplee & Dana Suskind, 2021. "The role of open science practices in scaling evidence-based prevention programs," Natural Field Experiments 00741, The Field Experiments Website.
    14. Nianbo Dong & Benjamin M. Kelcey, 2020. "A Review of Causality in a Social World: Moderation, Mediation, and Spill-Over," Journal of Educational and Behavioral Statistics, , vol. 45(3), pages 374-378, June.
    15. Jeffrey Smith, 2022. "Treatment Effect Heterogeneity," Evaluation Review, , vol. 46(5), pages 652-677, October.
    16. Philip M. Gleason, "undated". "What's the Secret Ingredient? Searching for Policies and Practices that Make Charter Schools Successful," Mathematica Policy Research Reports eea6e24d9bf1409f92f60ae29, Mathematica Policy Research.
    17. Rebecca Maynard, 2024. "Improving the Usefulness and Use of Meta-Analysis to Inform Policy and Practice," Evaluation Review, , vol. 48(3), pages 515-543, June.
    18. Xu Qin & Guanglei Hong, 2017. "A Weighting Method for Assessing Between-Site Heterogeneity in Causal Mediation Mechanism," Journal of Educational and Behavioral Statistics, , vol. 42(3), pages 308-340, June.
    19. Jason Shumberger & Akheil Singla, 2022. "Are tax and expenditure limitations constraining institutions or institutionally irrelevant? Evidence from Minnesota," Public Budgeting & Finance, Wiley Blackwell, vol. 42(4), pages 3-33, December.
    20. Howard S. Bloom & Rebecca Unterman & Pei Zhu & Sean F. Reardon, 2020. "Lessons from New York City's Small Schools of Choice about High School Features that Promote Graduation for Disadvantaged Students," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 39(3), pages 740-771, June.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:sae:anname:v:678:y:2018:i:1:p:180-191. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: SAGE Publications (email available below). General contact details of provider: .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.