IDEAS home Printed from https://ideas.repec.org/a/eee/epplan/v79y2020ics0149718919302605.html
   My bibliography  Save this article

A scoping review of knowledge syntheses in the field of evaluation across four decades of practice

Author

Listed:
  • Lawarée, Justin
  • Jacob, Steve
  • Ouimet, Mathieu

Abstract

This scoping review of 62 knowledge syntheses published in evaluation-focused journals between 1979 and May 2018 provides a portrait of synthesis practices and their evolution in the mainstream of the field of evaluation. Concerns surrounding the production of knowledge syntheses to answer policy questions are not new in the field of evaluation. However, during this last decade, knowledge synthesis methods have expanded as a means to go beyond the limits and constraints of singular evaluations. This scoping review reveals and discusses two key issues with regards to the expansion of knowledge synthesis practices within the field of evaluation: the diversity—and muddling— of methodological practices and synthesis designs, and the frequent omission of quality appraisals.

Suggested Citation

  • Lawarée, Justin & Jacob, Steve & Ouimet, Mathieu, 2020. "A scoping review of knowledge syntheses in the field of evaluation across four decades of practice," Evaluation and Program Planning, Elsevier, vol. 79(C).
    • Handle: RePEc:eee:epplan:v:79:y:2020:i:c:s0149718919302605
    DOI: 10.1016/j.evalprogplan.2019.101761
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0149718919302605
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.evalprogplan.2019.101761?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Lorthios-Guilledroit, Agathe & Richard, Lucie & Filiatrault, Johanne, 2018. "Factors associated with the implementation of community-based peer-led health promotion programs: A scoping review," Evaluation and Program Planning, Elsevier, vol. 68(C), pages 19-33.
    2. Kate Williams & Jonathan Grant, 2018. "A comparative review of how the policy and procedures to assess research impact evolved in Australia and the UK," Research Evaluation, Oxford University Press, vol. 27(2), pages 93-105.
    3. Sivarajah, Uthayasankar & Kamal, Muhammad Mustafa & Irani, Zahir & Weerakkody, Vishanth, 2017. "Critical analysis of Big Data challenges and analytical methods," Journal of Business Research, Elsevier, vol. 70(C), pages 263-286.
    4. Szijarto, Barbara & Milley, Peter & Svensson, Kate & Cousins, J. Bradley, 2018. "On the evaluation of social innovations and social enterprises: Recognizing and integrating two solitudes in the empirical knowledge base," Evaluation and Program Planning, Elsevier, vol. 66(C), pages 20-32.
    5. Bram Klievink & Bart-Jan Romijn & Scott Cunningham & Hans Bruijn, 2017. "Big data in the public sector: Uncertainties and readiness," Information Systems Frontiers, Springer, vol. 19(2), pages 267-283, April.
    6. Diane Paulsell & Jaime Thomas & Shannon Monahan & Neil S. Seftor, "undated". "A Trusted Source of Information: How Systematic Reviews Can Support User Decisions About Adopting Evidence-Based Programs," Mathematica Policy Research Reports d637ad38ce7649ae84a7ddf06, Mathematica Policy Research.
    7. Brian M. Belcher & Katherine E. Rasmussen & Matthew R. Kemshaw & Deborah A. Zornes, 2016. "Defining and assessing research quality in a transdisciplinary context," Research Evaluation, Oxford University Press, vol. 25(1), pages 1-17.
    8. David Moher & Alessandro Liberati & Jennifer Tetzlaff & Douglas G Altman & The PRISMA Group, 2009. "Preferred Reporting Items for Systematic Reviews and Meta-Analyses: The PRISMA Statement," PLOS Medicine, Public Library of Science, vol. 6(7), pages 1-6, July.
    9. Stolp, Sean & Bottorff, Joan L. & Seaton, Cherisse L. & Jones-Bricker, Margaret & Oliffe, John L. & Johnson, Steven T. & Errey, Sally & Medhurst, Kerensa & Lamont, Sonia, 2017. "Measurement and evaluation practices of factors that contribute to effective health promotion collaboration functioning: A scoping review," Evaluation and Program Planning, Elsevier, vol. 61(C), pages 38-44.
    10. Bram Klievink & Bart-Jan Romijn & Scott Cunningham & Hans Bruijn, 0. "Big data in the public sector: Uncertainties and readiness," Information Systems Frontiers, Springer, vol. 0, pages 1-17.
    11. Alessandro Liberati & Douglas G Altman & Jennifer Tetzlaff & Cynthia Mulrow & Peter C Gøtzsche & John P A Ioannidis & Mike Clarke & P J Devereaux & Jos Kleijnen & David Moher, 2009. "The PRISMA Statement for Reporting Systematic Reviews and Meta-Analyses of Studies That Evaluate Health Care Interventions: Explanation and Elaboration," PLOS Medicine, Public Library of Science, vol. 6(7), pages 1-28, July.
    12. Tilbury, Clare & Ramsay, Sylvia, 2018. "A systematic scoping review of parental satisfaction with child protection services," Evaluation and Program Planning, Elsevier, vol. 66(C), pages 141-146.
    13. Donnelly, James P., 2017. "A systematic review of concept mapping dissertations," Evaluation and Program Planning, Elsevier, vol. 60(C), pages 186-193.
    14. Daigneault, Pierre-Marc, 2014. "Taking stock of four decades of quantitative research on stakeholder participation and evaluation use: A systematic map," Evaluation and Program Planning, Elsevier, vol. 45(C), pages 171-181.
    15. Sarah Giest, 2017. "Big data for policymaking: fad or fasttrack?," Policy Sciences, Springer;Society of Policy Sciences, vol. 50(3), pages 367-382, September.
    16. Norton, Sophie & Milat, Andrew & Edwards, Barry & Giffin, Michael, 2016. "Narrative review of strategies by organizations for building evaluation capacity," Evaluation and Program Planning, Elsevier, vol. 58(C), pages 1-19.
    17. M. Heyvaert & B. Maes & P. Onghena, 2013. "Mixed methods research synthesis: definition, framework, and potential," Quality & Quantity: International Journal of Methodology, Springer, vol. 47(2), pages 659-676, February.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Roel Heijlen & Joep Crompvoets & Geert Bouckaert & Maxim Chantillon, 2018. "Evolving Government Information Processes for Service Delivery: Identifying Types & Impact," Administrative Sciences, MDPI, vol. 8(2), pages 1-14, May.
    2. Keshav Singh Rawat & Sandeep Kumar Sood, 2021. "Emerging trends and global scope of big data analytics: a scientometric analysis," Quality & Quantity: International Journal of Methodology, Springer, vol. 55(4), pages 1371-1396, August.
    3. Md Altab Hossin & Jie Du & Lei Mu & Isaac Owusu Asante, 2023. "Big Data-Driven Public Policy Decisions: Transformation Toward Smart Governance," SAGE Open, , vol. 13(4), pages 21582440231, December.
    4. Sarah Giest & Annemarie Samuels, 2020. "‘For good measure’: data gaps in a big data world," Policy Sciences, Springer;Society of Policy Sciences, vol. 53(3), pages 559-569, September.
    5. Alessandro Concari & Gerjo Kok & Pim Martens, 2020. "A Systematic Literature Review of Concepts and Factors Related to Pro-Environmental Consumer Behaviour in Relation to Waste Management Through an Interdisciplinary Approach," Sustainability, MDPI, vol. 12(11), pages 1-50, May.
    6. Giuseppe La Torre & Remigio Bova & Rosario Andrea Cocchiara & Cristina Sestili & Anna Tagliaferri & Simona Maggiacomo & Camilla Foschi & William Zomparelli & Maria Vittoria Manai & David Shaholli & Va, 2023. "What Are the Determinants of the Quality of Systematic Reviews in the International Journals of Occupational Medicine? A Methodological Study Review of Published Literature," IJERPH, MDPI, vol. 20(2), pages 1-12, January.
    7. Frank Peinemann & Ulrich Grouven & Nicolaus Kröger & Carmen Bartel & Max H Pittler & Stefan Lange, 2011. "First-Line Matched Related Donor Hematopoietic Stem Cell Transplantation Compared to Immunosuppressive Therapy in Acquired Severe Aplastic Anemia," PLOS ONE, Public Library of Science, vol. 6(4), pages 1-16, April.
    8. Jonathan Kingsley & Aisling Bailey & Nooshin Torabi & Pauline Zardo & Suzanne Mavoa & Tonia Gray & Danielle Tracey & Philip Pettitt & Nicholas Zajac & Emily Foenander, 2019. "A Systematic Review Protocol Investigating Community Gardening Impact Measures," IJERPH, MDPI, vol. 16(18), pages 1-12, September.
    9. Peter M. Bednar & Christine Welch, 0. "Socio-Technical Perspectives on Smart Working: Creating Meaningful and Sustainable Systems," Information Systems Frontiers, Springer, vol. 0, pages 1-18.
    10. S. Rajsic & H. Gothe & H. H. Borba & G. Sroczynski & J. Vujicic & T. Toell & Uwe Siebert, 2019. "Economic burden of stroke: a systematic review on post-stroke care," The European Journal of Health Economics, Springer;Deutsche Gesellschaft für Gesundheitsökonomie (DGGÖ), vol. 20(1), pages 107-134, February.
    11. Sibonokuhle Ndlovu, 2023. "Preparedness and Response to COVID-19 Disruptions and Learning Challenges for Students with Disabilities in South Africa: A Systematic Review," Sustainability, MDPI, vol. 15(2), pages 1-17, January.
    12. Abbas Mardani & Dalia Streimikiene & Edmundas Kazimieras Zavadskas & Fausto Cavallaro & Mehrbakhsh Nilashi & Ahmad Jusoh & Habib Zare, 2017. "Application of Structural Equation Modeling (SEM) to Solve Environmental Sustainability Problems: A Comprehensive Review and Meta-Analysis," Sustainability, MDPI, vol. 9(10), pages 1-65, October.
    13. Luísa Bandeira Lopes & João Albernaz Neves & João Botelho & Vanessa Machado & José João Mendes, 2021. "Regenerative Endodontic Procedures: An Umbrella Review," IJERPH, MDPI, vol. 18(2), pages 1-17, January.
    14. Gaspar, Rui & Yan, Zheng & Domingos, Samuel, 2019. "Extreme natural and man-made events and human adaptive responses mediated by information and communication technologies' use: A systematic literature review," Technological Forecasting and Social Change, Elsevier, vol. 145(C), pages 125-135.
    15. Nicholas A. Kirk & Nicholas A. Cradock-Henry, 2022. "Land Management Change as Adaptation to Climate and Other Stressors: A Systematic Review of Decision Contexts Using Values-Rules-Knowledge," Land, MDPI, vol. 11(6), pages 1-23, May.
    16. Timothy Noblet & John Marriott & Emma Graham-Clarke & Debra Shirley & Alison Rushton, 2018. "Clinical and cost-effectiveness of non-medical prescribing: A systematic review of randomised controlled trials," PLOS ONE, Public Library of Science, vol. 13(3), pages 1-15, March.
    17. Abbas Mardani & Mehrbakhsh Nilashi & Jurgita Antucheviciene & Madjid Tavana & Romualdas Bausys & Othman Ibrahim, 2017. "Recent Fuzzy Generalisations of Rough Sets Theory: A Systematic Review and Methodological Critique of the Literature," Complexity, Hindawi, vol. 2017, pages 1-33, October.
    18. E. Raguseo & Pigni, F. & Claudio Vitari, 2021. "Streams of digital data and competitive advantage: The mediation effects of process efficiency and product effectiveness," Grenoble Ecole de Management (Post-Print) hal-03323663, HAL.
    19. Wen-Hsiu Yeh & Ya-Ju Ju & Yu-Ting Liu & Ting-Yi Wang, 2022. "Systematic Review and Meta-Analysis on the Effects of Neurofeedback Training of Theta Activity on Working Memory and Episodic Memory in Healthy Population," IJERPH, MDPI, vol. 19(17), pages 1-14, September.
    20. Gourzoulidis, George & Kourlaba, Georgia & Stafylas, Panagiotis & Giamouzis, Gregory & Parissis, John & Maniadakis, Nikolaos, 2017. "Association between copayment, medication adherence and outcomes in the management of patients with diabetes and heart failure," Health Policy, Elsevier, vol. 121(4), pages 363-377.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:epplan:v:79:y:2020:i:c:s0149718919302605. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/evalprogplan .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.