IDEAS home Printed from https://ideas.repec.org/a/nat/nathum/v8y2024i5d10.1038_s41562-023-01813-4.html
   My bibliography  Save this article

Field testing the transferability of behavioural science knowledge on promoting vaccinations

Author

Listed:
  • Silvia Saccardo

    (Carnegie Mellon University)

  • Hengchen Dai

    (University of California Los Angeles)

  • Maria A. Han

    (University of California Los Angeles)

  • Sitaram Vangala

    (Glendon Avenue)

  • Juyea Hoo

    (University of California Los Angeles)

  • Jeffrey Fujimoto

    (University of California Los Angeles
    Cedars-Sinai Kerlan-Jobe Institute)

Abstract

As behavioural science is increasingly adopted by organizations, there is a growing need to assess the robustness and transferability of empirical findings. Here, we investigate the transferability of insights from various sources of behavioural science knowledge to field settings. Across three pre-registered randomized controlled trials (RCTs, N = 314,824) involving a critical policy domain—COVID-19 booster uptake—we field tested text-based interventions that either increased vaccinations in prior field work (RCT1, NCT05586204), elevated vaccination intentions in an online study (RCT2, NCT05586178) or were favoured by scientists and non-experts (RCT3, NCT05586165). Despite repeated exposure to COVID-19 vaccination messaging in our population, reminders and psychological ownership language increased booster uptake, replicating prior findings. However, strategies deemed effective by prediction or intention surveys, such as encouraging the bundling of COVID-19 boosters and flu shots or addressing misconceptions, yielded no detectable benefits over simple reminders. These findings underscore the importance of testing interventions’ transferability to real-world settings.

Suggested Citation

  • Silvia Saccardo & Hengchen Dai & Maria A. Han & Sitaram Vangala & Juyea Hoo & Jeffrey Fujimoto, 2024. "Field testing the transferability of behavioural science knowledge on promoting vaccinations," Nature Human Behaviour, Nature, vol. 8(5), pages 878-890, May.
  • Handle: RePEc:nat:nathum:v:8:y:2024:i:5:d:10.1038_s41562-023-01813-4
    DOI: 10.1038/s41562-023-01813-4
    as

    Download full text from publisher

    File URL: https://www.nature.com/articles/s41562-023-01813-4
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.

    File URL: https://libkey.io/10.1038/s41562-023-01813-4?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Stefano DellaVigna & Elizabeth Linos, 2022. "RCTs to Scale: Comprehensive Evidence From Two Nudge Units," Econometrica, Econometric Society, vol. 90(1), pages 81-116, January.
    2. Katherine L. Milkman & Dena Gromet & Hung Ho & Joseph S. Kay & Timothy W. Lee & Pepi Pandiloski & Yeji Park & Aneesh Rai & Max Bazerman & John Beshears & Lauri Bonacorsi & Colin Camerer & Edward Chang, 2021. "Megastudies improve the impact of applied behavioural science," Nature, Nature, vol. 600(7889), pages 478-483, December.
    3. Kai Barron & Mette Trier Damgaard & Christina Gravert, 2022. "When do reminders work? Memory constraints and medical adherence," CEBI working paper series 22-18, University of Copenhagen. Department of Economics. The Center for Economic Behavior and Inequality (CEBI).
    4. Soman, Dilip & Hossain, Tanjim, 2021. "Successfully scaled solutions need not be homogenous," Behavioural Public Policy, Cambridge University Press, vol. 5(1), pages 80-89, January.
    5. Hans IJzerman & Neil A. Lewis & Andrew K. Przybylski & Netta Weinstein & Lisa DeBruine & Stuart J. Ritchie & Simine Vazire & Patrick S. Forscher & Richard D. Morey & James D. Ivory & Farid Anvari, 2020. "Use caution when applying behavioural science to policy," Nature Human Behaviour, Nature, vol. 4(11), pages 1092-1094, November.
    6. Paolina C Medina, 2021. "Side Effects of Nudging: Evidence from a Randomized Intervention in the Credit Card Market [Regulating consumer financial products: Evidence from credit cards]," The Review of Financial Studies, Society for Financial Studies, vol. 34(5), pages 2580-2607.
    7. Hallsworth, Michael & List, John A. & Metcalfe, Robert D. & Vlaev, Ivo, 2017. "The behavioralist as tax collector: Using natural field experiments to enhance tax compliance," Journal of Public Economics, Elsevier, vol. 148(C), pages 14-31.
    8. Christopher J. Bryan & Elizabeth Tipton & David S. Yeager, 2021. "Behavioural science is unlikely to change the world without a heterogeneity revolution," Nature Human Behaviour, Nature, vol. 5(8), pages 980-989, August.
    9. Elizabeth Linos & Allen Prohofsky & Aparna Ramesh & Jesse Rothstein & Matthew Unrath, 2022. "Can Nudges Increase Take-Up of the EITC? Evidence from Multiple Field Experiments," American Economic Journal: Economic Policy, American Economic Association, vol. 14(4), pages 432-452, November.
    10. Camerer, Colin & Dreber, Anna & Forsell, Eskil & Ho, Teck-Hua & Huber, Jurgen & Johannesson, Magnus & Kirchler, Michael & Almenberg, Johan & Altmejd, Adam & Chan, Taizan & Heikensten, Emma & Holzmeist, 2016. "Evaluating replicability of laboratory experiments in Economics," MPRA Paper 75461, University Library of Munich, Germany.
    11. Dean Karlan & Margaret McConnell & Sendhil Mullainathan & Jonathan Zinman, 2016. "Getting to the Top of Mind: How Reminders Increase Saving," Management Science, INFORMS, vol. 62(12), pages 3393-3411, December.
    12. Vojtěch Bartoš & Michal Bauer & Jana Cahlíková & Julie Chytilová, 2022. "Communicating doctors’ consensus persistently increases COVID-19 vaccinations," Nature, Nature, vol. 606(7914), pages 542-549, June.
    13. Stefano DellaVigna & Devin Pope, 2018. "What Motivates Effort? Evidence and Expert Forecasts," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 85(2), pages 1029-1069.
    14. Cass R. Sunstein, 2022. "The distributional effects of nudges," Nature Human Behaviour, Nature, vol. 6(1), pages 9-10, January.
    15. Kai Ruggeri & Friederike Stock & S. Alexander Haslam & Valerio Capraro & Paulo Boggio & Naomi Ellemers & Aleksandra Cichocka & Karen M. Douglas & David G. Rand & Sander Linden & Mina Cikara & Eli J. F, 2024. "A synthesis of evidence for policy from behavioural science during COVID-19," Nature, Nature, vol. 625(7993), pages 134-147, January.
    16. repec:feb:artefa:0087 is not listed on IDEAS
    17. Levitt, Steven D. & List, John A., 2009. "Field experiments in economics: The past, the present, and the future," European Economic Review, Elsevier, vol. 53(1), pages 1-18, January.
    18. Luigi Butera & Philip J Grossman & Daniel Houser & John A List & Marie Claire Villeval, 2020. "A New Mechanism to Alleviate the Crises of Confidence in Science With An Application to the Public Goods GameA Review," Working Papers halshs-02512932, HAL.
    19. Michael Hallsworth, 2023. "A manifesto for applying behavioural science," Nature Human Behaviour, Nature, vol. 7(3), pages 310-322, March.
    20. Monya Baker, 2016. "1,500 scientists lift the lid on reproducibility," Nature, Nature, vol. 533(7604), pages 452-454, May.
    21. Hengchen Dai & Silvia Saccardo & Maria A. Han & Lily Roh & Naveen Raja & Sitaram Vangala & Hardikkumar Modi & Shital Pandya & Michael Sloyan & Daniel M. Croymans, 2021. "Behavioural nudges increase COVID-19 vaccinations," Nature, Nature, vol. 597(7876), pages 404-409, September.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. C. Yiwei Zhang & Jeffrey Hemmeter & Judd B. Kessler & Robert D. Metcalfe & Robert Weathers, 2023. "Nudging Timely Wage Reporting: Field Experimental Evidence from the U.S. Supplemental Security Income Program," Management Science, INFORMS, vol. 69(3), pages 1341-1353, March.
    2. Brade, Raphael & Himmler, Oliver & Jäckle, Robert, 2022. "Relative performance feedback and the effects of being above average — field experiment and replication," Economics of Education Review, Elsevier, vol. 89(C).
    3. Diane Pelly & Orla Doyle, 2022. "Nudging in the workplace: increasing participation in employee EDI wellness events," Working Papers 202208, Geary Institute, University College Dublin.
    4. Fels, Katja M., 2021. "Who nudges whom? Field experiments with public partners," Ruhr Economic Papers 906, RWI - Leibniz-Institut für Wirtschaftsforschung, Ruhr-University Bochum, TU Dortmund University, University of Duisburg-Essen.
    5. Eugen Dimant & Shaul Shalvi, 2022. "Meta-Nudging Honesty: Past, Present, and Future of the Research Frontier," CESifo Working Paper Series 9939, CESifo.
    6. S. Mills & S. Costa & C. R. Sunstein, 2023. "AI, Behavioural Science, and Consumer Welfare," Journal of Consumer Policy, Springer, vol. 46(3), pages 387-400, September.
    7. John A. List, 2024. "Optimally generate policy-based evidence before scaling," Nature, Nature, vol. 626(7999), pages 491-499, February.
    8. Eszter Czibor & David Jimenez‐Gomez & John A. List, 2019. "The Dozen Things Experimental Economists Should Do (More of)," Southern Economic Journal, John Wiley & Sons, vol. 86(2), pages 371-432, October.
    9. Dirkmaat, Thomas & Rohde, Kirsten I.M. & van de Veer, Evelien & van Dijk, Bram & Yu, Xiao, 2023. "Managing “Last Moment Behavior”: Non-binding target dates to reduce the spikes in task completion at deadlines," Journal of Public Economics, Elsevier, vol. 219(C).
    10. Brade, Raphael, 2022. "Social Information and Educational Investment - Nudging Remedial Math Course Participation," MPRA Paper 113076, University Library of Munich, Germany.
    11. Timmons, Shane & Robertson, Deirdre & Lunn, Pete, 2022. "Combining nudges and boosts to increase precautionary saving: A large-scale field experiment," Papers WP722, Economic and Social Research Institute (ESRI).
    12. Chadimová, Kateřina & Cahlíková, Jana & Cingl, Lubomír, 2022. "Foretelling what makes people pay: Predicting the results of field experiments on TV fee enforcement," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 100(C).
    13. Migchelbrink, Koen & Raymaekers, Pieter, 2023. "Nudging people to pay their parking fines on time. Evidence from a cluster-randomized field experiment," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 105(C).
    14. Felix Holzmeister & Magnus Johannesson & Robert Böhm & Anna Dreber & Jürgen Huber & Michael Kirchler, 2023. "Heterogeneity in effect size estimates: Empirical evidence and practical implications," Working Papers 2023-17, Faculty of Economics and Statistics, Universität Innsbruck.
    15. Rob Bauer & Inka Eberhardt & Paul Smeets, 2022. "A Fistful of Dollars: Financial Incentives, Peer Information, and Retirement Savings," The Review of Financial Studies, Society for Financial Studies, vol. 35(6), pages 2981-3020.
    16. Werner, Peter & Riedl, Arno, 2018. "The role of experiments for policy design," Research Memorandum 022, Maastricht University, Graduate School of Business and Economics (GSBE).
    17. Igor Asanov & Christoph Buehren & Panagiota Zacharodimou, 2020. "The power of experiments: How big is your n?," MAGKS Papers on Economics 202032, Philipps-Universität Marburg, Faculty of Business Administration and Economics, Department of Economics (Volkswirtschaftliche Abteilung).
    18. Stefano DellaVigna & Elizabeth Linos, 2022. "RCTs to Scale: Comprehensive Evidence From Two Nudge Units," Econometrica, Econometric Society, vol. 90(1), pages 81-116, January.
    19. Andor, Mark A. & Gerster, Andreas & Peters, Jörg & Schmidt, Christoph M., 2020. "Social Norms and Energy Conservation Beyond the US," Journal of Environmental Economics and Management, Elsevier, vol. 103(C).
    20. Gillitzer, Christian & Sinning, Mathias, 2020. "Nudging businesses to pay their taxes: Does timing matter?," Journal of Economic Behavior & Organization, Elsevier, vol. 169(C), pages 284-300.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:nat:nathum:v:8:y:2024:i:5:d:10.1038_s41562-023-01813-4. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.nature.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.