IDEAS home Printed from https://ideas.repec.org/a/plo/pbio00/1002456.html
   My bibliography  Save this article

Badges to Acknowledge Open Practices: A Simple, Low-Cost, Effective Method for Increasing Transparency

Author

Listed:
  • Mallory C Kidwell
  • Ljiljana B Lazarević
  • Erica Baranski
  • Tom E Hardwicke
  • Sarah Piechowski
  • Lina-Sophia Falkenberg
  • Curtis Kennett
  • Agnieszka Slowik
  • Carina Sonnleitner
  • Chelsey Hess-Holden
  • Timothy M Errington
  • Susann Fiedler
  • Brian A Nosek

Abstract

Beginning January 2014, Psychological Science gave authors the opportunity to signal open data and materials if they qualified for badges that accompanied published articles. Before badges, less than 3% of Psychological Science articles reported open data. After badges, 23% reported open data, with an accelerating trend; 39% reported open data in the first half of 2015, an increase of more than an order of magnitude from baseline. There was no change over time in the low rates of data sharing among comparison journals. Moreover, reporting openness does not guarantee openness. When badges were earned, reportedly available data were more likely to be actually available, correct, usable, and complete than when badges were not earned. Open materials also increased to a weaker degree, and there was more variability among comparison journals. Badges are simple, effective signals to promote open practices and improve preservation of data and materials by using independent repositories.Badges that acknowledge open practices significantly increase sharing of reported data and materials, as well as subsequent accessibility, correctness, usability, and completeness.Author Summary: Openness is a core value of scientific practice. The sharing of research materials and data facilitates critique, extension, and application within the scientific community, yet current norms provide few incentives for researchers to share evidence underlying scientific claims. In January 2014, the journal Psychological Science adopted such an incentive by offering “badges” to acknowledge and signal open practices in publications. In this study, we evaluated the effect that two types of badges—Open Data badges and Open Materials badges—have had on reported data and material sharing, as well as on the actual availability, correctness, usability, and completeness of those data and materials both in Psychological Science and in four comparison journals. We report an increase in reported data sharing of more than an order of magnitude from baseline in Psychological Science, as well as an increase in reported materials sharing, although to a weaker degree. Moreover, we show that reportedly available data and materials were more accessible, correct, usable, and complete when badges were earned. We demonstrate that badges are effective incentives that improve the openness, accessibility, and persistence of data and materials that underlie scientific research.

Suggested Citation

  • Mallory C Kidwell & Ljiljana B Lazarević & Erica Baranski & Tom E Hardwicke & Sarah Piechowski & Lina-Sophia Falkenberg & Curtis Kennett & Agnieszka Slowik & Carina Sonnleitner & Chelsey Hess-Holden &, 2016. "Badges to Acknowledge Open Practices: A Simple, Low-Cost, Effective Method for Increasing Transparency," PLOS Biology, Public Library of Science, vol. 14(5), pages 1-15, May.
  • Handle: RePEc:plo:pbio00:1002456
    DOI: 10.1371/journal.pbio.1002456
    as

    Download full text from publisher

    File URL: https://journals.plos.org/plosbiology/article?id=10.1371/journal.pbio.1002456
    Download Restriction: no

    File URL: https://journals.plos.org/plosbiology/article/file?id=10.1371/journal.pbio.1002456&type=printable
    Download Restriction: no

    File URL: https://libkey.io/10.1371/journal.pbio.1002456?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Miguel, E & Camerer, C & Casey, K & Cohen, J & Esterling, KM & Gerber, A & Glennerster, R & Green, DP & Humphreys, M & Imbens, G & Laitin, D & Madon, T & Nelson, L & Nosek, BA & Petersen, M & Sedlmayr, 2014. "Promoting Transparency in Social Science Research," Department of Economics, Working Paper Series qt0wt4q2q8, Department of Economics, Institute for Business and Economic Research, UC Berkeley.
    2. Kevin B Read & Jerry R Sheehan & Michael F Huerta & Lou S Knecht & James G Mork & Betsy L Humphreys & NIH Big Data Annotator Group, 2015. "Sizing the Problem of Improving Discovery and Access to NIH-Funded Data: A Preliminary Study," PLOS ONE, Public Library of Science, vol. 10(7), pages 1-18, July.
    3. Nosek, BA & Alter, G & Banks, GC & Borsboom, D & Bowman, SD & Breckler, SJ & Buck, S & Chambers, CD & Chin, G & Christensen, G & Contestabile, M & Dafoe, A & Eich, E & Freese, J & Glennerster, R & Gor, 2015. "Promoting an open research culture," Department of Economics, Working Paper Series qt7wh1000s, Department of Economics, Institute for Business and Economic Research, UC Berkeley.
    4. Andrew F Magee & Michael R May & Brian R Moore, 2014. "The Dawn of Open Access to Phylogenetic Data," PLOS ONE, Public Library of Science, vol. 9(10), pages 1-10, October.
    5. Michael Spence, 1973. "Job Market Signaling," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 87(3), pages 355-374.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Valérie Mignon & Marc Joëts, 2025. "Slaying the Undead: How Long Does It Take to Kill Zombie Papers?," Working Papers hal-04940088, HAL.
    2. Fluet, Claude & Garella, Paolo G., 2002. "Advertising and prices as signals of quality in a regime of price rivalry," International Journal of Industrial Organization, Elsevier, vol. 20(7), pages 907-930, September.
    3. Kristinn Hermannsson & Patrizio Lecca, 2016. "Human Capital in Economic Development: From Labour Productivity to Macroeconomic Impact," Economic Papers, The Economic Society of Australia, vol. 35(1), pages 24-36, March.
    4. Maite Blázquez & Santiago Budr�a, 2012. "Overeducation dynamics and personality," Education Economics, Taylor & Francis Journals, vol. 20(3), pages 260-283, March.
    5. Rodrigo M. S. Moita & Claudio Paiva, 2013. "Political Price Cycles in Regulated Industries: Theory and Evidence," American Economic Journal: Economic Policy, American Economic Association, vol. 5(1), pages 94-121, February.
    6. Sènakpon Fidèle A. Dedehouanou & Luca Tiberti & Hilaire G. Houeninvo & Djohodo Inès Monwanou, 2019. "Working while studying: Employment premium or penalty for youth in Benin?," Working Papers PMMA 2019-03, PEP-PMMA.
    7. Ferdinand Thies & Sören Wallbach & Michael Wessel & Markus Besler & Alexander Benlian, 2022. "Initial coin offerings and the cryptocurrency hype - the moderating role of exogenous and endogenous signals," Electronic Markets, Springer;IIM University of St. Gallen, vol. 32(3), pages 1691-1705, September.
    8. Inmaculada Garc�a-Mainar & V�ctor M. Montuenga-G�mez, 2017. "Subjective educational mismatch and signalling in Spain," Documentos de Trabajo dt2017-03, Facultad de Ciencias Económicas y Empresariales, Universidad de Zaragoza.
    9. Feser, Daniel & Runst, Petrik, 2015. "Energy efficiency consultants as change agents? Examining the reasons for EECs’ limited success," ifh Working Papers 1 (2015), Volkswirtschaftliches Institut für Mittelstand und Handwerk an der Universität Göttingen (ifh).
    10. Anders Gustafsson, 2019. "Busy doing nothing: why politicians implement inefficient policies," Constitutional Political Economy, Springer, vol. 30(3), pages 282-299, September.
    11. Michael Waldman, 1990. "A Signalling Explanation for Seniority Based Promotions and Other Labor Market Puzzles," UCLA Economics Working Papers 599, UCLA Department of Economics.
    12. Rod Mccoll & Yann Truong & Antonella La Rocca, 2019. "Service guarantees as a base for positioning in B2B," Post-Print hal-02326105, HAL.
    13. Ivana Fellini & Raffaele Guetto & Emilio Reyneri, 2018. "Poor Returns to Origin-Country Education for Non-Western Immigrants in Italy: An Analysis of Occupational Status on Arrival and Mobility," Social Inclusion, Cogitatio Press, vol. 6(3), pages 34-47.
    14. repec:ebl:ecbull:v:10:y:2004:i:8:p:1-8 is not listed on IDEAS
    15. Kuhnen, Camelia M., 2010. "Searching for Jobs: Evidence from MBA Graduates," MPRA Paper 21975, University Library of Munich, Germany.
    16. Dionne, G. & Doherty, N., 1991. "Adverse Selection In Insurance Markets: A Selective Survey," Cahiers de recherche 9105, Centre interuniversitaire de recherche en économie quantitative, CIREQ.
    17. Stuth, Stefan & Schorlemmer, Julia & Hennig, Marina & Allmendinger, Jutta, 2014. "Freiwilliges Engagement: Ein Patentrezept für Wiedereinsteigerinnen?," Discussion Papers, Presidential Department P 2014-007, WZB Berlin Social Science Center.
    18. Udo Kreickemeier & Jens Wrona, 2017. "Two-Way Migration between Similar Countries," The World Economy, Wiley Blackwell, vol. 40(1), pages 182-206, January.
    19. Nakabayashi, Masaki, 2011. "Schooling, employer learning, and internal labor market effect: Wage dynamics and human capital investment in the Japanese steel industry, 1930-1960s," MPRA Paper 30597, University Library of Munich, Germany.
    20. Michele Dell'Era & Luis Santos-Pinto, 2011. "Entrepreneurial Overconfidence, Self-Financing and Capital Market Efficiency," Cahiers de Recherches Economiques du Département d'économie 11.06, Université de Lausanne, Faculté des HEC, Département d’économie, revised Nov 2012.
    21. Jitender Singh, 2016. "Quality of Public Goods, Public Policy and Human Development: A State-wise Analysis," Indian Journal of Human Development, , vol. 10(2), pages 215-235, August.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:plo:pbio00:1002456. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: plosbiology (email available below). General contact details of provider: https://journals.plos.org/plosbiology/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.