IDEAS home Printed from https://ideas.repec.org/a/spr/scient/v127y2022i8d10.1007_s11192-022-04418-2.html
   My bibliography  Save this article

Reproducibility of COVID-19 pre-prints

Author

Listed:
  • Annie Collins

    (University of Toronto)

  • Rohan Alexander

    (University of Toronto)

Abstract

To examine the reproducibility of COVID-19 research, we create a dataset of pre-prints posted to arXiv, bioRxiv, and medRxiv between 28 January 2020 and 30 June 2021 that are related to COVID-19. We extract the text from these pre-prints and parse them looking for keyword markers signaling the availability of the data and code underpinning the pre-print. For the pre-prints that are in our sample, we are unable to find markers of either open data or open code for 75% of those on arXiv, 67% of those on bioRxiv, and 79% of those on medRxiv.

Suggested Citation

  • Annie Collins & Rohan Alexander, 2022. "Reproducibility of COVID-19 pre-prints," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(8), pages 4655-4673, August.
    • Handle: RePEc:spr:scient:v:127:y:2022:i:8:d:10.1007_s11192-022-04418-2
    DOI: 10.1007/s11192-022-04418-2
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11192-022-04418-2
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s11192-022-04418-2?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Gary King & Patrick Lam & Margaret E. Roberts, 2017. "Computer‐Assisted Keyword and Document Set Discovery from Unstructured Text," American Journal of Political Science, John Wiley & Sons, vol. 61(4), pages 971-988, October.
    2. Diana Kwon, 2020. "How swamped preprint servers are blocking bad coronavirus research," Nature, Nature, vol. 581(7807), pages 130-131, May.
    3. Guillaume Cabanac & Theodora Oikonomidi & Isabelle Boutron, 2021. "Day-to-day discovery of preprint–publication links," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(6), pages 5285-5304, June.
    4. Jaime A. Teixeira da Silva & Panagiotis Tsigaris & Mohammadamin Erfanmanesh, 2021. "Publishing volumes in major databases related to Covid-19," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(1), pages 831-842, January.
    5. Heidi Ledford & Richard Van Noorden, 2020. "High-profile coronavirus retractions raise concerns about data oversight," Nature, Nature, vol. 582(7811), pages 160-160, June.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Quan-Hoang Vuong & Tam-Tri Le & Viet-Phuong La & Huyen Thanh Thanh Nguyen & Manh-Toan Ho & Quy Khuc & Minh-Hoang Nguyen, 2022. "Covid-19 vaccines production and societal immunization under the serendipity-mindsponge-3D knowledge management theory and conceptual framework," Palgrave Communications, Palgrave Macmillan, vol. 9(1), pages 1-12, December.
    2. Uddin, Shahadat & Khan, Arif & Lu, Haohui, 2023. "Impact of COVID-19 on Journal Impact Factor," Journal of Informetrics, Elsevier, vol. 17(4).
    3. Sandra Wankmüller, 2023. "A comparison of approaches for imbalanced classification problems in the context of retrieving relevant documents for an analysis," Journal of Computational Social Science, Springer, vol. 6(1), pages 91-163, April.
    4. McCannon, Bryan & Zhou, Yang & Hall, Joshua, 2021. "Measuring a Contract’s Breadth: A Text Analysis," Working Papers 11013, George Mason University, Mercatus Center.
    5. Fraccaroli, Nicolò & Giovannini, Alessandro & Jamet, Jean-François & Persson, Eric, 2022. "Ideology and monetary policy. The role of political parties’ stances in the European Central Bank’s parliamentary hearings," European Journal of Political Economy, Elsevier, vol. 74(C).
    6. Erkan Işığıçok & Sadullah Çelik & Dilek Özdemir Yılmaz, 2023. "Analysis of Skills and Qualifications Required in Data Scientist Job Postings Based on the Pareto Analysis Perspective Using Text Mining," EKOIST Journal of Econometrics and Statistics, Istanbul University, Faculty of Economics, vol. 0(39), pages 10-25, December.
    7. Yu-Ru Lin & Wen-Ting Chung, 2020. "The dynamics of Twitter users’ gun narratives across major mass shooting events," Palgrave Communications, Palgrave Macmillan, vol. 7(1), pages 1-16, December.
    8. Guillaume Cabanac & Theodora Oikonomidi & Isabelle Boutron, 2021. "Day-to-day discovery of preprint–publication links," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(6), pages 5285-5304, June.
    9. Shelly X Bian & Eugene Lin, 2020. "Competing with a pandemic: Trends in research design in a time of Covid-19," PLOS ONE, Public Library of Science, vol. 15(9), pages 1-14, September.
    10. Marc Bertin & Iana Atanassova, 2022. "Preprint citation practice in PLOS," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(12), pages 6895-6912, December.
    11. Lisa Oswald, 2024. "More than news! Mapping the deliberative potential of a political online ecosystem with digital trace data," Palgrave Communications, Palgrave Macmillan, vol. 11(1), pages 1-16, December.
    12. Dugoua, Eugenie & Dumas, Marion & Noailly, Joëlle, 2022. "Text as data in environmental economics and policy," LSE Research Online Documents on Economics 115396, London School of Economics and Political Science, LSE Library.
    13. Ivan Kodvanj & Jan Homolak & Davor Virag & Vladimir Trkulja, 2022. "Publishing of COVID-19 preprints in peer-reviewed journals, preprinting trends, public discussion and quality issues," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(3), pages 1339-1352, March.
    14. Natalie Kyung Won Kim & Sera Choi & Taejin Jung & Sohee Park, 2023. "How does demand uncertainty from climate change exposure affect the firms' cost structures? Examining the real effects of climate change on the firms' operational decisions," Corporate Social Responsibility and Environmental Management, John Wiley & Sons, vol. 30(6), pages 2969-2989, November.
    15. Callan Windsor & Max Zang, 2023. "Firms' Price-setting Behaviour: Insights from Earnings Calls," RBA Research Discussion Papers rdp2023-06, Reserve Bank of Australia.
    16. Török, Ádám & Konka, Boglárka & Nagy, Andrea Magda, 2023. "A koronavírus-járvány a közgazdasági szakirodalomban. Egy új határterület tudománymetriai elemzése [The coronavirus pandemic in the economics literature. The scientometric analysis of a new discipl," Közgazdasági Szemle (Economic Review - monthly of the Hungarian Academy of Sciences), Közgazdasági Szemle Alapítvány (Economic Review Foundation), vol. 0(3), pages 284-304.
    17. Sophie E. Jordan & Sierra E. Hovet & Isaac Chun-Hai Fung & Hai Liang & King-Wa Fu & Zion Tsz Ho Tse, 2018. "Using Twitter for Public Health Surveillance from Monitoring and Prediction to Public Response," Data, MDPI, vol. 4(1), pages 1-20, December.
    18. Colella, Sara & Dufourt, Frédéric & Hildebrand, Vincent A. & Vivès, Rémi, 2023. "Mental health effects of COVID-19 lockdowns: A Twitter-based analysis," Economics & Human Biology, Elsevier, vol. 51(C).
    19. Yves Fassin, 2021. "Research on Covid-19: a disruptive phenomenon for bibliometrics," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(6), pages 5305-5319, June.
    20. Guillaume Cabanac & Ingo Frommholz & Philipp Mayr, 2020. "Scholarly literature mining with information retrieval and natural language processing: Preface," Scientometrics, Springer;Akadémiai Kiadó, vol. 125(3), pages 2835-2840, December.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:scient:v:127:y:2022:i:8:d:10.1007_s11192-022-04418-2. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.