IDEAS home Printed from https://ideas.repec.org/a/spr/scient/v129y2024i7d10.1007_s11192-024-05053-9.html
   My bibliography  Save this article

Streetlight effect in PubPeer comments: are Open Access publications more scrutinized?

Author

Listed:
  • Abdelghani Maddi

    (GEMASS – CNRS – Sorbonne Université)

  • Emmanuel Monneau

    (GEMASS – CNRS – Sorbonne Université)

  • Catherine Guaspare-Cartron

    (GEMASS – CNRS – Sorbonne Université)

  • Floriana Gargiulo

    (GEMASS – CNRS – Sorbonne Université)

  • Michel Dubois

    (GEMASS – CNRS – Sorbonne Université)

Abstract

The Streetlight Effect represents an observation bias that occurs when individuals search for something only where it is easiest to look. Despite the significant development of Post-Publication Peer Review (PPPR) in recent years, facilitated in part by platforms such as PubPeer, existing literature has not examined whether PPPR is affected by this type of bias. In other words, if the PPPR mainly concerns publications to which researchers have direct access (eg to analyze image duplications, etc.). In this study, we compare the Open Access (OA) structures of publishers and journals among 51,882 publications commented on PubPeer to those indexed in OpenAlex database (#156,700,177). Our findings indicate that OA journals are 33% more prevalent in PubPeer than in the global total (52% for the most commented journals). This result can be attributed to disciplinary bias in PubPeer, with overrepresentation of medical and biological research (which exhibits higher levels of openness). However, after normalization, the results reveal that PPPR does not exhibit a Streetlight Effect, as OA publications, within the same discipline, are on average 16% less prevalent in PubPeer than in the global total. These results suggest that the process of scientific self-correction operates independently of publication access status.

Suggested Citation

  • Abdelghani Maddi & Emmanuel Monneau & Catherine Guaspare-Cartron & Floriana Gargiulo & Michel Dubois, 2024. "Streetlight effect in PubPeer comments: are Open Access publications more scrutinized?," Scientometrics, Springer;Akadémiai Kiadó, vol. 129(7), pages 4231-4247, July.
    • Handle: RePEc:spr:scient:v:129:y:2024:i:7:d:10.1007_s11192-024-05053-9
    DOI: 10.1007/s11192-024-05053-9
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11192-024-05053-9
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s11192-024-05053-9?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Diego Ponte & Bozena I. Mierzejewska & Stefan Klein, 2017. "The transformation of the academic publishing market: multiple perspectives on innovation," Electronic Markets, Springer;IIM University of St. Gallen, vol. 27(2), pages 97-100, May.
    2. Abdelghani Maddi, 2020. "Measuring open access publications: a novel normalized open access indicator," Scientometrics, Springer;Akadémiai Kiadó, vol. 124(1), pages 379-398, July.
    3. Steffen Bernius & Matthias Hanauske & Wolfgang König & Berndt Dugall, 2009. "Open Access Models and their Implications for the Players on the Scientific Publishing Market," Economic Analysis and Policy, Elsevier, vol. 39(1), pages 103-115, March.
    4. José Luis Ortega, 2022. "Classification and analysis of PubPeer comments: How a web journal club is used," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 73(5), pages 655-670, May.
    5. Vincent Larivière & Stefanie Haustein & Philippe Mongeon, 2015. "The Oligopoly of Academic Publishers in the Digital Era," PLOS ONE, Public Library of Science, vol. 10(6), pages 1-15, June.
    6. Yuki Yamada & Jaime A. Teixeira da Silva, 2022. "A psychological perspective towards understanding the objective and subjective gray zones in predatory publishing," Quality & Quantity: International Journal of Methodology, Springer, vol. 56(6), pages 4075-4087, December.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Abdelghani Maddi, 2021. "Game theory and scholarly publishing: premises for an agreement around open access," Papers 2106.13321, arXiv.org, revised Dec 2021.
    2. Wrzesinski, Marcel & Riechert, Patrick Urs & Dubois, Frédéric & Katzenbach, Christian, 2021. "Working with publication technology to make open access journals sustainable," EconStor Preprints 231355, ZBW - Leibniz Information Centre for Economics.
    3. Yangping Zhou, 2021. "Self-citation and citation of top journal publishers and their interpretation in the journal-discipline context," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(7), pages 6013-6040, July.
    4. Julie Baldwin & Stephen Pinfield, 2018. "The UK Scholarly Communication Licence: Attempting to Cut through the Gordian Knot of the Complexities of Funder Mandates, Publisher Embargoes and Researcher Caution in Achieving Open Access," Publications, MDPI, vol. 6(3), pages 1-28, July.
    5. Sumiko Asai, 2021. "Collaboration between research institutes and large and small publishers for publishing open access journals," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(6), pages 5245-5262, June.
    6. Stephan Puehringer & Johanna Rath & Teresa Griesebner, 2021. "The political economy of academic publishing: On the commodification of a public good," PLOS ONE, Public Library of Science, vol. 16(6), pages 1-21, June.
    7. de Oliveira, Thaiane Moreira & de Albuquerque, Sofia & Toth, Janderson Pereira & Bello, Debora Zava, 2018. "International cooperation networks of the BRICS bloc," SocArXiv b6x43, Center for Open Science.
    8. Jesse L. Reynolds & Edward A. Parson, 2020. "Nonstate governance of solar geoengineering research," Climatic Change, Springer, vol. 160(2), pages 323-342, May.
    9. You, Taekho & Park, Jinseo & Lee, June Young & Yun, Jinhyuk & Jung, Woo-Sung, 2022. "Disturbance of questionable publishing to academia," Journal of Informetrics, Elsevier, vol. 16(2).
    10. Schmal, W. Benedikt & Haucap, Justus & Knoke, Leon, 2023. "The role of gender and coauthors in academic publication behavior," Research Policy, Elsevier, vol. 52(10).
    11. María Bordons & Borja González-Albo & Luz Moreno-Solano, 2023. "Improving our understanding of open access: how it relates to funding, internationality of research and scientific leadership," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(8), pages 4651-4676, August.
    12. Linh, Nguyen Thi Thuy & Lab, SDAG, 2019. "Factors influencing on salesperson performance in information service industry," Thesis Commons ugcre, Center for Open Science.
    13. Christian Heise & Joshua M. Pearce, 2020. "From Open Access to Open Science: The Path From Scientific Reality to Open Scientific Communication," SAGE Open, , vol. 10(2), pages 21582440209, May.
    14. Korytkowski, Przemyslaw & Kulczycki, Emanuel, 2021. "The gap between Plan S requirements and grantees’ publication practices," Journal of Informetrics, Elsevier, vol. 15(2).
    15. Najko Jahn & Lisa Matthias & Mikael Laakso, 2022. "Toward transparency of hybrid open access through publisher‐provided metadata: An article‐level study of Elsevier," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 73(1), pages 104-118, January.
    16. Sergio Copiello, 2019. "The open access citation premium may depend on the openness and inclusiveness of the indexing database, but the relationship is controversial because it is ambiguous where the open access boundary lie," Scientometrics, Springer;Akadémiai Kiadó, vol. 121(2), pages 995-1018, November.
    17. Justus Haucap & Nima Moshgbar & W. Benedikt Schmal, 2021. "The impact of the German 'DEAL' on competition in the academic publishing market," Managerial and Decision Economics, John Wiley & Sons, Ltd., vol. 42(8), pages 2027-2049, December.
    18. Mingkun Wei & Abdolreza Noroozi Chakoli, 2020. "Evaluating the relationship between the academic and social impact of open access books based on citation behaviors and social media attention," Scientometrics, Springer;Akadémiai Kiadó, vol. 125(3), pages 2401-2420, December.
    19. Yurij L. Katchanov & Yulia V. Markova, 2017. "The “space of physics journals”: topological structure and the Journal Impact Factor," Scientometrics, Springer;Akadémiai Kiadó, vol. 113(1), pages 313-333, October.
    20. Kovács, Kármen, 2017. "A nyílt hozzáférésű publikálás finanszírozási kérdései [The financial issues of open-access scholarly publishing]," Közgazdasági Szemle (Economic Review - monthly of the Hungarian Academy of Sciences), Közgazdasági Szemle Alapítvány (Economic Review Foundation), vol. 0(2), pages 185-207.

    More about this item

    Keywords

    Post-publication peer review; PPPR; Research integrity; PubPeer; Open Access; Streetlight effect; OpenAlex; Normalized open access index;
    All these keywords.

    JEL classification:

    • J16 - Labor and Demographic Economics - - Demographic Economics - - - Economics of Gender; Non-labor Discrimination
    • I23 - Health, Education, and Welfare - - Education - - - Higher Education; Research Institutions
    • I24 - Health, Education, and Welfare - - Education - - - Education and Inequality
    • Z13 - Other Special Topics - - Cultural Economics - - - Economic Sociology; Economic Anthropology; Language; Social and Economic Stratification

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:scient:v:129:y:2024:i:7:d:10.1007_s11192-024-05053-9. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.