IDEAS home Printed from https://ideas.repec.org/p/osf/metaar/8z45v_v2.html
   My bibliography  Save this paper

Use and Misuse of a Fast Approximation: Not a Criticism, but a Caution

Author

Listed:
  • Rainey, Carlisle

Abstract

A commentary on Isager, van ‘t Veer, and Lakens’ (2024) “Replication value as a function of citation impact and sample size” (https://osf.io/preprints/metaarxiv/knjea). I caution researchers that the fast approximation can easily become a harmful crutch; it might substitute for researchers’ expert judgment of replication value and stifle detailed, substantive arguments.

Suggested Citation

  • Rainey, Carlisle, 2025. "Use and Misuse of a Fast Approximation: Not a Criticism, but a Caution," MetaArXiv 8z45v_v2, Center for Open Science.
    • Handle: RePEc:osf:metaar:8z45v_v2
    DOI: 10.31219/osf.io/8z45v_v2
    as

    Download full text from publisher

    File URL: https://osf.io/download/67a87f1a5e572929658ed9f4/
    Download Restriction: no
    File URL: https://libkey.io/10.31219/osf.io/8z45v_v2?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Blair, Graeme & Coppock, Alexander & Moor, Margaret, 2020. "When to Worry about Sensitivity Bias: A Social Reference Theory and Evidence from 30 Years of List Experiments," American Political Science Review, Cambridge University Press, vol. 114(4), pages 1297-1315, November.
    2. Clifford, Scott & Sheagley, Geoffrey & Piston, Spencer, 2021. "Increasing Precision without Altering Treatment Effects: Repeated Measures Designs in Survey Experiments," American Political Science Review, Cambridge University Press, vol. 115(3), pages 1048-1065, August.
    3. Rainey, Carlisle, 2025. "Power Rules: Practical Statistical Power Calculations," OSF Preprints 5am9q, Center for Open Science.
    4. Dion, Michelle L. & Sumner, Jane Lawrence & Mitchell, Sara McLaughlin, 2018. "Gendered Citation Patterns across Political Science and Social Science Methodology Fields," Political Analysis, Cambridge University Press, vol. 26(3), pages 312-327, July.
    5. Rainey, Carlisle, 2025. "Power Rules: Practical Statistical Power Calculations," OSF Preprints 5am9q_v1, Center for Open Science.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Borau, Sylvie & Couprie, Hélène & Hopfensitz, Astrid, 2022. "The prosociality of married people: Evidence from a large multinational sample," Journal of Economic Psychology, Elsevier, vol. 92(C).
    2. Diane Alexander & Olga Gorelkina & Erin Hengel & Richard Tol, 2023. "Gender and the time cost of peer review," Tinbergen Institute Discussion Papers 23-044/V, Tinbergen Institute.
    3. James E. Prieger, 2023. "Tax noncompliance: The role of tax morale in smokers' behavior," Contemporary Economic Policy, Western Economic Association International, vol. 41(4), pages 653-673, October.
    4. Bělín, Matěj, 2020. "Time-invariant regressors under fixed effects: Simple identification via a proxy variable," Economics Letters, Elsevier, vol. 186(C).
    5. Allison C. Morgan & Nicholas LaBerge & Daniel B. Larremore & Mirta Galesic & Jennie E. Brand & Aaron Clauset, 2022. "Socioeconomic roots of academic faculty," Nature Human Behaviour, Nature, vol. 6(12), pages 1625-1633, December.
    6. Tahmooresnejad, Leila & Turkina, Ekaterina, 2022. "Female inventors over time: Factors affecting female Inventors’ innovation performance," Journal of Informetrics, Elsevier, vol. 16(1).
    7. Halling, Aske & Petersen, Niels Bjørn Grund, 2024. "Frontline Employees’ Responses to Citizens’ Communication of Administrative Burdens," OSF Preprints yqzg4, Center for Open Science.
    8. Joanna Tyrowicz & Lucas Augusto van der Velde & Magdalena Smyk, 2024. "Gender-neutral hiring of junior scholars," GRAPE Working Papers 94, GRAPE Group for Research in Applied Economics.
    9. Briggs, Ryan C & Solodoch, Omer, 2021. "Changes in perceptions of border security influence desired levels of immigration," OSF Preprints wt74y, Center for Open Science.
    10. Marjolijn N. Wijnen & Jorg J. M. Massen & Mariska E. Kret, 2021. "Gender bias in the allocation of student grants," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(7), pages 5477-5488, July.
    11. Olivia Bertelli & Thomas Calvo & Massa Coulibaly & Moussa Coulibaly & Emmanuelle Lavallée & Marion Mercier & Sandrine Mesplé-Somps & O. Z. Traoré, 2023. "Collecter des données sur des expériences et attitudes sensibles : le cas du Mali," Post-Print hal-04442342, HAL.
    12. Nakajima, Kazuki & Liu, Ruodan & Shudo, Kazuyuki & Masuda, Naoki, 2023. "Quantifying gender imbalance in East Asian academia: Research career and citation practice," Journal of Informetrics, Elsevier, vol. 17(4).
    13. Tóth, Tamás & Demeter, Márton & Csuhai, Sándor & Major, Zsolt Balázs, 2024. "When career-boosting is on the line: Equity and inequality in grant evaluation, productivity, and the educational backgrounds of Marie Skłodowska-Curie Actions individual fellows in social sciences an," Journal of Informetrics, Elsevier, vol. 18(2).
    14. H. O.’Leary & T. Gantzert & A. Mann & E. Z. Mann & N. Bollineni & M. Nelson, 2024. "Citation as representation: gendered academic citation politics persist in environmental studies publications," Journal of Environmental Studies and Sciences, Springer;Association of Environmental Studies and Sciences, vol. 14(3), pages 525-537, September.
    15. Paul A. Djupe & Kim Quaile Hill & Amy Erica Smith & Anand E. Sokhey, 2020. "Putting personality in context: determinants of research productivity and impact in political science," Scientometrics, Springer;Akadémiai Kiadó, vol. 124(3), pages 2279-2300, September.
    16. Wassim Le Lann & Gauthier Delozière & Yann Le Lann, 2023. "Greenwashing the Talents: attracting human capital through environmental pledges," SciencePo Working papers Main hal-04140191, HAL.
    17. Panagiotis Fotiadis & Matthew Cieslak & Xiaosong He & Lorenzo Caciagli & Mathieu Ouellet & Theodore D. Satterthwaite & Russell T. Shinohara & Dani S. Bassett, 2023. "Myelination and excitation-inhibition balance synergistically shape structure-function coupling across the human cortex," Nature Communications, Nature, vol. 14(1), pages 1-21, December.
    18. Ursula A. Tooley & Aidan Latham & Jeanette K. Kenley & Dimitrios Alexopoulos & Tara A. Smyser & Ashley N. Nielsen & Lisa Gorham & Barbara B. Warner & Joshua S. Shimony & Jeffrey J. Neil & Joan L. Luby, 2024. "Prenatal environment is associated with the pace of cortical network development over the first three years of life," Nature Communications, Nature, vol. 15(1), pages 1-16, December.
    19. Mengyu Yu & Mazie Krehbiel & Samantha Thompson & Tatjana Miljkovic, 2020. "An exploration of gender gap using advanced data science tools: actuarial research community," Scientometrics, Springer;Akadémiai Kiadó, vol. 123(2), pages 767-789, May.
    20. Michelle L. Dion & Sara McLaughlin Mitchell & Jane L. Sumner, 2020. "Gender, seniority, and self-citation practices in political science," Scientometrics, Springer;Akadémiai Kiadó, vol. 125(1), pages 1-28, October.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:osf:metaar:8z45v_v2. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: OSF (email available below). General contact details of provider: https://osf.io/preprints/metaarxiv .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.