IDEAS home Printed from https://ideas.repec.org/p/osf/socarx/5bck9_v1.html
   My bibliography  Save this paper

Replication in Social Science

Author

Listed:
  • Freese, Jeremy
  • Peterson, David

Abstract

Across the medical and social sciences, new discussions about replication have been transforming research practices. Sociologists, however, have been largely absent from these discussions. The goals of this review are to introduce sociologists to these developments, synthesize insights from science studies about replication in general, and detail the specific issues regarding replication that occur in sociology. The first half of the article argues that a sociologically sophisticated understanding of replication must take into account both the ways that replication rules and conventions evolved within an epistemic culture and how those cultures are shaped by specific research challenges. The second half outlines the four main dimensions of replicability in quantitative sociology- verifiability, robustness, repeatability, and generalizability- and discusses the specific ambiguities of interpretation that can arise in each. We conclude by advocating some commonsense changes to promote replication while acknowledging the epistemic diversity of our field.

Suggested Citation

  • Freese, Jeremy & Peterson, David, 2017. "Replication in Social Science," SocArXiv 5bck9_v1, Center for Open Science.
    • Handle: RePEc:osf:socarx:5bck9_v1
    DOI: 10.31219/osf.io/5bck9_v1
    as

    Download full text from publisher

    File URL: https://osf.io/download/592c96676c613b0265c43f6a/
    Download Restriction: no
    File URL: https://libkey.io/10.31219/osf.io/5bck9_v1?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Annette N. Brown & Drew B. Cameron & Benjamin D. K. Wood, 2014. "Quality evidence for policymaking: I'll believe it when I see the replication," Journal of Development Effectiveness, Taylor & Francis Journals, vol. 6(3), pages 215-235, September.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Daniel T. L. Shek & Diya Dou & Xiaoqin Zhu & Xiang Li & Lindan Tan, 2022. "Materialism, Egocentrism and Delinquent Behavior in Chinese Adolescents in Mainland China: A Short-Term Longitudinal Study," IJERPH, MDPI, vol. 19(8), pages 1-15, April.
    2. Ankel-Peters, Jörg & Fiala, Nathan & Neubauer, Florian, 2023. "Do economists replicate?," Journal of Economic Behavior & Organization, Elsevier, vol. 212(C), pages 219-232.
    3. Willy Bolander & Nawar N. Chaker & Alec Pappas & Daniel R. Bradbury, 2021. "Operationalizing salesperson performance with secondary data: aligning practice, scholarship, and theory," Journal of the Academy of Marketing Science, Springer, vol. 49(3), pages 462-481, May.
    4. Antonia Krefeld-Schwalb & Benjamin Scheibehenne, 2023. "Tighter nets for smaller fishes? Mapping the development of statistical practices in consumer research between 2008 and 2020," Marketing Letters, Springer, vol. 34(3), pages 351-365, September.
    5. Martin Kreidl & Zuzana Žilinčíková, 2023. "Adult children’s union type and contact with mothers: A replication," Demographic Research, Max Planck Institute for Demographic Research, Rostock, Germany, vol. 48(23), pages 641-680.
    6. Yuyan Jiang & Xueli Liu, 2023. "A construction and empirical research of the journal disruption index based on open citation data," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(7), pages 3935-3958, July.
    7. Mats Alvesson & Jörgen Sandberg, 2020. "The Problematizing Review: A Counterpoint to Elsbach and Van Knippenberg’s Argument for Integrative Reviews," Journal of Management Studies, Wiley Blackwell, vol. 57(6), pages 1290-1304, September.
    8. Dreber, Anna & Johannesson, Magnus, 2023. "A framework for evaluating reproducibility and replicability in economics," Ruhr Economic Papers 1055, RWI - Leibniz-Institut für Wirtschaftsforschung, Ruhr-University Bochum, TU Dortmund University, University of Duisburg-Essen.
    9. Luis Alfonso Dau & Grazia D. Santangelo & Arjen Witteloostuijn, 2022. "Replication studies in international business," Journal of International Business Studies, Palgrave Macmillan;Academy of International Business, vol. 53(2), pages 215-230, March.
    10. Thompson, Phillip S. & Klotz, Anthony C., 2022. "Led by curiosity and responding with voice: The influence of leader displays of curiosity and leader gender on follower reactions of psychological safety and voice," Organizational Behavior and Human Decision Processes, Elsevier, vol. 172(C).
    11. Fišar, Miloš & Greiner, Ben & Huber, Christoph & Katok, Elena & Ozkes, Ali & Management Science Reproducibility Collaboration, 2023. "Reproducibility in Management Science," Department for Strategy and Innovation Working Paper Series 03/2023, WU Vienna University of Economics and Business.
    12. Fanelli, Daniele, 2022. "The "Tau" of Science - How to Measure, Study, and Integrate Quantitative and Qualitative Knowledge," MetaArXiv 67sak, Center for Open Science.
    13. Andrew G.H. Thompson & Oliver Escobar & Jennifer J. Roberts & Stephen Elstub & Niccole M. Pamphilis, 2021. "The Importance of Context and the Effect of Information and Deliberation on Opinion Change Regarding Environmental Issues in Citizens’ Juries," Sustainability, MDPI, vol. 13(17), pages 1-21, September.
    14. Jack I. Richter & Pankaj C. Patel, 2022. "Impact of the COVID-19 pandemic on the hours lost by self-employed racial minorities: evidence from Brazil," Small Business Economics, Springer, vol. 58(2), pages 769-805, February.
    15. Franz Neuberger & Martin Bujard & Tobias Rüttenauer, 2022. "Where does public childcare boost female labor force participation? Exploring geographical heterogeneity across Germany 2007–2017," Demographic Research, Max Planck Institute for Demographic Research, Rostock, Germany, vol. 46(24), pages 693-722.
    16. Fanelli, Daniele, 2020. "Metascientific reproducibility patterns revealed by informatic measure of knowledge," MetaArXiv 5vnhj, Center for Open Science.
    17. Michel Herzig, 2020. "Mediating Factors of Family Structure and Early Home-leaving: A Replication and Extension of van den Berg, Kalmijn, and Leopold (2018)," European Journal of Population, Springer;European Association for Population Studies, vol. 36(4), pages 643-674, September.
    18. Stephan Puehringer, 2023. "Wie viel Wettbewerb wollen wir (uns leisten)? Zur Verwettbewerblichung der Universitaeten in Oesterreich und darueber hinaus," ICAE Working Papers 149, Johannes Kepler University, Institute for Comprehensive Analysis of the Economy.
    19. Ugofilippo Basellini, 2024. "Open science practices in demographic research: An appraisal," Demographic Research, Max Planck Institute for Demographic Research, Rostock, Germany, vol. 50(43), pages 1265-1280.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Emma McManus & David Turner & Tracey Sach, 2019. "Can You Repeat That? Exploring the Definition of a Successful Model Replication in Health Economics," PharmacoEconomics, Springer, vol. 37(11), pages 1371-1381, November.
    2. Wood, Benjamin D.K. & Dong, Michell, 2015. "Recalling Extra Data: A Replication Study of Finding Missing Markets," 2014: Food, Resources and Conflict, December 7-9, 2014. San Diego, California 206225, International Agricultural Trade Research Consortium.
    3. Benjamin D K Wood & Rui Müller & Annette N Brown, 2018. "Push button replication: Is impact evaluation evidence for international development verifiable?," PLOS ONE, Public Library of Science, vol. 13(12), pages 1-15, December.
    4. Cameron, Lisa & Olivia, Susan & Shah, Manisha, 2019. "Scaling up sanitation: Evidence from an RCT in Indonesia," Journal of Development Economics, Elsevier, vol. 138(C), pages 1-16.
    5. Laura Outhwaite & Jake Anders & Jo Van Herwegen, 2022. "Mathematics Attainment Falls Behind Reading in the Early Primary School Years," CEPEO Working Paper Series 22-06, UCL Centre for Education Policy and Equalising Opportunities, revised May 2022.
    6. Michael A. Clemens, 2017. "The Meaning Of Failed Replications: A Review And Proposal," Journal of Economic Surveys, Wiley Blackwell, vol. 31(1), pages 326-342, February.
    7. Eric W Djimeu & Anna C Heard, 2019. "Treatment of HIV among tuberculosis patients: A replication study of timing of antiretroviral therapy for HIV-1-associated tuberculosis," PLOS ONE, Public Library of Science, vol. 14(2), pages 1-20, February.
    8. Wood, Benjamin Douglas Kuflick & Vasquez, Maria, 2018. "Microplots and food security: Encouraging replication studies of policy relevant research," Economics - The Open-Access, Open-Assessment E-Journal (2007-2020), Kiel Institute for the World Economy (IfW Kiel), vol. 12, pages 1-12.
    9. Brown, Annette N. & Wood, Benjamin Douglas Kuflick, 2018. "Which tests not witch hunts: A diagnostic approach for conducting replication research," Economics - The Open-Access, Open-Assessment E-Journal (2007-2020), Kiel Institute for the World Economy (IfW Kiel), vol. 12, pages 1-26.
    10. Cuong Viet Nguyen, 2016. "Impacts of rural road on household welfare in Vietnam: Evidence from a replication study," Economics Discussion Papers 2016-40, Kiel Institute for the World Economy (IfW Kiel).
    11. Eric W Djimeu & Anna Heard, 2020. "Replication of influential studies on biomedical, social, behavioural and structural interventions for HIV prevention and treatment," PLOS ONE, Public Library of Science, vol. 15(10), pages 1-10, October.
    12. Freese, Jeremy & Peterson, David, 2017. "Replication in Social Science," SocArXiv 5bck9, Center for Open Science.
    13. Donovan, Kevin P., 2018. "The rise of the randomistas: on the experimental turn in international aid," SocArXiv xygzb_v1, Center for Open Science.
    14. Donovan, Kevin P., 2018. "The rise of the randomistas: on the experimental turn in international aid," SocArXiv xygzb, Center for Open Science.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:osf:socarx:5bck9_v1. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: OSF (email available below). General contact details of provider: https://arabixiv.org .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.