IDEAS home Printed from https://ideas.repec.org/a/nea/journl/y2024i65p178-194.html
   My bibliography  Save this article

"Zoo" of empirical results: Quantitative research and accumulation of knowledge in social sciences

Author

Listed:
  • Libman, A.

    (Free University of Berlin, Germany)

Abstract

The last decade became a period of an empirical turn in economics and in many other social sciences, i. e., increasing role of quantitative empirical research and declining importance of big paradigms and research programs. What does, however, the increase of the number of empirical studies mean for the overall accumulation of knowledge about societies? Fundamentally, generalizable results are frequently seen as an important advantage of the quantitative methods. However, our article shows that standard studies within the framework of the empirical turn hardly communicate with each other, build upon each other or try to refute each other. References to other papers play a more or less symbolic role. Instead of a systematic worldview a sort of a 'zoo' of numerous individual case studies emerges, being hardly connected to each other. This development, however, should not necessarily be perceived as evidence of a crisis in social sciences.

Suggested Citation

  • Libman, A., 2024. ""Zoo" of empirical results: Quantitative research and accumulation of knowledge in social sciences," Journal of the New Economic Association, New Economic Association, vol. 65(4), pages 178-194.
  • Handle: RePEc:nea:journl:y:2024:i:65:p:178-194
    DOI: 10.31737/22212264_2024_4_178-194
    as

    Download full text from publisher

    File URL: http://www.econorus.org/repec/journl/2024-65-178-194r.pdf
    Download Restriction: no

    File URL: https://libkey.io/10.31737/22212264_2024_4_178-194?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Abel Brodeur & Scott Carrell & David Figlio & Lester Lusher, 2023. "Unpacking P-hacking and Publication Bias," American Economic Review, American Economic Association, vol. 113(11), pages 2974-3002, November.
    2. Lieberman, Evan S., 2005. "Nested Analysis as a Mixed-Method Strategy for Comparative Research," American Political Science Review, Cambridge University Press, vol. 99(3), pages 435-452, August.
    3. Daniel J. Benjamin & James O. Berger & Magnus Johannesson & Brian A. Nosek & E.-J. Wagenmakers & Richard Berk & Kenneth A. Bollen & Björn Brembs & Lawrence Brown & Colin Camerer & David Cesarini & Chr, 2018. "Redefine statistical significance," Nature Human Behaviour, Nature, vol. 2(1), pages 6-10, January.
      • Daniel Benjamin & James Berger & Magnus Johannesson & Brian Nosek & E. Wagenmakers & Richard Berk & Kenneth Bollen & Bjorn Brembs & Lawrence Brown & Colin Camerer & David Cesarini & Christopher Chambe, 2017. "Redefine Statistical Significance," Artefactual Field Experiments 00612, The Field Experiments Website.
    4. Joshua D. Angrist & Jörn-Steffen Pischke, 2010. "The Credibility Revolution in Empirical Economics: How Better Research Design Is Taking the Con out of Econometrics," Journal of Economic Perspectives, American Economic Association, vol. 24(2), pages 3-30, Spring.
    5. R. I. Kapeliushnikov, 2018. "On current state of economics: Subjective semi-sociological observations," Voprosy Ekonomiki, NP Voprosy Ekonomiki, issue 5.
    6. Abel Brodeur & Nikolai Cook & Anthony Heyes, 2020. "Methods Matter: p-Hacking and Publication Bias in Causal Analysis in Economics," American Economic Review, American Economic Association, vol. 110(11), pages 3634-3660, November.
    7. Robert J. Barro, 1991. "Economic Growth in a Cross Section of Countries," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 106(2), pages 407-443.
    8. Blakeley B. McShane & David Gal & Andrew Gelman & Christian Robert & Jennifer L. Tackett, 2019. "Abandon Statistical Significance," The American Statistician, Taylor & Francis Journals, vol. 73(S1), pages 235-245, March.
    9. T. D. Stanley, 2005. "Beyond Publication Bias," Journal of Economic Surveys, Wiley Blackwell, vol. 19(3), pages 309-345, July.
    10. E. Han Kim & Adair Morse & Luigi Zingales, 2006. "What Has Mattered to Economics Since 1970," Journal of Economic Perspectives, American Economic Association, vol. 20(4), pages 189-202, Fall.
    11. David Colander, 2018. "Retrospectives: The Lost Art of Economics," Chapters, in: How Economics Should Be Done, chapter 3, pages 25-32, Edward Elgar Publishing.
    12. Jon Baron, 2018. "A Brief History of Evidence-Based Policy," The ANNALS of the American Academy of Political and Social Science, , vol. 678(1), pages 40-50, July.
    13. Jörg Peters & Jörg Langbein & Gareth Roberts, 2018. "Generalization in the Tropics – Development Policy, Randomized Controlled Trials, and External Validity," The World Bank Research Observer, World Bank, vol. 33(1), pages 34-64.
    14. Herrera, Yoshiko M. & Kapur, Devesh, 2007. "Improving Data Quality: Actors, Incentives, and Capabilities," Political Analysis, Cambridge University Press, vol. 15(4), pages 365-386.
    15. Abhijit Vinayak Banerjee, 2020. "Field Experiments and the Practice of Economics," American Economic Review, American Economic Association, vol. 110(7), pages 1937-1951, July.
    16. Edward Miguel, 2021. "Evidence on Research Transparency in Economics," Journal of Economic Perspectives, American Economic Association, vol. 35(3), pages 193-214, Summer.
    17. Mahoney, James & Goertz, Gary, 2006. "A Tale of Two Cultures: Contrasting Quantitative and Qualitative Research," Political Analysis, Cambridge University Press, vol. 14(3), pages 227-249, July.
    18. Mas-Colell, Andreu & Whinston, Michael D. & Green, Jerry R., 1995. "Microeconomic Theory," OUP Catalogue, Oxford University Press, number 9780195102680.
    19. Arel-Bundock, Vincent & Briggs, Ryan C. & Doucouliagos, Hristos & Mendoza Aviña, Marco & Stanley, Tom D., 2022. "Quantitative Political Science Research is Greatly Underpowered," I4R Discussion Paper Series 6, The Institute for Replication (I4R).
    20. Lee Sigelman & Robert Goldfarb, 2012. "The influence of economics on political science: by what pathway?," Journal of Economic Methodology, Taylor & Francis Journals, vol. 19(1), pages 1-19, March.
    21. Kevin Lang, 2023. "How Credible is the Credibility Revolution?," NBER Working Papers 31666, National Bureau of Economic Research, Inc.
    22. Bierens, Herman J. & Swanson, Norman R., 2000. "The econometric consequences of the ceteris paribus condition in economic theory," Journal of Econometrics, Elsevier, vol. 95(2), pages 223-253, April.
    23. R. I. Kapeliushnikov., 2018. "On current state of economics: Subjective semi-sociological observations," VOPROSY ECONOMIKI, N.P. Redaktsiya zhurnala "Voprosy Economiki", vol. 5.
    24. Kim, E. Han & Morse, Adair & Zingales, Luigi, 2006. "What Has Mattered to Economics Since 1970," Working Papers 212, The University of Chicago Booth School of Business, George J. Stigler Center for the Study of the Economy and the State.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Alexander L. Brown & Taisuke Imai & Ferdinand M. Vieider & Colin F. Camerer, 2024. "Meta-analysis of Empirical Estimates of Loss Aversion," Journal of Economic Literature, American Economic Association, vol. 62(2), pages 485-516, June.
    2. Guillaume Coqueret, 2023. "Forking paths in financial economics," Papers 2401.08606, arXiv.org.
    3. Rose, Julian & Neubauer, Florian & Ankel-Peters, Jörg, 2024. "Long-Term Effects of the Targeting the Ultra-Poor Program - A Reproducibility and Replicability Assessment of Banerjee et al. (2021)," I4R Discussion Paper Series 142, The Institute for Replication (I4R).
    4. Ankel-Peters, Jörg & Fiala, Nathan & Neubauer, Florian, 2023. "Do economists replicate?," Journal of Economic Behavior & Organization, Elsevier, vol. 212(C), pages 219-232.
    5. Travis J. Lybbert & Steven T. Buccola, 2021. "The evolving ethics of analysis, publication, and transparency in applied economics," Applied Economic Perspectives and Policy, John Wiley & Sons, vol. 43(4), pages 1330-1351, December.
    6. Gustav Lidén, 2013. "What about theory? The consequences on a widened perspective of social theory," Quality & Quantity: International Journal of Methodology, Springer, vol. 47(1), pages 213-225, January.
    7. Masselus, Lise & Petrik, Christina & Ankel-Peters, Jörg, 2024. "Lost in the Design Space? Construct Validity in the Microfinance Literature," OSF Preprints nwp8k_v1, Center for Open Science.
    8. Alejandro Avenburg & John Gerring & Jason Seawright, 2023. "How do social scientists reach causal inferences? A study of reception," Quality & Quantity: International Journal of Methodology, Springer, vol. 57(1), pages 257-275, February.
    9. Bayer, Patrick & Kennedy, Ryan & Yang, Joonseok & Urpelainen, Johannes, 2020. "The need for impact evaluation in electricity access research," Energy Policy, Elsevier, vol. 137(C).
    10. Gechert, Sebastian & Mey, Bianka & Opatrny, Matej & Havranek, Tomas & Stanley, T. D. & Bom, Pedro R. D. & Doucouliagos, Hristos & Heimberger, Philipp & Irsova, Zuzana & Rachinger, Heiko J., 2023. "Conventional Wisdom, Meta-Analysis, and Research Revision in Economics," EconStor Preprints 280745, ZBW - Leibniz Information Centre for Economics.
    11. Steven T. Berry & Philip A. Haile, 2024. "Nonparametric Identification of Differentiated Products Demand Using Micro Data," Econometrica, Econometric Society, vol. 92(4), pages 1135-1162, July.
    12. Michael Lechner, 2023. "Causal Machine Learning and its use for public policy," Swiss Journal of Economics and Statistics, Springer;Swiss Society of Economics and Statistics, vol. 159(1), pages 1-15, December.
    13. Sara Mota Cardoso & Aurora A. C. Teixeira, 2020. "The Focus on Poverty in the Most Influential Journals in Economics: A Bibliometric Analysis of the “Blue Ribbon” Journals," Poverty & Public Policy, John Wiley & Sons, vol. 12(1), pages 10-42, March.
    14. Brown, Craig O., 2020. "Economic leadership and growth," Journal of Monetary Economics, Elsevier, vol. 116(C), pages 298-333.
    15. Dreber, Anna & Johannesson, Magnus, 2023. "A framework for evaluating reproducibility and replicability in economics," Ruhr Economic Papers 1055, RWI - Leibniz-Institut für Wirtschaftsforschung, Ruhr-University Bochum, TU Dortmund University, University of Duisburg-Essen.
    16. Rinne, Sonja, 2024. "Estimating the merit-order effect using coarsened exact matching: Reconciling theory with the empirical results to improve policy implications," Energy Policy, Elsevier, vol. 185(C).
    17. Irsova, Zuzana & Doucouliagos, Hristos & Havranek, Tomas & Stanley, T. D., 2023. "Meta-Analysis of Social Science Research: A Practitioner’s Guide," EconStor Preprints 273719, ZBW - Leibniz Information Centre for Economics.
    18. Abel Brodeur & Scott Carrell & David Figlio & Lester Lusher, 2023. "Unpacking P-hacking and Publication Bias," American Economic Review, American Economic Association, vol. 113(11), pages 2974-3002, November.
    19. Martina Cioni & Giovanni Federico & Michelangelo Vasta, 2022. "Persistence studies: a new kind of economic history?," Review of Regional Research: Jahrbuch für Regionalwissenschaft, Springer;Gesellschaft für Regionalforschung (GfR), vol. 42(3), pages 227-248, December.
    20. Masselus, Lise & Petrik, Christina & Ankel-Peters, Jörg, 2024. "Lost in the design space? Construct validity in the microfinance literature," Ruhr Economic Papers 1097, RWI - Leibniz-Institut für Wirtschaftsforschung, Ruhr-University Bochum, TU Dortmund University, University of Duisburg-Essen.

    More about this item

    Keywords

    empirical research; quantitative methods; credibility revolution; replication; generalization of results;
    All these keywords.

    JEL classification:

    • A14 - General Economics and Teaching - - General Economics - - - Sociology of Economics
    • B41 - Schools of Economic Thought and Methodology - - Economic Methodology - - - Economic Methodology

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:nea:journl:y:2024:i:65:p:178-194. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Alexey Tcharykov (email available below). General contact details of provider: https://edirc.repec.org/data/nearuea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.