IDEAS home Printed from https://ideas.repec.org/a/gam/jecnmx/v7y2019i4p44-d290361.html
   My bibliography  Save this article

The Replication Crisis as Market Failure

Author

Listed:
  • John Quiggin

    (School of Economics, The University of Queensland, St Lucia QLD 4072, Australia)

Abstract

This paper begins with the observation that the constrained maximisation central to model estimation and hypothesis testing may be interpreted as a kind of profit maximisation. The output of estimation is a model that maximises some measure of model fit, subject to costs that may be interpreted as the shadow price of constraints imposed on the model. The replication crisis may be regarded as a market failure in which the price of “significant” results is lower than would be socially optimal.

Suggested Citation

  • John Quiggin, 2019. "The Replication Crisis as Market Failure," Econometrics, MDPI, vol. 7(4), pages 1-8, November.
  • Handle: RePEc:gam:jecnmx:v:7:y:2019:i:4:p:44-:d:290361
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/2225-1146/7/4/44/pdf
    Download Restriction: no

    File URL: https://www.mdpi.com/2225-1146/7/4/44/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. John P A Ioannidis, 2005. "Why Most Published Research Findings Are False," PLOS Medicine, Public Library of Science, vol. 2(8), pages 1-1, August.
    2. Kim, Jae H. & Ji, Philip Inyeob, 2015. "Significance testing in empirical finance: A critical review and assessment," Journal of Empirical Finance, Elsevier, vol. 34(C), pages 1-14.
    3. T. S. Breusch & A. R. Pagan, 1980. "The Lagrange Multiplier Test and its Applications to Model Specification in Econometrics," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 47(1), pages 239-253.
    4. McCloskey, Donald N, 1985. "The Loss Function Has Been Mislaid: The Rhetoric of Significance Tests," American Economic Review, American Economic Association, vol. 75(2), pages 201-205, May.
    5. Michael Kosfeld & Markus Heinrichs & Paul J. Zak & Urs Fischbacher & Ernst Fehr, 2005. "Oxytocin increases trust in humans," Nature, Nature, vol. 435(7042), pages 673-676, June.
    6. Engle, Robert F., 1984. "Wald, likelihood ratio, and Lagrange multiplier tests in econometrics," Handbook of Econometrics, in: Z. Griliches† & M. D. Intriligator (ed.), Handbook of Econometrics, edition 1, volume 2, chapter 13, pages 775-826, Elsevier.
    7. Anthony Lane & Moïra Mikolajczak & Evelyne Treinen & Dana Samson & Olivier Corneille & Philippe de Timary & Olivier Luminet, 2015. "Failed Replication of Oxytocin Effects on Trust: The Envelope Task Case," PLOS ONE, Public Library of Science, vol. 10(9), pages 1-10, September.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Johnstone, David, 2022. "Accounting research and the significance test crisis," CRITICAL PERSPECTIVES ON ACCOUNTING, Elsevier, vol. 89(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Adrian C. Darnell, 1994. "A Dictionary Of Econometrics," Books, Edward Elgar Publishing, number 118.
    2. Geweke, J. & Joel Horowitz & Pesaran, M.H., 2006. "Econometrics: A Bird’s Eye View," Cambridge Working Papers in Economics 0655, Faculty of Economics, University of Cambridge.
    3. Yash P. Mehra, 1995. "Some key empirical determinants of short-term nominal interest rates," Economic Quarterly, Federal Reserve Bank of Richmond, issue Sum, pages 33-51.
    4. Michaelides, Michael, 2021. "Large sample size bias in empirical finance," Finance Research Letters, Elsevier, vol. 41(C).
    5. Eszter Czibor & David Jimenez‐Gomez & John A. List, 2019. "The Dozen Things Experimental Economists Should Do (More of)," Southern Economic Journal, John Wiley & Sons, vol. 86(2), pages 371-432, October.
    6. Baltagi, Badi H. & Li, Qi, 1995. "Testing AR(1) against MA(1) disturbances in an error component model," Journal of Econometrics, Elsevier, vol. 68(1), pages 133-151, July.
    7. Coren L Apicella & David Cesarini & Magnus Johannesson & Christopher T Dawes & Paul Lichtenstein & Björn Wallace & Jonathan Beauchamp & Lars Westberg, 2010. "No Association between Oxytocin Receptor (OXTR) Gene Polymorphisms and Experimentally Elicited Social Preferences," PLOS ONE, Public Library of Science, vol. 5(6), pages 1-8, June.
    8. Stephan B. Bruns & David I. Stern, 2019. "Lag length selection and p-hacking in Granger causality testing: prevalence and performance of meta-regression models," Empirical Economics, Springer, vol. 56(3), pages 797-830, March.
    9. Gabriele Fiorentini & Enrique Sentana, 2012. "Tests for Serial Dependence in Static, Non-Gaussian Factor Models," Working Papers wp2012_1211, CEMFI.
    10. Antonio Páez & Takashi Uchida & Kazuaki Miyamoto, 2002. "A General Framework for Estimation and Inference of Geographically Weighted Regression Models: 1. Location-Specific Kernel Bandwidths and a Test for Locational Heterogeneity," Environment and Planning A, , vol. 34(4), pages 733-754, April.
    11. Gabriele Fiorentini & Enrique Sentana, 2019. "Dynamic specification tests for dynamic factor models," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 34(3), pages 325-346, April.
    12. Black, Bernard & Hollingsworth, Alex & Nunes, Letícia & Simon, Kosali, 2022. "Simulated power analyses for observational studies: An application to the Affordable Care Act Medicaid expansion," Journal of Public Economics, Elsevier, vol. 213(C).
    13. Gabriele Fiorentini & Enrique Sentana, 2009. "Dynamic Specification Tests for Static Factor Models," Working Papers wp2009_0912, CEMFI.
    14. Burkhard C. Schipper, 2015. "Sex Hormones and Competitive Bidding," Management Science, INFORMS, vol. 61(2), pages 249-266, February.
    15. Abel Brodeur & Nikolai Cook & Anthony Heyes, 2020. "Methods Matter: p-Hacking and Publication Bias in Causal Analysis in Economics," American Economic Review, American Economic Association, vol. 110(11), pages 3634-3660, November.
    16. Yock Y. Chong & David F. Hendry, 1986. "Econometric Evaluation of Linear Macro-Economic Models," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 53(4), pages 671-690.
    17. King, Maxwell L. & Zhang, Xibin & Akram, Muhammad, 2020. "Hypothesis testing based on a vector of statistics," Journal of Econometrics, Elsevier, vol. 219(2), pages 425-455.
    18. Hamilton, James D., 1996. "Specification testing in Markov-switching time-series models," Journal of Econometrics, Elsevier, vol. 70(1), pages 127-157, January.
    19. Gigi Foster, 2018. "Ethics in Economics," Agenda - A Journal of Policy Analysis and Reform, Australian National University, College of Business and Economics, School of Economics, vol. 24(1), pages 61-75.
    20. Jinyong Hahn & Ruoyao Shi, 2021. "Breusch and Pagan’s (1980) Test Revisited," Working Papers 202110, University of California at Riverside, Department of Economics.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jecnmx:v:7:y:2019:i:4:p:44-:d:290361. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.