IDEAS home Printed from https://ideas.repec.org/p/zbw/cbscwp/304408.html
   My bibliography  Save this paper

The conflict-of-interest discount in the marketplace of ideas

Author

Listed:
  • Barrios, John
  • Lancieri, Filippo Maria
  • Levy, Joshua
  • Singh, Shashank
  • Valletti, Tommaso M.
  • Zingales, Luigi

Abstract

We conduct a survey of economists and a representative sample of Americans to infer the reduction in the perceived value of a paper when its authors have conflicts of interest (CoI), i.e., they have financial, professional, or ideological stakes in the outcome of the results. On average, a CoI decreases trust in the conclusions of an economics paper by 30%. This reduction in trust reflects a combination of the frequency of conflicted papers and the bias of papers when they are conflicted. To isolate the second term, we introduce a key construct: the CoI Discount, which measures the reduction in the value of a conflicted paper relative to a nonconflicted one. We show that, on average, conflicted papers are worth less than half of non-conflicted ones, though this effect varies significantly depending on the nature of the conflict. The discount is more pronounced when the conflict involves the interest of a private rather than a public entity. Restricted data access also leads to a substantial discount. We validate our survey based estimates by comparing them to actual biases observed in conflicted papers within the economics and medical literature.

Suggested Citation

  • Barrios, John & Lancieri, Filippo Maria & Levy, Joshua & Singh, Shashank & Valletti, Tommaso M. & Zingales, Luigi, 2024. "The conflict-of-interest discount in the marketplace of ideas," Working Papers 348, The University of Chicago Booth School of Business, George J. Stigler Center for the Study of the Economy and the State.
  • Handle: RePEc:zbw:cbscwp:304408
    as

    Download full text from publisher

    File URL: https://www.econstor.eu/bitstream/10419/304408/1/1906201935.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Garret Christensen & Edward Miguel, 2018. "Transparency, Reproducibility, and the Credibility of Economics Research," Journal of Economic Literature, American Economic Association, vol. 56(3), pages 920-980, September.
    2. Ron Haskins, 2018. "Evidence-Based Policy: The Movement, the Goals, the Issues, the Promise," The ANNALS of the American Academy of Political and Social Science, , vol. 678(1), pages 8-37, July.
    3. Fabo, Brian & Jančoková, Martina & Kempf, Elisabeth & Pástor, Ľuboš, 2021. "Fifty shades of QE: Comparing findings of central bankers and academics," Journal of Monetary Economics, Elsevier, vol. 120(C), pages 1-20.
    4. Leuz, Christian & Malani, Anup & Muhn, Maximilian & Jakab, László, 2022. "Do conflict of interests disclosures work? Evidence from citations in medical journals," CFS Working Paper Series 702, Center for Financial Studies (CFS).
    5. Kellia Chiu & Quinn Grundy & Lisa Bero, 2017. "‘Spin’ in published biomedical literature: A methodological systematic review," PLOS Biology, Public Library of Science, vol. 15(9), pages 1-16, September.
    6. John J. Horton, 2023. "Large Language Models as Simulated Economic Agents: What Can We Learn from Homo Silicus?," NBER Working Papers 31122, National Bureau of Economic Research, Inc.
    7. Asatryan, Zareh & Havlik, Annika & Heinemann, Friedrich & Nover, Justus, 2020. "Biases in fiscal multiplier estimates," European Journal of Political Economy, Elsevier, vol. 63(C).
    8. Tamar Oostrom, 2024. "Funding of Clinical Trials and Reported Drug Efficacy," Journal of Political Economy, University of Chicago Press, vol. 132(10), pages 3298-3333.
    9. Kempf, Elisabeth, 2020. "The job rating game: Revolving doors and analyst incentives," Journal of Financial Economics, Elsevier, vol. 135(1), pages 41-67.
    10. De Long, J Bradford & Lang, Kevin, 1992. "Are All Economic Hypotheses False?," Journal of Political Economy, University of Chicago Press, vol. 100(6), pages 1257-1272, December.
    11. Maira Bes-Rastrollo & Matthias B Schulze & Miguel Ruiz-Canela & Miguel A Martinez-Gonzalez, 2013. "Financial Conflicts of Interest and Reporting Bias Regarding the Association between Sugar-Sweetened Beverages and Weight Gain: A Systematic Review of Systematic Reviews," PLOS Medicine, Public Library of Science, vol. 10(12), pages 1-9, December.
    12. David Krauth & Andrew Anglemyer & Rose Philipps & Lisa Bero, 2014. "Nonindustry-Sponsored Preclinical Studies on Statins Yield Greater Efficacy Estimates Than Industry-Sponsored Studies: A Meta-Analysis," PLOS Biology, Public Library of Science, vol. 12(1), pages 1-10, January.
    13. Adriane Fugh-Berman & Christina Pike McDonald & Alicia M Bell & Emily Catherine Bethards & Anthony R Scialli, 2011. "Promotional Tone in Reviews of Menopausal Hormone Therapy After the Women's Health Initiative: An Analysis of Published Articles," PLOS Medicine, Public Library of Science, vol. 8(3), pages 1-9, March.
    14. Lisa Bero & Fieke Oostvogel & Peter Bacchetti & Kirby Lee, 2007. "Factors Associated with Findings of Published Trials of Drug–Drug Comparisons: Why Some Statins Appear More Efficacious than Others," PLOS Medicine, Public Library of Science, vol. 4(6), pages 1-10, June.
    15. John J. Horton, 2023. "Large Language Models as Simulated Economic Agents: What Can We Learn from Homo Silicus?," Papers 2301.07543, arXiv.org.
    16. Janine Berg & Hannah Johnston, 2019. "Too Good to Be True? A Comment on Hall and Krueger’s Analysis of the Labor Market for Uber’s Driver-Partners," ILR Review, Cornell University, ILR School, vol. 72(1), pages 39-68, January.
    17. Lenard I Lesser & Cara B Ebbeling & Merrill Goozner & David Wypij & David S Ludwig, 2007. "Relationship between Funding Source and Conclusion among Nutrition-Related Scientific Articles," PLOS Medicine, Public Library of Science, vol. 4(1), pages 1-6, January.
    18. Mohsen Javdani & Ha-Joon Chang, 2023. "Who said or what said? Estimating ideological bias in views among economists," Cambridge Journal of Economics, Cambridge Political Economy Society, vol. 47(2), pages 309-339.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Garg, Prashant & Fetzer, Thiemo, 2024. "Causal Claims in Economics," I4R Discussion Paper Series 183, The Institute for Replication (I4R).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Brian Fabo & Martina Jancokova & Elisabeth Kempf & Lubos Pastor, 2020. "Fifty Shades of QE: Conflicts of Interest in Economic Research," Working Papers 2020-128, Becker Friedman Institute for Research In Economics.
    2. Fabo, Brian & Jančoková, Martina & Kempf, Elisabeth & Pástor, Ľuboš, 2021. "Fifty shades of QE: Comparing findings of central bankers and academics," Journal of Monetary Economics, Elsevier, vol. 120(C), pages 1-20.
    3. Bruno Ferman & Cristine Pinto & Vitor Possebom, 2020. "Cherry Picking with Synthetic Controls," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 39(2), pages 510-532, March.
    4. Stanley, T. D. & Doucouliagos, Chris, 2019. "Practical Significance, Meta-Analysis and the Credibility of Economics," IZA Discussion Papers 12458, Institute of Labor Economics (IZA).
    5. Christopher Snyder & Ran Zhuo, 2018. "Sniff Tests as a Screen in the Publication Process: Throwing out the Wheat with the Chaff," NBER Working Papers 25058, National Bureau of Economic Research, Inc.
    6. Kevin Leyton-Brown & Paul Milgrom & Neil Newman & Ilya Segal, 2024. "Artificial Intelligence and Market Design: Lessons Learned from Radio Spectrum Reallocation," NBER Chapters, in: New Directions in Market Design, National Bureau of Economic Research, Inc.
    7. Nelson, Jon Paul, 2020. "Fixed-effect versus random-effects meta-analysis in economics: A study of pass-through rates for alcohol beverage excise taxes," Economics Discussion Papers 2020-1, Kiel Institute for the World Economy (IfW Kiel).
    8. Kirshner, Samuel N., 2024. "GPT and CLT: The impact of ChatGPT's level of abstraction on consumer recommendations," Journal of Retailing and Consumer Services, Elsevier, vol. 76(C).
    9. Isaiah Andrews & Maximilian Kasy, 2019. "Identification of and Correction for Publication Bias," American Economic Review, American Economic Association, vol. 109(8), pages 2766-2794, August.
    10. Daniel M Cook & Elizabeth A Boyd & Claudia Grossmann & Lisa A Bero, 2007. "Reporting Science and Conflicts of Interest in the Lay Press," PLOS ONE, Public Library of Science, vol. 2(12), pages 1-5, December.
    11. Zengqing Wu & Run Peng & Xu Han & Shuyuan Zheng & Yixin Zhang & Chuan Xiao, 2023. "Smart Agent-Based Modeling: On the Use of Large Language Models in Computer Simulations," Papers 2311.06330, arXiv.org, revised Dec 2023.
    12. Abel Brodeur & Scott Carrell & David Figlio & Lester Lusher, 2023. "Unpacking P-hacking and Publication Bias," American Economic Review, American Economic Association, vol. 113(11), pages 2974-3002, November.
    13. Béné, Christophe, 2022. "Why the Great Food Transformation may not happen – A deep-dive into our food systems’ political economy, controversies and politics of evidence," World Development, Elsevier, vol. 154(C).
    14. Antoine Popelut & Fabien Valet & Olivier Fromentin & Aurélie Thomas & Philippe Bouchard, 2010. "Relationship between Sponsorship and Failure Rate of Dental Implants: A Systematic Approach," PLOS ONE, Public Library of Science, vol. 5(4), pages 1-9, April.
    15. Joshua C. Yang & Damian Dailisan & Marcin Korecki & Carina I. Hausladen & Dirk Helbing, 2024. "LLM Voting: Human Choices and AI Collective Decision Making," Papers 2402.01766, arXiv.org, revised Aug 2024.
    16. Nir Chemaya & Daniel Martin, 2023. "Perceptions and Detection of AI Use in Manuscript Preparation for Academic Journals," Papers 2311.14720, arXiv.org, revised Jan 2024.
    17. Lijia Ma & Xingchen Xu & Yong Tan, 2024. "Crafting Knowledge: Exploring the Creative Mechanisms of Chat-Based Search Engines," Papers 2402.19421, arXiv.org.
    18. Ali Goli & Amandeep Singh, 2023. "Exploring the Influence of Language on Time-Reward Perceptions in Large Language Models: A Study Using GPT-3.5," Papers 2305.02531, arXiv.org, revised Jun 2023.
    19. Evangelos Katsamakas, 2024. "Business models for the simulation hypothesis," Papers 2404.08991, arXiv.org.
    20. Yuan Gao & Dokyun Lee & Gordon Burtch & Sina Fazelpour, 2024. "Take Caution in Using LLMs as Human Surrogates: Scylla Ex Machina," Papers 2410.19599, arXiv.org, revised Jan 2025.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:zbw:cbscwp:304408. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: ZBW - Leibniz Information Centre for Economics (email available below). General contact details of provider: https://edirc.repec.org/data/gsuchus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.