IDEAS home Printed from https://ideas.repec.org/p/zbw/cbscwp/304408.html
   My bibliography  Save this paper

The conflict-of-interest discount in the marketplace of ideas

Author

Listed:
  • Barrios, John
  • Lancieri, Filippo Maria
  • Levy, Joshua
  • Singh, Shashank
  • Valletti, Tommaso M.
  • Zingales, Luigi

Abstract

We conduct a survey of economists and a representative sample of Americans to infer the reduction in the perceived value of a paper when its authors have conflicts of interest (CoI), i.e., they have financial, professional, or ideological stakes in the outcome of the results. On average, a CoI decreases trust in the conclusions of an economics paper by 30%. This reduction in trust reflects a combination of the frequency of conflicted papers and the bias of papers when they are conflicted. To isolate the second term, we introduce a key construct: the CoI Discount, which measures the reduction in the value of a conflicted paper relative to a nonconflicted one. We show that, on average, conflicted papers are worth less than half of non-conflicted ones, though this effect varies significantly depending on the nature of the conflict. The discount is more pronounced when the conflict involves the interest of a private rather than a public entity. Restricted data access also leads to a substantial discount. We validate our survey based estimates by comparing them to actual biases observed in conflicted papers within the economics and medical literature.

Suggested Citation

  • Barrios, John & Lancieri, Filippo Maria & Levy, Joshua & Singh, Shashank & Valletti, Tommaso M. & Zingales, Luigi, 2024. "The conflict-of-interest discount in the marketplace of ideas," Working Papers 348, The University of Chicago Booth School of Business, George J. Stigler Center for the Study of the Economy and the State.
  • Handle: RePEc:zbw:cbscwp:304408
    as

    Download full text from publisher

    File URL: https://www.econstor.eu/bitstream/10419/304408/1/1906201935.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Garret Christensen & Edward Miguel, 2018. "Transparency, Reproducibility, and the Credibility of Economics Research," Journal of Economic Literature, American Economic Association, vol. 56(3), pages 920-980, September.
    2. Ron Haskins, 2018. "Evidence-Based Policy: The Movement, the Goals, the Issues, the Promise," The ANNALS of the American Academy of Political and Social Science, , vol. 678(1), pages 8-37, July.
    3. Fabo, Brian & Jančoková, Martina & Kempf, Elisabeth & Pástor, Ľuboš, 2021. "Fifty shades of QE: Comparing findings of central bankers and academics," Journal of Monetary Economics, Elsevier, vol. 120(C), pages 1-20.
    4. Leuz, Christian & Malani, Anup & Muhn, Maximilian & Jakab, László, 2022. "Do conflict of interests disclosures work? Evidence from citations in medical journals," CFS Working Paper Series 702, Center for Financial Studies (CFS).
    5. Kellia Chiu & Quinn Grundy & Lisa Bero, 2017. "‘Spin’ in published biomedical literature: A methodological systematic review," PLOS Biology, Public Library of Science, vol. 15(9), pages 1-16, September.
    6. John J. Horton, 2023. "Large Language Models as Simulated Economic Agents: What Can We Learn from Homo Silicus?," NBER Working Papers 31122, National Bureau of Economic Research, Inc.
    7. Asatryan, Zareh & Havlik, Annika & Heinemann, Friedrich & Nover, Justus, 2020. "Biases in fiscal multiplier estimates," European Journal of Political Economy, Elsevier, vol. 63(C).
    8. Tamar Oostrom, 2024. "Funding of Clinical Trials and Reported Drug Efficacy," Journal of Political Economy, University of Chicago Press, vol. 132(10), pages 3298-3333.
    9. Kempf, Elisabeth, 2020. "The job rating game: Revolving doors and analyst incentives," Journal of Financial Economics, Elsevier, vol. 135(1), pages 41-67.
    10. De Long, J Bradford & Lang, Kevin, 1992. "Are All Economic Hypotheses False?," Journal of Political Economy, University of Chicago Press, vol. 100(6), pages 1257-1272, December.
    11. Maira Bes-Rastrollo & Matthias B Schulze & Miguel Ruiz-Canela & Miguel A Martinez-Gonzalez, 2013. "Financial Conflicts of Interest and Reporting Bias Regarding the Association between Sugar-Sweetened Beverages and Weight Gain: A Systematic Review of Systematic Reviews," PLOS Medicine, Public Library of Science, vol. 10(12), pages 1-9, December.
    12. David Krauth & Andrew Anglemyer & Rose Philipps & Lisa Bero, 2014. "Nonindustry-Sponsored Preclinical Studies on Statins Yield Greater Efficacy Estimates Than Industry-Sponsored Studies: A Meta-Analysis," PLOS Biology, Public Library of Science, vol. 12(1), pages 1-10, January.
    13. Adriane Fugh-Berman & Christina Pike McDonald & Alicia M Bell & Emily Catherine Bethards & Anthony R Scialli, 2011. "Promotional Tone in Reviews of Menopausal Hormone Therapy After the Women's Health Initiative: An Analysis of Published Articles," PLOS Medicine, Public Library of Science, vol. 8(3), pages 1-9, March.
    14. Lisa Bero & Fieke Oostvogel & Peter Bacchetti & Kirby Lee, 2007. "Factors Associated with Findings of Published Trials of Drug–Drug Comparisons: Why Some Statins Appear More Efficacious than Others," PLOS Medicine, Public Library of Science, vol. 4(6), pages 1-10, June.
    15. John J. Horton, 2023. "Large Language Models as Simulated Economic Agents: What Can We Learn from Homo Silicus?," Papers 2301.07543, arXiv.org.
    16. Janine Berg & Hannah Johnston, 2019. "Too Good to Be True? A Comment on Hall and Krueger’s Analysis of the Labor Market for Uber’s Driver-Partners," ILR Review, Cornell University, ILR School, vol. 72(1), pages 39-68, January.
    17. Lenard I Lesser & Cara B Ebbeling & Merrill Goozner & David Wypij & David S Ludwig, 2007. "Relationship between Funding Source and Conclusion among Nutrition-Related Scientific Articles," PLOS Medicine, Public Library of Science, vol. 4(1), pages 1-6, January.
    18. Mohsen Javdani & Ha-Joon Chang, 2023. "Who said or what said? Estimating ideological bias in views among economists," Cambridge Journal of Economics, Cambridge Political Economy Society, vol. 47(2), pages 309-339.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Prashant Garg & Thiemo Fetzer, 2024. "Causal Claims in Economics," CESifo Working Paper Series 11462, CESifo.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Brian Fabo & Martina Jancokova & Elisabeth Kempf & Lubos Pastor, 2020. "Fifty Shades of QE: Conflicts of Interest in Economic Research," Working Papers 2020-128, Becker Friedman Institute for Research In Economics.
    2. Fabo, Brian & Jančoková, Martina & Kempf, Elisabeth & Pástor, Ľuboš, 2021. "Fifty shades of QE: Comparing findings of central bankers and academics," Journal of Monetary Economics, Elsevier, vol. 120(C), pages 1-20.
    3. Bruno Ferman & Cristine Pinto & Vitor Possebom, 2020. "Cherry Picking with Synthetic Controls," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 39(2), pages 510-532, March.
    4. Nelson, Jon Paul, 2020. "Fixed-effect versus random-effects meta-analysis in economics: A study of pass-through rates for alcohol beverage excise taxes," Economics Discussion Papers 2020-1, Kiel Institute for the World Economy (IfW Kiel).
    5. Kirshner, Samuel N., 2024. "GPT and CLT: The impact of ChatGPT's level of abstraction on consumer recommendations," Journal of Retailing and Consumer Services, Elsevier, vol. 76(C).
    6. Isaiah Andrews & Maximilian Kasy, 2019. "Identification of and Correction for Publication Bias," American Economic Review, American Economic Association, vol. 109(8), pages 2766-2794, August.
    7. Abel Brodeur & Scott Carrell & David Figlio & Lester Lusher, 2023. "Unpacking P-hacking and Publication Bias," American Economic Review, American Economic Association, vol. 113(11), pages 2974-3002, November.
    8. Antoine Popelut & Fabien Valet & Olivier Fromentin & Aurélie Thomas & Philippe Bouchard, 2010. "Relationship between Sponsorship and Failure Rate of Dental Implants: A Systematic Approach," PLOS ONE, Public Library of Science, vol. 5(4), pages 1-9, April.
    9. Nir Chemaya & Daniel Martin, 2023. "Perceptions and Detection of AI Use in Manuscript Preparation for Academic Journals," Papers 2311.14720, arXiv.org, revised Jan 2024.
    10. Lijia Ma & Xingchen Xu & Yong Tan, 2024. "Crafting Knowledge: Exploring the Creative Mechanisms of Chat-Based Search Engines," Papers 2402.19421, arXiv.org.
    11. Ali Goli & Amandeep Singh, 2023. "Exploring the Influence of Language on Time-Reward Perceptions in Large Language Models: A Study Using GPT-3.5," Papers 2305.02531, arXiv.org, revised Jun 2023.
    12. Evangelos Katsamakas, 2024. "Business models for the simulation hypothesis," Papers 2404.08991, arXiv.org.
    13. Yuan Gao & Dokyun Lee & Gordon Burtch & Sina Fazelpour, 2024. "Take Caution in Using LLMs as Human Surrogates: Scylla Ex Machina," Papers 2410.19599, arXiv.org, revised Nov 2024.
    14. Marie A. Bragg & Brian Elbel & Marion Nestle, 2020. "Food Industry Donations to Academic Programs: A Cross-Sectional Examination of the Extent of Publicly Available Data," IJERPH, MDPI, vol. 17(5), pages 1-15, March.
    15. Andrew Y. Chen & Tom Zimmermann, 2022. "Publication Bias in Asset Pricing Research," Papers 2209.13623, arXiv.org, revised Sep 2023.
    16. Todd Mitton, 2022. "Methodological Variation in Empirical Corporate Finance," The Review of Financial Studies, Society for Financial Studies, vol. 35(2), pages 527-575.
    17. Christoph Engel & Max R. P. Grossmann & Axel Ockenfels, 2023. "Integrating machine behavior into human subject experiments: A user-friendly toolkit and illustrations," Discussion Paper Series of the Max Planck Institute for Research on Collective Goods 2024_01, Max Planck Institute for Research on Collective Goods.
    18. Yiting Chen & Tracy Xiao Liu & You Shan & Songfa Zhong, 2023. "The emergence of economic rationality of GPT," Proceedings of the National Academy of Sciences, Proceedings of the National Academy of Sciences, vol. 120(51), pages 2316205120-, December.
    19. Jiafu An & Difang Huang & Chen Lin & Mingzhu Tai, 2024. "Measuring Gender and Racial Biases in Large Language Models," Papers 2403.15281, arXiv.org.
    20. Dominika Ehrenbergerova & Josef Bajzik & Tomas Havranek, 2023. "When Does Monetary Policy Sway House Prices? A Meta-Analysis," IMF Economic Review, Palgrave Macmillan;International Monetary Fund, vol. 71(2), pages 538-573, June.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:zbw:cbscwp:304408. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: ZBW - Leibniz Information Centre for Economics (email available below). General contact details of provider: https://edirc.repec.org/data/gsuchus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.