IDEAS home Printed from https://ideas.repec.org/a/eee/ecolec/v226y2024ics0921800924002490.html
   My bibliography  Save this article

Comparing advice on climate policy between academic experts and ChatGPT

Author

Listed:
  • Salekpay, Foroogh
  • van den Bergh, Jeroen
  • Savin, Ivan

Abstract

We compare the results from a recent global expert survey on climate policy with answers to the same survey by the online artificial-intelligence chatbot ChatGPT. Such a study is timely and relevant as many people around the world are likely to use ChatGPT and similar language models to inquire about climate solutions, which in turn might influence public opinion. The comparison provides insights about performance criteria, policy instruments, and use of information from distinct academic disciplines. With a few exceptions, responses by ChatGPT are informative and of high quality. We find that ChatGPT answers questions with less bias than experts from various scientific disciplines. The latter may also be a disadvantage as it seems to weight all the information available equally without accounting well for relevance, which arguably may require human rather than artificial intelligence. On the other hand, experts from distinct disciplines show difference in average responses, with some even expressing opinions inconsistent with objective evidence, meaning there is no consistent and unbiased expert opinion on climate policy. As a new way of synthesizing large amounts of academic and grey literature, ChatGPT can serve policymaking. However, since the procedure that it follows for collecting and summarizing information remains a black box, it is best regarded as a complement rather than a substitute to traditional literature reviews and expert surveys.

Suggested Citation

  • Salekpay, Foroogh & van den Bergh, Jeroen & Savin, Ivan, 2024. "Comparing advice on climate policy between academic experts and ChatGPT," Ecological Economics, Elsevier, vol. 226(C).
    • Handle: RePEc:eee:ecolec:v:226:y:2024:i:c:s0921800924002490
    DOI: 10.1016/j.ecolecon.2024.108352
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0921800924002490
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.ecolecon.2024.108352?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Lüdering Jochen & Winker Peter, 2016. "Forward or Backward Looking? The Economic Discourse and the Observed Reality," Journal of Economics and Statistics (Jahrbuecher fuer Nationaloekonomie und Statistik), De Gruyter, vol. 236(4), pages 483-515, August.
    2. Lewis C. King & Ivan Savin & Stefan Drews, 2023. "Shades of green growth scepticism among climate policy researchers," Nature Sustainability, Nature, vol. 6(11), pages 1316-1320, November.
    3. Dechezleprêtre, Antoine & Fabre, Adrien & Kruse, Tobias & Planterose, Bluebery & Chico, Ana Sanchez & Stantcheva, Stefanie, 2022. "Fighting Climate Change: International Attitudes Toward Climate Policies," CEPR Discussion Papers 17602, C.E.P.R. Discussion Papers.
    4. Gugler, Klaus & Haxhimusa, Adhurim & Liebensteiner, Mario, 2021. "Effectiveness of climate policies: Carbon pricing vs. subsidizing renewables," Journal of Environmental Economics and Management, Elsevier, vol. 106(C).
    5. Andrea Baranzini & Jeroen C. J. M. van den Bergh & Stefano Carattini & Richard B. Howarth & Emilio Padilla & Jordi Roca, 2017. "Carbon pricing in climate policy: seven reasons, complementary instruments, and political economy considerations," Wiley Interdisciplinary Reviews: Climate Change, John Wiley & Sons, vol. 8(4), July.
    6. Peter Andre & Teodora Boneva & Felix Chopra & Armin Falk, 2024. "Globally representative evidence on the actual and perceived support for climate action," Nature Climate Change, Nature, vol. 14(3), pages 253-259, March.
    7. Drews, Stefan & Savin, Ivan & van den Bergh, Jeroen, 2024. "A Global Survey of Scientific Consensus and Controversy on Instruments of Climate Policy," Ecological Economics, Elsevier, vol. 218(C).
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Landon Yoder & Alora Cain & Ananya Rao & Nathaniel Geiger & Ben Kravitz & Mack Mercer & Deidra Miniard & Sangeet Nepal & Thomas Nunn & Mary Sluder & Grace Weiler & Shahzeen Z. Attari, 2024. "Muddling through Climate Change: A Qualitative Exploration of India and U.S. Climate Experts’ Perspectives on Solutions, Pathways, and Barriers," Sustainability, MDPI, vol. 16(13), pages 1-20, June.
    2. Jakub Sokołowski & Piotr Lewandowski & Jan Frankowski, 2023. "How to Prevent Yellow Vests? Evaluating Preferences for a Carbon Tax with a Discrete Choice Experiment," IBS Working Papers 03/2023, Instytut Badan Strukturalnych.
    3. Andreassen, Gøril L. & Kallbekken, Steffen & Rosendahl, Knut Einar, 2024. "Can policy packaging help overcome Pigouvian tax aversion? A lab experiment on combining taxes and subsidies," Journal of Environmental Economics and Management, Elsevier, vol. 127(C).
    4. Wu, Huihuang & Zhou, Yuhan & Wang, Xian & Hu, Xiurong & Zhang, Shihui & Ren, Yang & Liu, Junfeng & Liu, Ying & Tao, Shu, 2024. "The climate, health, and economic outcomes across different carbon pricing policies to achieve China's climate goals," Applied Energy, Elsevier, vol. 368(C).
    5. Silvi, Mariateresa & Padilla Rosa, Emilio, 2023. "A tragedy of the horizons? An intertemporal perspective on public support for carbon taxes," Energy Economics, Elsevier, vol. 125(C).
    6. Drews, Stefan, 2025. "Towards systems-oriented behavioral ecological economics," Ecological Economics, Elsevier, vol. 227(C).
    7. Xinkuo Xu & Liyan Han, 2017. "Diverse Effects of Consumer Credit on Household Carbon Emissions at Quantiles: Evidence from Urban China," Sustainability, MDPI, vol. 9(9), pages 1-25, September.
    8. Serhan Cevik, 2024. "Climate change and energy security: the dilemma or opportunity of the century?," Environmental Economics and Policy Studies, Springer;Society for Environmental Economics and Policy Studies - SEEPS, vol. 26(3), pages 653-672, July.
    9. Gabriel Târziu, 2024. "What does it mean, what does it take, and why is it important to understand climate change?," Palgrave Communications, Palgrave Macmillan, vol. 11(1), pages 1-5, December.
    10. Sterner, Thomas & Ewald, Jens & Sterner, Erik, 2024. "Economists and the climate," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 109(C).
    11. Jorge M. Uribe, 2023. ""Fiscal crises and climate change"," IREA Working Papers 202303, University of Barcelona, Research Institute of Applied Economics, revised Feb 2023.
    12. Zhang, Jiekuan, 2023. "Emissions trading scheme and energy consumption and output structure: Evidence from China," Renewable Energy, Elsevier, vol. 219(P1).
    13. Tian, Jianchi & Li, Yang & Sun, Yan & Yang, Bo & Chen, Xuefeng, 2024. "Warming climate apathy to mitigate the disparity in climate policy support across distinct income strata," Energy Policy, Elsevier, vol. 192(C).
    14. Tobias Angel & Alexandre Berthe & Valeria Costantini & Mariagrazia D’Angeli, 2024. "How the nature of inequality reduction matters for CO2 emissions," Working Papers 2024.14, Fondazione Eni Enrico Mattei.
    15. Ingar Haaland & Christopher Roth & Stefanie Stantcheva & Johannes Wohlfart, 2024. "Measuring What Is Top of Mind," CEBI working paper series 24-10, University of Copenhagen. Department of Economics. The Center for Economic Behavior and Inequality (CEBI).
    16. Dugan, Anna & Mayer, Jakob & Thaller, Annina & Bachner, Gabriel & Steininger, Karl W., 2022. "Developing policy packages for low-carbon passenger transport: A mixed methods analysis of trade-offs and synergies," Ecological Economics, Elsevier, vol. 193(C).
    17. Linden, Jules & O’Donoghue, Cathal & Sologon, Denisa M., 2024. "The many faces of carbon tax regressivity—Why carbon taxes are not always regressive for the same reason," Energy Policy, Elsevier, vol. 192(C).
    18. Bell, Christopher & Rhodes, Ekaterina & Long, Zoe & Salemi, Colette, 2025. "Do economic trade-offs matter in climate policy support? Survey evidence from the United Kingdom and Australia," Energy Policy, Elsevier, vol. 197(C).
    19. Teodora Boneva & Ana Brás-Monteiro & Marta Golin & Christopher Rauh, 2024. "Are Men’s Preferences for Couple Equity Misperceived? Evidence from Six Countries," CESifo Working Paper Series 11536, CESifo.
    20. Hänsel, Martin C. & Franks, Max & Kalkuhl, Matthias & Edenhofer, Ottmar, 2022. "Optimal carbon taxation and horizontal equity: A welfare-theoretic approach with application to German household data," Journal of Environmental Economics and Management, Elsevier, vol. 116(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:ecolec:v:226:y:2024:i:c:s0921800924002490. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/ecolecon .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.