IDEAS home Printed from https://ideas.repec.org/a/eee/ecolec/v226y2024ics0921800924002490.html
   My bibliography  Save this article

Comparing advice on climate policy between academic experts and ChatGPT

Author

Listed:
  • Salekpay, Foroogh
  • van den Bergh, Jeroen
  • Savin, Ivan

Abstract

We compare the results from a recent global expert survey on climate policy with answers to the same survey by the online artificial-intelligence chatbot ChatGPT. Such a study is timely and relevant as many people around the world are likely to use ChatGPT and similar language models to inquire about climate solutions, which in turn might influence public opinion. The comparison provides insights about performance criteria, policy instruments, and use of information from distinct academic disciplines. With a few exceptions, responses by ChatGPT are informative and of high quality. We find that ChatGPT answers questions with less bias than experts from various scientific disciplines. The latter may also be a disadvantage as it seems to weight all the information available equally without accounting well for relevance, which arguably may require human rather than artificial intelligence. On the other hand, experts from distinct disciplines show difference in average responses, with some even expressing opinions inconsistent with objective evidence, meaning there is no consistent and unbiased expert opinion on climate policy. As a new way of synthesizing large amounts of academic and grey literature, ChatGPT can serve policymaking. However, since the procedure that it follows for collecting and summarizing information remains a black box, it is best regarded as a complement rather than a substitute to traditional literature reviews and expert surveys.

Suggested Citation

  • Salekpay, Foroogh & van den Bergh, Jeroen & Savin, Ivan, 2024. "Comparing advice on climate policy between academic experts and ChatGPT," Ecological Economics, Elsevier, vol. 226(C).
    • Handle: RePEc:eee:ecolec:v:226:y:2024:i:c:s0921800924002490
    DOI: 10.1016/j.ecolecon.2024.108352
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0921800924002490
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.ecolecon.2024.108352?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Lüdering Jochen & Winker Peter, 2016. "Forward or Backward Looking? The Economic Discourse and the Observed Reality," Journal of Economics and Statistics (Jahrbuecher fuer Nationaloekonomie und Statistik), De Gruyter, vol. 236(4), pages 483-515, August.
    2. Lewis C. King & Ivan Savin & Stefan Drews, 2023. "Shades of green growth scepticism among climate policy researchers," Nature Sustainability, Nature, vol. 6(11), pages 1316-1320, November.
    3. Dechezleprêtre, Antoine & Fabre, Adrien & Kruse, Tobias & Planterose, Bluebery & Chico, Ana Sanchez & Stantcheva, Stefanie, 2022. "Fighting Climate Change: International Attitudes Toward Climate Policies," CEPR Discussion Papers 17602, C.E.P.R. Discussion Papers.
    4. Gugler, Klaus & Haxhimusa, Adhurim & Liebensteiner, Mario, 2021. "Effectiveness of climate policies: Carbon pricing vs. subsidizing renewables," Journal of Environmental Economics and Management, Elsevier, vol. 106(C).
    5. Andrea Baranzini & Jeroen C. J. M. van den Bergh & Stefano Carattini & Richard B. Howarth & Emilio Padilla & Jordi Roca, 2017. "Carbon pricing in climate policy: seven reasons, complementary instruments, and political economy considerations," Wiley Interdisciplinary Reviews: Climate Change, John Wiley & Sons, vol. 8(4), July.
    6. Drews, Stefan & Savin, Ivan & van den Bergh, Jeroen, 2024. "A Global Survey of Scientific Consensus and Controversy on Instruments of Climate Policy," Ecological Economics, Elsevier, vol. 218(C).
    7. Peter Andre & Teodora Boneva & Felix Chopra & Armin Falk, 2024. "Globally representative evidence on the actual and perceived support for climate action," Nature Climate Change, Nature, vol. 14(3), pages 253-259, March.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Andreassen, Gøril L. & Kallbekken, Steffen & Rosendahl, Knut Einar, 2024. "Can policy packaging help overcome Pigouvian tax aversion? A lab experiment on combining taxes and subsidies," Journal of Environmental Economics and Management, Elsevier, vol. 127(C).
    2. Landon Yoder & Alora Cain & Ananya Rao & Nathaniel Geiger & Ben Kravitz & Mack Mercer & Deidra Miniard & Sangeet Nepal & Thomas Nunn & Mary Sluder & Grace Weiler & Shahzeen Z. Attari, 2024. "Muddling through Climate Change: A Qualitative Exploration of India and U.S. Climate Experts’ Perspectives on Solutions, Pathways, and Barriers," Sustainability, MDPI, vol. 16(13), pages 1-20, June.
    3. Jakub Sokołowski & Piotr Lewandowski & Jan Frankowski, 2023. "How to Prevent Yellow Vests? Evaluating Preferences for a Carbon Tax with a Discrete Choice Experiment," IBS Working Papers 03/2023, Instytut Badan Strukturalnych.
    4. Silvi, Mariateresa & Padilla Rosa, Emilio, 2023. "A tragedy of the horizons? An intertemporal perspective on public support for carbon taxes," Energy Economics, Elsevier, vol. 125(C).
    5. Wu, Huihuang & Zhou, Yuhan & Wang, Xian & Hu, Xiurong & Zhang, Shihui & Ren, Yang & Liu, Junfeng & Liu, Ying & Tao, Shu, 2024. "The climate, health, and economic outcomes across different carbon pricing policies to achieve China's climate goals," Applied Energy, Elsevier, vol. 368(C).
    6. Drews, Stefan, 2025. "Towards systems-oriented behavioral ecological economics," Ecological Economics, Elsevier, vol. 227(C).
    7. Christian Schoder & Remzi Baris Tercioglu, 2024. "A climate-fiscal policy mix to achieve Türkiye’s net-zero ambition under feasibility constraints," European Journal of Economics and Economic Policies: Intervention, Edward Elgar Publishing, vol. 21(2), pages 331-359, April.
    8. Xinkuo Xu & Liyan Han, 2017. "Diverse Effects of Consumer Credit on Household Carbon Emissions at Quantiles: Evidence from Urban China," Sustainability, MDPI, vol. 9(9), pages 1-25, September.
    9. Serhan Cevik, 2024. "Climate change and energy security: the dilemma or opportunity of the century?," Environmental Economics and Policy Studies, Springer;Society for Environmental Economics and Policy Studies - SEEPS, vol. 26(3), pages 653-672, July.
    10. Liotta,Charlotte & Avner,Paolo & Viguié,Vincent & Selod,Harris & Hallegatte,Stephane, 2022. "Climate Policy and Inequality in Urban Areas : Beyond Incomes," Policy Research Working Paper Series 10185, The World Bank.
    11. Finon, Dominique, 2019. "Carbon policy in developing countries: Giving priority to non-price instruments," Energy Policy, Elsevier, vol. 132(C), pages 38-43.
    12. Sami Diaf & Jörg Döpke & Ulrich Fritsche & Ida Rockenbach, 2020. "Sharks and minnows in a shoal of words: Measuring latent ideological positions of German economic research institutes based on text mining techniques," Macroeconomics and Finance Series 202001, University of Hamburg, Department of Socioeconomics.
    13. Gabriel Târziu, 2024. "What does it mean, what does it take, and why is it important to understand climate change?," Palgrave Communications, Palgrave Macmillan, vol. 11(1), pages 1-5, December.
    14. Sterner, Thomas & Ewald, Jens & Sterner, Erik, 2024. "Economists and the climate," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 109(C).
    15. Christos Karelakis & Zacharias Papanikolaou & Christina Keramopoulou & George Theodossiou, 2024. "Green Growth, Green Development and Climate Change Perceptions: Evidence from a Greek Region," Agriculture, MDPI, vol. 14(8), pages 1-17, July.
    16. Jorge M. Uribe, 2023. ""Fiscal crises and climate change"," IREA Working Papers 202303, University of Barcelona, Research Institute of Applied Economics, revised Feb 2023.
    17. Agneman, Gustav & Henriks, Sofia & Bäck, Hanna & Renström, Emma, 2024. "On the nexus between material and ideological determinants of climate policy support," Ecological Economics, Elsevier, vol. 219(C).
    18. Helm, Carsten & Mier, Mathias, 2021. "Steering the energy transition in a world of intermittent electricity supply: Optimal subsidies and taxes for renewables and storage," Journal of Environmental Economics and Management, Elsevier, vol. 109(C).
    19. Zhang, Jiekuan, 2023. "Emissions trading scheme and energy consumption and output structure: Evidence from China," Renewable Energy, Elsevier, vol. 219(P1).
    20. Tian, Jianchi & Li, Yang & Sun, Yan & Yang, Bo & Chen, Xuefeng, 2024. "Warming climate apathy to mitigate the disparity in climate policy support across distinct income strata," Energy Policy, Elsevier, vol. 192(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:ecolec:v:226:y:2024:i:c:s0921800924002490. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/ecolecon .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.