IDEAS home Printed from https://ideas.repec.org/a/eee/rensus/v152y2021ics1364032121008819.html
   My bibliography  Save this article

Value-added diagnostics for the assessment and validation of integrated assessment models

Author

Listed:
  • Wigley, Tom M.L.
  • Hong, Sanghyun
  • Brook, Barry W.

Abstract

We evaluated three Integrated Assessment Models (IAMs: IGSM, MERGE, MiniCAM) by: (i) comparing their global Primary Energy year-2000 initializations and projections for 2010 and 2015 to historical data; (ii) mapping their CO2 emissions projections against observations; and (iii) examining model-output diagnostics. The IAMs underestimated historical primary energy consumption and initial/projected CO2 emissions in both reference and stabilization scenarios (particularly for combustion fuels) but overestimated usage of non-biomass renewables, causing underestimates of future CO2 emissions that, for the stabilization scenarios, are wildly optimistic. Mitigation technology breakdowns in the policy scenarios vary enormously across IAMs, suggesting that confidence in their projections might be misplaced, or that options for mitigation have greater scope than is supposed. Most increases in carbon-free technologies in the stabilization scenarios are already captured in the reference cases. Energy-conversion efficiencies in electricity generation improve over time, but, (except for gas-powered generation in IGSM), efficiencies in the policy scenarios are less than in the reference. Electrification results diverge widely: IGSM has little change over the 21st century, while MiniCAM and MERGE have major electrification increases in their policy scenarios. We suggest: 1) comprehensive model output suitable for secondary analysis should be more readily available; 2) directly comparable reference and policy-driven mitigation scenarios are essential for assessing mitigation measures; 3) model validation using historical, source-specific energy data is crucial for assessing model credibility; 4) separation of mitigation contributions into no-policy and policy-driven amounts is needed to assess the effectiveness of mitigation policies; and 5) detailed inter-model comparisons can provide important insights into model credibility.

Suggested Citation

  • Wigley, Tom M.L. & Hong, Sanghyun & Brook, Barry W., 2021. "Value-added diagnostics for the assessment and validation of integrated assessment models," Renewable and Sustainable Energy Reviews, Elsevier, vol. 152(C).
  • Handle: RePEc:eee:rensus:v:152:y:2021:i:c:s1364032121008819
    DOI: 10.1016/j.rser.2021.111605
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S1364032121008819
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.rser.2021.111605?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. David M. Reiner, 2016. "Learning through a portfolio of carbon capture and storage demonstration projects," Nature Energy, Nature, vol. 1(1), pages 1-7, January.
    2. Wise, Marshall & Dooley, James & Luckow, Patrick & Calvin, Katherine & Kyle, Page, 2014. "Agriculture, land use, energy and carbon emission impacts of global biofuel mandates to mid-century," Applied Energy, Elsevier, vol. 114(C), pages 763-773.
    3. Robert S. Pindyck, 2013. "Climate Change Policy: What Do the Models Tell Us?," Journal of Economic Literature, American Economic Association, vol. 51(3), pages 860-872, September.
    4. Staffan A Qvist & Barry W Brook, 2015. "Potential for Worldwide Displacement of Fossil-Fuel Electricity by Nuclear Energy in Three Decades Based on Extrapolation of Regional Deployment Data," PLOS ONE, Public Library of Science, vol. 10(5), pages 1-10, May.
    5. Mathijs Harmsen & Elmar Kriegler & Detlef van Vuuren & Kaj-Ivar van Der Wijst & Gunnar Luderer & Ryna Cui & Olivier Dessens & Laurent Drouet & Johannes Emmerling & Jennifer Morris & Florian Fosse & Di, 2021. "Integrated assessment model diagnostics: key indicators and model evolution," Post-Print hal-03216627, HAL.
    6. Nicholas Stern, 2016. "Economics: Current climate models are grossly misleading," Nature, Nature, vol. 530(7591), pages 407-409, February.
    7. John M. DeCicco & Danielle Yuqiao Liu & Joonghyeok Heo & Rashmi Krishnan & Angelika Kurthen & Louise Wang, 2016. "Carbon balance effects of U.S. biofuel production and use," Climatic Change, Springer, vol. 138(3), pages 667-680, October.
    8. Katherine Bourzac, 2017. "We have the technology," Nature, Nature, vol. 550(7675), pages 66-69, October.
    9. Popp, J. & Lakner, Z. & Harangi-Rákos, M. & Fári, M., 2014. "The effect of bioenergy expansion: Food, energy, and environment," Renewable and Sustainable Energy Reviews, Elsevier, vol. 32(C), pages 559-578.
    10. Roger Pielke & Tom Wigley & Christopher Green, 2008. "Dangerous assumptions," Nature, Nature, vol. 452(7187), pages 531-532, April.
    11. Cherubini, Francesco & Bird, Neil D. & Cowie, Annette & Jungmeier, Gerfried & Schlamadinger, Bernhard & Woess-Gallasch, Susanne, 2009. "Energy- and greenhouse gas-based LCA of biofuel and bioenergy systems: Key issues, ranges and recommendations," Resources, Conservation & Recycling, Elsevier, vol. 53(8), pages 434-447.
    12. John Weyant, 2017. "Some Contributions of Integrated Assessment Models of Global Climate Change," Review of Environmental Economics and Policy, Association of Environmental and Resource Economists, vol. 11(1), pages 115-137.
    13. Barry W. Brook & Julian J. O'Grady & Andrew P. Chapman & Mark A. Burgman & H. Resit Akçakaya & Richard Frankham, 2000. "Predictive accuracy of population viability analysis in conservation biology," Nature, Nature, vol. 404(6776), pages 385-387, March.
    14. Elmar Kriegler & John Weyant & Geoffrey Blanford & Volker Krey & Leon Clarke & Jae Edmonds & Allen Fawcett & Gunnar Luderer & Keywan Riahi & Richard Richels & Steven Rose & Massimo Tavoni & Detlef Vuu, 2014. "The role of technology for achieving climate policy objectives: overview of the EMF 27 study on global technology and climate policy strategies," Climatic Change, Springer, vol. 123(3), pages 353-367, April.
    15. Carl-Friedrich Schleussner & Joeri Rogelj & Michiel Schaeffer & Tabea Lissner & Rachel Licker & Erich M. Fischer & Reto Knutti & Anders Levermann & Katja Frieler & William Hare, 2016. "Science and policy characteristics of the Paris Agreement temperature goal," Nature Climate Change, Nature, vol. 6(9), pages 827-835, September.
    16. Renn, Ortwin & Marshall, Jonathan Paul, 2016. "Coal, nuclear and renewable energy policies in Germany: From the 1950s to the “Energiewende”," Energy Policy, Elsevier, vol. 99(C), pages 224-232.
    17. Pfenninger, Stefan & DeCarolis, Joseph & Hirth, Lion & Quoilin, Sylvain & Staffell, Iain, 2017. "The importance of open data and software: Is energy research lagging behind?," Energy Policy, Elsevier, vol. 101(C), pages 211-215.
    18. Richard H. Moss & Jae A. Edmonds & Kathy A. Hibbard & Martin R. Manning & Steven K. Rose & Detlef P. van Vuuren & Timothy R. Carter & Seita Emori & Mikiko Kainuma & Tom Kram & Gerald A. Meehl & John F, 2010. "The next generation of scenarios for climate change research and assessment," Nature, Nature, vol. 463(7282), pages 747-756, February.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Lamperti, F. & Dosi, G. & Napoletano, M. & Roventini, A. & Sapio, A., 2018. "Faraway, So Close: Coupled Climate and Economic Dynamics in an Agent-based Integrated Assessment Model," Ecological Economics, Elsevier, vol. 150(C), pages 315-339.
    2. Dr. Christian Lutz & Dr. Marc Ingo Wolter, 2021. "Wege zur Klimaneutralität bis 2045 – Politische Handlungsfelder," GWS Discussion Paper Series 21-4, GWS - Institute of Economic Structures Research.
    3. Ajay Gambhir & Isabela Butnar & Pei-Hao Li & Pete Smith & Neil Strachan, 2019. "A Review of Criticisms of Integrated Assessment Models and Proposed Approaches to Address These, through the Lens of BECCS," Energies, MDPI, vol. 12(9), pages 1-21, May.
    4. Fankhauser, Samuel & Jotzo, Frank, 2017. "Economic growth and development with low-carbon energy," LSE Research Online Documents on Economics 86850, London School of Economics and Political Science, LSE Library.
    5. Balint, T. & Lamperti, F. & Mandel, A. & Napoletano, M. & Roventini, A. & Sapio, A., 2017. "Complexity and the Economics of Climate Change: A Survey and a Look Forward," Ecological Economics, Elsevier, vol. 138(C), pages 252-265.
    6. Awaworyi Churchill, Sefa & Inekwe, John & Smyth, Russell & Zhang, Xibin, 2019. "R&D intensity and carbon emissions in the G7: 1870–2014," Energy Economics, Elsevier, vol. 80(C), pages 30-37.
    7. Francesco Lamperti & Giovanni Dosi & Mauro Napoletano & Andrea Roventini & Alessandro Sapio, 2018. "And then he wasn't a she : Climate change and green transitions in an agent-based integrated assessment model," Working Papers hal-03443464, HAL.
    8. Luca Gerotto & Paolo Pellizzari, 2021. "A replication of Pindyck’s willingness to pay: on the efforts required to obtain results," SN Business & Economics, Springer, vol. 1(5), pages 1-25, May.
    9. Kalkuhl, Matthias & Wenz, Leonie, 2020. "The impact of climate conditions on economic production. Evidence from a global panel of regions," Journal of Environmental Economics and Management, Elsevier, vol. 103(C).
    10. Franziska Piontek & Matthias Kalkuhl & Elmar Kriegler & Anselm Schultes & Marian Leimbach & Ottmar Edenhofer & Nico Bauer, 2019. "Economic Growth Effects of Alternative Climate Change Impact Channels in Economic Modeling," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 73(4), pages 1357-1385, August.
    11. Sandra Gschnaller, 2020. "The albedo loss from the melting of the Greenland ice sheet and the social cost of carbon," Climatic Change, Springer, vol. 163(4), pages 2201-2231, December.
    12. Patrick Bolton Patrick & Després Morgan & Pereira da Silva Luiz Awazu & Samama Frédéric & Svartzman Romain, 2020. "“Green Swans”: central banks in the age of climate-related risks [Le « Cygne Vert » : les banques centrales à l’ère des risques climatiques]," Bulletin de la Banque de France, Banque de France, issue 229.
    13. John M. DeCicco, 2018. "Methodological Issues Regarding Biofuels and Carbon Uptake," Sustainability, MDPI, vol. 10(5), pages 1-15, May.
    14. Wei, Yi-Ming & Mi, Zhi-Fu & Huang, Zhimin, 2015. "Climate policy modeling: An online SCI-E and SSCI based literature review," Omega, Elsevier, vol. 57(PA), pages 70-84.
    15. Francesco Lamperti & Valentina Bosetti & Andrea Roventini & Massimo Tavoni, 2019. "The public costs of climate-induced financial instability," Nature Climate Change, Nature, vol. 9(11), pages 829-833, November.
    16. repec:spo:wpmain:info:hdl:2441/1nlv566svi86iqtetenms15tc4 is not listed on IDEAS
    17. Pretis, Felix, 2021. "Exogeneity in climate econometrics," Energy Economics, Elsevier, vol. 96(C).
    18. Ruda Zhang & Patrick Wingo & Rodrigo Duran & Kelly Rose & Jennifer Bauer & Roger Ghanem, 2020. "Environmental Economics and Uncertainty: Review and a Machine Learning Outlook," Papers 2004.11780, arXiv.org.
    19. Kevin D. Dayaratna & Ross McKitrick & Patrick J. Michaels, 2020. "Climate sensitivity, agricultural productivity and the social cost of carbon in FUND," Environmental Economics and Policy Studies, Springer;Society for Environmental Economics and Policy Studies - SEEPS, vol. 22(3), pages 433-448, July.
    20. Dobes Leo & Jotzo Frank & Stern David I., 2014. "The Economics of Global Climate Change: A Historical Literature Review," Review of Economics, De Gruyter, vol. 65(3), pages 281-320, December.
    21. Antonina Ivanova & Asim Zia & Paiman Ahmad & Mairon Bastos-Lima, 0. "Climate mitigation policies and actions: access and allocation issues," International Environmental Agreements: Politics, Law and Economics, Springer, vol. 0, pages 1-15.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:rensus:v:152:y:2021:i:c:s1364032121008819. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/600126/description#description .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.