IDEAS home Printed from https://ideas.repec.org/a/eee/rensus/v156y2022ics1364032121012594.html
   My bibliography  Save this article

Beyond climate change. Multi-attribute decision making for a sustainability assessment of energy system transformation pathways

Author

Listed:
  • Hottenroth, H.
  • Sutardhio, C.
  • Weidlich, A.
  • Tietze, I.
  • Simon, S.
  • Hauser, W.
  • Naegler, T.
  • Becker, L.
  • Buchgeister, J.
  • Junne, T.
  • Lehr, U.
  • Scheel, O.
  • Schmidt-Scheele, R.
  • Ulrich, P.
  • Viere, T.

Abstract

A multitude of pathways for decarbonizing energy systems have been formulated. In the development of these scenarios, the focus is often only on system costs at a given CO2 emission reduction. However, when assessing the sustainability of energy systems in a broader sense, many more aspects need to be considered: In addition to greenhouse gas emissions, energy systems induce further environmental and socio-economic impacts and must meet requirements for security of supply and cost efficiency. For assessing the compatibility of a future energy system with sustainability concepts, alternative pathways must be compared holistically using dedicated assessment methods, which is facilitated by multi-attribute decision making methods (MADM). With the target of identifying sustainable transformation pathways, we assess ten transformation scenarios for the example of Germany, using the three MADM methods weighted sum method, PROMETHEE II and TOPSIS. We find that top ranks are not completely stable across methods, but there are scenario clusters which rank high, medium and low for all methods. In the top ranks, there are both less ambitious scenarios that aim at reducing direct CO2 emissions by 80%, and more ambitious scenarios with a reduction by at least 95%. We conclude that scenarios with more ambitious climate protection goals are not necessarily more (or less) sustainable than scenarios that aim for a reduction of 80% only.

Suggested Citation

  • Hottenroth, H. & Sutardhio, C. & Weidlich, A. & Tietze, I. & Simon, S. & Hauser, W. & Naegler, T. & Becker, L. & Buchgeister, J. & Junne, T. & Lehr, U. & Scheel, O. & Schmidt-Scheele, R. & Ulrich, P. , 2022. "Beyond climate change. Multi-attribute decision making for a sustainability assessment of energy system transformation pathways," Renewable and Sustainable Energy Reviews, Elsevier, vol. 156(C).
  • Handle: RePEc:eee:rensus:v:156:y:2022:i:c:s1364032121012594
    DOI: 10.1016/j.rser.2021.111996
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S1364032121012594
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.rser.2021.111996?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Karger, Cornelia R. & Hennings, Wilfried, 2009. "Sustainability evaluation of decentralized electricity generation," Renewable and Sustainable Energy Reviews, Elsevier, vol. 13(3), pages 583-593, April.
    2. Tobias Naegler & Lisa Becker & Jens Buchgeister & Wolfgang Hauser & Heidi Hottenroth & Tobias Junne & Ulrike Lehr & Oliver Scheel & Ricarda Schmidt-Scheele & Sonja Simon & Claudia Sutardhio & Ingela T, 2021. "Integrated Multidimensional Sustainability Assessment of Energy System Transformation Pathways," Sustainability, MDPI, vol. 13(9), pages 1-28, May.
    3. Kowalski, Katharina & Stagl, Sigrid & Madlener, Reinhard & Omann, Ines, 2009. "Sustainable energy futures: Methodological challenges in combining scenarios and participatory multi-criteria analysis," European Journal of Operational Research, Elsevier, vol. 197(3), pages 1063-1074, September.
    4. Maxim, Alexandru, 2014. "Sustainability assessment of electricity generation technologies using weighted multi-criteria decision analysis," Energy Policy, Elsevier, vol. 65(C), pages 284-297.
    5. Haralambopoulos, D.A. & Polatidis, H., 2003. "Renewable energy projects: structuring a multi-criteria group decision-making framework," Renewable Energy, Elsevier, vol. 28(6), pages 961-973.
    6. Carlos Henggeler Antunes & Carla Oliveira Henriques, 2016. "Multi-Objective Optimization and Multi-Criteria Analysis Models and Methods for Problems in the Energy Sector," International Series in Operations Research & Management Science, in: Salvatore Greco & Matthias Ehrgott & José Rui Figueira (ed.), Multiple Criteria Decision Analysis, edition 2, chapter 0, pages 1067-1165, Springer.
    7. Ribeiro, Fernando & Ferreira, Paula & Araújo, Madalena, 2013. "Evaluating future scenarios for the power generation sector using a Multi-Criteria Decision Analysis (MCDA) tool: The Portuguese case," Energy, Elsevier, vol. 52(C), pages 126-136.
    8. Browne, David & O'Regan, Bernadette & Moles, Richard, 2010. "Use of multi-criteria decision analysis to explore alternative domestic energy and electricity policy scenarios in an Irish city-region," Energy, Elsevier, vol. 35(2), pages 518-528.
    9. Munda, G. & Nijkamp, P. & Rietveld, P., 1995. "Qualitative multicriteria methods for fuzzy evaluation problems: An illustration of economic-ecological evaluation," European Journal of Operational Research, Elsevier, vol. 82(1), pages 79-97, April.
    10. Georgopoulou, E. & Lalas, D. & Papagiannakis, L., 1997. "A multicriteria decision aid approach for energy planning problems: The case of renewable energy option," European Journal of Operational Research, Elsevier, vol. 103(1), pages 38-54, November.
    11. Siskos, J. & Hubert, Ph., 1983. "Multi-criteria analysis of the impacts of energy alternatives: A survey and a new comparative approach," European Journal of Operational Research, Elsevier, vol. 13(3), pages 278-299, July.
    12. Rovere, Emilio Lebre La & Soares, Jeferson Borghetti & Oliveira, Luciano Basto & Lauria, Tatiana, 2010. "Sustainable expansion of electricity sector: Sustainability indicators as an instrument to support decision making," Renewable and Sustainable Energy Reviews, Elsevier, vol. 14(1), pages 422-429, January.
    13. Kumar, Abhishek & Sah, Bikash & Singh, Arvind R. & Deng, Yan & He, Xiangning & Kumar, Praveen & Bansal, R.C., 2017. "A review of multi criteria decision making (MCDM) towards sustainable renewable energy development," Renewable and Sustainable Energy Reviews, Elsevier, vol. 69(C), pages 596-609.
    14. Brand, Bernhard & Missaoui, Rafik, 2014. "Multi-criteria analysis of electricity generation mix scenarios in Tunisia," Renewable and Sustainable Energy Reviews, Elsevier, vol. 39(C), pages 251-261.
    15. Atilgan, Burcin & Azapagic, Adisa, 2016. "An integrated life cycle sustainability assessment of electricity generation in Turkey," Energy Policy, Elsevier, vol. 93(C), pages 168-186.
    16. Tobias Junne & Sonja Simon & Jens Buchgeister & Maximilian Saiger & Manuel Baumann & Martina Haase & Christina Wulf & Tobias Naegler, 2020. "Environmental Sustainability Assessment of Multi-Sectoral Energy Transformation Pathways: Methodological Approach and Case Study for Germany," Sustainability, MDPI, vol. 12(19), pages 1-28, October.
    17. Klein, Sharon J.W. & Whalley, Stephanie, 2015. "Comparing the sustainability of U.S. electricity options through multi-criteria decision analysis," Energy Policy, Elsevier, vol. 79(C), pages 127-149.
    18. Nayyar Hussain Mirjat & Mohammad Aslam Uqaili & Khanji Harijan & Mohd Wazir Mustafa & Md. Mizanur Rahman & M. Waris Ali Khan, 2018. "Multi-Criteria Analysis of Electricity Generation Scenarios for Sustainable Energy Planning in Pakistan," Energies, MDPI, vol. 11(4), pages 1-33, March.
    19. Onat, Nevzat & Bayar, Haydar, 2010. "The sustainability indicators of power production systems," Renewable and Sustainable Energy Reviews, Elsevier, vol. 14(9), pages 3108-3115, December.
    20. Arne Risa Hole, 2007. "Fitting mixed logit models by using maximum simulated likelihood," Stata Journal, StataCorp LP, vol. 7(3), pages 388-401, September.
    21. Nigim, K. & Munier, N. & Green, J., 2004. "Pre-feasibility MCDM tools to aid communities in prioritizing local viable renewable energy sources," Renewable Energy, Elsevier, vol. 29(11), pages 1775-1791.
    22. Heinrich, G. & Howells, M. & Basson, L. & Petrie, J., 2007. "Electricity supply industry modelling for multiple objectives under demand growth uncertainty," Energy, Elsevier, vol. 32(11), pages 2210-2229.
    23. Peter C. Fishburn, 1967. "Letter to the Editor—Additive Utilities with Incomplete Product Sets: Application to Priorities and Assignments," Operations Research, INFORMS, vol. 15(3), pages 537-542, June.
    24. Rahman, Md. Mizanur & Paatero, Jukka V. & Lahdelma, Risto & A. Wahid, Mazlan, 2016. "Multicriteria-based decision aiding technique for assessing energy policy elements-demonstration to a case in Bangladesh," Applied Energy, Elsevier, vol. 164(C), pages 237-244.
    25. Georgiou, Dimitris & Mohammed, Essam Sh. & Rozakis, Stelios, 2015. "Multi-criteria decision making on the energy supply configuration of autonomous desalination units," Renewable Energy, Elsevier, vol. 75(C), pages 459-467.
    26. Afgan, Naim H. & Carvalho, Maria G., 2002. "Multi-criteria assessment of new and renewable energy power plants," Energy, Elsevier, vol. 27(8), pages 739-755.
    27. Burton, Jonathan & Hubacek, Klaus, 2007. "Is small beautiful? A multicriteria assessment of small-scale energy technology applications in local governments," Energy Policy, Elsevier, vol. 35(12), pages 6402-6412, December.
    28. Pohekar, S. D. & Ramachandran, M., 2004. "Application of multi-criteria decision making to sustainable energy planning--A review," Renewable and Sustainable Energy Reviews, Elsevier, vol. 8(4), pages 365-381, August.
    29. Wenguang Yang, 2020. "Ingenious Solution for the Rank Reversal Problem of TOPSIS Method," Mathematical Problems in Engineering, Hindawi, vol. 2020, pages 1-12, January.
    30. Chatzimouratidis, Athanasios I. & Pilavachi, Petros A., 2009. "Sensitivity analysis of technological, economic and sustainability evaluation of power plants using the analytic hierarchy process," Energy Policy, Elsevier, vol. 37(3), pages 788-798, March.
    31. Christina Wulf & Petra Zapp & Andrea Schreiber & Wilhelm Kuckshinrichs, 2021. "Setting Thresholds to Define Indifferences and Preferences in PROMETHEE for Life Cycle Sustainability Assessment of European Hydrogen Production," Sustainability, MDPI, vol. 13(13), pages 1-21, June.
    32. Cavallaro, Fausto & Ciraolo, Luigi, 2005. "A multicriteria approach to evaluate wind energy plants on an Italian island," Energy Policy, Elsevier, vol. 33(2), pages 235-244, January.
    33. Topcu, Y.I & Ulengin, F, 2004. "Energy for the future: An integrated decision aid for the case of Turkey," Energy, Elsevier, vol. 29(1), pages 137-154.
    34. Christoph Schlenzig, 1999. "Energy planning and environmental management with the information and decision support system MESAP," International Journal of Global Energy Issues, Inderscience Enterprises Ltd, vol. 12(1/2/3/4/5), pages 81-91.
    35. Tsoutsos, Theocharis & Drandaki, Maria & Frantzeskaki, Niki & Iosifidis, Eleftherios & Kiosses, Ioannis, 2009. "Sustainable energy planning by using multi-criteria analysis application in the island of Crete," Energy Policy, Elsevier, vol. 37(5), pages 1587-1600, May.
    36. Volkart, Kathrin & Weidmann, Nicolas & Bauer, Christian & Hirschberg, Stefan, 2017. "Multi-criteria decision analysis of energy system transformation pathways: A case study for Switzerland," Energy Policy, Elsevier, vol. 106(C), pages 155-168.
    37. Hong, Sanghyun & Bradshaw, Corey J.A. & Brook, Barry W., 2013. "Evaluating options for the future energy mix of Japan after the Fukushima nuclear crisis," Energy Policy, Elsevier, vol. 56(C), pages 418-424.
    38. Nico Bauer & Steven K. Rose & Shinichiro Fujimori & Detlef P. Vuuren & John Weyant & Marshall Wise & Yiyun Cui & Vassilis Daioglou & Matthew J. Gidden & Etsushi Kato & Alban Kitous & Florian Leblanc &, 2020. "Global energy sector emission reductions and bioenergy use: overview of the bioenergy demand phase of the EMF-33 model comparison," Climatic Change, Springer, vol. 163(3), pages 1553-1568, December.
    39. Gulagi, Ashish & Alcanzare, Myron & Bogdanov, Dmitrii & Esparcia, Eugene & Ocon, Joey & Breyer, Christian, 2021. "Transition pathway towards 100% renewable energy across the sectors of power, heat, transport, and desalination for the Philippines," Renewable and Sustainable Energy Reviews, Elsevier, vol. 144(C).
    40. Shmelev, Stanislav E. & van den Bergh, Jeroen C.J.M., 2016. "Optimal diversity of renewable energy alternatives under multiple criteria: An application to the UK," Renewable and Sustainable Energy Reviews, Elsevier, vol. 60(C), pages 679-691.
    41. Yue, Xiufeng & Patankar, Neha & Decarolis, Joseph & Chiodi, Alessandro & Rogan, Fionn & Deane, J.P. & O’Gallachoir, Brian, 2020. "Least cost energy system pathways towards 100% renewable energy in Ireland by 2050," Energy, Elsevier, vol. 207(C).
    42. Madlener, Reinhard & Stagl, Sigrid, 2005. "Sustainability-guided promotion of renewable electricity generation," Ecological Economics, Elsevier, vol. 53(2), pages 147-167, April.
    43. Baležentis, Tomas & Streimikiene, Dalia, 2017. "Multi-criteria ranking of energy generation scenarios with Monte Carlo simulation," Applied Energy, Elsevier, vol. 185(P1), pages 862-871.
    44. Häyhä, Tiina & Franzese, Pier Paolo & Ulgiati, Sergio, 2011. "Economic and environmental performance of electricity production in Finland: A multicriteria assessment framework," Ecological Modelling, Elsevier, vol. 223(1), pages 81-90.
    45. Chatzimouratidis, Athanasios I. & Pilavachi, Petros A., 2008. "Multicriteria evaluation of power plants impact on the living standard using the analytic hierarchy process," Energy Policy, Elsevier, vol. 36(3), pages 1074-1089, March.
    46. Fthenakis, Vasilis & Kim, Hyung Chul, 2009. "Land use and electricity generation: A life-cycle analysis," Renewable and Sustainable Energy Reviews, Elsevier, vol. 13(6-7), pages 1465-1474, August.
    47. Diakoulaki, D. & Karangelis, F., 2007. "Multi-criteria decision analysis and cost-benefit analysis of alternative scenarios for the power generation sector in Greece," Renewable and Sustainable Energy Reviews, Elsevier, vol. 11(4), pages 716-727, May.
    48. Evans, Annette & Strezov, Vladimir & Evans, Tim J., 2009. "Assessment of sustainability indicators for renewable energy technologies," Renewable and Sustainable Energy Reviews, Elsevier, vol. 13(5), pages 1082-1088, June.
    49. Guitouni, Adel & Martel, Jean-Marc, 1998. "Tentative guidelines to help choosing an appropriate MCDA method," European Journal of Operational Research, Elsevier, vol. 109(2), pages 501-521, September.
    50. Chatzimouratidis, Athanasios I. & Pilavachi, Petros A., 2009. "Technological, economic and sustainability evaluation of power plants using the Analytic Hierarchy Process," Energy Policy, Elsevier, vol. 37(3), pages 778-787, March.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Vögele, Stefan & Teja Josyabhatla, Vishnu & Ball, Christopher & Rhoden, Imke & Grajewski, Matthias & Rübbelke, Dirk & Kuckshinrichs, Wilhelm, 2023. "Robust assessment of energy scenarios from stakeholders' perspectives," Energy, Elsevier, vol. 282(C).
    2. Wohlschlager, Daniela & Kigle, Stephan & Schindler, Vanessa & Neitz-Regett, Anika & Fröhling, Magnus, 2024. "Environmental effects of vehicle-to-grid charging in future energy systems – A prospective life cycle assessment," Applied Energy, Elsevier, vol. 370(C).
    3. Buchmayr, A. & Taelman, S.E. & Thomassen, G. & Verhofstadt, E. & Van Ootegem, L. & Dewulf, J., 2023. "A distance-to-sustainability-target approach for indicator aggregation and its application for the comparison of wind energy alternatives," Renewable and Sustainable Energy Reviews, Elsevier, vol. 185(C).
    4. Chuanjia Du & Chengjun Wang & Tao Feng, 2023. "The Impact of China’s National Sustainable Development Experimental Zone Policy on Energy Transition," Sustainability, MDPI, vol. 15(10), pages 1-21, May.
    5. Christina Francis & Paul Hansen & Bjarnhéðinn Guðlaugsson & David M. Ingram & R. Camilla Thomson, 2022. "Weighting Key Performance Indicators of Smart Local Energy Systems: A Discrete Choice Experiment," Energies, MDPI, vol. 15(24), pages 1-17, December.
    6. Fei Wang & Zhi Dong & Jichang Dong, 2023. "Assessment of the Drivers and Effects of International Science and Technology Cooperation in Xinjiang in the Context of the Belt and Road Initiative," Sustainability, MDPI, vol. 15(2), pages 1-20, January.
    7. Xu, Xin & An, Haizhong & Huang, Shupei & Jia, Nanfei & Qi, Yajie, 2024. "Measurement of daily climate physical risks and climate transition risks faced by China's energy sector stocks," International Review of Economics & Finance, Elsevier, vol. 93(PB), pages 625-640.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Strantzali, Eleni & Aravossis, Konstantinos, 2016. "Decision making in renewable energy investments: A review," Renewable and Sustainable Energy Reviews, Elsevier, vol. 55(C), pages 885-898.
    2. Troldborg, Mads & Heslop, Simon & Hough, Rupert L., 2014. "Assessing the sustainability of renewable energy technologies using multi-criteria analysis: Suitability of approach for national-scale assessments and associated uncertainties," Renewable and Sustainable Energy Reviews, Elsevier, vol. 39(C), pages 1173-1184.
    3. Shmelev, Stanislav E. & van den Bergh, Jeroen C.J.M., 2016. "Optimal diversity of renewable energy alternatives under multiple criteria: An application to the UK," Renewable and Sustainable Energy Reviews, Elsevier, vol. 60(C), pages 679-691.
    4. Saraswat, S.K. & Digalwar, Abhijeet K., 2021. "Empirical investigation and validation of sustainability indicators for the assessment of energy sources in India," Renewable and Sustainable Energy Reviews, Elsevier, vol. 145(C).
    5. Tobias Naegler & Lisa Becker & Jens Buchgeister & Wolfgang Hauser & Heidi Hottenroth & Tobias Junne & Ulrike Lehr & Oliver Scheel & Ricarda Schmidt-Scheele & Sonja Simon & Claudia Sutardhio & Ingela T, 2021. "Integrated Multidimensional Sustainability Assessment of Energy System Transformation Pathways," Sustainability, MDPI, vol. 13(9), pages 1-28, May.
    6. Abbas Mardani & Ahmad Jusoh & Edmundas Kazimieras Zavadskas & Fausto Cavallaro & Zainab Khalifah, 2015. "Sustainable and Renewable Energy: An Overview of the Application of Multiple Criteria Decision Making Techniques and Approaches," Sustainability, MDPI, vol. 7(10), pages 1-38, October.
    7. Buchmayr, A. & Taelman, S.E. & Thomassen, G. & Verhofstadt, E. & Van Ootegem, L. & Dewulf, J., 2023. "A distance-to-sustainability-target approach for indicator aggregation and its application for the comparison of wind energy alternatives," Renewable and Sustainable Energy Reviews, Elsevier, vol. 185(C).
    8. Alkan, Ömer & Albayrak, Özlem Karadağ, 2020. "Ranking of renewable energy sources for regions in Turkey by fuzzy entropy based fuzzy COPRAS and fuzzy MULTIMOORA," Renewable Energy, Elsevier, vol. 162(C), pages 712-726.
    9. Sellak, Hamza & Ouhbi, Brahim & Frikh, Bouchra & Palomares, Iván, 2017. "Towards next-generation energy planning decision-making: An expert-based framework for intelligent decision support," Renewable and Sustainable Energy Reviews, Elsevier, vol. 80(C), pages 1544-1577.
    10. Büyüközkan, Gülçin & Karabulut, Yağmur, 2017. "Energy project performance evaluation with sustainability perspective," Energy, Elsevier, vol. 119(C), pages 549-560.
    11. Kurka, Thomas & Blackwood, David, 2013. "Participatory selection of sustainability criteria and indicators for bioenergy developments," Renewable and Sustainable Energy Reviews, Elsevier, vol. 24(C), pages 92-102.
    12. Strantzali, Eleni & Aravossis, Konstantinos & Livanos, Georgios A., 2017. "Evaluation of future sustainable electricity generation alternatives: The case of a Greek island," Renewable and Sustainable Energy Reviews, Elsevier, vol. 76(C), pages 775-787.
    13. Stein, Eric W., 2013. "A comprehensive multi-criteria model to rank electric energy production technologies," Renewable and Sustainable Energy Reviews, Elsevier, vol. 22(C), pages 640-654.
    14. Khishtandar, Soheila & Zandieh, Mostafa & Dorri, Behrouz, 2017. "A multi criteria decision making framework for sustainability assessment of bioenergy production technologies with hesitant fuzzy linguistic term sets: The case of Iran," Renewable and Sustainable Energy Reviews, Elsevier, vol. 77(C), pages 1130-1145.
    15. Wang, Jiang-Jiang & Jing, You-Yin & Zhang, Chun-Fa & Zhao, Jun-Hong, 2009. "Review on multi-criteria decision analysis aid in sustainable energy decision-making," Renewable and Sustainable Energy Reviews, Elsevier, vol. 13(9), pages 2263-2278, December.
    16. Liu, Gang, 2014. "Development of a general sustainability indicator for renewable energy systems: A review," Renewable and Sustainable Energy Reviews, Elsevier, vol. 31(C), pages 611-621.
    17. Ishizaka, Alessio & Siraj, Sajid & Nemery, Philippe, 2016. "Which energy mix for the UK (United Kingdom)? An evolutive descriptive mapping with the integrated GAIA (graphical analysis for interactive aid)–AHP (analytic hierarchy process) visualization tool," Energy, Elsevier, vol. 95(C), pages 602-611.
    18. Vögele, Stefan & Teja Josyabhatla, Vishnu & Ball, Christopher & Rhoden, Imke & Grajewski, Matthias & Rübbelke, Dirk & Kuckshinrichs, Wilhelm, 2023. "Robust assessment of energy scenarios from stakeholders' perspectives," Energy, Elsevier, vol. 282(C).
    19. Akber, Muhammad Zeshan & Thaheem, Muhammad Jamaluddin & Arshad, Husnain, 2017. "Life cycle sustainability assessment of electricity generation in Pakistan: Policy regime for a sustainable energy mix," Energy Policy, Elsevier, vol. 111(C), pages 111-126.
    20. Mourmouris, J.C. & Potolias, C., 2013. "A multi-criteria methodology for energy planning and developing renewable energy sources at a regional level: A case study Thassos, Greece," Energy Policy, Elsevier, vol. 52(C), pages 522-530.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:rensus:v:156:y:2022:i:c:s1364032121012594. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/600126/description#description .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.