IDEAS home Printed from https://ideas.repec.org/a/gam/jsusta/v10y2018i12p4529-d186887.html
   My bibliography  Save this article

On Evaluating Social Learning Outcomes of Serious Games to Collaboratively Address Sustainability Problems: A Literature Review

Author

Listed:
  • Robert-Jan Den Haan

    (Department of Design, Production and Management, Faculty of Engineering Technology, University of Twente, Drienerlolaan 5, 7522NB Enschede, The Netherlands)

  • Mascha C. Van der Voort

    (Department of Design, Production and Management, Faculty of Engineering Technology, University of Twente, Drienerlolaan 5, 7522NB Enschede, The Netherlands)

Abstract

Serious games are increasingly explored as collaborative tools to enhance social learning on sustainable management of land and natural resources. A systematic literature review was conducted to examine the current state of the art of the different methods and procedures used to assess social learning outcomes of collaborative serious games. Forty-two publications were identified and included in the review following study selection and quality assessment steps. Extracted data from the publications were categorized in relation to five research questions. Approaches that were used to assess cognitive, normative, and relational learning outcomes of collaborative serious games were subsequently identified based on the categorizations. As a result, these approaches distinguished between the nature of learning in the assessment of collaborative serious games. Combined, these approaches provide an overview of how to assess social learning outcomes of collaborative serious games, including the methods and procedures that can be used, and may serve as a reference for scholars designing and evaluating collaborative serious games.

Suggested Citation

  • Robert-Jan Den Haan & Mascha C. Van der Voort, 2018. "On Evaluating Social Learning Outcomes of Serious Games to Collaboratively Address Sustainability Problems: A Literature Review," Sustainability, MDPI, vol. 10(12), pages 1-26, December.
    • Handle: RePEc:gam:jsusta:v:10:y:2018:i:12:p:4529-:d:186887
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/2071-1050/10/12/4529/pdf
    Download Restriction: no
    File URL: https://www.mdpi.com/2071-1050/10/12/4529/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Jasper N. Meya & Klaus Eisenack, 2018. "Effectiveness of gaming for communicating and teaching climate change," Climatic Change, Springer, vol. 149(3), pages 319-333, August.
    2. Meinzen-Dick, Ruth & Janssen, Marco A. & Kandikuppa, Sandeep & Chaturvedi, Rahul & Rao, Kaushalendra & Theis, Sophie, 2018. "Playing games to save water: Collective action games for groundwater management in Andhra Pradesh, India," World Development, Elsevier, vol. 107(C), pages 40-53.
    3. Pahl-Wostl, Claudia & Tabara, David & Bouwen, Rene & Craps, Marc & Dewulf, Art & Mostert, Erik & Ridder, Dagmar & Taillieu, Tharsi, 2008. "The importance of social learning and culture for sustainable water management," Ecological Economics, Elsevier, vol. 64(3), pages 484-495, January.
    4. Jan Duffhues & Igor S Mayer & Merten Nefs & Mirte van der Vliet, 2014. "Breaking Barriers to Transit-Oriented Development: Insights from the Serious Game SPRINTCITY," Environment and Planning B, , vol. 41(5), pages 770-791, October.
    5. Jason S. Wu & Joey J. Lee, 2015. "Climate change games as tools for education and engagement," Nature Climate Change, Nature, vol. 5(5), pages 413-418, May.
    6. Astrid Offermans & Marjolijn Haasnoot & Pieter Valkering, 2011. "A method to explore social response for sustainable water management strategies under changing conditions," Sustainable Development, John Wiley & Sons, Ltd., vol. 19(5), pages 312-324, September.
    7. Stefan Moser & Oliver Mußhoff, 2016. "Ex-ante Evaluation of Policy Measures: Effects of Reward and Punishment for Fertiliser Reduction in Palm Oil Production," Journal of Agricultural Economics, Wiley Blackwell, vol. 67(1), pages 84-104, February.
    8. W. Douven & M. Mul & L. Son & N. Bakker & G. Radosevich & A. Hendriks, 2014. "Games to Create Awareness and Design Policies for Transboundary Cooperation in River Basins: Lessons from the Shariva Game of the Mekong River Commission," Water Resources Management: An International Journal, Published for the European Water Resources Association (EWRA), Springer;European Water Resources Association (EWRA), vol. 28(5), pages 1431-1447, March.
    9. Lawrence, Judy & Haasnoot, Marjolijn, 2017. "What it took to catalyse uptake of dynamic adaptive pathways planning to address climate change uncertainty," Environmental Science & Policy, Elsevier, vol. 68(C), pages 47-57.
    10. Hertzog, Thomas & Poussin, Jean-Christophe & Tangara, Bréhima & Kouriba, Indé & Jamin, Jean-Yves, 2014. "A role playing game to address future water management issues in a large irrigated system: Experience from Mali," Agricultural Water Management, Elsevier, vol. 137(C), pages 1-14.
    11. Salvini, G. & van Paassen, A. & Ligtenberg, A. & Carrero, G.C. & Bregt, A.K., 2016. "A role-playing game as a tool to facilitate social learning and collective action towards Climate Smart Agriculture: Lessons learned from Apuí, Brazil," Environmental Science & Policy, Elsevier, vol. 63(C), pages 113-121.
    12. Cristina Ampatzidou & Katharina Gugerell & Teodora Constantinescu & Oswald Devisch & Martina Jauschneg & Martin Berger, 2018. "All Work and No Play? Facilitating Serious Games and Gamified Applications in Participatory Urban Planning and Governance," Urban Planning, Cogitatio Press, vol. 3(1), pages 34-46.
    13. David Moher & Alessandro Liberati & Jennifer Tetzlaff & Douglas G Altman & The PRISMA Group, 2009. "Preferred Reporting Items for Systematic Reviews and Meta-Analyses: The PRISMA Statement," PLOS Medicine, Public Library of Science, vol. 6(7), pages 1-6, July.
    14. Abby Muricho Onencan & Bartel Van de Walle, 2018. "From Paris Agreement to Action: Enhancing Climate Change Familiarity and Situation Awareness," Sustainability, MDPI, vol. 10(6), pages 1-30, June.
    15. Martin, G., 2015. "A conceptual framework to support adaptation of farming systems – Development and application with Forage Rummy," Agricultural Systems, Elsevier, vol. 132(C), pages 52-61.
    16. M. Muro & P. Jeffrey, 2008. "A critical review of the theory and application of social learning in participatory natural resource management processes," Journal of Environmental Planning and Management, Taylor & Francis Journals, vol. 51(3), pages 325-344.
    17. Speelman, E.N. & García-Barrios, L.E. & Groot, J.C.J. & Tittonell, P., 2014. "Gaming for smallholder participation in the design of more sustainable agricultural landscapes," Agricultural Systems, Elsevier, vol. 126(C), pages 62-75.
    18. Danya Rumore & Todd Schenk & Lawrence Susskind, 2016. "Role-play simulations for climate change adaptation education and engagement," Nature Climate Change, Nature, vol. 6(8), pages 745-750, August.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Mathias Lanezki & Catharina Siemer & Steffen Wehkamp, 2020. "“Changing the Game—Neighbourhood”: An Energy Transition Board Game, Developed in a Co-Design Process: A Case Study," Sustainability, MDPI, vol. 12(24), pages 1-18, December.
    2. Anastasia Roukouni & Heide Lukosch & Alexander Verbraeck & Rob Zuidwijk, 2020. "Let the Game Begin: Enhancing Sustainable Collaboration among Actors in Innovation Ecosystems in a Playful Way," Sustainability, MDPI, vol. 12(20), pages 1-17, October.
    3. Falk, Thomas & Zhang, Wei & Meinzen-Dick, Ruth & Bartels, Lara, 2021. "Games for Triggering Collective Change in Natural Resource Management: A Conceptual Framework and Insights from Four Cases from India," 2021 Conference, August 17-31, 2021, Virtual 315341, International Association of Agricultural Economists.
    4. Sylvain, Dernat & Bertrand, Dumont & Dominique, Vollet, 2023. "La Grange®: A generic game to reveal trade-offs and synergies among stakeholders in livestock farming areas," Agricultural Systems, Elsevier, vol. 209(C).
    5. Elena Bakhanova & Jaime A. Garcia & William L. Raffe & Alexey Voinov, 2023. "Gamification Framework for Participatory Modeling: A Proposal," Group Decision and Negotiation, Springer, vol. 32(5), pages 1167-1182, October.
    6. Aubert, Alice H. & Schmid, Sara & Lienert, Judit, 2024. "Can online interfaces enhance learning for public decision-making? Eliciting citizens’ preferences for multicriteria decision analysis," European Journal of Operational Research, Elsevier, vol. 314(2), pages 760-775.
    7. Husam AlWaer & Ian Cooper, 2020. "Changing the Focus: Viewing Design-Led Events within Collaborative Planning," Sustainability, MDPI, vol. 12(8), pages 1-24, April.
    8. Merit Tatar & Mariia Khrapunenko & Richard Karl Henahan & Andra Asser, 2023. "Engaging Citizens in the Bioeconomy: Insights from the Co-Creation and Co-Design in the Development of the Serious Bioeconomy Game “Mission BioHero”," Sustainability, MDPI, vol. 15(18), pages 1-45, September.
    9. Lehmann, Paul & Ammermann, Kathrin & Gawel, Erik & Geiger, Charlotte & Hauck, Jennifer & Heilmann, Jörg & Meier, Jan-Niklas & Ponitka, Jens & Schicketanz, Sven & Stemmer, Boris & Tafarte, Philip & Thr, 2021. "Managing spatial sustainability trade-offs: The case of wind power," Ecological Economics, Elsevier, vol. 185(C).
    10. Théophile Bongarts Lebbe & Hélène Rey-Valette & Éric Chaumillon & Guigone Camus & Rafael Almar & Anny Cazenave & Joachim Claudet & Nicolas Rocle & Catherine Meur-Ferec & Frédérique Viard & Denis Merci, 2021. "Designing coastal adaptation strategies to tackle sea level rise," Post-Print hal-03412421, HAL.
    11. Franziska Steinberger & Tobias Minder & Evelina Trutnevyte, 2020. "Efficiency versus Equity in Spatial Siting of Electricity Generation: Citizen Preferences in a Serious Board Game in Switzerland," Energies, MDPI, vol. 13(18), pages 1-17, September.
    12. Joop de Kraker & Astrid Offermans & Merel M. van der Wal, 2021. "Game-Based Social Learning for Socially Sustainable Water Management," Sustainability, MDPI, vol. 13(9), pages 1-15, April.
    13. Laterra, Pedro & Weyland, Federico & Auer, Alejandra & Barral, Paula & González, Aira & Mastrángelo, Matías & Rositano, Florencia & Sirimarco, Ximena, 2023. "MARCHI: A serious game for participatory governance of ecosystem services in multiple-use protected areas," Ecosystem Services, Elsevier, vol. 63(C).
    14. Theresa Tribaldos & Flurina Schneider, 2021. "Enabling Players to Develop Theories of Change for Sustainable Development: A Serious Game," Simulation & Gaming, , vol. 52(5), pages 664-678, October.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Joop de Kraker & Astrid Offermans & Merel M. van der Wal, 2021. "Game-Based Social Learning for Socially Sustainable Water Management," Sustainability, MDPI, vol. 13(9), pages 1-15, April.
    2. Michalscheck, Mirja & Groot, Jeroen C.J. & Fischer, Gundula & Tittonell, Pablo, 2020. "Land use decisions: By whom and to whose benefit? A serious game to uncover dynamics in farm land allocation at household level in Northern Ghana," Land Use Policy, Elsevier, vol. 91(C).
    3. Ditzler, Lenora & Klerkx, Laurens & Chan-Dentoni, Jacqueline & Posthumus, Helena & Krupnik, Timothy J. & Ridaura, Santiago López & Andersson, Jens A. & Baudron, Frédéric & Groot, Jeroen C.J., 2018. "Affordances of agricultural systems analysis tools: A review and framework to enhance tool design and implementation," Agricultural Systems, Elsevier, vol. 164(C), pages 20-30.
    4. Tina-Simone Neset & Lotta Andersson & Ola Uhrqvist & Carlo Navarra, 2020. "Serious Gaming for Climate Adaptation—Assessing the Potential and Challenges of a Digital Serious Game for Urban Climate Adaptation," Sustainability, MDPI, vol. 12(5), pages 1-18, February.
    5. Lisette Beek & Manjana Milkoreit & Linda Prokopy & Jason B. Reed & Joost Vervoort & Arjan Wardekker & Roberta Weiner, 2022. "The effects of serious gaming on risk perceptions of climate tipping points," Climatic Change, Springer, vol. 170(3), pages 1-23, February.
    6. Moojen, Fernanda Gomes & Ryschawy, Julie & dos Santos, Davi Teixeira & Barth Neto, Armindo & Vieira, Paulo Cardozo & Portella, Elisa & de Faccio Carvalho, Paulo César, 2022. "The farm coaching experience to support the transition to integrated crop–livestock systems: From gaming to action," Agricultural Systems, Elsevier, vol. 196(C).
    7. Tasos Hovardas, 2021. "Social Sustainability as Social Learning: Insights from Multi-Stakeholder Environmental Governance," Sustainability, MDPI, vol. 13(14), pages 1-20, July.
    8. Kengo Suzuki & Ryohei Ishiwata, 2022. "Impact of a Carbon Tax on Energy Transition in a Deregulated Market: A Game-Based Experimental Approach," Sustainability, MDPI, vol. 14(19), pages 1-19, October.
    9. Wegmann, Johannes & Mußhoff, Oliver, 2019. "Groundwater management institutions in the face of rapid urbanization – Results of a framed field experiment in Bengaluru, India," Ecological Economics, Elsevier, vol. 166(C), pages 1-1.
    10. Clémence Moreau & Cécile Barnaud & Raphaël Mathevet, 2019. "Conciliate Agriculture with Landscape and Biodiversity Conservation: A Role-Playing Game to Explore Trade-Offs among Ecosystem Services through Social Learning," Sustainability, MDPI, vol. 11(2), pages 1-20, January.
    11. Falk, Thomas & Kumar, Shalander & Srigiri, Srinivasa, 2019. "Experimental games for developing institutional capacity to manage common water infrastructure in India," Agricultural Water Management, Elsevier, vol. 221(C), pages 260-269.
    12. Ison, Ray & Blackmore, Chris & Iaquinto, Benjamin L., 2013. "Towards systemic and adaptive governance: Exploring the revealing and concealing aspects of contemporary social-learning metaphors," Ecological Economics, Elsevier, vol. 87(C), pages 34-42.
    13. Victoria Wibeck & Tina‐Simone Neset, 2020. "Focus groups and serious gaming in climate change communication research—A methodological review," Wiley Interdisciplinary Reviews: Climate Change, John Wiley & Sons, vol. 11(5), September.
    14. Bartels, Lara & Falk, Thomas & Duche, Vishwambhar & Vollan, Björn, 2022. "Experimental games in transdisciplinary research: The potential importance of individual payments," Journal of Environmental Economics and Management, Elsevier, vol. 113(C).
    15. Meine van Noordwijk & Erika Speelman & Gert Jan Hofstede & Ai Farida & Ali Yansyah Abdurrahim & Andrew Miccolis & Arief Lukman Hakim & Charles Nduhiu Wamucii & Elisabeth Lagneaux & Federico Andreotti , 2020. "Sustainable Agroforestry Landscape Management: Changing the Game," Land, MDPI, vol. 9(8), pages 1-38, July.
    16. Andreas Gerber & Markus Ulrich & Flurin X. Wäger & Marta Roca-Puigròs & João S. V. Gonçalves & Patrick Wäger, 2021. "Games on Climate Change: Identifying Development Potentials through Advanced Classification and Game Characteristics Mapping," Sustainability, MDPI, vol. 13(4), pages 1-26, February.
    17. J. Nicolas Hernandez-Aguilera & Max Mauerman & Alexandra Herrera & Kathryn Vasilaky & Walter Baethgen & Ana Maria Loboguerrero & Rahel Diro & Yohana Tesfamariam Tekeste & Daniel Osgood, 2020. "Games and Fieldwork in Agriculture: A Systematic Review of the 21st Century in Economics and Social Science," Games, MDPI, vol. 11(4), pages 1-22, October.
    18. Falk, Thomas & Zhang, Wei & Meinzen-Dick, Ruth Suseela & Bartels, Lara, 2021. "Games for triggering collective change in natural resource management: A conceptual framework and insights from four cases from India," IFPRI discussion papers 1995, International Food Policy Research Institute (IFPRI).
    19. Ricart Casadevall, Sandra, 2016. "Improving the management of water multi-functionality through stakeholder involvement in decision-making processes," Utilities Policy, Elsevier, vol. 43(PA), pages 71-81.
    20. Dolinska, Aleksandra & Hassenforder, Emeline & Loboguerrero, Ana Maria & Sultan, Benjamin & Bossuet, Jérôme & Cottenceau, Jeanne & Bonatti, Michelle & Hellin, Jon & Mekki, Insaf & Drogoul, Alexis & Va, 2023. "Co-production opportunities seized and missed in decision-support frameworks for climate-change adaptation in agriculture – How do we practice the “best practice”?," Agricultural Systems, Elsevier, vol. 212(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jsusta:v:10:y:2018:i:12:p:4529-:d:186887. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.