IDEAS home Printed from https://ideas.repec.org/a/gam/jijerp/v19y2022i20p13308-d943356.html
   My bibliography  Save this article

Emotional-Health-Oriented Urban Design: A Novel Collaborative Deep Learning Framework for Real-Time Landscape Assessment by Integrating Facial Expression Recognition and Pixel-Level Semantic Segmentation

Author

Listed:
  • Xuan Zhang

    (Institute of Urban and Rural Planning Theories and Technologies, College of Civil Engineering and Architecture, Zhejiang University, Hangzhou 310058, China)

  • Haoying Han

    (Institute of Urban and Rural Planning Theories and Technologies, College of Civil Engineering and Architecture, Zhejiang University, Hangzhou 310058, China)

  • Lin Qiao

    (Institute of Landscape Architecture, College of Agriculture and Biotechnology, Zhejiang University, Hangzhou 310058, China)

  • Jingwei Zhuang

    (Institute of Landscape Architecture, College of Agriculture and Biotechnology, Zhejiang University, Hangzhou 310058, China)

  • Ziming Ren

    (Department of Landscape Architecture, School of Civil Engineering and Architecture, Zhejiang Sci-Tech University, Hangzhou 310018, China)

  • Yang Su

    (The Architectural Design & Research Institute of Zhejiang University Co., Ltd., Hangzhou 310030, China)

  • Yiping Xia

    (Institute of Landscape Architecture, College of Agriculture and Biotechnology, Zhejiang University, Hangzhou 310058, China)

Abstract

Emotional responses are significant for understanding public perceptions of urban green space (UGS) and can be used to inform proposals for optimal urban design strategies to enhance public emotional health in the times of COVID-19. However, most empirical studies fail to consider emotion-oriented landscape assessments under dynamic perspectives despite the fact that individually observed sceneries alter with angle. To close this gap, a real-time sentimental-based landscape assessment framework is developed, integrating facial expression recognition with semantic segmentation of changing landscapes. Furthermore, a case study using panoramic videos converted from Google Street View images to simulate changing scenes was used to test the viability of this framework, resulting in five million big data points. The result of this study shows that through the collaboration of deep learning algorithms, finer visual variables were classified, subtle emotional responses were tracked, and better regression results for valence and arousal were obtained. Among all the predictors, the proportion of grass was the most significant predictor for emotional perception. The proposed framework is adaptable and human-centric, and it enables the instantaneous emotional perception of the built environment by the general public as a feedback survey tool to aid urban planners in creating UGS that promote emotional well-being.

Suggested Citation

  • Xuan Zhang & Haoying Han & Lin Qiao & Jingwei Zhuang & Ziming Ren & Yang Su & Yiping Xia, 2022. "Emotional-Health-Oriented Urban Design: A Novel Collaborative Deep Learning Framework for Real-Time Landscape Assessment by Integrating Facial Expression Recognition and Pixel-Level Semantic Segmentat," IJERPH, MDPI, vol. 19(20), pages 1-20, October.
  • Handle: RePEc:gam:jijerp:v:19:y:2022:i:20:p:13308-:d:943356
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/1660-4601/19/20/13308/pdf
    Download Restriction: no

    File URL: https://www.mdpi.com/1660-4601/19/20/13308/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Seth G. Benzell & Avinash Collis & Christos Nicolaides, 2020. "Rationing social contact during the COVID-19 pandemic: Transmission risk and social benefits of US locations," Proceedings of the National Academy of Sciences, Proceedings of the National Academy of Sciences, vol. 117(26), pages 14642-14644, June.
    2. Ge Chen & Jiaying Shi & Yiping Xia & Katsunori Furuya, 2020. "The Sustainable Development of Urban Cultural Heritage Gardens Based on Tourists’ Perception: A Case Study of Tokyo’s Cultural Heritage Gardens," Sustainability, MDPI, vol. 12(16), pages 1-14, August.
    3. Michelle C. Kondo & Jaime M. Fluehr & Thomas McKeon & Charles C. Branas, 2018. "Urban Green Space and Its Impact on Human Health," IJERPH, MDPI, vol. 15(3), pages 1-28, March.
    4. Linjia Wu & Qidi Dong & Shixian Luo & Wenyuan Jiang & Ming Hao & Qibing Chen, 2021. "Effects of Spatial Elements of Urban Landscape Forests on the Restoration Potential and Preference of Adolescents," Land, MDPI, vol. 10(12), pages 1-16, December.
    5. Helena Nordh & Caroline M. Hagerhall & Kenneth Holmqvist, 2013. "Tracking Restorative Components: Patterns in Eye Movements as a Consequence of a Restorative Rating Task," Landscape Research, Taylor & Francis Journals, vol. 38(1), pages 101-116, February.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Tytti P. Pasanen & Anna Kajosaari, 2023. "Special Issue: Place, Space, and Mental Health," IJERPH, MDPI, vol. 20(6), pages 1-3, March.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Bruno Marques & Jacqueline McIntosh & Chitrakala Muthuveerappan & Krzysztof Herman, 2022. "The Importance of Outdoor Spaces during the COVID-19 Lockdown in Aotearoa—New Zealand," Sustainability, MDPI, vol. 14(12), pages 1-17, June.
    2. Hui, Ling Chui & Jim, C.Y., 2022. "Urban-greenery demands are affected by perceptions of ecosystem services and disservices, and socio-demographic and environmental-cultural factors," Land Use Policy, Elsevier, vol. 120(C).
    3. Anindya Ghose & Beibei Li & Meghanath Macha & Chenshuo Sun & Natasha Ying Zhang Foutz, 2020. "Trading Privacy for the Greater Social Good: How Did America React During COVID-19?," Papers 2006.05859, arXiv.org.
    4. Amber L. Pearson & Victoria Breeze & Aaron Reuben & Gwen Wyatt, 2021. "Increased Use of Porch or Backyard Nature during COVID-19 Associated with Lower Stress and Better Symptom Experience among Breast Cancer Patients," IJERPH, MDPI, vol. 18(17), pages 1-13, August.
    5. Malik, Khyati & Kim, Sowon & Cultice, Brian J., 2023. "The impact of remote work on green space values in regional housing markets," Journal of Housing Economics, Elsevier, vol. 62(C).
    6. Xiaojia Liu & Xi Chen & Yan Huang & Weihong Wang & Mingkan Zhang & Yang Jin, 2023. "Landscape Aesthetic Value of Waterfront Green Space Based on Space–Psychology–Behavior Dimension: A Case Study along Qiantang River (Hangzhou Section)," IJERPH, MDPI, vol. 20(4), pages 1-22, February.
    7. Fei Qin & Yiqing Song & George P Nassis & Lina Zhao & Yanan Dong & Cuicui Zhao & Yiwei Feng & Jiexiu Zhao, 2020. "Physical Activity, Screen Time, and Emotional Well-Being during the 2019 Novel Coronavirus Outbreak in China," IJERPH, MDPI, vol. 17(14), pages 1-16, July.
    8. A. Haven Kiers & Billy Krimmel & Caroline Larsen-Bircher & Kate Hayes & Ash Zemenick & Julia Michaels, 2022. "Different Jargon, Same Goals: Collaborations between Landscape Architects and Ecologists to Maximize Biodiversity in Urban Lawn Conversions," Land, MDPI, vol. 11(10), pages 1-18, September.
    9. Aksoy, Cevat Giray & Ganslmeier, Michael & Poutvaara, Panu, 2020. "Public Attention and Policy Responses to COVID-19 Pandemic," IZA Discussion Papers 13427, Institute of Labor Economics (IZA).
    10. Zhen Yang & Weijun Gao, 2022. "Evaluating the Coordinated Development between Urban Greening and Economic Growth in Chinese Cities during 2005 to 2019," IJERPH, MDPI, vol. 19(15), pages 1-25, August.
    11. Suling Guo & Wei Sun & Wen Chen & Jianxin Zhang & Peixue Liu, 2021. "Impact of Artificial Elements on Mountain Landscape Perception: An Eye-Tracking Study," Land, MDPI, vol. 10(10), pages 1-18, October.
    12. Marina Azzimonti-Renzo & Alessandra Fogli & Fabrizio Perri & Mark Ponder, 2020. "Pandemic Control in ECON-EPI Networks," Staff Report 609, Federal Reserve Bank of Minneapolis.
    13. Natália Cristina de Oliveira & Pedro Balikian Júnior & Arnaldo Tenório da Cunha Júnior & Edson de Souza Bento & Josealdo Tonholo & Thiago Aquino & Filipe Antonio de Barros Sousa & Gustavo Gomes de Ara, 2023. "Environmental Planning and Non-Communicable Diseases: A Systematic Review on the Role of the Metabolomic Profile," IJERPH, MDPI, vol. 20(14), pages 1-15, July.
    14. Nan Li & Muzi Chen & Difang Huang, 2022. "How Do Logistics Disruptions Affect Rural Households? Evidence from COVID-19 in China," Sustainability, MDPI, vol. 15(1), pages 1-17, December.
    15. Yonatal Tefera & Veronica Soebarto & Courtney Bishop & John Kandulu & Carmel Williams, 2023. "A Scoping Review of Urban Planning Decision Support Tools and Processes That Account for the Health, Environment, and Economic Benefits of Trees and Greenspace," IJERPH, MDPI, vol. 21(1), pages 1-28, December.
    16. Noszczyk, Tomasz & Gorzelany, Julia & Kukulska-Kozieł, Anita & Hernik, Józef, 2022. "The impact of the COVID-19 pandemic on the importance of urban green spaces to the public," Land Use Policy, Elsevier, vol. 113(C).
    17. Lisa Dandolo & Christina Hartig & Klaus Telkmann & Sophie Horstmann & Lars Schwettmann & Peter Selsam & Alexandra Schneider & Gabriele Bolte & on behalf of the INGER Study Group, 2022. "Decision Tree Analyses to Explore the Relevance of Multiple Sex/Gender Dimensions for the Exposure to Green Spaces: Results from the KORA INGER Study," IJERPH, MDPI, vol. 19(12), pages 1-25, June.
    18. Till Baldenius & Nicolas Koch & Hannah Klauber & Nadja Klein, 2023. "Heat increases experienced racial segregation in the United States," Papers 2306.13772, arXiv.org.
    19. Jeremy Mennis & Xiaojiang Li & Mahbubur Meenar & J. Douglas Coatsworth & Thomas P. McKeon & Michael J. Mason, 2021. "Residential Greenspace and Urban Adolescent Substance Use: Exploring Interactive Effects with Peer Network Health, Sex, and Executive Function," IJERPH, MDPI, vol. 18(4), pages 1-15, February.
    20. Brzoska, P. & Grunewald, K. & Bastian, O., 2021. "A multi-criteria analytical method to assess ecosystem services at urban site level, exemplified by two German city districts," Ecosystem Services, Elsevier, vol. 49(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jijerp:v:19:y:2022:i:20:p:13308-:d:943356. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.