IDEAS home Printed from https://ideas.repec.org/a/gam/jijerp/v19y2022i20p13308-d943356.html
   My bibliography  Save this article

Emotional-Health-Oriented Urban Design: A Novel Collaborative Deep Learning Framework for Real-Time Landscape Assessment by Integrating Facial Expression Recognition and Pixel-Level Semantic Segmentation

Author

Listed:
  • Xuan Zhang

    (Institute of Urban and Rural Planning Theories and Technologies, College of Civil Engineering and Architecture, Zhejiang University, Hangzhou 310058, China)

  • Haoying Han

    (Institute of Urban and Rural Planning Theories and Technologies, College of Civil Engineering and Architecture, Zhejiang University, Hangzhou 310058, China)

  • Lin Qiao

    (Institute of Landscape Architecture, College of Agriculture and Biotechnology, Zhejiang University, Hangzhou 310058, China)

  • Jingwei Zhuang

    (Institute of Landscape Architecture, College of Agriculture and Biotechnology, Zhejiang University, Hangzhou 310058, China)

  • Ziming Ren

    (Department of Landscape Architecture, School of Civil Engineering and Architecture, Zhejiang Sci-Tech University, Hangzhou 310018, China)

  • Yang Su

    (The Architectural Design & Research Institute of Zhejiang University Co., Ltd., Hangzhou 310030, China)

  • Yiping Xia

    (Institute of Landscape Architecture, College of Agriculture and Biotechnology, Zhejiang University, Hangzhou 310058, China)

Abstract

Emotional responses are significant for understanding public perceptions of urban green space (UGS) and can be used to inform proposals for optimal urban design strategies to enhance public emotional health in the times of COVID-19. However, most empirical studies fail to consider emotion-oriented landscape assessments under dynamic perspectives despite the fact that individually observed sceneries alter with angle. To close this gap, a real-time sentimental-based landscape assessment framework is developed, integrating facial expression recognition with semantic segmentation of changing landscapes. Furthermore, a case study using panoramic videos converted from Google Street View images to simulate changing scenes was used to test the viability of this framework, resulting in five million big data points. The result of this study shows that through the collaboration of deep learning algorithms, finer visual variables were classified, subtle emotional responses were tracked, and better regression results for valence and arousal were obtained. Among all the predictors, the proportion of grass was the most significant predictor for emotional perception. The proposed framework is adaptable and human-centric, and it enables the instantaneous emotional perception of the built environment by the general public as a feedback survey tool to aid urban planners in creating UGS that promote emotional well-being.

Suggested Citation

  • Xuan Zhang & Haoying Han & Lin Qiao & Jingwei Zhuang & Ziming Ren & Yang Su & Yiping Xia, 2022. "Emotional-Health-Oriented Urban Design: A Novel Collaborative Deep Learning Framework for Real-Time Landscape Assessment by Integrating Facial Expression Recognition and Pixel-Level Semantic Segmentat," IJERPH, MDPI, vol. 19(20), pages 1-20, October.
  • Handle: RePEc:gam:jijerp:v:19:y:2022:i:20:p:13308-:d:943356
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/1660-4601/19/20/13308/pdf
    Download Restriction: no

    File URL: https://www.mdpi.com/1660-4601/19/20/13308/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Seth G. Benzell & Avinash Collis & Christos Nicolaides, 2020. "Rationing social contact during the COVID-19 pandemic: Transmission risk and social benefits of US locations," Proceedings of the National Academy of Sciences, Proceedings of the National Academy of Sciences, vol. 117(26), pages 14642-14644, June.
    2. Helena Nordh & Caroline M. Hagerhall & Kenneth Holmqvist, 2013. "Tracking Restorative Components: Patterns in Eye Movements as a Consequence of a Restorative Rating Task," Landscape Research, Taylor & Francis Journals, vol. 38(1), pages 101-116, February.
    3. Michelle C. Kondo & Jaime M. Fluehr & Thomas McKeon & Charles C. Branas, 2018. "Urban Green Space and Its Impact on Human Health," IJERPH, MDPI, vol. 15(3), pages 1-28, March.
    4. Linjia Wu & Qidi Dong & Shixian Luo & Wenyuan Jiang & Ming Hao & Qibing Chen, 2021. "Effects of Spatial Elements of Urban Landscape Forests on the Restoration Potential and Preference of Adolescents," Land, MDPI, vol. 10(12), pages 1-16, December.
    5. Ge Chen & Jiaying Shi & Yiping Xia & Katsunori Furuya, 2020. "The Sustainable Development of Urban Cultural Heritage Gardens Based on Tourists’ Perception: A Case Study of Tokyo’s Cultural Heritage Gardens," Sustainability, MDPI, vol. 12(16), pages 1-14, August.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Tytti P. Pasanen & Anna Kajosaari, 2023. "Special Issue: Place, Space, and Mental Health," IJERPH, MDPI, vol. 20(6), pages 1-3, March.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Hui, Ling Chui & Jim, C.Y., 2022. "Urban-greenery demands are affected by perceptions of ecosystem services and disservices, and socio-demographic and environmental-cultural factors," Land Use Policy, Elsevier, vol. 120(C).
    2. Anindya Ghose & Beibei Li & Meghanath Macha & Chenshuo Sun & Natasha Ying Zhang Foutz, 2020. "Trading Privacy for the Greater Social Good: How Did America React During COVID-19?," Papers 2006.05859, arXiv.org.
    3. Amber L. Pearson & Victoria Breeze & Aaron Reuben & Gwen Wyatt, 2021. "Increased Use of Porch or Backyard Nature during COVID-19 Associated with Lower Stress and Better Symptom Experience among Breast Cancer Patients," IJERPH, MDPI, vol. 18(17), pages 1-13, August.
    4. Malik, Khyati & Kim, Sowon & Cultice, Brian J., 2023. "The impact of remote work on green space values in regional housing markets," Journal of Housing Economics, Elsevier, vol. 62(C).
    5. Xiaojia Liu & Xi Chen & Yan Huang & Weihong Wang & Mingkan Zhang & Yang Jin, 2023. "Landscape Aesthetic Value of Waterfront Green Space Based on Space–Psychology–Behavior Dimension: A Case Study along Qiantang River (Hangzhou Section)," IJERPH, MDPI, vol. 20(4), pages 1-22, February.
    6. Fei Qin & Yiqing Song & George P Nassis & Lina Zhao & Yanan Dong & Cuicui Zhao & Yiwei Feng & Jiexiu Zhao, 2020. "Physical Activity, Screen Time, and Emotional Well-Being during the 2019 Novel Coronavirus Outbreak in China," IJERPH, MDPI, vol. 17(14), pages 1-16, July.
    7. A. Haven Kiers & Billy Krimmel & Caroline Larsen-Bircher & Kate Hayes & Ash Zemenick & Julia Michaels, 2022. "Different Jargon, Same Goals: Collaborations between Landscape Architects and Ecologists to Maximize Biodiversity in Urban Lawn Conversions," Land, MDPI, vol. 11(10), pages 1-18, September.
    8. Suling Guo & Wei Sun & Wen Chen & Jianxin Zhang & Peixue Liu, 2021. "Impact of Artificial Elements on Mountain Landscape Perception: An Eye-Tracking Study," Land, MDPI, vol. 10(10), pages 1-18, October.
    9. Lisa Dandolo & Klaus Telkmann & Christina Hartig & Sophie Horstmann & Sara Pedron & Lars Schwettmann & Peter Selsam & Alexandra Schneider & Gabriele Bolte & on behalf of the INGER Study Group, 2023. "Do Multiple Sex/Gender Dimensions Play a Role in the Association of Green Space and Self-Rated Health? Model-Based Recursive Partitioning Results from the KORA INGER Study," IJERPH, MDPI, vol. 20(7), pages 1-23, March.
    10. Adriano Bressane & Mirela Beatriz Silva & Ana Paula Garcia Goulart & Líliam César de Castro Medeiros, 2024. "Understanding How Green Space Naturalness Impacts Public Well-Being: Prospects for Designing Healthier Cities," IJERPH, MDPI, vol. 21(5), pages 1-11, May.
    11. Chang Li & Yu Yuan & Changan Sun & Minkai Sun, 2022. "The Perceived Restorative Quality of Viewing Various Types of Urban and Rural Scenes: Based on Psychological and Physiological Responses," Sustainability, MDPI, vol. 14(7), pages 1-21, March.
    12. Bram Oosterbroek & Joop de Kraker & Maud M. T. E. Huynen & Pim Martens, 2024. "Integrated Assessment of Health Benefits and Burdens of Urban Greenspace Designs," Sustainability, MDPI, vol. 16(17), pages 1-18, August.
    13. Luciano Telesca & Michele Lovallo & Gianfranco Cardettini & Angelo Aromando & Nicodemo Abate & Monica Proto & Antonio Loperte & Nicola Masini & Rosa Lasaponara, 2023. "Urban and Peri-Urban Vegetation Monitoring Using Satellite MODIS NDVI Time Series, Singular Spectrum Analysis, and Fisher–Shannon Statistical Method," Sustainability, MDPI, vol. 15(14), pages 1-20, July.
    14. Michael E. Darden & David Dowdy & Lauren Gardner & Barton H. Hamilton & Karen Kopecky & Melissa Marx & Nicholas W. Papageorge & Daniel Polsky & Kimberly A. Powers & Elizabeth A. Stuart & Matthew V. Za, 2022. "Modeling to inform economy‐wide pandemic policy: Bringing epidemiologists and economists together," Health Economics, John Wiley & Sons, Ltd., vol. 31(7), pages 1291-1295, July.
    15. Brenda B. Lin & Susan Thompson & Richard Mitchell & Thomas Astell-Burt & Evelyne De Leeuw & Bin Jalaludin & Xiaoqi Feng, 2023. "Policymaker and Practitioner Perceptions of Parks for Health and Wellbeing: Scoping a Holistic Approach," Sustainability, MDPI, vol. 15(6), pages 1-16, March.
    16. Valentina Cattivelli, 2023. "Review and Analysis of the Motivations Associated with Urban Gardening in the Pandemic Period," Sustainability, MDPI, vol. 15(3), pages 1-18, January.
    17. Wojciech Durlak & Margot Dudkiewicz & Małgorzata Milecka, 2022. "A Combined Methods of Senile Trees Inventory in Sustainable Urban Greenery Management on the Example of the City of Sandomierz (Poland)," Land, MDPI, vol. 11(11), pages 1-29, October.
    18. Junfang Xie & Binyi Liu & Mohamed Elsadek, 2021. "How Can Flowers and Their Colors Promote Individuals’ Physiological and Psychological States during the COVID-19 Lockdown?," IJERPH, MDPI, vol. 18(19), pages 1-15, September.
    19. Nicole V. DeVille & Linda Powers Tomasso & Olivia P. Stoddard & Grete E. Wilt & Teresa H. Horton & Kathleen L. Wolf & Eric Brymer & Peter H. Kahn & Peter James, 2021. "Time Spent in Nature Is Associated with Increased Pro-Environmental Attitudes and Behaviors," IJERPH, MDPI, vol. 18(14), pages 1-18, July.
    20. Shunwei Ji & Renfeng Ma & Liyan Ren & Caijuan Wang, 2020. "How to Find Vacant Green Space in the Process of Urban Park Planning: Case Study in Ningbo (China)," IJERPH, MDPI, vol. 17(21), pages 1-19, November.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jijerp:v:19:y:2022:i:20:p:13308-:d:943356. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.