IDEAS home Printed from https://ideas.repec.org/a/eee/rensus/v192y2024ics1364032123010237.html
   My bibliography  Save this article

Computer vision to advance the sensing and control of built environment towards occupant-centric sustainable development: A critical review

Author

Listed:
  • Wang, Junqi
  • Jiang, Lanfei
  • Yu, Hanhui
  • Feng, Zhuangbo
  • Castaño-Rosa, Raúl
  • Cao, Shi-jie

Abstract

As urban development progresses, the built environment control has faced more critical challenges in improving energy efficiency, air quality, and environmental comfort. Occupant information (e.g., occupant status and behavior) sensing is a key but challenging aspect of built environmental control. Computer vision (CV) technology provides a new way for multi-dimensional information acquisition. However, a critical review is lacking in the cross-research area of CV and built environment control, particularly considering the technological advancements following the COVID-19 pandemic. This article reviews the latest advancements in the built environment from international sources, with a focus on the research frontier in four branches: ventilation and indoor air quality control, COVID-19 control, thermal environment control, and lighting control. Through critical comparisons and analyses, it demonstrates that CV technology can effectively sense highly dynamic built environments, which greatly enhances the data dimension, resolution and accuracy compared to existing sensing technologies. Reported data shows that CV technology achieved an average detection accuracy of about 95% for occupant-related information and 86% for comfort-related information. Effective methods to improve the accuracy include incorporating data fusion by using other sensors, upgrading algorithms, and improving the model training. Particularly, the COVID-19 pandemic has driven the development of mask detection and social distancing detection using CV. The challenges, future trends and potential applications are discussed. This study emphasizes the need for cross-field integration of CV and built environment to facilitate the sharing of cutting-edge techniques and knowledge, which will stimulate more innovations in the future.

Suggested Citation

  • Wang, Junqi & Jiang, Lanfei & Yu, Hanhui & Feng, Zhuangbo & Castaño-Rosa, Raúl & Cao, Shi-jie, 2024. "Computer vision to advance the sensing and control of built environment towards occupant-centric sustainable development: A critical review," Renewable and Sustainable Energy Reviews, Elsevier, vol. 192(C).
    • Handle: RePEc:eee:rensus:v:192:y:2024:i:c:s1364032123010237
    DOI: 10.1016/j.rser.2023.114165
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S1364032123010237
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.rser.2023.114165?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Ghahramani, Ali & Zhang, Kenan & Dutta, Kanu & Yang, Zheng & Becerik-Gerber, Burcin, 2016. "Energy savings from temperature setpoints and deadband: Quantifying the influence of building and system properties on savings," Applied Energy, Elsevier, vol. 165(C), pages 930-942.
    2. Pal, Monalisa & Alyafi, Amr Alzouhri & Ploix, Stéphane & Reignier, Patrick & Bandyopadhyay, Sanghamitra, 2019. "Unmasking the causal relationships latent in the interplay between occupant’s actions and indoor ambience: A building energy management outlook," Applied Energy, Elsevier, vol. 238(C), pages 1452-1470.
    3. Wei, Shuangyu & Tien, Paige Wenbin & Calautit, John Kaiser & Wu, Yupeng & Boukhanouf, Rabah, 2020. "Vision-based detection and prediction of equipment heat gains in commercial office buildings using a deep learning method," Applied Energy, Elsevier, vol. 277(C).
    4. Shariq, M. Hasan & Hughes, Ben Richard, 2020. "Revolutionising building inspection techniques to meet large-scale energy demands: A review of the state-of-the-art," Renewable and Sustainable Energy Reviews, Elsevier, vol. 130(C).
    5. Heangwoo Lee & Chang-ho Choi & Minki Sung, 2018. "Development of a Dimming Lighting Control System Using General Illumination and Location-Awareness Technology," Energies, MDPI, vol. 11(11), pages 1-19, November.
    6. Ghahramani, Ali & Castro, Guillermo & Karvigh, Simin Ahmadi & Becerik-Gerber, Burcin, 2018. "Towards unsupervised learning of thermal comfort using infrared thermography," Applied Energy, Elsevier, vol. 211(C), pages 41-49.
    7. Pang, Zhihong & Chen, Yan & Zhang, Jian & O'Neill, Zheng & Cheng, Hwakong & Dong, Bing, 2020. "Nationwide HVAC energy-saving potential quantification for office buildings with occupant-centric controls in various climates," Applied Energy, Elsevier, vol. 279(C).
    8. Garrido, I. & Lagüela, S. & Otero, R. & Arias, P., 2020. "Thermographic methodologies used in infrastructure inspection: A review—Post-processing procedures," Applied Energy, Elsevier, vol. 266(C).
    9. Jazizadeh, Farrokh & Jung, Wooyoung, 2018. "Personalized thermal comfort inference using RGB video images for distributed HVAC control," Applied Energy, Elsevier, vol. 220(C), pages 829-841.
    10. Eun Ji Choi & Jin Woo Moon & Ji-hoon Han & Yongseok Yoo, 2021. "Development of a Deep Neural Network Model for Estimating Joint Location of Occupant Indoor Activities for Providing Thermal Comfort," Energies, MDPI, vol. 14(3), pages 1-14, January.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Ghahramani, Ali & Pantelic, Jovan & Lindberg, Casey & Mehl, Matthias & Srinivasan, Karthik & Gilligan, Brian & Arens, Edward, 2018. "Learning occupants’ workplace interactions from wearable and stationary ambient sensing systems," Applied Energy, Elsevier, vol. 230(C), pages 42-51.
    2. Tien, Paige Wenbin & Wei, Shuangyu & Liu, Tianshu & Calautit, John & Darkwa, Jo & Wood, Christopher, 2021. "A deep learning approach towards the detection and recognition of opening of windows for effective management of building ventilation heat losses and reducing space heating demand," Renewable Energy, Elsevier, vol. 177(C), pages 603-625.
    3. Darowicki, K. & Janicka, E. & Mielniczek, M. & Zielinski, A. & Gawel, L. & Mitzel, J. & Hunger, J., 2019. "The influence of dynamic load changes on temporary impedance in hydrogen fuel cells, selection and validation of the electrical equivalent circuit," Applied Energy, Elsevier, vol. 251(C), pages 1-1.
    4. Chaudhuri, Tanaya & Soh, Yeng Chai & Li, Hua & Xie, Lihua, 2019. "A feedforward neural network based indoor-climate control framework for thermal comfort and energy saving in buildings," Applied Energy, Elsevier, vol. 248(C), pages 44-53.
    5. Jung, Wooyoung & Jazizadeh, Farrokh, 2020. "Energy saving potentials of integrating personal thermal comfort models for control of building systems: Comprehensive quantification through combinatorial consideration of influential parameters," Applied Energy, Elsevier, vol. 268(C).
    6. Jihye Ryu & Jungsoo Kim, 2021. "Effect of Different HVAC Control Strategies on Thermal Comfort and Adaptive Behavior in High-Rise Apartments," Sustainability, MDPI, vol. 13(21), pages 1-20, October.
    7. Pantua, Conrad Allan Jay & Calautit, John Kaiser & Wu, Yupeng, 2021. "Sustainability and structural resilience of building integrated photovoltaics subjected to typhoon strength winds," Applied Energy, Elsevier, vol. 301(C).
    8. Yoon, Y. & Jung, S. & Im, P. & Salonvaara, M. & Bhandari, M. & Kunwar, N., 2023. "Empirical validation of building energy simulation model input parameter for multizone commercial building during the cooling season," Renewable and Sustainable Energy Reviews, Elsevier, vol. 188(C).
    9. Nilofar Asim & Marzieh Badiei & Masita Mohammad & Halim Razali & Armin Rajabi & Lim Chin Haw & Mariyam Jameelah Ghazali, 2022. "Sustainability of Heating, Ventilation and Air-Conditioning (HVAC) Systems in Buildings—An Overview," IJERPH, MDPI, vol. 19(2), pages 1-16, January.
    10. Hua Chen & Shuang Dai & Fanlin Meng, 2023. "Smart Building Thermal Management: A Data-Driven Approach Based on Dynamic and Consensus Clustering," Sustainability, MDPI, vol. 15(21), pages 1-25, October.
    11. Tien, Paige Wenbin & Wei, Shuangyu & Calautit, John Kaiser & Darkwa, Jo & Wood, Christopher, 2022. "Real-time monitoring of occupancy activities and window opening within buildings using an integrated deep learning-based approach for reducing energy demand," Applied Energy, Elsevier, vol. 308(C).
    12. Jianwu Xiong & Linlin Chen & Yin Zhang, 2023. "Building Energy Saving for Indoor Cooling and Heating: Mechanism and Comparison on Temperature Difference," Sustainability, MDPI, vol. 15(14), pages 1-20, July.
    13. Azar, Elie & Nikolopoulou, Christina & Papadopoulos, Sokratis, 2016. "Integrating and optimizing metrics of sustainable building performance using human-focused agent-based modeling," Applied Energy, Elsevier, vol. 183(C), pages 926-937.
    14. Afroz, Zakia & Urmee, Tania & Shafiullah, G.M. & Higgins, Gary, 2018. "Real-time prediction model for indoor temperature in a commercial building," Applied Energy, Elsevier, vol. 231(C), pages 29-53.
    15. Ye, Yunyang & Chen, Yan & Zhang, Jian & Pang, Zhihong & O’Neill, Zheng & Dong, Bing & Cheng, Hwakong, 2021. "Energy-saving potential evaluation for primary schools with occupant-centric controls," Applied Energy, Elsevier, vol. 293(C).
    16. Yamaguchi, Yohei & Kim, Bumjoon & Kitamura, Takuya & Akizawa, Kotone & Chen, Hemiao & Shimoda, Yoshiyuki, 2022. "Building stock energy modeling considering building system composition and long-term change for climate change mitigation of commercial building stocks," Applied Energy, Elsevier, vol. 306(PA).
    17. Turhan, Cihan & Simani, Silvio & Gokcen Akkurt, Gulden, 2021. "Development of a personalized thermal comfort driven controller for HVAC systems," Energy, Elsevier, vol. 237(C).
    18. Quddus Tushar & Guomin Zhang & Satheeskumar Navaratnam & Muhammed A. Bhuiyan & Lei Hou & Filippo Giustozzi, 2023. "A Review of Evaluative Measures of Carbon-Neutral Buildings: The Bibliometric and Science Mapping Analysis towards Sustainability," Sustainability, MDPI, vol. 15(20), pages 1-31, October.
    19. Zhang, Xiangyu & Pipattanasomporn, Manisa & Rahman, Saifur, 2017. "A self-learning algorithm for coordinated control of rooftop units in small- and medium-sized commercial buildings," Applied Energy, Elsevier, vol. 205(C), pages 1034-1049.
    20. Dehwah, Ammar H.A. & Krarti, Moncef, 2022. "Optimal controls of precooling strategies using switchable insulation systems for commercial buildings," Applied Energy, Elsevier, vol. 320(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:rensus:v:192:y:2024:i:c:s1364032123010237. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/600126/description#description .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.