IDEAS home Printed from https://ideas.repec.org/a/eee/rensus/v192y2024ics1364032123010237.html
   My bibliography  Save this article

Computer vision to advance the sensing and control of built environment towards occupant-centric sustainable development: A critical review

Author

Listed:
  • Wang, Junqi
  • Jiang, Lanfei
  • Yu, Hanhui
  • Feng, Zhuangbo
  • Castaño-Rosa, Raúl
  • Cao, Shi-jie

Abstract

As urban development progresses, the built environment control has faced more critical challenges in improving energy efficiency, air quality, and environmental comfort. Occupant information (e.g., occupant status and behavior) sensing is a key but challenging aspect of built environmental control. Computer vision (CV) technology provides a new way for multi-dimensional information acquisition. However, a critical review is lacking in the cross-research area of CV and built environment control, particularly considering the technological advancements following the COVID-19 pandemic. This article reviews the latest advancements in the built environment from international sources, with a focus on the research frontier in four branches: ventilation and indoor air quality control, COVID-19 control, thermal environment control, and lighting control. Through critical comparisons and analyses, it demonstrates that CV technology can effectively sense highly dynamic built environments, which greatly enhances the data dimension, resolution and accuracy compared to existing sensing technologies. Reported data shows that CV technology achieved an average detection accuracy of about 95% for occupant-related information and 86% for comfort-related information. Effective methods to improve the accuracy include incorporating data fusion by using other sensors, upgrading algorithms, and improving the model training. Particularly, the COVID-19 pandemic has driven the development of mask detection and social distancing detection using CV. The challenges, future trends and potential applications are discussed. This study emphasizes the need for cross-field integration of CV and built environment to facilitate the sharing of cutting-edge techniques and knowledge, which will stimulate more innovations in the future.

Suggested Citation

  • Wang, Junqi & Jiang, Lanfei & Yu, Hanhui & Feng, Zhuangbo & Castaño-Rosa, Raúl & Cao, Shi-jie, 2024. "Computer vision to advance the sensing and control of built environment towards occupant-centric sustainable development: A critical review," Renewable and Sustainable Energy Reviews, Elsevier, vol. 192(C).
    • Handle: RePEc:eee:rensus:v:192:y:2024:i:c:s1364032123010237
    DOI: 10.1016/j.rser.2023.114165
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S1364032123010237
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.rser.2023.114165?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Ghahramani, Ali & Zhang, Kenan & Dutta, Kanu & Yang, Zheng & Becerik-Gerber, Burcin, 2016. "Energy savings from temperature setpoints and deadband: Quantifying the influence of building and system properties on savings," Applied Energy, Elsevier, vol. 165(C), pages 930-942.
    2. Pal, Monalisa & Alyafi, Amr Alzouhri & Ploix, Stéphane & Reignier, Patrick & Bandyopadhyay, Sanghamitra, 2019. "Unmasking the causal relationships latent in the interplay between occupant’s actions and indoor ambience: A building energy management outlook," Applied Energy, Elsevier, vol. 238(C), pages 1452-1470.
    3. Pang, Zhihong & Chen, Yan & Zhang, Jian & O'Neill, Zheng & Cheng, Hwakong & Dong, Bing, 2020. "Nationwide HVAC energy-saving potential quantification for office buildings with occupant-centric controls in various climates," Applied Energy, Elsevier, vol. 279(C).
    4. Wei, Shuangyu & Tien, Paige Wenbin & Calautit, John Kaiser & Wu, Yupeng & Boukhanouf, Rabah, 2020. "Vision-based detection and prediction of equipment heat gains in commercial office buildings using a deep learning method," Applied Energy, Elsevier, vol. 277(C).
    5. Shariq, M. Hasan & Hughes, Ben Richard, 2020. "Revolutionising building inspection techniques to meet large-scale energy demands: A review of the state-of-the-art," Renewable and Sustainable Energy Reviews, Elsevier, vol. 130(C).
    6. Heangwoo Lee & Chang-ho Choi & Minki Sung, 2018. "Development of a Dimming Lighting Control System Using General Illumination and Location-Awareness Technology," Energies, MDPI, vol. 11(11), pages 1-19, November.
    7. Garrido, I. & Lagüela, S. & Otero, R. & Arias, P., 2020. "Thermographic methodologies used in infrastructure inspection: A review—Post-processing procedures," Applied Energy, Elsevier, vol. 266(C).
    8. Jazizadeh, Farrokh & Jung, Wooyoung, 2018. "Personalized thermal comfort inference using RGB video images for distributed HVAC control," Applied Energy, Elsevier, vol. 220(C), pages 829-841.
    9. Eun Ji Choi & Jin Woo Moon & Ji-hoon Han & Yongseok Yoo, 2021. "Development of a Deep Neural Network Model for Estimating Joint Location of Occupant Indoor Activities for Providing Thermal Comfort," Energies, MDPI, vol. 14(3), pages 1-14, January.
    10. Ghahramani, Ali & Castro, Guillermo & Karvigh, Simin Ahmadi & Becerik-Gerber, Burcin, 2018. "Towards unsupervised learning of thermal comfort using infrared thermography," Applied Energy, Elsevier, vol. 211(C), pages 41-49.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Ghahramani, Ali & Pantelic, Jovan & Lindberg, Casey & Mehl, Matthias & Srinivasan, Karthik & Gilligan, Brian & Arens, Edward, 2018. "Learning occupants’ workplace interactions from wearable and stationary ambient sensing systems," Applied Energy, Elsevier, vol. 230(C), pages 42-51.
    2. Chaudhuri, Tanaya & Soh, Yeng Chai & Li, Hua & Xie, Lihua, 2019. "A feedforward neural network based indoor-climate control framework for thermal comfort and energy saving in buildings," Applied Energy, Elsevier, vol. 248(C), pages 44-53.
    3. Tien, Paige Wenbin & Wei, Shuangyu & Liu, Tianshu & Calautit, John & Darkwa, Jo & Wood, Christopher, 2021. "A deep learning approach towards the detection and recognition of opening of windows for effective management of building ventilation heat losses and reducing space heating demand," Renewable Energy, Elsevier, vol. 177(C), pages 603-625.
    4. Darowicki, K. & Janicka, E. & Mielniczek, M. & Zielinski, A. & Gawel, L. & Mitzel, J. & Hunger, J., 2019. "The influence of dynamic load changes on temporary impedance in hydrogen fuel cells, selection and validation of the electrical equivalent circuit," Applied Energy, Elsevier, vol. 251(C), pages 1-1.
    5. Jung, Wooyoung & Jazizadeh, Farrokh, 2020. "Energy saving potentials of integrating personal thermal comfort models for control of building systems: Comprehensive quantification through combinatorial consideration of influential parameters," Applied Energy, Elsevier, vol. 268(C).
    6. Yoon, Y. & Jung, S. & Im, P. & Salonvaara, M. & Bhandari, M. & Kunwar, N., 2023. "Empirical validation of building energy simulation model input parameter for multizone commercial building during the cooling season," Renewable and Sustainable Energy Reviews, Elsevier, vol. 188(C).
    7. Nilofar Asim & Marzieh Badiei & Masita Mohammad & Halim Razali & Armin Rajabi & Lim Chin Haw & Mariyam Jameelah Ghazali, 2022. "Sustainability of Heating, Ventilation and Air-Conditioning (HVAC) Systems in Buildings—An Overview," IJERPH, MDPI, vol. 19(2), pages 1-16, January.
    8. Jianwu Xiong & Linlin Chen & Yin Zhang, 2023. "Building Energy Saving for Indoor Cooling and Heating: Mechanism and Comparison on Temperature Difference," Sustainability, MDPI, vol. 15(14), pages 1-20, July.
    9. Azar, Elie & Nikolopoulou, Christina & Papadopoulos, Sokratis, 2016. "Integrating and optimizing metrics of sustainable building performance using human-focused agent-based modeling," Applied Energy, Elsevier, vol. 183(C), pages 926-937.
    10. Afroz, Zakia & Urmee, Tania & Shafiullah, G.M. & Higgins, Gary, 2018. "Real-time prediction model for indoor temperature in a commercial building," Applied Energy, Elsevier, vol. 231(C), pages 29-53.
    11. Ye, Yunyang & Chen, Yan & Zhang, Jian & Pang, Zhihong & O’Neill, Zheng & Dong, Bing & Cheng, Hwakong, 2021. "Energy-saving potential evaluation for primary schools with occupant-centric controls," Applied Energy, Elsevier, vol. 293(C).
    12. Quddus Tushar & Guomin Zhang & Satheeskumar Navaratnam & Muhammed A. Bhuiyan & Lei Hou & Filippo Giustozzi, 2023. "A Review of Evaluative Measures of Carbon-Neutral Buildings: The Bibliometric and Science Mapping Analysis towards Sustainability," Sustainability, MDPI, vol. 15(20), pages 1-31, October.
    13. Idahosa, Love Odion & Akotey, Joseph Oscar, 2021. "A social constructionist approach to managing HVAC energy consumption using social norms – A randomised field experiment," Energy Policy, Elsevier, vol. 154(C).
    14. Romero Rodríguez, Laura & Sánchez Ramos, José & Álvarez Domínguez, Servando & Eicker, Ursula, 2018. "Contributions of heat pumps to demand response: A case study of a plus-energy dwelling," Applied Energy, Elsevier, vol. 214(C), pages 191-204.
    15. Heangwoo Lee & Janghoo Seo & Chang-ho Choi, 2019. "Preliminary Study on the Performance Evaluation of a Light Shelf Based on Reflector Curvature," Energies, MDPI, vol. 12(22), pages 1-20, November.
    16. Pang, Zhihong & O'Neill, Zheng & Chen, Yan & Zhang, Jian & Cheng, Hwakong & Dong, Bing, 2023. "Adopting occupancy-based HVAC controls in commercial building energy codes: Analysis of cost-effectiveness and decarbonization potential," Applied Energy, Elsevier, vol. 349(C).
    17. Bui, Dac-Khuong & Nguyen, Tuan Ngoc & Ngo, Tuan Duc & Nguyen-Xuan, H., 2020. "An artificial neural network (ANN) expert system enhanced with the electromagnetism-based firefly algorithm (EFA) for predicting the energy consumption in buildings," Energy, Elsevier, vol. 190(C).
    18. Katharina Boudier & Sabine Hoffmann, 2022. "Analysis of the Potential of Decentralized Heating and Cooling Systems to Improve Thermal Comfort and Reduce Energy Consumption through an Adaptive Building Controller," Energies, MDPI, vol. 15(3), pages 1-28, February.
    19. Nick Van Loy & Griet Verbeeck & Elke Knapen, 2021. "Personal Heating in Dwellings as an Innovative, Energy-Sufficient Heating Practice: A Case Study Research," Sustainability, MDPI, vol. 13(13), pages 1-27, June.
    20. Anatolijs Borodinecs & Arturs Palcikovskis & Andris Krumins & Deniss Zajecs & Kristina Lebedeva, 2024. "Assessment of HVAC Performance and Savings in Office Buildings Using Data-Driven Method," Clean Technol., MDPI, vol. 6(2), pages 1-12, June.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:rensus:v:192:y:2024:i:c:s1364032123010237. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/600126/description#description .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.