IDEAS home Printed from https://ideas.repec.org/a/gam/jsusta/v16y2024i12p5058-d1414591.html
   My bibliography  Save this article

Single-Shot Visual Relationship Detection for the Accurate Identification of Contact-Driven Hazards in Sustainable Digitized Construction

Author

Listed:
  • Daeho Kim

    (Civil and Mineral Engineering, University of Toronto, 35 St. George St., Toronto, ON M5S 1A4, Canada)

  • Ankit Goyal

    (NVIDIA Seattle Robotics Lab, 11431 Willows Rd., Redmond, WA 98052, USA)

  • SangHyun Lee

    (Civil and Environmental Engineering, University of Michigan, 2350 Hayward St., Ann Arbor, MI 48109, USA)

  • Vineet R. Kamat

    (Civil and Environmental Engineering, University of Michigan, 2350 Hayward St., Ann Arbor, MI 48109, USA)

  • Meiyin Liu

    (Civil and Environmental Engineering, Rutgers University, 96 Frelinghuysen Rd., Piscataway, NJ 08854, USA)

Abstract

Deploying construction robots alongside workers presents the risk of unwanted forcible contact—a critical safety concern. To address a semantic digital twin where such contact-driven hazards can be monitored accurately, the authors present a single-shot deep neural network (DNN) model that can perform proximity and relationship detections simultaneously. Given that workers and construction robots must sometimes collaborate in close proximity, their relationship must be considered, along with proximity, before concluding an event is a hazard. To address this issue, we leveraged a unique two-in-one DNN architecture called Pixel2Graph (i.e., object + relationship detections). The potential of this DNN architecture for relationship detection was confirmed by follow-up testing using real-site images, achieving 90.63% recall@5 when object bounding boxes and classes were given. When integrated with existing proximity monitoring methods, single-shot visual relationship detection will enable the accurate identification of contact-driven hazards in a digital twin platform, an essential step in realizing sustainable and safe collaboration between workers and robots.

Suggested Citation

  • Daeho Kim & Ankit Goyal & SangHyun Lee & Vineet R. Kamat & Meiyin Liu, 2024. "Single-Shot Visual Relationship Detection for the Accurate Identification of Contact-Driven Hazards in Sustainable Digitized Construction," Sustainability, MDPI, vol. 16(12), pages 1-16, June.
  • Handle: RePEc:gam:jsusta:v:16:y:2024:i:12:p:5058-:d:1414591
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/2071-1050/16/12/5058/pdf
    Download Restriction: no

    File URL: https://www.mdpi.com/2071-1050/16/12/5058/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Byung-Wan Jo & Yun-Sung Lee & Jung-Hoon Kim & Do-Keun Kim & Pyung-Ho Choi, 2017. "Proximity Warning and Excavator Control System for Prevention of Collision Accidents," Sustainability, MDPI, vol. 9(8), pages 1-20, August.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Ali Noudoostbeni & Kiran Kaur & Hashem Salarzadeh Jenatabadi, 2018. "A Comparison of Structural Equation Modeling Approaches with DeLone & McLean’s Model: A Case Study of Radio-Frequency Identification User Satisfaction in Malaysian University Libraries," Sustainability, MDPI, vol. 10(7), pages 1-16, July.
    2. Yun-Sung Lee & Do-Keun Kim & Jung-Hoon Kim, 2023. "Deep-Learning-Based Anti-Collision System for Construction Equipment Operators," Sustainability, MDPI, vol. 15(23), pages 1-28, November.
    3. Ahmed Khairadeen Ali & One Jae Lee & Doyeop Lee & Chansik Park, 2021. "Remote Indoor Construction Progress Monitoring Using Extended Reality," Sustainability, MDPI, vol. 13(4), pages 1-23, February.
    4. Bon-Gang Hwang & Ming Shan, 2018. "Management Strategies and Innovations: Important Roles to Sustainable Construction," Sustainability, MDPI, vol. 10(3), pages 1-3, February.
    5. Marta Gómez-Galán & José Pérez-Alonso & Ángel-Jesús Callejón-Ferre & Julián Sánchez-Hermosilla-López, 2018. "Assessment of Postural Load during Melon Cultivation in Mediterranean Greenhouses," Sustainability, MDPI, vol. 10(8), pages 1-33, August.
    6. Jieun Baek & Yosoon Choi, 2020. "Smart Glasses-Based Personnel Proximity Warning System for Improving Pedestrian Safety in Construction and Mining Sites," IJERPH, MDPI, vol. 17(4), pages 1-15, February.
    7. Danilo Monarca & Pierluigi Rossi & Riccardo Alemanno & Filippo Cossio & Paolo Nepa & Andrea Motroni & Roberto Gabbrielli & Marco Pirozzi & Carla Console & Massimo Cecchini, 2022. "Autonomous Vehicles Management in Agriculture with Bluetooth Low Energy (BLE) and Passive Radio Frequency Identification (RFID) for Obstacle Avoidance," Sustainability, MDPI, vol. 14(15), pages 1-13, August.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jsusta:v:16:y:2024:i:12:p:5058-:d:1414591. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.