IDEAS home Printed from https://ideas.repec.org/a/gam/jmathe/v9y2021i22p2908-d679713.html
   My bibliography  Save this article

Truck Driver Fatigue Detection Based on Video Sequences in Open-Pit Mines

Author

Listed:
  • Yi Wang

    (School of Resources and Safety Engineering, Central South University, Changsha 410083, China)

  • Zhengxiang He

    (School of Resources and Safety Engineering, Central South University, Changsha 410083, China)

  • Liguan Wang

    (School of Resources and Safety Engineering, Central South University, Changsha 410083, China)

Abstract

Due to complex background interference and weak space–time connection, traditional driver fatigue detection methods perform poorly for open-pit truck drivers. For these issues, this paper presents a driver fatigue detection method based on Libfacedetection and an LRCN. The method consists of three stages: (1) using a face detection module with a tracking method to quickly extract the ROI of the face; (2) extracting and coding the features; (3) combining the coding model to build a spatiotemporal classification network. The innovation of the method is to utilize the spatiotemporal features of the image sequence to build a spatiotemporal classification model suitable for this task. Meanwhile, a tracking method is added to the face detection stage to reduce time expenditure. As a result, the average speed with the tracking method for face detection on video is increased by 74% in comparison with the one without the tracking method. Our best model adopts a DHLSTM and feature-level frame aggregation, which achieves high accuracy of 99.30% on the self-built dataset.

Suggested Citation

  • Yi Wang & Zhengxiang He & Liguan Wang, 2021. "Truck Driver Fatigue Detection Based on Video Sequences in Open-Pit Mines," Mathematics, MDPI, vol. 9(22), pages 1-14, November.
    • Handle: RePEc:gam:jmathe:v:9:y:2021:i:22:p:2908-:d:679713
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/2227-7390/9/22/2908/pdf
    Download Restriction: no
    File URL: https://www.mdpi.com/2227-7390/9/22/2908/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Han, Li & Jing, Huitian & Zhang, Rongchang & Gao, Zhiyu, 2019. "Wind power forecast based on improved Long Short Term Memory network," Energy, Elsevier, vol. 189(C).
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Hasan Alkahtani & Zeyad A. T. Ahmed & Theyazn H. H. Aldhyani & Mukti E. Jadhav & Ahmed Abdullah Alqarni, 2023. "Deep Learning Algorithms for Behavioral Analysis in Diagnosing Neurodevelopmental Disorders," Mathematics, MDPI, vol. 11(19), pages 1-18, October.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Wang, Delu & Gan, Jun & Mao, Jinqi & Chen, Fan & Yu, Lan, 2023. "Forecasting power demand in China with a CNN-LSTM model including multimodal information," Energy, Elsevier, vol. 263(PE).
    2. Zhang, Jiao & Li, Youping & Liu, Chunqiong & Wu, Bo & Shi, Kai, 2022. "A study of cross-correlations between PM2.5 and O3 based on Copula and Multifractal methods," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 589(C).
    3. Wang, Yun & Zou, Runmin & Liu, Fang & Zhang, Lingjun & Liu, Qianyi, 2021. "A review of wind speed and wind power forecasting with deep neural networks," Applied Energy, Elsevier, vol. 304(C).
    4. Abdulelah Alkesaiberi & Fouzi Harrou & Ying Sun, 2022. "Efficient Wind Power Prediction Using Machine Learning Methods: A Comparative Study," Energies, MDPI, vol. 15(7), pages 1-24, March.
    5. Hu, Huanling & Wang, Lin & Lv, Sheng-Xiang, 2020. "Forecasting energy consumption and wind power generation using deep echo state network," Renewable Energy, Elsevier, vol. 154(C), pages 598-613.
    6. Guoqing An & Ziyao Jiang & Libo Chen & Xin Cao & Zheng Li & Yuyang Zhao & Hexu Sun, 2021. "Ultra Short-Term Wind Power Forecasting Based on Sparrow Search Algorithm Optimization Deep Extreme Learning Machine," Sustainability, MDPI, vol. 13(18), pages 1-18, September.
    7. Jianwei Gao & Yu Yang & Fangjie Gao & Pengcheng Liang, 2021. "Optimization of Electric Vehicles Based on Frank-Copula- GlueCVaR Combined Wind and Photovoltaic Output Scheduling Research," Energies, MDPI, vol. 14(19), pages 1-15, September.
    8. Medine Colak & Mehmet Yesilbudak & Ramazan Bayindir, 2020. "Daily Photovoltaic Power Prediction Enhanced by Hybrid GWO-MLP, ALO-MLP and WOA-MLP Models Using Meteorological Information," Energies, MDPI, vol. 13(4), pages 1-19, February.
    9. Korkmaz, Deniz, 2021. "SolarNet: A hybrid reliable model based on convolutional neural network and variational mode decomposition for hourly photovoltaic power forecasting," Applied Energy, Elsevier, vol. 300(C).
    10. Liu, Yangyang & Shen, Zhongqi & Tang, Xiaowei & Lian, Hongbo & Li, Jiarui & Gong, Jinxia, 2019. "Worst-case conditional value-at-risk based bidding strategy for wind-hydro hybrid systems under probability distribution uncertainties," Applied Energy, Elsevier, vol. 256(C).
    11. Zhang, Fei & Li, Peng-Cheng & Gao, Lu & Liu, Yong-Qian & Ren, Xiao-Ying, 2021. "Application of autoregressive dynamic adaptive (ARDA) model in real-time wind power forecasting," Renewable Energy, Elsevier, vol. 169(C), pages 129-143.
    12. Simian Pang & Zixuan Zheng & Fan Luo & Xianyong Xiao & Lanlan Xu, 2021. "Hybrid Forecasting Methodology for Wind Power-Photovoltaic-Concentrating Solar Power Generation Clustered Renewable Energy Systems," Sustainability, MDPI, vol. 13(12), pages 1-16, June.
    13. Seung Chan Jo & Young Gyu Jin & Yong Tae Yoon & Ho Chan Kim, 2021. "Methods for Integrating Extraterrestrial Radiation into Neural Network Models for Day-Ahead PV Generation Forecasting," Energies, MDPI, vol. 14(9), pages 1-18, May.
    14. Saeed, Adnan & Li, Chaoshun & Gan, Zhenhao & Xie, Yuying & Liu, Fangjie, 2022. "A simple approach for short-term wind speed interval prediction based on independently recurrent neural networks and error probability distribution," Energy, Elsevier, vol. 238(PC).
    15. Xu Ran & Chang Xu & Lei Ma & Feifei Xue, 2022. "Wind Power Interval Prediction with Adaptive Rolling Error Correction Based on PSR-BLS-QR," Energies, MDPI, vol. 15(11), pages 1-22, June.
    16. Wang, Yun & Xu, Houhua & Zou, Runmin & Zhang, Lingjun & Zhang, Fan, 2022. "A deep asymmetric Laplace neural network for deterministic and probabilistic wind power forecasting," Renewable Energy, Elsevier, vol. 196(C), pages 497-517.
    17. Gong, Yu & Liu, Pan & Ming, Bo & Li, Dingfang, 2021. "Identifying the effect of forecast uncertainties on hybrid power system operation: A case study of Longyangxia hydro–photovoltaic plant in China," Renewable Energy, Elsevier, vol. 178(C), pages 1303-1321.
    18. Sandra Minerva Valdivia-Bautista & José Antonio Domínguez-Navarro & Marco Pérez-Cisneros & Carlos Jesahel Vega-Gómez & Beatriz Castillo-Téllez, 2023. "Artificial Intelligence in Wind Speed Forecasting: A Review," Energies, MDPI, vol. 16(5), pages 1-28, March.
    19. Xu, Fang Yuan & Tang, Rui Xin & Xu, Si Bin & Fan, Yi Liang & Zhou, Ya & Zhang, Hao Tian, 2021. "Neural network-based photovoltaic generation capacity prediction system with benefit-oriented modification," Energy, Elsevier, vol. 223(C).
    20. Pirhooshyaran, Mohammad & Scheinberg, Katya & Snyder, Lawrence V., 2020. "Feature engineering and forecasting via derivative-free optimization and ensemble of sequence-to-sequence networks with applications in renewable energy," Energy, Elsevier, vol. 196(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jmathe:v:9:y:2021:i:22:p:2908-:d:679713. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.