IDEAS home Printed from https://ideas.repec.org/a/gam/jijerp/v19y2022i4p2352-d752545.html
   My bibliography  Save this article

Deep Neural Network Approach for Pose, Illumination, and Occlusion Invariant Driver Emotion Detection

Author

Listed:
  • Susrutha Babu Sukhavasi

    (Department of Computer Science and Engineering, University of Bridgeport, Bridgeport, CT 06604, USA)

  • Suparshya Babu Sukhavasi

    (Department of Computer Science and Engineering, University of Bridgeport, Bridgeport, CT 06604, USA)

  • Khaled Elleithy

    (Department of Computer Science and Engineering, University of Bridgeport, Bridgeport, CT 06604, USA)

  • Ahmed El-Sayed

    (Department of Computer Science and Engineering, University of Bridgeport, Bridgeport, CT 06604, USA)

  • Abdelrahman Elleithy

    (Department of Computer Science, William Paterson University, Wayne, NJ 07470, USA)

Abstract

Monitoring drivers’ emotions is the key aspect of designing advanced driver assistance systems (ADAS) in intelligent vehicles. To ensure safety and track the possibility of vehicles’ road accidents, emotional monitoring will play a key role in justifying the mental status of the driver while driving the vehicle. However, the pose variations, illumination conditions, and occlusions are the factors that affect the detection of driver emotions from proper monitoring. To overcome these challenges, two novel approaches using machine learning methods and deep neural networks are proposed to monitor various drivers’ expressions in different pose variations, illuminations, and occlusions. We obtained the remarkable accuracy of 93.41%, 83.68%, 98.47%, and 98.18% for CK+, FER 2013, KDEF, and KMU-FED datasets, respectively, for the first approach and improved accuracy of 96.15%, 84.58%, 99.18%, and 99.09% for CK+, FER 2013, KDEF, and KMU-FED datasets respectively in the second approach, compared to the existing state-of-the-art methods.

Suggested Citation

  • Susrutha Babu Sukhavasi & Suparshya Babu Sukhavasi & Khaled Elleithy & Ahmed El-Sayed & Abdelrahman Elleithy, 2022. "Deep Neural Network Approach for Pose, Illumination, and Occlusion Invariant Driver Emotion Detection," IJERPH, MDPI, vol. 19(4), pages 1-23, February.
    • Handle: RePEc:gam:jijerp:v:19:y:2022:i:4:p:2352-:d:752545
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/1660-4601/19/4/2352/pdf
    Download Restriction: no
    File URL: https://www.mdpi.com/1660-4601/19/4/2352/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Neska Haouij & Jean-Michel Poggi & Raja Ghozi & Sylvie Sevestre-Ghalila & Mériem Jaïdane, 2019. "Random forest-based approach for physiological functional variable selection for driver’s stress level classification," Statistical Methods & Applications, Springer;Società Italiana di Statistica, vol. 28(1), pages 157-185, March.
    2. Sayan Putatunda, 2019. "Machine Learning: An Introduction," Springer Proceedings in Business and Economics, in: Arnab Kumar Laha (ed.), Advances in Analytics and Applications, pages 3-11, Springer.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Fabrizio Maturo & Rosanna Verde, 2023. "Supervised classification of curves via a combined use of functional data analysis and tree-based methods," Computational Statistics, Springer, vol. 38(1), pages 419-459, March.
    2. Antonis Kostopoulos & Thodoris Garefalakis & Eva Michelaraki & Christos Katrakazas & George Yannis, 2024. "Modeling and Sustainability Implications of Harsh Driving Events: A Predictive Machine Learning Approach," Sustainability, MDPI, vol. 16(14), pages 1-20, July.
    3. Huiqin Chen & Hao Liu & Hailong Chen & Jing Huang, 2023. "Towards Sustainable Safe Driving: A Multimodal Fusion Method for Risk Level Recognition in Distracted Driving Status," Sustainability, MDPI, vol. 15(12), pages 1-22, June.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jijerp:v:19:y:2022:i:4:p:2352-:d:752545. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.