Author
Listed:
- Hany Said
(College of Artificial Intelligence, Arab Academy for Science, Technology, and Maritime Transport, El Alamein 51718, Egypt
Research and Innovation Center, Arab Academy for Science, Technology, and Maritime Transport, El Alamein 51718, Egypt
These authors contributed equally to this work.)
- Khaled Mahar
(Arab Center for Artificial Intelligence, Arab Academy for Science, Technology, and Maritime Transport, Alexandria 21532, Egypt
College of Computing and Information Technology, Arab Academy for Science, Technology, and Maritime Transport, Alexandria 21532, Egypt)
- Shaymaa E. Sorour
(Department of Management Information Systems, School of Business, King Faisal University, Alhufof 31982, Saudi Arabia
Faculty of Specific Education, Kafrelsheikh University, Kafrelsheikh 33511, Egypt)
- Ahmed Elsheshai
(College of Medicine, Arab Academy for Science, Technology, and Maritime Transport, El Alamein 51718, Egypt)
- Ramy Shaaban
(Department of Instructional Technology and Learning Sciences, Utah State University, Salt Lake City, UT 84322, USA)
- Mohamed Hesham
(College of Medicine, Arab Academy for Science, Technology, and Maritime Transport, El Alamein 51718, Egypt)
- Mustafa Khadr
(Research and Innovation Center, Arab Academy for Science, Technology, and Maritime Transport, El Alamein 51718, Egypt)
- Youssef A. Mehanna
(Research and Innovation Center, Arab Academy for Science, Technology, and Maritime Transport, El Alamein 51718, Egypt)
- Ammar Basha
(Research and Innovation Center, Arab Academy for Science, Technology, and Maritime Transport, El Alamein 51718, Egypt)
- Fahima A. Maghraby
(Research and Innovation Center, Arab Academy for Science, Technology, and Maritime Transport, El Alamein 51718, Egypt
College of Computing and Information Technology, Arab Academy for Science, Technology, and Maritime Transport, Cairo 2033, Egypt
These authors contributed equally to this work.)
Abstract
Autism is a challenging brain disorder affecting children at global and national scales. Applied behavior analysis is commonly conducted as an efficient medical therapy for children. This paper focused on one paradigm of applied behavior analysis, imitation, where children mimic certain lessons to enhance children’s social behavior and play skills. This paper introduces IMITASD, a practical monitoring assessment model designed to evaluate autistic children’s behaviors efficiently. The proposed model provides an efficient solution for clinics and homes equipped with mid-specification computers attached to webcams. IMITASD automates the scoring of autistic children’s videos while they imitate a series of lessons. The model integrates two core modules: attention estimation and imitation assessment. The attention module monitors the child’s position by tracking the child’s face and determining the head pose. The imitation module extracts a set of crucial key points from both the child’s head and arms to measure the similarity with a reference imitation lesson using dynamic time warping. The model was validated using a refined dataset of 268 videos collected from 11 Egyptian autistic children during conducting six imitation lessons. The analysis demonstrated that IMITASD provides fast scoring, takes less than three seconds, and shows a robust measure as it has a high correlation with scores given by medical therapists, about 0.9, highlighting its effectiveness for children’s training applications.
Suggested Citation
Hany Said & Khaled Mahar & Shaymaa E. Sorour & Ahmed Elsheshai & Ramy Shaaban & Mohamed Hesham & Mustafa Khadr & Youssef A. Mehanna & Ammar Basha & Fahima A. Maghraby, 2024.
"IMITASD: Imitation Assessment Model for Children with Autism Based on Human Pose Estimation,"
Mathematics, MDPI, vol. 12(21), pages 1-25, November.
Handle:
RePEc:gam:jmathe:v:12:y:2024:i:21:p:3438-:d:1513135
Download full text from publisher
Corrections
All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jmathe:v:12:y:2024:i:21:p:3438-:d:1513135. See general information about how to correct material in RePEc.
If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.
We have no bibliographic references for this item. You can help adding them by using this form .
If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .
Please note that corrections may take a couple of weeks to filter through
the various RePEc services.