Neural Network-Based Method for Early Diagnosis of Autism Spectral Disorder Head-Banging Behavior from Recorded Videos

Autism spectrum disorder (ASD) is a mental developmental disorder associated with social and communicational defects and Stereotypical Motor Movements (SMM). SMM is a set of repetitive motor activities associated with several mental developmental disorders like Autism. SMM has several forms like arm flapping, head banging, ear covering, and spinning with various degrees of severity that might lead to self-injury in severe cases. Developing a computer-vision-based technology to detect noticeable SMM behaviors can help in the early diagnosis of autism. In this paper, a computer vision-based neural network model was proposed to detect and recognize repetitive motor behaviors. The proposed model went through three main stages: First, data preparation. Second, human body features extraction using deep learning pose estimation and the skeleton representation model, and finally, multiclass classification to distinguish between several classes of headbanging. The proposed solution was evaluated using the Self Stimulatory Behavior Dataset (SSBD) which is a public dataset of three classes of repetitive motor behaviors associated with autism. We also collected a set of 40 videos of autistic children exhibiting headbanging from public domains like YouTube. In addition to that, we captured 25 videos of typically developing subjects mimicking headbanging. The collected and the videoed videos were used to evaluate the proposed model. This work proves the applicability of diagnosing mental developmental syndrome symptoms using vision-based techniques in cooperation with neural networks. The produced results prove that the used techniques can operate well in real-world challenging applications. The proposed model achieved 85.5% accuracy on SSBD and 93% on the collected and recorded videos.