Automatic video analysis and classification of sleep‐related hypermotor seizures and disorders of arousal

Objective Sleep-related hypermotor epilepsy (SHE) is a focal epilepsy with seizures occurring mostly during sleep. SHE seizures present different motor characteristics ranging from dystonic posturing to hyperkinetic motor patterns, sometimes associated with affective symptoms and complex behaviors. Disorders of arousal (DOA) are sleep disorders with paroxysmal episodes that may present analogies with SHE seizures. Accurate interpretation of the different SHE patterns and their differentiation from DOA manifestations can be difficult and expensive, and can require highly skilled personnel not always available. Furthermore, it is operator dependent. Methods Common techniques for human motion analysis, such as wearable sensors (e.g., accelerometers) and motion capture systems, have been considered to overcome these problems. Unfortunately, these systems are cumbersome and they require trained personnel for marker and sensor positioning, limiting their use in the epilepsy domain. To overcome these problems, recently significant effort has been spent in studying automatic methods based on video analysis for the characterization of human motion. Systems based on computer vision and deep learning have been exploited in many fields, but epilepsy has received limited attention. Results In this paper, we present a pipeline composed of a set of three-dimensional convolutional neural networks that, starting from video recordings, reached an overall accuracy of 80% in the classification of different SHE semiology patterns and DOA. Significance The preliminary results obtained in this study highlight that our deep learning pipeline could be used by physicians as a tool to support them in the differential diagnosis of the different patterns of SHE and DOA, and encourage further investigation.