The future of EEG education in the era of artificial intelligence

Artificial intelligence (AI), the technology that enables computers to simulate human problem-solving capabilities, is rapidly evolving. In the field of epilepsy, AI's application has already demonstrated potential for improved quality, cost, and access to patient care.1 Although these advancements are exciting, they also pose several questions for the epilepsy community that are imperative to address now, before the imminent implementation of AI in clinical practice. As academics and educators, one question we are often asked is whether, or to what degree, electroencephalography (EEG) interpretation should be taught to the next generations of (human) neurologists. To address this in a meaningful way, we first examine our current predicament and then anticipate the road ahead. In doing so, we argue for a system that carefully integrates AI-based algorithms into the workflow of expert human EEG interpretation, which will ultimately necessitate a change in the way we educate our trainees and the next generation of electroencephalographers. EEG is the tool most often used in the diagnostic evaluation of individuals with suspected epilepsy and frequently employed during sleep studies, surgeries, and in neurocritical care settings; therefore, accurate and reliable EEG interpretation is essential for optimal care of a variety of patients. In real-world practice, EEG misinterpretation does occur—either through over-calling normal EEG patterns as abnormal, or under-calling abnormal findings as benign, both of which can negatively impact patient care and outcomes. EEG “over-calling” (i.e., false-positive errors) can lead to epilepsy misdiagnosis with resultant unnecessary driving restrictions, employment difficulties, overprescription of anti-seizure medications, unwarranted surgery, inappropriate prognostication, other forms of comorbid stigma and social marginalization, as well as notable negative effects to health care systems. Meanwhile, “under-calling” (i.e., false-negative errors) can result in missed opportunities to prevent seizure-related injury, negative cognitive sequelae, and, in some circumstances, death.2-8 Additional implications are well documented in patients without epilepsy but where EEG is still used.9 Unfortunately, there are significant gaps in the current landscape of EEG education. For both adult and pediatric neurology training programs, there is limited exposure to EEG, subpar quality teaching, a paucity of objective competencies, and significant inter-program variability.10, 11 As such, many neurology graduates leave training without feeling confident in their EEG-reading capabilities.12, 13 This presents a substantial problem in clinical practice, as a large portion of EEG studies across the world—including the United States and many European countries—are interpreted by general neurologists without additional EEG/epilepsy training.14, 15 With so much room for improvement, it is easy to see why AI-centered EEG interpretation holds promise. Several automated AI algorithms have shown high accuracy in identifying EEG patterns including interictal epileptiform discharges (IEDs), interictal slowing, seizures, and findings on the ictal-interictal continuum. Some of these algorithms have been validated in routine and critical care EEGs, achieving human expert level performance with improved efficiency and consistency.16-24 As such, it is more than plausible that the future will involve appreciable adoption of these technologies. However, we need to consider the larger implications of implementation and have the foresight to address them in a meaningful way through proper education. First, one must recognize that the high accuracy and efficiency of a tool does not always lead to equivalent levels of credibility. Human, or in this case, patient, perception is an important variable that changes an otherwise straightforward equation. The credibility of AI systems, regardless of their accuracy, remains generally quite low. In large global surveys on perceptions of this new technology, most people are wary about trusting AI and have a low or moderate acceptance of it.25 Due to the inherent legal liabilities and ethical considerations26 involved in misdiagnosis and mismanagement, which have not yet been fully elucidated, it is implausible that fully autonomous AI would be applied to the diagnostic or therapeutic process until the community at large takes time to thoughtfully address these issues (e.g., through the establishment of minimum standards). Furthermore, the many limitations of AI must be acknowledged. Even the highest quality AI models are primarily data-driven algorithms that are trained and validated on finite, historical datasets with expert input. These datasets, if not properly designed, can perpetuate discriminatory practices, give rise to “hallucinations” (false predictions),27 and create suboptimal behavioral change, all of which could impact patient care. As there is not yet a complete, automated EEG interpretation system available, we must carefully consider the datasets on which these AI algorithms were trained and validated to ensure that they are applied in the appropriate context. For example, SPaRCNET16 was developed to read critical care EEG, whereas SCORE-AI18, 19 was developed to read outpatient/routine EEG; hence, a one size fits all approach to interpretation would be imprudent without more rigorous investigation. We also must acknowledge that many seizure types have markedly different electrographic signals (e.g., neonatal seizures, epileptic spasms, atonic seizures, myoclonic seizures, and so on) for which AI algorithms have not been developed and will require trained human readers to recognize these patterns along with corresponding video of the events, if available, at least until more sophisticated models are developed. As such, the most plausible scenario, and the gold standard we should aim for, is a complementary “hybrid” model20—one in which augmentation with AI could allow experts to make higher quality decisions more efficiently than those not using the technology, while maintaining oversight and human credibility that will best serve our patients, particularly in cases where the algorithms fall short. Over the past few years, examples of some hybrid approaches have been demonstrated that have the potential to improve interpretation and promote better, more-efficient reading skills. In a comparison between three fully automated AI algorithms and a human-supervised AI model applying an operational definition to detect IEDs, the specificity of the fully automated approaches was too low for clinical implementation, despite the high sensitivity. Meanwhile the human-supervised approach significantly increased the specificity, maintained good sensitivity and accuracy, and decreased the time burden of review compared to conventional visual analysis. In another study, a more “interpretable” deep learning model that accurately classifies six patterns of potentially harmful EEG activity was applied to EEG recordings in the intensive care unit (ICU) setting and led to significant pattern classification accuracy improvement by human readers using this assisted technology.28 It is important to note that this performance was also significantly better than that of a corresponding uninterpretable “black-box” model, demonstrating further promise for AI–human collaboration but also highlighting the importance of design and context for the end user. Additional applications that have not yet been described or validated should also make interpretation more efficient and education more focused. For example, applying appropriate AI algorithms with high sensitivities will allow trainees to focus less on the more time-consuming aspects of interpretation, such as scrolling through long, multiday continuous EEG files, and instead focus on interpreting snippets flagged as “concerning” by AI. Similarly, rapid-response EEG systems with high negative predictive value could be used to triage which EEG recordings require more detailed review overnight and which could wait until morning, freeing up considerable clinical burden on trainees. Better automated detection algorithms could be applied in ICU settings to reduce “alarm fatigue,” a longstanding issue that has been well documented to affect clinician concentration and diagnostic accuracy, leading to burnout and reduced quality of life.29-32 In resource-limited settings, where there are either no epileptologists, or general neurologists without proper exposure to EEG reading during training, AI implementation could help mitigate these deficits. Although these algorithms can run locally on a tablet without internet connection, we also acknowledge that many low- and middle-income areas lack the important high-tech infrastructure for easy adoption,33 such as the resources for machinery, personnel, quality control, and cloud storage, all of which can contribute to an increased carbon footprint and may limit feasibility of use.26 Finally, in challenging or equivocal EEG cases, AI interpretation could offer a “second opinion” for readers, with certain models validated to perform closer to the consensus of a group of experts than the average of the individual expert.18 In an ideal world, we will not just be teaching trainees how to integrate AI-based EEG interpretation into practice, but we will be using AI to help us learn as well. In a study where a machine learning model was applied to EEG studies of critically ill patients of various etiologies, the convolutional neural network was able to identify novel EEG signatures to predict future clinical outcomes.34 Visual analysis showed that the machine application learned EEG patterns typically recognized by human experts but also suggested new criteria that could serve as important electrographic biomarkers to improve care, demonstrating more potential novel applications for AI–human collaboration. This is all to say that, although there are still important challenges we must address prior to a larger rollout, we advocate for academic programs to implement a curriculum that includes the operation, implementation, and oversight of AI in clinical practice. To create a roadmap for EEG and epilepsy education in the time of AI, we must simultaneously acknowledge that our current educational system would benefit from higher quality teaching, more consistent exposure to EEG during training, and standardized competencies that prepare our neurologists to perform well,10, 11, 35 and also that better trained readers will help ensure the highest quality care in a future “hybrid” model of AI augmentation. We know from our colleagues in cardiology that inexperienced readers may not have the confidence to override the automated output of ECG studies36; therefore, to reduce false-positive and false-negative errors of AI interpreted EEG results, we will need to continue to produce well-trained, confident human readers. In the same vein, to ensure optimal AI output, we must acknowledge that the data fed into the algorithms will be pulled from human interpretation; therefore, a byproduct of high-quality EEG education should be an improved AI. We propose that—once these AI-based algorithms are commercially available for EEG interpretation—all trainees should have meaningful exposure to this emerging technology. There should be clear parameters for where and when this technology can be used, including discussions on the ethical, practical, and equity issues surrounding implementation and the establishment of minimal acceptable standards. We may not need to teach our trainees or patients how a given algorithm works from a technical perspective, but all clinicians using this technology should be able to explain the clinical implication of these results to the patient; therefore, any educational curriculum must include modules on both proper interpretation and communication. For oversight, particularly as we continue to refine these technologies and train newer models, we will need dedicated teaching on the limitations of the technology and how humans best operate in this environment. Finally, continuing education on both the capabilities and limitations of AI will be essential for all neurologists not in active training programs to effectively incorporate these tools into their practice, for we believe AI should not be a tool available just for the technologically savvy, but for everyone in the community willing to learn how to safely use it. If we can implement these changes, rather than resist the sea change ahead, the future of epilepsy will be brighter than ever. None. Dr. McLaren, Dr. Yuan, Dr. Beniczky, and Dr. Nascimento have no conflicts of interest. Dr. Westover has received support from grants from the National Institutes of Health (NIH; RF1AG064312, RF1NS120947, R01AG073410, R01HL161253, R01NS126282, R01AG073598, R01NS131347, and R01NS130119), and the National Science Foundation (NSF; 2014431). Dr. Westover is a co-founder and scientific advisor of, and consultant to Beacon Biosignals, and he has a personal equity interest in the company. He also receives royalties for authoring “Pocket Neurology” from Wolters Kluwer and “Atlas of Intensive Care Quantitative EEG” by Demos Medical. We confirm that we have read the Journal's position on issues involved in ethical publication and affirm that this report is consistent with those guidelines. Data sharing is not applicable to this article as no new data were created or analyzed in this study.