MultiEpilepsyNet: An EEG and MRI Data based Multimodal Seizure Detection Model using Hybrid Deep learning Model

Epilepsy is a critical neurological disorder that requires accurate and privacy-preserving diagnostic solutions to enable early detection and effective management. However, existing approaches face key challenges, including reliance on centralized data, poor generalizability across modalities, suboptimal feature extraction, and vulnerability to noise. To address these issues, we propose MultiEpilepsyNet, a novel multimodal seizure detection framework that integrates federated learning with hybrid deep learning models. At its core, the system introduces SeizureFed-Net, a federated architecture that enables collaborative learning from EEG and MRI data while safeguarding patient privacy. For detection, we design SeizureShieldNet, a hybrid model that fuses the temporal learning capabilities of BBIDNet (Boosted BiLSTM Intrusion Detector Network) with the adaptive decision-making of FD-TMS (Fuzzy-DQN Threat Mitigation System) under uncertainty. To further enhance model efficiency, a Jackal-Wolf Hybrid Optimizer (JWHO)-a novel combination of Golden Jackal Optimization and Grey Wolf Optimizer-is employed for optimal feature subset selection. On the imaging side, MRI preprocessing is improved through EpiSkullNet++, a modified 3D UNet++ architecture tailored for precise brain segmentation.Extensive experiments on two benchmark datasets demonstrate the superiority of our approach, achieving 99.36% accuracy on the CHB-MIT EEG dataset and 99.38% accuracy on an epilepsy MRI dataset. Beyond accuracy, MultiEpilepsyNet demonstrates improved robustness to missing modalities, reduced training overhead via federated aggregation, and enhanced privacy preservation compared to centralized deep learning models, thereby addressing critical barriers in practical clinical deployment. These outcomes highlight the effectiveness, scalability, and real-world clinical potential of the proposed framework for epilepsy diagnosis and management.