深度学习
人工智能
医学
肺炎
计算机科学
放射科
计算机视觉
模式识别(心理学)
融合
图像融合
呼吸音
语音识别
作者
Varun Reddy,Nirmal Keshari Swain,Sunil Suthar,D. Sai Nath,Yugandhar Manchala
出处
期刊:
[Institute of Electrical and Electronics Engineers]
日期:2026-03-14
卷期号:: 1-6
标识
DOI:10.1109/i3ctcon68242.2026.11507757
摘要
Pneumonia is a respiratory infection that can lead to severe health complications if not detected early. Timely and accurate diagnosis is critical, particularly in low-resource or remote healthcare settings. This research presents a multimodal deep learning framework for pneumonia detection by integrating chest X-ray images and cough audio signals. The system employs transfer learning using ResNet50 for X-ray feature extraction, while cough audio signals are transformed and processed to extract acoustic features. An early fusion strategy combines both visual and acoustic feature representations before classification through a dense neural network. The dataset includes labeled chest X-rays from the Kaggle Pediatric CXR dataset and cough audio samples from publicly available sources. The model is trained with the Adam optimizer and binary crossentropy loss, using ReLU activations in intermediate layers and a sigmoid function for the final output. Experimental results demonstrate that fusing X-ray and audio modalities improves diagnostic accuracy, robustness, and generalization compared to singlemodality approaches, supporting scalable deployment in telemedicine environments.
科研通智能强力驱动
Strongly Powered by AbleSci AI