谵妄
接收机工作特性
医学
人工智能
机器学习
混乱
混淆矩阵
病历
观察研究
金标准(测试)
临床决策支持系统
健康档案
自然语言处理
内科学
重症监护医学
计算机科学
决策支持系统
心理学
医疗保健
精神分析
经济增长
经济
作者
Wendong Ge,Haitham S. Alabsi,Aayushee Jain,Elissa M Ye,Haoqi Sun,Marta P. Fernandes,Colin Magdamo,Ryan A. Tesh,Sarah Isabel Collens,Amy L. Newhouse,Lidia M.V.R. Moura,Sahar F. Zafar,John Hsu,Oluwaseun Akeju,Gregory K. Robbins,Shibani S. Mukerji,Sudeshna Das,Michael Brandon Westover
摘要
BACKGROUND: Delirium in hospitalized patients is a syndrome of acute brain dysfunction. Diagnostic (International Classification of Diseases [ICD]) codes are often used in studies using electronic health records (EHRs), but they are inaccurate. OBJECTIVE: We sought to develop a more accurate method using natural language processing (NLP) to detect delirium episodes on the basis of unstructured clinical notes. METHODS: We collected 1.5 million notes from >10,000 patients from among 9 hospitals. Seven experts iteratively labeled 200,471 sentences. Using these, we trained three NLP classifiers: Support Vector Machine, Recurrent Neural Networks, and Transformer. Testing was performed using an external data set. We also evaluated associations with delirium billing (ICD) codes, medications, orders for restraints and sitters, direct assessments (Confusion Assessment Method [CAM] scores), and in-hospital mortality. F1 scores, confusion matrices, and areas under the receiver operating characteristic curve (AUCs) were used to compare NLP models. We used the φ coefficient to measure associations with other delirium indicators. RESULTS: The transformer NLP performed best on the following parameters: micro F1=0.978, macro F1=0.918, positive AUC=0.984, and negative AUC=0.992. NLP detections exhibited higher correlations (φ) than ICD codes with deliriogenic medications (0.194 vs 0.073 for ICD codes), restraints and sitter orders (0.358 vs 0.177), mortality (0.216 vs 0.000), and CAM scores (0.256 vs -0.028). CONCLUSIONS: Clinical notes are an attractive alternative to ICD codes for EHR delirium studies but require automated methods. Our NLP model detects delirium with high accuracy, similar to manual chart review. Our NLP approach can provide more accurate determination of delirium for large-scale EHR-based studies regarding delirium, quality improvement, and clinical trails.
科研通智能强力驱动
Strongly Powered by AbleSci AI