可读性
医学
泌尿妇科
健康素养
聊天机器人
利克特量表
医学物理学
印为红字的
阅读(过程)
可用性
医学教育
医学诊断
读写能力
教育测量
状语
梅德林
健康信息学
模拟病人
医疗保健
作者
Leanne E. Brechtel,Colin Johnson,Sarah R. Rabice,Douglas Russo,Kimberly Ann Kenne,Christina Lewicky‐Gaupp,Joseph T. Kowalski
标识
DOI:10.1097/spv.0000000000001862
摘要
IMPORTANCE: Patient education materials are important components of shared decision making in urogynecologic surgery. Traditional materials are often difficult to update, lack personalization, and are not easily adaptable. Chatbots offer a new approach to generating comprehensive and accessible content, but their utility in a clinic setting remains unclear. OBJECTIVE: The objective of this study was to compare the performance of a general-purpose chatbot, ChatGPT, and a domain-specific chatbot developed by the Foundation for Female Health Awareness (FFHA) (FFHA Assistant) in generating surgical counseling information, using standardized materials from the International Urogynecological Association (IUGA) as reference. STUDY DESIGN: Seven IUGA handouts representing common urogynecologic surgical procedures were selected. Identical prompts were submitted to ChatGPT-4.0 and the FFHA Assistant. Responses were reviewed by 7 blinded urogynecology experts using 5-point Likert scales to assess accuracy, completeness, and understandability. Readability was evaluated using the Flesch-Kincaid Grade Level and Flesch Reading Ease Score. RESULTS: ChatGPT-4.0 outperformed in completeness as compared with the IUGA leaflets (median 4 [3-5] vs 3 [3-4], P<0.01), whereas the FFHA Assistant scored higher in accuracy (median 3 [3-3] vs 3 [2-3], P<0.01) and understandability (3 [3-4] vs 3 [3-3], P<0.01). Both large language models generated longer responses than the IUGA leaflets. The FFHA Assistant responses had better readability scores, aligning more closely with health literacy recommendations. CONCLUSIONS: Both chatbots generated counseling content comparable to or superior to existing materials. The domain-specific FFHA Assistant responses were better aligned with health literacy recommendations. Further research is needed to better understand the reproducibility of responses and the clinical utility of chatbots in patient education.
科研通智能强力驱动
Strongly Powered by AbleSci AI