判决
生成语法
能力(人力资源)
变压器
计算机科学
医学教育
自然语言处理
人工智能
医学
心理学
工程类
社会心理学
电气工程
电压
作者
Soshi Takagi,Takashi Watari,Ayano Erabi,Kota Sakaguchi
摘要
The competence of ChatGPT (Chat Generative Pre-Trained Transformer) in non-English languages is not well studied.This study compared the performances of GPT-3.5 (Generative Pre-trained Transformer) and GPT-4 on the Japanese Medical Licensing Examination (JMLE) to evaluate the reliability of these models for clinical reasoning and medical knowledge in non-English languages.This study used the default mode of ChatGPT, which is based on GPT-3.5; the GPT-4 model of ChatGPT Plus; and the 117th JMLE in 2023. A total of 254 questions were included in the final analysis, which were categorized into 3 types, namely general, clinical, and clinical sentence questions.The results indicated that GPT-4 outperformed GPT-3.5 in terms of accuracy, particularly for general, clinical, and clinical sentence questions. GPT-4 also performed better on difficult questions and specific disease questions. Furthermore, GPT-4 achieved the passing criteria for the JMLE, indicating its reliability for clinical reasoning and medical knowledge in non-English languages.GPT-4 could become a valuable tool for medical education and clinical support in non-English-speaking regions, such as Japan.
科研通智能强力驱动
Strongly Powered by AbleSci AI