Performance of ChatGPT and DeepSeek in the Management of Postprostatectomy Uri-nary Incontinence.

医学 普通外科
作者
Vicktor Bruno Pereira Pinto,Romullo José Costa Ataídes,Leonel Alves do Nascimento,Carina Gaspar,Pedro Alves,Magnum Adriel Santos Pereira,M. Macedo,Willian Carlos Nahas,José de Bessa,Cristiano Mendes Gomes
出处
期刊:PubMed [National Institutes of Health]
卷期号:51 (6)
标识
DOI:10.1590/s1677-5538.ibju.2025.0325
摘要

Artificial intelligence (AI) continues to evolve as a tool in clinical decision support. Large language models (LLMs), such as ChatGPT and DeepSeek, are increasingly used in medicine to provide fast, accessible information. This study aimed to compare the performance of ChatGPT and DeepSeek in generating recommendations for the management of postprostatectomy urinary incontinence (PPUI), based on the AUA/SUFU guideline. A total of 20 questions (10 conceptual and 10 case-based) were developed by three urologists with expertise in PPUI, following the AUA/SUFU guideline. Each question was submitted in English using zero-shot prompting to ChatGPT-4o and DeepSeek R1. Responses were limited to 200 words and graded independently as correct (1 point), partially correct (0.5), or incorrect (0). Total and domain-specific scores were compared. ChatGPT achieved 19 out of 20 points (95.0%), while DeepSeek scored 14.5 (72.5%; p = 0.031). In conceptual questions, scores were 9.0 (ChatGPT) and 8.0 (DeepSeek; p = 0.50). In case-based scenarios, ChatGPT scored 10.0 versus 6.5 for DeepSeek (p = 0.08). ChatGPT outperformed DeepSeek across all guideline domains. DeepSeek made critical errors in the treatment domain, such as recommending a male sling for radiated patients. ChatGPT demonstrated superior performance in providing guideline-based recommendations for PPUI. However, both models should be used under expert supervision, and future research is needed to optimize their safe integration into clinical workflows.
最长约 10秒,即可获得该文献文件

科研通智能强力驱动
Strongly Powered by AbleSci AI
科研通是完全免费的文献互助平台,具备全网最快的应助速度,最高的求助完成率。 对每一个文献求助,科研通都将尽心尽力,给求助人一个满意的交代。
实时播报
ZMTW发布了新的文献求助30
3秒前
LJT发布了新的文献求助10
3秒前
5秒前
soapffz完成签到,获得积分0
8秒前
颜雨蘅发布了新的文献求助10
8秒前
111发布了新的文献求助10
12秒前
李爱国的应助被矮小的断秋采纳,获得10
15秒前
终生科研徒刑完成签到 ,获得积分10
16秒前
伤心词香菇酱完成签到,获得积分10
18秒前
19秒前
Ava的应助被LJT采纳,获得10
19秒前
20秒前
打打的应助被111采纳,获得10
21秒前
lx完成签到,获得积分10
21秒前
21秒前
22秒前
22秒前
24秒前
与闲完成签到,获得积分10
25秒前
Hello的应助被孙子钊采纳,获得10
27秒前
SYX发布了新的文献求助10
27秒前
29秒前
yuyuyu完成签到 ,获得积分10
30秒前
聪明的含桃完成签到,获得积分10
31秒前
33秒前
33秒前
Metrix发布了新的文献求助10
35秒前
333完成签到 ,获得积分10
36秒前
欢喜若灵发布了新的文献求助10
36秒前
111完成签到 ,获得积分10
36秒前
Morii完成签到,获得积分10
36秒前
孙子钊发布了新的文献求助10
38秒前
Lucas的应助被SYX采纳,获得10
44秒前
老的火龙果的应助被虚幻青曼采纳,获得10
45秒前
俊逸绮玉完成签到,获得积分20
47秒前
杨小坤完成签到 ,获得积分10
50秒前
51秒前
53秒前
满意外套完成签到,获得积分0
56秒前
59秒前
高分求助中
(应助此贴封号)【重要!!请各用户(尤其是新用户)详细阅读】【科研通的精品贴汇总】 10000
Rosenblum, Global Change Biology 800
自動車の空力技術 800
Organizational Behavior 510
Management and the Arts 510
Issues in Task-Based Language Teaching 500
Wafer Surface Defect 420
热门求助领域 (近24小时)
化学 材料科学 医学 生物 纳米技术 计算机科学 化学工程 工程类 有机化学 物理 复合材料 生物化学 内科学 细胞生物学 基因 遗传学 免疫学 冶金 光电子学 癌症研究
热门帖子
关注 科研通微信公众号,转发送积分 7784319
求助须知:如何正确求助?哪些是违规求助? 9323644
关于积分的说明 20394846
捐赠科研通 7373064
什么是DOI,文献DOI怎么找? 3320990
关于科研通互助平台的介绍 2468974
邀请新用户注册赠送积分活动 2337253