Performance of ChatGPT and DeepSeek in the Management of Postprostatectomy Uri-nary Incontinence.

医学 普通外科
作者
Vicktor Bruno Pereira Pinto,Romullo José Costa Ataídes,Leonel Alves do Nascimento,Carina Gaspar,Pedro Alves,Magnum Adriel Santos Pereira,M. Macedo,Willian Carlos Nahas,José de Bessa,Cristiano Mendes Gomes
出处
期刊:PubMed [National Institutes of Health]
卷期号:51 (6)
标识
DOI:10.1590/s1677-5538.ibju.2025.0325
摘要

Artificial intelligence (AI) continues to evolve as a tool in clinical decision support. Large language models (LLMs), such as ChatGPT and DeepSeek, are increasingly used in medicine to provide fast, accessible information. This study aimed to compare the performance of ChatGPT and DeepSeek in generating recommendations for the management of postprostatectomy urinary incontinence (PPUI), based on the AUA/SUFU guideline. A total of 20 questions (10 conceptual and 10 case-based) were developed by three urologists with expertise in PPUI, following the AUA/SUFU guideline. Each question was submitted in English using zero-shot prompting to ChatGPT-4o and DeepSeek R1. Responses were limited to 200 words and graded independently as correct (1 point), partially correct (0.5), or incorrect (0). Total and domain-specific scores were compared. ChatGPT achieved 19 out of 20 points (95.0%), while DeepSeek scored 14.5 (72.5%; p = 0.031). In conceptual questions, scores were 9.0 (ChatGPT) and 8.0 (DeepSeek; p = 0.50). In case-based scenarios, ChatGPT scored 10.0 versus 6.5 for DeepSeek (p = 0.08). ChatGPT outperformed DeepSeek across all guideline domains. DeepSeek made critical errors in the treatment domain, such as recommending a male sling for radiated patients. ChatGPT demonstrated superior performance in providing guideline-based recommendations for PPUI. However, both models should be used under expert supervision, and future research is needed to optimize their safe integration into clinical workflows.
最长约 10秒,即可获得该文献文件

科研通智能强力驱动
Strongly Powered by AbleSci AI
科研通是完全免费的文献互助平台,具备全网最快的应助速度,最高的求助完成率。 对每一个文献求助,科研通都将尽心尽力,给求助人一个满意的交代。
实时播报
小黑发布了新的文献求助10
刚刚
徐双凯发布了新的文献求助10
刚刚
ank0完成签到,获得积分10
1秒前
小懒猪发布了新的文献求助10
2秒前
wanci应助坦率灵槐采纳,获得10
2秒前
3秒前
3秒前
4秒前
5秒前
Jay发布了新的文献求助10
5秒前
5秒前
FashionBoy应助ken采纳,获得10
6秒前
6秒前
Shandongdaxiu发布了新的文献求助10
6秒前
wdf关闭了wdf文献求助
6秒前
7秒前
愤怒野猪发布了新的文献求助10
7秒前
汉堡包应助cc采纳,获得10
8秒前
8秒前
9秒前
9秒前
apathy发布了新的文献求助10
10秒前
顾矜应助Mois采纳,获得10
10秒前
10秒前
linman发布了新的文献求助10
10秒前
10秒前
榆果子发布了新的文献求助10
10秒前
隐形曼青应助愤怒野猪采纳,获得10
11秒前
我不是奶黄包完成签到,获得积分10
11秒前
香蕉觅云应助天天向上上采纳,获得30
12秒前
12秒前
13秒前
有趣的桃完成签到,获得积分10
13秒前
14秒前
珝潏发布了新的文献求助10
14秒前
15秒前
共享精神应助杨乐多采纳,获得10
16秒前
赵一铭发布了新的文献求助10
16秒前
16秒前
16秒前
高分求助中
Principles of Economics, 11th Edition 10000
University Physics with Modern Physics, 16th edition 10000
(应助此贴封号)【重要!!请各用户(尤其是新用户)详细阅读】【科研通的精品贴汇总】 10000
Environmental Leverage in Times of Climate Crisis: Product Standards, Carbon Border Measures and Preferential Trade Agreements 1000
Matrix Methods in Data Mining and Pattern Recognition 510
Social Skills Improvement System-Rating Scales--Chinese Version 500
Dynamische Polarisation von H-1 und B-11 in (CH-3)-3NBH-3 500
热门求助领域 (近24小时)
化学 材料科学 医学 生物 纳米技术 工程类 有机化学 化学工程 生物化学 计算机科学 内科学 物理 复合材料 催化作用 细胞生物学 无机化学 光电子学 物理化学 电极 基因
热门帖子
关注 科研通微信公众号,转发送积分 7243731
求助须知:如何正确求助?哪些是违规求助? 8867931
关于积分的说明 18706344
捐赠科研通 6918292
什么是DOI,文献DOI怎么找? 3196713
关于科研通互助平台的介绍 2370441
邀请新用户注册赠送积分活动 2171347