计算机科学
语言模型
感觉
培训(气象学)
比例(比率)
人工智能
机器学习
心理学
认知心理学
应用心理学
自然语言处理
考试(生物学)
第二语言
训练集
人机交互
作者
Lujain Ibrahim,Franziska Sofia Hafner,Luc Rocher
出处
期刊:Nature
[Nature Portfolio]
日期:2026-04-29
卷期号:652 (8112): 1159-1165
标识
DOI:10.1038/s41586-026-10410-0
摘要
. Here we show how this can create a significant trade-off: optimizing language models for warmth can undermine their performance, especially when users express vulnerability. We conducted controlled experiments on five different language models, training them to produce warmer responses, then evaluating them on consequential tasks. Warm models showed substantially higher error rates (+10 to +30 percentage points) than their original counterparts, promoting conspiracy theories, providing inaccurate factual information and offering incorrect medical advice. They were also significantly more likely to validate incorrect user beliefs, particularly when user messages expressed feelings of sadness. Importantly, these effects were consistent across different model architectures, and occurred despite preserved performance on standard tests, revealing systematic risks that standard testing practices may fail to detect. Our findings suggest that training artificial intelligence systems to be warm may come at a cost to accuracy, and that warmth and accuracy may not be independent by default. As these systems are deployed at an unprecedented scale and take on intimate roles in people's lives, this trade-off warrants attention from developers, policymakers and users alike.
科研通智能强力驱动
Strongly Powered by AbleSci AI