Whether LLMs Can Navigate Beliefs and Facts Depends on How You Phrase It

作者
Quang Minh Nguyen,Luis Frentzen Salim
出处
期刊: 卷期号:: 26862-26872
标识
DOI:10.18653/2026.emnlp-main.1171
摘要

Humans naturally form and express beliefs in daily communication, e.g., "I think the answer is 3" or "I suppose that's right."Such beliefs inevitably intertwine with fact and knowledge, making the ability to handle them in tandem desirable for large language models (LLMs), as they are increasingly deployed in user-facing settings.Prior work showed that even capable LLMs exhibit a systemic weakness in acknowledging user beliefs grounded in incorrect information.We extend this evaluation to 10 LLMs across 18 epistemic expressions and find that the size and direction of this weakness depend on the verb used to express the belief, with the accuracy gap between factual and false information ranging from +50% on "I vaguely remember" to -14% on "I seriously doubt".We further show that the phenomenon stems from what we call task confusion: models default to fact-checking the underlying claim, overriding the user's stated belief.We provide evidence where chains of thought that explicitly fact-check show lower accuracy on false information than those that do not, and a single instruction can reverse the failure across verb families.Mechanistically, models attend more to false beliefs they fail to confirm, but suppressing this attention at decoding time recovers accuracy only partially and only in some models, calling for future work on intervention methods.Our findings clarify prior results and show how fact-checking, a generally desirable behavior, can interfere with belief tracking in LLMs 1 .

科研通智能强力驱动
Strongly Powered by AbleSci AI
科研通是完全免费的文献互助平台,具备全网最快的应助速度,最高的求助完成率。 对每一个文献求助,科研通都将尽心尽力,给求助人一个满意的交代。
实时播报
lws完成签到,获得积分10
刚刚
Harden完成签到,获得积分10
刚刚
刚刚
liangyong完成签到,获得积分10
刚刚
林林林9527发布了新的文献求助10
刚刚
白三烯小童鞋完成签到 ,获得积分10
1秒前
yanny完成签到,获得积分10
1秒前
害羞便当完成签到,获得积分10
1秒前
文献狗完成签到,获得积分10
1秒前
2秒前
文sdiw完成签到,获得积分10
2秒前
2秒前
叁月二完成签到 ,获得积分10
2秒前
2秒前
852的应助被糖掌老采纳,获得10
2秒前
灵允发布了新的文献求助10
3秒前
njw完成签到,获得积分10
3秒前
早日毕业完成签到,获得积分10
3秒前
ywyw完成签到,获得积分10
3秒前
森海完成签到,获得积分10
4秒前
仔仔不吃肉肉完成签到,获得积分10
4秒前
霸气的梦露完成签到,获得积分10
5秒前
5秒前
brodie完成签到,获得积分10
6秒前
ecki123123发布了新的文献求助10
6秒前
孔维哲完成签到,获得积分10
6秒前
旺旺小仙完成签到,获得积分10
6秒前
Akim的应助被轻松小刺猬采纳,获得10
6秒前
科研狗echo完成签到 ,获得积分10
6秒前
ss完成签到,获得积分10
7秒前
7秒前
boluo77完成签到,获得积分10
7秒前
7秒前
123发布了新的文献求助10
7秒前
咸不辣苏完成签到,获得积分10
8秒前
sxw完成签到 ,获得积分10
8秒前
闪闪星星完成签到,获得积分10
8秒前
vv完成签到,获得积分10
8秒前
老迟到的涫完成签到,获得积分10
9秒前
蜚英腾茂完成签到,获得积分10
9秒前
高分求助中
(应助此贴封号)【重要!!请各用户(尤其是新用户)详细阅读】【科研通的精品贴汇总】 10000
IRTSD: Open-Source Data and Toolset for Electromagnetic Transient Analysis of Disturbances and IBR Control Malfunctions in Transmission Systems 1000
Spec 401: Standards for Jet Fuel Facility and Equipment Commissioning and Flushing at Airports, 2026.1 (Original Issue) 1000
Spec 103: Standard for Jet Fuel Quality Control at Airports, Revision 2026.1 1000
Les Mots du discours 600
A Consideration on Use of Material Grades for Hull Structural Members Based on Fracture Toughness(Second Report) 500
AI Disclosure in Annual Reports: Evolution, Determinants, and Capital Market Participants’ Perceptions 500
热门求助领域 (近24小时)
化学 材料科学 医学 生物 纳米技术 计算机科学 工程类 有机化学 化学工程 生物化学 物理 复合材料 内科学 催化作用 光电子学 人工智能 细胞生物学 无机化学 物理化学 数学
热门帖子
关注 科研通微信公众号,转发送积分 8109029
求助须知:如何正确求助?哪些是违规求助? 9516770
关于积分的说明 21506037
捐赠科研通 7685859
什么是DOI,文献DOI怎么找? 3411038
关于科研通互助平台的介绍 2538414
邀请新用户注册赠送积分活动 2451002