计算机科学
人工智能
一般化
抽象
代表(政治)
相似性(几何)
人工神经网络
集合(抽象数据类型)
机器学习
航程(航空)
深度学习
钥匙(锁)
学习迁移
认知
视觉推理
概念学习
人类智力
特征学习
知识表示与推理
抽象层
深层神经网络
计算模型
人类视觉系统模型
自然语言处理
常识
语义学(计算机科学)
训练集
语义网络
作者
Muttenthaler, Lukas,Greff, Klaus,Born, Frieda,Spitzer, Bernhard,Kornblith, Simon,Mozer, Michael C.,Müller, Klaus-Robert,Unterthiner, Thomas,Lampinen, Andrew K.
出处
期刊:Nature
[Nature Portfolio]
日期:2025-11-12
卷期号:647 (8089): 349-355
被引量:1
标识
DOI:10.1038/s41586-025-09631-6
摘要
Abstract Deep neural networks have achieved success across a wide range of applications, including as models of human behaviour and neural representations in vision tasks 1,2 . However, neural network training and human learning differ in fundamental ways, and neural networks often fail to generalize as robustly as humans do 3,4 , raising questions regarding the similarity of their underlying representations. We need to determine what is missing for modern learning systems to exhibit more human-aligned behaviour. Here we highlight a key misalignment between vision models and humans: whereas human conceptual knowledge is hierarchically organized from fine- to coarse-scale distinctions (for example, ref. 5 ), model representations do not accurately capture all these levels of abstraction. To address this misalignment, we first train a teacher model to imitate human judgements, then transfer human-aligned structure from its representations to refine the representations of pretrained state-of-the-art vision foundation models via fine-tuning. These human-aligned models more accurately approximate human behaviour and uncertainty across a wide range of similarity tasks, including a dataset of human judgements spanning multiple levels of semantic abstractions. They also perform better on a diverse set of machine learning tasks, increasing generalization and out-of-distribution robustness. Thus, infusing neural networks with additional human knowledge yields a best-of-both-worlds representation that is both more consistent with human cognitive judgements and more practically useful, paving the way towards more robust, interpretable and human-aligned artificial intelligence systems.
科研通智能强力驱动
Strongly Powered by AbleSci AI