计算机科学
特质
人工智能
阈下刺激
机器学习
人工神经网络
语言模型
简单(哲学)
感知器
传输(电信)
自然语言处理
蒸馏
基础(拓扑)
深度学习
数据建模
认知心理学
训练集
多层感知器
语言习得
作者
Alex Cloud,Minh Hoang Le,James Chua,Jan Betley,Anna Sztyber,Sören Mindermann,Jacob Hilton,Samuel Marks,Owain Evans
出处
期刊:Nature
[Nature Portfolio]
日期:2026-04-15
卷期号:652 (8110): 615-621
被引量:3
标识
DOI:10.1038/s41586-026-10319-8
摘要
. Here we show that distillation can lead to subliminal learning-the transmission of behavioural traits through semantically unrelated data. In our main experiments, a 'teacher' model with some trait T (such as disproportionately generating responses favouring owls or showing broad misaligned behaviour) generates datasets consisting solely of number sequences. Remarkably, a 'student' model trained on these data learns T, even when references to T are rigorously removed. More realistically, we observe the same effect when the teacher generates math reasoning traces or code. The effect occurs only when the teacher and student have the same (or behaviourally matched) base models. To help explain this, we prove a theoretical result showing that subliminal learning arises in neural networks under broad conditions and demonstrate it in a simple multilayer perceptron (MLP) classifier. As artificial intelligence systems are increasingly trained on the outputs of one another, they may inherit properties not visible in the data. Safety evaluations may therefore need to examine not just behaviour, but the origins of models and training data and the processes used to create them.
科研通智能强力驱动
Strongly Powered by AbleSci AI