缩放比例
计算机科学
标度律
统计物理学
法学
政治学
数学
几何学
物理
作者
Jared Kaplan A,Sam McCandlish,Tom Henighan,Brown, Tom B.,Benjamin Chess,Rewon Child,Scott Gray,Alec Radford,Jeffrey Wu,Dario Amodei
标识
DOI:10.48550/arxiv.2001.08361
摘要
This paper develops a transport-validity theory for agentic AI interventions that are first screened on small systems and later considered for frontier-scale deployment. Rather than predicting absolute frontier performance, it asks when a comparative gain observed at small scale can be carried forward without overclaiming. The analysis targets an explicitly delimited class of operationally isolatable interventions whose effects can be compiled from logged event-local channels with bounded spillover and replayable extraction maps. The paper proves structured failure modes for naive extrapolation, including sign reversal under bottleneck-weight shift and the vacuity of observable closeness when a descriptor omits a sign-relevant coordinate. It then develops a constructive positive framework based on executable lower certificates: a two-stage compiler architecture, replayable identified sets for stage-one mode laws, descriptor-language growth audits, witness-cover transport certificates, branch-local evaluation bridges, confidence-calibrated audit rules, and portfolio-level frontier allocation under interaction risk. The result is a finite, machine-readable, and operational framework for deciding which small-scale architectural improvements—such as decomposition, tool routing, memory policy, verifier coupling, orchestration, and related inference-time interventions—deserve expensive frontier trials, and how scarce frontier budget should be allocated among them. The paper does not claim a law for AGI timelines and does not remove the need for frontier experimentation; its claim is narrower and practical: to provide replayable, falsifiable conditions for responsible scale-up decisions in agentic AI research.
科研通智能强力驱动
Strongly Powered by AbleSci AI