You Are the Best Reviewer of Your Own Papers: The Isotonic Mechanism
作者
Weijie Su
出处
期刊:Operations Research [Institute for Operations Research and the Management Sciences] 日期:2025-12-03
标识
DOI:10.1287/opre.2022.0622
摘要
Fixing AI’s “Peer Review Lottery” Getting a paper into a top AI conference can feel like a lottery, with studies showing reviewer scores are often arbitrary. Now, research from Weijie Su introduces a fix set to reform the field. The new "isotonic mechanism" tackles the crisis by asking authors to do the seemingly counter-intuitive: rank their own submissions from best to worst. The method’s effectiveness lies in its game-theoretic proof that honesty is actually the author’s best possible strategy. By harnessing this truthful self-assessment, the mechanism calibrates noisy and random reviewer scores, ensuring genuine scientific merit rises to the top. After successful large-scale experiments at major conferences, this mechanism isn’t just a theory. It’s being officially adopted by the International Conference on Machine Learning (ICML) in 2026, promising a fairer, more reliable future for millions of AI researchers.