替代模型
计算机科学
稳健性(进化)
最优化问题
多目标优化
数学优化
水准点(测量)
Boosting(机器学习)
稳健优化
人工智能
工程优化
进化算法
机器学习
元启发式
调度(生产过程)
随机优化
离散优化
进化计算
全局优化
强化学习
作者
Yuxin Wu,Hongshu Guo,Ting Huang,Yue-Jiao Gong,Zeyuan Ma
标识
DOI:10.48550/arxiv.2602.00540
摘要
Surrogate-assisted Evolutionary Algorithms~(SAEAs) have shown promising robustness in solving expensive optimization problems. A key aspect that impacts SAEAs' effectiveness is surrogate model selection, which in existing works is predominantly decided by human developer. Such human-made design choice introduces strong bias into SAEAs and may hurt their expected performance on out-of-scope tasks. In this paper, we propose a reinforcement learning-assisted ensemble framework, termed as SEEMOO, which is capable of scheduling different surrogate models within a single optimization process, hence boosting the overall optimization performance in a cooperative paradigm. Specifically, we focus on expensive multi-objective optimization problems, where multiple objective functions shape a compositional landscape and hence challenge surrogate selection. SEEMOO comprises following core designs: 1) A pre-collected model pool that maintains different surrogate models; 2) An attention-based state-extractor supports universal optimization state representation of problems with varied objective numbers; 3) a deep Q-network serves as dynamic surrogate selector: Given the optimization state, it selects desired surrogate model for current-step evaluation. SEEMOO is trained to maximize the overall optimization performance under a training problem distribution. Extensive benchmark results demonstrate SEEMOO's surrogate ensemble paradigm boosts the optimization performance of single-surrogate baselines. Further ablation studies underscore the importance of SEEMOO's design components.
科研通智能强力驱动
Strongly Powered by AbleSci AI