双层优化
数学优化
算法
计算机科学
数学
计算复杂性理论
最优化问题
作者
Jie Hou,Xianlin Zeng,Shisheng Cui,Xia Jiang,Jian Qiao Sun
标识
DOI:10.1109/tsp.2025.3596231
摘要
Bilevel optimization, where one optimization problem is inherently nested within another, has gained significant attention due to its extensive applications in machine learning, such as hyperparameter optimization and meta-learning. Most existing algorithms are designed to address unconstrained bilevel optimization problems, with few are capable of effectively tackling complex constrained settings. To address this gap, we propose a novel, fully single-loop stochastic Frank-Wolfe algorithm. This algorithm incorporates a Hessian-inverse-vector approximation technique, momentum-based gradient tracking, and a Frank-Wolfe update. Our proposed algorithm improves per-iteration complexity and achieves lower sample complexity compared to existing Frank-Wolfe algorithms for bilevel optimization. We also conduct numerical simulations to demonstrate the efficacy of our algorithm compared to state-of-the-art methods.
科研通智能强力驱动
Strongly Powered by AbleSci AI