强化学习
计算机科学
延迟(音频)
桥接(联网)
水准点(测量)
人工智能
机器学习
计算机网络
大地测量学
电信
地理
作者
Changqiao Xu,Zhen Wang,Shuncheng Liu,Yaliang Li,Kai Zeng,Bolin Ding,Jingren Zhou,Han Su,Kai Zheng
出处
期刊:Proceedings of the VLDB Endowment
[VLDB Endowment]
日期:2023-04-01
卷期号:16 (8): 1958-1966
标识
DOI:10.14778/3594512.3594525
摘要
Some recent works have shown the advantages of reinforcement learning (RL) based learned query optimizers. These works often use the cost (i.e., the estimation of cost model) or the latency (i.e., execution time) as guidance signals for training their learned models. However, cost-based learning underperforms in latency and latency-based learning is time-intensive. In order to bypass such a dilemma, researchers attempt to transfer a learned value network from the cost domain to the latency domain. We recognize critical insights in cost/latency-based training, prompting us to transfer the reward function rather than the value network. Based on this idea, we propose a two-stage RL-based framework, BASE , to bridge the gap between cost and latency. After learning a policy based on cost signals in its first stage, BASE formulates transferring the reward function as a variant of inverse reinforcement learning. Intuitively, BASE learns to calibrate the reward function and updates the policy regarding the calibrated one in a mutually-improved manner. Extensive experiments exhibit the superiority of BASE on two benchmark datasets: Our optimizer outperforms traditional DBMS, using 30% less training time than SOTA methods. Meanwhile, our approach can enhance the efficiency of other learning-based optimizers.
科研通智能强力驱动
Strongly Powered by AbleSci AI