A Deep Reinforcement Learning Framework for Multi-Objective Optimization and Decision-Making With Application to Wastewater Treatment

作者
Yu Sun,Yuqing Chang,Fuli Wang,Tianzi Zheng,Bangwu Dai,Shengxiang Yang
出处
期刊:IEEE Transactions on Automation Science and Engineering [Institute of Electrical and Electronics Engineers]
卷期号:23: 17753-17767
标识
DOI:10.1109/tase.2026.3737832
摘要

Multi-objective optimization is essential in complex systems, where multiple conflicting objectives must be balanced simultaneously. Traditional multi-objective evolutionary algorithms (MOEAs) are effective in approximating the Pareto front but typically rely on iterative population-based optimization, which may limit their applicability to online decision-making. Reinforcement learning (RL) offers an alternative, while adaptive trade-off selection during policy execution remains an important issue in multi-objective decision-making. This study proposes a multi-objective deep RL framework (MODRL) to address these issues. A scalarization-based reward design enables policy learning under varying trade-offs, while augmenting the state with weight vectors allows the policy to internalize preference information and generalize across different preference settings. In addition, a Q-value-guided dynamic weight adaptation mechanism is employed during inference, enabling adaptive adjustment of trade-offs according to system conditions. Experimental results on the ZDT and WFG benchmark suites show that MODRL achieves competitive optimization performance compared with representative MOEAs, while enabling efficient online policy execution after offline training. Furthermore, the effectiveness of the proposed framework is validated in the Benchmark Simulation Model No. 1 (BSM1) wastewater treatment process, demonstrating its potential for practical multi-objective optimization and decision-making. Note to Practitioners—This paper presents a reinforcement learning framework for multi-objective operational decision-making, demonstrated on a wastewater treatment process where conflicting objectives such as operating cost and effluent quality must be balanced. The framework learns decision policies directly from interaction with a process simulator, which is useful when accurate mechanistic models are difficult to obtain. During online operation, the learned policy can adapt objective trade-offs according to current system conditions. In practice, engineers need a reliable simulator or digital twin for offline training, as well as clearly defined performance indicators and operational constraints. The method is flexible and can incorporate different deep reinforcement learning algorithms according to practical requirements.

科研通智能强力驱动
Strongly Powered by AbleSci AI
科研通是完全免费的文献互助平台,具备全网最快的应助速度,最高的求助完成率。 对每一个文献求助,科研通都将尽心尽力,给求助人一个满意的交代。
实时播报
追风少年完成签到,获得积分10
刚刚
MOMO完成签到,获得积分10
刚刚
愉快的丹彤完成签到 ,获得积分10
刚刚
莱特沐恩完成签到 ,获得积分10
1秒前
糊涂的涂涂完成签到,获得积分10
1秒前
Liugz完成签到,获得积分10
1秒前
Arthur完成签到,获得积分10
1秒前
zsj完成签到,获得积分10
1秒前
DHMO完成签到,获得积分10
1秒前
xty完成签到,获得积分10
1秒前
KYTYYDS发布了新的文献求助30
2秒前
晏旭完成签到,获得积分10
2秒前
华无剑完成签到,获得积分10
2秒前
大风完成签到,获得积分10
2秒前
lilac完成签到,获得积分10
3秒前
qqshown完成签到,获得积分10
3秒前
傲娇的秋莲完成签到,获得积分10
3秒前
339564965完成签到,获得积分0
3秒前
iliuyang2完成签到,获得积分10
3秒前
yuhan完成签到,获得积分10
3秒前
lylyspeechless完成签到,获得积分10
3秒前
研友_ZA2B68完成签到,获得积分0
3秒前
ice完成签到,获得积分10
4秒前
尤尤SCI完成签到 ,获得积分10
4秒前
egoistMM完成签到,获得积分10
4秒前
小天发布了新的文献求助10
4秒前
动人的巧蕊完成签到 ,获得积分10
4秒前
ccc完成签到,获得积分0
4秒前
Helios完成签到,获得积分0
4秒前
JY'完成签到,获得积分0
4秒前
lee完成签到,获得积分10
5秒前
精明的盼雁完成签到,获得积分10
5秒前
BK_201完成签到,获得积分0
5秒前
依然完成签到 ,获得积分10
5秒前
Shanks完成签到,获得积分10
5秒前
只想顺利毕业的科研狗完成签到,获得积分0
5秒前
ZHD完成签到,获得积分10
5秒前
教授完成签到,获得积分10
5秒前
迷人雅容完成签到,获得积分10
5秒前
duyu完成签到,获得积分10
6秒前
高分求助中
(应助此贴封号)【重要!!请各用户(尤其是新用户)详细阅读】【科研通的精品贴汇总】 10000
拉伸高分子熔体中缠结行为的模拟和小角中子散射研究 1700
The World Atlas of Wine 9th edition 1000
奈特基础组织学:配套组织病理学(第4版)(Netter's Essential Histology With Correlated Histopathology) 800
John McDowells Bildungstheorie 800
八旗制度の研究 600
Hidden Empire of Finance: How Wall Street Profits from Our Cities and Fuels Global Inequality 500
热门求助领域 (近24小时)
化学 材料科学 医学 生物 纳米技术 计算机科学 工程类 有机化学 化学工程 生物化学 物理 复合材料 内科学 催化作用 光电子学 人工智能 细胞生物学 无机化学 物理化学 数学
热门帖子
关注 科研通微信公众号,转发送积分 8166570
求助须知:如何正确求助?哪些是违规求助? 9559581
关于积分的说明 21750904
捐赠科研通 7757397
什么是DOI,文献DOI怎么找? 3429170
关于科研通互助平台的介绍 2553530
邀请新用户注册赠送积分活动 2473923