Optimizing Control of Wastewater Treatment Plant With Reinforcement Learning: Technical Evaluation of Twin-Delayed Deep Deterministic Policy Gradient Agent

作者
Zuzanna Klawikowska,Michał Grochowski
出处
期刊:IEEE Access [Institute of Electrical and Electronics Engineers]
卷期号:12: 130318-130333 被引量:19
标识
DOI:10.1109/access.2024.3458186
摘要

Control of the wastewater treatment processes presents significant challenges due to the fluctuating nature of inflow and wastewater composition, alongside the system’s non-linear dynamics. Traditional control methods struggle to adapt to these variations, leading to an economically suboptimal operation of the process and a violation of norms imposed on the quality of wastewater discharged to the catchment area. This study proposes using a reinforcement learning approach to control a wastewater treatment plant. Specifically, the twin-delayed deep deterministic policy gradient algorithm is employed and comprehensively validated. This algorithm enhances control efficiency, optimizing costs while improving the plant’s wastewater treatment capabilities. The proposed control approach is implemented and evaluated using Benchmark Simulation Model No. 1. The evaluation is based on four representative weather scenarios and examines sixteen different metrics. In the proposed case study, an agent controls oxygen transfer coefficients in three oxygen tanks of a wastewater treatment plant. Two distinct reward functions are employed to guide the reinforcement learning agent. The first one focuses on maintaining aerobic conditions and minimizing total nitrogen. The second function retains these objectives and also aims to minimize the aeration energy. The experimental results demonstrate that the proposed control strategy significantly enhances aeration energy efficiency and reduces the overall cost index, indicating a more cost-effective operation. However, future work is required to improve further the performance of reinforcement learning that optimizes the wastewater treatment process.

科研通智能强力驱动
Strongly Powered by AbleSci AI
科研通是完全免费的文献互助平台,具备全网最快的应助速度,最高的求助完成率。 对每一个文献求助,科研通都将尽心尽力,给求助人一个满意的交代。
实时播报
鲍展鹏完成签到,获得积分10
刚刚
科研通AI6.4的应助被Nowaki采纳,获得10
1秒前
摩奥锚发布了新的文献求助30
1秒前
1秒前
1秒前
superworm1完成签到,获得积分10
2秒前
和谐的沧海完成签到,获得积分10
2秒前
任风发布了新的文献求助10
2秒前
充电宝的应助被zys采纳,获得10
2秒前
BZPL完成签到,获得积分10
3秒前
养火花完成签到 ,获得积分20
3秒前
思源的应助被自由归尘采纳,获得10
3秒前
3秒前
思源的应助被1762454767采纳,获得10
4秒前
大模型的应助被Zxy采纳,获得10
4秒前
爆米花的应助被佳洛父亲采纳,获得10
5秒前
111111发布了新的文献求助10
5秒前
厉亮完成签到,获得积分10
5秒前
5秒前
甜蜜花发布了新的文献求助10
5秒前
Liu_letters的应助被科研通管家采纳,获得10
5秒前
molihuakai的应助被科研通管家采纳,获得10
5秒前
5秒前
科目三的应助被科研通管家采纳,获得10
6秒前
Akim的应助被科研通管家采纳,获得10
6秒前
零负一的应助被科研通管家采纳,获得30
6秒前
zhangsiyu发布了新的文献求助10
6秒前
酷波er的应助被科研通管家采纳,获得10
6秒前
yyyyy发布了新的文献求助50
6秒前
Maestro_S的应助被科研通管家采纳,获得10
6秒前
上官若男的应助被科研通管家采纳,获得10
6秒前
milai发布了新的文献求助10
6秒前
隐形曼青的应助被科研通管家采纳,获得10
6秒前
rammy的应助被科研通管家采纳,获得10
6秒前
李健的应助被科研通管家采纳,获得10
7秒前
零负一的应助被科研通管家采纳,获得10
7秒前
7秒前
8秒前
keten完成签到,获得积分10
8秒前
无限凛发布了新的文献求助10
9秒前
高分求助中
(应助此贴封号)【重要!!请各用户(尤其是新用户)详细阅读】【科研通的精品贴汇总】 10000
拉伸高分子熔体中缠结行为的模拟和小角中子散射研究 1700
The World Atlas of Wine 9th edition 1000
奈特基础组织学:配套组织病理学(第4版)(Netter's Essential Histology With Correlated Histopathology) 800
John McDowells Bildungstheorie 800
八旗制度の研究 600
What Else Can I Tell You?: A Pragmatic Study of English Rhetorical Questions as Discursive and Argumentative Acts 500
热门求助领域 (近24小时)
化学 材料科学 医学 生物 纳米技术 计算机科学 工程类 有机化学 化学工程 生物化学 物理 复合材料 内科学 催化作用 光电子学 人工智能 细胞生物学 无机化学 物理化学 数学
热门帖子
关注 科研通微信公众号,转发送积分 8163835
求助须知:如何正确求助?哪些是违规求助? 9557925
关于积分的说明 21742693
捐赠科研通 7754454
什么是DOI,文献DOI怎么找? 3428350
关于科研通互助平台的介绍 2553034
邀请新用户注册赠送积分活动 2472982