A cooperative hierarchical deep reinforcement learning based multi-agent method for distributed job shop scheduling problem with random job arrivals

作业车间调度 强化学习 工作车间 计算机科学 分布式制造 调度(生产过程) 工厂(面向对象编程) 流水车间调度 马尔可夫决策过程 人工智能 工业工程 数学优化 运筹学 分布式计算 马尔可夫过程 工程类 制造工程 地铁列车时刻表 数学 操作系统 程序设计语言 统计
作者
Jiang‐Ping Huang,Liang Gao,Xinyu Li,Chunjiang Zhang
出处
期刊:Computers & Industrial Engineering [Elsevier BV]
卷期号:185: 109650-109650 被引量:47
标识
DOI:10.1016/j.cie.2023.109650
摘要

Distributed manufacturing can reduce the production cost through the cooperation among factories, and it has been an important trend in the industrial field. For the enterprises with daily delivered production tasks, the random job arrivals are regular. Thus, the Distributed Job-shop Scheduling Problem (DJSP) with random job arrivals is studied, and it is a typical case from the equipment manufacturing industry. The DJSP involves two coupled decision-making processes, job assigning and job sequencing, and the distributed and uncertain production environment requires the scheduling method to be more responsive and adaptive. Thus, a Deep Reinforcement Learning (DRL) based multi-agent method is explored, and it is composed of the assigning agent and the sequencing agent. Two Markov Decision Processes (MDPs) are formulated for the two agents respectively. In the MDP for the assigning agent, fourteen factory-and-job related features are extracted as the state features, seven composite assigning rules are designed as the candidate actions, and the reward depends on the total processing time of different factories. In the MDP of the sequencing agent, five machine-and-job related features are set as the state features, six sequencing rules make up the action space, and the change of the factory makespan is the reward. Besides, to enhance the learning ability of the agents, a Deep Q-Network (DQN) framework with variable threshold probability in the training stage is designed, which can balance the exploitation and exploration in the model training. The proposed multi-agent method’s effectiveness is proved by the independent utility test and the comparison test that are based on 1350 production instances, and its practical value in the actual production is implied by the case study from an automotive engine manufacturing company.
最长约 10秒,即可获得该文献文件

科研通智能强力驱动
Strongly Powered by AbleSci AI
科研通是完全免费的文献互助平台,具备全网最快的应助速度,最高的求助完成率。 对每一个文献求助,科研通都将尽心尽力,给求助人一个满意的交代。
实时播报
wlq完成签到,获得积分10
1秒前
壮观依云完成签到,获得积分10
1秒前
君为臣纲的应助被小亦雪采纳,获得10
1秒前
LJR完成签到,获得积分10
1秒前
1秒前
李佳会发布了新的文献求助10
1秒前
2秒前
hhh关注了科研通微信公众号
2秒前
2秒前
真开心完成签到,获得积分10
2秒前
lianhe完成签到 ,获得积分10
3秒前
3秒前
豚骨大王完成签到,获得积分10
3秒前
根号3完成签到 ,获得积分10
3秒前
书写笔迹完成签到,获得积分10
3秒前
桐桐的应助被未晞采纳,获得10
4秒前
M先生完成签到 ,获得积分10
4秒前
xuedan完成签到,获得积分10
4秒前
4秒前
Elias_HK完成签到 ,获得积分10
4秒前
雾随风完成签到,获得积分10
4秒前
晓锅巴完成签到 ,获得积分10
5秒前
拼搏傲蕾完成签到,获得积分10
5秒前
Zzhangoo完成签到 ,获得积分10
5秒前
sky完成签到,获得积分10
5秒前
5秒前
小太阳完成签到,获得积分10
5秒前
5秒前
顺利毕业完成签到,获得积分10
5秒前
从不离家的蜗牛完成签到,获得积分10
6秒前
张颖涛发布了新的文献求助10
6秒前
渴者易饮完成签到,获得积分10
6秒前
JOhn发布了新的文献求助10
6秒前
luyue9406的应助被小yu采纳,获得10
6秒前
哈哈哈哈完成签到,获得积分10
6秒前
hanxin108完成签到,获得积分20
6秒前
fei关闭了fei的文献求助
6秒前
天天向上的应助被六六采纳,获得10
6秒前
纹纹发布了新的文献求助10
7秒前
奋斗的誉完成签到,获得积分10
7秒前
高分求助中
(应助此贴封号)【重要!!请各用户(尤其是新用户)详细阅读】【科研通的精品贴汇总】 10000
拉伸高分子熔体中缠结行为的模拟和小角中子散射研究 1700
The World Atlas of Wine 9th edition 1000
奈特基础组织学:配套组织病理学(第4版)(Netter's Essential Histology With Correlated Histopathology) 800
John McDowells Bildungstheorie 800
Social Psychology in the Real World 600
八旗制度の研究 600
热门求助领域 (近24小时)
化学 材料科学 医学 生物 纳米技术 计算机科学 工程类 有机化学 化学工程 生物化学 物理 复合材料 内科学 催化作用 光电子学 人工智能 细胞生物学 无机化学 物理化学 数学
热门帖子
关注 科研通微信公众号,转发送积分 8180275
求助须知:如何正确求助?哪些是违规求助? 9570366
关于积分的说明 21810725
捐赠科研通 7776380
什么是DOI,文献DOI怎么找? 3433277
关于科研通互助平台的介绍 2557483
邀请新用户注册赠送积分活动 2479042