Multi-objective energy management strategy for a dual-stack fuel cell heavy-duty truck via deep reinforcement learning

The Proton Exchange Membrane Fuel Cell (PEMFC) system, as an efficient, zero-pollution emission, and high-efficiency energy conversion device, is particularly suitable for heavy-duty transportation. Considering the limited power of the current PEMFC system, this study focuses on a hybrid fuel cell heavy-duty truck with dual stacks. Considering the optimal operating range of the PEMFC system and the health status of the lithium-ion battery pack, an energy management strategy (EMS) based on the Deep Deterministic Policy Gradient (DDPG) algorithm is established. This strategy optimizes the hydrogen consumption cost, degradation costs of lithium-ion battery and fuel cells. Additionally, a dynamic programming (DP) and an equivalent consumption minimization strategy (ECMS) based EMSs are established. The power allocation and overall transportation costs under the CSC driving cycle are compared and verified for the three EMSs. The results show that the DDPG algorithm provides a more optimal power allocation for the dual-stack fuel cells, improving the overall system efficiency, enhancing the lifecycle of heavy-duty trucks, and significantly reducing overall travel costs.