Multiscale Deep Attention Q Network: A New Deep Reinforcement Learning Method for Imbalanced Fault Diagnosis in Gearboxes

Ensuring the safety of mechanical driving systems relies heavily on accurate gearbox fault diagnosis. However, the presence of actual multi-working conditions and uneven sample distribution makes fault diagnosis in gearboxes more challenging. Although intelligent fault diagnosis employing convolutional neural networks has shown promising results, they often require strong feedback learning and experienced adjustment of hyper-parameters for different tasks. In this paper, a novel approach called multiscale deep attention Q network (MDAQN) is proposed for imbalanced gearbox fault diagnosis from a deep reinforcement learning perspective. An imbalanced classification Markov decision process is introduced that considers inter-class deviation, serving as an environment simulation to enhance classification policy learning under data imbalance. Additionally, a new multiscale attention convolution network is designed as the agent structure of the deep Q network (DQN) algorithm, thereby improving the discriminative feature learning ability under complex running conditions. By employing weak feedback interaction from deep reinforcement learning, the diagnostic model is trained to enable imbalanced gearbox fault diagnosis effectively. Experimental results on three gearbox imbalanced datasets demonstrate that MDAQN exhibits superior feature extraction ability and generalization, achieving an accuracy of over 99.0% when compared to multiple existing approaches.