Fault diagnosis of rolling bearing based on multimodal data fusion and deep belief network

Aiming at raw vibration signal of rolling bearing with long time series, a fault diagnosis model based on multimodal data fusion and deep belief network is proposed in this paper. First, multimodal data composed of artificial features and model features can be obtained by time-frequency domain analysis and unsupervised learning based on restricted Boltzmann machine (RBM). Second, canonical correlation analysis method is used to extract the typical feature pairs from the multimodal data to realize the feature-level multimodal data fusion. Third, deep belief network is applied to extract deep feature mapping between typical feature pairs and fault types. After greedy layer-wise pre-training and fine-tuning, it is available to achieve the trained model for fault diagnosis of rolling bearing. Typical rolling bearing datasets are used to testify the effectiveness of the proposed method. It is verified that the robustness and accuracy of the proposed method are superior to common methods.