Deep feature interactive network for machinery fault diagnosis using multi-source heterogeneous data

Infrared thermal images have been applied for monitoring health condition of machines due to the noncontact and nonintrusive manner. While fault diagnosis performance of those deep neural networks (DNNs) that use infrared thermal images is restricted by the information learned from single sensor. In this study, multi-source heterogeneous data (i.e., infrared thermal images and vibration signals) are used for machinery fault diagnosis. A new DNN, i.e., deep feature interactive network (DFINet) is proposed for machinery fault diagnosis, where a novel interactive feature extraction module is developed for adaptive feature fusion on multi-source heterogeneous data. Firstly, the private and public features of multi-source heterogeneous data are extracted separately by measuring the distribution discrepancy between heterogeneous features in the feature interactive module. The feature splicing is implemented to interactively fuse common fault features of heterogeneous data and to preserve private unique features. A global feature fusion module is further proposed for adaptive fusion of superficial local features and deep abstract features learned by different feature interactive modules. The experimental results on a rotor test-bed and gearbox test-bed indicate that DFINet is promising for fusion and feature extraction on multi-source heterogeneous data in machinery fault diagnosis.