Lightweight Bearing Fault Diagnosis Method Based on Cross-Scale Learning Transformer under Imbalanced Data

Abstract Due to the limited amount of failure data in rolling bearing faults, traditional fault diagnosis models encounter challenges such as low diagnostic accuracy and efficiency when dealing with imbalanced data. Additionally, many fault diagnosis models are overly complex and demand high computational resources. To address these issues, a lightweight bearing fault diagnosis method based on cross-scale learnable transformer (CSLT) is proposed for imbalanced data. For difficult-to-classify samples, a learnable generalized focal loss function is defined. The learnable parameters are employed to increase its flexibility, it better addresses the issue of bearing fault diagnosis under imbalanced data conditions. Then, a multi-head broadcasted self-attention mechanism is designed by capturing critical local features of the signal through one-dimensional convolution operations, which not only improves feature extraction capability but also reduces computational complexity. Finally, a dynamic label prediction pruning module is developed to trim redundant labels, which helps in lightening the model and enhancing both feature extraction and diagnostic efficiency. The experimental results demonstrate that the proposed diagnosis method exhibits superior diagnostic precision and efficiency by comparing with other methods.