SLE diagnosis research based on SERS combined with a multi-modal fusion method

As artificial intelligence technology gains widespread adoption in biomedicine, the exploration of integrating biofluidic Raman spectroscopy for enhanced disease diagnosis opens up new prospects for the practical application of Raman spectroscopy in clinical settings. However, for systemic lupus erythematosus (SLE), origin Raman spectral data (ORS) have relatively weak signals, making it challenging to obtain ideal classification results. Although the surface enhancement technique can enhance the scattering signal of Raman spectroscopic data, the sensitivity of the SERS substrate to airborne impurities and the inhomogeneous distribution of hotspots degrade part of the signal. To fully utilize both kinds of data, this paper proposes a two-branch residual-attention network (DBRAN) fusion technique, which allows the ORS to complement the degraded portion and thus improve the model's classification accuracy. The features are extracted using the residual module, which retains the original features while extracting the deep features. At the same time, the study incorporates the attention module in both the upper and lower branches to handle the weight allocation of the two modal features more efficiently. The experimental results demonstrate that both the low-level fusion method and the intermediate-level fusion method can significantly improve the diagnostic accuracy of SLE disease classification compared with a single modality, in which the intermediate-level fusion of DBRAN achieves 100% classification accuracy, sensitivity, and specificity. The accuracy is improved by 10% and 7% compared with the ORS unimodal and the SERS unimodal modalities, respectively. The experiment, by fusing the multimodal spectral, realized rapid diagnosis of SLE disease by fusing multimodal spectral data, which provides a reference idea in the field of Raman spectroscopy and can be further promoted to clinical practical applications in the future.