Multimodal magnetic resonance imaging for Alzheimer's disease diagnosis using hybrid features extraction and ensemble support vector machines

Abstract Magnetic resonance imaging (MRI) is increasingly used in the diagnosis of Alzheimer's disease (AD) in order to identify abnormalities in the brain. Indeed, cortical atrophy, a powerful biomarker for AD, can be detected using structural MRI (sMRI), but it cannot detect impairment in the integrity of the white matter (WM) preceding cortical atrophy. The early detection of these changes is made possible by the novel MRI modality known as diffusion tensor imaging (DTI). In this study, we integrate DTI and sMRI as complementary imaging modalities for the early detection of AD in order to create an effective computer‐assisted diagnosis tool. The fused Bag‐of‐Features (BoF) with Speeded‐Up Robust Features (SURF) and modified AlexNet convolutional neural network (CNN) are utilized to extract local and deep features. This is applied to DTI scalar metrics (fractional anisotropy and diffusivity metric) and segmented gray matter images from T1‐weighted MRI images. Then, the classification of local unimodal and deep multimodal features is first performed using support vector machine (SVM) classifiers. Then, the majority voting technique is adopted to predict the final decision from the ensemble SVMs. The study is directed toward the classification of AD versus mild cognitive impairment (MCI) versus cognitively normal (CN) subjects. Our proposed method achieved an accuracy of 98.42% and demonstrated the robustness of multimodality imaging fusion.