Functional brain network identification and fMRI augmentation using a VAE-GAN framework

Recently, deep learning models have achieved superior performance for mapping functional brain networks from functional magnetic resonance imaging (fMRI) data compared with traditional methods. However, due to the lack of sufficient data and the high dimensionality of brain volume, deep learning models of fMRI tend to suffer from overfitting. In addition, existing methods rarely studied fMRI data augmentation and its application. To address these issues, we developed a VAE-GAN framework that combined a VAE (variational auto-encoder) with a GAN (generative adversarial net) for functional brain network identification and fMRI augmentation. As a generative model, the VAE-GAN models the distribution of fMRI so that it enables the extraction of more generalized features, and thus relieve the overfitting issue. The VAE-GAN is easier to train on fMRI than a standard GAN since it uses latent variables from VAE to generate fake data rather than relying on random noise that is used in a GAN, and it can generate higher quality of fake data than VAE since the discriminator can promote the training of the generator. In other words, the VAE-GAN inherits the advantages of VAE and GAN and avoids their limitations in modeling of fMRI data. Extensive experiments on task fMRI datasets from HCP have proved the effectiveness and superiority of the proposed VAE-GAN framework for identifying both temporal features and functional brain networks compared with existing models, and the quality of fake data is higher than those from VAE and GAN. The results on resting state fMRI of Attention Deficit Hyperactivity Disorder (ADHD)-200 dataset further demonstrated that the fake data generated by the VAE-GAN can help improve the performance of brain network modeling and ADHD classification.