Study of crystal properties based on attention mechanism and crystal graph convolutional neural network

Abstract The prediction of crystal properties has always been limited by huge computational costs. In recent years, the rise of machine learning methods has gradually made it possible to study crystal properties on a large scale. We propose an attention mechanism-based crystal graph convolutional neural network, which builds a machine learning model by inputting crystallographic information files and target properties. In our research, the attention mechanism is introduced in the crystal graph convolutional neural network to learn the local chemical environment, and node normalization is added to reduce the risk of overfitting. We collect structural information and calculation data of about 36,000 crystals and examine the prediction performance of the models for the formation energy, total energy, bandgap, and Fermi energy of crystals in our research. Compared with the crystal graph convolutional neural network, it is found that the accuracy of the predicted properties can be further improved to varying degrees by the introduction of the attention mechanism. Moreover, the total magnetization and bandgap can be classified under the same neural network framework. The classification accuracy of wide bandgap semiconductor crystals with a bandgap threshold of 2.3 eV reaches 93.2%, and the classification accuracy of crystals with a total magnetization threshold of 0.5 μB reaches 88.8%. The work is helpful to realize large-scale prediction and classification of crystal properties, accelerating the discovery of new functional crystal materials.