Deep Semi-Supervised Learning with Fine-Grained Dynamic Weights and Pseudo-Label Constraints

Semi-supervised learning is comonly trained using a large amount of unlabeled data and a small amount of labeled data. Existing works have achieved excellent results through consistent regularization methods. However, when designing the loss function, they set a loss function for labeled and unlabeled data separately, ignoring the connection between labeled and unlabeled data. Furthermore, unlabeled data all share the same weight, but the weights of different unlabeled data should be different. Based on these observations, a pair loss is proposed in this paper to strengthen the connection between labeled and unlabeled data; in addition, a dynamic weight is designed for each unlabeled data based on EMA (Exponential Moving Average) when calculating the loss function. Finally, a deep semi-supervised learning method called DWPC is proposed by combining dynamic weighting and pair loss. Experimental results on several datasets show that the proposed method improves performance in many scenarios.