Object Detection for Aerial Images With Feature Enhancement and Soft Label Assignment

Object detection in aerial images, different from general object detection, faces with several challenges such as arbitrary-oriented objects and extremely imbalanced foreground-background distribution. Although some recent proposed aerial object detection methods achieve promising results, they are mainly anchor-based detectors which rely heavily on pre-defined anchor boxes and the final detection performance is sensitive to anchor-related hyper-parameters. In contrast, in this paper, we present an anchor-free detector with feature enhancement and soft label assignment (FSDet) which adopts a simpler design and achieves competitive performance. Specifically, to address the feature misalignment for detecting oriented objects, we propose an oriented feature refinement module to align the features with oriented objects. To alleviate the background issue, we design a class-aware context aggregation module to integrate the intra-class context information and suppress background context. Moreover, we propose a soft label assignment mechanism to measure the weight of training samples within the arbitrary-oriented objects, which can concentrate more on representative items with regard to their potential to detect oriented objects, achieving a more stable optimization during training. Extensive experiments on several datasets suggest that the proposed method is superior to the state-of-the-art methods and achieves a better trade-off between speed and accuracy.