A survey on deep learning-based panoptic segmentation

In the era of deep learning, various segmentation tasks have been studied. As a new segmentation task, panoptic segmentation has been proposed and studied by researchers recently. This article summarizes the basic ideas of the panoptic segmentation method based on deep learning and classifies the current image panoptic segmentation into four categories: top-down, bottom-up methods, single-path methods and other methods. In some methods, they are further divided into several small categories. The characteristics and limitations of each method are analyzed, and the segmentation effects are compared. In addition, video panoptic segmentation and LiDAR data panoptic segmentation are also involved. Finally, the possible future research directions are prospected.