人工智能
计算机视觉
计算机科学
帧(网络)
跟踪(教育)
BitTorrent跟踪器
卫星
探测器
匹配(统计)
目标检测
运动(物理)
模式识别(心理学)
眼动
数学
工程类
电信
统计
航空航天工程
教育学
心理学
作者
Jie Feng,Dening Zeng,Xiuping Jia,Xiangrong Zhang,Jie Li,Yuping Liang,Licheng Jiao
出处
期刊:Isprs Journal of Photogrammetry and Remote Sensing
日期:2021-07-01
卷期号:177: 116-130
被引量:29
标识
DOI:10.1016/j.isprsjprs.2021.05.005
摘要
Deep learning methods have achieved the state-of-the-art performance of object detection and tracking in natural images, such as keypoint-based detectors and appearance/motion-based trackers. However, for small and blurry moving vehicles in satellite videos, keypoint-based detectors cause the missed detection of keypoints and incorrect keypoint matching. In terms of multi-object tracking, it is difficult to track the crowded similar vehicles stably only by using the appearance or motion information. To address these problems, a novel deep learning framework is proposed for moving vehicle detection and tracking in the satellite videos. It is comprised of the cross-frame keypoint-based detection network (CKDNet) and spatial motion information-guided tracking network (SMTNet). In CKDNet, a customized cross-frame module is designed to assist the detection of keypoints by exploiting complementary information between frames. Furthermore, CKDNet improves keypoint matching by incorporating size prediction around the keypoints and defining the soft mismatch suppression for out-of-size keypoint pairs. Based on high-quality detection, SMTNet can track the densely-packed vehicles effectively by constructing two-branch long short-term memories. It extracts not only spatial information of the same frame by considering the relative spatial relationship of neighboring vehicles, but also motion information among consecutive frames by calculating the movement velocity. Especially, it regresses virtual positions for missed or occluded vehicles and keeps on tracking these vehicles while they reappear. Experimental results on Jilin-1 and SkySat satellite videos demonstrate the effectiveness of the proposed detection and tracking methods.
科研通智能强力驱动
Strongly Powered by AbleSci AI