计算机科学
人工智能
分割
任务(项目管理)
模棱两可
对象(语法)
多任务学习
特征(语言学)
特征学习
最小边界框
市场细分
深度学习
机器学习
过程(计算)
跳跃式监视
代表(政治)
面子(社会学概念)
任务分析
模式识别(心理学)
图像(数学)
政治学
语言学
社会科学
法学
程序设计语言
管理
营销
经济
业务
社会学
哲学
操作系统
政治
作者
Dingwen Zhang,Junwei Han,Le Yang,Dong Xu
标识
DOI:10.1109/tpami.2018.2881114
摘要
Object localization and segmentation in weakly labeled videos are two interesting yet challenging tasks. Models built for simultaneous object localization and segmentation have been explored in the conventional fully supervised learning scenario to boost the performance of each task. However, none of the existing works has attempted to jointly learn object localization and segmentation models under weak supervision. To this end, we propose a joint learning framework called Self-Paced Fine-Tuning Network (SPFTN) for localizing and segmenting objects in weakly labelled videos. Learning the deep model jointly for object localization and segmentation under weak supervision is very challenging as the learning process of each single task would face serious ambiguity issue due to the lack of bounding-box or pixel-level supervision. To address this problem, our proposed deep SPFTN model is carefully designed with a novel multi-task self-paced learning objective, which leverages the task-specific prior knowledge and the knowledge that has been already captured to infer the confident training samples for each task. By aggregating the confident knowledge from each single task to mine reliable patterns and learning deep feature representation for both tasks, the proposed learning framework can address the ambiguity issue under weak supervision with simple optimization. Comprehensive experiments on the large-scale YouTube-Objects and DAVIS datasets demonstrate that the proposed approach achieves superior performance when compared with other state-of-the-art methods and the baseline networks/models.
科研通智能强力驱动
Strongly Powered by AbleSci AI