SCL: Self-supervised contrastive learning for few-shot image classification

计算机科学 人工智能 模式识别(心理学) 样品(材料) 班级(哲学) 水准点(测量) 基础(拓扑) 一般化 任务(项目管理) 旋转(数学) 代表(政治) 机器学习 数学 化学 管理 大地测量学 色谱法 经济 地理 数学分析 政治 政治学 法学
作者
Jit Yan Lim,Kian Ming Lim,Chin Poo Lee,Yong Xuan Tan
出处
期刊:Neural Networks [Elsevier]
卷期号:165: 19-30 被引量:35
标识
DOI:10.1016/j.neunet.2023.05.037
摘要

Few-shot learning aims to train a model with a limited number of base class samples to classify the novel class samples. However, to attain generalization with a limited number of samples is not a trivial task. This paper proposed a novel few-shot learning approach named Self-supervised Contrastive Learning (SCL) that enriched the model representation with multiple self-supervision objectives. Given the base class samples, the model is trained with the base class loss. Subsequently, contrastive-based self-supervision is introduced to minimize the distance between each training sample with their augmented variants to improve the sample discrimination. To recognize the distant sample, rotation-based self-supervision is proposed to enable the model to learn to recognize the rotation degree of the samples for better sample diversity. The multitask environment is introduced where each training sample is assigned with two class labels: base class label and rotation class label. Complex augmentation is put forth to help the model learn a deeper understanding of the object. The image structure of the training samples are augmented independent of the base class information. The proposed SCL is trained to minimize the base class loss, contrastive distance loss, and rotation class loss simultaneously to learn the generic features and improve the novel class performance. With the multiple self-supervision objectives, the proposed SCL outperforms state-of-the-art few-shot approaches on few-shot image classification benchmark datasets.
最长约 10秒,即可获得该文献文件

科研通智能强力驱动
Strongly Powered by AbleSci AI
科研通是完全免费的文献互助平台,具备全网最快的应助速度,最高的求助完成率。 对每一个文献求助,科研通都将尽心尽力,给求助人一个满意的交代。
实时播报
斯文败类应助silence采纳,获得10
刚刚
1秒前
lucky发布了新的文献求助10
2秒前
科研通AI6.3应助Frank采纳,获得10
2秒前
能干穆发布了新的文献求助10
3秒前
3秒前
5秒前
5秒前
隐形曼青应助三三采纳,获得10
5秒前
ding应助小李同学采纳,获得10
5秒前
6秒前
WHTTTTT发布了新的文献求助10
6秒前
7秒前
鳗鱼初瑶关注了科研通微信公众号
8秒前
华仔应助夜夜夜采纳,获得10
9秒前
胖狗完成签到 ,获得积分10
9秒前
OrthoLee完成签到,获得积分10
9秒前
科研小强发布了新的文献求助10
9秒前
月光完成签到,获得积分10
9秒前
9秒前
9秒前
10秒前
汉堡包应助悦耳的万天采纳,获得10
11秒前
11秒前
科研完成签到,获得积分10
12秒前
12秒前
大模型应助vastom采纳,获得10
14秒前
15秒前
wfy1227发布了新的文献求助10
16秒前
不得明月发布了新的文献求助10
17秒前
maun222发布了新的文献求助10
17秒前
19秒前
20秒前
欲见完成签到 ,获得积分10
21秒前
22秒前
Q_Q完成签到,获得积分10
23秒前
25秒前
Ca完成签到,获得积分10
25秒前
陈瑞发布了新的文献求助10
25秒前
浮生梦完成签到 ,获得积分10
26秒前
高分求助中
(应助此贴封号)【重要!!请各用户(尤其是新用户)详细阅读】【科研通的精品贴汇总】 10000
Molecular Biology of Cancer: Mechanisms, Targets, and Therapeutics 3000
Les Mantodea de guyane 2500
VASCULITIS(血管炎)Rheumatic Disease Clinics (Clinics Review Articles) —— 《风湿病临床》(临床综述文章) 1000
Feldspar inclusion dating of ceramics and burnt stones 1000
What is the Future of Psychotherapy in a Digital Age? 801
The Psychological Quest for Meaning 800
热门求助领域 (近24小时)
化学 材料科学 生物 医学 工程类 计算机科学 有机化学 物理 生物化学 纳米技术 复合材料 内科学 化学工程 人工智能 催化作用 遗传学 数学 基因 量子力学 物理化学
热门帖子
关注 科研通微信公众号,转发送积分 5971712
求助须知:如何正确求助?哪些是违规求助? 7288942
关于积分的说明 15992394
捐赠科研通 5109548
什么是DOI,文献DOI怎么找? 2744066
邀请新用户注册赠送积分活动 1709783
关于科研通互助平台的介绍 1621760