亲爱的研友该休息了!由于当前在线用户较少,发布求助请尽量完整的填写文献信息,科研通机器人24小时在线,伴您度过漫漫科研夜!身体可是革命的本钱,早点休息,好梦!

In search of a robust facial expressions recognition model: A large-scale visual cross-corpus study

一般化 计算机科学 人工智能 领域(数学分析) 模式识别(心理学) 语音识别 面部表情 自然语言处理 机器学习 数学 数学分析
作者
Elena Ryumina,Denis Dresvyanskiy,Alexey Karpov
出处
期刊:Neurocomputing [Elsevier]
卷期号:514: 435-450 被引量:43
标识
DOI:10.1016/j.neucom.2022.10.013
摘要

Many researchers have been seeking robust emotion recognition system for already last two decades. It would advance computer systems to a new level of interaction, providing much more natural feedback during human-computer interaction due to analysis of user affect state. However, one of the key problems in this domain is a lack of generalization ability: we observe dramatic degradation of model performance when it was trained on one corpus and evaluated on another one. Although some studies were done in this direction, visual modality still remains under-investigated. Therefore, we introduce the visual cross-corpus study conducted with the utilization of eight corpora, which differ in recording conditions, participants’ appearance characteristics, and complexity of data processing. We propose a visual-based end-to-end emotion recognition framework, which consists of the robust pre-trained backbone model and temporal sub-system in order to model temporal dependencies across many video frames. In addition, a detailed analysis of mistakes and advantages of the backbone model is provided, demonstrating its high ability of generalization. Our results show that the backbone model has achieved the accuracy of 66.4% on the AffectNet dataset, outperforming all the state-of-the-art results. Moreover, the CNN-LSTM model has demonstrated a decent efficacy on dynamic visual datasets during cross-corpus experiments, achieving comparable with state-of-the-art results. In addition, we provide backbone and CNN-LSTM models for future researchers: they can be accessed via GitHub.
最长约 10秒,即可获得该文献文件

科研通智能强力驱动
Strongly Powered by AbleSci AI
科研通是完全免费的文献互助平台,具备全网最快的应助速度,最高的求助完成率。 对每一个文献求助,科研通都将尽心尽力,给求助人一个满意的交代。
实时播报
3秒前
6秒前
7秒前
万能图书馆应助KLAB采纳,获得10
8秒前
KLAB完成签到,获得积分10
19秒前
去码头整点薯条完成签到,获得积分10
21秒前
27秒前
yanzinie完成签到,获得积分10
28秒前
努力乘凉发布了新的文献求助10
29秒前
anqi6688发布了新的文献求助10
30秒前
36秒前
41秒前
yanzinie发布了新的文献求助10
41秒前
DD完成签到 ,获得积分0
44秒前
科研通AI2S应助科研通管家采纳,获得10
48秒前
53秒前
柚子茶完成签到 ,获得积分10
55秒前
哈哈哈完成签到,获得积分10
56秒前
科研通AI2S应助nihao采纳,获得10
57秒前
酷波er应助yanzinie采纳,获得10
1分钟前
1分钟前
1分钟前
1分钟前
nihao发布了新的文献求助10
1分钟前
许之北完成签到 ,获得积分10
1分钟前
nihao完成签到,获得积分20
1分钟前
1分钟前
1分钟前
zqq完成签到,获得积分0
1分钟前
baolong完成签到,获得积分10
1分钟前
2分钟前
2分钟前
司空起眸完成签到,获得积分10
2分钟前
司空起眸发布了新的文献求助10
2分钟前
CC完成签到,获得积分10
2分钟前
2分钟前
风语村应助迷人紫寒采纳,获得10
2分钟前
2分钟前
2分钟前
2分钟前
高分求助中
Continuum Thermodynamics and Material Modelling 3000
Production Logging: Theoretical and Interpretive Elements 2700
Les Mantodea de Guyane Insecta, Polyneoptera 1000
Structural Load Modelling and Combination for Performance and Safety Evaluation 1000
Conference Record, IAS Annual Meeting 1977 820
電気学会論文誌D(産業応用部門誌), 141 巻, 11 号 510
Typology of Conditional Constructions 500
热门求助领域 (近24小时)
化学 材料科学 生物 医学 工程类 有机化学 生物化学 物理 纳米技术 计算机科学 内科学 化学工程 复合材料 基因 遗传学 物理化学 催化作用 量子力学 光电子学 冶金
热门帖子
关注 科研通微信公众号,转发送积分 3571183
求助须知:如何正确求助?哪些是违规求助? 3141842
关于积分的说明 9444594
捐赠科研通 2843250
什么是DOI,文献DOI怎么找? 1562777
邀请新用户注册赠送积分活动 731243
科研通“疑难数据库(出版商)”最低求助积分说明 718487