计算机科学
注释
面部表情
任务(项目管理)
人工智能
表达式(计算机科学)
模式
钥匙(锁)
面部表情识别
感觉
情感计算
情报检索
自然语言处理
机器学习
模式识别(心理学)
面部识别系统
心理学
管理
程序设计语言
经济
社会学
社会心理学
计算机安全
社会科学
作者
Xiaobai Li,Shiyang Cheng,Yante Li,Muzammil Behzad,Jie Shen,Stefanos Zafeiriou,Maja Pantić,Guoying Zhao
出处
期刊:IEEE Transactions on Affective Computing
[Institute of Electrical and Electronics Engineers]
日期:2023-10-01
卷期号:14 (4): 3031-3047
被引量:23
标识
DOI:10.1109/taffc.2022.3182342
摘要
Micro-expressions (ME) are a special form of facial expressions which may occur when people try to hide their true feelings for some reasons.MEs are important clues to reveal people's true feelings, but are difficult or impossible to be captured by ordinary persons with naked-eyes as they are very short and subtle.It is expected that robust computer vision methods can be developed to automatically analyze MEs which requires lots of ME data.The current ME datasets are insufficient, and mostly contain only one single form of 2D color videos.Researches on 4D data of ordinary facial expressions have prospered, but so far no 4D data is available in ME study.In the current study, we introduce the 4DME dataset: a new spontaneous ME dataset which includes 4D data along with three other video modalities.Both micro-and macro-expression clips are labeled out in 4DME, and 22 AU labels and five categories of emotion labels are annotated.Experiments are carried out using three 2D-based methods and one 4D-based method to provide baseline results.The results indicate that the 4D data can potentially benefit ME recognition.The 4DME dataset could be used for developing 4D-based approaches, or exploring fusion of multiple video sources (e.g., texture and depth) for the task of ME analysis in future.Besides, we also emphasize the importance of forming a clear and unified criteria of ME annotation for future ME data collection studies.Several key questions related with ME annotation are listed and discussed in depth, especially about the relationship between AUs and ME emotion categories.A preliminary AU-Emo mapping table is proposed with justified explanations and supportive experimental results.Several unsolved issues are also summarized for future work.
科研通智能强力驱动
Strongly Powered by AbleSci AI