定位
计算机科学
计算机视觉
偏移量(计算机科学)
光流
表达式(计算机科学)
光学滤波器
面部表情
滤波器(信号处理)
人工智能
光学
物理
程序设计语言
图像(数学)
作者
Jun Yu,Zhongpeng Cai,Zepeng Liu,Guochen Xie,Peng He
标识
DOI:10.1145/3503161.3551608
摘要
The purpose of micro expression (ME) and macro expression (MaE) spotting task is to locate the onset and offset frames of MaE and ME clips. Compared with MaEs, MEs are shorter in duration and lower in intensity, which makes MEs harder to be spotted. In this paper, we propose an efficient pipeline based on optical flow features to spot MEs and MaEs. We crop and align the faces and select the eyebrows area, nose area, and mouth area as our regions of interest to exclude the interference of extraneous factors on the face expression representation. Then, we extract the optical flow in these regions and enhance the features of the expressions in the optical flow with low-pass filter and EMD method. Finally, the sliding window method is used to locate the peaks of optical flow features and get the intervals containing MEs or MaEs. We evaluate the performance of our method on the MEGC2022-TestSet including 10 long videos from SAMM and CAS(ME)3 and achieve the first place in the MEGC2022 Challenge. The results prove the effectiveness of our method.
科研通智能强力驱动
Strongly Powered by AbleSci AI