首页 | 官方网站   微博 | 高级检索  
     

基于双注意力模型和迁移学习的Apex帧微表情识别
引用本文:徐玮,郑豪,杨种学.基于双注意力模型和迁移学习的Apex帧微表情识别[J].智能系统学报,2021,16(6):1015-1020.
作者姓名:徐玮  郑豪  杨种学
作者单位:1. 广西师范大学 计算机科学与工程学院/软件学院,广西 桂林 541004;2. 南京晓庄学院 信息工程学院,江苏 南京 211171
摘    要:微表情具有持续时间短、强度低的特点,其识别准确率普遍不高。针对该问题提出了一种改进的深度学习识别方法,该方法取微表情视频序列中的Apex帧,采用集成空间、通道双注意力模块的ResNet18网络,引入Focal Loss函数解决微表情数据样本不平衡的问题,并将宏表情识别领域的先验知识迁移到微表情识别领域,以提高识别效果。在CASME II微表情数据集上使用“留一交叉验证法”进行实验,结果表明本文方法相比一些现有的方法识别准确率及 ${F_1}$ 值更高。

关 键 词:微表情识别  深度学习  Apex帧  双注意力模型  ResNet18网络  Focal  Loss函数  宏表情  迁移学习

Apex frame microexpression recognition based on dual attention model and transfer learning
XU Wei,ZHENG Hao,YANG Zhongxue.Apex frame microexpression recognition based on dual attention model and transfer learning[J].CAAL Transactions on Intelligent Systems,2021,16(6):1015-1020.
Authors:XU Wei  ZHENG Hao  YANG Zhongxue
Affiliation:1. School of Computer Science and Engineering/School of Software, Guangxi Normal University, Guilin 541004, China;2. School of Information and Engineering, Nanjing Xiaozhuang University, Nanjing 211171, China
Abstract:Microexpression is of short duration and low intensity, and its recognition accuracy is generally not high. To address this problem, an improved deep learning recognition method is proposed. This method takes Apex frames in the microexpression video sequence and adopts the ResNet18 network integrating spatial and channel dual attention modules. Moreover, the method introduces the Focal Loss function to solve the imbalance of microexpression data samples and transfers the prior knowledge in the field of macroexpression recognition to the field of microexpression recognition to improve the recognition effect. Experiments were performed on the CASME II microexpression dataset using the “leave one out-cross validation” method. The results show that the method presented in this paper has a higher recognition accuracy and F1 value than other existing methods.
Keywords:microexpression recognition  deep learning  Apex frame  dual attention model  ResNet18 network  Focal Loss function  macroexpression  transfer learning
点击此处可从《智能系统学报》浏览原始摘要信息
点击此处可从《智能系统学报》下载全文
设为首页 | 免责声明 | 关于勤云 | 加入收藏

Copyright©北京勤云科技发展有限公司    京ICP备09084417号-23

京公网安备 11010802026262号