| 基于浅三维稠密网的多模态手势识别算法 |
| |
| 引用本文： | 邓智方,袁家政,刘宏哲,原春锋,张宏源.基于浅三维稠密网的多模态手势识别算法[J].计算机工程与应用,2019,55(19):166-172. |
| |
| 作者姓名： | 邓智方 袁家政 刘宏哲 原春锋 张宏源 |
| |
| 作者单位： | 北京联合大学 北京市信息服务工程重点实验室,北京,100101;北京开放大学 科学研究处,北京,100081;中国科学院 自动化研究所 模式识别重点实验室,北京,100190 |
| |
| 基金项目： | 国家自然科学基金;国家自然科学基金;国家自然科学基金;北京成像技术高精尖创新中心高精尖项目;北京市属高水平教师队伍建设支持计划项目;国家科技支撑计划;研究生项目 |
| |
| 摘 要： | 手势识别旨在理解人体的动态手势，是人机交互领域极其重要的交互方式之一。该方法通过将二维稠密网扩展为三维稠密网，并加入Inception结构，提出了一种基于浅三维稠密网的多模态手势识别方法，将其命名为Spatial Temporal 3D（ST3D） dense network。所提出的方法在手势识别公开数据集大规模离散手势数据集（IsoGD）上进行了评估，并取得了目前最好效果。实验证明，所提方法能够有效地学习到视频样本中手势的短期、中期以及长期时空特征。
|
| 关 键 词： | ST3D方法 Inception结构 多模态 手势识别 |
Multimodal Gesture Recognition Algorithm Based on Shallow 3D Dense Networks |
| |
| DENG Zhifang,YUAN Jiazheng,LIU Hongzhe,YUAN Chunfeng,ZHANG Hongyuan.Multimodal Gesture Recognition Algorithm Based on Shallow 3D Dense Networks[J].Computer Engineering and Applications,2019,55(19):166-172. |
| |
| Authors: | DENG Zhifang YUAN Jiazheng LIU Hongzhe YUAN Chunfeng ZHANG Hongyuan |
| |
| Affiliation: | 1.Beijing Key Laboratory of Information Service Engineering, Beijing Union University, Beijing 100101, China
2.Office of Academic Research, Beijing Open University, Beijing 100081, China
3.National Laboratory of Pattern Recognition, Institute of Automation, Chinese Academy of Sciences, Beijing 100190, China |
| |
| Abstract: | Gesture recognition aims at understanding dynamic gestures of the human body, and is one of the most important ways of human-computer interaction. A multimodal gesture recognition method based on a shallow 3D dense network is proposed by extending the two-dimensional dense network into a 3D dense network and adding the Inception structure, which is named Spatial Temporal 3D（ST3D） dense network. The proposed method is evaluated on the Charlearn LAP large-scale Isolated Gesture Dataset（IsoGD）and achieves the best results. Experimental results show that the proposed method can effectively learn short, mid and long term spatiotemporal features of gestures in video samples. |
| |
| Keywords: | Spatial Temporal 3D（ST3D） dense network Inception structure multimodal gesture recognition |
| 本文献已被 万方数据 等数据库收录！ |
| 点击此处可从《计算机工程与应用》浏览原始摘要信息 |
|
点击此处可从《计算机工程与应用》下载全文 |
|
