| 基于特征融合的双模态低辨识度目标识别 |
| |
| 引用本文： | 吴愿,薛培林,殷国栋,黄文涵,耿可可,邹伟.基于特征融合的双模态低辨识度目标识别[J].中国机械工程,2021,32(10):1205. |
| |
| 作者姓名： | 吴愿 薛培林 殷国栋 黄文涵 耿可可 邹伟 |
| |
| 作者单位： | 东南大学机械工程学院，南京，211189 |
| |
| 基金项目： | 国家重点研发计划(2016YFD0700905)；
国家自然科学基金(51975118，U1664258)；
江苏省重点研发计划(BE2019004-2) |
| |
| 摘 要： | 针对单一彩色相机对低辨识度目标识别准确率低的问题，提出了一种利用彩色相机和红外热成像仪同时检测自动驾驶目标的方案。为了同时提取彩色图像的颜色特征与红外图像的温度特征，在单模态YOLOv3网络基础上改进网络结构得到双模态YOLOv3神经网络，并设计四种特征融合对比实验以确定最佳融合方案;建立双模态数据集同步采集系统，采集彩色图像与红外图像对并用于双模态网络的训练与测试；使用未经网络训练的验证集得到4种双模态特征融合模型的平均精度值与损失值。实验结果表明，在训练30次后，该双模态网络模型的平均精度值最高可达59.42%。
|
| 关 键 词： | 低辨识度目标识别 双模态YOLOv3神经网络 双模态数据集 特征融合 |
Low-identification Dual Target Recognition Based on Feature Fusion |
| |
| WU Yuan,XUE Peilin,YIN Guodong,HUANG Wenhan,GENG Keke,ZOU Wei.Low-identification Dual Target Recognition Based on Feature Fusion[J].China Mechanical Engineering,2021,32(10):1205. |
| |
| Authors: | WU Yuan XUE Peilin YIN Guodong HUANG Wenhan GENG Keke ZOU Wei |
| |
| Affiliation: | School of Mechanical Engineering,Southeast University,Nanjing,211189 |
| |
| Abstract: | Aiming at the problems of low accuracy of low-identification target recognition by a single color camera, a scheme for simultaneously detecting an autonomous driving target was proposed by using a RGB camera and an infrared camera. In order to simultaneously extract the color characteristics of the color images and the temperature characteristics of the infrared images, the network structure was improved on the basis of YOLOv3 network to obtain a dual YOLOv3 neural network, and four feature fusion comparison experiments were designed to determine the optimal fusion scheme. A dual data set synchronous acquisition system was established, which collected color and infrared images for training and testing of the dual network. The validation set without network training was used to obtain four dual feature fusion models of average value and loss value. Experimental results show that the average accuracy of the dual-modal network model may reach 59.42% after 30 trainings. |
| |
| Keywords: | low-identification target recognition dual YOLOv3 neural network dual data set feature fusion |
| 本文献已被 CNKI 等数据库收录！ |
| 点击此处可从《中国机械工程》浏览原始摘要信息 |
|
点击此处可从《中国机械工程》下载全文 |
