首页 | 官方网站   微博 | 高级检索  
     

基于特征融合的双模态低辨识度目标识别
引用本文:吴愿,薛培林,殷国栋,黄文涵,耿可可,邹伟. 基于特征融合的双模态低辨识度目标识别[J]. 中国机械工程, 2021, 32(10): 1205-1212,1221. DOI: 10.3969/j.issn.1004-132X.2021.10.009
作者姓名:吴愿  薛培林  殷国栋  黄文涵  耿可可  邹伟
作者单位:东南大学机械工程学院,南京,211189
基金项目:国家重点研发计划(2016YFD0700905);国家自然科学基金(51975118,U1664258);江苏省重点研发计划(BE2019004-2)
摘    要:针对单一彩色相机对低辨识度目标识别准确率低的问题,提出了一种利用彩色相机和红外热成像仪同时检测自动驾驶目标的方案.为了同时提取彩色图像的颜色特征与红外图像的温度特征,在单模态YOLOv3网络基础上改进网络结构得到双模态YOLOv3神经网络,并设计四种特征融合对比实验以确定最佳融合方案;建立双模态数据集同步采集系统,采集...

关 键 词:低辨识度目标识别  双模态YOLOv3神经网络  双模态数据集  特征融合

Low-identification Dual Target Recognition Based on Feature Fusion
WU Yuan,XUE Peilin,YIN Guodong,HUANG Wenhan,GENG Keke,ZOU Wei. Low-identification Dual Target Recognition Based on Feature Fusion[J]. China Mechanical Engineering, 2021, 32(10): 1205-1212,1221. DOI: 10.3969/j.issn.1004-132X.2021.10.009
Authors:WU Yuan  XUE Peilin  YIN Guodong  HUANG Wenhan  GENG Keke  ZOU Wei
Affiliation:School of Mechanical Engineering,Southeast University,Nanjing,211189
Abstract:Aiming at the problems of low accuracy of low-identification target recognition by a single color camera, a scheme for simultaneously detecting an autonomous driving target was proposed by using a RGB camera and an infrared camera. In order to simultaneously extract the color characteristics of the color images and the temperature characteristics of the infrared images, the network structure was improved on the basis of YOLOv3 network to obtain a dual YOLOv3 neural network, and four feature fusion comparison experiments were designed to determine the optimal fusion scheme. A dual data set synchronous acquisition system was established, which collected color and infrared images for training and testing of the dual network. The validation set without network training was used to obtain four dual feature fusion models of average value and loss value. Experimental results show that the average accuracy of the dual-modal network model may reach 59.42% after 30 trainings.
Keywords:low-identification target recognition   dual YOLOv3 neural network   dual data set   feature fusion  
本文献已被 CNKI 等数据库收录!
点击此处可从《中国机械工程》浏览原始摘要信息
点击此处可从《中国机械工程》下载免费的PDF全文
设为首页 | 免责声明 | 关于勤云 | 加入收藏

Copyright©北京勤云科技发展有限公司    京ICP备09084417号-23

京公网安备 11010802026262号