| 基于变换域VGGNet19的红外与可见光图像融合 |
| |
| 引用本文： | 李永萍,杨艳春,党建武,王阳萍.基于变换域VGGNet19的红外与可见光图像融合[J].红外技术,2022,44(12):1293-1300. |
| |
| 作者姓名： | 李永萍 杨艳春 党建武 王阳萍 |
| |
| 作者单位： | 兰州交通大学 电子与信息工程学院, 甘肃 兰州 730070 |
| |
| 基金项目： | 长江学者和创新团队发展计划资助IRT_16R36国家自然科学基金62067006甘肃省科技计划项目18JR3RA104甘肃省高等学校产业支撑计划项目2020C-19兰州市科技计划项目2019-4-49甘肃省教育厅:青年博士基金项目2022QB-067甘肃省自然科学基金21JR7RA300兰州交通大学天佑创新团队TY202003兰州交通大学-天津大学联合创新基金项目2021052 |
| |
| 摘 要： | 针对红外与可见光图像融合中出现细节信息丢失及边缘模糊的问题，提出一种在变换域中通过VGGNet19网络的红外与可见光图像融合方法。首先，为了使得源图像在分解过程中提取到精度更高的基础与细节信息，将源图像利用具有保边平滑功能的多尺度引导滤波器进行分解，分解为一个基础层与多个细节层；然后，采用具有保留主要能量信息特点的拉普拉斯能量对基础层进行融合得到基础融合图；其次，为了防止融合结果丢失一些细节边缘信息，采用VGGNet19网络对细节层进行特征提取，L1正则化、上采样以及最终的加权平均策略得到融合后的细节部分；最后，通过两种融合图的相加即可得最终的融合结果。实验结果表明，本文方法更好地提取了源图像中的边缘及细节信息，在主观评价以及客观评价指标中均取得了更好的效果。
|
| 关 键 词： | 图像融合 引导滤波 VGGNet19 拉普拉斯能量 红外与可见光图像 |
| 收稿时间： | 2022-01-15 |
Infrared and Visible Image Fusion Based on Transform Domain VGGNet19 |
| |
| Affiliation: | School of Electronic and Information Engineering, Lanzhou Jiaotong University, Lanzhou 730070, China |
| |
| Abstract: | To address the problems of loss of detailed information and blurred edges in the fusion of infrared and visible images, an infrared and visible image fusion method through the VGGNet19 network in the transform domain is proposed. Firstly, in order to extract more accurate basic and detailed data from the source images during the decomposition process, the source images are decomposed using a multi-scale guided filter with edge-preserving smoothing function into a base layer and multiple detailed layers. Then, the Laplacian energy with the characteristics of retaining the main energy information is used to fuse the basic layer to obtain the basic fusion map. Subsequently, to prevent the fusion result from losing some detailed edge information, the VGGNet19 network is used to extract the features of the detail layers, L1 regularization, upsampling and final weighted average, thus the fused detail. Finally, the final fusion is obtained by adding two fusion graphs. The experimental results show that the method proposed can better extract the edge and detailed information in the source images, and achieve better results in terms of both subjective and objective evaluation indicators. |
| |
| Keywords: | |
|
| 点击此处可从《红外技术》浏览原始摘要信息 |
|
点击此处可从《红外技术》下载全文 |
|
