基于NSST和SWT的红外与可见光图像融合算法研究

目的鉴于非下采样剪切波变换NSST的红外与可见光图像融合的结果存在细微特征缺失问题,提出一种基于NSST和SWT的红外与可见光图像融合算法,以提升融合图像的质量。方法首先分别对红外与可见光图像进行NSST分解,各得到一个低频系数和多个不同方向、尺度的高频系数。然后低频系数分别通过SWT分解得到新的低频系数和高频系数,通过SWT分解得到的新的低频系数和高频系数分别采用采用线性加权平均法和区域平均能量取大的融合策略,融合结果再进行SWT逆变换得到低频系数融合结果。高频系数采用区域平均能量取大的融合策略进行融合。最后通过NSST逆变换得到最终的融合图像。结果通过仿真实验结果表明,文中算法与NSST,SWT和NSCT等算法相比,融合图像在主观视觉上的红外目标更突出,图像细节更清晰,且在IE, AG, QAB/F, SF和SD等评价指标上也最优。结论文中算法的融合结果能更好地表现源图像的目标信息和细节纹理信息,表明该算法具有优越性。     

Multi-focus image fusion based on the non-subsampled contourlet transform

In this paper, a new image fusion algorithm based on non-subsampled contourlet transform (NSCT) is proposed for the fusion of multi-focus images. The selection of different subband coefficients obtained by the NSCT decomposition is critical to image fusion. So, in this paper, firstly, original images are decomposed into different frequency subband coefficients by NSCT. Secondly, the selection of the low-frequency subband coefficients and the bandpass directional subband coefficients is discussed in detail. For the selection of the low-frequency subband coefficients, the non-negative matrix factorization (NMF) method is adopted. For the selection of bandpass directional subband coefficients, a regional cross-gradient method that selects the coefficients according to the minimum of the regional cross-gradient is proposed. Finally, the fused image is obtained by performing the inverse NSCT on the combined coefficients. The experimental results show that the proposed fusion algorithm can achieve significant results in getting a new image where all parts are sharp.     

一种NSCT域多聚焦图像融合新方法

针对多聚焦图像融合存在的问题,提出一种基于非下采样Contourlet变换（NSCT）的多聚焦图像融合新方法。首先,采用NSCT对多聚焦图像进行分解;然后,对低频系数采用基于改进拉普拉斯能量和（SML）的视觉特征对比度进行融合,对高频系数采用基于二维Log-Gabor能量进行融合;最后,对得到的融合系数进行重构得到融合图像。实验结果表明,无论是运用视觉的主观评价,还是基于互信息、边缘信息保留值等客观评价标准,该文所提方法都优于传统的离散小波变换、平移不变离散小波变换、NSCT等融合方法。     

Improving medical image fusion method using fuzzy entropy and nonsubsampling contourlet transform

Many types of medical images must be fused, as single‐modality medical images can only provide limited information due to the imaging principles and the complexity of human organ structures. In this paper, a multimodal medical image fusion method that combines the advantages of nonsubsampling contourlet transform (NSCT) and fuzzy entropy is proposed to provide a basis for clinical diagnosis and improve the accuracy of target recognition and the quality of fused images. An image is initially decomposed into low‐ and high‐frequency subbands through NSCT. The corresponding fusion rules are adopted in accordance with the different characteristics of the low‐ and high‐frequency components. The membership degree of low‐frequency coefficients is calculated. The fuzzy entropy is also computed and subsequently used to guide the fusion of coefficients to preserve image details. High‐frequency components are fused by maximizing the regional energy. The final fused image is obtained by inverse transformation. Experimental results show that the proposed method achieves good fusion effect based on the subjective visual effect and objective evaluation criteria. This method can also obtain high average gradient, SD, and edge preservation and effectively retain the details of the fused image. The results of the proposed algorithm can provide effective reference for doctors to assess patient condition.     

Medical image fusion based on laws of texture energy measures in stationary wavelet transform domain

Medical image fusion is widely used in various clinical procedures for the precise diagnosis of a disease. Image fusion procedures are used to assist real-time image-guided surgery. These procedures demand more accuracy and less computational complexity in modern diagnostics. Through the present work, we proposed a novel image fusion method based on stationary wavelet transform (SWT) and texture energy measures (TEMs) to address poor contrast and high-computational complexity issues of fusion outcomes. SWT extracts approximate and detail information of source images. TEMs have the capability to capture various features of the image. These are considered for fusion of approximate information. In addition, the morphological operations are used to refine the fusion process. Datasets consisting of images of seven patients suffering from neurological disorders are used in this study. Quantitative comparison of fusion results with visual information fidelity-based image fusion quality metric, ratio of spatial frequency error, edge information-based image fusion quality metric, and structural similarity index-based image fusion quality metrics proved the superiority. Also, the proposed method is superior in terms of average execution time to state-of-the-art image fusion methods. The proposed work can be extended for fusion of other imaging modalities like fusion of functional image with an anatomical image. Suitability of the fused images by the proposed method for image analysis tasks needs to be studied.     

Multifocus noisy image fusion using contourlet transform

Abstract

Image fusion is a challenging area of research with a variety of applications. The process of image fusion collects information from different sources and combines them in a single composite image. The composite fused image can better describe the scene than any of the source images. In this paper, we have proposed a method for noisy image fusion in contourlet domain. The proposed method works equally well for fusion of noise free images. Contourlet transform is a multiscale, multidirectional transform with various aspect ratios. These properties make it more suitable for image fusion than other conventional transforms. In the proposed work, the fusion algorithm is combined with a denoising algorithm to reverse the effect of noise. In the proposed method, we have used a level dependent threshold that is based on standard deviation of contourlet coefficients, mean and median of the absolute contourlet coefficients. Experimental results demonstrate that the proposed method performs well in the presence of different types of noise. Performance of the proposed method is compared with principal components analysis and sharp fusion based methods as well as other fusion methods based on variants of wavelet transform like dual tree complex wavelet transform, discrete wavelet transform, lifting wavelet transform, multiwavelet transform, stationary wavelet transform and pyramid transform using six standard quantitative quality metrics (entropy, standard deviation, edge strength, fusion factor, sharpness and peak signal to noise ratio). The combined qualitative and quantitative evaluation of the experimental results shows that the proposed method performs better than other methods.     

基于Retinex的弱可见光和红外图像融合算法

目的 针对目前弱可见光与红外图像融合后的图像仍存在细节大量丢失、目标模糊不清的问题,提出一种基于Retinex对弱可见光图像进行增强预处理后,再基于NSST和SWT变换进行图像融合的算法。方法 首先用SSR对弱可见光图像进行增强处理,增强后的可见光和红外图像进行NSST分解得到第1次的高低频系数,高频系数采用基于局部能量特征的方法进行融合;低频系数经过SWT分解得到第2次高低频系数,第2次的高频系数采用同样的方法融合,低频系数采用线性加权方法融合,然后将第2次高低频的融合结果经过SWT逆变换得到新的低频系数。最后把第1次高频系数融合结果和新的低频系数进行NSST逆变换得到融合图像。结果 通过仿真实验,将文中算法与NSST,NSCT以及文献[5]算法进行对比,结果表明主观视觉上融合图像细节更加清晰,客观评价上,平均梯度、空间频率（SF）、标准差、信息熵、边缘信息保留量等指标分别提高了35.63%,26.73%,16.89%,7.2%,4.6%。结论 文中算法对图像融合有较好的改善作用,融合图像的可视性和图像质量都得到显著提高。     

A novel multi-modal medical image fusion method based on shift-invariant shearlet transform

Abstract

Medical image fusion plays an important role in clinical applications, such as image-guided surgery, image-guided radiotherapy, non-invasive diagnosis and treatment planning. Shearlet is a novel multi-scale geometric analysis (MGA) tool proposed recently. In order to overcome the drawback of the shearlet-based fusion methods that the pseudo-Gibbs phenomenon is easily caused around the singularities of the fused image, a new multi-modal medical image fusion method is proposed in shift-invariant shearlet transform domain. First, the original images are decomposed into lowpass sub-bands and highpass sub-bands; then, the lowpass sub-bands and high sub-bands are combined according to the fusion rules, respectively. All the operations are performed in shift-invariant shearlet domain. The final fused image is obtained by directly applying inverse shift-invariant shearlet transform to the fused lowpass sub-bands and highpass sub-bands. Experimental results demonstrate that the proposed method can not only suppress the pseudo-Gibbs phenomenon efficiently, but perform better than the popular wavelet transform-based method, contourlet transform-based method and non-subsampled contourlet transform-based method.     

基于Curvelet变换的多聚焦图像融合方法

由于可见光成像系统的聚焦范围有限,很难获得同一场景内所有物体都清晰的图像.多聚焦图像融合技术可有效地解决这一问题.在分析了传统多聚焦图像融合方法和Curvelet变换的原理后,提出了一种基于Curvelet变换的多聚焦图像融合方法,先对不同聚焦图像分别进行Curvelet变换,采用低频系数取平均,高频系数取大的融合规则,再进行Curvelet反变换得到融合结果.仿真试验表明,基于Curvelet变换的融合方法可有效综合多聚焦图像,相比小波变换法,获得了更好的融合效果.     

基于多目标粒子群算法的多传感器图像融合

针对图像融合中参数优化的问题,提出了一种基于多目标粒子群优化算法的多传感器图像融合方法。首先采用非采样Contourlet变换(NSCT)对源图像进行多尺度、多方向分解;然后选取图像融合的客观评价指标为优化目标函数,采用多目标粒子群优化算法对低频系数的融合参数进行优化,带通方向子带系数采用取绝对值最大的融合规则;最后通过NSCT逆变换得到融合图像。分别对多聚焦图像融合和红外与可见光图像进行融合实验,并对融合图像进行主客观评价,实验结果表明,得到的融合图像具有较好的主观视觉效果和客观评价指标。     

基于小波系数邻域特征的CT与MR图像融合方法

提出一种基于小波变换的像素级CT,MR医学图像融合方法,利用离散小波变换分别将两幅源图像进行多尺度分解,再用不同的小波系数邻域特征指导高频分量和低频分量的小波系数的融合,低频分量采用邻域方差指导,高频分量采用邻域能量指导,最后根据融合图像的各小波系数重构融合图像.实验表明:不论从主观感受,还是采用信息熵和平均梯度两项指标作为客观定量评价标准,该方法都优于传统的融合方法,获得的融合图像有效地综合了CT与MR图像信息,能够同时清晰地显示脑部骨组织和软组织.     

Optimal multi-scale geometric fusion based on non-subsampled contourlet transform and modified central force optimization

In the current era of technological development, medical imaging plays an important part in several applications of medical diagnosis and therapy. This requires more precise images with much more details and information for correct medical diagnosis and therapy. Medical image fusion is one of the solutions for obtaining much spatial and spectral information in a single image. This article presents an optimization-based contourlet image fusion approach in addition to a comparative study for the performance of both multi-resolution and multi-scale geometric effects on fusion quality. An optimized multi-scale fusion technique based on the Non-Subsampled Contourlet Transform (NSCT) using the Modified Central Force Optimization (MCFO) and local contrast enhancement techniques is presented. The first step in the proposed fusion approach is the histogram matching of one of the images to the other to allow the same dynamic range for both images. The NSCT is used after that to decompose the images to be fused into their coefficients. The MCFO technique is used to determine the optimum decomposition level and the optimum gain parameters for the best fusion of coefficients based on certain constraints. Finally, an additional contrast enhancement process is applied on the fused image to enhance its visual quality and reinforce details. The proposed fusion framework is subjectively and objectively evaluated with different fusion quality metrics including average gradient, local contrast, standard deviation (STD), edge intensity, entropy, peak signal-to-noise ratio, Q ^ab/f, and processing time. Experimental results demonstrate that the proposed optimized NSCT medical image fusion approach based on the MCFO and histogram matching achieves a superior performance with higher image quality, average gradient, edge intensity, STD, better local contrast and entropy, a good quality factor, and much more details in images. These characteristics help for more accurate medical diagnosis in different medical applications.     

Contrast enhancement of medical images using fuzzy set theory and nonsubsampled shearlet transform

Noises and artifacts are introduced in medical images during the process of imaging and transmission, resulting in reduced definition and lack of detail. Therefore, a contrast enhancement method, based on fuzzy set theory and nonsubsampled shearlet transform (NSST), is proposed. First, the original image is decomposed into several high-frequency components and a low-frequency component by NSST. Then, the threshold method is used to remove noises in the high-frequency components. In addition, a linear stretch is used to improve the overall contrast in the low-frequency component. Then, the reconstruct image is reconstructed by applying the inverse NSST to the processed high-frequency and low-frequency components. Finally, the fuzzy contrast is used to improve the detail information and global contrast in the reconstruct image. Experimental results indicate that, relative to contrast algorithms, the peak signal-to-noise ratio of the proposed method is improved by approximately 18%, and the root mean square error (RMSE) is optimized to approximately 48%. The proposed method also improves the image definition and texture information. Moreover, when compared with the Improved Fuzzy Contrast Combined Adaptive Threshold in NSCT for Medical Image Enhancement, the processing time (time) of this proposed method optimizes about 86%, which can obviously improve the computational efficiency of this method.     

Medical image enhancement algorithm based on NSCT and the improved fuzzy contrast

In order to solve the problem of noise amplification, low contrast and image distortion in the process of medical image enhancement, a new algorithm is proposed which combines NSCT (nonsubsampled contourlet transform) and improved fuzzy contrast. The image is decomposed by NSCT. Firstly, linear enhancement method is used in low frequency coefficients; secondly the improved adaptive threshold function is used to deal with the high frequency coefficients. Finally, the improved fuzzy contrast is used to enhance the global contrast and the Laplace operator is used to enhance the details of the medical images. Experimental results show that the proposed algorithm can improve the image visual effects, remove the noise and enhance the details of medical images. © 2015 Wiley Periodicals, Inc. Int J Imaging Syst Technol, 25, 7–14, 2015     

基于边缘检测的邻域加窗图像去噪算法

针对目前图像去噪算法中,消除噪声的同时又破坏边缘细节信息的问题,本文提出了结合边缘检测及邻域加窗的新算法.该算法采取平稳小波基以保持相位不变性,对低频和高频子带进行边缘检测,并将检测后的边缘信息选择后融合,即可得到原图像近似的边缘信息.依据小波方向性特点和层内相关性原理,对不同的子带在非边缘信息处采用不同的模板进行加窗处理.实验结果表明,该方法在降低了图像噪声的同时又尽可能地保留了图像的细节,较好地复原了图像.     

无下采样轮廓波变换纹理图像检索系统

针对基本轮廓波变换纹理检索系统检索率较低的问题,提出了一种无下采样轮廓波变换(NSCT)纹理图像检索系统.该系统采用的轮廓波变换由无下采样拉普拉斯金字塔级联无下采样方向滤波器构成,特征向量采用子带系数的能量和标准偏差连接而成;以Canberra距离为相似度度量标准.比较了基于同样架构的基本轮廓波变换和NSCT纹理检索系统的性能.实验结果表明:在特征向量长度,检索时间、所需存储空间基本相同的情况下,NSCT检索系统比基本轮廓波变换检索系统具有更高的检索率;NSCT分解结构参数以及图像类型对于平均检索率也有较大的影响.     

Image fusion based on wavelet transform and gray-level features

Image fusion makes the fused image more reliable and intelligible, and more suitable for human vision and computer detection, classification, recognition and understanding. This paper proposes a pixel-level image fusion method for merging two source images of the same scene using wavelet transform and gray-level features (GLF). First, a three-level discrete two-dimensional wavelet transform is used to decompose the two source images into low-frequency image components and horizontal, vertical, and diagonal high-frequency components. Then, the spatial frequency correlation coefficient is used to determine the pixel fusion rule to apply to each of the low-frequency images, and the correlation coefficient of the GLF is used to determine the pixel fusion rule to apply to each of the high-frequency images. Finally, the fused image is reconstructed using inverse wavelet transform. The results of the experiments conducted indicate that the proposed method is more effective than relevant conventional methods.     

一种基于Directionlet变换的图像融合算法

为了提高图像融合效果,提出了一种基于Directionlet变换的图像融合算法.首先对已配准的待融合源图像由给定的生成矩阵分别进行陪集分解,得到每个陪集对应的子图;接着将每两个子图相减,得到源图像的高频和低频分量,其中边缘、纹理等奇异特征包含在高频分量中;然后对低频分量采用直接平均融合的方法进行系数选择,对高频分量选择子区域边缘信息较强的系数;最后,通过Directionlet陪集分解的反变换,得到融合后的图像.多聚焦图像融合实验表明,在主观视觉上,该算法明显更好地融合了边缘等图像特征,从而较好地保持了左右聚焦图像各自的细节信息;在客观评价上,通过熵、平均梯度、标准差和互信息量等性能参数比较,该方法也优于小波变换和其他的融合方法.     

基于特征能量加权的红外与可见光图像融合

目前红外与可见光图像直接融合存在红外目标取舍和场景信息提取困难,结合非采样Contourlet的多尺度、多方向性和平移不变性的优点,本文提出了一种基于非采样Contourlet变换(NSCT)的红外与可见光图像融合方法.首先对源图像进行分解,然后低频子带通过构造基于区域的特征像素能量,进行加权融合,高频子带直接选用方差取大法融合.使用该算法进行了融合实验,并给出了融合质量评价.实验结果表明,本文提出的基于NSCT的图像融合算法在保留图像细节信息、增加信息量方面都有显著地提高.     

一种基于小波变换的多聚焦图像融合方法

提出了一种基于低频系数局部区域梯度信息的多分辨率图像融合方法。根据局部梯度信息对源图像的小波低频系数进行选择,获取融合图像的对应低频系数。依照平均误差、峰值信噪比、均方根误差以及偏差度、熵等评价标准,将该方法的多聚焦图像融合效果与其他三种常用低频系数融合方法的效果进行了比较。实验结果表明,该方法获得的大部分评价指标都优于其他三种方法,且其最佳小波分解层数为2层,而其他三种方法的最佳小波分解层数为5层。最佳小波分解层数越少,图像融合的计算量越小。该方法在减少计算量的同时,提高了融合质量。