基于进化策略和IHS变换的图像融合方法

IHS变换法对多光谱图像和高分辨图像进行融合会丢失较多的光谱信息,本文利用进化策略来求解IHS变换法中光谱强度分量的最佳变换问题,经过变换后的光谱强度分量与多光谱图像的光谱强度分量和高分辨图像都具有较强的相关性,经过IHS反变换后可以得到同时具有较好的空间分辨率和光谱信息的融合图像.实验结果表明,该方法得到的融合图像优于传统的IHS变换法和小波变换方法.     

Generalized IHS‐Based Satellite Imagery Fusion Using Spectral Response Functions

Image fusion is a technical method to integrate the spatial details of the high‐resolution panchromatic (HRP) image and the spectral information of low‐resolution multispectral (LRM) images to produce high‐resolution multispectral images. The most important point in image fusion is enhancing the spatial details of the HRP image and simultaneously maintaining the spectral information of the LRM images. This implies that the physical characteristics of a satellite sensor should be considered in the fusion process. Also, to fuse massive satellite images, the fusion method should have low computation costs. In this paper, we propose a fast and efficient satellite image fusion method. The proposed method uses the spectral response functions of a satellite sensor; thus, it rationally reflects the physical characteristics of the satellite sensor to the fused image. As a result, the proposed method provides high‐quality fused images in terms of spectral and spatial evaluations. The experimental results of IKONOS images indicate that the proposed method outperforms the intensity‐hue‐saturation and wavelet‐based methods.     

自适应字典学习的卷积稀疏表示遥感图像融合

基于细节注入方案的遥感图像融合主要包括两个步骤:空间细节提取与注入。为保证被提取细节的质量与确定合适的调制系数,本文提出一种基于自适应字典学习的卷积稀疏表示遥感图像融合方法。该方法先利用引导滤波和非抽取小波变换来分别获取全色图像和多光谱图像的空间细节;然后自适应地学习提取空间细节的字典,并将其引入卷积稀疏表示模型来重构联合细节图像;最后,将联合细节通过联合判别调制系数注入到上采样的多光谱图像中得到最终融合结果。实验结果表明,本文方法的融合结果无论从主观效果还是客观定量评价,都优于一些主流的遥感图像融合方法。      

Estimation of the Number of Decomposition Levels for a Wavelet-Based Multiresolution Multisensor Image Fusion

The wavelet-based scheme for the fusion of multispectral (MS) and panchromatic (PAN) imagery has become quite popular due to its ability to preserve the spectral fidelity of the MS imagery while improving its spatial quality. This is important if the resultant imagery is used for automatic classification. Wavelet-based fusion results depend on the number of decomposition levels applied in the wavelet transform. Too few decomposition levels result in poor spatial quality fused images. On the other hand, too many levels reduce the spectral similarity between the original MS and the pan-sharpened images. If the shift-invariant wavelet transform is applied, each excessive decomposition level results in a large computational penalty. Thus, the choice of the number of decomposition levels is significant. In this paper, PAN and MS image pairs with different resolution ratios were fused using the shift-invariant wavelet transform, and the optimal decomposition levels were determined for each resolution ratio. In general, it can be said that the fusion of images with larger resolution ratios requires a higher number of decomposition levels. This paper provides the practitioner an understanding of the tradeoffs associated with the computational demand and the spatial and spectral quality of the wavelet-based fusion algorithm as a function of the number of decomposition levels     

一种超高分辨率遥感图像融合新算法

该文针对超高分辨率的全色光图像和多光谱图像的融合,提出了一种基于对应分析的图像融合新算法。该算法在对多光谱数据进行对应分析的基础上,利用冗余小波变换提取出全色光图像的空间细节信息并将其融入到成分空间。实验分别采用IKONOS和QuickBird数据,融合结果的目视效果与客观评价表明,相比现有同类融合方法,该方法能够在提高空间分辨率的同时更好地保持光谱特性,有效地减少了色彩失真的现象。     

Fusion of multispectral and panchromatic images using improved IHS and PCA mergers based on wavelet decomposition

Since Chavez proposed the highpass filtering procedure to fuse multispectral and panchromatic images, several fusion methods have been developed based on the same principle: to extract from the panchromatic image spatial detail information to later inject it into the multispectral one. In this paper, we present new fusion alternatives based on the same concept, using the multiresolution wavelet decomposition to execute the detail extraction phase and the intensity-hue-saturation (IHS) and principal component analysis (PCA) procedures to inject the spatial detail of the panchromatic image into the multispectral one. The multiresolution wavelet decomposition has been performed using both decimated and undecimated algorithms and the resulting merged images compared both spectral and spatially. These fusion methods, as well as standard IHS-, PCA-, and wavelet-based methods have been used to merge Systeme Pour l'Observation de la Terre (SPOT) 4 XI and SPOT 4 M images with a ratio 4:1. We have estimated the validity of each fusion method by analyzing, visually and quantitatively, the quality of the resulting fused images. The methodological approaches proposed in this paper result in merged images with improved quality with respect to those obtained by standard IHS, PCA, and standard wavelet-based fusion methods. For both proposed fusion methods, better results are obtained when an undecimated algorithm is used to perform the multiresolution wavelet decomposition.     

Introduction of sensor spectral response into image fusion methods. Application to wavelet-based methods

Usual image fusion methods inject features from a high spatial resolution panchromatic sensor into every low spatial resolution multispectral band trying to preserve spectral signatures and improve spatial resolution to that of the panchromatic sensor. The objective is to obtain the image that would be observed by a sensor with the same spectral response (i.e., spectral sensitivity and quantum efficiency) as the multispectral sensors and the spatial resolution of the panchromatic sensor. But in these methods, features from electromagnetic spectrum regions not covered by multispectral sensors are injected into them, and physical spectral responses of the sensors are not considered during this process. This produces some undesirable effects, such as resolution overinjection images and slightly modified spectral signatures in some features. The authors present a technique which takes into account the physical electromagnetic spectrum responses of sensors during the fusion process, which produces images closer to the image obtained by the ideal sensor than those obtained by usual wavelet-based image fusion methods. This technique is used to define a new wavelet-based image fusion method.     

一种基于非采样Contourlet变换的遥感图像融合算法

为使融合后的多光谱图像尽可能保持原多光谱图像光谱特性的同时提高空间质量,提出了一种基于非采样Contourlet变换（NSCT）和多尺度边缘检测的融合算法。介绍了非采样Contourlet变换和多尺度边缘检测;设计了基于多尺度边缘检测、直接替代的高频、低频子带融合规则;用QuickBird卫星高分辨率遥感图像进行仿真实验。实验结果表明该算法能够在保持光谱信息的同时注入更丰富的空间细节信息,优于传统的Wavelet变换法和Contourlet变换法。     

基于采样二通道不可分小波的多光谱图像融合

针对基于非下采样不可分小波图像融合方法空间分辨率不高、基于张量积小波融合方法会出现方块效应的不足,提出了一种基于伸缩矩阵为[1,1;1,-1]的二通道采样不可分小波的多光谱图像和全色图像融合方法.利用矩阵扩充方法,构造了一组新的不可分低通滤波器和高通滤波器组,利用所设计滤波器组分别对多光谱图像的亮度分量和全色图像作下采样的多尺度不可分小波分解,分别对分解后的低频子图像和高频子图像按不同的融合规则进行融合.实验结果表明,其保持光谱信息的能力和保持空间分辨率信息的能力比基于IHS变换融合方法、基于DWT的融合方法、基于IHS-DWT的融合方法、基于IHS-Contourlet变换的融合方法、基于IHS-Curvelet变换的融合方法、SRF方法都强,与基于非下采样的二通道不可分正交小波和不可分双正交小波融合方法相比,该方法能保持较好的整体光谱信息和较高的空间分辨率信息.     

基于小波变换的加权图像融合方法

提出了一种基于小波变换的多光谱图像与高空间分辨率图像融合方法。该方法通过局部方差准则利用加权平均将高空间分辨率图像和多光谱图像经小波分解的低频分量进行融合,然后将融合的低频分量和高空间分辨率图像的细节分量结合进行小波反演变换得到融合图像。通过和WT方法的融合结果进行对比评价,表明了该方法在提高多光谱图像的空间细节表现能力和保持光谱信息上都有很好的效果。     

Context-driven fusion of high spatial and spectral resolution images based on oversampled multiresolution analysis

This paper compares two general and formal solutions to the problem of fusion of multispectral images with high-resolution panchromatic observations. The former exploits the undecimated discrete wavelet transform, which is an octave bandpass representation achieved from a conventional discrete wavelet transform by omitting all decimators and upsampling the wavelet filter bank. The latter relies on the generalized Laplacian pyramid, which is another oversampled structure obtained by recursively subtracting from an image an expanded decimated lowpass version. Both the methods selectively perform spatial-frequencies spectrum substitution from an image to another. In both schemes, context dependency is exploited by thresholding the local correlation coefficient between the images to be merged, to avoid injection of spatial details that are not likely to occur in the target image. Unlike other multiscale fusion schemes, both the present decompositions are not critically subsampled, thus avoiding possible impairments in the fused images, due to missing cancellation of aliasing terms. Results are presented and discussed on SPOT data.     

基于联合卷积分析与合成稀疏表示的遥感图像分量替换融合方法

针对遥感图像融合中传统分量替换方法光谱失真严重问题,提出了一种基于联合卷积分析与合成稀疏表示的改进分量替换融合方法.与传统分量替换方法不同,该方法旨在改进融合过程中空间细节信息提取和注入策略,以生成具有更高光谱与空间质量的遥感图像.首先利用联合卷积分析与合成稀疏表示算法分别对强度分量和直方图匹配后的全色图像进行分解,获...     

Estimating the probability of the presence of a signal of interest in multiresolution single- and multiband image denoising.

We develop three novel wavelet domain denoising methods for subband-adaptive, spatially-adaptive and multivalued image denoising. The core of our approach is the estimation of the probability that a given coefficient contains a significant noise-free component, which we call "signal of interest." In this respect, we analyze cases where the probability of signal presence is 1) fixed per subband, 2) conditioned on a local spatial context, and 3) conditioned on information from multiple image bands. All the probabilities are estimated assuming a generalized Laplacian prior for noise-free subband data and additive white Gaussian noise. The results demonstrate that the new subband-adaptive shrinkage function outperforms Bayesian thresholding approaches in terms of mean-squared error. The spatially adaptive version of the proposed method yields better results than the existing spatially adaptive ones of similar and higher complexity. The performance on color and on multispectral images is superior with respect to recent multiband wavelet thresholding.     

基于非下采样三通道不可分对称小波的多光谱图像融合

针对IHS变换融合方法不能保持好的光谱信息,张量积小波变换融合方法生成的融合结果图像空间分辨率偏低、且易产生方块效应等不足.提出了一种基于三通道不可分对称小波的多光谱图像融合方法.利用矩阵扩充的方法,给出了三通道不可分对称小波滤波器组的构造方法,用所构造的不可分小波滤波器组分别对多光谱图像的亮度分量和全色图像作非下采样...     

基于NSCT的多光谱和全色图像的融合

提出了一种基于无下采样Contourlet变换的多光谱和全色图像的融合方法.该方法在对多光谱影像进行IHS变换的基础上,对多光谱的I分量和高分辨率的全色影像分别进行无下采样Contourlet变换(NSCT),然后对分解得到的近似分量以及各层金字塔各方向的细节分量利用本文提出的一定的融合准则分别对近似分量和细节分量进行影像融合,最后通过无下采样Conlourlet逆变换得到新的I分量,与H,S分量一起还原到RGB空间,最终得到融合后的高分辨率多光谱彩色图像.本文采用一组多光谱图像和全色图像数据进行融合实验,其实验融合图像的目视效果和统计指标均优于传统的IHS融合方法、小波融合方法以及Contourlet变换方法.     

基于KL与小波联合变换的多光谱图像压缩

鉴于卫星拍摄的遥感图像的空间分辨率和光谱分辨率越来越高,在一些应用中,常会对多光谱图像进行压缩。为了提高多光谱图像的压缩质量,提出了联合相位相关和仿射变换的图像配准方法,有效提高了图像谱段之间的相关性。针对多光谱图像压缩,提出了结合Karhunen-Love,KL变换去除谱间相关和嵌入式二维小波编码方法。相比JPEG2000谱段图像独立压缩方法,提出方法解压图像的Peak Signal to Noise Ratio,PSNR值平均提高2.1 dB。实验结果表明:所提出的方法能在相同的压缩率下获得比JPEG2000谱段图像独立压缩方法更好的图像质量。     

联合多流融合和多尺度学习的卷积神经网络遥感图像融合方法

为尽可能保持原始低分辨率多光谱(LRMS)图像光谱信息的同时,显著提高融合后的多光谱图像的空间分辨率,该文提出一种联合多流融合和多尺度学习的卷积神经网络遥感图融合方法.首先将原始MS图像输入频谱特征提取子网得到其光谱特征,然后分别将通过梯度算子处理全色图像得到的梯度信息和通过卷积后的全色图像与得到的光谱特征图在通道上拼...     

一种基于小波变换的可调节遥感影像融合方法

光谱保持和高分辨率保留是影像融合的两个重要问题,不同的应用可能对融合的结果有不同的要求．提出了一种基于小波变换的可调节遥感影像融合方法．该方法首先分别将高分辨率影像和多光谱影像进行小波分解,然后根据影像的特点,在小波域内进行影像融合,最后通过小波逆变换得到融合结果．通过引入可调节参数,该方法可以在细节保留和光谱保持两方面达到不同程度的平衡,在某些参数组合下,融合图像的目视效果和统计指标可以达到甚至超过传统的小波融合法、IHS变换和主成分变换融合法的效果．     

基于Contourlet系数局部特征的选择性遥感图像融合算法

为了使融合后的多光谱图像在显著提高空间分辨率的同时,尽可能多地保持原始多光谱特性,提出了一种基于Contourlet变换系数局部特征的选择性遥感图像融合方法。根据多光谱和全色图像融合过程中Contourlet变换后的低频和高频部分融合目的的不同,对得到的近似和各层各方向的细节分量分别运用窗口邻域移动模板逐一计算相应区域Contourlet系数阵的不同局部特征量,然后选择适当的准则,对图像的近似和细节分量分别应用不同的策略在Contourlet系数域内进行选择性融合,通过Contourlet和亮度-色调-饱和度(IHS)逆变换得到融合的高分辨率多光谱图像。采用Landsat TM多光谱和SPOT全色图像进行的融合实验结果表明:提出的算法在显著提高空间分辨率的同时,又能很好地保持原始图像的光谱特征,并优于传统的融合方法。