Image fusion through local feature extraction by using multi-scale top-hat by reconstruction operators

The purpose of image fusion is to combine useful image features of different original images into the final fusion image, which will produce one useful result image for different applications. One of the main difficulties of image fusion is extracting useful image features of different original images. In some cases, useful image features are local image features of the whole image. To efficiently extract local image features and produce an efficient fusion result, an image fusion algorithm based on the extracted local image features by using multi-scale top-hat by reconstruction operators is proposed in this paper. Firstly, multi-scale local feature extraction using multi-scale top-hat by reconstruction operators is discussed. Then, based on the extracted multi-scale local features of different original images, the useful image features for image fusion are constructed. Finally, the constructed useful image features for image fusion are combined into the final fusion image. Experimental results on different types of images show that, the proposed algorithm performs well for image fusion.     

Multiple linear feature detection through top-hat transform by using multi linear structuring elements

A multiple linear feature detection algorithm through top-hat transform using the constructed multiple linear structuring elements is proposed in this paper. The desired linear features are treated as a set. And, the set is divided into different subsets. Multi linear structuring elements corresponding to different subsets are constructed. After that, top-hat transform is performed by using the constructed linear structuring elements, and the results are combined to reconstruct the desired linear features. Then, the extracted linear features are binarized and processed to form the final detected binary linear features. Because of the effective performance of the top-hat transform using the constructed multi linear structuring elements, the linear features of different images from different applications could be well detected. The analysis and experimental results show that, the proposed algorithm could be well used for multiple linear feature detection in different applications.     

A fusion method for infrared–visible image and infrared-polarization image based on multi-scale center-surround top-hat transform

This paper presents a fusion method for infrared–visible image and infrared-polarization image based on multi-scale center-surround top-hat transform which can effectively extract the feature information and detail information of source images. Firstly, the multi-scale bright (dark) feature regions of source images at different scale levels are respectively extracted by multi-scale center-surround top-hat transform. Secondly, the bright (dark) feature regions at different scale levels are refined for eliminating the redundancies by spatial scale. Thirdly, the refined bright (dark) feature regions from different scales are combined into the fused bright (dark) feature regions through adding. Then, a base image is calculated by performing dilation and erosion on the source images with the largest scale outer structure element. Finally, the fusion image is obtained by importing the fused bright and dark features into the base image with a reasonable strategy. Experimental results indicate that the proposed fusion method can obtain state-of-the-art performance in both aspects of objective assessment and subjective visual quality.     

Image enhancement through contrast enlargement using the image regions extracted by multiscale top-hat by reconstruction

An image enhancement algorithm based on multiscale top-hat by reconstruction is proposed in this paper. Firstly, multiscale top-hat by reconstruction using multiscale structuring elements is discussed. Then, multiscale bright and black image regions are extracted. Thirdly, useful image regions for image enhancement are obtained from the extracted multiscale bright and black image regions. Finally, after a base image is calculated from the results of the opening and closing by reconstruction operations, the original image is enhanced through combing the useful image regions into the base image. Experimental results on different types of images show that the proposed algorithm is efficient.     

Image enhancement using multi scale image features extracted by top-hat transform

To efficiently enhance images, a novel algorithm using multi scale image features extracted by top-hat transform is proposed in this paper. Firstly, the multi scale bright and dim regions are extracted through top-hat transform using structuring elements with the same shape and increasing sizes. Then, two types of multi scale image features, which are the multi scale bright and dim image regions at each scale and the multi scale image details between neighboring scales, are extracted and used to form the final extracted bright and dim image regions. Finally, the image is enhanced through enlarging the contrast between the final extracted bright and dim image features. Experimental results on images from different applications verified that the proposed algorithm could efficiently enhance the contrast and details of image, and produce few noise regions.     

Fusion of infrared-visible images using improved multi-scale top-hat transform and suitable fusion rules

Integration of infrared and visible images is an active and important topic in image understanding and interpretation. In this paper, a new fusion method is proposed based on the improved multi-scale center-surround top-hat transform, which can effectively extract the feature information and detail information of source images. Firstly, the multi-scale bright (dark) feature regions of infrared and visible images are respectively extracted at different scale levels by the improved multi-scale center-surround top-hat transform. Secondly, the feature regions at the same scale in both images are combined by multi-judgment contrast fusion rule, and the final feature images are obtained by simply adding all scales of feature images together. Then, a base image is calculated by performing Gaussian fuzzy logic combination rule on two smoothed source images. Finally, the fusion image is obtained by importing the extracted bright and dark feature images into the base image with a suitable strategy. Both objective assessment and subjective vision of the experimental results indicate that the proposed method is superior to current popular MST-based methods and morphology-based methods in the field of infrared-visible images fusion.     

Multiscale top-hat selection transform based infrared and visual image fusion with emphasis on extracting regions of interest

To effectively combine regions of interest in original infrared and visual images, an adaptively weighted infrared and visual image fusion algorithm is developed based on the multiscale top-hat selection transform. First, the multiscale top-hat selection transform using multiscale structuring elements with increasing sizes is discussed. Second, the image regions of the original infrared and visual images at each scale are extracted by using the multiscale top-hat selection transform. Third, the final fusion regions are constructed from the extracted multiscale image regions. Finally, the final fusion regions are combined into a base image calculated from the original images to form the final fusion result. The combination of the final fusion regions uses the adaptive weight strategy, and the weights are adaptively obtained based on the importance of the extracted features. In the paper, we compare seven image fusion methods: wavelet pyramid algorithm (WP), shift invariant discrete wavelet transform algorithm (SIDWT), Laplacian pyramid algorithm (LP), morphological pyramid algorithm (MP), multiscale morphology based algorithm (MSM), center-surround top-hat transform based algorithm (CSTHT), and the proposed multiscale top-hat selection transform based algorithm. These seven methods are compared over five different publicly available image sets using three metrics of spatial frequency, mean gradient, and Q. The results show that the proposed algorithm is effective and may be useful for the applications related to the infrared and visual image fusion.     

Non-local and nonlinear background suppression method controlled by multi-scale clutter metric

To improve the detection performance for non-morphological multi-scale target in IR image containing complex cloud clutter, on basis of cloud scenario self-similarity feature, a non-local and nonlinear background suppression algorithm controlled by multi-scale clutter metric is presented. According to the classical achievements on cloud structure, self-similarity and relativity of cloud clutter on image for target detection is deeply analyzed by classical indicators firstly. Then we establish multi-scale clutter metric method based on LoG operator to describe scenes feature for controlled suppression method. After that, non-local means based on optimal strength similarity metric as non-local processing, and multi-scale median filter and on minimum gradient direction as local processing are set up. Finally linear fusing principle adopting clutter metric for local and non-local processing is put forward. Experimental results by two kinds of infrared imageries show that compared with classical and similar methods, the proposed method solves the existing problems of targets energy attenuation and suppression degradation in strongly evolving regions in previous methods. By evaluating indicators, the proposed method has a superior background suppression performance by increasing the BSF and ISCR 2 times at least.     

An infrared and visible image fusion method based upon multi-scale and top-hat transforms

The high-frequency components in the traditional multi-scale transform method are approximately sparse, which can represent different information of the details. But in the low-frequency component, the coefficients around the zero value are very few, so we cannot sparsely represent low-frequency image information. The low-frequency component contains the main energy of the image and depicts the profile of the image. Direct fusion of the low-frequency component will not be conducive to obtain highly accurate fusion result. Therefore, this paper presents an infrared and visible image fusion method combining the multi-scale and top-hat transforms. On one hand, the new top-hat-transform can effectively extract the salient features of the low-frequency component. On the other hand, the multi-scale transform can extract highfrequency detailed information in multiple scales and from diverse directions. The combination of the two methods is conducive to the acquisition of more characteristics and more accurate fusion results. Among them, for the low-frequency component, a new type of top-hat transform is used to extract low-frequency features, and then different fusion rules are applied to fuse the low-frequency features and low-frequency background; for high-frequency components, the product of characteristics method is used to integrate the detailed information in high-frequency. Experimental results show that the proposed algorithm can obtain more detailed information and clearer infrared target fusion results than the traditional multiscale transform methods. Compared with the state-of-the-art fusion methods based on sparse representation, the proposed algorithm is simple and efficacious, and the time consumption is significantly reduced.     

Multi-scale toggle operator for constructing image sharpness measure

To construct effective image sharpness measure with good discrimination ability, a multi-scale toggle operator based algorithm is proposed in this paper. Firstly, toggle operator is used to extract image details. And, the multi-scale theory is used in toggle operator to extract multi-scale image details. Then, the final image details are obtained through applying the pixel-wise maximum operation on the extracted multi-scale image details. Finally, the mean value of the obtained final image details is used as the constructed image sharpness measure. Experimental results on different images show that, the proposed image sharpness measure could correctly quantify the clarity of image and is suitable for discriminating the image clarity change.     

特征增强SSD算法及其在遥感目标检测中的应用

为了提高对复杂场景下多尺度遥感目标的检测精度,提出了基于多尺度单发射击检测(SSD)的特征增强目标检测算法.首先对SSD的金字塔特征层中的浅层网络设计浅层特征增强模块,以提高浅层网络对小目标物体的特征提取能力;然后设计深层特征融合模块,替换SSD金字塔特征层中的深层网络,提高深层网络的特征提取能力;最后将提取的图像特征与不同纵横比的候选框进行匹配以执行不同尺度遥感图像目标检测与定位.在光学遥感图像数据集上的实验结果表明,该算法能够适应不同背景下的遥感目标检测,有效地提高了复杂场景下的遥感目标的检测精度.此外,在拓展实验中,文中算法对图像中的模糊目标的检测效果也优于SSD.     

A feature-based robust digital image watermarking scheme using bandelet transform

Desynchronization attacks are among the most difficult attacks to resist, for it can desynchronize the location of the watermark and hence cause incorrect watermark detection. The design of an image watermarking scheme that is robust against desynchronization attacks is challenging. Based on a multi-scale SIFT (scale invariant feature transform) detector and Bandelet transform theory, we propose a new content based image watermarking algorithm with good visual quality and reasonable resistance toward desynchronization attacks. Firstly, the stable image feature points are extracted from the original host by using the multi-scale SIFT detector, and the local feature regions (LFRs) are constructed adaptively according to the feature scale theory. The Bandelet transform is then performed on the LFRs. Finally, the digital watermark is embedded into the LFRs by modifying the significant Bandelet coefficients. By binding the watermark with the geometrically invariant image features, the watermark detection can be done without synchronization error. Experimental results show that the proposed image watermarking is not only invisible and robust against common signal processing such as sharpening, noise adding, JPEG compression, etc., but also robust against the desynchronization attacks such as rotation, translation, scaling, row or column removal, cropping, etc.     

Defects’ geometric feature recognition based on infrared image edge detection

Edge detection is an important technology in image segmentation, feature extraction and other digital image processing areas. Boundary contains a wealth of information in the image, so to extract defects’ edges in infrared images effectively enables the identification of defects’ geometric features. This paper analyzed the detection effect of classic edge detection operators, and proposed fuzzy C-means (FCM) clustering-Canny operator algorithm to achieve defects’ edges in the infrared images. Results show that the proposed algorithm has better effect than the classic edge detection operators, which can identify the defects’ geometric feature much more completely and clearly. The defects’ diameters have been calculated based on the image edge detection results.     

多尺度形态算子融合图像滤波技术及滤波质量评价

针对舰载红外警戒系统的红外和电视图像,提出了一种新的海空背景下受强杂波、噪声污染的图像目标滤波算法和滤波效果的定量评价算子。算法采用多尺度的形态算子对输入的图像并行滤波,大尺度形态算子抑制图像噪声,小尺度形态算子提取目标边缘细节信息。处理后的图像进行基于树状小波帧变换的图像信息融合,融合图像可完备提取不同尺度滤波后的图像信息。针对目标检测跟踪的图像滤波算法的评价,提出了目标与背景的交叉分辨力评价算子及评价准则。仿真实验表明。该滤波算法要优于中值滤波、自适应滤波、小波变换滤波算法,滤波质量的定量评价算法是合理的、有效的。算法适用于舰载红外警戒系统。     

基于多尺度特征提取与多元回归分析的人脸识别

为提高人脸识别的正确率,提出了一种改进的特征提取及分类算法。首先采用Contour-let变换对人脸图像进行多尺度分解,然后由低频子带和各尺度各方向的高频子带得到人脸的特征值,并将它们组合成多尺度特征向量,再应用多元回归分析方法进行人脸识别。由于多尺度特征向量不仅反映了整幅图像的全局特征,还反映了图像各种尺度下的边缘、纹理等奇异特征,因此具有更多的鉴别信息;多元回归分析则充分考虑了同一总体的各样本间的强线性关系。在ORL人脸库上的实验显示人脸识别率达97．78％,优于其他的方法。     

Infrared image enhancement through saliency feature analysis based on multi-scale decomposition

To improve contrast between dim target region and background in infrared (IR) long-range surveillance, this paper proposes a fast image enhancement approach using saliency feature extraction based on multi-scale decomposition. Firstly, a smooth based multi-scale decomposition is designed and applied to original infrared image, generating sub-images with various frequency components at different decomposition levels. The dim target regions of sub-images are extracted by a local frequency-tuned based saliency feature detection method, secondly. With saliency maps created by saliency extraction using multi-scale local windows with different sizes, the sub-images are enhanced at different decomposition scales. Finally, the enhanced result is reconstructed by synthesizing the all sub-images with adjustable synthetic weights. Since salient areas are analyzed based on fast multi-scale image decomposition, IR image can be s enhanced with good contrast successfully and rapidly. Compared with other algorithms, the experimental results prove that the proposed method is robust and efficient for IR image enhancement.     

一种新的空谱联合探测高光谱影像目标探测算法

高光谱遥感影像不但具有高分辨率的空间信息还包含连续的光谱信息,因此在目标探测领域具有独特的应用优势。传统的高光谱遥感影像目标探测侧重于光谱信息的应用,形成了确定性算法和统计学算法。确定性算法通过计算目标光谱与待检测光谱之间的距离来查找目标,不能检测亚像素目标,而且容易受到噪声的影响;统计学目标检测计算背景统计特性,通过探测异常点来检测目标,可以检测亚像素目标和小目标,但容易受到目标尺寸的影响,不能很好的检测大目标。随着高光谱遥感影像的空间分辨率的增加,探测目标已有亚像素目标逐步转换为单像素及多像素目标,此时,在高光谱图像中,相同类别的地物在空间分布上呈现聚类特性, 因此,在利用高光谱遥感影像进行目标探测时,需要将其空间信息融入算法中。将空间特征引入传统目标探测算法。提出了一种新的空谱结合的高光谱目标探测算法,将传统的基于统计的目标探测算子与空域邻域聚类算法相结合,首先利用目标探测算子将影像划分为潜在目标区域与背景区域;通过计算潜在目标区域的质心,以质心为中心进行邻域聚类,剔除潜在目标区域中的背景区域,通过迭代计算获取最终目标探测结果。传统的基于统计的目标探测算子,将整个探测区域定义为背景区域,实现对背景区域的统计特征提取,而该方法将背景区域与潜在目标区域分离,剔除了目标区域对背景区域的统计干扰。将本算子与传统的约束能量最小化算子和自适应余弦探测算子进行分析比较可知,该算子的大目标探测性能优于传统的统计算子。     

基于特征融合的多尺度窗口产品外观检测方法

为提高产品外观质量的检测精度和实时性,提出一种基于特征融合的多尺度滑动窗口机器视觉检测方法;在训练阶段,首先提取图像的HOG特征和Lab颜色特征,并采用典型相关分析法(CCA)进行特征融合;接下来,采用支持向量机(SVM)对融合的特征进行训练,生成分类器;在检测阶段,产品外观不同区域对精度的要求不同,为提高检测效率,生成不同尺度的滑动窗口,在每个窗口中都进行图像的特征提取与特征融合;最后,对采集的图像序列进行匹配,实现产品外观划痕的实时检测;实验中,选取不同的特征提取方法进行对比,并分别生成大小不同的滑动窗口,通过分析实验结果,结合检测时间与精度,确定各个区域的窗口尺度;实验表明,与传统的检测方法相比,所提方法在检测精度和实时性上具有显著提高。     

基于SIFT特征的彩色图像拼接方法研究

针对传统特征提取拼接算法在复杂图像中配准过程中出现的过多误匹配,导致拼接后图像出现鬼影、模糊等问题,从而影响拼接图像的质量,提出一种改进的SIFT配准算法。在对目标图像提取SIFT特征后,利用SIFT描述子的尺度以及梯度方向信息建立最小邻域匹配剔除误匹配点,之后利用局部均方根误差(RMSE)评价映射矩阵与RANSAC算法相结合,迭代出精确变换模型。在对图像进行几何矫正后,提出一种自适应的混合线性算法对重合区域图像变换至HIS颜色空间进行图像拼接,最后得到平滑无缝的完整彩色全景拼接图像。实验结果证明,该算法在拼接复杂场景并且重合区域不多时仍有较好的准确性及稳定性。     

多尺度融合超分辨率算法在无人机探测中的应用

基于光电传感器的低慢小无人机探测系统能够快速准确地发现并识别无人机目标,但远距离非合作无人机目标在图像中像素比重过小,特征退化较明显,使识别率大大降低。图像超分辨技术能够从低分辨率目标图像区域中获得高分辨率图像并恢复更多的细节特征,现有超分辨技术很难在保证推理速度的前提下兼容图像的高低频特征,因此为了满足探测系统的需求,基于FSRCNN（fast super-resolution convolutional neural network）的特征提取与非线性映射网络结构并结合多尺度融合,提出一种包含4分支的轻量级多尺度融合超分辨率网络,能够在超分辨率图形中兼容高低频图像信息,且参数量较低,实时性高。经实验结果表明,该算法能够更加快速高效地重建出高分辨率的无人机轮廓与细节;在YOLOV3检测效果的实验中,该算法能够使无人机检测置信度平均提升6.72%,具备较高的实际应用价值。