Multi-window visual saliency extraction for fusion of visible and infrared images

Fusion for visible and infrared images aims to combine the source images of the same scene into a single image with more feature information and better visual performance. In this paper, the authors propose a fusion method based on multi-window visual saliency extraction for visible and infrared images. To extract feature information from infrared and visible images, we design local-window-based frequency-tuned method. With this idea, visual saliency maps are calculated for variable feature information under different local window. These maps show the weights of people’s attention upon images for each pixel and region. Enhanced fusion is done using simple weight combination way. Compared with the classical and state-of-the-art approaches, the experimental results demonstrate the proposed approach runs efficiently and performs better than other methods, especially in visual performance and details enhancement.     

Image enhancement algorithm based on improved lateral inhibition network

There is often substantial noise and blurred details in the images captured by cameras. To solve this problem, we propose a novel image enhancement algorithm combined with an improved lateral inhibition network. Firstly, we built a mathematical model of a lateral inhibition network in conjunction with biological visual perception; this model helped to realize enhanced contrast and improved edge definition in images. Secondly, we proposed that the adaptive lateral inhibition coefficient adhere to an exponential distribution thus making the model more flexible and more universal. Finally, we added median filtering and a compensation measure factor to build the framework with high pass filtering functionality thus eliminating image noise and improving edge contrast, addressing problems with blurred image edges. Our experimental results show that our algorithm is able to eliminate noise and the blurring phenomena, and enhance the details of visible and infrared images.     

Noise suppression and details enhancement for infrared image via novel prior

Infrared images always suffer from blurring edges, fewer details and low signal-to-noise ratio. So, sharpening edges and suppressing noise become the urgent techniques in infrared image technology field. However, they are contradictories in most cases. Hence, to depict correctly infrared image features under low signal-to-noise ratio circumstance, a novel prior, which is immune to noise, is presented in this paper. The proposed method scopes noise suppression and details enhancement. In noise suppression, the prior is introduced into Bayesian model to obtain optimal estimation through iteration. In details enhancement, based on the proposed prior, the final image is obtained by the improved unsharp mask algorithm which enhances adaptively details and edges of optimal estimation. The effectiveness and robustness of the proposed method is analyzed by testing the infrared images obtained from different signal-to-noise ratio conditions. Compared with other well-established methods, the proposed method shows a significant performance in terms of noise suppression, actual scene reappearance, enhancing the details and sharpening edges.     

Infrared and visible image fusion based on visual saliency map and weighted least square optimization

The goal of infrared (IR) and visible image fusion is to produce a more informative image for human observation or some other computer vision tasks. In this paper, we propose a novel multi-scale fusion method based on visual saliency map (VSM) and weighted least square (WLS) optimization, aiming to overcome some common deficiencies of conventional methods. Firstly, we introduce a multi-scale decomposition (MSD) using the rolling guidance filter (RGF) and Gaussian filter to decompose input images into base and detail layers. Compared with conventional MSDs, this MSD can achieve the unique property of preserving the information of specific scales and reducing halos near edges. Secondly, we argue that the base layers obtained by most MSDs would contain a certain amount of residual low-frequency information, which is important for controlling the contrast and overall visual appearance of the fused image, and the conventional “averaging” fusion scheme is unable to achieve desired effects. To address this problem, an improved VSM-based technique is proposed to fuse the base layers. Lastly, a novel WLS optimization scheme is proposed to fuse the detail layers. This optimization aims to transfer more visual details and less irrelevant IR details or noise into the fused image. As a result, the fused image details would appear more naturally and be suitable for human visual perception. Experimental results demonstrate that our method can achieve a superior performance compared with other fusion methods in both subjective and objective assessments.     

用于MR图像非局域均值去噪的边缘增强策略

非局域均值(NLM)滤波有很好的去噪效果并已成功地应用于磁共振图像的去噪中,但与所有去噪方法相同,总是会在一定程度上模糊图像细节. 该文提出将从原始图像中提取出来的高频信息与NLM去噪图像相融合,来还原在去噪过程中丢失的细节. 首先利用一种基于拉普拉斯金字塔的多分辨率方法,从原始图像中提取出包含丰富的边缘信息的高频组分. 然后利用作者提出的一种新的基于SUSAN算子的边缘检测算子产生一幅连续的边缘图,并利用该边缘图将高频组分与NLM方法去噪的图像相融合. 该方法在图像的平滑区域取得了良好的去噪效果,同时可以保留甚至增强图像的细节. 同时,该方法对图像的增强不会导致增强图像中常见的伪影.     

Infrared image enhancement using Cellular Automata

Image enhancement is a crucial technique for infrared images. The clear image details are important for improving the quality of infrared images in computer vision. In this paper, we propose a new enhancement method based on two priors via Cellular Automata. First, we directly learn the gradient distribution prior from the images via Cellular Automata. Second, considering the importance of image details, we propose a new gradient distribution error to encode the structure information via Cellular Automata. Finally, an iterative method is applied to remap the original image based on two priors, further improving the quality of enhanced image. Our method is simple in implementation, easy to understand, extensible to accommodate other vision tasks, and produces more accurate results. Experiments show that the proposed method performs better than other methods using qualitative and quantitative measures.     

Multi-sparse dictionary colorization algorithm based on the feature classification and detail enhancement

For the problems of missing details and performance of the colorization based on sparse representation, we propose a conceptual model framework for colorizing gray-scale images, and then a multi-sparse dictionary colorization algorithm based on the feature classification and detail enhancement (CEMDC) is proposed based on this framework. The algorithm can achieve a natural colorized effect for a gray-scale image, and it is consistent with the human vision. First, the algorithm establishes a multi-sparse dictionary classification colorization model. Then, to improve the accuracy rate of the classification, the corresponding local constraint algorithm is proposed. Finally, we propose a detail enhancement based on Laplacian Pyramid, which is effective in solving the problem of missing details and improving the speed of image colorization. In addition, the algorithm not only realizes the colorization of the visual gray-scale image, but also can be applied to the other areas, such as color transfer between color images, colorizing gray fusion images, and infrared images.     

The effect of Laplacian filter in adaptive unsharp masking for infrared image enhancement

Image processing, in particular image enhancement techniques have been the focal point of considerable research activity in the last decade. With the aid of an existing image enhancement technique, adaptive unsharp masking (AUM), we propose a novel kernel to be used in AUM filtering in order to enhance discontinuities which occur on the edges of targets of interest in infrared (IR) images. The proposed method uses an adaptive filter approach where an objective function is minimized by using descent algorithms. The output IR image has better sharpness and contrast adjustment for the detection of targets in terms of objective quality metrics. Hence, the proposed method ensures that the edges of the targets in IR images are sharper and that the quality of contrast adjustment has its optimum level in terms of peak signal-to-noise ratios.     

Single image deblurring using novel image prior constraints

Single image deblurring is a highly ill-posed problem and requires to be regularized. Many common forms of image prior have a major drawback that is unable to make full use of local image information. In this paper, we propose a single image deblurring method using novel image prior constraints. We establish a probabilistic model by enforcing inspired image prior constraints and adopt an advanced iterative scheme that alternates between blur kernel estimation and non-blind image restoration. To suppress ringing artifacts caused by inevitable blur kernel estimated errors, our method employs total variation image restoration and presents an alternation half-quadratic algorithm to solve the non-convex cost function. Finally, experiments show that our method has good performance in suppressing ringing artifacts, and makes a good balance between alleviating staircase effects and preserving image details.     

Novel infrared image enhancement technology based on the frequency compensation approach

A novel infrared image enhancement method has been proposed in this paper. Our aim is to develop a detail enhancement method which is focused on the frequency feature of the image. The proposed method is following the most popular strategy of enhancing the infrared images nowadays, but concentrating on the frequency domain. Firstly, the original image is separated by a guided image filter into detail layer and the base layer. Quite unlike the traditional methods, we use the guided image filter to eliminate most of the noise and weak signal of the scenario. Then, by a designed iteration process, the higher frequency of the scenario will be calculated back and add to the detail layer. The noise will not be enhanced because the iteration is only focused on the leftover scenario frequency. We run many tests on the raw data captured by the 320 × 256 HgCdTe cooled thermal imager, and make a comparison between our approach with the previous method of bilateral filtering digital detail enhancement and guided image filtering digital detail enhancement. Figures and analytical data show that our method is better than the previous proposed researches. Our method could effectively process the infrared image with less noise and artifacts, which has potential applications in testing, manufacturing, chemical imaging, night vision, and surveillance security.     

The infrared and visible image fusion algorithm based on target separation and sparse representation

Although the fused image of the infrared and visible image takes advantage of their complementary, the artifact of infrared targets and vague edges seriously interfere the fusion effect. To solve these problems, a fusion method based on infrared target extraction and sparse representation is proposed. Firstly, the infrared target is detected and separated from the background rely on the regional statistical properties. Secondly, DENCLUE (the kernel density estimation clustering method) is used to classify the source images into the target region and the background region, and the infrared target region is accurately located in the infrared image. Then the background regions of the source images are trained by Kernel Singular Value Decomposition (KSVD) dictionary to get their sparse representation, the details information is retained and the background noise is suppressed. Finally, fusion rules are built to select the fusion coefficients of two regions and coefficients are reconstructed to get the fused image. The fused image based on the proposed method not only contains a clear outline of the infrared target, but also has rich detail information.     

Fusion of visible and infrared images using global entropy and gradient constrained regularization

Infrared and visible image fusion has been an important and popular topic in imaging science. Dual-band image fusion aims to extract both target regions in infrared image and abundant detail information in visible image into fused result, preserving even enhancing the information that inherits from source images. In our study, we propose an optimization-based fusion method by combining global entropy and gradient constrained regularization. We design a cost function by taking the advantages of global maximum entropy as the first term, together with gradient constraint as the regularized term. In this cost function, global maximum entropy could make the fused result inherit as more information as possible from sources. And using gradient constraint, the fused result would have clear details and edges with noise suppression. The fusion is achieved based on the minimization of the cost function by adding weight value matrix. Experimental results indicate that the proposed method performs well and has obvious superiorities over other typical algorithms in both subjective visual performance and objective criteria.     

Analysis of the features and reconstruction of a high resolution infrared image based on a multi-aperture imaging system

Infrared images of good quality are strictly important for such applications as targets detection, tracking and identifying. Traditional single aperture infrared imaging system brings in some defects for its imaging scheme. Multi-aperture imaging system shows promising characteristic of improving image quality and reducing size of optical instruments. We reconstruct a high resolution infrared image from the low resolution sub-images collected by the compact multi-aperture imaging system. A novel reconstruction method called pixels closely arrange (PCA) is proposed based on analyzing the compound eye imaging process, and this method is verified in a simulated 3D infrared scene to capture sub-images. An evaluation of the reconstructed image quality is presented to discuss the significant factors that affect the final result. Experimental results show that the PCA method can be efficiently applied to the multi-aperture infrared imaging system as long as the structure of the micro-lens array is specifically designed to be adaptive to the infrared focal plane array (IFPA).     

Fusion of the low-light-level visible and infrared images for night-vision context enhancement

For better night-vision applications using the low-light-level visible and infrared imaging, a fusion framework for night-vision context enhancement(FNCE) method is proposed. An adaptive brightness stretching method is first proposed for enhancing the visible image. Then, a hybrid multi-scale decomposition with edge-preserving filtering is proposed to decompose the source images. Finally, the fused result is obtained via a combination of the decomposed images in three different rules. Experimental results demonstrate that the FNCE method has better performance on the details(edges), the contrast, the sharpness, and the human visual perception. Therefore,better results for the night-vision context enhancement can be achieved.     

Defects’ geometric feature recognition based on infrared image edge detection

Edge detection is an important technology in image segmentation, feature extraction and other digital image processing areas. Boundary contains a wealth of information in the image, so to extract defects’ edges in infrared images effectively enables the identification of defects’ geometric features. This paper analyzed the detection effect of classic edge detection operators, and proposed fuzzy C-means (FCM) clustering-Canny operator algorithm to achieve defects’ edges in the infrared images. Results show that the proposed algorithm has better effect than the classic edge detection operators, which can identify the defects’ geometric feature much more completely and clearly. The defects’ diameters have been calculated based on the image edge detection results.     

Hierarchical image enhancement

Image enhancement is an important technique in computer vision. In this paper, we propose a hierarchical image enhancement approach based on the structure layer and texture layer. In the structure layer, we propose a structure-based method based on GMM, which better exploits structure details with fewer noise. In the texture layer, we present a structure-filtering method to filter unwanted texture with keeping completeness of detected salient structure. Next, we introduce a structure constraint prior to integrate them, leading to an improved enhancement result. Extensive experiments demonstrate that the proposed approach achieves higher quality results than previous approaches.     

Wave atom transform generated strong image hashing scheme

The rapid development of multimedia technology has resulted in a rising rate on digital unauthorized utilization and forgery, which makes the situation of image authentication increasingly severe. A novel strong image hashing scheme is proposed based on wave atom transform, which can better authenticate images by precisely distinguishing the malicious tampered images from the non-maliciously processed ones. Wave atom transform is employed since it has significantly sparser expansion and better characteristics of texture feature extraction than other traditional transforms. For better detection sensitivity, gray code is applied instead of natural binary code to optimize the hamming distance. Randomizations are also performed using Rényi chaotic map for the purposes of secure image hashing and key sensitivity. The experimental results show that the proposed strong scheme is robust to non-malicious content-preserving operations and also fragile to malicious content-altering operations. The scheme also outperforms DCT and DWT based schemes in terms of receiving operating characteristic (ROC) curves. Moreover, to provide an application-defined tradeoff, a security enhancement approach based on Rényi map is presented, which can further protect the integrity and secrecy of images.     

基于区域分维和非采样Contourlet变换的图像融合算法

针对源图像有用信息的提取,提出了基于区域分维和非下采样Contourlet变换相结合的红外与可见光图像融合算法.将图像的区域属性、区域大小、边缘强度以及纹理显著程度等特点用图像不同尺度上的区域分维进行描述,对于非下采样Contourlet变换低频系数,根据源图像不同尺度上的区域分维进行基于系数选择的融合.针对带通子带系数设计了系数局部匹配度算子,依据匹配度不同采用加权和系数选取相结合的融合规则.与其他常规融合方法进行比较,该算法可有效实现红外与可见光图像的融合.     

基于双边纹理滤波的图像细节增强方法

为了实现图像的细节增强,特别是纹理细节增强,同时尽可能保持图像的结构完整,提出了一种基于双边纹理滤波的图像多尺度分解方法。首先,对图像进行多尺度双边纹理滤波分解,分别得到一幅基本图像和一系列细节纹理图像。接着,类似于小波增强方法,对细节图像采用多尺度自适应增强方法,得到一系列增强后的纹理细节图像。最后,将基本图像和增强后细节图像相加,重构出最后的增强图像。实验结果表明:本文提出的增强方法能够在突出边缘的同时,较好地增强图像中的纹理细节信息。将基于双边纹理滤波的多尺度分解引入图像增强,能更好地体现图像纹理细节特征,为增强图像提供更加丰富的信息。     

Optimization-based image reconstruction in x-ray computed tomography by sparsity exploitation of local continuity and nonlocal spatial self-similarity

The additional sparse prior of images has been the subject of much research in problems of sparse-view computed tomography(CT) reconstruction. A method employing the image gradient sparsity is often used to reduce the sampling rate and is shown to remove the unwanted artifacts while preserve sharp edges, but may cause blocky or patchy artifacts.To eliminate this drawback, we propose a novel sparsity exploitation-based model for CT image reconstruction. In the presented model, the sparse representation and sparsity exploitation of both gradient and nonlocal gradient are investigated.The new model is shown to offer the potential for better results by introducing a similarity prior information of the image structure. Then, an effective alternating direction minimization algorithm is developed to optimize the objective function with a robust convergence result. Qualitative and quantitative evaluations have been carried out both on the simulation and real data in terms of accuracy and resolution properties. The results indicate that the proposed method can be applied for achieving better image-quality potential with the theoretically expected detailed feature preservation.