Correction of color information of a 3D model using a range intensity image

Most active optical range sensors record, simultaneously with the range image, the amount of light reflected at each measured surface location: this information forms what is called a range intensity image, also known as a reflectance image. This paper proposes a method that uses this type of image for the correction of the color information of a textured 3D model. This color information is usually obtained from color images acquired using a digital camera. The lighting condition for the color images are usually not controlled, thus this color information may not be accurate. On the other hand, the illumination condition for the range intensity image is known since it is obtained from a controlled lighting and observation configuration, as required for the purpose of active optical range measurement. The paper describes a method for combining the two sources of information, towards the goal of compensating for a reference range intensity image is first obtained by considering factors such as sensor properties, or distance and relative surface orientation of the measured surface. The color image of the corresponding surface portion is then corrected using this reference range intensity image. A B-spline interpolation technique is applied to reduce the noise of range intensity images. Finally, a method for the estimation of the illumination color is applied to compensate for the light source color. Experiments show the effectiveness of the correction method using range intensity images.     

利用色彩直方图特征进行偏色图象的自动检测和校正

在肤色检测、人脸识别、图象和视频检索的研究中，大量算法都是基于对图象色彩特征进行分析的，然而当图象发生偏色时，这些算法的性能会明显下降，甚至无效，而且由于现有的偏色校正算法，引入了其他关于偏色图象的先验性信息，具有很大的使用局限性，为此，提出了一种在只给出偏色图象的条件下，进行偏色检测和自动校正的算法．该算法首先获取并分析偏色图象在RGB各通道内的直方图特征，然后参照这些特征检测偏色通道，并通过调整偏色或非偏色通道强度分布来达到各个通道之间色彩平衡．实验表明，在较大程度的偏色情况下，该算法校正恢复出的图象与原始无偏色图象能达到视觉上基本一致的效果，并具有普遍的适用性．     

高质量快速全景场景再现技术

目的 色彩纠正和图像融合是生成高质量全景场景图像的关键技术。色彩纠正中参考图像的选择以及图像融合算法,决定着所生成全景图像的质量和速度。现有方法在确定一幅图像是否适合作为参考图像时,需要遍历所有其他图像,计算其作为参考图像进行色彩纠正的效果,复杂度高,速度慢;在图像融合时存在融合质量与融合速度之间的矛盾。因此,如何快速生成高质量的全景图像就成为全景场景再现的主要诉求。为此本文提出优化的参考图像自动选择的色彩纠正方法和基于重叠区域划分的分区融合方法。方法 针对参考图像选择算法复杂度高的问题,根据图像质量与稳定性通常呈反比关系的事实,采用贪婪策略,选择质量最差的图像在色彩纠正前后的相似度,作为是否选择当前图像作为参考图像的评价指标,在保证参考图像满足色彩纠正需求的前提下,大幅降低计算复杂度。针对融合质量与融合速度之间的矛盾,提出分区融合：将重叠区域划分为接缝区域和非接缝区域,利用泊松融合的接缝不可见性和线性融合实现速度快的特性分别对接缝区域和非接缝区域进行融合,既保证融合的质量,又加快融合速度。在此基础上,加入简单点光源,解决上述过程产生的光线一致性问题,进一步提高图像质量。结果 采用主观和客观相结合的方法对结果进行评估。主观方面,本文算法生成的全景图像色彩基本实现平滑过渡且图像原始信息保留完整。客观方面,色彩纠正前后图像的结构相似度（SSIM）控制在0.850.99之间,时间复杂度由原来的O（n²）降低到O（n）;分区融合后图像信息熵接近于泊松融合,但时间消耗降低72%。采用基于PC端的问卷调查法和OG-IQA算法将本文算法与PTGui、OpenCV、Xiong方法生成的全景图质量进行对比,在大多数情况下本文算法均优于上述算法。结论 实验表明,本文算法适用于多种场景,在保证目视效果良好的前提下,时间消耗降低,可广泛应用于医学、数字旅游、遥感等领域。     

Multi-illuminant color reproduction for electronic cameras via CANFIS neuro-fuzzy modular network device characterization

We describe color reproduction and correction of images captured by electronic cameras under multiple illumination (or lighting) conditions, relating to color device characterization for enhancing the quality of color in the obtained images. In particular, we highlight a very practical use of neuro-fuzzy modular network coactive neuro-fuzzy inference systems (CANFIS) models for this application, and discuss their strengths and weaknesses compared with other adaptive network models (e.g., multilayer perceptron (MLP)) as well as conventional lookup-table-type (TRC-matrix) methods. Our in-depth investigation based on comprehensive numerical tests with a wide variety of illumination/lighting data (180 sources of illumination) shows that the "neuro-fuzzy CANFIS with MLP local experts" possesses a remarkable generalization/approximation capacity, even under a very restricted condition where only four-illuminant data sets were permitted to be used for optimization because of efficient practical implementation subject to an industrial setting.     

Objects based change detection in a pair of gray-level images

The goal of the presented change detection algorithm is to extract objects that appear in only one of two input images. A typical application is surveillance, where a scene is captured at different times of the day or even on different days. In this paper we assume that there may be a significant noise or illumination differences between the input images. For example, one image may be captured in daylight while the other was captured during night with an infrared device. By using a connectivity analysis along gray-level technique, we extract significant blobs from both images. All the extracted blobs are candidates to be classified as changes or part of a change. Then, the candidate blobs from both images are matched. A blob from one image that does not satisfy the matching criteria with its corresponding blob from the other image is considered as an object of change. The algorithm was found to be reliable, fast, accurate, and robust even under extreme changes in illumination and some distortion of the images. The performance of the algorithm is demonstrated using real images. The worst-case time complexity of the algorithm is almost linear in the image size. Therefore, it is suitable for real-time applications.     

A Hybrid Color Quantization Algorithm Incorporating a Human Visual Perception Model

Color quantization is a common image processing technique where full color images are to be displayed using a limited palette of colors. The choice of a good palette is crucial as it directly determines the quality of the resulting image. Standard quantization approaches aim to minimize the mean squared error (MSE) between the original and the quantized image, which does not correspond well to how humans perceive the image differences. In this article, we introduce a color quantization algorithm that hybridizes an optimization scheme based with an image quality metric that mimics the human visual system. Rather than minimizing the MSE, its objective is to maximize the image fidelity as evaluated by S‐CIELAB, an image quality metric that has been shown to work well for various image processing tasks. In particular, we employ a variant of simulated annealing with the objective function describing the S‐CIELAB image quality of the quantized image compared with its original. Experimental results based on a set of standard images demonstrate the superiority of our approach in terms of achieved image quality.     

变压器油下图像增强算法

为解决变压器检测机器人在变质、变色的变压器油内部采集的图像存在色彩失真、对比度低等问题,提出一种变压器油下图像融合增强算法.首先,利用完美反射算法对图像进行白平衡处理,以消除油下光照强度不均匀对图像颜色的影响,使得色彩更加均衡;然后,对色彩校正的图像进行自适应伽马校正,以提高图像的对比度;最后,采用多尺度融合策略将色彩校正后的图像与自适应伽马校正处理后的图像进行融合,得到变压器油下清晰的图像.实验结果表明,经所提出算法处理后的变压器油下图像色彩鲜明、细节丰富,与原始图像相比,图像质量评价指标(UCIQE)、特征点匹配个数以及信息熵均有显著提高,能够为变压器内部故障检测提供清晰的数据.     

基于照度与场景纹理注意力图的低光图像增强

目的 现有的低照度图像增强算法常存在局部区域欠增强、过增强及色彩偏差等情况,且对于极低照度图像增强,伴随着噪声放大及细节信息丢失等问题。对此,提出了一种基于照度与场景纹理注意力图的低光图像增强算法。方法 首先,为了降低色彩偏差对注意力图估计模块的影响,对低光照图像进行了色彩均衡处理;其次,试图利用低照度图像最小通道约束图对正常曝光图像的照度和纹理进行注意力图估计,为后续增强模块提供信息引导;然后,设计全局与局部相结合的增强模块,用获取的照度和场景纹理注意力估计图引导图像亮度提升和噪声抑制,并将得到的全局增强结果划分成图像块进行局部优化,提升增强性能,有效避免了局部欠增强和过增强的问题。结果 将本文算法与2种传统方法和4种深度学习算法比较,主观视觉和客观指标均表明本文增强结果在亮度、对比度以及噪声抑制等方面取得了优异的性能。在VV（Vasileios Vonikakis）数据集上,本文方法的BTMQI（blind tone-mapped quality index）和NIQMC（no-reference image quality metric for contrast distortion）指标均达到最优值;在178幅普通低照度图像上本文算法的BTMQI和NIQMC均取得次优值,但纹理突出和噪声抑制优势显著。结论 大量定性及定量的实验结果表明,本文方法能有效提升图像亮度和对比度,且在突出暗区纹理时,能有效抑制噪声。本文方法用于极低照度图像时,在色彩还原、细节纹理恢复和噪声抑制方面均具有明显优势。代码已共享在Github上：https://github.com/shuanglidu/LLIE_CEIST.git。     

Video color conceptualization using optimization

Color conceptualization aims to propagate"color concepts"from a library of natural color images to the input image by changing the main color.However,the existing method may lead to spatial discontinuities in images because of the absence of a spatial consistency constraint.In this paper,to solve this problem,we present a novel method to force neighboring pixels with similar intensities to have similar color.Using this constraint,the color conceptualization is formalized as an optimization problem with a quadratic cost function.Moreover,we further expand two-dimensional(still image)color conceptualization to three-dimensional(video),and use the information of neighboring pixels in both space and time to improve the consistency between neighboring frames.The performance of our proposed method is demonstrated for a variety of images and video sequences.     

场景化立体空间色彩饱和度动态修正仿真研究

当前立体空间色彩饱和度修正方法,受到噪声干扰导致图像空间的光照信息计算失准,造成低动态范围图像空间色彩饱和度失衡,从而需要二次修正,存在修正耗时较长、成本较高、且图像细节信息模糊的问题。据此提出场景化立体空间色彩饱和度动态修正方法,采用Retinex图像增强算法加入全局自适应亮度调节以及去噪环节,对图像亮度分量进行增强处理,在求解反射分量的过程中,保留场景化立体空间中的光照信息,以完成图像的预处理。将经过预处理的彩色图像压缩到普通显示器能够显示的范围内,采用阶跃方程对低动态范围内场景化立体空间色彩饱和度进行动态调整,实现场景化立体空间色彩饱和度动态修正。仿真结果表明,所提方法修正耗时较短、成本较低,并且能够更好的保存图像的细节信息。     

Content-based retrieval of logo and trademarks in unconstrained color image databases using Color Edge Gradient Co-occurrence Histograms

In this paper, we present an algorithm that extends the Color Edge Co-occurrence Histogram (CECH) object detection scheme on compound color objects, for the retrieval of logos and trademarks in unconstrained color image databases. We introduce more accurate information to the CECH, by virtue of incorporating color edge detection using vector order statistics. This produces a more accurate representation of edges in color images, as compared to the simple color pixel difference classification of edges seen with the CECH. Our proposed method is thus reliant on edge gradient information, and so we call it the Color Edge Gradient Co-occurrence Histogram (CEGCH). We also introduce a color quantization method based in the hue–saturation–value (HSV) color space, illustrating that it is a more suitable scheme of quantization for image retrieval, compared to the color quantization scheme introduced with the CECH. Experimental results demonstrate that the CEGCH and the HSV color quantization scheme is insensitive to scaling, rotation, and partial deformations, and outperforms the use of the CECH in image retrieval, with higher precision and recall. We also perform experiments on a closely related algorithm based on the Color Co-occurrence Histogram (CCH) and demonstrate that our algorithm is also superior in comparison, with higher precision and recall.     

基于颜色恒常性的低照度图像视见度增强

在彩色成像过程中,低照度是导致图像降质的一个重要因素. 本文提出了一种新的基于颜色恒常性的低照度图像视见度增强算法. 为了避免场景光源的影响,提出了像素有效集的概念. 基于灰色调算法的灰度像素假设,利用有效像素估计光 照的颜色;在后处理阶段,利用有效像素的灰度级范围确定直方图剪裁的上下限. 实验表明,算法有效地校正了图像 的颜色、对比度和亮度,从而增强了图像的视见度,且不会产生Retinex 算法所固有的灰化效应和Halo 效应.     

Appearance-based visual learning and object recognition with illumination invariance

This paper describes a method for recognizing partially occluded objects under different levels of illumination brightness by using the eigenspace analysis. In our previous work, we developed the “eigenwindow” method to recognize the partially occluded objects in an assembly task, and demonstrated with sufficient high performance for the industrial use that the method works successfully for multiple objects with specularity under constant illumination. In this paper, we modify the eigenwindow method for recognizing objects under different illumination conditions, as is sometimes the case in manufacturing environments, by using additional color information. In the proposed method, a measured color in the RGB color space is transformed into one in the HSV color space. Then, the hue of the measured color, which is invariant to change in illumination brightness and direction, is used for recognizing multiple objects under different illumination conditions. The proposed method was applied to real images of multiple objects under various illumination conditions, and the objects were recognized and localized successfully.     

Automatic selection of color reference image for panoramic stitching

Color correction is an important step in the generation of high-resolution stitched panoramas. Typically, color correction schemes try to match the color of each image in the panorama to an arbitrarily selected reference image. We provide a scheme that uses quantitative metrics such as image contrast, gradient-based structure similarity index measure (G-SSIM) and color clipping information to automatically select the best reference that results in visually pleasing output panoramas. Quantitative and qualitative evaluation of the scheme show encouraging results for panoramic images as well as for stitched videos. The scheme acts as a pre-processing step to color correction and its applicability to both parametric and non-parametric global color correction schemes has also been demonstrated.     

结合内外先验知识的低照度图像增强与去噪算法

目的 现有大多数低照度图像增强算法会放大噪声,且用于极低照度图像时会出现亮度提升不足、色彩失真等问题。为此,提出一种基于Retinex(retina cortex)的增强与去噪方法。方法 为了增强极低照度图像,首先利用暗通道先验原理估计场景的全局光照,若光照低于0.5,对图像进行初始光照校正;其次,提出一种Retinex顺序分解模型,使低照度图像中的噪声均体现在反射分量中,基于分解结果,利用Gamma校正求取增强后的噪声图像;最后,提出一种基于内外双重互补先验约束的去噪机制,利用非局部自相似性原理为反射分量构建内部先验约束,基于深度学习,为增强后的噪声图像构建外部先验约束,使内外约束相互制约。结果 将本文算法与6种算法比较,在140幅普通低照度图像和162幅极低照度图像上（有正常曝光参考图像）进行主观视觉和客观指标评价比较,结果显示本文方法在亮度提升、色彩保真及去噪方面均有明显优势,对于普通低照度图像,BTMQI(blind tone-mapped quality index)和NIQE(natural image quality evaluator)指标均取得次优值,对于极低照度图像...     

Background subtraction model based on color and depth cues

Background subtraction consists of segmenting objects in movement in a video captured by a static camera. This is typically performed using color information, but it leads to wrong estimations due to perspective and illumination issues. We show that multimodal approaches based on the integrated use of color and depth cues produce more accurate and robust results than using either data source independently. Depth is less affected by issues such as shadows or foreground objects similar to background. However, objects close to the background may not be detected when using only range information, being color information complementary in those cases. We propose an extension of a well-known background subtraction technique which fuses range and color information, as well as a post-processing mask fusion stage to get the best of each feature. We have evaluated the method proposed using a well-defined dataset and different disparity estimation algorithms, showing the benefits of our method for fusion color and depth cues.     

几种彩色模型在不同光照条件下的稳定性分析

彩色图象虽然比灰度图象多了一个色彩信息，但在彩色图象的获得过程中往往容易受到环境光线的干扰，这对彩色图象的处理和分析带来很大的困难，本文利用二色反射模型对几种彩色模型的光照稳定性进行了分析，然后用颜色试验进行了验证，结果表明，rgb和HS在白光下具有光强不变性，mlm2m3在不同强度和颜色的光照下都表现了较高的稳定性，经改进的m1m2m3(n1n2n3)减弱了噪点的影响，稳定性更好。     

基于彩色图像的色系坐标变换的面部定位与跟踪法

文中通过对彩色图像的色彩因素的分析,得出了关于色度与彩色坐标系的关系,建立了相应的肤色,唇色色系的坐标变换方法,基于这种坐标系,可以通过简单的阈值 定,得到彩色图像的人睑面部定位与跟踪的方法,此方法能有效、稳健地测得目标的位置,不受对象姿态、背景的影响,通过在线学习还可以支除光照条件变化的影响及摄像设备的影响,它是利用彩色图像中对亮度信息规一化处理后、提取出来的相对稳定的色义来检测和确定目标,进行