基于颜色传递的双波段目标跟踪算法研究

针对复杂背景下Camshift算法容易丢失目标的情况,提出一种基于YCBCR空间将红外与可见光融合图像与彩色参考图像进行颜色传递后,采用Camshift进行目标跟踪的算法。该算法在颜色传递时充分利用双波段图像信息,得到的目标对比度高并且颜色空间较其周围背景突出,增强了目标的颜色概率图,提高了Camshift算法效率。实验表明,通过对可见光图像、经颜色传递后的红外图像以及传统颜色传递方法得到的图像采用相同跟踪算法进行定性分析,在该算法得到的图像中,跟踪窗口中心相对于目标质心仅有3个像素的误差,跟踪精度远远优于对比实验图像的跟踪结果,并且算法的跟踪时间为每帧20.6 ms,达到了实时性的要求。     

基于非下采样Shearlet变换与剥离策略的可见光与红外图像融合算法北大核心CSCD

为了使可见光与红外融合图像能更好的表达目标信息,联合非下采样Shearlet变换与剥离策略,对其进行融合。首先,借助非下采样Shearlet变换,获取可见光与红外图像的高、低频成分。然后,通过Otsu阈值分割方法来构建剥离策略,将红外图像中的目标层与其背景层进行剥离,并以目标层为基础,利用图像的区域能量特征,对可见光图像与红外图像背景层的低频系数进行加权计算,并将结果与红外图像的目标层结合,以得到富含目标内容和背景内容的融合低频系数。引入区域方差函数,对图像的细节特征进行测算,通过构造方差加权因子,得到富含细节特征的融合高频系数。最后,对两个融合系数实施非下采样Shearlet逆变换,从而输出融合图像。实验结果显示,本算法融合的图像,比现有融合算法融合的图像更具优良的目标及细节表达能力,可用于获取高质量的可见光与红外融合图像。     

一种基于算法融合的红外目标跟踪方法

视频目标跟踪的难点在于快速、准确地在帧与帧之间匹配目标.由于红外图像目标与背景的反差低,图像的边缘模糊并且灰度级动态范围小,使红外目标跟踪难度比可见光更大.本文提出一种针对红外日标跟踪的融合算法,该方法融合直方图和不变矩的特点.首先利用目标的直方图计算简单快速的特点,由均值平移算法快速找到局部最优解,但由于该局部最优解仪为直方图匹配的最优解,缺少目标形状特征,与实际目标位置存在一定的偏差;其次,利用边缘小变矩作为修正特征修正误差,避免跟踪误差逐渐累计而最终导致跟踪失败,以提高跟踪的稳定性和精度.实验结果表明,该算法能够消除跟踪过程中的漂移现象,提高跟踪精度.     

基于加权mean-shift可见光/红外双通道目标跟踪

为提高目标亮度突变时的跟踪性能,在每一帧进行目标跟踪时,首先提取可见光图像的颜色特征,红外图像的垂直投影图像和水平投影图像特征,然后利用可见光/红外各自通道的Bhattacharyya系数计算该通道的权值,并对加权mean-shift双通道跟踪方法进行了推导,提出了基于加权mean-shift可见光/红外双通道目标跟踪算法.该方法使前后两帧目标相似度大的通道取大的权值,从而达到有效利用各通道有利信息、提高跟踪性能的目的.实验表明,用本文提出的算法进行可见光/红外双通道目标跟踪时,与基于mean-shift单通道(可见光或红外)目标跟踪算法相比,可提高目标跟踪的准确度,特别是当目标进入树荫区域,引起目标亮度发生显著变化时,跟踪性能基本不受影响.     

复杂天空背景下的红外弱小目标跟踪

为解决传统跟踪算法不能有效区分复杂天空云层背景边缘和红外弱小目标,从而在跟踪过程中产生“偏移”的问题。在时空上下文原理基础上分析跟踪“偏移”的原因,引入高斯曲率滤波,提出一种改进的时空上下文红外弱小目标跟踪算法。该算法首先采用高斯曲率滤波对上下文区域进行预处理,在保留上下文区域背景边缘的同时剔除高频的红外弱小目标和噪声,从而获得准确的红外弱小目标置信图,利用红外弱小目标置信图估计出红外弱小目标位置。采用四组复杂天空背景下的红外弱小目标图像序列进行实验,并与经典的模板匹配算法、基于粒子滤波的均值漂移算法和快速压缩跟踪算法三种跟踪算法作比较。实验结果表明,算法在主观视觉和客观评价指标方面均优于其他三种算法,具有更高的目标跟踪精度与较好的实时性,可以实现对复杂天空背景下红外弱小目标的有效跟踪。     

基于多特征融合的复杂背景下弱小多目标检测和跟踪算法

针对红外弱小多目标的检测和跟踪难题,提出一种基于多特征融合的复杂背景下弱小多目标检测和跟踪算法.融合红外弱小运动目标的灰度特征、梯度特征、运动特征等多个典型特性,进行复杂背景下弱小多目标的检测和跟踪.实验证明:该算法应用于复杂背景下低信噪比的红外弱小多目标图像序列能得到较理想的结果,算法检测概率高、检测速度快、具有较强鲁棒性.     

一种基于区域特性的红外与可见光图像融合算法

提出了一种基于区域分割和à trous小波变换的红外与可见光图像融合算法.首先,对红外与可见光图像进行区域分割及区域关联,并按关联映射图所划分区域提取红外与可见光图像的的能量信息及梯度信息;然后,对红外与可见光图像进行多尺度à trous小波变换分解,分解后的低频部分按照文中所提出的区域能量比和区域清晰比指标进行区域融合,高频部分采用绝对值取大算子进行融合;最后进行重构得到融合图像.结果表明,该算法既可保持可见光图像的光谱信息,又可有效获取红外图像的热目标信息.     

海天复杂背景下红外目标的检测跟踪算法

在分析海天复杂背景下红外目标图像特征的基础上,提出适合该环境的红外目标检测算法.该算法采用行均值相减的方法抑制海平面非线性温度场的影响,并进行中值滤波处理.对于更加复杂的环境,选用数学形态滤波法抑制背景中的大面积云团或海浪,从而确定出目标区域来进行目标图像的分割及增强.同时,综合使用图像捕获区域指定、运动目标检测法、弱目标的增强提取、记忆外推功能、数据融合加权跟踪方法,来保证在海天复杂背景下红外目标的可靠跟踪.实验表明,该算法能较好地处理海天复杂背景下红外目标的检测,且算法易于硬件实现,提高目标检测的实时效率.     

双机IRST配准融合图像的弱小目标检测方法

针对单机红外搜索跟踪（IRST）系统探测距离和精度有限,得到的红外图像在杂乱背景和强噪声环境中弱小目标难以检测的问题,采用双机IRST对同时刻同目标区域探测后的图像进行配准融合,融合过程中采用高频基于区域、低频基于像素的多规则算法,提出一种基于小波变换与边缘信息表征的目标检测方法。仿真实验表明,多规则融合算法使图像质量评价指标提高了30%～50%,该目标检测方法可有效剔除虚假目标及滤除杂波干扰,从融合滤波前的7个减少到3个,虚警率降低,有助于弱小目标更为精确的检测识别。     

基于双模态融合网络的目标检测算法

针对红外图像和可见光图像的融合目标检测问题,提出一种基于双模态融合网络的目标检测算法。在同时输入红外和可见光图像对后,利用设计的红外编码器提取红外图像空间特征信息;通过设计的可见光编码器将可见光图像从垂直和水平两个空间方向聚合特征,通过精确的位置信息对通道关系进行编码;最后,采用提出的门控融合网络自适应调节两路特征的权重分配,实现跨模态特征融合。在KAIST行人数据集上,与基准算法YOLOv5-n单独检测可见光图像和红外图像的结果相比,所提算法检测精度分别提升15.1%和2.8%;与基准算法YOLOv5-s相比,检测精度分别提升14.7%和3%;同时,检测速度在两个不同基准算法模型上分别达到117.6 FPS和102 FPS。在自建的GIR数据集上,所提算法的检测精度和速度也同样具有明显优势。此外,该算法还能对单独输入的可见光或红外图像进行目标检测,且检测性能与基准算法相比有明显提升。     

Region-based fusion of infrared and visible images using nonsubsampled contourlet transform

With the nonsubsampled contourlet transform (NSCT), a novel region-segmentation-based fusion algorithm for infrared (IR) and visible images is presented.The IR image is segmented according to the physical features of the target.The source images are decomposed by the NSCT, and then, different fusion rules for the target regions and the background regions are employed to merge the NSCT coefficients respectively.Finally, the fused image is obtained by applying the inverse NSCT.Experimental results show that the proposed algorithm outperforms the pixel-based methods, including the traditional wavelet-based method and NSCT-based method.     

The infrared and visible image fusion algorithm based on target separation and sparse representation

Although the fused image of the infrared and visible image takes advantage of their complementary, the artifact of infrared targets and vague edges seriously interfere the fusion effect. To solve these problems, a fusion method based on infrared target extraction and sparse representation is proposed. Firstly, the infrared target is detected and separated from the background rely on the regional statistical properties. Secondly, DENCLUE (the kernel density estimation clustering method) is used to classify the source images into the target region and the background region, and the infrared target region is accurately located in the infrared image. Then the background regions of the source images are trained by Kernel Singular Value Decomposition (KSVD) dictionary to get their sparse representation, the details information is retained and the background noise is suppressed. Finally, fusion rules are built to select the fusion coefficients of two regions and coefficients are reconstructed to get the fused image. The fused image based on the proposed method not only contains a clear outline of the infrared target, but also has rich detail information.     

运动背景下弱小目标的提取算法

 对低信噪比运动背景下序列图像中弱小目标的提取算法进行了研究，提出一种新的目标提取算法。根据运动背景的相关性和目标运动的连续性，采用背景模板匹配技术，计算各帧背景运动量，去除复杂背景，用自适应预估和阈值分割技术捕获跟踪目标。实验中，结合所研究的算法，对100帧包含低对比度弱小目标的运动图像序列进行了处理。实验结果表明，此方法能有效地实现目标的自动捕获与跟踪，跟踪效率高，跟踪稳定。     

One color contrast enhanced infrared and visible image fusion method

Color constancy (Toet and Franken, 2003 [2]; Toet, 2003 [7]) and color contrast (Scribner et al., 2000 [21]; Lee et al., 2005 [23]) are two important topics for color image fusion. The paper focuses on the low color contrast problem of linear fusion algorithms with color transfer method. Color transfer technology is popular in infrared (IR) and visible image fusion to give the fused image a natural day-time color appearance (Toet, 2003 [7]; Wang et al., 2007 [8]; Zheng and Essock, 2008 [9]). However, in the color transfer step, all three channels of the color space are processed with the same linear mapping without color enhancement, resulting in low color contrast between the target and the background (Wang et al., 2007 [8]). Based on the characteristics of the IR image, we introduce a ratio of local to global divergence of the IR image to improve the color contrast. The enhancement ratios for both hot and cold targets are larger than one, while it tends to one for the background. As a result, the proposed method pops out both hot and cold targets in color, where hot targets will appear intense red, and cold targets will appear cyan. Subjective results show visible color contrast enhancement effects. Target detection experiments through hue and saturation components of the fused image show an improvement in the hit rate for target detection, owing to larger color distance between the target and the background.     

基于深度玻尔兹曼模型的红外与可见光图像融合

为了克服红外与可见光图像融合时噪声干扰及易产生伪影导致目标轮廓不鲜明、对比度低的缺点,提出一种基于深度模型分割的图像融合方法.首先,采用深度玻尔兹曼机学习红外与可见光的目标和背景轮廓先验,构建轮廓的深度分割模型,通过Split Bregman迭代算法获取最优能量分割后的红外与可见光图像轮廓;然后再使用非下采样轮廓波变换对源图像进行分解,并针对所分割的背景轮廓采用结构相似度的规则进行系数组合;最后进行非下采样轮廓波反变换重构出融合图像.数值试验证明,该算法可以有效获取目标和背景轮廓均清晰的融合图像,融合结果不但具有较高的对比度,还能抑制噪声影响,具有有效性.     

Infrared (IR) image synthesis method of IR real background and modeled IR target

An infrared (IR) image synthesis method is proposed for the synthesis of a real IR background and modeled IR target, used as IR signatures, as well as a band-transformation between short wave IR (SWIR), middle wave IR (MWIR), and long wave IR (LWIR) in an IR imaging system simulation. IR target images are created by the RadThermIR software, an IR signature prediction software. Individual radiances for IR signatures, corresponding to the max/min temperatures of a real IR background and modeled IR target image, are calculated with Planck’s law. First, an IR background of an arbitrary wavelength band is transformed to one of the other wavelength bands with the temperature-radiance characteristics. And then, after adjusting the gray levels of the arbitrary IR target signatures based on their radiances for the wavelength band of the transformed IR background, these IR target and background signatures can be synthesized as one image for a specific wavelength band. The experimental results show that the modeled IR target images, such as a modeled helicopter and F16, can be synthesized on the IR background images of three IR wavelength bands. And we confirmed that IR background images of the three IR wavelength bands can diversely be synthesized with the modeled IR targets as the setting temperature of the target and background, the target distance, and the field of view (FOV) arbitrarily.     

Effective and robust infrared small target detection with the fusion of polydirectional first order derivative images under facet model

The robust detection of IR small target acts as one of the key techniques in the infrared search and tracking system (IRSTS). This paper presents a new method of small-target detection which formulates the problem as the detection of Gaussian-like spot. Initially, the amendatory first-order directional derivative (AFODD) based on facet model is applied to get the polydirectional derivative IR images, and the direction information of targets is reserved in these images. Then, the AFODD images are fused together to ensure the robustness and effectiveness of target detection. At last, the Principal Component Analysis (PCA) method is carried out to make targets in the fusion image more prominent, so that they can be extracted out by a simple threshold segmentation. Experiment results show that the presented method performs well even in the IR images with complex backgrounds.     

一种新的热红外图像生成方法研究

针对目标与背景热红外辐射特性的描述是否精确将直接影响到红外导引头对目标的发现、识别和跟踪水平，在分析热红外图像再现技术原理的基础上，按照所需再现热图像的灰度分布特征制成相应透射水平的热图底片，提出了一种利用不同透射能力涂层生成热图像的方法。借助热红外图像再现实验和图像相关系数算法，证明该方法能较好地再现目标以及背景的热红外辐射特征和细节。它不仅可用于热红外导引头和热成像仪性能的检测及评估，同时也为军用目标的热红外隐真和示假方法提供了一种新的技术途径。     

实时多运动目标提取与跟踪研究

介绍一种静止背景条件下实时多运动日标提取与跟踪的方法。使用了单模态背景模型,用连通检测的方法分割出目标,取得目标信息,采用特征参数匹配的方法跟踪目标。对实际中出现的目标停止移动、被背景遮掩和相交运动等情况做了分析。通过采集的图像序列证实采用所提出的运动日标提取与跟踪算法可获得良好效果。