Image fusion and subpixel parameter estimation for automatedoptical inspection of electronic components

The authors present a new approach to automated optical inspection (AOI) of circular features that combines image fusion with subpixel edge detection and parameter estimation. In their method, several digital images are taken of each part as it moves past a camera, creating an image sequence. These images are fused to produce a high-resolution image of the features to be inspected. Subpixel edge detection is performed on the high-resolution image, producing a set of data points that is used for ellipse parameter estimation. The fitted ellipses are then back-projected into 3-space in order to obtain the sizes of the circular features being inspected, assuming that the depth is known. The method is accurate, efficient, and easily implemented. The authors present experimental results for real intensity images of circular features of varying sizes. Their results demonstrate that their algorithm shows greatest improvement over traditional methods in cases where the feature size is small relative to the resolution of the imaging device     

基于多分辨率Trace变换的纹理图像分类

针对Trace变换提取的图像特征缺乏对纹理边缘信息描述和计算代价高的问题,利用小波变换对图像轮廓的表征优势,提出了多分辨率Trace变换并应用于纹理图像分类.首先,将小波变换引入到Trace变换中,对纹理图像进行非下采样小波变换,得到不同频率的低频特征子图及高频边缘子图;其次,在各级子图上进行一组泛函的Trace变换,获取纹理图像的融合特征,在获得图像边缘信息的同时避免了Trace变换不同泛函组合计算代价过高的问题;最后,把融合特征送入支持向量机对图像进行分类.实验结果表明,对图像采用多分辨率Trace变换提取的融合特征具有更好的纹理描述能力,相对于传统Trace变换及MCM等对比方法具有更高的鉴别性能,且在时间效率上相对于传统Trace变换有大幅提升.     

Fusing integrated visual vocabularies-based bag of visual words and weighted colour moments on spatial pyramid layout for natural scene image classification

The bag of visual words (BOW) model is an efficient image representation technique for image categorization and annotation tasks. Building good visual vocabularies, from automatically extracted image feature vectors, produces discriminative visual words, which can improve the accuracy of image categorization tasks. Most approaches that use the BOW model in categorizing images ignore useful information that can be obtained from image classes to build visual vocabularies. Moreover, most BOW models use intensity features extracted from local regions and disregard colour information, which is an important characteristic of any natural scene image. In this paper, we show that integrating visual vocabularies generated from each image category improves the BOW image representation and improves accuracy in natural scene image classification. We use a keypoint density-based weighting method to combine the BOW representation with image colour information on a spatial pyramid layout. In addition, we show that visual vocabularies generated from training images of one scene image dataset can plausibly represent another scene image dataset on the same domain. This helps in reducing time and effort needed to build new visual vocabularies. The proposed approach is evaluated over three well-known scene classification datasets with 6, 8 and 15 scene categories, respectively, using 10-fold cross-validation. The experimental results, using support vector machines with histogram intersection kernel, show that the proposed approach outperforms baseline methods such as Gist features, rgbSIFT features and different configurations of the BOW model.     

A hierarchical approach to feature extraction and grouping

In this paper, the problem of extracting and grouping image features from complex scenes is solved by a hierarchical approach based on two main processes: voting and clustering. Voting is performed for assigning a score to both global and local features. The score represents the evidential support provided by input data for the presence of a feature. Clustering aims at individuating a minimal set of significant local features by grouping together simpler correlated observations. It is based on a spatial relation between simple observations on a fixed level, i.e., the definition of a distance in an appropriate space. As the multilevel structure of the system implies that input data for an intermediate level are outputs of the lower level, voting can be seen as a functional representation of the "part-of" relation between features at different abstraction levels. The proposed approach has been tested on both synthetic and real images and compared with other existing feature grouping methods.     

利用灰度和纹理特征的SAR图像分类研究

多类别多特征量情况下的合成孔径雷达(SAR)图像的目标分类是一个难以解决的问题.从灰度和纹理模型出发,提出了综合利用灰度和纹理特征的目标分类方法.均值和方差是灰度模型中重要的特征统计量,而能量、熵、对比度、局部相似性和相关性是纹理模型中重要的特征统计量.灰度和纹理特征能确切地描述SAR图像中的目标.通过构造特征向量,定义向量之间的距离,并按照最小距离方法进行目标分类.以一定大小的窗口读入样本,提高了算法的运行速度和抗噪能力.理论上,窗口越大,特征向量值越接近真实值.窗口越小,边缘的分类精度越高.实验表明该方法较好地处理了多类别多特征量情况下的SAR图像分类问题,分类结果是有效的,这为SAR图像目标分类提供了一条简单可行的途径.     

Deformable shape finding with models based on kernel methods.

In this paper, a new kernel-based deformable model is proposed for detecting deformable shapes. To incorporate valuable information for shape detection, such as edge orientations into the shape representation, a novel scheme based on kernel methods has been utilized. The variation model of a deformable shape is established by a set of training samples of the shape represented in a kernel feature space. The proposed deformable model consists of two parts: a set of basis vectors describing the sample subspace, including the shape representations of the training samples, and a feasibility constraint generated by the one-class support vector machine to describe the feasible region of the training samples in the sample subspace. The aim of the proposed feasibility constraint is to avoid finding some invalid shapes. By using the proposed deformable model, an efficient algorithm without initial solutions is developed for shape detection. The proposed approach was tested against real images. Experimental results show the effectiveness of the proposed deformable model and prove the feasibility of the proposed approach.     

多方向多尺度Gabor特征表示及其匹配算法

Gabor滤波是众所周知的一类特征提取方法,在机器视觉等领域得到了广泛研究和应用.本文提出了一种多方向多尺度Gabor特征表示、提取以及其匹配算法.多方向多尺度Gabor特征通过使用一组不同尺度和不同方向的Gabor滤波器对图像进行滤波,而后将滤波结果在各个滤波方向按尺度大小排序后连接而成.本文进一步提出了循环向量的概念,并将两个多方向多尺度Gabor特征相似度重新定义为一个多方向多尺度Gabor特征和对应的多个循环向量之间最大值.实验结果表明,本文提出的多方向多尺度Gabor特征不仅具有平移不变性、旋转不变性、尺度不变性,也展现出优秀的局部特征表示能力以及显著的鉴别力.     

基于二维Gabor小波的人脸识别算法

该文提出了一种基于二维Gabor小波的人脸识别算法。该算法先对人脸图像进行多分辨率的Gabor小波变换,然后在图像上放置一组网格结点,每个结点用该结点处的多尺度Gabor幅度特征描述,采用主元分析法对每个结点进行去相关、降维,最后形成特征结。把每个特征结作为观测向量,对隐马尔可夫模型进行训练,并把优化的模型参数用于人脸识别。实验结果表明,该方法识别率高,复杂度较低。     

基于渐进式生成对抗网络的舰船红外图像仿真

红外图像仿真在红外导引头设计、仿真训练中起到十分关键的作用。针对如何生成高分辨率、视觉特征可控的红外图像,提出了一种基于渐进式生成对抗网络的红外图像仿真方法。本文利用舰船模型的红外图像数据集训练了图像合成网络,输入随机特征向量,输出高分辨率的红外仿真图像;设计了图像编码网络,实现红外图像到特征向量的转换;利用Logistic回归方法,在特征向量域找到了控制红外图像角度特征的方向向量,并据此生成了不同角度的舰船模型仿真图像;最后通过均值哈希算法和平均结构相似性算法来定量评价仿真图像和真实图像的差异,实验结果表明仿真的红外图像和真实图像的相似度很高,可以为真实舰船的可控化红外图像仿真提供参考。     

Learned local Gabor patterns for face representation and recognition

In this paper, we propose Learned Local Gabor Patterns (LLGP) for face representation and recognition. The proposed method is based on Gabor feature and the concept of texton, and defines the feature cliques which appear frequently in Gabor features as the basic patterns. Different from Local Binary Patterns (LBP) whose patterns are predefined, the local patterns in our approach are learned from the patch set, which is constructed by sampling patches from Gabor filtered face images. Thus, the patterns in our approach are face-specific and desirable for face perception tasks. Based on these learned patterns, each facial image is converted into multiple pattern maps and the block-based histograms of these patterns are concatenated together to form the representation of the face image. In addition, we propose an effective weighting strategy to enhance the performances, which makes use of the discriminative powers of different facial parts as well as different patterns. The proposed approach is evaluated on two face databases: FERET and CAS-PEAL-R1. Extensive experimental results and comparisons with existing methods show the effectiveness of the LLGP representation method and the weighting strategy. Especially, heterogeneous testing results show that the LLGP codebook has very impressive generalizability for unseen data.     

基于相关反馈的一种加权距离法

在基于内容的图像检索系统中我们经常使用一些底层特征,如表现图像的颜色和文本信息.如果给出了这些特征的内容,如特征向量,我们就可以通过计算特征空间的距离测量出图像之间的相似度.然而,这些底层特征并不一定能反映人的视觉中高层概念的相似度.相关反馈技术就是通过交互检索来提高检索性能,在数据库的搜索中参考了用户的反馈信息.因此...     

累积结构特征描述的多模态遥感影像匹配

针对相位一致性图大部分特征值为零且易受噪声干扰,导致其构造的多模态图像特征描述子能力有限的问题,提出了一种累积结构特征图(Cumulative Structural Feature,CSF)构造及其特征描述子建立方法,通过增强图像结构来提高特征点描述子的辨识能力。首先,采用Log-Gabor奇对称滤波器提取多模态图像多个尺度和方向的边缘结构特征,通过特征信号平方和归一化构造CSF,增强图像的结构相似性,并直接在CSF上提取特征点;再利用多个尺度和方向的边缘结构信息构造方向特征图;最后,结合CSF和方向特征图建立特征描述子,提高描述子的辨识能力。六种场景的多模态图像匹配实验表明,与其他方法的最好结果相比,所提方法的平均正确匹配数量提升了27.07%,平均正确率提升了2.26%,且增强了对场景的适应能力。     

结构保持的双边滤波极化SAR图像降噪

针对极化合成孔径雷达(Polarimetric Synthetic Aperture Radar, PolSAR)图像相干斑抑制时结构保持的难题,该文提出一种PolSAR图像的双边滤波算法:结构保持的双边滤波(SPBF)。该算法通过结合边缘结构特征和地物散射特性,增强对PolSAR图像结构信息的描述,减少滤波时图像结构信息的损失,实现滤波性能的提高。该算法首先使用边缘检测模板在极化总功率图像(Span)上提取边缘方向,实现自适应选择滤波方向窗;其次,采用Freeman-Durden分解获取像素的散射机制,并根据极化数据的统计分布特性获取地物散射的聚类标记;最终在所选的方向窗中,以聚类标记图为掩膜,利用改进的双边滤波算法对PolSAR数据进行相干斑抑制。真实SAR数据的实验结果表明,该方法能够有效抑制相干斑噪声,同时提高了对图像的边缘、强点目标和极化散射特性的保持能力。     

A Pattern Similarity Scheme for Medical Image Retrieval

In this paper, we propose a novel scheme for efficient content-based medical image retrieval, formalized according to the PAtterns for Next generation DAtabase systems (PANDA) framework for pattern representation and management. The proposed scheme involves block-based low-level feature extraction from images followed by the clustering of the feature space to form higher-level, semantically meaningful patterns. The clustering of the feature space is realized by an expectation–maximization algorithm that uses an iterative approach to automatically determine the number of clusters. Then, the 2-component property of PANDA is exploited: the similarity between two clusters is estimated as a function of the similarity of both their structures and the measure components. Experiments were performed on a large set of reference radiographic images, using different kinds of features to encode the low-level image content. Through this experimentation, it is shown that the proposed scheme can be efficiently and effectively applied for medical image retrieval from large databases, providing unsupervised semantic interpretation of the results, which can be further extended by knowledge representation methodologies.      

一种基于多级空间视觉词典集体的图像分类方法

针对单一特征时存在提取的信息量不足,对图像内容描述比较片面,提出将传统的SIFT特征与KDES-G特征进行串行融合,生成一个联合向量作为新的特征向量.针对传统的视觉词典构造方法缺乏考虑视觉词汇在空间的分布特点,本文引入图像空间信息,提出了一种空间视觉词典的构造方法,先对图像进行空间金字塔划分,再把空间各子区域内的特征分别聚类,构建属于对应子空间区域的空间视觉词典.在图像表示阶段,图像各子区域内的特征基于其对应的空间视觉词典进行LLC稀疏编码,根据各子区域对图像贡献程度的不同,把编码后各子区域的特征向量赋予不同的权重加权处理,再连接形成最终的图像描述.最后,利用线性SVM进行图像分类,实验结果表明了本文方法的有效性和鲁棒性.     

基于原型理论的极化SAR图像特征表达

该文提出一种基于原型理论的极化SAR图像表达方法。该方法首先利用原型理论构建原型集,然后以正则化逻辑回归函数计算测试样本与每个原型集的相似度,最后通过集成投影获得图像的特征表达。在极化SAR数据上的非监督分类实验结果表明,该方法能够准确表达图像中各类地物的极化特性,达到较好的分类效果。      

Adaptive segmentation of textured images by using the coupled Markov random field model.

Although simple and efficient, traditional feature-based texture segmentation methods usually suffer from the intrinsical less inaccuracy, which is mainly caused by the oversimplified assumption that each textured subimage used to estimate a feature is homogeneous. To solve this problem, an adaptive segmentation algorithm based on the coupled Markov random field (CMRF) model is proposed in this paper. The CMRF model has two mutually dependent components: one models the observed image to estimate features, and the other models the labeling to achieve segmentation. When calculating the feature of each pixel, the homogeneity of the subimage is ensured by using only the pixels currently labeled as the same pattern. With the acquired features, the labeling is obtained through solving a maximum a posteriori problem. In our adaptive approach, the feature set and the labeling are mutually dependent on each other, and therefore are alternately optimized by using a simulated annealing scheme. With the gradual improvement of features' accuracy, the labeling is able to locate the exact boundary of each texture pattern adaptively. The proposed algorithm is compared with a simple MRF model based method in segmentation of Brodatz texture mosaics and real scene images. The satisfying experimental results demonstrate that the proposed approach can differentiate textured images more accurately.     

基于非负矩阵分解的SAR图像目标识别

 特征提取是合成孔径雷达自动目标识别的关键技术,同时也是难点问题之一。本文提出了一种基于非负矩阵分解算法与Fisher线性判别方法的合成孔径雷达图像目标识别的方法,通过基于基向量非负加权组合的形式构建SAR目标图像,能充分利用目标的局部空间结构信息提取目标特征信息实现目标识别。首先将水平集分割预处理后的SAR目标图像样本构成初始矩阵,然后利用非负矩阵分解后得到的权向量作为目标图像的特征向量,再通过依据Fisher线性判别构成的分类器,实现对MSTAR数据中3类目标的识别,并与目前已有的几种典型方案进行对比。试验结果表明该方法是可行且有效的,并能够明显提高对目标识别的稳定性和正确率。