A novel local octa-pattern feature descriptor for image retrieval

The local tetra patterns (LTrPs) gives four-directional information and ignores the diagonal pixel information, thereby affecting the retrieved image efficiency. In the present work, a novel retrieval approach has been proposed using local octa-patterns (LOcPs) for content-based image indexing and retrieval. The proposed approach encodes the center pixel directional information with its eight adjacent neighbors, from the directions that are computed using the first-order derivatives. Also the nth-order LOcP is computed using \((n-1)\)th-order local direction variations. In addition, the performance of the developed method by combining it with the Gabor transform has been analyzed. The performance of the proposed technique has been compared to existing techniques like LBP, LTP, LDP, and LTrP on Corel-1000 database (DB1) and Describable Textures Dataset (DB2). The performance observed shows that the developed method improves the retrieval parameters from 75.9%/77.13% to 79.4%/81.5% in the form of average precision on DB1/DB2 databases.     

Local maximum edge binary patterns: A new descriptor for image retrieval and object tracking

A new algorithm meant for content based image retrieval (CBIR) and object tracking applications is presented in this paper. The local region of image is represented by local maximum edge binary patterns (LMEBP), which are evaluated by taking into consideration the magnitude of local difference between the center pixel and its neighbors. This LMEBP differs from the existing LBP in a manner that it extracts the information based on distribution of edges in an image. Further, the effectiveness of our algorithm is confirmed by combining it with Gabor transform. Four experiments have been carried out for proving the worth of our algorithm. Out of which three are meant for CBIR and one for object tracking. It is further mentioned that the database considered for first three experiments are Brodatz texture database (DB1), MIT VisTex database (DB2), rotated Brodatz database (DB3) and the fourth contains three observations. The results after being investigated show a significant improvement in terms of their evaluation measures as compared to LBP and other existing transform domain techniques.     

MRI and CT image indexing and retrieval using local mesh peak valley edge patterns

In this paper, a new pattern based feature, local mesh peak valley edge pattern (LMePVEP) is proposed for biomedical image indexing and retrieval. The standard LBP extracts the gray scale relationship between the center pixel and its surrounding neighbors in an image. Whereas the proposed method extracts the gray scale relationship among the neighbors for a given center pixel in an image. The relations among the neighbors are peak/valley edges which are obtained by performing the first-order derivative. The performance of the proposed method (LMePVEP) is tested by conducting two experiments on two benchmark biomedical databases. Further, it is mentioned that the databases used for experiments are OASIS−MRI database which is the magnetic resonance imaging (MRI) database and VIA/I–ELCAP-CT database which includes region of interest computer tomography (CT) images. The results after being investigated show a significant improvement in terms average retrieval precision (ARP) and average retrieval rate (ARR) as compared to LBP and LBP variant features.     

Expert content-based image retrieval system using robust local patterns

A new image indexing and retrieval algorithm for content based image retrieval is proposed in this paper. The local region of the image is represented by making the use of local difference operator (LDO), separating it into two components i.e. sign and magnitude. The sign LBP operator (S_LBP) is a generalized LBP operator. The magnitude LBP (M_LBP) operator is calculated using the magnitude of LDO. A robust LBP (RLBP) operator is presented employing robust S_LBP and robust M_LBP. Further, the combination of Gabor transform and RLBP operator has also been presented. The robustness is established by conducting four experiments on different image database i.e. Corel 1000 (DB1), Brodatz texture database (DB2) and MIT VisTex database (DB3) under different lighting (illumination) and noise conditions. Investigations reveal a promising achievement of the technique presented when compared to S_LBP and other existing transform domain techniques in terms of their evaluation measures.     

Efficient Cloud Image Retrieval System Using Weighted-Inverted Index and Database Filtering Algorithms

With the advance of multimedia technology and communications, images and videos become the major streaming information through the Internet. How to fast retrieve desired similar images precisely from the Internet scale image/video databases is the most important retrieval control target. In this paper, a cloud based content-based image retrieval (CBIR) scheme is presented. Database-categorizing based on weighted-inverted index (DCWⅡ) and database filtering algorithm (DFA) is used to speed up the features matching process. In the DCWⅡ, the weights are assigned to discrete cosine transform (DCT) coefficients histograms and the database is categorized by weighted features. In addition, the DFA filters out the irrelevant image in the database to reduce unnecessary computation loading for features matching. Experiments show that the proposed CBIR scheme outperforms previous work in the precision-recall performance and maintains mean average precision (mAP) about 0.678 in the large-scale database comprising one million images. Our scheme also can reduce about 50% to 85% retrieval time by pre-filtering the database, which helps to improve the efficiency of retrieval systems.     

Center symmetric local binary co-occurrence pattern for texture,face and bio-medical image retrieval

Content based image retrieval is a common problem for a large image database. Many methods have been proposed for image retrieval for some particular type of datasets. In the proposed work, a new image retrieval technique has been introduced. This technique is useful for different kind of dataset. In the proposed method, center symmetric local binary pattern has been extracted from the original image to obtain the local information. Co-occurrence of pixel pairs in local pattern map have been observed in different directions and distances using gray level co-occurrence matrix. Earlier methods have utilized histogram to extract the frequency information of local pattern map but co-occurrence of pixel pairs is more robust than frequency of patterns. The proposed method is tested on three different category of images, i.e., texture, face and medical image database and compared with typical state-of-the-art local patterns.     

Content based image indexing and retrieval using directional local extrema and magnitude patterns

In this paper, we integrate the concept of directional local extremas and their magnitude based patterns for content based image indexing and retrieval. The standard ditectional local extrama pattern (DLEP) extracts the directional edge information based on local extrema in 0°, 45°, 90°, and 135° directions in an image. However, they are not considering the magnitudes of local extremas. The proposed method integrates these two concepts for better retrieval performance. The sign DLEP (SDLEP) operator is a generalized DLEP operator and magnitude DLEP (MDLEP) operator is calculated using magnitudes of local extremas. The performance of the proposed method is compared with DLEP, local binary patterns (LBPs), block-based LBP (BLK_LBP), center-symmetric local binary pattern (CS-LBP), local edge patterns for segmentation (LEPSEG) and local edge patterns for image retrieval (LEPINV) methods by conducting two experiments on benchmark databases, viz. Corel-5K and Corel-10K databases. The results after being investigated show a significant improvement in terms of their evaluation measures as compared to other existing methods on respective databases.     

融合统一模式的LBP和GLCM特征的图像检索算法

文章提出一种融合统一模式的LBP特征和GLCM特征的图像检索算法。首先,对图像做统一模式的LBP变换处理提取图像直方图特征。计算图像GLCM在0°、45°、90°、135°四个方向下的对比度、相关性、能量、同质系数的均值和标准差。然后,融合LBP直方图特征与GLCM纹理统计特征作为图像的检索特征,选用Canberra距离进行相似度度量,完成图像检索。实验结果表明,本算法在两个图像库上均具有较高的平均查准率,分别达到了82.91%和79.48%。     

基于局部边缘二值模式的图像检索

在定义局部边缘的基础上提出了局部边缘二值模式(LEBP),并结合Gabor滤波器将其扩展到多分辨率LEBP(MLEBP)。对传统的中心对称局部二值模式(CS-LBP)和方向局部二值模式(D-LBP)进行了改进,新描述符在不增加计算复杂度和提高特征维数的基础上,进一步融入了局部边缘信息。为验证新描述符的性能,采用3个通用的纹理图像库进行图像检索实验。结果表明,结合本文方法,明显提高了传统描述符的分辨能力。     

Zernike moments and LDP-weighted patches for content-based image retrieval

This paper proposes a new algorithm using global and local features for content-based image retrieval. Global features are extracted using the magnitude of Zernike moments (ZMs). Local features are obtained through local directional pattern (LDP). Generally, LDP is used to extract texture-based features from an image. In this paper, LDP is used to encode both texture and shape information of an image to represent more meaningful features. To encode texture-based features, original image is used to compute the LDP features. To extract shape information from an image, dual-tree complex wavelet transform (DT-CWT) is applied on image which generates six directional wavelets. These six directional wavelets are superimposed in order to obtain shape-encoded image. LDP is then applied on this wavelet-based shape-encoded image. Further, to enhance retrieval accuracy, LDP features are extracted from patches of both original and shape-encoded images. These patches are assigned with weights based on average discrimination capability of features in a patch. Experiments are performed using three different standard databases with various variations such as pose, distortion, partial occlusion and complex structure. The proposed technique achieves 96.4 and 98.76 % retrieval accuracy at a recall of 50 %, for Kimia-99 and COIL-100 databases, respectively. For MPEG-7 CE-2 shape database, retrieval accuracy of 61.93 % is achieved in terms of average Bull’s eye performance (BEP). The proposed technique is also tested on Springer medical image database to explore its scope in other areas, wherein it attains average BEP of 69.68 % in comparison with 61.52 % with ZMs. It is observed that the proposed technique outperforms other well-known existing methods of image retrieval.     

基于内容的图像检索技术研究

在对海量的图像数据进行检索时,传统的基于数值/字符的信息检索技术并不能满足要求.因此,基于内容的图像检索技术(CBIR:Content-Based Image Retrieval)的研究应运而生,并引起了广泛关注.本文主要讨论CBIR研究中的一些关键问题:图像的内容特征及其提取、特征之间的相似度计算、查询条件的表达、检索性能的评价、压缩域的图像检索技术等等,并指出了一些可值得深入研究的方向.     

Content-based microscopic image retrieval system for multi-image queries

In this paper, we describe the design and development of a multitiered content-based image retrieval (CBIR) system for microscopic images utilizing a reference database that contains images of more than one disease. The proposed CBIR system uses a multitiered approach to classify and retrieve microscopic images involving their specific subtypes, which are mostly difficult to discriminate and classify. This system enables both multi-image query and slide-level image retrieval in order to protect the semantic consistency among the retrieved images. New weighting terms, inspired from information retrieval theory, are defined for multiple-image query and retrieval. The performance of the system was tested on a dataset including 1666 imaged high power fields extracted from 57 follicular lymphoma (FL) tissue slides with three subtypes and 44 neuroblastoma (NB) tissue slides with four subtypes. Each slide is semantically annotated according to their subtypes by expert pathologists. By using leave-one-slide out testing scheme, the multi-image query algorithm with the proposed weighting strategy achieves about 93% and 86% of average classification accuracy at the first rank retrieval, outperforming the image-level retrieval accuracy by about 38 and 26 percentage points, for FL and NB diseases, respectively.     

A framework for medical image retrieval using machine learning and statistical similarity matching techniques with relevance feedback.

A content-based image retrieval (CBIR) framework for diverse collection of medical images of different imaging modalities, anatomic regions with different orientations and biological systems is proposed. Organization of images in such a database (DB) is well defined with predefined semantic categories; hence, it can be useful for category-specific searching. The proposed framework consists of machine learning methods for image prefiltering, similarity matching using statistical distance measures, and a relevance feedback (RF) scheme. To narrow down the semantic gap and increase the retrieval efficiency, we investigate both supervised and unsupervised learning techniques to associate low-level global image features (e.g., color, texture, and edge) in the projected PCA-based eigenspace with their high-level semantic and visual categories. Specially, we explore the use of a probabilistic multiclass support vector machine (SVM) and fuzzy c-mean (FCM) clustering for categorization and prefiltering of images to reduce the search space. A category-specific statistical similarity matching is proposed in a finer level on the prefiltered images. To incorporate a better perception subjectivity, an RF mechanism is also added to update the query parameters dynamically and adjust the proposed matching functions. Experiments are based on a ground-truth DB consisting of 5000 diverse medical images of 20 predefined categories. Analysis of results based on cross-validation (CV) accuracy and precision-recall for image categorization and retrieval is reported. It demonstrates the improvement, effectiveness, and efficiency achieved by the proposed framework.     

A new way for multidimensional medical data management: volume of interest (VOI)-based retrieval of medical images with visual and functional features.

The advances in digital medical imaging and storage in integrated databases are resulting in growing demands for efficient image retrieval and management. Content-based image retrieval (CBIR) refers to the retrieval of images from a database, using the visual features derived from the information in the image, and has become an attractive approach to managing large medical image archives. In conventional CBIR systems for medical images, images are often segmented into regions which are used to derive two-dimensional visual features for region-based queries. Although such approach has the advantage of including only relevant regions in the formulation of a query, medical images that are inherently multidimensional can potentially benefit from the multidimensional feature extraction which could open up new opportunities in visual feature extraction and retrieval. In this study, we present a volume of interest (VOI) based content-based retrieval of four-dimensional (three spatial and one temporal) dynamic PET images. By segmenting the images into VOIs consisting of functionally similar voxels (e.g., a tumor structure), multidimensional visual and functional features were extracted and used as region-based query features. A prototype VOI-based functional image retrieval system (VOI-FIRS) has been designed to demonstrate the proposed multidimensional feature extraction and retrieval. Experimental results show that the proposed system allows for the retrieval of related images that constitute similar visual and functional VOI features, and can find potential applications in medical data management, such as to aid in education, diagnosis, and statistical analysis.     

A novel long-term learning algorithm for relevance feedback in content-based image retrieval

Relevance feedback has proven to be a powerful tool to bridge the semantic gap between low-level features and high-level human concepts in content-based image retrieval (CBIR). However, traditional short-term relevance feedback technologies are confined to using the current feedback record only. Log-based long-term learning captures the semantic relationships among images in a database by analyzing the historical relevance information to boost the retrieval performance effectively. In this paper, we propose an expanded-judging model to analyze the historical log data’s semantic information and to expand the feedback sample set from both positive and negative relevant information. The index table is used to facilitate the log analysis. The expanded-judging model is applied in image retrieval by combining with short-term relevance feedback algorithms. Experiments were carried out to evaluate the proposed algorithm based on the Corel image database. The promising experimental results validate the effectiveness of our proposed expanded-judging model.     

Integration of wavelet transform,Local Binary Patterns and moments for content-based image retrieval

The proliferation of large number of images has made it necessary to develop systems for indexing and organizing images for easy access. This has made Content-Based Image Retrieval (CBIR) an important area of research in Computer Vision. This paper proposes a combination of features in multiresolution analysis framework for image retrieval. In this work, the concept of multiresolution analysis has been exploited through the use of wavelet transform. This paper combines Local Binary Pattern (LBP) with Legendre Moments at multiple resolutions of wavelet decomposition of image. First, LBP codes of Discrete Wavelet Transform (DWT) coefficients of images are computed to extract texture feature from image. The Legendre Moments of these LBP codes are then computed to extract shape feature from texture feature for constructing feature vectors. These feature vectors are used to search and retrieve visually similar images from large database. The proposed method has been tested on five benchmark datasets, namely, Corel-1K, Olivia-2688, Corel-5K, Corel-10K, and GHIM-10K, and performance of the proposed method has been measured in terms of precision and recall. The experimental results demonstrate that the proposed method outperforms some of the other state-of-the-art methods in terms of precision and recall.     

自适应局部综合特征加权的单样本人脸特征提取

为了有效地提取单训练人脸样本的特征,提出了一种新的人脸局部特征描述方法,改进了局部二进制模式的方向性描述单一的问题,并且加入了像素间变化趋势幅度的描述,称之为局部综合模式(Local Comprehensive Patterns,LCP).首先对人脸样本图像进行分块,然后每个的分块子图像进行改进LCP算子运算;其次考虑到每个子块的特征对整幅人脸图像的贡献度不一致,提出了贡献度图谱(Contribution Map,CM);最后根据贡献度图谱对每个子块的改进LCP描述进行自适应加权融合形成最终的人脸描述特征,最后在ORL和Yale B库上进行了有效性的测试,与现有的多种算法进行比对,所提出的算法对于非限定环境下人脸的识别有良好的效果.     

基于颜色和边缘的快速图像检索研究

在分析传统的图像检索技术基础上,研究了一种基于颜色和边缘特征的快速图像检索技术。首先,在HSI颜色空间中,使用色调直方图对原图像库进行初步检索,获得初级检索图像库;然后,用改进的数学形态学算法对初级检索图像库进行边缘提取,使用边缘像素点集合颜色直方图对初级检索图像库进行再次检索,从而得到最终的检索结果。实验结果表明方法在提高图像检索精度的同时,大大缩短了检索时间。