Irrelevance reduction with locality-sensitive hash learning for efficient cross-media retrieval |
| |
Authors: | Yuhua Jia Liang Bai Peng Wang Jinlin Guo Yuxiang Xie Tianyuan Yu |
| |
Affiliation: | 1.Science and Technology on Information Systems Engineering Laboratory,National University of Defense Technology,Changsha,China;2.National Laboratory for Information Science and Technology, Department of Computer Science and Technology,Tsinghua University,Beijing,China |
| |
Abstract: | Cross-media retrieval is an imperative approach to handle the explosive growth of multimodal data on the web. However, existing approaches to cross-media retrieval are computationally expensive due to high dimensionality. To efficiently retrieve in multimodal data, it is essential to reduce the proportion of irrelevant documents. In this paper, we propose a fast cross-media retrieval approach (FCMR) based on locality-sensitive hashing (LSH) and neural networks. One modality of multimodal information is projected by LSH algorithm to cluster similar objects into the same hash bucket and dissimilar objects into different ones and then another modality is mapped into these hash buckets using hash functions learned through neural networks. Once given a textual or visual query, it can be efficiently mapped to a hash bucket in which objects stored can be near neighbors of this query. Experimental results show that, in the set of the queries’ near neighbors obtained by the proposed method, the proportions of relevant documents can be much boosted, and it indicates that the retrieval based on near neighbors can be effectively conducted. Further evaluations on two public datasets demonstrate the efficacy of the proposed retrieval method compared to the baselines. |
| |
Keywords: | |
本文献已被 SpringerLink 等数据库收录! |
|