| 基于多模态子空间相关性传递的视频语义挖掘 |
| |
| 引用本文： | 刘亚楠,吴飞,庄越挺.基于多模态子空间相关性传递的视频语义挖掘[J].计算机研究与发展,2009,46(1). |
| |
| 作者姓名： | 刘亚楠 吴飞 庄越挺 |
| |
| 作者单位： | 浙江大学计算机科学与技术学院,杭州,310027 |
| |
| 基金项目： | 国家自然科学基金，国家高技术研究发展计划(863计划)，教育部长江学者和创新团队发展计划 |
| |
| 摘 要： | 在视频语义信息理解和挖掘中,充分利用图像、音频和文本等多模态媒质之间的交互关联是非常重要的研究方向.考虑到视频的多模态和时序关联共生特性,提出了一种基于多模态子空间相关性传递的语义概念检测方法来挖掘视频的语义信息.该方法对所提取视频镜头的多模态底层特征,根据共生数据嵌入(co-occurrence data embedding)和相似度融合(SimFusion)进行多模态子空间相关性传递而得到镜头之间的相似度关系,接着通过局部不变投影(locality preserving projections)对原始数据进行降维以获得低维语义空间内的坐标,再利用标注信息训练分类模型,从而可对训练集外的测试数据进行语义概念检测,实现视频语义信息挖掘.实验表明该方法有较高的准确率.
|
| 关 键 词： | 视频语义挖掘 多模态 语义概念检测 子空间相关性传递 时序关联共生特性 |
Video Semantics Mining Using Multi-Modality Subspace Correlation Propagation |
| |
| Liu Yanan,Wu Fei,Zhuang Yueting.Video Semantics Mining Using Multi-Modality Subspace Correlation Propagation[J].Journal of Computer Research and Development,2009,46(1). |
| |
| Authors: | Liu Yanan Wu Fei Zhuang Yueting |
| |
| Affiliation: | College of Computer Science and Technology;Zhejiang University;Hangzhou 310027 |
| |
| Abstract: | Research on content-based multimedia retrieval is motivated by a growing amount of digital multimedia content in which video data is a big part.Interaction and integration of multi-modality media types such as visual,audio and textual data in video are the essence of video content analysis.Although any uni-modality type partially expresses limited semantics less or more,video semantics are fully manifested only by interaction and integration of any unimodal.Video data comprises plentiful semantics,such as p... |
| |
| Keywords: | video semantics mining multi-modality semantic concept detection subspace correlation propagation temporal associated co-occurrence |
| 本文献已被 CNKI 万方数据 等数据库收录！ |
