结合语义与统计的特征降维短文本聚类

为解决文本聚类时文本的高维稀疏性问题，提出一种语义和统计特征相结合的短文本聚类算法。该算法通过语义词典对词汇的语义相关性分析实现一次降维，结合统计方法进行特征选择实现二次降维，并融合二次降维特征实现短文本聚类。实验结果表明，该算法具有较好的短文本聚类效果和效率。

Feature Dimension Reduction Short Text Clustering Combined with Semantic and Statistics

The primary difficulty of text clustering lies in the multi-dimensional sparseness of texts. A short text clustering algorithm which takes semantic and statistic features into account is proposed. A dimensionality reduction is achieved via the semantic relativity analysis of lexical semantics by semantic dictionary. The second dimension reduction is completed after a feature selection through statistical methods. The short text clustering is obtained with the combination of the two reductions. Experimental result shows that the algorithm has better clustering effect and efficiency on short text.