基于聚类的文本分类算法框架研究

KNN算法因其易于理解、理论成熟等优点而被广泛应用于文本分类.由于KNN需遍历样本空间计算距离,当训练集样本规模较大或维数较高时,计算开销是巨大的.针对此问题,首先将遗传算法适应度函数设计部分与K-medoids算法思想相融合形成K-GA-medoids,其次将其与KNN相结合形成用于文本分类的算法框架,在分类过程中,...

Research on the Framework of Text Classification Algorithms Based on Clustering

KNN algorithm is widely used in text categorization because of its easy to understand and mature theory.Because KNN needs to traverse sample space to calculate distance,when the sample size of training set is large or the dimension is high,the computational cost is huge.In response to this problem,firstly,the fitness function design part of genetic algorithm is combined with the idea of K-medoids algorithm to form K-GA-medoids,secondly,it is combined with KNN to form an algorithm framework for text categorization,in the process of classification,the steps of clustering first and then classification are adopted to reduce the training set samples and reduce the computational overhead.Experiments show that the clustering effect of K-GA-medoids is better than that of traditional K-medoids,and compared with the traditional KNN algorithm,the algorithm framework for text categoriza?tion improves the efficiency of text categorization effectively on the premise of guaranteeing the accuracy of classification.