| 基于Map Reduce的Bagging贝叶斯文本分类 |
| |
| 引用本文： | 冀素琴,石洪波,卫洁.基于Map Reduce的Bagging贝叶斯文本分类[J].计算机工程,2012,38(16):203-206. |
| |
| 作者姓名： | 冀素琴 石洪波 卫洁 |
| |
| 作者单位： | 山西财经大学信息管理学院 |
| |
| 基金项目： | 国家自然科学基金资助项目(60873100);山西省自然科学基金资助项目(2009011017 4) |
| |
| 摘 要： | 集中式系统框架难以进行海量文本数据分类。为此，提出一种基于Map Reduce的Bagging贝叶斯文本分类算法。介绍朴素贝叶斯文本分类算法，将其与Bagging算法结合，运用Map Reduce并行编程模型，在Hadoop平台上实现算法。实验结果表明，该算法分类准确率较高，运行时间较短，适用于大规模文本数据集的分类学习。
|
| 关 键 词： | 分布式 Map Reduce模型 文本分类 集成学习 朴素贝叶斯 Bagging算法 |
| 收稿时间： | 2011-09-15 |
| 修稿时间： | 2011-12-08 |
Bagging Bayes Text Classification Based on Map Reduce |
| |
| JI Su-qin,SHI Hong-bo,WEI Jie.Bagging Bayes Text Classification Based on Map Reduce[J].Computer Engineering,2012,38(16):203-206. |
| |
| Authors: | JI Su-qin SHI Hong-bo WEI Jie |
| |
| Affiliation: | (School of Information Management,Shanxi University of Finance & Economics,Taiyuan 030031,China) |
| |
| Abstract: | In order to solve the problem that the classification is difficult on massive text data under the framework of a centralized system,this paper proposes a Bagging Bayes text classification algorithm based on Map Reduce.It introduces the Naive Bayes text classification algorithm.Combined with the Bagging algorithm,it uses Map Reduce parallel programming model to realize the algorithm on Hadoop platform.Experimental results show that this algorithm can be used in the classification of large scale text data sets,have good accuracy and short running time. |
| |
| Keywords: | distribution Map Reduce model text classification ensemble learning Naive Bayes Bagging algorithm |
| 本文献已被 CNKI 维普 等数据库收录！ |
| 点击此处可从《计算机工程》浏览原始摘要信息 |
|
点击此处可从《计算机工程》下载全文 |
