| 基于PML结构文件的MapReduce算法优化* |
| |
| 引用本文： | 田世海,魏志强.基于PML结构文件的MapReduce算法优化*[J].计算机应用研究,2016,33(9). |
| |
| 作者姓名： | 田世海 魏志强 |
| |
| 作者单位： | 哈尔滨理工大学 管理学院 哈尔滨 150000,哈尔滨理工大学 管理学院 哈尔滨 150000 |
| |
| 基金项目： | 黑龙江省自然科学(G201203,G201302)；黑龙江省博士后科研启动金项目(LBH-Q12065)；黑龙江省高等学校哲学社会科学创新团队建设计划资助项目(TD201203) |
| |
| 摘 要： | 针对目前物联网和云计算技术结合后，物联网RFID产生的小型数据致使云计算中MapReduce算法产生运算瓶颈问题进行了研究。运用PML和EPC编码技术保证了数据存储的完整，采用快速排序和改进XGrind压缩技术对于MapReduce算法进行优化。由实验获得，优化后MapReduce算法减小64%的I/O吞吐和45%的CPU耗用，同时使查询数据效率提高75%，可改善查询物联网获取的海量信息的效能。最终通过对云计算下MapReduce算法的优化，为云计算下的物联网追溯平台数据高效使用提供了技术支撑。
|
| 关 键 词： | 物联网，云计算，乳制品追溯，MapReduce，XGrind |
| 收稿时间： | 2015/10/8 0:00:00 |
| 修稿时间： | 2016/7/29 0:00:00 |
MapReduce algorithm optimization based on PML file structure |
| |
| Tian Shihai and Wei Zhiqiang.MapReduce algorithm optimization based on PML file structure[J].Application Research of Computers,2016,33(9). |
| |
| Authors: | Tian Shihai and Wei Zhiqiang |
| |
| Affiliation: | Dept of Management,Harbin University of Science and Technology,Harbin Heilongjiang Province 150000,China |
| |
| Abstract: | For the IOT and cloud computing technology combination, that the small data produced by the IOT''s RFID caused the MapReduce algorithm to operation bottleneck was studied. In this paper, by using the PML and EPC coding technology ensured the data integrity, by using quick sort and developed XGrind compression techniques improved MapReduce algorithm. From the experiment the optimized algorithm reduces I/O throughput to 64% and CPU consumption to 45%, at the same time improves efficiency of querying data by 75%, improves query of the huge amounts of information obtained by IOT. In the end through the optimization of MapReduce algorithm under the cloud computing, provide the technical support for the data of cloud computing platform using efficient. |
| |
| Keywords: | Internet of Thing Cloud Computing Traceability System of Dairy Products MapReduce XGrind |
|
| 点击此处可从《计算机应用研究》浏览原始摘要信息 |
|
点击此处可从《计算机应用研究》下载全文 |
