| MapReduce模型的调度及容错机制研究 |
| |
| 引用本文： | 孙广中,肖锋,熊曦.MapReduce模型的调度及容错机制研究[J].微电子学与计算机,2007,24(9):178-180. |
| |
| 作者姓名： | 孙广中 肖锋 熊曦 |
| |
| 作者单位： | 中国科学技术大学,计算机科学与技术系,安徽,合肥,230027 |
| |
| 摘 要： | MapReduce是一种并行编程模型,可以用来处理和生成大量数据集。它的调度以及容错机制是模型的重要一部分。通过对MapReduce模型的执行过程进行分析,提取得到其上面的调度以及容错模型。并将P2P模型中常用的调度思想使用于MapReduce调度模型上,对原来的调度机制和容错机制做一定的修改。
|
| 关 键 词： | 调度 容错 |
| 文章编号： | 1000-7180（2007）09-0178-03 |
| 修稿时间： | 2007-06-04 |
Study on Scheduling and Fault Tolerance Strategy of MapReduce |
| |
| SUN Guang-zhong,XIAO Feng,XIONG Xi.Study on Scheduling and Fault Tolerance Strategy of MapReduce[J].Microelectronics & Computer,2007,24(9):178-180. |
| |
| Authors: | SUN Guang-zhong XIAO Feng XIONG Xi |
| |
| Affiliation: | Department of Computer Sci. and Tech., University of Science and Technology of China, Hefei 230027, China |
| |
| Abstract: | MapReduce is a kind of parallel programming model which can be used to process and generate large data sets. The strategies of scheduling and fault tolerance play an important role in the execution of MapReduce. After analyzing the execution of MapReduce, we get the scheduling and fault tolerance model. Based on this model, using some common strategies in P2P model, we propose three new scheduling strategies, and we get the new fault tolerance mechanism for each scheduling strategy after making some modifications to the original fault tolerance method of MapReduce. |
| |
| Keywords: | MapReduce |
| 本文献已被 CNKI 维普 万方数据 等数据库收录！ |
|
