| 基于纠删码的HDFS存储方案 |
| |
| 引用本文： | 卞艺杰,马瑞敏,李亚冰,吴慧.基于纠删码的HDFS存储方案[J].计算机系统应用,2014,23(11):208-213. |
| |
| 作者姓名： | 卞艺杰 马瑞敏 李亚冰 吴慧 |
| |
| 作者单位： | 河海大学 商学院,南京,211100 |
| |
| 摘 要： | HDFS 文件系统通过多副本备份的方式解决数据损坏或丢失的问题，但是随着存储系统内容增多，在数据量级很大的时候，这种容灾方案消耗的额外存储空间是实际存储内容的数倍，不利于系统资源长期积累。文章提出使用纠删码编/解码文件代替 HDFS 的副本备份容灾策略，在保证数据安全性的前提下大大提高了存储空间利用率，降低存储额外消耗。
|
| 关 键 词： | 纠删码 副本备份容灾 |
| 收稿时间： | 2014/3/11 0:00:00 |
| 修稿时间： | 4/8/2014 12:00:00 AM |
HDFS Storage Solutions Based on Erasure Codes |
| |
| BIAN Yi-Jie,MA Rui-Min,LI Ya-Bing and WU Hui.HDFS Storage Solutions Based on Erasure Codes[J].Computer Systems& Applications,2014,23(11):208-213. |
| |
| Authors: | BIAN Yi-Jie MA Rui-Min LI Ya-Bing and WU Hui |
| |
| Affiliation: | Business School, Hohai University, Nanjing 211100, China;Business School, Hohai University, Nanjing 211100, China;Business School, Hohai University, Nanjing 211100, China;Business School, Hohai University, Nanjing 211100, China |
| |
| Abstract: | Through the multiple-backup strategy HDFS can restore data easily when data is damaged or missed. However, the data stored in system increases all the time. When the data scale has become very big, the strategy will need several times of storage space to store the backup data. This article proposes to use erasure codes to replace the multiple-backup strategy, which can greatly improve the storage efficiency and reduce extra storage expend. |
| |
| Keywords: | HDFS erasure code multiple-backup |
| 本文献已被 维普 等数据库收录！ |
| 点击此处可从《计算机系统应用》浏览原始摘要信息 |
|
点击此处可从《计算机系统应用》下载全文 |
|
