| 基于Hadoop的分布式哈希算法实现 |
| |
| 引用本文： | 仇李寅,邱卫东,苏芊,廖凌.基于Hadoop的分布式哈希算法实现[J].信息安全与通信保密,2011,9(11):54-56. |
| |
| 作者姓名： | 仇李寅 邱卫东 苏芊 廖凌 |
| |
| 作者单位： | 1. 上海交通大学信息安全工程学院,上海,200240
2. 上海交通大学资产管理处,上海,200240 |
| |
| 摘 要： | 互联网的发展使得计算密集型的任务正在逐渐走向分布式和云计算。文中对Hadoop项目中的MapReduce和HDFS进行了研究,采用HDFS作为底层分布式文件系统,MapReduce作为编程框架来实现哈希算法。通过对多个节点中的测试结果的分析表明,在Hadoop上运行哈希函数的任务,能够起到在多台计算机的群集中分摊负载的效果,并且有效地减少了任务的总时间开销。以Hadoop为基础的云计算平台具有良好的可靠性和可扩展性,对于哈希算法在Hadoop平台上的实现和测试,为将来密钥恢复等系统的研究和搭建提供了良好的基础。
|
| 关 键 词： | Hadoop MapReduce 云计算 密钥恢复 |
Distributed Hash Algorithm Implementation based on Hadoop Infrastructure |
| |
| QIU Li-yin ,QIU Wei-dong ,SU Qian ,LIAO Ling.Distributed Hash Algorithm Implementation based on Hadoop Infrastructure[J].China Information Security,2011,9(11):54-56. |
| |
| Authors: | QIU Li-yin QIU Wei-dong SU Qian LIAO Ling |
| |
| Affiliation: | QIU Li-yin 1,QIU Wei-dong 1,SU Qian 1,LIAO Ling 2(1 School of Information Security and Engineering,Shanghai Jiaotong University,Shanghai 200240,China,2 Asset Management Department,China) |
| |
| Abstract: | The development of the Internet makes computing-intensive tasks gradually move toward distributed and cloud computing. This paper discusses the Hadoop project,including MapReduce and HDFS,and with HDFS as the underlying distributed file system and MapReduce as the programming framework Hash algorithm is implemented. By analyzing the test results of the tasks running in Hadoop cluster,Hash function tasks running in Hadoop cluster is finally achieved,thus realizing computing load-sharing and total time-consuming reduction. Hadoop-based cloud computing platform is of good reliability and scalability. The implementation and test of hash algorithm on Hadoop could provide an excellent foundation for the future research of distributed password recovery system. |
| |
| Keywords: | Hadoop MapReduce cloud computing password recovery |
| 本文献已被 CNKI 维普 万方数据 等数据库收录！ |
|
