| 面向金融行业的大数据迁移的研究与实现 |
| |
| 引用本文： | 王永超,鲁鸣鸣.面向金融行业的大数据迁移的研究与实现[J].计算机工程与应用,2018,54(13):93-99. |
| |
| 作者姓名： | 王永超 鲁鸣鸣 |
| |
| 作者单位： | 中南大学 信息科学与工程学院，长沙 410083 |
| |
| 摘 要： | 现有的金融行业的数据管理模式主要依赖于传统关系型数据库，然而传统架构受到拓展能力和存储性能的限制，难以满足大数据时代快速增长的海量数据量处理的需要。针对金融数据规模大、跨地域、跨系统存储、数据多样化等特点，提出了HiETL大数据迁移管理平台，实现了异构关系型数据库业务系统向Hadoop大数据平台的统一迁移，以及海量数据的集中整合、拓展存储、高效分析查询等一站式管理平台，在保证迁移准确的情况下，其速度可达到3?MB/s。
|
| 关 键 词： | 大数据 数据迁移 关系型数据库 Hadoop平台 HiETL |
Research and implementation of big data migration for financial industry |
| |
| WANG Yongchao,LU Mingming.Research and implementation of big data migration for financial industry[J].Computer Engineering and Applications,2018,54(13):93-99. |
| |
| Authors: | WANG Yongchao LU Mingming |
| |
| Affiliation: | School of Information Science and Engineering, Central South University, Changsha 410083, China |
| |
| Abstract: | Current data management scheme in financial industry basically relies on traditional databases. However, due to the inherent limitation on the extension capability and storage performance, it is difficult to meet the rapid growing demands for massive data processing in big data era. Based on the characteristics of financial data, such as, large scale, diversity, cross region and cross storage system, this paper proposes a big data migration management platform, called HiETL, the functions of which include the data migration from heterogeneous relational databases to Hadoop platform, centralized integration of massive data, expanding storage, and efficient query. The migration speed can reach 3 MB/s as long as the migration accuracy is ensured. |
| |
| Keywords: | big data data migration relational databases Hadoop platform HiETL |
|
| 点击此处可从《计算机工程与应用》浏览原始摘要信息 |
|
点击此处可从《计算机工程与应用》下载全文 |
|
