| 公共数据中心的ETL系统设计与实现 |
| |
| 引用本文： | 赵俊,夏小玲.公共数据中心的ETL系统设计与实现[J].计算机应用与软件,2011(10). |
| |
| 作者姓名： | 赵俊 夏小玲 |
| |
| 作者单位： | 东华大学计算机科学与技术学院; |
| |
| 摘 要： | ETL过程是构建数据仓库的重要步骤。大多数现有ETL系统在数据量较大时处理效率偏低。根据ETL在公共数据中心的实际应用改进了原有的ETL结构。鉴于公共数据保密性的特点,设计了数据不同的获取方式;在设置数据转换规则的过程中结合相应领域知识,保证数据质量;前置机之间实行负载均衡,同时把数据转换的不同步骤分配到两台ETL服务器来完成,保证抽取和转换效率。通过实验证明了该ETL系统具有较好的效率。
|
| 关 键 词： | ETL 数据仓库 数据抽取 数据转换 数据质量 |
DESIGN AND IMPLEMENTATION OF ETL SYSTEM IN THE COMMON DATA CENTER |
| |
| Zhao Jun Xia Xiaoling.DESIGN AND IMPLEMENTATION OF ETL SYSTEM IN THE COMMON DATA CENTER[J].Computer Applications and Software,2011(10). |
| |
| Authors: | Zhao Jun Xia Xiaoling |
| |
| Affiliation: | Zhao Jun Xia Xiaoling(School of Computer Science and Technology,Donghua University,Shanghai 201620,China) |
| |
| Abstract: | ETL process is an important step in building a data warehouse.Most existing ETL systems are slow when processing large amounts of data.This paper refers to a practical application of ETL in the common data center to improve the original structure of the ETL.In view of the confident characteristics of common data,different data access methods are designed;during the process of setting data transformation rules,corresponding domain knowledge is integrated to ensure data quality;load balancing among front-ends... |
| |
| Keywords: | ETL Data warehouse Data extraction Data transform Data quality |
| 本文献已被 CNKI 等数据库收录！ |
