计算机工程与应用 ›› 2012, Vol. 48 ›› Issue (6): 114-118.

• 数据库、信号与信息处理 • 上一篇    下一篇

元数据驱动ETL的研究

宿 芳,寿永熙,苏依拉   

  1. 内蒙古工业大学 信息工程学院,呼和浩特 010051
  • 收稿日期:1900-01-01 修回日期:1900-01-01 出版日期:2012-02-21 发布日期:2012-02-21

Research on metadata driven ETL

SU Fang, SHOU Yongxi, SU Yila   

  1. College of Information Engineering, Inner Mongolia University of Technology, Hohhot 010051, China
  • Received:1900-01-01 Revised:1900-01-01 Online:2012-02-21 Published:2012-02-21

摘要: 对原始数据的提取、转换、加载(ETL)是数据仓库开发的重要步骤。一个稳定而可靠的ETL系统取决于它的总体设计。在原有ETL基础上,提出了元数据驱动ETL的思想,利用包引擎和SQL引擎以及相关算法,对传统ETL的方法进行改进,目的是提高ETL系统的稳定性和可靠性,使用户通过对元数据的维护来控制ETL的执行过程。

关键词: 抽取、转换和加载(ETL), 数据仓库, 元数据, SQL引擎, 包引擎

Abstract: With the development of data warehouse, ETL(Extract, Transformation and Load) are so important steps in processing data while building a data warehouse. A stable and reliable ETL system is depended on the overall design. Base on the traditional ETL, this paper is mainly about metadata driven ETL. Using SQL engine, package engine and related algorithm to solve the problem, the aim is to improve the ETL System’s stability and reliability, and enable users to control the process by maintaining metadata.

Key words: Extract, Transformation and Load(ETL), data warehouse, metadata, SQL engine, package engine