Computer Engineering and Applications ›› 2012, Vol. 48 ›› Issue (4): 115-117.

• 数据库、信号与信息处理 • Previous Articles     Next Articles

Method of incremental data extraction based on pivotal attributes contract

LIU Sheng1, YANG Yuexiang1,2, DENG Jinsheng2, LI Yang2   

  1. 1.School of Computer Science, National University of Defense Technology, Changsha 410073, China
    2.Information Center, National University of Defense Technology, Changsha 410073, China
  • Received:1900-01-01 Revised:1900-01-01 Online:2012-02-01 Published:2012-04-05

基于关键属性比对的增量数据抽取方法

刘 胜1,杨岳湘1,2,邓劲生2,李 阳2   

  1. 1.国防科技大学 计算机学院,长沙 410073
    2.国防科技大学 信息中心,长沙 410073

Abstract: This paper outlines the present commonly used incremental data extraction method of ETL, in the foundation of method of the entire table contract, it proposes a method of incremental data extraction based on pivotal attributes contract. It describes the algorithm of pivotal attributes contract, and establishes its model. It is verified that the method based on pivotal attributes contract is superior to the method of the entire table contract and the method of the entire table deletion and insertion.

Key words: pivotal attributes, incremental data extraction, entire table contract, Extraction Transformation Loading(ETL)

摘要: 概述了ETL目前常用的增量数据抽取方法,在全表比对方法基础上,提出了基于关键属性比对的增量数据提取方法,描述了关键属性提取算法,并建立其模型,用实验验证了基于关键属性比对的方法优于全表比对方法和全表删除插入方法。

关键词: 关键属性, 增量数据抽取, 全表比对, 提取转换加载(ETL)