一种基于发布订阅机制的数据集成方法

计算机工程与应用 ›› 2007, Vol. 43 ›› Issue (9): 164-166.

一种基于发布订阅机制的数据集成方法

汪洋李爱平缪嘉嘉邹鹏

国防科学技术大学同济大学机械工程学院国防科技大学计算机学院

收稿日期:2006-07-24 修回日期:1900-01-01 出版日期:2007-03-21 发布日期:2007-03-21
通讯作者: 汪洋

A Solution to Data Integration Based on Pub/Sub System

Received:2006-07-24 Revised:1900-01-01 Online:2007-03-21 Published:2007-03-21

摘要/Abstract

摘要： 数据集成包括数据的抽取、转换、加载三个过程。针对当前大多数据集成工具适应性差、源数据端和目的数据端的耦合度太紧和数据不易自动更新的问题，本文基于发布/订阅机制的消息代理模式提出了一种新型的数据集成体系结构，把数据集成划分为源数据处理（抽取转换）和目的数据处理（过滤加载）两个过程，不仅实现了数据的可靠异步传输，而且降低了源数据端和目的数据端的耦合度，增加了数据集成的灵活性，并使数据的抽取转换和过滤加载独立、并行执行。实验结果也证明了本文提出的数据集成方法有效地提高了数据集成的效率。

关键词: 数据集成消息代理发布/订阅

Abstract: Data integration includes three phases: Data Extraction, Data Transformation and Data Loading. Poor adaptability, high coupling between source and destination and lacking of supporting automatic updating are main problems in most of data integration tools. In this essay, a new data integration architecture based on Message Agent pattern of Pub/Sub mechanism technology is proposed, which divided the Data Integration into dealing of source(Extraction and Transformation) and destination(Filtration and Loading), which not only realize reliable asynchronous transmitting, but also reduce coupling between source and destination, thus enhancing the flexibility of data integration, and enables extracting、transforming and loading in a independent、parallel and efficient way.

Key words: Data Integration, Message Agent, Pub/Sub

汪洋李爱平缪嘉嘉邹鹏. 一种基于发布订阅机制的数据集成方法[J]. 计算机工程与应用, 2007, 43(9): 164-166.