计算机工程与应用 ›› 2007, Vol. 43 ›› Issue (34): 114-118.

• 产品、研发、测试 • 上一篇    下一篇

一种基于后缀树的包装器自动生成方法研究

李永丽1,张玉良2   

  1. 1.东北师范大学 计算机学院,长春 130024
    2.吉林大学 计算机科学与技术学院,长春 130012
  • 收稿日期:1900-01-01 修回日期:1900-01-01 出版日期:2007-12-01 发布日期:2007-12-01
  • 通讯作者: 李永丽

Research of automatic wrapper generation method based on suffix tree

LI Yong-li1,ZHANG Yu-liang2   

  1. 1.College of Computer,Northeast Normal University,Changchun 130024,China
    2.College of Computer Science and Technology,Jilin University,Changchun 130012,China
  • Received:1900-01-01 Revised:1900-01-01 Online:2007-12-01 Published:2007-12-01
  • Contact: LI Yong-li

摘要: 包装器是一种能够从网页中自动抽取数据并将其转换为结构化数据的软件程序。现有的包装器生成系统多是半自动化的,需要用户具有关于目标页面的先验知识,而且大多只能处理简单结构数据,而不能很好地处理具有嵌套结构的数据。提出了一种基于后缀树的包装器自动生成方法,生成的包装器不仅可以处理简单结构数据,还可以处理嵌套结构数据,具有较低的时间复杂度,有一定的实用价值。

关键词: 网页, 信息抽取, 后缀树, 半结构化数据, 包装器自动生成

Abstract: Wrappers are specialized program routines that automatically extract data from Web pages and convert the information into a structured format.Currently,most approaches to wrapper construction are semi-automated:they either need human involvement or have mainly focused on extracting plain-structured data objects with a fixed number of attributes and values,and usally cannot handle nested-structured data objects,whose instances may have variable number of values on their attributes.In this paper,makes a research on a suffix tree based automatic wrapper generation method.The wrapper generated by this method can handle not only data objects with plain structures,but also those with nested structures.This method decreases time complexity,and has certain useful value.

Key words: Web page, information extraction, suffix tree, semi-structure data, automatic wrapper generation