Research of automatic wrapper generation method based on suffix tree

Computer Engineering and Applications ›› 2007, Vol. 43 ›› Issue (34): 114-118.

• 产品、研发、测试 • Previous Articles Next Articles

Research of automatic wrapper generation method based on suffix tree

LI Yong-li¹,ZHANG Yu-liang²

1.College of Computer，Northeast Normal University，Changchun 130024，China
2.College of Computer Science and Technology，Jilin University，Changchun 130012，China

Received:1900-01-01 Revised:1900-01-01 Online:2007-12-01 Published:2007-12-01
Contact: LI Yong-li

一种基于后缀树的包装器自动生成方法研究

李永丽¹,张玉良²

1.东北师范大学计算机学院，长春 130024
2.吉林大学计算机科学与技术学院，长春 130012

通讯作者: 李永丽

Abstract

Abstract: Wrappers are specialized program routines that automatically extract data from Web pages and convert the information into a structured format.Currently，most approaches to wrapper construction are semi-automated：they either need human involvement or have mainly focused on extracting plain-structured data objects with a fixed number of attributes and values，and usally cannot handle nested-structured data objects，whose instances may have variable number of values on their attributes.In this paper，makes a research on a suffix tree based automatic wrapper generation method.The wrapper generated by this method can handle not only data objects with plain structures，but also those with nested structures.This method decreases time complexity，and has certain useful value.

Key words: Web page, information extraction, suffix tree, semi-structure data, automatic wrapper generation

摘要： 包装器是一种能够从网页中自动抽取数据并将其转换为结构化数据的软件程序。现有的包装器生成系统多是半自动化的，需要用户具有关于目标页面的先验知识，而且大多只能处理简单结构数据，而不能很好地处理具有嵌套结构的数据。提出了一种基于后缀树的包装器自动生成方法，生成的包装器不仅可以处理简单结构数据，还可以处理嵌套结构数据，具有较低的时间复杂度，有一定的实用价值。

关键词: 网页, 信息抽取, 后缀树, 半结构化数据, 包装器自动生成

LI Yong-li¹,ZHANG Yu-liang². Research of automatic wrapper generation method based on suffix tree[J]. Computer Engineering and Applications, 2007, 43(34): 114-118.

李永丽¹,张玉良². 一种基于后缀树的包装器自动生成方法研究[J]. 计算机工程与应用, 2007, 43(34): 114-118.

[1]	WAN Mengxiang, YAO Hanbing. GAN Model for Malicious Web Training Data Generation [J]. Computer Engineering and Applications, 2021, 57(6): 124-130.
[2]	WEI Hao, ZHOU Ai, ZHANG Yijia, CHEN Fei, QU Wen, LU Mingyu. Review of Deep Learning-Based Biomedical Entity Relation Extraction Research [J]. Computer Engineering and Applications, 2021, 57(21): 14-23.
[3]	WU Cheng, WANG Chaokun, WANG Muxian. Entity Attributes Extraction Based on Text Simplification [J]. Computer Engineering and Applications, 2020, 56(21): 115-122.
[4]	YANG Heping, ZHANG Zhiqiang, YANG Ming, YANG Di, JIANG Xiaowei, CHEN Jinghua. Design and Development of Online Visualization Platform for Meteorological Grid Data [J]. Computer Engineering and Applications, 2019, 55(18): 207-211.
[5]	HUANG Cheng1，2, LIU Jiayong1, LIU Liang1, HE Xiang1, TANG Dianhua2. Research on extraction model of malicious domain corpus based on context semantics [J]. Computer Engineering and Applications, 2018, 54(9): 101-108.
[6]	GAO Yongbing1, ZHANG Guijuan1, HU Wenjiang1, MA Zhanfei2. Research of regional microblog summarization based on Suffix Tree Clustering algorithm [J]. Computer Engineering and Applications, 2018, 54(9): 126-132.
[7]	WANG Haiyong, FENG Zhaoxu, YANG Haibo, ZHANG Jindong. Research on text extraction algorithm based on structure similarity page clustering [J]. Computer Engineering and Applications, 2018, 54(11): 122-127.
[8]	DU Boyuan1, WANG Meiqing1, CHEN Changfu2, CHEN Fei1. Tags extraction for Web information based on structure consistency and feature learning [J]. Computer Engineering and Applications, 2017, 53(7): 74-78.
[9]	ZHAO Xiaoyong, WANG Lei. Product specification auto extract method of e-commerce websites [J]. Computer Engineering and Applications, 2017, 53(24): 168-171.
[10]	GU Nannan, FENG Jun, SUN Xia, ZHAO Yan, ZHANG Lei. Chinese resume information automatic extraction and recommendation algorithm [J]. Computer Engineering and Applications, 2017, 53(18): 141-148.
[11]	SUN Hongmin, JIANG Nannan, LI Xiang. Research on biological information mining model based on document set [J]. Computer Engineering and Applications, 2016, 52(24): 102-106.
[12]	YI Zheng, XU Wuping, XU Aiping. Discovery method of webpage subject area based on structural analysis [J]. Computer Engineering and Applications, 2015, 51(6): 227-230.
[13]	CHEN Xianfu, LI Shijun, ZENG Hui. Classification of web pages based on extreme learning machine [J]. Computer Engineering and Applications, 2015, 51(5): 102-106.
[14]	HUANG Yanjiao, WU Qin, LIANG Jiuzhen. Boosted constrained conditional random fields for Web object information extraction [J]. Computer Engineering and Applications, 2015, 51(23): 143-148.
[15]	QIAO Naosheng1, ZHANG Fen2. Method of defect image edge information extraction of printed circuit board [J]. Computer Engineering and Applications, 2015, 51(20): 11-15.

Research of automatic wrapper generation method based on suffix tree

一种基于后缀树的包装器自动生成方法研究

PDF

Knowledge

Abstract

Cite this article

share this article

References

Related Articles 15

Recommended Articles

Metrics