Abstract: Web text extraction is the foundation of Web information processing work（information retrieval, text mining, etc.）. Based on the statistical analysis of theme pages, including body features and structure characteristics, this paper puts forward a kind of theme pages text extraction method combining Web page text features and HTML tags characteristics. The text content block is acquired according to the DOM tree parsed from the Web pages, and then the characteristics of noise information are analysed in the text content block in order to remove the noise information. Experiments show this method has higher accuracy and recall rate.

Key words: body feature, tag information, content extraction

摘要： Web正文信息抽取是信息检索、文本挖掘等Web信息处理工作的基础。在统计分析了主题网页的正文特征及结构特征的基础上，提出了一种结合网页正文信息特征及HTML标签特点的主题网页正文信息抽取方法。在将Web页面解析成DOM树的基础上，根据页面DOM树结构获取正文信息块，分析正文信息块块内噪音信息的特点，去除块内噪音信息。实验证明，这种方法具有很好的准确率及召回率。

关键词: 正文特征, 标签信息, 正文抽取