关键词: Web, 抽取, STU-DOM树, 信息熵

Abstract: This paper presents a method of information extraction by pruning the nodes of which information entropy production reach a certain extent. Firstly, a DOM tree is constructed by parsing HTML document. Then, the nodes which don't need to be dealt with are filtrated out, and a STU tree is created. Lastly, the nodes whose information entropy's increase overtops the threshold value are pruned, and the topic information of the Web pages is obtained. The primary experiment result proves the validity of the method using for extracting Web page's information. The mathematical model of the method is simple and credible, so it can work automatically without intervention of people. This method can be applied to Web data mining and information extraction for mobile device such as PDA etc.

Key words: Web, extraction, STU-DOM Tree, information entropy