关键词: Web内容挖掘, 行情数据抽取, 行情预测

Abstract:

It is significant to extract market data in Web pages for prediction and analysis.An extraction algorithm for Web pages is proposed.Taking into account the common practice that “market data are usually displayed in the largest table on a Web page”，the market data extraction algorithm first detects the largest table on a Web page and then transfers it into a DOM tree，and in the end gets the node values of the tree.This algorithm is different from traditional ones in that it can automatically detect market data and does not need a data extraction region to be specified by the users.A prototype system for agriculture product price prediction is designed and developed.The system extracts market price data from a given website automatically and predicts the price in the future months.Experimental results show the prediction results are satisfying.

Key words: Web content mining, market data extraction, market data prediction