关键词: 文本挖掘, 分词, 词语过滤, 特征计算, 关键短语提取

Abstract:

Aiming at the problems that traditional Chinese key phrase extraction algorithm has low accuracy, strong ambiguity and little information, inspired by the English key phrase extraction algorithm TAKE（Totally Automated Keyword Extraction）, this paper adds a new word recognition technique based on multi-domain specificity and improves the text segmentation, word filtering and feature calculation methods of the original algorithm. An improved TAKE algorithm is proposed and applied to Chinese text key phrase mining. By compared with traditional key phrase extraction algorithms, it is shown that the proposed algorithm has a significant improvement in the quantization results of precision, recall and [F] values.

Key words: text mining, word segmentation, word filtering, feature calculation, key phrase extraction