Computer Engineering and Applications ›› 2011, Vol. 47 ›› Issue (35): 155-157.

• 数据库、信号与信息处理 • Previous Articles     Next Articles

Text clustering algorithm based on concept vector

BAI Qiuchan1,JIN Chunxia2,ZHOU Haiyan2   

  1. 1.Faculty of Electronic and Electrical Engineering,Huaiyin Institute of Technology,Huai’an,Jiangsu 223003,China
    2.Faculty of Computer Engineering,Huaiyin Institute of Technology,Huai’an,Jiangsu 223003,China
  • Received:1900-01-01 Revised:1900-01-01 Online:2011-12-11 Published:2011-12-11

概念向量文本聚类算法

白秋产1,金春霞2,周海岩2   

  1. 1.淮阴工学院 电子与电气工程学院,江苏 淮安 223003
    2.淮阴工学院 计算机工程学院,江苏 淮安 223003

Abstract: The text clustering algorithm based on traditional keyword does not take into account the semantic relation between key words,and then causes the concept of the text vector is not accurate enough.The paper proposes the text clustering algorithm based on concept vector.The algorithm adopts HowNet properties and the density of semantic field and the weight of meaning in concept tree to select the appropriate meaning of the original concepts as keywords,the text vector would be transformed from keyword vector to concept vector.It not only adds the texts semantic,but also reduces vector dimensions.It is used to realize text clustering to increase the efforts clustering.Experimental results show that the algorithm improves the accuracy and recall of text clustering.

Key words: HowNet, concept semantic field, the original meaning extracting, concept vector, text clustering

摘要: 为了解决基于传统关键词的文本聚类算法没有考虑特征关键词之间的相关性,而导致文本向量概念表达不够准确,提出基于概念向量的文本聚类算法TCBCV(Text Clustering Based on Concept Vector),采用HowNet的概念属性,并利用语义场密度和义原在概念树的权值选取合适的义原作为关键词的概念,实现关键词到概念的映射,不仅增加了文本之间的语义关系,而且降低了向量维度,将其应用于文本聚类,能够提高文本聚类效果。实验结果表明,该算法在文本聚类的准确率和召回率上都得到了较大的提高。

关键词: 知网, 概念语义场, 义原抽取, 概念向量, 文本聚类