计算机工程与应用 ›› 2011, Vol. 47 ›› Issue (36): 134-136.

• 数据库、信号与信息处理 • 上一篇    下一篇

结合概率潜在语义分析的文本谱聚类方法研究

张玉芳,张 洪,熊忠阳,李文田   

  1. 重庆大学 计算机学院,重庆 400044
  • 收稿日期:1900-01-01 修回日期:1900-01-01 出版日期:2011-12-21 发布日期:2011-12-21

Research of spectral clustering based on probabilistic latent semantic analysis

ZHANG Yufang,ZHANG Hong,XIONG Zhongyang,LI Wentian   

  1. College of Computer Science,Chongqing University,Chongqing 400044,China
  • Received:1900-01-01 Revised:1900-01-01 Online:2011-12-21 Published:2011-12-21

摘要: 传统谱聚类的相似矩阵建立在VSM(Vector Space Model)之上,该模型把词看作孤立的单元,没有考虑自然语言中存在大量的同义词、多义词现象。针对这一问题,提出一种用概率潜在语义分析(Probabilistic Latent Semantic Analysis,PLSA)来提取文本中隐含语义信息的方法,并构建文本集的相似矩阵,从语义的角度考虑了文本之间的相关性。实验结果表明,利用该方法得到的聚类精度有较大提高,结果要好于传统的谱聚类算法,从而验证了该方法的有效性。

关键词: 文本聚类, 概率潜在语义分析, 谱聚类, 相似矩阵

Abstract: Traditional similar matrix of spectral clustering is dependent on vector space model,which regards index word as independent unit and ignores a large number of synonyms and polysemy existing in natural language.To solve this problem,the paper comes up with a new method of extracting semantic information implicit in the text and constructing the similar matrix based on Probabilistic Latent Semantic Analysis(PLSA),which takes into account the similarities of the texts.Experiments indicate that such similar matrix built by PLSA can greatly improve categorization precision,and bring better results than traditional way like spectral clustering,further proves the availability of PLSA.

Key words: text clustering, Probabilistic Latent Semantic Analysis(PLSA), spectral clustering, similarity matrix