Research of spectral clustering based on probabilistic latent semantic analysis

Computer Engineering and Applications ›› 2011, Vol. 47 ›› Issue (36): 134-136.

• 数据库、信号与信息处理 • Previous Articles Next Articles

Research of spectral clustering based on probabilistic latent semantic analysis

ZHANG Yufang，ZHANG Hong，XIONG Zhongyang，LI Wentian

College of Computer Science，Chongqing University，Chongqing 400044，China

Received:1900-01-01 Revised:1900-01-01 Online:2011-12-21 Published:2011-12-21

结合概率潜在语义分析的文本谱聚类方法研究

张玉芳，张洪，熊忠阳，李文田

重庆大学计算机学院，重庆 400044

Abstract

Abstract: Traditional similar matrix of spectral clustering is dependent on vector space model，which regards index word as independent unit and ignores a large number of synonyms and polysemy existing in natural language.To solve this problem，the paper comes up with a new method of extracting semantic information implicit in the text and constructing the similar matrix based on Probabilistic Latent Semantic Analysis（PLSA），which takes into account the similarities of the texts.Experiments indicate that such similar matrix built by PLSA can greatly improve categorization precision，and bring better results than traditional way like spectral clustering，further proves the availability of PLSA.

Key words: text clustering, Probabilistic Latent Semantic Analysis（PLSA）, spectral clustering, similarity matrix

摘要： 传统谱聚类的相似矩阵建立在VSM（Vector Space Model）之上，该模型把词看作孤立的单元，没有考虑自然语言中存在大量的同义词、多义词现象。针对这一问题，提出一种用概率潜在语义分析（Probabilistic Latent Semantic Analysis，PLSA）来提取文本中隐含语义信息的方法，并构建文本集的相似矩阵，从语义的角度考虑了文本之间的相关性。实验结果表明，利用该方法得到的聚类精度有较大提高，结果要好于传统的谱聚类算法，从而验证了该方法的有效性。

关键词: 文本聚类, 概率潜在语义分析, 谱聚类, 相似矩阵

ZHANG Yufang，ZHANG Hong，XIONG Zhongyang，LI Wentian. Research of spectral clustering based on probabilistic latent semantic analysis[J]. Computer Engineering and Applications, 2011, 47(36): 134-136.

张玉芳，张洪，熊忠阳，李文田. 结合概率潜在语义分析的文本谱聚类方法研究[J]. 计算机工程与应用, 2011, 47(36): 134-136.

[1]	HUO Guangyu, ZHANG Yong, SUN Yanfeng, YIN Baocai. Research on Archive Data Intelligent Classification Based on Semantic [J]. Computer Engineering and Applications, 2021, 57(6): 247-253.
[2]	ZHAO Fan, ZHANG Lin, WEN Zhiquan, YANG Linlin, LIN Guangfeng. Direct and Efficient Natural Scene Chinese Character Approaching Spotting Method [J]. Computer Engineering and Applications, 2021, 57(6): 159-167.
[3]	HU Xiaomin, WANG Mingfeng, ZHANG Shourong, LI Min. New Differential Evolution with Particle Swarm Optimization Algorithm for Text Clustering [J]. Computer Engineering and Applications, 2021, 57(4): 61-67.
[4]	BAI Lu, ZHAO Xin, KONG Yuting, ZHANG Zhenghang, SHAO Jinxin, QIAN Yurong. Survey of Spectral Clustering Algorithms [J]. Computer Engineering and Applications, 2021, 57(14): 15-26.
[5]	PAN Chengsheng, ZHANG Bin, LYU Yana, DU Xiuli, QIU Shaoming. K-Means Text Clustering Based on Improved Gray Wolf Optimization Algorithm [J]. Computer Engineering and Applications, 2021, 57(1): 188-193.
[6]	WANG Yusi, LU Deyang, LI Haiyang. Sparse Subspace Clustering Method Based on Fractional Function Constraints [J]. Computer Engineering and Applications, 2020, 56(7): 39-47.
[7]	ZHANG Weiwei, HU Yaqi, ZHAI Guangyu, LIU Zhipeng. Academic Abstract Clustering Method Based on LDA Model and Doc2vec [J]. Computer Engineering and Applications, 2020, 56(6): 180-185.
[8]	ZHENG Yi, MA Yingcang, YANG Xiaofei, XU Qiuxia. Sparse Subspace Clustering Based on [k]-Nearest Neighbors and Local Similarity [J]. Computer Engineering and Applications, 2020, 56(4): 99-108.
[9]	ZHU Dan, CHEN Xiaohong, WU Qingyuan, LI Shunming. Subspace Clustering Induced by Adaptive Graph Learning [J]. Computer Engineering and Applications, 2020, 56(21): 30-37.
[10]	YANG Jingya, SUN Linfu, WU Qishi. After-Sales Customer Segmentation Based on Semi-Supervised Spectral Clustering Ensemble [J]. Computer Engineering and Applications, 2020, 56(2): 266-271.
[11]	ZHANG Yunchun, ZHANG Kun, XU Jiming, YUAN Weiping, CAI Ying, GAO Ya. Multi-document Summary Generation Algorithm Based on Graph Model [J]. Computer Engineering and Applications, 2020, 56(16): 124-131.
[12]	YANG Lu, SONG Huansheng, ZHANG Zhaoyang. Highway Vehicle Detection Based on Sparse Trajectory Clustering [J]. Computer Engineering and Applications, 2020, 56(15): 251-258.
[13]	JIANG Yirui, PEI Yang, CHEN Lei, WANG Wenle, DAI Jiangyan, YI Yugen. Multiple Locality-Constrained Self-Representation for Spectral Clustering [J]. Computer Engineering and Applications, 2020, 56(11): 172-178.
[14]	WANG Xiaoyu1, DING Shifei1，2. Pairwise Constrained Spectral Clustering Algorithm Based on Shared Nearest Neighborhood [J]. Computer Engineering and Applications, 2019, 55(2): 142-147.
[15]	ZHOU Xiaoyu, ZHANG Longbo, WANG Lei, LI Xinxiang. Medical Image Segmentation Combined with Spectral Clustering and Improved RSF Model [J]. Computer Engineering and Applications, 2019, 55(15): 193-197.

Research of spectral clustering based on probabilistic latent semantic analysis

结合概率潜在语义分析的文本谱聚类方法研究

PDF

Knowledge

Abstract

Cite this article

share this article

References

Related Articles 15

Recommended Articles

Metrics