Research of regional microblog summarization based on Suffix Tree Clustering algorithm

doi:10.3778/j.issn.1002-8331.1612-0103

Computer Engineering and Applications ›› 2018, Vol. 54 ›› Issue (9): 126-132.DOI: 10.3778/j.issn.1002-8331.1612-0103

Previous Articles Next Articles

Research of regional microblog summarization based on Suffix Tree Clustering algorithm

GAO Yongbing1, ZHANG Guijuan1, HU Wenjiang1, MA Zhanfei2

1.School of Information Engineering, Inner Mongolia University of Science and Technology, Baotou, Inner Mongolia 014010, China
2.Department of Computer, Baotou Teachers College, Baotou, Inner Mongolia 014010, China

Online:2018-05-01 Published:2018-05-15

基于后缀树算法的地区微博摘要技术研究

高永兵1，张贵娟1，胡文江1，马占飞2

1.内蒙古科技大学信息工程学院，内蒙古包头 014010
2.包头师范学院计算机系，内蒙古包头 014010

Abstract

Abstract: A large number of region-related event information is contained by regional official Microblog, aggregating these official Microblog data can find the local important events. Depending on the features of regional Microblog data, such as regional nicknames, multi-levels and distinctive attributes of regional label, the research of region-related Microblog summarization based on Suffix Tree Clustering（STC） algorithm is proposed. Regional Microblog data is preprocessed to integrate similar meanings words using regional weight tree and HowNet. Then clusters are generated by adopting Suffix Tree Clustering and Singular Value Decomposition?algorithm. At?last the regional Microblog data is comprehensively rated considering its features and the representative Microblog sentences are selected as summary. The experiments prove the feasibility of the proposed method which can effectively identity local event and generate events with high readability.

Key words: regional microblog, regional weight tree, Hownet, Suffix Tree Clustering（STC）, summarization

摘要： 地区官方微博中包含了大量相关当地的事件信息，聚合地区官方微博数据可以发掘当地的重要事件；结合地区微博数据地区别称、不同层级，地区标签属性突显等特征提出了基于后缀树算法的地区微博摘要技术研究。利用地区权值树和知网HowNet对地区微博数据进行预处理，将意思相近的词汇进行替换统一；利用后缀树聚类算法STC和奇异值分解SVD对地区微博进行聚类；结合地区微博特征对其综合打分，选取有代表性的微博句子生成摘要。实验验证了该方法的可行性，表明所提出的方法能够很好地识别出当地事件并生成可读性高的事件摘要。

关键词: 地区微博, 地区权值树, 知网, 后缀树聚类, 摘要

GAO Yongbing1, ZHANG Guijuan1, HU Wenjiang1, MA Zhanfei2. Research of regional microblog summarization based on Suffix Tree Clustering algorithm[J]. Computer Engineering and Applications, 2018, 54(9): 126-132.

高永兵1，张贵娟1，胡文江1，马占飞2. 基于后缀树算法的地区微博摘要技术研究[J]. 计算机工程与应用, 2018, 54(9): 126-132.

[1]	ZHANG Tao, YU Jiong, LIAO Bin, BI Xuehua. Method for Attributed Graph Summarization Based on Minimum Description Length [J]. Computer Engineering and Applications, 2021, 57(15): 124-132.
[2]	HE Junmin, LU Menghua, MENG Kui. Chinese Document-Level Summary Model — DSum-SSE [J]. Computer Engineering and Applications, 2021, 57(15): 200-206.
[3]	MEI Feng, ZHOU Juanping, LU Lu. Research on Video Summarization Technology Combining Local Reward Mechanism [J]. Computer Engineering and Applications, 2021, 57(11): 211-218.
[4]	ZHANG Min, ZENG Biqing, HAN Xuli, XU Ruyang. DAPC：Dual Attention and Pointer-Coverage Network Based Summarization Model [J]. Computer Engineering and Applications, 2020, 56(8): 149-157.
[5]	DANG Hongshe, TAO Yafan, ZHANG Xuande. Abstractive Summarization Model Based on Mixture Attention and Reinforcement Learning [J]. Computer Engineering and Applications, 2020, 56(1): 185-190.
[6]	ZHOU Jian, TIAN Xuan, CUI Xiaohui. Generation Method of Text Summarization Based on Advanced Sequence-to-Sequence Model [J]. Computer Engineering and Applications, 2019, 55(1): 128-134.
[7]	QIU Yunfei, ZHAO Bin, LIN Mingming, WANG Wei. Improved K-means clustering algorithm combined semantic similarity of short text [J]. Computer Engineering and Applications, 2016, 52(19): 78-83.
[8]	LIU Fengbin1, YUAN Zhiyong1, XIAO Ling2, WANG Huiling2, WANG Gaohua2. Anxiety and depression factors mining based on improved BUS algorithm [J]. Computer Engineering and Applications, 2015, 51(18): 126-130.
[9]	ZHANG Sen, CAO Hui. Research on building Chinese semantic lexicon based on concept definition of HowNet [J]. Computer Engineering and Applications, 2015, 51(17): 118-123.
[10]	Mahpirat Wali1, ZHAO Mengyuan2, Askar Hamdulla1. Keyword based Uyghur single document summarization [J]. Computer Engineering and Applications, 2015, 51(16): 130-135.
[11]	JIANG Shengyi1, YANG Yao2, LIAO Jingxin1. Research of building Chinese musical emotional lexicon and emotional classification [J]. Computer Engineering and Applications, 2014, 50(24): 118-121.
[12]	YAN Rong, GAO Guanglai. Word sense disambiguation based on word semantic relevancy computation [J]. Computer Engineering and Applications, 2012, 48(27): 109-113.
[13]	WANG Hongling1，2, ZHANG Minghui1，2, ZHOU Guodong1，2. Chinese multi-document summarization system based on topic information [J]. Computer Engineering and Applications, 2012, 48(25): 132-136.
[14]	XIONG Zhongyang, FU Lingling, ZHANG Yufang. Mixed method of feature reduction based on concept mapping in text classification [J]. Computer Engineering and Applications, 2012, 48(1): 166-169.
[15]	HU Qi，ZOU Xiyong. Design and implementation of multi-document automatic summarization using MapReduce [J]. Computer Engineering and Applications, 2011, 47(35): 67-70.

Research of regional microblog summarization based on Suffix Tree Clustering algorithm

基于后缀树算法的地区微博摘要技术研究

PDF

Knowledge

Abstract

Cite this article

share this article

References

Related Articles 15

Recommended Articles

Metrics