Tracking Events of Public Opinion News Based on Online Biterm Topic Model

doi:10.3778/j.issn.1002-8331.2104-0399

Abstract

Abstract: Event tracking of public opinion news is critical for the research and application of public opinion monitoring, heat analysis and policy making. In terms of the features of public opinion news, such as the sparsity and sensibility of features, evolvability and secondary topics, the novel monitor Biterm topic model（MBTM） for public opinion news events is proposed in this paper, based on the online Biterm topic model（OBTM） and updating the parameters by the stochastic collapsed variational Bayesian inference（SCVB0） algorithm. Firstly, the MBTM is used to detect the original topics of events and track the topics of subsequent news. Further, this paper gives the concept of event threading and measures the correlation of event threading from topic and semantic levels. Finally, this paper generates event threading based on the topic of news events to concatenate the events that are related. Experimental results show that MBTM is superior to OBTM on most indicators, which verifies the effectiveness and efficiency of the proposed method.

Key words: public opinion news events, event tracking, event threading, online Biterm topic model

摘要： 舆情新闻事件跟踪，是舆情监控、热点分析、政策制定等研究和应用的重要基础。针对舆情新闻的稀疏性、敏感性、易演化性、次生性等特点，基于在线Biterm主题模型（online Biterm topic model，DBTM），通过随机坍缩变分贝叶斯（stochastic collapsed variational Bayesian inference，SCVB0）算法更新参数，提出面向舆情新闻事件监控的主题模型MBTM（monitor Biterm topic model），利用该模型检测初期事件主题，跟踪后续新闻所属的主题。为了对存在关联关系的事件进行串联，进一步给出事件线索的概念，分别从主题层面和语义层面度量线索关联度，进而针对新闻事件主题生成事件线索。实验结果表明，MBTM模型在大多数指标上均优于OBTM等模型，验证了该方法的有效性和高效性。

关键词: 舆情新闻事件, 事件跟踪, 事件线索, 在线Biterm主题模型

MA Zijuan, YUE Kun, DUAN Liang, ZHAO Tianzi. Tracking Events of Public Opinion News Based on Online Biterm Topic Model[J]. Computer Engineering and Applications, 2022, 58(22): 132-141.

马子娟, 岳昆, 段亮, 赵天资. 基于在线Biterm主题模型的舆情新闻事件跟踪[J]. 计算机工程与应用, 2022, 58(22): 132-141.

References

[1] 陈琪，张莉，蒋竞，等.一种基于支持向量机和主题模型的评论分析方法[J].软件学报，2019，30（5）：1547-1560.
CHEN Q，ZHANG L，JIANG J，et al.Review analysis method based on support vector machine and latent Dirichlet allocation[J].Journal of Software，2019，30（5）：1547-1560.
[2] BLEI D，NG A，JORDAN M，et al.Latent Dirichlet allocation[J].Journal of Machine Learning Research，2003，3：993-1022.
[3] YAN X，GUO J，LAN Y，et al.A biterm topic model for short texts[C]//Proceedings of the 22nd International Conference on World Wide Web.New York：ACM，2013：1445-1456.
[4] CHENG X，YAN X，LAN Y，et al.BTM：topic modeling over short texts[J].IEEE Transactions on Knowledge and Data Engineering，2014，26（12）：2928-2941.
[5] HOFFMAN M，BLEI D M，BACH F.Online learning for latent Dirichlet allocation[C]//Advances in Neural Information Processing Systems 23，2010：856-864.
[6] SUNCHION A，WELLING W，SMYTH P，et al.On smoothing and inference for topic models[C]//Proceedings of the 25th Conference on Uncertainty in Artificial Intelligence.Arlington：AUAI，2009：27-34.
[7] FUOLDS J，BOYLES L，DUBOIS C，et al.Stochastic collapsed variational Bayesian inference for latent Dirichlet allocation[C]//Proceedings of the 19th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining.New York：ACM，2013：446-454.
[8] MEI Q，ZHAI C X.Discovering evolutionary theme patterns from text—an exploration of temporal text mining[C]//Proceedings of the 11th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining.New York：ACM，2005：198-207.
[9] MATEUSZ F，BRENT F，VIJAY R，et al.Real-time event detection on social data streams[C]//Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining.New York：ACM，2019：2774-2782.
[10] 唐晓波，王中勤，钟林霞.基于维基语义扩展的微博话题追踪模型研究[J].情报科学，2017，35（2）：80-85.
TANG X B，WANG Z Q，ZHONG L X.Microblog topic tracking model based on wikipedia semantic extension[J].Information Science，2017，35（2）：80-85.
[11] 张佩瑶，刘东苏.基于词向量和BTM的短文本话题演化分析[J].数据分析与知识发现，2019，3（3）：95-101.
ZHANG P Y，LIU D S.Topic evolutionary analysis of short text based on word vector and BTM[J].Data Analysis and Knowledge Discovery，2019，3（3）：95-101.
[12] 王晰巍，张柳，黄博，等.基于LDA的微博用户主题图谱构建及实证研究——以“埃航空难”为例[J].数据分析与知识发现，2020，4（10）：47-57.
WANG X W，ZHANG L，HUANG B，et al.Constructing topic graph for Weibo users based on LDA：case study of “Egypt air disaster”[J].Data Analysis and Knowledge Discovery，2020，4（10）：47-57.
[13] 黄佳佳，李鹏伟，彭敏，等.基于深度学习的主题模型研究[J].计算机学报，2020，43（5）：827-855.
HUANG J J，LI P W，PENG M，et al.Review of deep learning-based topic model[J].Chinese Journal of Computers，2020，43（5）：827-855.
[14] ALSUMAIT L，BARBARA D，DOMENICONI C.On-line LDA：adaptive topic models for mining text streams with applications to topic detection and tracking[C]//Proceedings of the 8th IEEE International Conference on Data Mining，2008：3-12.
[15] CANINI R K，LEI S，GRIFFITHS T L.Online inference of topics with latent Dirichlet allocation[C]//Proceedings of the 12th International Conference on Artificial Intelligence and Statistics.Berlin：Springer，2009：65-72.
[16] 周楠，杜攀，靳小龙，等.面向舆情事件的子话题标签生成模型ET-TAG[J].计算机学报，2018，41（7）：1490-1503.
ZHOU N，DU P，JIN X L，et al.ET-TAG：a tag generation model for the sub-topics of public opinion events[J].Chinese Journal of Computers，2018，41（7）：1490-1503.
[17] 陈建英，朱晖，刘小芳.基于灰色关联计算的网络民族舆情事件监测模型研究[J].情报杂志，2017，36（12）：126-131.
CHEN J Y，ZHU H，LIU X F.A novel minority public opinion detection model based on grey correlation computing[J].Journal of Intelligence，2017，36（12）：126-131.
[18] LIANG S，YILMAZ E，KANOULAS E.Dynamic clustering of streaming short documents[C]//Proceedings of the 22th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining.New York：ACM，2016：995-1004.
[19] 李莹莹，马帅，蒋浩谊，等.一种基于社交事件关联的故事脉络生成方法[J].计算机研究与发展，2018，55（9）：1972-1986.
LI Y Y，MA S，JIANG H Y，et al.An approach for story telling by correlating events from social networks[J].Journal of Computer Research and Development，2018，55（9）：1972-1986.
[20] LI Z，DING X，LIU T.Constructing narrative event evolutionary graph for script event prediction[C]//Proceedings of the 27th International Joint Conference on Artificial Intelligence.San Francisco：Morgan Kaufmann，2018：4201-4207.
[21] HUOLSBY N，BLEI D.A filtering approach to stochastic variational inference[C]//Advances in Neural Information Processing Systems 27，2014：2114-2122.