Supervise multi-label text classification based on hierarchical dirichlet process

doi:10.3778/j.issn.1002-8331.1709-0162

Abstract

Abstract: With the development of Internet and information technology, a large number of multi-label texts data quickly generated. In the text classification, how to determine the appropriate number of categories and how to identify the label of the textmore accurately is an urgent problem to be solved. The HL_LDA model proposed in this paper automatically determines the number of categories through the hierarchical Dirichlet process, and improves the quality of the classification by discovering the hierarchical information between labels of multi-label documents. The experimental results show that the evaluation of HL_LDA is superior to the existing method in precision and F1-score compared with the LDA- based and SVM-based methods on different types of data sets.

Key words: multi-label, text clustering, tag dependence, hierarchical Dirichlet process

摘要： 随着互联网和信息技术的发展，大量的多标签文本数据快速产生。在文本分类中如何确定合适的分类数目以及如何更加准确地辨别文档的标签是亟待解决的问题。提出的HL_LDA模型通过层次狄利克雷过程自动确定分类的数目，通过发掘多标签文档的标签之间的层次信息提高分类的质量。实验结果表明在不同类型的数据集中，和经典的LDA，SVM等方法相比，HL_LDA在精度，F1-score等评估指标上明显优于现有的方法。

关键词: 多标签, 文本分类, 标签依赖, 层次狄利克雷过程

XIE Chenyang1，LU Yanxin2. Supervise multi-label text classification based on hierarchical dirichlet process[J]. Computer Engineering and Applications, 2017, 53(23): 18-23.

谢晨阳1，卢焱鑫2. 基于HDP的监督多标签文本分类研究[J]. 计算机工程与应用, 2017, 53(23): 18-23.

[1]	SANG Jianghui, JIANG Haiyan. Multi-label Transfer Learning Algorithm Based on Joint Distribution Alignment [J]. Computer Engineering and Applications, 2021, 57(9): 154-161.
[2]	HUO Guangyu, ZHANG Yong, SUN Yanfeng, YIN Baocai. Research on Archive Data Intelligent Classification Based on Semantic [J]. Computer Engineering and Applications, 2021, 57(6): 247-253.
[3]	HU Xiaomin, WANG Mingfeng, ZHANG Shourong, LI Min. New Differential Evolution with Particle Swarm Optimization Algorithm for Text Clustering [J]. Computer Engineering and Applications, 2021, 57(4): 61-67.
[4]	ZHANG Shurui, ZHANG Bozheng, ZHANG Fuxin, YANG Wanchun. Towards ICD Coding Using Deep Learning Approach [J]. Computer Engineering and Applications, 2021, 57(18): 172-180.
[5]	WANG Haobin, HU Ping. Multi-label Long Text Classification Algorithm Based on Multi-level Features [J]. Computer Engineering and Applications, 2021, 57(15): 193-199.
[6]	WANG Yingxuan, SONG Huansheng, LIANG Haoxiang, YU Xiaoyu, YUN Xu. Highway Vehicle Object Detection Based on Improved YOLOv4 Method [J]. Computer Engineering and Applications, 2021, 57(13): 218-226.
[7]	HAO Chao, QIU Hangping, SUN Yi, ZHANG Chaoran. Research Progress of Multi-label Text Classification [J]. Computer Engineering and Applications, 2021, 57(10): 48-56.
[8]	PAN Chengsheng, ZHANG Bin, LYU Yana, DU Xiuli, QIU Shaoming. K-Means Text Clustering Based on Improved Gray Wolf Optimization Algorithm [J]. Computer Engineering and Applications, 2021, 57(1): 188-193.
[9]	ZHANG Weiwei, HU Yaqi, ZHAI Guangyu, LIU Zhipeng. Academic Abstract Clustering Method Based on LDA Model and Doc2vec [J]. Computer Engineering and Applications, 2020, 56(6): 180-185.
[10]	WANG Jingjing, YANG Youlong. Multi-Label Classification Algorithm for Weak-Label Data [J]. Computer Engineering and Applications, 2020, 56(5): 65-73.
[11]	YAO Jiaqi, XU Zhengguo, YAN Jikun, XIONG Gang, LI Zhixiang. Dynamic Multi-label Text Classification Algorithm Based on Label Semantic Similarity [J]. Computer Engineering and Applications, 2020, 56(19): 94-98.
[12]	ZHANG Yunchun, ZHANG Kun, XU Jiming, YUAN Weiping, CAI Ying, GAO Ya. Multi-document Summary Generation Algorithm Based on Graph Model [J]. Computer Engineering and Applications, 2020, 56(16): 124-131.
[13]	LIU Xinhui, CHEN Wenshi, ZHOU Ai, CHEN Fei, QU Wen, LU Mingyu. Multi-label Text Classification Based on Joint Model [J]. Computer Engineering and Applications, 2020, 56(14): 111-117.
[14]	LI Feng, YANG Youlong. Multi-Label Classification Algorithm Based on Label-Specific Features and Label Correlation [J]. Computer Engineering and Applications, 2019, 55(4): 48-55.
[15]	DING Hengke, WU Zizhao, WANG Yigang. 3D Model Labeling Method Based on Multi-Label Propagation [J]. Computer Engineering and Applications, 2019, 55(21): 197-205.

Supervise multi-label text classification based on hierarchical dirichlet process

基于HDP的监督多标签文本分类研究

PDF

Knowledge

Abstract

Cite this article

share this article

References

Related Articles 15

Recommended Articles

Metrics