Research on application of word correlation in Naive Bayes text classification

doi:10.3778/j.issn.1002-8331.2009.16.046

Computer Engineering and Applications ›› 2009, Vol. 45 ›› Issue (16): 159-161.DOI: 10.3778/j.issn.1002-8331.2009.16.046

• 数据库、信息处理 • Previous Articles Next Articles

Research on application of word correlation in Naive Bayes text classification

ZHANG Shun-zhong^1,2,WANG Shu-mei¹,HUANG He-yan³,CHEN Zhao-xiong³

1.Department of Computer Science，Nanjing University of Science and Techology，Nanjing 210094，China
2.Department of Electronic Business，Nanjing University of Finance and Economics，Nanjing 210046，China
3.Computer Language Information Engineering Research Center，Chinese Academy of Sciences，Beijing 100083，China

Received:2008-04-01 Revised:2008-06-11 Online:2009-06-01 Published:2009-06-01
Contact: ZHANG Shun-zhong

词间相关性在贝叶斯文本分类中的应用研究

章舜仲^1,2,王树梅¹,黄河燕³,陈肇雄³

1.南京理工大学计算机科学系，南京 210094
2.南京财经大学电子商务系，南京 210046
3.中国科学院计算机语言信息工程研究中心，北京 100083

通讯作者: 章舜仲

Abstract

Abstract: Aiming at the deficiency of Naive Bayes’ attribute independence assumption，the concept of correlation and that between multi-variations were discussed，and the definition of correlation degree between terms was presented.Based on the analysis of the correlation between terms of TAN classifier，authors proposed a fomula to evaluate the correlation degree between document feature words and the algorithm of its application to ameliorating Naive Bayesian classifier.The experiments on Reuters-21578 collection show the improvement of algorithm to be simple，effective and easy to implement.

Key words: text classification, Naive Bayes, event correlation, correlation degree, Tree Augmented Naive Bayes（TAN） classifier

摘要： 针对朴素贝叶斯分类的属性独立性假设的不足，讨论了相关性及多变量相关的概念，给出词间相关度的定义。在TAN分类器的词间相关性分析基础上，提出一种文档特征词相关度估计公式及其在改进朴素贝叶斯分类模型中应用的算法，在Reuters-21578文本数据集上的实验表明，改进算法简单易行，能有效改进贝叶斯分类性能。

关键词: 文本分类, 朴素贝叶斯, 事件相关, 相关度, 树扩展型朴素贝叶斯分类器

ZHANG Shun-zhong^1,2,WANG Shu-mei¹,HUANG He-yan³,CHEN Zhao-xiong³. Research on application of word correlation in Naive Bayes text classification[J]. Computer Engineering and Applications, 2009, 45(16): 159-161.

章舜仲^1,2,王树梅¹,黄河燕³,陈肇雄³. 词间相关性在贝叶斯文本分类中的应用研究[J]. 计算机工程与应用, 2009, 45(16): 159-161.

[1]	HUO Guangyu, ZHANG Yong, SUN Yanfeng, YIN Baocai. Research on Archive Data Intelligent Classification Based on Semantic [J]. Computer Engineering and Applications, 2021, 57(6): 247-253.
[2]	HUANG Jinjie, LIN Jiangquan, HE Yongjun, HE Jinjie, WANG Yajun. Chinese Short Text Classification Algorithm Based on Local Semantics and Context [J]. Computer Engineering and Applications, 2021, 57(6): 94-100.
[3]	ZHENG Cheng, DONG Chunyang, HUANG Xiayan. Short Text Classification Method Based on BTM Graph Convolutional Network [J]. Computer Engineering and Applications, 2021, 57(4): 155-160.
[4]	HE Wenliang, ZHU Minling. Research Status and Future Analysis of Capsule Neural Network [J]. Computer Engineering and Applications, 2021, 57(3): 33-43.
[5]	TENG Jinbao, KONG Weiwei, TIAN Qiaoxin, WANG Zhaoqian, LI Long. Multi-channel Attention Mechanism Text Classification Model Based on CNN and LSTM [J]. Computer Engineering and Applications, 2021, 57(23): 154-162.
[6]	WU Shuzhao, LI Gongquan, BU Mingwei. Construction of Question Answering System for Suicide Tendency Detection Based on Knowledge Graph [J]. Computer Engineering and Applications, 2021, 57(22): 304-312.
[7]	ZHAO Yu, ZHU Yi, YU Qiao, CHEN Xiaoying. Cross Project Defect Prediction Method Based on Hierarchical Data Screening [J]. Computer Engineering and Applications, 2021, 57(20): 279-286.
[8]	LI Jie, LI Miao, YUAN Xiguo. Detection Algorithm?of Pathogenic Microbes from Next-Generation Sequencing Data [J]. Computer Engineering and Applications, 2021, 57(19): 282-289.
[9]	LI Tiefei, SHENG Long, WU Di. Study on Text Classification Method of BERT-TECNN Model [J]. Computer Engineering and Applications, 2021, 57(18): 186-193.
[10]	DING Yong, CHENG Jiaqiao, JIANG Cuiqing, WANG Zhao. Comparative Text Classification Method Based on Topic and Keyword Feature [J]. Computer Engineering and Applications, 2021, 57(17): 196-202.
[11]	TENG Jinbao, KONG Weiwei, TIAN Qiaoxin, WANG Zhaoqian. Text Classification Method Based on LSTM-Attention and CNN Hybrid Model [J]. Computer Engineering and Applications, 2021, 57(14): 126-133.
[12]	ZHAI Yiming, WANG Binjun, ZHOU Zhining, TONG Xin. Multi-head Attention Pooling-Based RCNN Model for Text Classification [J]. Computer Engineering and Applications, 2021, 57(12): 155-160.
[13]	YAO Jiaqi, XU Zhengguo, YAN Jikun, WANG Keren. GCN-PU: PU Text Classification Algorithm Based on Graph Convolutional Network [J]. Computer Engineering and Applications, 2021, 57(11): 162-167.
[14]	CHE Minshi, NIE Chunyan, YANG Chengjin, RUAN Xinlei, FAN Rujun. Research on Correlation Between Physiological Signal and Emotion Based on Grey Relational Method [J]. Computer Engineering and Applications, 2021, 57(11): 168-172.
[15]	HAO Chao, QIU Hangping, SUN Yi, ZHANG Chaoran. Research Progress of Multi-label Text Classification [J]. Computer Engineering and Applications, 2021, 57(10): 48-56.

Research on application of word correlation in Naive Bayes text classification

词间相关性在贝叶斯文本分类中的应用研究

PDF

Knowledge

Abstract

Cite this article

share this article

References

Related Articles 15

Recommended Articles

Metrics