Application of quantitative characteristics of Chinese genres in text clustering

doi:10.3778/j.issn.1002-8331.2009.29.007

Computer Engineering and Applications ›› 2009, Vol. 45 ›› Issue (29): 25-27.DOI: 10.3778/j.issn.1002-8331.2009.29.007

• 博士论坛 • Previous Articles Next Articles

Application of quantitative characteristics of Chinese genres in text clustering

HUANG Wei^1，2，LIU Hai-tao²

1.Chinese Proficiency Test Center（HSK），Beijing Language and Culture University，Beijing 100083，China
2.Institute of Applied Linguistics，Communication University of China，Beijing 100024，China

Received:2009-07-31 Revised:2009-08-31 Online:2009-10-11 Published:2009-10-11
Contact: HUANG Wei

汉语语体的计量特征在文本聚类中的应用

黄伟^1，2，刘海涛²

1.北京语言大学汉语水平考试中心，北京 100083
2.中国传媒大学应用语言学研究所，北京 100024

通讯作者: 黄伟

Abstract

Abstract: The method of applying the findings in quantitative study on linguistics to research on text clustering is presented.16 linguistic structures，which distribute distinctively between oral and written Chinese，are investigated based on two sample corpora with size of half million words for each.Test texts represented by using 7 of those linguistic structures are correctly clustered into spoken（similarity=89.84%） and written（similarity=86.93%） classes in a text clustering experiment.The method of representing texts with quantitative characteristics of linguistic structures enhances the interpretability of the results，and is feasible and theoretically and practicably significative in text clustering and text classification.Corpus and statistics are methodologically significant in describing study on Chinese genres，the theoretical foundations of which are also included.

Key words: text clustering, genre characteristics, linguistic structure, spoken Chinese, written Chinese

摘要： 提出了将语言计量研究成果应用于文本聚类研究的方法。通过两个50万词的语料样本发现了在现代汉语口语体和书面语体中具有显著分布差异的16个语言结构特征；以其中7个作为文本表示特征准确地将实验文本聚类为口语体（相似度89.84%）和书面语体（相似度86.93%）两类。以语言结构的计量特征表示文本的方法加强了聚类/分类研究的可解释性，具有较高的理论和应用价值。以语料库和统计方法进行语体特征计量研究是汉语语体描写研究的重要方法，阐述了其理论基础。

关键词: 文本聚类, 语体特征, 语言结构, 汉语口语, 汉语书面语

CLC Number:

TP391.1

HUANG Wei^1，2，LIU Hai-tao². Application of quantitative characteristics of Chinese genres in text clustering[J]. Computer Engineering and Applications, 2009, 45(29): 25-27.

黄伟^1，2，刘海涛². 汉语语体的计量特征在文本聚类中的应用[J]. 计算机工程与应用, 2009, 45(29): 25-27.

[1]	HUO Guangyu, ZHANG Yong, SUN Yanfeng, YIN Baocai. Research on Archive Data Intelligent Classification Based on Semantic [J]. Computer Engineering and Applications, 2021, 57(6): 247-253.
[2]	HU Xiaomin, WANG Mingfeng, ZHANG Shourong, LI Min. New Differential Evolution with Particle Swarm Optimization Algorithm for Text Clustering [J]. Computer Engineering and Applications, 2021, 57(4): 61-67.
[3]	HUANG Zijun, CHEN Qi, LUO Wenbing. Chinese Character Generation Method Based on Deep Learning [J]. Computer Engineering and Applications, 2021, 57(17): 29-36.
[4]	PAN Chengsheng, ZHANG Bin, LYU Yana, DU Xiuli, QIU Shaoming. K-Means Text Clustering Based on Improved Gray Wolf Optimization Algorithm [J]. Computer Engineering and Applications, 2021, 57(1): 188-193.
[5]	QIN Chaoyong, ZHENG Peng, ZHANG Xiao. Offline Handwritten Chinese Character Recognition Based on MQDF-DBM Model [J]. Computer Engineering and Applications, 2020, 56(7): 141-146.
[6]	ZHANG Weiwei, HU Yaqi, ZHAI Guangyu, LIU Zhipeng. Academic Abstract Clustering Method Based on LDA Model and Doc2vec [J]. Computer Engineering and Applications, 2020, 56(6): 180-185.
[7]	ZHANG Yunchun, ZHANG Kun, XU Jiming, YUAN Weiping, CAI Ying, GAO Ya. Multi-document Summary Generation Algorithm Based on Graph Model [J]. Computer Engineering and Applications, 2020, 56(16): 124-131.
[8]	LI Guoqiang, ZHOU He, MA Kai, ZHANG Lu. Feature Grouping Extraction Fusion of Deep Network Offline Handwritten Chinese Character Recognition [J]. Computer Engineering and Applications, 2020, 56(12): 163-168.
[9]	WANG Binyu1, LIU Wenfen2, HU Xuexian1, WEI Jianghong1. Research on text clustering for selecting initial cluster center based on Cosine distance [J]. Computer Engineering and Applications, 2018, 54(10): 11-18.
[10]	XIE Chenyang1，LU Yanxin2. Supervise multi-label text classification based on hierarchical dirichlet process [J]. Computer Engineering and Applications, 2017, 53(23): 18-23.
[11]	YAN Xiliang1, WANG Liming2. Handwritten Chinese character recognition system based on neural network convolution depth [J]. Computer Engineering and Applications, 2017, 53(10): 246-250.
[12]	LI Xin1, WANG Suge1，2, LI Deyu1，2. Dimension identification method for text sentiment clustering [J]. Computer Engineering and Applications, 2015, 51(7): 124-130.
[13]	YANG Xiaofu, QI Jiandong, JI Pengfei, ZHU Wenfei. New text clustering algorithm based on CF tree and KNN graph partition [J]. Computer Engineering and Applications, 2015, 51(6): 114-119.
[14]	LIU Haifeng, LIU Shousheng, SU Zhan. Sample cutting and weighting method in text classification based on position [J]. Computer Engineering and Applications, 2015, 51(2): 131-135.
[15]	ZHAN Zhijian, YANG Xiaoping. Text similarity calculation based on language network and semantic information [J]. Computer Engineering and Applications, 2014, 50(5): 33-38.

Application of quantitative characteristics of Chinese genres in text clustering

汉语语体的计量特征在文本聚类中的应用

PDF

Knowledge

Abstract

Cite this article

share this article

References

Related Articles 15

Recommended Articles

Metrics