Design Dictionary of Chinese Word Segmentation

Computer Engineering and Applications ›› 2007, Vol. 43 ›› Issue (1): 1-1.

• 博士论坛 • Next Articles

Design Dictionary of Chinese Word Segmentation

,,,

中科院高能物理研究所计算中心

Received:2006-08-01 Revised:1900-01-01 Online:2007-01-01 Published:2007-01-01

汉语分词词典设计

翟伟斌,周振柳,蒋卓明,许榕生

中科院高能物理研究所计算中心

通讯作者: 翟伟斌 zhaiwb

Abstract

Abstract: Chinese word segmentation dictionary is the important base of Chinese information processing system. The arithmetic of the dictionary influences the speed and efficiency of segmentation. In this paper, the dictionary mechanism is dynamic TRIE tree, and we have designed the Chinese word segmentation dictionary. The dictionary uses less memory. The experiment shows that the dictionary has high efficiency.

Key words: Chinese word segmentation, Search dictionary, Chinese information processing

摘要： 汉语分词词典是中文信息处理系统的重要基础，词典算法设计的优劣直接关系着分词的速度和效率。本文采用动态TRIE索引树的词典机制，设计并实现了汉语分词词典，有效的减少了词典空间。实验结果表明该词典具有较高的查询性能。

关键词: 汉语分词, 词典查询, 中文信息处理

,,,. Design Dictionary of Chinese Word Segmentation[J]. Computer Engineering and Applications, 2007, 43(1): 1-1.

翟伟斌,周振柳,蒋卓明,许榕生. 汉语分词词典设计[J]. 计算机工程与应用, 2007, 43(1): 1-1.

[1]	WU Man, WEN Lili, SUN Miao. Attention Mechanism Image Understanding Algorithm of Ocean Scene [J]. Computer Engineering and Applications, 2022, 58(10): 231-239.
[2]	TU Wenbo, YUAN Zhenming, YU Kai. Convolutional Neural Networks Without Pooling Layer for Chinese Word Segmentation [J]. Computer Engineering and Applications, 2020, 56(2): 120-126.
[3]	SUN Baoshan, LI Wei. Recurrent Neural Network for Chinese Word Segmentation with Peephole-Connections [J]. Computer Engineering and Applications, 2019, 55(19): 160-165.
[4]	CHENG Yusi1, SHI Yuntao2. Domain specific Chinese word segmentation [J]. Computer Engineering and Applications, 2018, 54(17): 30-34.
[5]	ZHAO Weifeng1，2, ZHANG Qin1. Automatic identification of address description in unstructured Chinese natural language [J]. Computer Engineering and Applications, 2016, 52(23): 19-24.
[6]	ZHU Yanhui, LIU Jing, XU Yeqiang, TIAN Hailong, MA Jin. Chinese word segmentation research based on Conditional Random Field [J]. Computer Engineering and Applications, 2016, 52(15): 97-100.
[7]	HU Jinzhu1, SHU Jiangbo2, HU Quan3, LI Yuan1, YANG Jincai1, XIE Fang4. Research on expression method of rules in auto-identifying relational word of Chinese compound sentences [J]. Computer Engineering and Applications, 2016, 52(1): 127-132.
[8]	ZHANG Sifa, MA Yongge. Design and implementation of vertical search engine for field of geosciences [J]. Computer Engineering and Applications, 2012, 48(33): 85-88.
[9]	YE Jiping, ZHANG Guizhu. Research and improvement of Chinese word segmentation dictionary [J]. Computer Engineering and Applications, 2012, 48(23): 139-142.
[10]	ZHAO Youqiao1, ZHANG Shanshan1, LU Songfeng1, WU Zhijie2. COX：Chinese-oriented XML compressor with high compression ratio [J]. Computer Engineering and Applications, 2012, 48(17): 143-147.
[11]	LI Guohe1，2，3, LIU Guangsheng1，2，3, QIN Bobo1，2，3, WU Weijiang1，2，3, LI Hongqi1，2，3. Method of Chinese word rough segmentation by maximum match and ambiguity detection algorithms [J]. Computer Engineering and Applications, 2012, 48(14): 139-142.
[12]	FAN Xinghua, WANG Peng, ZHOU Peng. Two-step text orientation identification based on feature extension [J]. Computer Engineering and Applications, 2012, 48(1): 162-165.
[13]	YU Jiangde¹，WANG Xijie¹，FAN Xiaozhong². Comparing of importance of above-context versus below-context for Chinese word segmentation [J]. Computer Engineering and Applications, 2011, 47(4): 117-120.
[14]	LIU Ronghui^1，2，ZHENG Jianguo¹. Clustering algorithm in Deep Web based on Chinese word segmentation [J]. Computer Engineering and Applications, 2011, 47(4): 138-140.
[15]	YOU Huili，YAN Li，YANG Xiaodong. Research on combinational ambiguity strings in Chinese word segmentation [J]. Computer Engineering and Applications, 2011, 47(31): 125-127.

Design Dictionary of Chinese Word Segmentation

汉语分词词典设计

PDF

Knowledge

Abstract

Cite this article

share this article

References

Related Articles 15

Recommended Articles

Metrics