Full-mapping dictionary implemented by single array

Computer Engineering and Applications ›› 2007, Vol. 43 ›› Issue (23): 184-186.

• 数据库与信息处理 • Previous Articles Next Articles

Full-mapping dictionary implemented by single array

WEI Jin，CHANG Chao-wen

Institute of Electronic Technology，PLA Information Engineering University，Zhengzhou 450004，China

Received:1900-01-01 Revised:1900-01-01 Online:2007-08-11 Published:2007-08-11
Contact: WEI Jin

单数组全映射分词词典

魏进，常朝稳

解放军信息工程大学电子技术学院，郑州 450004

通讯作者: 魏进

Abstract

Abstract: Provide and implement a new dictionary named Single-Array-Full-Mapping（SAFM） by studying and analyzing four typical dictionary at present：binary-seek-by-word，TRIE indexing tree，binary-seek-by-characters and double-character-hash-indexing.SAFM dictionary has a simple structure，high speed of segmentation and little memory requirement.

Key words: Chinese information processing, Chinese word segmentation, dictionary mechanism for Chinese word segmentation, single array full mapping

摘要： 通过研究和分析目前几种典型的分词词典机制：整词二分、TRIE索引树、逐字二分及双字哈希，提出并实现了新的单数组全映射（SAFM）分词词典。该词典具有构造简单，分词速度快，占用空间小的优点。

关键词: 中文信息处理, 汉语自动分词, 汉语自动分词词典机制, 单数组全映射

WEI Jin，CHANG Chao-wen. Full-mapping dictionary implemented by single array[J]. Computer Engineering and Applications, 2007, 43(23): 184-186.

魏进，常朝稳. 单数组全映射分词词典[J]. 计算机工程与应用, 2007, 43(23): 184-186.

[1]	TU Wenbo, YUAN Zhenming, YU Kai. Convolutional Neural Networks Without Pooling Layer for Chinese Word Segmentation [J]. Computer Engineering and Applications, 2020, 56(2): 120-126.
[2]	SUN Baoshan, LI Wei. Recurrent Neural Network for Chinese Word Segmentation with Peephole-Connections [J]. Computer Engineering and Applications, 2019, 55(19): 160-165.
[3]	CHENG Yusi1, SHI Yuntao2. Domain specific Chinese word segmentation [J]. Computer Engineering and Applications, 2018, 54(17): 30-34.
[4]	ZHAO Weifeng1，2, ZHANG Qin1. Automatic identification of address description in unstructured Chinese natural language [J]. Computer Engineering and Applications, 2016, 52(23): 19-24.
[5]	ZHU Yanhui, LIU Jing, XU Yeqiang, TIAN Hailong, MA Jin. Chinese word segmentation research based on Conditional Random Field [J]. Computer Engineering and Applications, 2016, 52(15): 97-100.
[6]	HU Jinzhu1, SHU Jiangbo2, HU Quan3, LI Yuan1, YANG Jincai1, XIE Fang4. Research on expression method of rules in auto-identifying relational word of Chinese compound sentences [J]. Computer Engineering and Applications, 2016, 52(1): 127-132.
[7]	ZHANG Sifa, MA Yongge. Design and implementation of vertical search engine for field of geosciences [J]. Computer Engineering and Applications, 2012, 48(33): 85-88.
[8]	YE Jiping, ZHANG Guizhu. Research and improvement of Chinese word segmentation dictionary [J]. Computer Engineering and Applications, 2012, 48(23): 139-142.
[9]	ZHAO Youqiao1, ZHANG Shanshan1, LU Songfeng1, WU Zhijie2. COX：Chinese-oriented XML compressor with high compression ratio [J]. Computer Engineering and Applications, 2012, 48(17): 143-147.
[10]	LI Guohe1，2，3, LIU Guangsheng1，2，3, QIN Bobo1，2，3, WU Weijiang1，2，3, LI Hongqi1，2，3. Method of Chinese word rough segmentation by maximum match and ambiguity detection algorithms [J]. Computer Engineering and Applications, 2012, 48(14): 139-142.
[11]	FAN Xinghua, WANG Peng, ZHOU Peng. Two-step text orientation identification based on feature extension [J]. Computer Engineering and Applications, 2012, 48(1): 162-165.
[12]	YU Jiangde¹，WANG Xijie¹，FAN Xiaozhong². Comparing of importance of above-context versus below-context for Chinese word segmentation [J]. Computer Engineering and Applications, 2011, 47(4): 117-120.
[13]	LIU Ronghui^1，2，ZHENG Jianguo¹. Clustering algorithm in Deep Web based on Chinese word segmentation [J]. Computer Engineering and Applications, 2011, 47(4): 138-140.
[14]	YOU Huili，YAN Li，YANG Xiaodong. Research on combinational ambiguity strings in Chinese word segmentation [J]. Computer Engineering and Applications, 2011, 47(31): 125-127.
[15]	FENG Min-xuan. Parallel processing of contemporary Chinese “V+N” sequence relations [J]. Computer Engineering and Applications, 2010, 46(30): 8-10.

Full-mapping dictionary implemented by single array

单数组全映射分词词典

PDF

Knowledge

Abstract

Cite this article

share this article

References

Related Articles 15

Recommended Articles

Metrics