关键词: 中文分词, 正向最大匹配, 词典, 三级索引

Abstract: Chinese word segmentation dictionary is the important base of Chinese information processing system. The arithmetic of the dictionary influences the speed and efficiency of segmentation. This paper analyzes the three typical dictionary structures, and then presents a new dictionary structure using three-level index. On the basis of this new structure, this paper also improves the positive matching method, reduces the complexity of matching process. Then a comparison is given between typical dictionary structures. The result proves that the new dictionary structure is better in many aspects such as the efficiency of retrieving and the speed of Chinese word segmentation and it can fulfill the need of Chinese processing system.

Key words: Chinese word segmentation, positive matching method, word dictionary, three-level index