Computer Engineering and Applications ›› 2011, Vol. 47 ›› Issue (6): 138-139.

• 数据库、信号与信息处理 • Previous Articles     Next Articles

Tibetan corpus processing method

CAI Rangjia   

  1. Research Center of Tibetan Information,Qinghai Normal University,Xining 810008,China
  • Received:1900-01-01 Revised:1900-01-01 Online:2011-02-21 Published:2011-02-21

藏语语料库加工方法研究

才让加   

  1. 青海师范大学 藏文信息研究中心,西宁 810008

Abstract: In order to make the Tibetan corpus standardization,unity,practicability and to improve the overall level of processing.The multifarious Tibetan corpus in the processing part should be arranged and unified,which can get high quality of raw corpora.Then the processing units of Tibetan ancillary facilities for segmentation is determined,the Tibetan language syntax category and Tibetan words corpus are put forward,and participles tagging dictionary is set up based on the selection in the words of Tibetan categorize and statistics.The Tibetan automatic word segmentation tagging is designed and carried.The large-scale Tibetan corpus is segmented and labeled by using participle labeling software.The multilevel processing of Tibetan Corpus is implemented.

Key words: Tibetan corpus, norms, lexicon, mark sets, dictionary, participle labeling

摘要: 为了使藏语语料库具有规范性、统一性和实用性,提高加工的整体水平,在藏语语料库的加工过程中首先要对五花八门的藏语语料库进行整理和统一,得到高质量的原始语料库,其次确定藏语原料库加工的切分单位,针对藏语的语法特征提出藏语语料库藏语词语类别和词类标记集,同时在对藏语词语进行归类和统计的基础上建立分词标注词典库,设计并实现藏文自动分词标注软件,利用分词标注软件对大规模藏语语料库进行切分和标注,最终实现藏语语料库的多级加工。

关键词: 藏语语料库, 规范, 词类, 标记集, 词典, 分词标注