计算机工程与应用 ›› 2011, Vol. 47 ›› Issue (6): 138-139.
• 数据库、信号与信息处理 • 上一篇 下一篇
才让加
收稿日期:
修回日期:
出版日期:
发布日期:
CAI Rangjia
Received:
Revised:
Online:
Published:
摘要: 为了使藏语语料库具有规范性、统一性和实用性,提高加工的整体水平,在藏语语料库的加工过程中首先要对五花八门的藏语语料库进行整理和统一,得到高质量的原始语料库,其次确定藏语原料库加工的切分单位,针对藏语的语法特征提出藏语语料库藏语词语类别和词类标记集,同时在对藏语词语进行归类和统计的基础上建立分词标注词典库,设计并实现藏文自动分词标注软件,利用分词标注软件对大规模藏语语料库进行切分和标注,最终实现藏语语料库的多级加工。
关键词: 藏语语料库, 规范, 词类, 标记集, 词典, 分词标注
Abstract: In order to make the Tibetan corpus standardization,unity,practicability and to improve the overall level of processing.The multifarious Tibetan corpus in the processing part should be arranged and unified,which can get high quality of raw corpora.Then the processing units of Tibetan ancillary facilities for segmentation is determined,the Tibetan language syntax category and Tibetan words corpus are put forward,and participles tagging dictionary is set up based on the selection in the words of Tibetan categorize and statistics.The Tibetan automatic word segmentation tagging is designed and carried.The large-scale Tibetan corpus is segmented and labeled by using participle labeling software.The multilevel processing of Tibetan Corpus is implemented.
Key words: Tibetan corpus, norms, lexicon, mark sets, dictionary, participle labeling
才让加. 藏语语料库加工方法研究[J]. 计算机工程与应用, 2011, 47(6): 138-139.
CAI Rangjia. Tibetan corpus processing method[J]. Computer Engineering and Applications, 2011, 47(6): 138-139.
0 / 推荐
导出引用管理器 EndNote|Ris|BibTeX
链接本文: http://cea.ceaj.org/CN/
http://cea.ceaj.org/CN/Y2011/V47/I6/138