Computer Engineering and Applications ›› 2006, Vol. 42 ›› Issue (21): 13-.

• 博士论坛 • Previous Articles     Next Articles

Conditional Random Fields Based POS Tagging

,,   

  1. 哈尔滨工业大学,计算机科学与技术学院
  • Received:2006-04-13 Revised:1900-01-01 Online:2006-07-21 Published:2006-07-21

基于条件随机域的词性标注模型

姜维,关毅,王晓龙   

  1. 哈尔滨工业大学,计算机科学与技术学院
  • 通讯作者: 姜维 SeaBreeze

Abstract: The main difficulties in POS tagging are multi-class word disambiguation and unknown word tagging. However, more features cannot be added into Hidden Markov Model, and there is label bias problem in Maximum Entropy Markov Model. So Conditional Random Field (CRF) is introduced to build POS tagging model in this paper, in order to overcome above problems. In addition, long distance features are extracted and utilized to label complicated multi-class word. As for the unknown word tagging, named entities recognition and suffix-based method etc. are adopted to improve the POS tagging performance. Moreover, we explore the mixing models’ performance based on CRF. The experiment indicated our model achieve a good performance with 96.10% tagging precision.

Key words: POS Tagging, Conditional Random Fields, Trigger

摘要: 词性标注主要面临兼类词消歧以及未知词标注的难题,传统隐马尔科夫方法不易融合新特征,而最大熵马尔科夫模型存在标注偏置等问题。本文引入条件随机域建立词性标注模型,易于融合新的特征,并能解决标注偏置的问题。此外,又引入长距离特征有效地标注复杂兼类词,以及应用后缀词与命名实体识别等方法提高未知词的标注精度。在条件随机域模型框架下,本文进一步探讨了融合模型的方法及性能。词性标注开放实验表明,条件随机域模型获得了96.10%的标注精度。

关键词: 词性标注, 条件随机域, 触发对