Computer Engineering and Applications ›› 2008, Vol. 44 ›› Issue (21): 157-161.DOI: 10.3778/j.issn.1002-8331.2008.21.044

• 机器学习 • Previous Articles     Next Articles

Study of personal name recognition

ZHANG Su-xiang1,ZHANG Su-xian2,WANG Xiao-jie3   

  1. 1.Department of Electronic and Communication Engineering of North China Electric Power University,Baoding,Hebei 071003,China
    2.Health Vocational and Technical Colleges of Hebei University,Baoding,Hebei 071000,China
    3.School of Information Engineering of Beijing University of Posts and Telecommunications,Beijing 100876,China
  • Received:2008-04-30 Revised:2008-06-18 Online:2008-07-21 Published:2008-07-21
  • Contact: ZHANG Su-xiang

一种人名识别方法的研究

张素香1,张素贤2,王小捷3   

  1. 1.华北电力大学 电子与通信工程系,河北 保定 071003
    2.河北大学 卫生职业技术学院,河北 保定 071000
    3.北京邮电大学 信息工程学院,北京 100876
  • 通讯作者: 张素香

Abstract: A new approach is proposed to recognize personal name,where,combining multi-knowledge and multi-model,the inner-feature of personal name and its context information are considered.This paper proposes a probabilistic feature based Maximum Entropy(ME) model for personal name recognition.Where,probabilistic feature functions are used instead of binary feature functions,it is one of the several differences between this model and the most of the previous ME based model.We also explore confidence functions.We use sub-models to model Chinese Person Names,foreign names and word-only name respectively.The dynamic priority method is used to prevent a foreign personal name from splitting a Chinese personal name and the other section.Experimental results show this ME model combining above new elements brings significant improvements.The experiment shows that recall is 90.06% and precision is 89.27% in People’s Daily(1998/01),recall is 95.39% and precision is 96.71% in SIGHAN MSRA corpus,and recall is 87.56% and precision is 91.04% in SIGHAN LDC corpus.

Key words: maximum entropy, probability feature, confidence function, evaluation

摘要: 针对汉语人名识别的难点,基于最大熵算法提出了结合多知识、多模型的识别方法,充分考虑了人名的内部特征(小颗粒特征)和人名的语境信息。论文的主要贡献是:将概率信息赋予最大熵模型,极大提高人名的准确率和召回率;细化了分类模型,将人名识别分成中国人名识别、外国译名识别和单字人名识别;提出动态优先级方法来防止一个外国译名被部分识别为一个或几个中国人名。实验测试数据为1998年1月的人民日报和Sighan(2006)命名实体测试语料。测试结果表明,人民日报(1998-01)的召回率为90.06%,准确率为89.27%;Sighan(MSRA)语料的召回率为95.39%,准确率为96.71%;Sighan(LDC)语料的召回率为87.56%,准确率为91.04%。实验结果证明,提出的人名识别方法是非常有效的。

关键词: 最大熵, 概率特征, 自信度函数, 评测