Chinese personal name recognition based on multilevel threshold

Computer Engineering and Applications ›› 2007, Vol. 43 ›› Issue (33): 1-3.

• 博士论坛 • Previous Articles Next Articles

Chinese personal name recognition based on multilevel threshold

YU Zu-bo¹,GAO Qing-shi^1,2,MA Jian-jun¹

1.Department of Computer Science and Engineering,Dalian University of Technology,Dalian,Liaoning 116023,China
2.Institute of Intelligence,Linguistics and Computer Science,University of Science and Technology Beijing,Beijing 100083,China

Received:1900-01-01 Revised:1900-01-01 Online:2007-11-21 Published:2007-11-21
Contact: YU Zu-bo

基于多级阈值的中文人名识别

余祖波¹,高庆狮^1,2,马建军¹

1.大连理工大学计算机科学与工程系,辽宁大连 116023
2.北京科技大学智能、语言与计算机科学研究所,北京 100083

通讯作者: 余祖波

Abstract

Abstract: This paper presents the rules of surname words and name words of all kinds of Chinese personal names based on a large scale personal names base.It also shows the probability of all surname words being a surname and their contexts rules by making a statistics on a large scale corpus.In allusion to personal names of Chinese Han Nationality,multilevel threshold of surname is proposed.In order to recognize personal names of Chinese minority nationalities and transliterated personal names,it proposes multilevel threshold of the first word of personal name as well.And these thresholds are chosen by 3σ rule.The results show that the model of multilevel threshold is effective in recognizing Chinese personal names.

Key words: natural language processing, unknown words recognition, Chinese personal name recognition, multilevel threshold, 3σ rule

摘要： 在对大规模姓名样本库统计的基础上,研究了各种中文人名的姓氏、名字用字规律,并通过对大规模语料库的统计分析,得到了每个姓氏用字在真实文本中用作真实姓氏的概率及其上下文规律;针对汉族人名和少数民族人名及音译人名,分别提出了多级姓氏阈值和多级首字阈值的概念,并使用3σ法则确定阈值。实验结果表明,基于多级阈值的中文人名识别模型是有效的。

关键词: 自然语言处理, 未登录词识别, 中文人名识别, 多级阈值, 3σ法则

YU Zu-bo¹,GAO Qing-shi^1,2,MA Jian-jun¹. Chinese personal name recognition based on multilevel threshold [J]. Computer Engineering and Applications, 2007, 43(33): 1-3.

余祖波¹,高庆狮^1,2,马建军¹. 基于多级阈值的中文人名识别[J]. 计算机工程与应用, 2007, 43(33): 1-3.

[1]	LIU Bowen, FAN Chunxiao. Relation Extraction Based on CapsuleNet via Position Perception [J]. Computer Engineering and Applications, 2021, 57(6): 101-107.
[2]	LIAO Wenxiong, ZENG Bi, XU Yayun. Natural Language Processing Model Based on One-Dimensional Dilated Convolution and Attention Mechanism [J]. Computer Engineering and Applications, 2021, 57(4): 114-119.
[3]	JIANG Yangyang, JIN Bo, ZHANG Baochang. Research Progress of Natural Language Processing Based on Deep Learning [J]. Computer Engineering and Applications, 2021, 57(22): 1-14.
[4]	YUAN Xun, LIU Rong, LIU Ming. Aspect-Level Sentiment Analysis Model Incorporating Multi-layer Attention [J]. Computer Engineering and Applications, 2021, 57(22): 147-152.
[5]	YANG Quan. SVM Algorithm for N1+N2 Structure Syntax Relation Determination [J]. Computer Engineering and Applications, 2021, 57(20): 104-108.
[6]	JIAO Kainan, LI Xin, ZHU Rongchen. Overview of Chinese Domain Named Entity Recognition [J]. Computer Engineering and Applications, 2021, 57(16): 1-15.
[7]	LIU Chang, Abudukelimu·Abulizi, YAO Dengfeng, Halidanmu·Abudukelimu. Survey for Uyghur Morphological Analysis [J]. Computer Engineering and Applications, 2021, 57(15): 42-61.
[8]	LI Zhi, WANG Zhen, YANG Fugeng, Xi Xuefeng. Research and Prospect of Automatic Question Answer Based on Table [J]. Computer Engineering and Applications, 2021, 57(13): 67-76.
[9]	BAO Yue, LI Yanling, LIN Min. Review of Extractive Machine Reading Comprehension [J]. Computer Engineering and Applications, 2021, 57(12): 25-36.
[10]	HE Yujie, DU Fang, SHI Yingjie, SONG Lijuan. Survey of Named Entity Recognition Based on Deep Learning [J]. Computer Engineering and Applications, 2021, 57(11): 21-36.
[11]	HAO Chao, QIU Hangping, SUN Yi, ZHANG Chaoran. Research Progress of Multi-label Text Classification [J]. Computer Engineering and Applications, 2021, 57(10): 48-56.
[12]	SUN Linghao. Cross-Lingual Chinese Named Entity Recognition Based on Translation Model [J]. Computer Engineering and Applications, 2021, 57(10): 94-100.
[13]	YU Tongrui, JIN Ran, HAN Xiaozhen, LI Jiahui, YU Ting. Review of Pre-training Models for Natural Language Processing [J]. Computer Engineering and Applications, 2020, 56(23): 12-22.
[14]	WU Cheng, WANG Chaokun, WANG Muxian. Entity Attributes Extraction Based on Text Simplification [J]. Computer Engineering and Applications, 2020, 56(21): 115-122.
[15]	TU Wenbo, YUAN Zhenming, YU Kai. Convolutional Neural Networks Without Pooling Layer for Chinese Word Segmentation [J]. Computer Engineering and Applications, 2020, 56(2): 120-126.

Chinese personal name recognition based on multilevel threshold

基于多级阈值的中文人名识别

PDF

Knowledge

Abstract

Cite this article

share this article

References

Related Articles 15

Recommended Articles

Metrics