Improving phrase-based statistical translation by modifying phrase extraction algorithm

Computer Engineering and Applications ›› 2008, Vol. 44 ›› Issue (13): 147-149.

• 数据库、信号与信息处理 • Previous Articles Next Articles

Improving phrase-based statistical translation by modifying phrase extraction algorithm

QIANG Jing^1,2,ZHANG Jian¹

1.Institute of Intelligent Machines，Chinese Academy of Sciences，Hefei 230031，China
2.School of Information Science and Technology，University of Science and Technology of China，Hefei 230027，China

Received:2007-08-21 Revised:2007-11-15 Online:2008-05-01 Published:2008-05-01
Contact: QIANG Jing

基于短语的统计机器翻译中短语抽取算法改进

强静^1,2,张建¹

1.中国科学院合肥智能机械研究所，合肥 230031
2.中国科学技术大学信息科学技术学院，合肥 230027

通讯作者: 强静

Abstract

Abstract: The paper proposes an improved algorithm of Phrase Extract based on the Och’s phrase extraction algorithm in the phrase based statistical machine translation.The algorithm can take more accurate alignment information based on the original algorithm.It is of great significance for the smaller corpus statistical machinery.It can reduce the unknown words by increasing in correct alignment information，and increases the rate of correct translation.After the different scale corpus experiment.The extracted number of phrase is obviously increase.

Key words: machine translation, translation model, phrase extract

摘要： 针对基于短语统计机器翻译中目前常用的Och提出的短语抽取算法，提出了一种改进算法。该算法能够在原有算法的基础上抽取出更多的准确对齐信息，这对语料库较小的汉民统计机器来说意义重大，增加正确的对齐信息可以减少未登录词的产生，提高翻译正确率。经过对不同规模语料库的实验，抽取的短语对数目有明显增多。

关键词: 统计机器翻译, 翻译模型, 短语抽取

QIANG Jing^1,2,ZHANG Jian¹. Improving phrase-based statistical translation by modifying phrase extraction algorithm[J]. Computer Engineering and Applications, 2008, 44(13): 147-149.

强静^1,2,张建¹. 基于短语的统计机器翻译中短语抽取算法改进[J]. 计算机工程与应用, 2008, 44(13): 147-149.

[1]	Hasan Wumaier, Sirajahmat Ruzmamat, Xireaili Hairela, LIU Wenqi, Tuergen Yibulayin, WANG Liejun, Wayit Abulizi. Bi-directional Uyghur-Chinese Neural Machine Translation with Marked Syllables [J]. Computer Engineering and Applications, 2021, 57(4): 161-168.
[2]	FAN Wei, LIU Huan, ZHANG Yuxiang. Keyphrase Extraction Algorithm Integrating Word Embeddings and Position Information [J]. Computer Engineering and Applications, 2020, 56(5): 179-185.
[3]	MENG Fuyong, TANG Xuri. Efficiency First：Reviewing Technologies of Machine Translation Post-Editing [J]. Computer Engineering and Applications, 2020, 56(22): 25-32.
[4]	LIU Chenhui, ZHANG Desheng, HU Gang. Research on Chinese Key Phrase Extraction Algorithm Based on TAKE [J]. Computer Engineering and Applications, 2020, 56(10): 115-121.
[5]	HOU Qiang1, HOU Ruili2. Review of Studies and Developments on Machine Translation Methodology [J]. Computer Engineering and Applications, 2019, 55(10): 30-35.
[6]	MUHETAER Palidan, SILAMU Wushouer, Maimaitayifu, YOULUWASI Nuermaimaiti. Application of RNN encoder-decoder in Uyghur-Chinese machine translation [J]. Computer Engineering and Applications, 2018, 54(15): 235-240.
[7]	XU Chun1，2，3, YANG Yong4, JIANG Tonghai1. Research on machine translation based Uyghur morphological analysis [J]. Computer Engineering and Applications, 2017, 53(14): 138-142.
[8]	GUO Junbo1, ZHANG Xiyuan2, DU Jinhua2. N-best syntactic knowledge enhanced pre-reordering model for statistical machine translation [J]. Computer Engineering and Applications, 2016, 52(17): 160-165.
[9]	WU Peihao, XU Jin’an, ZHANG Yujie. Research on joint Chinese-Japanese word segmentation for phrase-based statistical machine translation [J]. Computer Engineering and Applications, 2015, 51(5): 116-120.
[10]	HE Xiangzhen1, WAN Fucheng1, YU Hongzhi1, WU Xihong2. Machine translation technology based on Tibetan semantic parsing [J]. Computer Engineering and Applications, 2015, 51(15): 134-137.
[11]	WAN Fucheng1, YU Hongzhi1, WU Xihong2, HE Xiangzhen1. Research of Tibetan syntax for machine translation [J]. Computer Engineering and Applications, 2015, 51(13): 211-215.
[12]	LI Hongzheng, ZHU Yun, JIN Yaohong. Automatic identification of verb-preposition multi-category words for Chinese-English patent machine translation [J]. Computer Engineering and Applications, 2015, 51(11): 6-11.
[13]	LIU Zhiying1，2，GUO Yanbo3，JIN Yaohong1，2. Format conversion in Chinese-English machine translation [J]. Computer Engineering and Applications, 2014, 50(6): 192-196.
[14]	JIN Yaohong1，2. Hybrid-strategy method combining semantic analysis with rule-based MT for patent machine translation [J]. Computer Engineering and Applications, 2012, 48(4): 29-32.
[15]	LIU Ying, JIANG Wei. Translation rules extraction for statistical machine translation [J]. Computer Engineering and Applications, 2012, 48(32): 98-101.

Improving phrase-based statistical translation by modifying phrase extraction algorithm

基于短语的统计机器翻译中短语抽取算法改进

PDF

Knowledge

Abstract

Cite this article

share this article

References

Related Articles 15

Recommended Articles

Metrics