Computer Engineering and Applications ›› 2020, Vol. 56 ›› Issue (11): 225-229.DOI: 10.3778/j.issn.1002-8331.1901-0257

Previous Articles     Next Articles

Research on Chinese Language Assistant Teaching System in Deaf-Mute Schools

Yisa·Watbek, Alifu·Kuerban, HAO Ziyu, ZHOU Lei, LV Qingshen   

  1. College of Software, Xinjiang University, Urumqi 830046, China
  • Online:2020-06-01 Published:2020-06-01

聋哑学校语文辅助教学系统研究

依沙·吾阿提别克,阿里甫·库尔班,郝子煜,周雷,吕情深   

  1. 新疆大学 软件学院,乌鲁木齐 830046

Abstract:

In order to help teachers teach deaf-mute students Chinese, a teaching system that translates text into sign language is developed. The improved JieBa segmentation method is used to segment the content of the text, the sentences of the text are transformed into word sequences and the word sequences are edited by the system editing function to meet the requirements of grammar of sign language. At the same time, for the purpose of realizing the automatic translation of text content to sign language, virtual human is established and sign language animation is produced by key frame technology, and the transition between sign language animation synthesis and animation is completed by using Unity3D game engine. This research has special significance for deaf-mute students’ Chinese teaching and has certain practical value.

Key words: sign language translation, synthesis of sign gesture, sign words segmentation, sign language

摘要:

为了达到辅助老师教聋哑学生语文的目的,开发一套文本翻译成手语的教学系统。采用改进的结巴分词对课文内容进行分词,课文句子转化成词语序列,使用系统编辑功能对词语序列进行编辑,使其满足文法手语要求;同时建立虚拟人,采用关键帧技术制作手语动画,使用Unity3D游戏引擎完成手语动画合成和动画之间的过渡,实现课文内容自动翻译成手语的辅助教学系统。该研究对聋哑学生语文教学有特殊的意义,具有一定的实用价值。

关键词: 手语翻译, 手势动画合成, 手语分词, 文法手语