Research Progress on Evaluation Methods of Handwritten Chinese Characters

doi:10.3778/j.issn.1002-8331.2107-0207

Abstract

Abstract: Handwritten Chinese character evaluation promotes the rapid development of computer-aided teaching. How to realize the grade/normative evaluation of handwritten Chinese characters without teachers’ help through handwritten Chinese character evaluation technology is the focus of current research. Firstly, this paper expounds the related concepts and development trend of handwritten Chinese character evaluation. Secondly, different research methods of handwritten Chinese character evaluation are introduced in detail, including rule-based, feature similarity calculation, fuzzy matrix and machine learning, and the advantages and disadvantages of various methods are summarized. Then it introduces the feedback form of handwritten Chinese character evaluation, including data to text generation, font matching and graphic assistance. Finally, it analyzes many problems faced by the evaluation of handwritten Chinese characters, and further considers its future development.

Key words: writing quality evaluation, feature extraction, feature matching, deep learning

摘要： 手写汉字评价推动了计算机辅助教学的快速发展，如何通过手写汉字评价技术，在无教师帮助的情况下实现手写汉字的等级/规范性评价是当前研究的重点。对手写汉字评价相关概念以及发展趋势进行阐述；对手写汉字评价的不同研究方法进行详细介绍，包括基于规则、特征相似度计算、模糊矩阵以及机器学习等方面，并对各种方法的优缺点进行总结归纳；对手写汉字评价的反馈形式进行介绍，包括数据到文本生成、字形匹配与图形辅助等方面；分析手写汉字评价面临的多个问题，进一步思考其未来的发展。

关键词: 书写质量评价, 特征提取, 特征匹配, 深度学习

XIAO Xue, LI Chengcheng. Research Progress on Evaluation Methods of Handwritten Chinese Characters[J]. Computer Engineering and Applications, 2022, 58(2): 27-42.

肖雪, 李成城. 手写汉字评价方法研究进展[J]. 计算机工程与应用, 2022, 58(2): 27-42.

References

[1] 王宇.计算机辅助教学存在的问题及改进措施[J].中国新通信，2013（10）：7.
WANG Yu.Problems and improvement measures of CAI[J].China New Communication，2013（10）：7.
[2] 张凤民.《中小学书法教育指导纲要》简要解读[J].书法教育，2018（1）：88-93.
ZHANG Fengmin.Brief interpretation of guiding outline for calligraphy education in primary and secondary schools[J].Calligraphy Education，2018（1）：88-93.
[3] 姜杰，徐晖，范斯琪，等.基于特征标记的硬笔汉字书写工整性智能测评效度研究[J].电化教育研究，2016，37（6）：84-89.
JIANG Jie，XU Hui，FAN Siqi，et al.Research on the validity of intelligent evaluation of the quality of Chinese characters hard-pen writing based on the method of feature symbol[J].Eeducation Research，2016，37（6）：84-89.
[4] 王庆，赵荣椿，冯大淦.手写体汉字的规范化处理及评价[J].数据采集与处理，2001，16（2）：227-232.
WANG Qing，ZHAO Rongchun，FENG Dagan.Methodologies and evaluation of normalization for handwritten Chinese characters[J].Journal of Data Acquisition & Processing，2001，16（2）：227-232.
[5] 安维华.计算机辅助汉字书写教学技术研究综述[J].计算机工程与应用，2019，55（23）：1-6.
AN Weihua.Survey of computer aided technology for teaching Chinese characters handwriting[J].Computer Engineering and Applications，2019，55（23）：1-6.
[6] LAM H C，PUN K H，LEUNG S T，et al.Computer-assisted-learning for learning Chinese characters[J].Communications of COLIPS，1993，3（1）：31-44.
[7] TAM V，HUANG C.An extendible software for learning to write Chinese characters in correct stroke sequences on smartphones[C]//Proceedings of the 2011 IEEE 11th International Conference on Advanced Learning Technologies，2011：118-119.
[8] LI J，ZHANG X.The design and implementation of multimedia intelligent tutoring system for Chinese characters[C]//IEEE First International Conference on Multi-media Engineering Education，2002.
[9] LAM H，KI W，LAW N，et al.Designing CALL for learning Chinese characters[J].Journal of Computer Assisted Learning，2010，17（1）：115-128.
[10] TAM V，YEUNG K.Learning to write Chinese characters with correct stroke sequences on mobile devices[C]//2010 2nd International Conference on Education Technology and Computer，2010：4395-4399.
[11] HU Z，YUN X，HUANG L，et al.A Chinese handwriting education system with automatic error detection[J].Journal of Software，2009，4（2）：101-107.
[12] SUN K，HSU S，CHEN Y.An intelligent tutoring system for teaching the stroke orders of Chinese characters on the internet[C]//The International Computer Symposium Workshop on Computer Networks，Internet，and Multimedia，1998：199-206.
[13] 庄崇彪，金连文.在线汉字书写正误及工整的智能评判算法[C]//第十二届全国信号处理学术年会（CCSP-2005）论文集，2005.
ZHUANG Chongbiao，JIN Lianwen.An intelligently verified algorithm for correctness and calligraphy of on-line handwritten Chinese characters[C]//Proceedings of the 12th National Annual Conference on Signal Processing（CCSP-2005），2005.
[14] 王军，陈翠琴.基于RFID信息与视频图像的人员识别的研究[J].物联网技术，2015，5（3）：30-31.
WANG Jun，CHEN Cuiqin.Research on personnel identification based on RFID information and video image[J].Internet of Things Technology，2015，5（3）：30-31.
[15] TSAI W H，FU K S.Error-correcting isomorphisms of attributed relational graphs for pattern analysis[J].IEEE Transactions on Systems Man & Cybernetics，1979，9（12）：757-768.
[16] TANG K T，LI K K，LEUNG H.A web-based Chinese handwriting education system with automatic feedback and analysis[C]//International Conference on Advances in Web Based Learning，2006.
[17] 闫文耀，郭铭涛，王志晓，等.面向汉字书写质量评价的Gabor特征提取方法[J].计算机技术与发展，2020，30（10）：92-96.
YAN Wenyao，GUO Mingtao，WANG Zhixiao，et al.Gabor-based feature extraction towards Chinese character writing quality evaluation[J].Computer Technology and Development，2020，30（10）：92-96.
[18] NENKOVA A，PASSONNEAU R.Evaluating content selection in summarization：the pyramid method[C]//Proceedings of the Human Language Technology Conference of the North American Chapter of the Association for Computational Linguistics，2004.
[19] 赵乐乐，张丽萍.代码注释自动生成研究进展[J].计算机应用研究，2021，38（4）：982-989.
ZHAO Lele，ZHANG Liping.Review on code comment automatic generation[J].Application Research of Computers，2021，38（4）：982-989.
[20] 韩睿方，安维华，荀恩东，等.汉字书写过程中笔画规，范，性的实时分级评判[J].计算机应用，2016，36（S1）：281-285.
HAN Ruifang，AN Weihua，XUN Endong，et al.Real-time grading judgement for stroke quality in Chinese character handwriting[J].Journal of Computer Applications，2016，36（S1）：281-285.
[21] TAN C K.An algorithm for online strokes verification of Chinese characters using discrete features[C]//International Workshop on Frontiers in Handwriting Recognition，2002.
[22] KOZIELSKI M，NUHN M，DOETSCH P，et al.Towards unsupervised learning for handwriting recognition[C]//14th International Conference on Frontiers in Handwriting Recognition（ICFHR 2014），2014：549-554.
[23] 俞凯，吴江琴，庄越挺.基于骨架相似性的书法字检索[J].计算机辅助设计与图形学学报，2009，21（6）：746-751.
YU Kai，WU Jiangqin，ZHUANG Yueting.Calligraphic characters retrieval based on skeleton similarity[J].Journal of Computer-Aided Design & Computer Graphics，2009，21（6）：746-751.
[24] 邓学雄，李京陶，李牧.毛笔书法临帖的计算机评价[J].图学学报，2014，35（6）：899-904.
DENG Xuexiong，LI Jingtao，LI Mu.Computer evaluation of imitation in Chinese calligraphy[J].Journal of Graphics，2014，35（6）：899-904.
[25] 夏伟平.联机手写体汉字楷书美化方法的研究[D].广州：华南理工大学，2010.
XIA Weiping.Research of Kai-style calligraphic beautification method for handwriting Chinese character[D].Guangzhou：South China University of Technology，2010.
[26] 李牧.书法临帖计算机评价的研究[D].广州：华南理工大学，2013.
LI Mu.Computer evaluation of Chinese calligraphy copy[D].Guangzhou：South China University of Technology，2013.
[27] 吴楚洲.书法临帖评价系统研究与实现[D].广州：华南理工大学，2017.
WU Chuzhou.Research and implementation of evaluation system of Chinese calligraphy copy[D].Guangzhou：South China University of Technology，2017.
[28] 邵荣堂.基于机器学习的书法字识别与智能评判[D].武汉：湖北工业大学，2020.
SHAO Rongtang.Machine learning-based calligraphy character recognition and intelligent judgment[D].Wuhan：Hubei University of Technology，2020.
[29] HAN C C，CHOU C H，WU C S.An interactive grading and learning system for Chinese calligraphy[J].Machine Vision and Applications，2008，19：43-55.
[30] 王耀，戴永.规定格式文字书写练习质量普适评价[J].计算机工程与应用，2010，46（29）：69-72.
WANG Yao，DAI Yong.Universal evaluation of writing exercises from prescribed form of characters’ quality[J].Computer Engineering and Applications，2010，46（29）：69-72.
[31] 樊亮，戴永，覃冰梅.触摸屏手写汉字笔画的笔力模糊评价[J].中文信息学报，2013，27（2）：91-97.
FAN Liang，DAI Yong，QIN Bingmei.Fuzzy evaluation for stroke force of handwritten Chinese character on touch screen[J].Journal of Chinese Information Processing，2013，27（2）：91-97.
[32] 樊亮.文字书写教学系统交互结构与汉字笔画笔力评价研究[D].湘潭：湘潭大学，2012.
FAN Liang.Research on interactive structure and evaluation for stroke force of handwritten Chinese character of the writing’s teaching system[D].Xiangtan：Xiangtan University，2012.
[33] 张洪梅.基于模糊综合评判的联机手写汉字工整性研究[D].南京：南京师范大学，2016.
ZHANG Hongmei.Research on the integrity of online handwritten Chinese characters based on fuzzy comprehensive evaluation[D].Nanjing：Nanjing Normal University，2016.
[34] 葛佳敏.基于可能性概率分布的机器人毛笔字审美评价[D].厦门：厦门大学，2016.
GE Jiamin.Aesthetic evaluation of robot calligraphy based on probability distribution[D].Xiamen：Xiamen University，2016.
[35] 王求真，戴永，樊亮，等.汉字书写质量的模糊分析方法[J].计算机工程与应用，2013，49（21）：180-185.
WANG Qiuzhen，DAI Yong，FAN Liang，et al.Fuzzy analysis method for quality of handwritten Chinese characters[J].Computer Engineering and Applications，2013，49（21）：180-185.
[36] GU X，ZHANG H，KIM S.Deep code search[C]//Proceedings of the 40th International Conference on Software Engineering.New York：ACM Press，2018：933-944.
[37] CHEN G，JHENG Y，LIN L.Computer-based assessment for the stroke order of Chinese characters writing[C]//Proceedings of the 2nd International Conference on Innovative Computing，Information and Control，2007.
[38] 黄峰.基于模板匹配的硬笔汉字书写质量评价方法研究[D].南京：南京师范大学，2015.
HUANG FENG.Research on hard pen Chinese character writing quality evaluation method based on template matching[D].Nanjing：Nanjing Normal University，2015.
[39] SUN R，LIAN Z，TANG Y，et al.Aesthetic visual qualityevaluation of Chinese handwritings[C]//Proceedings of the 24th International Joint Conference on Artificial Intelligence，2015：2510-2516.
[40] 耿晓艳，许维胜，吴继伟.基于神经网络的汉字质量量化评价模型[J].计算机与现代化，2014（1）：96-99.
GENG Xiaoyan，XU Weisheng，WU Jiwei.Quality evaluation model of Chinese characters based on neural network[J].Computer and Modernization，2014（1）：96-99.
[41] 夏伟平，金连文.一种基于模板的联机手写体汉字布局评价方法[C]//全国模式识别学术会议，2008.
XIA Weiping，JIN Lianwen.A method for layout evaluation of online handwritten Chinese character quality based on template[C]//National Academic Conference on Pattern Recognition，2008.
[42] 殷飞，张颐康，刘成林.手写汉字书写质量评价方法及系统：CN109543777A[P].2019.
YIN Fei，ZHANG Yikang，LIU Chenglin.Quality evaluation method and system of handwritten Chinese characters：CN109543777A[P].2019.
[43] 庄子明.基于深度学习的手写汉字识别与美感评分[D].北京：北京邮电大学，2019.
ZHUANG Ziming.Handwritten Chinese character recognition and aesthetic grading based on deep learning[D].Beijing：Beijing University of Posts and Telecommunications，2019.
[44] QI H N.A size-independent method for Chinese character writing structure assessment[C]//International Conference on Machine Learning & Cybernetics，2008.
[45] LI K K，LEUNG H，LAM S，et al.An assessment tool for judging the overall appearance of Chinese handwriting based on opinions from occupational therapists[C]//International Conference on Advances in Web Based Learning，2007.
[46] 祁亨年，陈丰农，庄立，等.一种无大小约束的汉字书写结构评测方法[J].郑州大学学报（理学版），2008（3）：59-62.
QI Hengnian，CHEN Fengnong，ZHUANG Li，et al.An evaluation method of Chinese character writing structure without size constraint[J].Journal of Zhengzhou University（Natural Science Edition），2008（3）：59-62.
[47] 温丽敏.基于审美特征的书法评价模型构造与实现[J].计算机工程与设计，2008（7）：1865-1868.
WEN Limin.Calligraphy appreciation model and its implementation based on artistic feature[J].Computer Engineering and Design，2008（7）：1865-1868.
[48] 朱永清，赵鹏，赵菲菲，等.基于深度学习的生成式文本摘要技术综述[J].计算机工程，2021，47（11）：11-21.
ZHU Y Q，ZHAO P，ZHAO F F，et al.Survey on abstractive text summarization technologies based on deep learning[J].Computer Engineering，2021，47（11）：11-21.
[49] 李雪晴，王石，王朱君，等.自然语言生成综述[J].计算机应用，2021，41（5）：1227-1235.
LI Xueqing，WANG Shi，WANG Zhujun，et al.Summarization of natural language generation[J].Journal of Computer Applications，2021，41（5）：1227-1235.
[50] GKATZIA D，LEMON O，RIESER V.Natural language generation enhances human decision-making with uncertain information[C]//Proceedings of ACL，2016.
[51] QIN G，YAO J G，WANG X，et al.Learning Latent semantic annotations for grounding natural language to structured data[C]//Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing，2018.
[52] PUDUPPULLY R，DONG L，LAPATA M.Data-to-text generation with content selection and planning[C]//Proceedings of the AAAI Conference on Artificial Intelligence，2019：6908-6915.
[53] 许晓泓，何霆，王华珍，等.结合Transformer模型与深度神经网络的数据到文本生成方法[J].重庆大学学报，2020，43（7）：91-100.
XU Xiaohong，HE Ting，WANG Huazhen，et al.Research on data-to-text generation based on transformer model and deep neural network[J].Journal of Chongqing University，2020，43（7）：91-100.
[54] HU Z，LEUNG H，YUN X.Automated Chinese handwriting error detection using attributed relational graph matching[C]//International Conference on Advances in Web Based Learning，2008.
[55] 刘颖滨，孙燕南，荀恩东.一种基于三维空间信息的字形匹配方法[J].北京大学学报（自然科学版），2016，52（1）：81-88.
LIU Yingbin，SUN Yannan，XUN Endong.Chinese calligraphy alignment based on 3D point set registration[J].Acta Scientiarum Naturalium Universitatis Pekinensis，2016，52（1）：81-88.
[56] CHEN G S，YAO H C，JHENG Y D，et al.On-line assessment for the stroke order of chinese characters writing[C]//Proceedings-ICCE 2008：16th International Conference on Computers in Education，2008.
[57] TANG W，LEONG H，NGAI G，et al.Detecting handwriting errors with visual feedback in early childhood for Chinesecharacters[C]//Proceedings of the 2014 Conference on Interaction Design and Children，2014：273-276.
[58] 曲丽娜.联机手写汉字识别系统应用研究[J].信息与电脑（理论版），2018（18）：71-72.
QU Lina.Application and research of on-line handwritten Chinese character recognition system[J].China Computer & Communication，2018（18）：71-72.
[59] 李兰英，周志刚，陈德运.DBN和CNN融合的脱机手写汉字识别[J].哈尔滨理工大学学报，2020，25（3）：137-143.
LI Lanying，ZHOU Zhigang，CHEN Deyun.Offline handwritten Chinese character recognition based on DBN and CNN fusion model[J].Journal of Harbin University of Science and Technology，2020，25（3）：137-143.
[60] 成授昌.谈谈板书粉笔字[J].江苏教育，1981（1）：48.
CHENG Shouchang.On blackboard writing with chalk[J].Jiangsu Education，1981（1）：48.
[61] TSANG K，LEUNG H.Teaching stroke order of Chinese characters by using minimal feedback[C]//4th International Conference on Web-Based Learning：Technology and Pedagogy，2005.
[62] 朱欣蔚，杨长强.基于图的书法字笔画提取研究[J].软件导刊，2019，18（4）：184-187.
ZHU Xinwei，YANG Changqiang.Graph based stroke extraction for Chinese calligraphy[J].Software Guide，2019，18（4）：184-187.
[63] 李红.图像文字提取及基于Android的文字识别实现[D].青岛：山东科技大学，2020.
LI Hong.Android based application for text extraction and recognition from images[D].Qingdao：Shandong University of Science and Technology，2020.
[64] 董雷.基于图像的书法信息提取及机器人临摹研究[D].武汉：湖北工业大学，2019.
DONG Lei.Image-based calligraphy information extraction and robot copying research[D].Wuhan：Hubei University of Technology，2019.
[65] 曹忠升，苏哲文，王元珍，等.基于模糊区域检测的手写汉字笔画提取方法[J].中国图象图形学报，2009，14（11）：2341-2348.
CAO Zhongsheng，SU Zhewen，WANG Yuanzhen，et al.A method of handwritten Chinese stroke extraction based on ambiguous-zone detection[J].Journal of Image and Graphics，2009，14（11）：2341-2348.
[66] CHEN C P，CHEN Y，SUBBARAYAN G.Parametric stitching for smooth coupling of subdomains with non-matching discretizations[J].Computer Methods in Applied Mechanics and Engineering，2021，373：113519.