Chinese Event Argument Extraction Based on GLSTM and Attention

doi:10.3778/j.issn.1002-8331.2009-0494

Abstract

Abstract: Event extraction is one of the tasks in information extraction（IE）, which aims to detect triggers and arguments of different events. As the task is susceptible to the sparsity of data, argument extraction is a nodus in Chinese event extraction, and the focus of research is on the construction of features. As Chinese grammar is much more complicated than English, the method of capturing English text features is not effective in Chinese tasks. However, the commonly used neural network models only consider contextual information. Considering lexical and syntactic features of Chinese text, the review proposes an attention and grouped long-short term memory（GLSTM） based Chinese event extraction（AGCEE） method. The model composites lexical features and contextual features by attention, captures context information by GLSTM, and extracts the event arguments by conditional random fields（CRF）. Finally, experiments and analysis are conducted on a public data set to verify the effectiveness of the method.

Key words: event argument extraction, attention mechanism, fusion features, grouped long-short term memory（GLSTM）

摘要： 事件信息抽取是信息抽取任务中的一种，旨在识别并提出一个事件的触发词和元素。由于容易受到数据稀疏的影响，事件要素的抽取是中文事件抽取任务中的一个难点，研究的重点在于特征工程的构建。中文语法相较英文要复杂许多，所以捕获英文文本特征的方法在中文任务中效果并不明显，而目前常用的神经网络模型仅考虑了上下文信息，不能兼顾词法和句法特征。因此针对中文的词法和句法特点，构建一种结合分组长短期记忆网络（grouped long-short term memory，GLSTM）和Attention的中文事件要素抽取方法AGCEE（attention and GLSTM based Chinese event extraction），通过Attention机制融合词特征和句子特征，采用GLSTM捕获句子的上下文信息，并通过条件随机场（conditional random fields，CRF）进行事件信息抽取，最后在公开数据集上进行实验以验证模型的有效性。

关键词: 事件要素抽取, 注意力机制, 融合特征, 分组长短期记忆网络（GLSTM）

CAO Yukun, SUN Tao. Chinese Event Argument Extraction Based on GLSTM and Attention[J]. Computer Engineering and Applications, 2022, 58(6): 157-163.

曹渝昆, 孙涛. 基于GLSTM和Attention的中文事件要素提取[J]. 计算机工程与应用, 2022, 58(6): 157-163.

References

[1] CHEN Y，LIU S，ZHANG X，et al.Automatically labeled data generation for large scale event extraction[C]//Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics（Volume 1：Long Papers），2017.
[2] LAFFERTY J，MCCALLUM A，PEREIRA F C N.Conditional random fields：probabilistic models for segmenting and labeling sequence data[C]//Proceedings of 18th International Conference on Machine Learning，2001.
[3] VASWANI A，SHAZEER N，PARMAR N，et al.Attention is all you need[J].arXiv：1706.03762，2017.
[4] CHEN Y，XU L，LIU K，et al.Event extraction via dynamic multi-pooling convolutional neural networks[C]//The 53rd Annual Meeting of the Association for Computational Linguistics（ACL2015），2015.
[5] BJ?RNE J，SALAKOSKI T.Biomedical event extraction using convolutional neural networks and dependency parsing[C]//Proceedings of the BioNLP 2018 Workshop，Melbourne，Australia，July 19，2018.
[6] LIU X，LUO Z，HUANG H.Jointly multiple events extraction via attention-based graph information aggregation[J].arXiv：1809.09078v1，2018.
[7] SHAFIEIBAVANI E，YEPES A J，ZHONG X，et al.Global locality in biomedical relation and event extraction[C]//Proceedings of the 19th SIGBioMed Workshop on Biomedical Language Processing，2020.
[8] KUSA W，SPRANGER M.External evaluation of event extraction classifiers for automatic pathway curation：a next ended study of them TOR pathway[C]//Proceedings of the BioNLP 2017 Workshop，Vancouver，Canada，August 4，2017：247-256.
[9] YANG H，CHEN Y，LIU K，et al.DCFEE：a document-level hinese financial event extraction system based on automatically labeled training data[C]//Proceedings of ACL 2018，System Demonstrations，Association for Computational Linguistics，Melbourne，Australia，2018：50-55.
[10] ZHENG S，CAO W，XU W，et al.Doc2EDAG：an end-to-end document-level framework for Chinese financial event extraction[J].arXiv：1904.07535，2019.
[11] CAO P，CHEN Y，LIU K，et al.Adversarial transfer learning for Chinese named entity recognition with self-attention mechanism[C]//Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing，2018.
[12] THAKKER U，BEU J，GOPE D，et al.Run-time efficient RNN compression for inference on edge devices[C]//2019 2nd Workshop on Energy Efficient Machine Learning and Cognitive Computing for Embedded Applications（EMC2），2019.
[13] DU Y，PEI B，ZHAO X，et al.Deep scaled dot-product attention based domain adaptation model for biomedical question answering[J].Methods，2020，173：69-74.
[14] LAMPLE G，BALLESTEROS M，SUBRAMANIAN S，et al.Neural architectures for named entity recognition[J].arXiv：1603.01360，2016.
[15] ZHANG P，MENG J，LUAN Y，et al.Plant miRNA-lncRNA interaction prediction with the ensemble of CNN and IndRNN[J].Interdisciplinary Sciences：Computational Life Sciences，2020，12（1）：82-89.
[16] GONNET P，DESELAERS T.Indylstms：independently recurrent LSTMS[C]//2020 IEEE International Conference on Acoustics，Speech and Signal Processing（ICASSP），2020.
[17] ZHANG X J，LIU Z T，LIU W，et al.Research on event-based semantic annotation of Chinese[C]//Proceedings of 2012 2nd International Conference on Computer Science and Network Technology，2013.
[18] SUABOOT J，TARI Z，MAHMOOD A，et al.Sub-curve HMM：a malware detection approach based on partial analysis of API call sequences[J].Computers & Security，2020，92：101773.