Review of Deep Learning-Based Biomedical Entity Relation Extraction Research

doi:10.3778/j.issn.1002-8331.2103-0469

Abstract

Abstract:

With the development of life science and technology, the literature in the field of biomedicine has grown exponentially. How to excavate and extract valuable information from massive literature has become a new research opportunity in the field of biomedicine. As the core technology of information extraction, named entity recognition and relationship extraction become the basis and key of biomedical text mining. Its main work is to identify the entities in the biomedical text and extract the biomedical semantic relations between the entities. This paper aims to summarize the deep learning-based methods of entity identification and relationship extraction in biomedical field. It comprehensively expounds the development process of various technologies from the perspectives of concept, progress and status quo, and further clarifies the exploration direction of biomedical text information extraction.

Key words: biomedical, information extraction, named entity recognition, relation extraction, deep learning

摘要：

随着生命科学技术的发展，生物医学领域文献呈指数级增长，如何从海量文献中挖掘、抽取有价值的信息成为生物医学领域新的研究契机。作为信息抽取的核心技术，命名实体识别和关系抽取成为生物医学文本挖掘的基础和关键，其主要工作为识别生物医学文本中的实体，并提取实体间存在的生物医学语义关系。当前深度学习技术在各领域自然语言处理任务中取得了长足的发展，旨在总结基于神经网络的生物医学实体识别和关系抽取的方法，从概念、进展、现状等多角度全面阐述各项技术在生物医学领域的发展历程，进一步明确生物医学文本信息抽取工作的探索方向。

关键词: 生物医学, 信息抽取, 命名实体识别, 关系抽取, 深度学习

WEI Hao, ZHOU Ai, ZHANG Yijia, CHEN Fei, QU Wen, LU Mingyu. Review of Deep Learning-Based Biomedical Entity Relation Extraction Research[J]. Computer Engineering and Applications, 2021, 57(21): 14-23.

隗昊，周爱，张益嘉，陈飞，屈雯，鲁明羽. 深度学习生物医学实体关系抽取研究综述[J]. 计算机工程与应用, 2021, 57(21): 14-23.

References

[1] U.S.National library of medicine detailed indexing statistics[EB/OL].[2021-03-01].https：//www.nlm.nih.gov/bsd/index_
stats_comp.html.
[2] GRISHMAN R.Information extraction：techniques and challenges[C]//International Summer School on Information Extraction.Berlin，Heidelberg：Springer，1997：10-27.
[3] LECUN Y，BENGIO Y，HINTON G.Deep learning[J].Nature，2015，521（7553）：436.
[4] KIM Y.Convolutional neural networks for sentence classification[J].arXiv：1408.5882，2014.
[5] VASWANI A，SHAZEER N，PARMAR N，et al.Attention is all you need[J].arXiv：1706.03762，2017.
[6] MIKOLOV T，KARAFIáT M，BURGET L，et al.Recurrent neural network based language model[C]//Eleventh Annual Conference of the International Speech Communication Association，2010.
[7] HOCHREITER S，SCHMIDHUBER J.Long short-term memory[J].Neural Computation，1997，9（8）：1735-1780.
[8] CHO K，VAN MERRI?NBOER B，GULCEHRE C，et al.Learning phrase representations using RNN encoder-decoder for statistical machine translation[J].arXiv：1406. 1078，2014.
[9] COLETTI M H，BLEICH H L.Medical subject headings used to search the biomedical literature[J].Journal of the American Medical Informatics Association，2001，8（4）：317-323.
[10] SCHUEMIE M J，MONS B，WEEBER M，et al.Evaluation of techniques for increasing recall in a dictionary approach to gene and protein name identification[J].Journal of Biomedical Informatics，2007，40（3）：316-324.
[11] YANG Z，LIN H，LI Y.Exploiting the performance of dictionary-based bio-entity name recognition in biomedical literature[J].Computational Biology and Chemistry，2008，32（4）：287-291.
[12] KIM J D，OHTA T，TSURUOKA Y，et al.Introduction to the bio-entity recognition task at JNLPBA[C]//Proceedings of the International Joint Workshop on Natural Language Processing in Biomedicine and Its Applications，2004：70-75.
[13] PROUX D，RECHENMANN F，JULLIARD L，et al.Detecting gene symbols and names in biological texts[J].Genome Informatics，1998，9：72-80.
[14] COLLIER N，NOBATA C，TSUJII J.Extracting the names of genes and gene products with a hidden Markov model[C]//Proceedings of the 18th Conference on Computational Linguistics-Volume 1，Association for Computational Linguistics，2000：201-207.
[15] LIAO Z，WU H.Biomedical named entity recognition based on skip-chain Crfs[C]//2012 International Conference on Industrial Control and Electronics Engineering（ICICEE），2012：1495-1498.
[16] YAO L，LIU H，LIU Y，et al.Biomedical named entity recognition based on deep neutral network[J].International Journal of Hybrid Information Technology，2015，8（8）：279-288.
[17] LI L，JIN L，JIANG Y，et al.Recognizing biomedical named entities based on the sentence vector/twin word embeddings conditioned bidirectional LSTM[M]//Chinese computational linguistics and natural language processing based on naturally annotated big data.Cham：Springer，2016：165-176.
[18] ZHAO Z，YANG Z，LUO L，et al.Disease named entity recognition from biomedical literature using a novel convolutional neural network[J].BMC Medical Genomics，2017，10（5）：73.
[19] ZENG D，SUN C，LIN L，et al.LSTM-CRF for drug-named entity recognition[J].Entropy，2017，19（6）：283.
[20] LYU C，CHEN B，REN Y，et al.Long short-term memory RNN for biomedical named entity recognition[J].BMC Bioinformatics，2017，18（1）：462.
[21] 李丽双，郭元凯.基于CNN-BILSTM-CRF模型的生物医学命名实体识别[J].中文信息学报，2018，32（1）：116-122.
LI L S，GUO Y K.Biomedical named entity recognition with CNN-BILSTM-CRF[J].Journal of Chinese Information Processing，2018，32（1）：116-122.
[22] REI M，CRICHTON G K O，PYYSALO S.Attending to characters in neural sequence labeling models[J].arXiv：1611.04361，2016.
[23] PANDEY C，IBRAHIM Z，WU H，et al.Improving RNN with attention and embedding for adverse drug reactions[C]//Proceedings of the 2017 International Conference on Digital Health，2017：67-71.
[24] LUO L，YANG Z，YANG P，et al.An attention-based BiLSTM-CRF approach to document-level chemical named entity recognition[J].Bioinformatics，2017，34（8）：1381-1388.
[25] LEE J，YOON W，KIM S，et al.BioBERT：a pre-trained biomedical language representation model for biomedical text mining[J].Bioinformatics，2020，36（4）：1234-1240.
[26] JIN Q，DHINGRA B，COHEN W W，et al.Probing biomedical embeddings from language models[J].arXiv：1904.02181，2019.
[27] HAKALA K，PYYSALO S.Biomedical named entity recognition with multilingual BERT[C]//Proceedings of the 5th Workshop on BioNLP Open Shared Tasks，2019：56-61.
[28] YU X，HU W，LU S，et al.BioBERT based named entity recognition in electronic medical record[C]//2019 10th International Conference on Information Technology in Medicine and Education（ITME），2019：49-52.
[29] NASEEM U，MUSIAL K，EKLUND P，et al.Biomedical named-entity recognition by hierarchically fusing biobert representations and deep contextual-level word-embedding[C]//2020 International Joint Conference on Neural Networks（IJCNN），2020：1-8.
[30] WANG X，ZHANG Y，REN X，et al.Cross-type biomedical named entity recognition with deep multi-task learning[J].arXiv：1801.09851，2018.
[31] WEI H，GAO M，ZHOU A，et al.A multichannel biomedical named entity recognition model based on multitask learning and contextualized word representations[J].Wireless Communications and Mobile Computing，2020（5）：1-13.
[32] GIORGI J M，BADER G D.Towards reliable named entity recognition in the biomedical domain[J].Bioinformatics，2020，36（1）：280-286.
[33] 李芳，刘胜宇，刘峥.生物医学语义关系抽取方法综述[J].图书馆论坛，2017，37（6）：61-69.
LI F，LIU S Y，LIU Z.A review of methods for semantic relation extraction in biomedical field[J].Library Tribune，2017，37（6）：61-69.
[34] PYYSALO S，AIROLA A，HEIMONEN J，et al.Comparative analysis of five protein-protein interaction corpora[C]//BMC Bioinformatics，2008.
[35] SEGURA-BEDMAR I，MARTíNEZ P，HERRERO-ZAZO M.Lessons learnt from the DDIExtraction-2013 shared task[J].Journal of Biomedical Informatics，2014，51：152-164.
[36] WEI C H，PENG Y，LEAMAN R，et al.Assessing the state of the art in biomedical relation extraction：overview of the BioCreative V chemical-disease relation（CDR） task[J].The Jounal of Biological Databases and Curation，2016（64）.
[37] 宁尚明，滕飞，李天瑞.基于多通道自注意力机制的电子病历实体关系抽取[J].计算机学报，2020，43（5）：916-929.
NING S M，TENG F，LI T R.Multi-channel self-attention mechanism for relation extraction in clinical records[J].Chinese Journal of Computers，2020，43（5）：916-929.
[38] BLASCHKE C，VALENCIA A.The frame-based module of the SUISEKI information extraction system[J].IEEE Intelligent Systems，2002，17（2）：14-20.
[39] CORNEY D P A，BUXTON B F，LANGDON W B，et al.BioRAT：extracting biological information from full-length papers[J].Bioinformatics，2004，20（17）：3206-3213.
[40] FUNDEL K，KüFFNER R，ZIMMER R.RelEx—Relation extraction using dependency parse trees[J].Bioinformatics，2006，23（3）：365-371.
[41] KIM S，LIU H，YEGANOVA L，et al.Extracting drug-drug interactions from literature using a rich feature-based linear kernel approach[J].Journal of Biomedical Informatics，2015，55：23-30.
[42] 王健，刘敏捷，林鸿飞.基于多特征与多分类器融合的PPIE方法[J].计算机工程，2015，41（11）：207-212.
WANG J，LIU M J，LIN H F.Protein-protein interaction extraction method based on multiple features and multiple classifiers fusion[J].Computer Engineering，2015，41（11）：207-212.
[43] AIROLA A，PYYSALO S，BJ?RNE J，et al.A graph kernel for protein-protein interaction extraction[C]//Proceedings of the Workshop on Current Trends in Biomedical Natural Language Processing，2008：1-9.
[44] ZHANG Y，LIN H，YANG Z，et al.A single kernel-based approach to extract drug-drug interactions from biomedical literature[J].PLoS One，2012，7（11）：e48901.
[45] MIWA M，S?TRE R，MIYAO Y，et al.Protein-protein interaction extraction by leveraging multiple kernels and parsers[J].International Journal of Medical Informatics，2009，78（12）：39-46.
[46] LIU S，TANG B，CHEN Q，et al.Drug-drug interaction extraction via convolutional neural networks[J].Computational and Mathematical Methods in Medicine，2016.
[47] HUA L，QUAN C.A shortest dependency path based convolutional neural network for protein-protein relation extraction[J].BioMed Research International，2016：1-9.
[48] ZHAO Z，YANG Z，LUO L，et al.Drug drug interaction extraction from biomedical literature using syntax convolutional neural network[J].Bioinformatics，2016，32（22）：3444-3453.
[49] LIM S，LEE K，KANG J.Drug drug interaction extraction from the literature using a recursive neural network[J].PloS One，2018，13（1）：e0190926.
[50] ASADA M，MIWA M，SASAKI Y.Extracting drug-drug interactions with attention CNNs[C]//BioNLP，2017：9-18.
[51] YI Z，LI S，YU J，et al.Drug-drug interaction extraction via recurrent neural network with multiple attention layers[C]//International Conference on Advanced Data Mining and Applications.Cham：Springer，2017：554-566.
[52] CHRISTOPOULOU F，TRAN T T，SAHU S K，et al.Adverse drug events and medication relation extraction in electronic health records with ensemble deep learning methods[J].Journal of the American Medical Informatics Association，2020，27（1）：39-46.
[53] SONG L，ZHANG Y，GILDEA D，et al.Leveraging dependency forest for neural medical relation extraction[J].arXiv：1911.04123，2019.
[54] PARK C，PARK J，PARK S.AGCN：attention-based graph convolutional networks for drug-drug interaction extraction[J].Expert Systems with Applications，2020，159：113538.
[55] ZHANG Y，LIN H，YANG Z，et al.Chemical-protein interaction extraction via contextualized word representations and multihead attention[J].The Journal of Biological Databases and Curation，2019.
[56] SUN C，YANG Z，SU L，et al.Chemical-protein interaction extraction via Gaussian probability distribution and external biomedical knowledge[J].Bioinformatics，2020，36（15）：4323-4330.
[57] LAMURIAS A，CLARKE L A，COUTO F M.Extracting microRNA-gene relations from biomedical literature using distant supervision[J].Plos One，2017，12（3）：e0171929.
[58] LI G，WU C，VIJAY-SHANKER K.Noise reduction methods for distantly supervised biomedical relation extraction[C]//The Journal of Biological Databases and Curation，2017：184-193.
[59] SOUSA D，LAMURIAS A，COUTO F M.A hybrid approach toward biomedical relation extraction training corpora：combining distant supervision with crowdsourcing[J].The Journal of Biological Databases and Curation，2020.
[60] ZHAO Z，YANG Z，SUN C，et al.A hybrid protein-protein interaction triple extraction method for biomedical literature[C]//2017 IEEE International Conference on Bioinformatics and Biomedicine，2017：1515-1521.
[61] KORDJAMSHIDI P，ROTH D，MOENS M F.Structured learning for spatial information extraction from biomedical text：bacteria biotopes[J].BMC Bioinformatics，2015，16（1）：129.
[62] KORDJAMSHIDI P，VAN OTTERLO M，MOENS M F.Spatial role labeling：towards extraction of spatial relations from natural language[J].ACM Transactions on Speech and Language Processing，2011，8（3）：4.
[63] 刘奔，姬东鸿.药物实体和药物相互关系的联合识别[J].计算机工程与设计，2017，38（5）：1377-1381.
LIU B，JI D H.Joint extraction of drug entity and drug-drug interaction[J].Computer Engineering and Design，2017，38（5）：1377-1381.
[64] LI F，ZHANG M，FU G，et al.A neural joint model for entity and relation extraction from biomedical text[J].BMC Bioinformatics，2017，18（1）：198.
[65] BEKOULIS G，DELEU J，DEMEESTER T，et al.Adversarial training for multi-context joint entity and relation extraction[J].arXiv：1808.06876，2018.
[66] LUO L，YANG Z，CAO M，et al.A neural network-based joint learning approach for biomedical entity and relation extraction from biomedical literature[J].Journal of Biomedical Informatics，2020，103：103384.