首页 | 官方网站   微博 | 高级检索  
     

基于位置编码与实体交互信息的关系抽取方法
引用本文:厉晓妍,张德平.基于位置编码与实体交互信息的关系抽取方法[J].计算机系统应用,2022,31(6):238-244.
作者姓名:厉晓妍  张德平
作者单位:南京航空航天大学 计算机科学与技术学院, 南京 211106
基金项目:十四五装备预研项目(JCKY2020605C003)
摘    要:关系抽取作为信息抽取领域的重要研究课题, 其主要目的是抽取句子中已标记实体对之间的语义关系, 对句子语义理解及知识库构建有着重要作用. 针对现有抽取方法中未能充分利用单词位置信息和实体间的交互信息导致重要特征丢失的问题, 本工作提出一种基于位置编码与实体交互信息的关系抽取方法(BPI-BERT). 首先将新型位置编码融入BERT预训练语言模型生成的词向量中后使用平均池化技术得到实体和句子向量, 再利用哈达玛乘积构造实体交互信息, 最后将实体向量、句子向量及交互信息向量拼接得到关系向量并输入到Softmax分类器进行关系分类. 实验结果表明BPI-BERT在精准率和 F1上较现有方法有提高, 证明了BPI-BERT的有效性.

关 键 词:位置编码  实体交互  预训练语言模型  关系抽取  监督学习  深度学习  特征融合
收稿时间:2021/9/10 0:00:00
修稿时间:2021/10/14 0:00:00

Relation Extraction Method Based on Entity Interaction and Position Encoding
LI Xiao-Yan,ZHANG De-Ping.Relation Extraction Method Based on Entity Interaction and Position Encoding[J].Computer Systems& Applications,2022,31(6):238-244.
Authors:LI Xiao-Yan  ZHANG De-Ping
Affiliation:College of Computer Science and Technology, Nanjing University of Aeronautics and Astronautics, Nanjing 211106, China
Abstract:As an important research program in the field of information extraction, relation extraction is mainly aimed at extracting semantic relations between labeled entity pairs in sentences, which plays an important role in sentence semantic understanding and knowledge base construction. The existing extraction methods fail to make full use of the word position information and the interaction information between entities, which leads to the loss of effective features in relation extraction. To solve this problem, this study proposes a relation extraction method BPI-BERT based on the interaction information between position encoding and entities. The novel position coding is integrated into the word vector generated by the BERT pre-trained language model, and the entity and sentence vectors are obtained through the average pooling technology. The Hadamard product is used to construct the entity interaction information. Finally, the entity vector, sentence vector, and interaction information vector are stitched together to obtain the relation vector which is then input to the Softmax classifier for relation classification. The experimental results show that the precision and F1 of BPI-BERT are significantly improved compared with those of the existing methods, and thus the effectiveness of BPI-BERT is proved.
Keywords:position encoding  entity interaction  pre-trained language model  relation extraction  supervised learning  deep learning  feature fusion
本文献已被 万方数据 等数据库收录!
点击此处可从《计算机系统应用》浏览原始摘要信息
点击此处可从《计算机系统应用》下载全文
设为首页 | 免责声明 | 关于勤云 | 加入收藏

Copyright©北京勤云科技发展有限公司    京ICP备09084417号-23

京公网安备 11010802026262号