首页 | 官方网站   微博 | 高级检索  
     

基于GRU和注意力机制的远程监督关系抽取
引用本文:黄兆玮,常亮,宾辰忠,孙彦鹏,孙磊.基于GRU和注意力机制的远程监督关系抽取[J].计算机应用研究,2019,36(10).
作者姓名:黄兆玮  常亮  宾辰忠  孙彦鹏  孙磊
作者单位:桂林电子科技大学广西可信软件重点实验室,广西桂林,541004
基金项目:国家自然科学基金资助项目(U1501252,61572146);广西创新驱动重大专项项目(AA17202024);广西自然科学基金资助项目(2016GXNSFDA380006);广西信息科学实验中心平台建设项目(PT1601)
摘    要:随着深度学习的发展,越来越多的深度学习模型被运用到了关系提取的任务中,但是传统的深度学习模型无法解决长距离依赖问题;同时,远程监督将会不可避免地产生错误标签。针对以上两个问题,提出一种基于GRU(gated recurrent unit)和注意力机制的远程监督关系抽取方法,首先通过使用GRU神经网络来提取文本特征,解决长距离依赖问题;接着在实体对上构建句子级的注意力机制,减小噪声句子的权重;最后在真实的数据集上,通过计算准确率、召回率并绘出PR曲线证明该方法与现有的一些方法相比,取得了比较显著的进步。

关 键 词:深度学习  远程监督  门控循环单元  注意力机制
收稿时间:2018/3/19 0:00:00
修稿时间:2018/4/28 0:00:00

Distant supervision relationship extraction based on GRU and attention mechanism
Huang Zhaowei,Chang Liang,Bin Chenzhong,Sun Yanpeng and Sun Lei.Distant supervision relationship extraction based on GRU and attention mechanism[J].Application Research of Computers,2019,36(10).
Authors:Huang Zhaowei  Chang Liang  Bin Chenzhong  Sun Yanpeng and Sun Lei
Affiliation:Guilin University of Electronic Technology,Guangxi Key Laboratory of Trusted Software,Guangxi Guilin,541004,,,,
Abstract:With the development of deep learning, more and more deep learning models have been applied to the task of relation extraction, but traditional deep learning models cann''t solve long distance dependence problems. At the same time, distant supervision will inevitably generate wrong labels. For these two problems, this paper proposed a distant supervision relationship extraction method based on GRU(gated recurrent unit) and the attention mechanism. First, it adopted the GRU neural network to extract text features and solve long-distance dependence problems. Second it constructed a sentence-level attention mechanism on entity pairs to reduce the weight of noise sentences. Finally, based on the real data set, by calculating the accuracy rate and recall rate, and drawing the PR curve to prove the proposed method has achieved significant progress compared with some existing methods.
Keywords:deep learning  distant supervision  GRU  attention mechanism
本文献已被 万方数据 等数据库收录!
点击此处可从《计算机应用研究》浏览原始摘要信息
点击此处可从《计算机应用研究》下载全文
设为首页 | 免责声明 | 关于勤云 | 加入收藏

Copyright©北京勤云科技发展有限公司    京ICP备09084417号-23

京公网安备 11010802026262号