中文句法异构蕴含语块标注和边界识别研究

文本蕴含是自然语言处理的难点,其形式、类型复杂,知识难以概括。早期多利用词汇蕴含和逻辑推理知识识别蕴含,但该方法反对特定类型的蕴含有效。近年来,利用大规模数据训练深度学习模型的方法在句级蕴含关系识别任务上取得优异性能,但模型不可解释,尤其是无法标定引起蕴含的具体语言片段。该文研究文本蕴含成因形式,归纳为词汇、句法异构、常识和社会经验三类,并以句法异构蕴含为研究对象。针对上述两个问题,提出句法异构蕴含语块的概念,定义其边界识别任务。该文制定句法异构蕴含语块标注规范,建立标注数据集。在此基础上,分别建立基于规则和基于深度学习的模型,探索句法异构蕴含语块的自动识别方法。实验结果表明,该文提出的深度学习模型能有效发现蕴含语块,为下一步的研究提供可靠的基线方法。

Chinese Chunked-based Heterogeneous Entailment Parser and Boundary Identification

Textual entailment(RTE) is a challenging issue for natural language processing. This paper proposes to categorize the textual entailment into three tyes: lexical entailment, chunked-based heterogeneous entailment and common-sense entailment. Focused on the concept of chunked-based heterogeneous, we further present a chunk annotation standard and a labeled dataset. Then we explore the rule-based model and the deep learning model respectively for the automatic detection of the chunk entailments. The experimental results show that the deep learning model adopted in this paper can discover the entailment fragments effectively.