基于大规模语料库的句法模式匹配研究

通过大量记录的正确处理实例的分析过程和结果,在句法分析时,搜寻近似实例或片段,匹配相似语言结构和分析过程,这样的句法分析体现了“语言分析依赖经验”的思想。基于这样的思想,本文提出了一种基于模式匹配的句法分析的方法,即从大规模标注语料树库中抽取出蕴含的句法模式,构建模式、子模式及其规约库,句法分析的过程转化为模式匹配和局部模式转换的过程。实验表明句法分析的各项指标都比较理想,尤其是处理效率很高,平均句耗时0.46秒(CPU为Intel双核2.8G,内存为1G)。

Researches on Large Scale Corpus-Based Syntactic Pattern Matching

Based on a large amount of rightly parsed examples with which both parsing procedures and parsing results are recorded,syntactic parsing can be carried out by searching similar example or fragment,and matching similar language structure and analysis in the examples.This embodies the assumption that human language perception and production work with representations of concrete language experiences,rather than with abstract grammar rules.In this paper,we propose a new parsing technique based on syntactic pattern matching.We extract syntactic patterns from a large-scale tree bank,and establish a library of syntactic patterns/sub-patterns and corresponding reduction procedures beforehand.Parsing tasks are fulfilled by pattern matching and partial pattern transforming.The experiments show that the parsing results are satisfying and the program execution speed is very high,achieving 0.46s/per sentence on average(CPU: Intel Core Duo 2.8G,Memory:1G).