机器学习在汉语关联词语识别中的应用

关联词语在一些汉语议论文章中占很大的比重,因而,对于此类汉语文章的分析,关联词可以起到非常重要的作用。本文主要讨论如何将机器学习应用于汉语关联词的歧义辨别——原因,方法和效果。我们在已经加工完毕的80篇汉语语料的基础上,抽取了用于机器学习的训练集和测试集,并使用C4.5进行了测试,识别正确率在80%以上。在文章的后面,我们还从语言学的角度对机器学习的结果进行了解释和分析。

Applying Machine Learning to Identify Chinese Discourse Markers

With their high occurrence rates in argumentative Chinese texts,discourse markers play a significant role in the automatic processing of these kinds of Chinese texts,such as automatic summarization.This paper reports on an effort in applying machine learning to identify discourse markers in Chinese.We have processed 80 Chinese texts from which we have selected subsets for data training and data testing.We used C4.5 in our experiments and obtained accuracies of the order of 80%.We also interpret and analyze our experimental results in the linguistic perspective.