| 基于条件随机域和语义类的中文组块分析方法 |
| |
| 引用本文： | 孙广路,郎非,薛一波. 基于条件随机域和语义类的中文组块分析方法[J]. 哈尔滨工业大学学报, 2011, 43(7): 135-139 |
| |
| 作者姓名： | 孙广路 郎非 薛一波 |
| |
| 作者单位： | 清华大学信息技术研究院;哈尔滨理工大学计算机科学与技术学院;哈尔滨理工大学外国语学院;清华大学信息技术研究院 |
| |
| 基金项目： | 国家自然科学基金资助项目(60903083);黑龙江省自然科学基金项目(F200936);黑龙江省高等学校新世纪优秀人才基金资助项目(1155-ncet-008) |
| |
| 摘 要： | 为了解决中文组块分析精度不高和未利用词的语义信息的问题,提出了一种基于条件随机域模型和语义类的中文组块分析方法.该方法通过研究中文组块分析任务及其序列化特性,采用条件随机域模型融合不同类型特征,克服标记偏置问题,将语义词典中抽取的语义类特征应用到中文组块分析中,提高分析精度.实验表明,该方法取得了F值为92.77%的中...
|
| 关 键 词： | 条件随机域 中文组块分析 特征模板 语义词典 |
Chinese chunking method based on conditional random fields and semantic classes |
| |
| SUN Guang-lu,LANG Fei and XUE Yi-bo. Chinese chunking method based on conditional random fields and semantic classes[J]. Journal of Harbin Institute of Technology, 2011, 43(7): 135-139 |
| |
| Authors: | SUN Guang-lu LANG Fei XUE Yi-bo |
| |
| Affiliation: | Research Institute of Information Technology,Tsinghua University,100084 Beijing,China;School of Computer Science and Technology,Harbin University of Science and Technology,150080 Harbin,China;School of Foreign Languages,Harbin University of Science and Technology,150080 Harbin,China);Research Institute of Information Technology,Tsinghua University,100084 Beijing,China |
| |
| Abstract: | To improve the accuracy of Chinese chunking and utilize the semantic information of words,a new Chinese chunking method is proposed based on conditional random fields and semantic classes.Through the analysis of Chinese chunking task and its sequential characteristics,conditional random fields that could incorporate various types of features were applied to overcome the label bias problem.Semantic features were utilized to improve the chunking performance.Experimental results show that the algorithm achieves impressive accuracy of 92.77% in terms of the F-score.A further experiment indicates the effects of feature template selection and training data′s scales on the aspect of chunking performance. |
| |
| Keywords: | conditional random fields Chinese chunking feature template semantic dictionary |
| 本文献已被 CNKI 等数据库收录！ |
| 点击此处可从《哈尔滨工业大学学报》浏览原始摘要信息 |
|
点击此处可从《哈尔滨工业大学学报》下载全文 |
|
