摘要
汉语自动分词是中文信息处理的基本问题。从分词的基本理论出发,对近年来中文分词研究的现状进行介绍,指出了能够大幅度提高未登录词识别性能的分词方法将是未来汉语自动分词技术的发展趋势,分析了分词中存在的两个困难及其解决方法。
Word Segmentation is a fundamental problem of the Chinese natural language progressing. Based on the theory of the Chinese word segmentation, an overview of the Chinese word segmentation technology is presented, through the existent Chinese word segmentation system is analyzed, and put forward the greatly improve out-of-vocabulary word recognition method must be development trends of future Chinese automatic segmentation research is put forward. In the end it discuss various factors of Chinese automatic segmentation.
出处
《计算机与数字工程》
2008年第11期57-59,共3页
Computer & Digital Engineering
关键词
汉语自动分词
分词方法
未登录词识别
条件随机场
Chinese word segmentation, approach of Chinese word segmentation, out-of-vocabulary （OOV） word recognition, conditional random fields
