摘要
本文提出了一种用于汉英平行语料库对齐的扩展方法。该扩展方法以基于长度的统计对齐方法为主,然后根据双语词典引入了词汇信息,而基于标点的方法作为对齐的后处理部分。这种扩展方法不仅避免了复杂的中文处理,例如,汉语分词和词性标注,而且在统计方法中引入了关键词信息,以提高句子对齐的正确率。本文中所用的双语语料是LDC的关于香港的双语新闻报道。动态规划算法用于系统的实现。和单纯的基于长度的方法和词汇方法相比,我们的扩展方法提高了句子对齐的正确率,并且结果是比较理想的。
In this paper, we present a new approach to align Chinese-English sentences in the parallel texts. This approach Ks mainly based on statistical approach, here is length-based alignment approach, and simultaneously considers lexical informarion from the bilingual lexicon. Punctoation-based approach is the post-processing for alignment. This extended approach not only avoids complicated Chinese processing further, such as segmentation and part-of-speech tagging, but also uses some Chinese key words in the statistical approach to improve accuracy of sentence alignment. The bilingual corpus in this paper is LDC parallel texts in Hong Kong newspaper. Then dynamic programming algorithm is used to accomplish the alignment processing. Compared with length-based approach and lexical approach, our approach improves the alignment accuracy and the experiment result is desirable.
出处
《中文信息学报》
CSCD
北大核心
2005年第5期31-36,58,共7页
Journal of Chinese Information Processing
基金
日本情报通信研究机构的委托研究项目
关键词
人工智能
机器翻译
句子对齐
中文处理
双语语料库
artificial intelligence
machine translation
sentence alignment
Chinese processing
bilingual corpus
