摘要
针对传统的卷积神经网络(CNN)在进行情感分析任务时会忽略词的上下文语义以及CNN在最大池化操作时会丢失大量特征信息,从而限制模型的文本分类性能这两大问题,提出一种并行混合神经网络模型CA-BGA。首先,采用特征融合的方法在CNN的输出端融入双向门限循环单元(BiGRU)神经网络,通过融合句子的全局语义特征加强语义学习;然后,在CNN的卷积层和池化层之间以及BiGRU的输出端引入注意力机制,从而在保留较多特征信息的同时,降低噪声干扰;最后,基于以上两种改进策略构造出了并行混合神经网络模型。实验结果表明,提出的混合神经网络模型具有收敛速度快的特性,并且有效地提升了文本分类的F1值,在中文评论短文本情感分析任务上具有优良的性能。
Concerning the problems that the traditional Convolutional Neural Network (CNN) ignores the contextual semantics of words when performing sentiment analysis tasks and CNN loses a lot of feature information during max pooling operation at the pooling layer,which limit the text classification performance of model,a parallel hybrid neural network model,namely CA-BGA (Convolutional Neural Network Attention and Bidirectional Gated Recurrent Unit Attention),was proposed.Firstly,a feature fusion method was adopted to integrate Bidirectional Gated Recurrent Unit (BiGRU) into the output of CNN,thus semantic learning was enhanced by integrating the global semantic features of sentences.Then,the attention mechanism was introduced between the convolutional layer and the pooling layer of CNN and at the output of BiGRU to reduce noise interference while retaining more feature information.Finally,a parallel hybrid neural network model was constructed based on the above two improvement strategies.Experimental results show that the proposed hybrid neural network model has the characteristic of fast convergence,and effectively improves the F1 value of text classification.The proposed model has excellent performance in Chinese short text sentiment analysis tasks.
作者
陈洁
邵志清
张欢欢
费佳慧
CHEN Jie;SHAO Zhiqing;ZHANG Huanhuan;FEI Jiahui(School of Information Science and Engineering,East China University of Science and Technology,Shanghai 200237,China)
出处
《计算机应用》
CSCD
北大核心
2019年第8期2192-2197,共6页
journal of Computer Applications
基金
国家自然科学基金资助项目(61462073)~~
关键词
卷积神经网络
特征融合
双向门限循环单元
注意力机制
短文本情感分析
Convolutional Neural Network (CNN)
feature fusion
Bidirectional Gated Recurrent Unit (BiGRU)
attention mechanism
short text sentiment analysis
