A Long Short-Term Memory(LSTM) Recurrent Neural Network(RNN) has driven tremendous improvements on an acoustic model based on Gaussian Mixture Model(GMM). However, these models based on a hybrid method require a force...A Long Short-Term Memory(LSTM) Recurrent Neural Network(RNN) has driven tremendous improvements on an acoustic model based on Gaussian Mixture Model(GMM). However, these models based on a hybrid method require a forced aligned Hidden Markov Model(HMM) state sequence obtained from the GMM-based acoustic model. Therefore, it requires a long computation time for training both the GMM-based acoustic model and a deep learning-based acoustic model. In order to solve this problem, an acoustic model using CTC algorithm is proposed. CTC algorithm does not require the GMM-based acoustic model because it does not use the forced aligned HMM state sequence. However, previous works on a LSTM RNN-based acoustic model using CTC used a small-scale training corpus. In this paper, the LSTM RNN-based acoustic model using CTC is trained on a large-scale training corpus and its performance is evaluated. The implemented acoustic model has a performance of 6.18% and 15.01% in terms of Word Error Rate(WER) for clean speech and noisy speech, respectively. This is similar to a performance of the acoustic model based on the hybrid method.展开更多
云计算的快速发展使得服务器面临的负载压力逐渐增加,如何精准预测负载资源成为云中心资源分配与服务器安全运行的重要课题。现有的单一模型在捕捉全局特征方面存在不足,而组合模型在处理时序数据时的平稳性和解释性方面有所欠缺。因此...云计算的快速发展使得服务器面临的负载压力逐渐增加,如何精准预测负载资源成为云中心资源分配与服务器安全运行的重要课题。现有的单一模型在捕捉全局特征方面存在不足,而组合模型在处理时序数据时的平稳性和解释性方面有所欠缺。因此,提出一种基于NeuralProphet分解的卷积神经网络(CNN)-长短期记忆(LSTM)网络-注意力(Attention)机制的组合模型。NeuralProphet将负载数据分解为趋势、季节和自回归项分量,增强数据的平稳性和解释性,从而使模型能更高效地捕捉全局特征和长期依赖关系;并通过注意力机制动态权重分配,聚焦影响预测结果的关键特征,进一步提高对未来时刻的预测精度。在Alibaba Cluster Data V2018数据集上的实验结果表明,所提出的组合模型在预测精度和性能方面优于其他深度学习模型。与单一模型NeuralProphet及CNN-BiLSTM组合模型相比,该模型在R2评分上提高了17.9%,均方根误差(RMSE)降低了73.6%,平均绝对误差(MAE)降低了69.7%,对称平均绝对百分比误差(sMAPE)降低了65.3%,具备更高的预测准确性和鲁棒性,有助于提高云资源利用效率。展开更多
In the electricity market,fluctuations in real-time prices are unstable,and changes in short-term load are determined by many factors.By studying the timing of charging and discharging,as well as the economic benefits...In the electricity market,fluctuations in real-time prices are unstable,and changes in short-term load are determined by many factors.By studying the timing of charging and discharging,as well as the economic benefits of energy storage in the process of participating in the power market,this paper takes energy storage scheduling as merely one factor affecting short-term power load,which affects short-term load time series along with time-of-use price,holidays,and temperature.A deep learning network is used to predict the short-term load,a convolutional neural network(CNN)is used to extract the features,and a long short-term memory(LSTM)network is used to learn the temporal characteristics of the load value,which can effectively improve prediction accuracy.Taking the load data of a certain region as an example,the CNN-LSTM prediction model is compared with the single LSTM prediction model.The experimental results show that the CNN-LSTM deep learning network with the participation of energy storage in dispatching can have high prediction accuracy for short-term power load forecasting.展开更多
基金supported by the Ministry of Trade,Industry & Energy(MOTIE,Korea) under Industrial Technology Innovation Program (No.10063424,'development of distant speech recognition and multi-task dialog processing technologies for in-door conversational robots')
文摘A Long Short-Term Memory(LSTM) Recurrent Neural Network(RNN) has driven tremendous improvements on an acoustic model based on Gaussian Mixture Model(GMM). However, these models based on a hybrid method require a forced aligned Hidden Markov Model(HMM) state sequence obtained from the GMM-based acoustic model. Therefore, it requires a long computation time for training both the GMM-based acoustic model and a deep learning-based acoustic model. In order to solve this problem, an acoustic model using CTC algorithm is proposed. CTC algorithm does not require the GMM-based acoustic model because it does not use the forced aligned HMM state sequence. However, previous works on a LSTM RNN-based acoustic model using CTC used a small-scale training corpus. In this paper, the LSTM RNN-based acoustic model using CTC is trained on a large-scale training corpus and its performance is evaluated. The implemented acoustic model has a performance of 6.18% and 15.01% in terms of Word Error Rate(WER) for clean speech and noisy speech, respectively. This is similar to a performance of the acoustic model based on the hybrid method.
文摘云计算的快速发展使得服务器面临的负载压力逐渐增加,如何精准预测负载资源成为云中心资源分配与服务器安全运行的重要课题。现有的单一模型在捕捉全局特征方面存在不足,而组合模型在处理时序数据时的平稳性和解释性方面有所欠缺。因此,提出一种基于NeuralProphet分解的卷积神经网络(CNN)-长短期记忆(LSTM)网络-注意力(Attention)机制的组合模型。NeuralProphet将负载数据分解为趋势、季节和自回归项分量,增强数据的平稳性和解释性,从而使模型能更高效地捕捉全局特征和长期依赖关系;并通过注意力机制动态权重分配,聚焦影响预测结果的关键特征,进一步提高对未来时刻的预测精度。在Alibaba Cluster Data V2018数据集上的实验结果表明,所提出的组合模型在预测精度和性能方面优于其他深度学习模型。与单一模型NeuralProphet及CNN-BiLSTM组合模型相比,该模型在R2评分上提高了17.9%,均方根误差(RMSE)降低了73.6%,平均绝对误差(MAE)降低了69.7%,对称平均绝对百分比误差(sMAPE)降低了65.3%,具备更高的预测准确性和鲁棒性,有助于提高云资源利用效率。
基金supported by a State Grid Zhejiang Electric Power Co.,Ltd.Economic and Technical Research Institute Project(Key Technologies and Empirical Research of Diversified Integrated Operation of User-Side Energy Storage in Power Market Environment,No.5211JY19000W)supported by the National Natural Science Foundation of China(Research on Power Market Management to Promote Large-Scale New Energy Consumption,No.71804045).
文摘In the electricity market,fluctuations in real-time prices are unstable,and changes in short-term load are determined by many factors.By studying the timing of charging and discharging,as well as the economic benefits of energy storage in the process of participating in the power market,this paper takes energy storage scheduling as merely one factor affecting short-term power load,which affects short-term load time series along with time-of-use price,holidays,and temperature.A deep learning network is used to predict the short-term load,a convolutional neural network(CNN)is used to extract the features,and a long short-term memory(LSTM)network is used to learn the temporal characteristics of the load value,which can effectively improve prediction accuracy.Taking the load data of a certain region as an example,the CNN-LSTM prediction model is compared with the single LSTM prediction model.The experimental results show that the CNN-LSTM deep learning network with the participation of energy storage in dispatching can have high prediction accuracy for short-term power load forecasting.
