针对现有视频摘要算法以及摘要评价方法未能充分考虑工业智能终端所感知的视频数据特点以及工业智能感知相关应用需求,改写了代表性与多样性两种评价约束,基于此,结合DWConv(Depthwise Convolution)与ConvLSTM(Convolutional Long Short...针对现有视频摘要算法以及摘要评价方法未能充分考虑工业智能终端所感知的视频数据特点以及工业智能感知相关应用需求,改写了代表性与多样性两种评价约束,基于此,结合DWConv(Depthwise Convolution)与ConvLSTM(Convolutional Long Short-Term Memory)设计了一种混合双向多层的工业视频摘要方案。该方案由全局粗粒度特征提取、局部细粒度特征提取、反馈更新以及以查询为驱动的特征融合这4部分组成。为应对工业数据高冗余性、感知的视频噪声大等特点,围绕着ConvLSTM与注意力机制搭建全局特征提取模块;为充分提取视频数据的时空特性,结合注意力机制与DB-DWConvLSTM构建局部特征提取模块;针对工业数据具有的周期性与局部稳定性,借助残差网络思想,设计了融合DWConv反馈模块;为了更加凸显关键帧特征,便于更好的筛选关键帧,研究以查询驱动的特征融合模块。为验证方案的有效性与可行性,将该方案在TVSum与SumMe两个数据集上进行分析验证。实验结果表明:该方案在交叉验证、消融实验以及对比分析中都有着较好的性能。展开更多
本文应用ConvLSTM (Convolutional Long Short-Term Memory)模型解决了空气污染物浓度短时预测的问题。首先基于卷积神经网络和长短期记忆网络对ConvLSTM模型的构建方法进行了探讨,深入剖析了模型的基本构成与结构特性,然后通过实验实...本文应用ConvLSTM (Convolutional Long Short-Term Memory)模型解决了空气污染物浓度短时预测的问题。首先基于卷积神经网络和长短期记忆网络对ConvLSTM模型的构建方法进行了探讨,深入剖析了模型的基本构成与结构特性,然后通过实验实例详细展示了该模型在空气污染物浓度预测领域的应用过程,包括数据预处理、模型训练、预测结果分析等。实验结果表明,ConvLSTM模型用于空气污染物浓度短时预测的精度较高(始终保持在0.1%以内),同时也表明模型预测精度与时间序列并非总是正相关。当时间步长在某个值(本文实验中时间步长为10)附近时,模型预测精度较高。本研究可为其他具有类似时空特征数据序列的预测问题提供参考。展开更多
针对现有雷达回波外推模型存在长时序回波外推模糊失真和强回波预测准确率较低等问题,利用安徽2016年5-9月的多普勒雷达组合反射率拼图数据,设计了一种基于自注意力和稠密卷积改进卷积长短期记忆(convolutional long short-term memory,...针对现有雷达回波外推模型存在长时序回波外推模糊失真和强回波预测准确率较低等问题,利用安徽2016年5-9月的多普勒雷达组合反射率拼图数据,设计了一种基于自注意力和稠密卷积改进卷积长短期记忆(convolutional long short-term memory,ConvLSTM)网络的雷达回波外推方法。模型以ConvLSTM为基础,在每个单元结构以及编解码器中间融入自注意力机制,强化模型对于特征长时空间依赖的提取能力,同时用稠密连接卷积代替普通卷积,提高模型的特征重用能力。实验利用过去1 h雷达回波图像预测未来2 h雷达回波图像,并与改进前的ConvLSTM进行对比证明了提出的模型能够提高雷达回波外推的准确率。展开更多
Spatiotemporal forecasting of surface soil moisture(SSM)is recognized as a critical scientific issue in precision agricultural irrigation,regional drought monitoring,and early warning systems for extreme precipitation...Spatiotemporal forecasting of surface soil moisture(SSM)is recognized as a critical scientific issue in precision agricultural irrigation,regional drought monitoring,and early warning systems for extreme precipitation.However,long-term forecasting continues to pose formidable challenges because of the complexity observed across both the spatial and temporal scales.In this study,we used a daily SSM dataset at a 0.05°×0.05°spatial resolution over the Qilian Mountains,China and proposed a hybrid Convolutional Long Short-Term Memory(ConvLSTM)-Nudging model,which combined deep neural networks with data assimilation to increase the accuracy of long-term SSM forecasting.We trained and evaluated the SSM predictive performance of four models(Convolutional Neural Network(CNN),Long Short-Term Memory(LSTM),ConvLSTM,and ConvLSTM with Squeeze-and-Excitation(SE)attention mechanism(ConvLSTM-SE))in both short-term and long-term scenarios.The results showed that all the models perform well under short-term predictions,but the accuracy decrease substantially in long-term predictions.Therefore,we integrated Nudging technique during the long-term prediction phase to assimilate observational information and rectify model biases.Comprehensive evaluations demonstrate that Nudging significantly improves all the models,with ConvLSTM-Nudging achieving the best performance under the 200-d forecasting scenario.Relative to those of the best-performing ConvLSTM model for long-term forecasts,when observation noiseδ=0.00 and observation fraction obs=50.0%,the coefficient of determination(R2)of ConvLSTM-Nudging increases by approximately 82.1%,while its mean absolute error(MAE)and root mean squared error(RMSE)decrease by approximately 84.8%and 77.3%,respectively;the average Pearson correlation coefficient(r)improves by approximately 23.6%,and Bias is reduced by 98.1%.These results demonstrated that although pure deep learning models achieve high accuracy in the short-term predictions,they are prone to error accumulation and systematic drift in long-term autoregressive predictions.Integrating data assimilation with deep learning and continuously correcting the state through observation can effectively suppress long-term biases,thereby achieving robust long-term SSM forecasting.展开更多
文摘针对现有视频摘要算法以及摘要评价方法未能充分考虑工业智能终端所感知的视频数据特点以及工业智能感知相关应用需求,改写了代表性与多样性两种评价约束,基于此,结合DWConv(Depthwise Convolution)与ConvLSTM(Convolutional Long Short-Term Memory)设计了一种混合双向多层的工业视频摘要方案。该方案由全局粗粒度特征提取、局部细粒度特征提取、反馈更新以及以查询为驱动的特征融合这4部分组成。为应对工业数据高冗余性、感知的视频噪声大等特点,围绕着ConvLSTM与注意力机制搭建全局特征提取模块;为充分提取视频数据的时空特性,结合注意力机制与DB-DWConvLSTM构建局部特征提取模块;针对工业数据具有的周期性与局部稳定性,借助残差网络思想,设计了融合DWConv反馈模块;为了更加凸显关键帧特征,便于更好的筛选关键帧,研究以查询驱动的特征融合模块。为验证方案的有效性与可行性,将该方案在TVSum与SumMe两个数据集上进行分析验证。实验结果表明:该方案在交叉验证、消融实验以及对比分析中都有着较好的性能。
文摘针对在多传感器下变转速且带有不同程度噪声的工况下故障特征被淹没的问题,提出一种基于改进卷积长短时记忆网络(Convolutional LSTM, ConvLSTM)的故障诊断方法:首先将多个传感器采集的一维振动信号切分为二维矩阵序列;再利用由改进ConvLSTM单元构成的特征提取层提取信号内的时间特征和空间特征,改进ConvLSTM单元是将传统ConvLSTM单元输入门中的普通卷积换成膨胀卷积,在相同的卷积核其有更大的感受野读取输入信息;最后通过由卷积层和全局平均池化(Global Average Pooling,GAP)构造的分类输出层得到诊断结果。试验使用CWRU滚动轴承数据集和XJTU-SY滚动轴承数据集进行验证。试验结果表明,与其他对比模型相比,改进ConvLSTM模型在变转速且带有不同程度噪声下达到较高的精确率并且受样本量的影响更小。
文摘本文应用ConvLSTM (Convolutional Long Short-Term Memory)模型解决了空气污染物浓度短时预测的问题。首先基于卷积神经网络和长短期记忆网络对ConvLSTM模型的构建方法进行了探讨,深入剖析了模型的基本构成与结构特性,然后通过实验实例详细展示了该模型在空气污染物浓度预测领域的应用过程,包括数据预处理、模型训练、预测结果分析等。实验结果表明,ConvLSTM模型用于空气污染物浓度短时预测的精度较高(始终保持在0.1%以内),同时也表明模型预测精度与时间序列并非总是正相关。当时间步长在某个值(本文实验中时间步长为10)附近时,模型预测精度较高。本研究可为其他具有类似时空特征数据序列的预测问题提供参考。
基金funded by the National Natural Science Foundation of China(42461053)the Department of Education of Gansu Province:Higher Education Innovation Fund Project(2023B-064)+1 种基金the Youth Doctoral Fund Project(2024QB-014)the Natural Science Foundation of Gansu Province(25JRRA012).
文摘Spatiotemporal forecasting of surface soil moisture(SSM)is recognized as a critical scientific issue in precision agricultural irrigation,regional drought monitoring,and early warning systems for extreme precipitation.However,long-term forecasting continues to pose formidable challenges because of the complexity observed across both the spatial and temporal scales.In this study,we used a daily SSM dataset at a 0.05°×0.05°spatial resolution over the Qilian Mountains,China and proposed a hybrid Convolutional Long Short-Term Memory(ConvLSTM)-Nudging model,which combined deep neural networks with data assimilation to increase the accuracy of long-term SSM forecasting.We trained and evaluated the SSM predictive performance of four models(Convolutional Neural Network(CNN),Long Short-Term Memory(LSTM),ConvLSTM,and ConvLSTM with Squeeze-and-Excitation(SE)attention mechanism(ConvLSTM-SE))in both short-term and long-term scenarios.The results showed that all the models perform well under short-term predictions,but the accuracy decrease substantially in long-term predictions.Therefore,we integrated Nudging technique during the long-term prediction phase to assimilate observational information and rectify model biases.Comprehensive evaluations demonstrate that Nudging significantly improves all the models,with ConvLSTM-Nudging achieving the best performance under the 200-d forecasting scenario.Relative to those of the best-performing ConvLSTM model for long-term forecasts,when observation noiseδ=0.00 and observation fraction obs=50.0%,the coefficient of determination(R2)of ConvLSTM-Nudging increases by approximately 82.1%,while its mean absolute error(MAE)and root mean squared error(RMSE)decrease by approximately 84.8%and 77.3%,respectively;the average Pearson correlation coefficient(r)improves by approximately 23.6%,and Bias is reduced by 98.1%.These results demonstrated that although pure deep learning models achieve high accuracy in the short-term predictions,they are prone to error accumulation and systematic drift in long-term autoregressive predictions.Integrating data assimilation with deep learning and continuously correcting the state through observation can effectively suppress long-term biases,thereby achieving robust long-term SSM forecasting.
