Complicated loads encountered by floating offshore wind turbines(FOWTs)in real sea conditions are crucial for future optimization of design,but obtaining data on them directly poses a challenge.To address this issue,w...Complicated loads encountered by floating offshore wind turbines(FOWTs)in real sea conditions are crucial for future optimization of design,but obtaining data on them directly poses a challenge.To address this issue,we applied machine learning techniques to obtain hydrodynamic and aerodynamic loads of FOWTs by measuring platform motion responses and wave-elevation sequences.First,a computational fluid dynamics(CFD)simulation model of the floating platform was established based on the dynamic fluid body interaction technique and overset grid technology.Then,a long short-term memory(LSTM)neural network model was constructed and trained to learn the nonlinear relationship between the waves,platform-motion inputs,and hydrodynamic-load outputs.The optimal model was determined after analyzing the sensitivity of parameters such as sample characteristics,network layers,and neuron numbers.Subsequently,the effectiveness of the hydrodynamic load model was validated under different simulation conditions,and the aerodynamic load calculation was completed based on the D'Alembert principle.Finally,we built a hybrid-scale FOWT model,based on the software in the loop strategy,in which the wind turbine was replaced by an actuation system.Model tests were carried out in a wave basin and the results demonstrated that the root mean square errors of the hydrodynamic and aerodynamic load measurements were 4.20%and 10.68%,respectively.展开更多
An accurate landslide displacement prediction is an important part of landslide warning system. Aiming at the dynamic characteristics of landslide evolution and the shortcomings of traditional static prediction models...An accurate landslide displacement prediction is an important part of landslide warning system. Aiming at the dynamic characteristics of landslide evolution and the shortcomings of traditional static prediction models, this paper proposes a dynamic prediction model of landslide displacement based on singular spectrum analysis(SSA) and stack long short-term memory(SLSTM) network. The SSA is used to decompose the landslide accumulated displacement time series data into trend term and periodic term displacement subsequences. A cubic polynomial function is used to predict the trend term displacement subsequence, and the SLSTM neural network is used to predict the periodic term displacement subsequence. At the same time, the Bayesian optimization algorithm is used to determine that the SLSTM network input sequence length is 12 and the number of hidden layer nodes is 18. The SLSTM network is updated by adding predicted values to the training set to achieve dynamic displacement prediction. Finally, the accumulated landslide displacement is obtained by superimposing the predicted value of each displacement subsequence. The proposed model was verified on the Xintan landslide in Hubei Province, China. The results show that when predicting the displacement of the periodic term, the SLSTM network has higher prediction accuracy than the support vector machine(SVM) and auto regressive integrated moving average(ARIMA). The mean relative error(MRE) is reduced by 4.099% and 3.548% respectively, while the root mean square error(RMSE) is reduced by 5.830 mm and 3.854 mm respectively. It is concluded that the SLSTM network model can better simulate the dynamic characteristics of landslides.展开更多
Wind and solar energy are two popular forms of renewable energy used in microgrids and facilitating the transition towards net-zero carbon emissions by 2050.However,they are exceedingly unpredictable since they rely h...Wind and solar energy are two popular forms of renewable energy used in microgrids and facilitating the transition towards net-zero carbon emissions by 2050.However,they are exceedingly unpredictable since they rely highly on weather and atmospheric conditions.In microgrids,smart energy management systems,such as integrated demand response programs,are permanently established on a step-ahead basis,which means that accu-rate forecasting of wind speed and solar irradiance intervals is becoming increasingly crucial to the optimal operation and planning of microgrids.With this in mind,a novel“bidirectional long short-term memory network”(Bi-LSTM)-based,deep stacked,sequence-to-sequence autoencoder(S2SAE)forecasting model for predicting short-term solar irradiation and wind speed was developed and evaluated in MATLAB.To create a deep stacked S2SAE prediction model,a deep Bi-LSTM-based encoder and decoder are stacked on top of one another to reduce the dimension of the input sequence,extract its features,and then reconstruct it to produce the forecasts.Hyperparameters of the proposed deep stacked S2SAE forecasting model were optimized using the Bayesian optimization algorithm.Moreover,the forecasting performance of the proposed Bi-LSTM-based deep stacked S2SAE model was compared to three other deep,and shallow stacked S2SAEs,i.e.,the LSTM-based deep stacked S2SAE model,gated recurrent unit-based deep stacked S2SAE model,and Bi-LSTM-based shallow stacked S2SAE model.All these models were also optimized and modeled in MATLAB.The results simulated based on actual data confirmed that the proposed model outperformed the alternatives by achieving an accuracy of up to 99.7%,which evidenced the high reliability of the proposed forecasting.展开更多
In the face of the large number of people with motor function disabilities,rehabilitation robots have attracted more and more attention.In order to promote the active participation of the user's motion intention i...In the face of the large number of people with motor function disabilities,rehabilitation robots have attracted more and more attention.In order to promote the active participation of the user's motion intention in the assisted rehabilitation process of the robots,it is crucial to establish the human motion prediction model.In this paper,a hybrid prediction model built on long short-term memory(LSTM)neural network using surface electromyography(sEMG)is applied to predict the elbow motion of the users in advance.This model includes two sub-models:a back-propagation neural network and an LSTM network.The former extracts a preliminary prediction of the elbow motion,and the latter corrects this prediction to increase accuracy.The proposed model takes time series data as input,which includes the sEMG signals measured by electrodes and the continuous angles from inertial measurement units.The offline and online tests were carried out to verify the established hybrid model.Finally,average root mean square errors of 3.52°and 4.18°were reached respectively for offline and online tests,and the correlation coefficients for both were above 0.98.展开更多
Lithium-ion batteries are the most widely accepted type of battery in the electric vehicle industry because of some of their positive inherent characteristics. However, the safety problems associated with inaccurate e...Lithium-ion batteries are the most widely accepted type of battery in the electric vehicle industry because of some of their positive inherent characteristics. However, the safety problems associated with inaccurate estimation and prediction of the state of health of these batteries have attracted wide attention due to the adverse negative effect on vehicle safety. In this paper, both machine and deep learning models were used to estimate the state of health of lithium-ion batteries. The paper introduces the definition of battery health status and its importance in the electric vehicle industry. Based on the data preprocessing and visualization analysis, three features related to actual battery capacity degradation are extracted from the data. Two learning models, SVR and LSTM were employed for the state of health estimation and their respective results are compared in this paper. The mean square error and coefficient of determination were the two metrics for the performance evaluation of the models. The experimental results indicate that both models have high estimation results. However, the metrics indicated that the SVR was the overall best model.展开更多
Hand gestures are a natural way for human-robot interaction.Vision based dynamic hand gesture recognition has become a hot research topic due to its various applications.This paper presents a novel deep learning netwo...Hand gestures are a natural way for human-robot interaction.Vision based dynamic hand gesture recognition has become a hot research topic due to its various applications.This paper presents a novel deep learning network for hand gesture recognition.The network integrates several well-proved modules together to learn both short-term and long-term features from video inputs and meanwhile avoid intensive computation.To learn short-term features,each video input is segmented into a fixed number of frame groups.A frame is randomly selected from each group and represented as an RGB image as well as an optical flow snapshot.These two entities are fused and fed into a convolutional neural network(Conv Net)for feature extraction.The Conv Nets for all groups share parameters.To learn longterm features,outputs from all Conv Nets are fed into a long short-term memory(LSTM)network,by which a final classification result is predicted.The new model has been tested with two popular hand gesture datasets,namely the Jester dataset and Nvidia dataset.Comparing with other models,our model produced very competitive results.The robustness of the new model has also been proved with an augmented dataset with enhanced diversity of hand gestures.展开更多
To address the shortcomings of single-step decision making in the existing deep reinforcement learning based unmanned aerial vehicle(UAV)real-time path planning problem,a real-time UAV path planning algorithm based on...To address the shortcomings of single-step decision making in the existing deep reinforcement learning based unmanned aerial vehicle(UAV)real-time path planning problem,a real-time UAV path planning algorithm based on long shortterm memory(RPP-LSTM)network is proposed,which combines the memory characteristics of recurrent neural network(RNN)and the deep reinforcement learning algorithm.LSTM networks are used in this algorithm as Q-value networks for the deep Q network(DQN)algorithm,which makes the decision of the Q-value network has some memory.Thanks to LSTM network,the Q-value network can use the previous environmental information and action information which effectively avoids the problem of single-step decision considering only the current environment.Besides,the algorithm proposes a hierarchical reward and punishment function for the specific problem of UAV real-time path planning,so that the UAV can more reasonably perform path planning.Simulation verification shows that compared with the traditional feed-forward neural network(FNN)based UAV autonomous path planning algorithm,the RPP-LSTM proposed in this paper can adapt to more complex environments and has significantly improved robustness and accuracy when performing UAV real-time path planning.展开更多
In order to effectively solve the problems of low accuracy,large amount of computation and complex logic of deep learning algorithms in behavior recognition,a kind of behavior recognition based on the fusion of 3 dime...In order to effectively solve the problems of low accuracy,large amount of computation and complex logic of deep learning algorithms in behavior recognition,a kind of behavior recognition based on the fusion of 3 dimensional batch normalization visual geometry group(3D-BN-VGG)and long short-term memory(LSTM)network is designed.In this network,3D convolutional layer is used to extract the spatial domain features and time domain features of video sequence at the same time,multiple small convolution kernels are stacked to replace large convolution kernels,thus the depth of neural network is deepened and the number of network parameters is reduced.In addition,the latest batch normalization algorithm is added to the 3-dimensional convolutional network to improve the training speed.Then the output of the full connection layer is sent to LSTM network as the feature vectors to extract the sequence information.This method,which directly uses the output of the whole base level without passing through the full connection layer,reduces the parameters of the whole fusion network to 15324485,nearly twice as much as those of 3D-BN-VGG.Finally,it reveals that the proposed network achieves 96.5%and 74.9%accuracy in the UCF-101 and HMDB-51 respectively,and the algorithm has a calculation speed of 1066 fps and an acceleration ratio of 1,which has a significant predominance in velocity.展开更多
Because behavior recognition is based on video frame sequences,this paper proposes a behavior recognition algorithm that combines 3D residual convolutional neural network(R3D)and long short-term memory(LSTM).First,the...Because behavior recognition is based on video frame sequences,this paper proposes a behavior recognition algorithm that combines 3D residual convolutional neural network(R3D)and long short-term memory(LSTM).First,the residual module is extended to three dimensions,which can extract features in the time and space domain at the same time.Second,by changing the size of the pooling layer window the integrity of the time domain features is preserved,at the same time,in order to overcome the difficulty of network training and over-fitting problems,the batch normalization(BN)layer and the dropout layer are added.After that,because the global average pooling layer(GAP)is affected by the size of the feature map,the network cannot be further deepened,so the convolution layer and maxpool layer are added to the R3D network.Finally,because LSTM has the ability to memorize information and can extract more abstract timing features,the LSTM network is introduced into the R3D network.Experimental results show that the R3D+LSTM network achieves 91%recognition rate on the UCF-101 dataset.展开更多
Efficient energy management and grid stability strongly rely on accurate Short-Term Load Forecasting(STLF).Existing forecasting models,unfortunately,are often inaccurate and computationally demanding.To overcome these...Efficient energy management and grid stability strongly rely on accurate Short-Term Load Forecasting(STLF).Existing forecasting models,unfortunately,are often inaccurate and computationally demanding.To overcome these challenges,a novel hybrid model,combining both linear regression and machine learning techniques,is proposed in this study.The hybrid model,MLR-LSTM-FFNN,captures both temporal and non-linear de-pendencies in load data by integrating multi-linear regression(MLR)with long short-term memory(LSTM)networks and feed-forward neural networks(FFNN).Using datasets from Qatar,with 5 min,15 min,30 min,and 1 h time intervals and from Panama City with a 1 h interval,experiments were conducted to thoroughly test the robustness of the model.The results showed that the MLR-LSTM-FFNN hybrid model outperformed the baseline and state-of-the-art hybrid models for each of the datasets,in terms of lower RMSE,MAE,and MAPE values along with a faster training time.This superior performance across different datasets underscores the model’s scal-ability and reliability as an STLF approach,providing a practical solution to energy demand prediction tasks.The improvement in short-term forecasting accuracy provides utilities with a practical tool to optimize demand-side management,reduce operational costs,and enhance grid reliability.展开更多
Current aero-engine life prediction areas typically focus on single-scale degradation features,and the existing methods are not comprehensive enough to capture the relationship within time series data.To address this ...Current aero-engine life prediction areas typically focus on single-scale degradation features,and the existing methods are not comprehensive enough to capture the relationship within time series data.To address this problem,we propose a novel remaining useful life(RUL)estimation method based on the attention mechanism.Our approach designs a two-layer multi-scale feature extraction module that integrates degradation features at different scales.These features are then processed in parallel by a self-attention module and a three-layer long short-term memory(LSTM)network,which together capture long-term dependencies and adaptively weigh important feature.The integration of degradation patterns from both components into the attention module enhances the model’s ability to capture long-term dependencies.Visualizing the attention module’s weight matrices further improves model interpretability.Experimental results on the C-MAPSS dataset demonstrate that our approach outperforms the existing state-of-the-art methods.展开更多
Stroke survivors often face significant challenges when performing daily self-care activities due to upper limb motor impairments.Traditional surface electromyography(sEMG)analysis typically focuses on isolated hand p...Stroke survivors often face significant challenges when performing daily self-care activities due to upper limb motor impairments.Traditional surface electromyography(sEMG)analysis typically focuses on isolated hand postures,overlooking the complexity of object-interactive behaviors that are crucial for promoting patient independence.This study introduces a novel framework that combines high-density sEMG(HD-sEMG)signals with an improved Whale Optimization Algorithm(IWOA)-optimized Long Short-Term Memory(LSTM)network to address this limitation.The key contributions of this work include:(1)the creation of a specialized HD-sEMG dataset that captures nine continuous self-care behaviors,along with time and posture markers,to better reflect real-world patient interactions;(2)the development of a multi-channel feature fusion module based on Pascal’s theorem,which enables efficient signal segmentation and spatial–temporal feature extraction;and(3)the enhancement of the IWOA algorithm,which integrates optimal point set initialization,a diversity-driven pooling mechanism,and cosine-based differential evolution to optimize LSTM hyperparameters,thereby improving convergence and global search capabilities.Experimental results demonstrate superior performance,achieving 99.58%accuracy in self-care behavior recognition and 86.19%accuracy for 17 continuous gestures on the Ninapro db2 benchmark.The framework operates with low latency,meeting the real-time requirements for assistive devices.By enabling precise,context-aware recognition of daily activities,this work advances personalized rehabilitation technologies,empowering stroke patients to regain autonomy in self-care tasks.The proposed methodology offers a robust,scalable solution for clinical applications,bridging the gap between laboratory-based gesture recognition and practical,patient-centered care.展开更多
Missile acceleration saturation in a practical terminal guidance process may significantly reduce the interception performance.To solve this problem,this paper presents an anti-saturation guidance law with finite-time...Missile acceleration saturation in a practical terminal guidance process may significantly reduce the interception performance.To solve this problem,this paper presents an anti-saturation guidance law with finite-time convergence for a three dimensional maneuvering interception.The finite time boundedness(FTB)theory and the input-output finite time stability(IO-FTS)theory are used,as well as the long short-term memory(LSTM)network.A sufficient condition for FTB and IO-FTS of a class of nonlinear systems is given.Then,an anti-acceleration saturation missile terminal guidance law based on LSTM,namely LSTM-ASGL,is designed.It can effectively suppress the effect of acceleration saturation to track the maneuvering target more accurately in the complex dynamic environment.The excellent performance of LSTM-ASGL in different maneuvering target scenarios is verified by simulation.The simulation results show that the guidance law successfully prevents acceleration saturation and improves the tracking ability of the missile system to the maneuvering target.It is also shown that LSTM-ASGL has good generalization and anti-jamming performance,and consumes less energy than the anti-acceleration saturation terminal guidance law.展开更多
基金This work is supported by the National Key Research and Development Program of China(No.2023YFB4203000)the National Natural Science Foundation of China(No.U22A20178)
文摘Complicated loads encountered by floating offshore wind turbines(FOWTs)in real sea conditions are crucial for future optimization of design,but obtaining data on them directly poses a challenge.To address this issue,we applied machine learning techniques to obtain hydrodynamic and aerodynamic loads of FOWTs by measuring platform motion responses and wave-elevation sequences.First,a computational fluid dynamics(CFD)simulation model of the floating platform was established based on the dynamic fluid body interaction technique and overset grid technology.Then,a long short-term memory(LSTM)neural network model was constructed and trained to learn the nonlinear relationship between the waves,platform-motion inputs,and hydrodynamic-load outputs.The optimal model was determined after analyzing the sensitivity of parameters such as sample characteristics,network layers,and neuron numbers.Subsequently,the effectiveness of the hydrodynamic load model was validated under different simulation conditions,and the aerodynamic load calculation was completed based on the D'Alembert principle.Finally,we built a hybrid-scale FOWT model,based on the software in the loop strategy,in which the wind turbine was replaced by an actuation system.Model tests were carried out in a wave basin and the results demonstrated that the root mean square errors of the hydrodynamic and aerodynamic load measurements were 4.20%and 10.68%,respectively.
基金supported by the Natural Science Foundation of Shaanxi Province under Grant 2019JQ206in part by the Science and Technology Department of Shaanxi Province under Grant 2020CGXNG-009in part by the Education Department of Shaanxi Province under Grant 17JK0346。
文摘An accurate landslide displacement prediction is an important part of landslide warning system. Aiming at the dynamic characteristics of landslide evolution and the shortcomings of traditional static prediction models, this paper proposes a dynamic prediction model of landslide displacement based on singular spectrum analysis(SSA) and stack long short-term memory(SLSTM) network. The SSA is used to decompose the landslide accumulated displacement time series data into trend term and periodic term displacement subsequences. A cubic polynomial function is used to predict the trend term displacement subsequence, and the SLSTM neural network is used to predict the periodic term displacement subsequence. At the same time, the Bayesian optimization algorithm is used to determine that the SLSTM network input sequence length is 12 and the number of hidden layer nodes is 18. The SLSTM network is updated by adding predicted values to the training set to achieve dynamic displacement prediction. Finally, the accumulated landslide displacement is obtained by superimposing the predicted value of each displacement subsequence. The proposed model was verified on the Xintan landslide in Hubei Province, China. The results show that when predicting the displacement of the periodic term, the SLSTM network has higher prediction accuracy than the support vector machine(SVM) and auto regressive integrated moving average(ARIMA). The mean relative error(MRE) is reduced by 4.099% and 3.548% respectively, while the root mean square error(RMSE) is reduced by 5.830 mm and 3.854 mm respectively. It is concluded that the SLSTM network model can better simulate the dynamic characteristics of landslides.
文摘Wind and solar energy are two popular forms of renewable energy used in microgrids and facilitating the transition towards net-zero carbon emissions by 2050.However,they are exceedingly unpredictable since they rely highly on weather and atmospheric conditions.In microgrids,smart energy management systems,such as integrated demand response programs,are permanently established on a step-ahead basis,which means that accu-rate forecasting of wind speed and solar irradiance intervals is becoming increasingly crucial to the optimal operation and planning of microgrids.With this in mind,a novel“bidirectional long short-term memory network”(Bi-LSTM)-based,deep stacked,sequence-to-sequence autoencoder(S2SAE)forecasting model for predicting short-term solar irradiation and wind speed was developed and evaluated in MATLAB.To create a deep stacked S2SAE prediction model,a deep Bi-LSTM-based encoder and decoder are stacked on top of one another to reduce the dimension of the input sequence,extract its features,and then reconstruct it to produce the forecasts.Hyperparameters of the proposed deep stacked S2SAE forecasting model were optimized using the Bayesian optimization algorithm.Moreover,the forecasting performance of the proposed Bi-LSTM-based deep stacked S2SAE model was compared to three other deep,and shallow stacked S2SAEs,i.e.,the LSTM-based deep stacked S2SAE model,gated recurrent unit-based deep stacked S2SAE model,and Bi-LSTM-based shallow stacked S2SAE model.All these models were also optimized and modeled in MATLAB.The results simulated based on actual data confirmed that the proposed model outperformed the alternatives by achieving an accuracy of up to 99.7%,which evidenced the high reliability of the proposed forecasting.
文摘为了解决单个神经网络预测的局限性和时间序列的波动性,提出了一种奇异谱分析(singular spectrum analysis,SSA)和Stacking框架相结合的短期负荷预测方法。利用随机森林筛选出与历史负荷相关性强烈的特征因素,采用SSA为负荷数据降噪,简化模型计算过程;基于Stacking框架,结合长短期记忆(long and short-term memory,LSTM)-自注意力机制(self-attention mechanism,SA)、径向基(radial base functions,RBF)神经网络和线性回归方法集成新的组合模型,同时利用交叉验证方法避免模型过拟合;选取PJM和澳大利亚电力负荷数据集进行验证。仿真结果表明,与其他模型比较,所提模型预测精度高。
基金the National Key Research and Development Program of China(No.2020YFC2007500)the Science and Technology Commission of Shanghai Municipality(No.20DZ2220400)。
文摘In the face of the large number of people with motor function disabilities,rehabilitation robots have attracted more and more attention.In order to promote the active participation of the user's motion intention in the assisted rehabilitation process of the robots,it is crucial to establish the human motion prediction model.In this paper,a hybrid prediction model built on long short-term memory(LSTM)neural network using surface electromyography(sEMG)is applied to predict the elbow motion of the users in advance.This model includes two sub-models:a back-propagation neural network and an LSTM network.The former extracts a preliminary prediction of the elbow motion,and the latter corrects this prediction to increase accuracy.The proposed model takes time series data as input,which includes the sEMG signals measured by electrodes and the continuous angles from inertial measurement units.The offline and online tests were carried out to verify the established hybrid model.Finally,average root mean square errors of 3.52°and 4.18°were reached respectively for offline and online tests,and the correlation coefficients for both were above 0.98.
文摘Lithium-ion batteries are the most widely accepted type of battery in the electric vehicle industry because of some of their positive inherent characteristics. However, the safety problems associated with inaccurate estimation and prediction of the state of health of these batteries have attracted wide attention due to the adverse negative effect on vehicle safety. In this paper, both machine and deep learning models were used to estimate the state of health of lithium-ion batteries. The paper introduces the definition of battery health status and its importance in the electric vehicle industry. Based on the data preprocessing and visualization analysis, three features related to actual battery capacity degradation are extracted from the data. Two learning models, SVR and LSTM were employed for the state of health estimation and their respective results are compared in this paper. The mean square error and coefficient of determination were the two metrics for the performance evaluation of the models. The experimental results indicate that both models have high estimation results. However, the metrics indicated that the SVR was the overall best model.
文摘Hand gestures are a natural way for human-robot interaction.Vision based dynamic hand gesture recognition has become a hot research topic due to its various applications.This paper presents a novel deep learning network for hand gesture recognition.The network integrates several well-proved modules together to learn both short-term and long-term features from video inputs and meanwhile avoid intensive computation.To learn short-term features,each video input is segmented into a fixed number of frame groups.A frame is randomly selected from each group and represented as an RGB image as well as an optical flow snapshot.These two entities are fused and fed into a convolutional neural network(Conv Net)for feature extraction.The Conv Nets for all groups share parameters.To learn longterm features,outputs from all Conv Nets are fed into a long short-term memory(LSTM)network,by which a final classification result is predicted.The new model has been tested with two popular hand gesture datasets,namely the Jester dataset and Nvidia dataset.Comparing with other models,our model produced very competitive results.The robustness of the new model has also been proved with an augmented dataset with enhanced diversity of hand gestures.
基金supported by the Natural Science Basic Research Prog ram of Shaanxi(2022JQ-593)。
文摘To address the shortcomings of single-step decision making in the existing deep reinforcement learning based unmanned aerial vehicle(UAV)real-time path planning problem,a real-time UAV path planning algorithm based on long shortterm memory(RPP-LSTM)network is proposed,which combines the memory characteristics of recurrent neural network(RNN)and the deep reinforcement learning algorithm.LSTM networks are used in this algorithm as Q-value networks for the deep Q network(DQN)algorithm,which makes the decision of the Q-value network has some memory.Thanks to LSTM network,the Q-value network can use the previous environmental information and action information which effectively avoids the problem of single-step decision considering only the current environment.Besides,the algorithm proposes a hierarchical reward and punishment function for the specific problem of UAV real-time path planning,so that the UAV can more reasonably perform path planning.Simulation verification shows that compared with the traditional feed-forward neural network(FNN)based UAV autonomous path planning algorithm,the RPP-LSTM proposed in this paper can adapt to more complex environments and has significantly improved robustness and accuracy when performing UAV real-time path planning.
基金the National Natural Science Foundation of China(No.61772417,61634004,61602377)Key R&D Program Projects in Shaanxi Province(No.2017GY-060)Shaanxi Natural Science Basic Research Project(No.2018JM4018).
文摘In order to effectively solve the problems of low accuracy,large amount of computation and complex logic of deep learning algorithms in behavior recognition,a kind of behavior recognition based on the fusion of 3 dimensional batch normalization visual geometry group(3D-BN-VGG)and long short-term memory(LSTM)network is designed.In this network,3D convolutional layer is used to extract the spatial domain features and time domain features of video sequence at the same time,multiple small convolution kernels are stacked to replace large convolution kernels,thus the depth of neural network is deepened and the number of network parameters is reduced.In addition,the latest batch normalization algorithm is added to the 3-dimensional convolutional network to improve the training speed.Then the output of the full connection layer is sent to LSTM network as the feature vectors to extract the sequence information.This method,which directly uses the output of the whole base level without passing through the full connection layer,reduces the parameters of the whole fusion network to 15324485,nearly twice as much as those of 3D-BN-VGG.Finally,it reveals that the proposed network achieves 96.5%and 74.9%accuracy in the UCF-101 and HMDB-51 respectively,and the algorithm has a calculation speed of 1066 fps and an acceleration ratio of 1,which has a significant predominance in velocity.
基金Supported by the Shaanxi Province Key Research and Development Project (No. 2021GY-280)Shaanxi Province Natural Science Basic Research Program (No. 2021JM-459)the National Natural Science Foundation of China (No. 61772417)
文摘Because behavior recognition is based on video frame sequences,this paper proposes a behavior recognition algorithm that combines 3D residual convolutional neural network(R3D)and long short-term memory(LSTM).First,the residual module is extended to three dimensions,which can extract features in the time and space domain at the same time.Second,by changing the size of the pooling layer window the integrity of the time domain features is preserved,at the same time,in order to overcome the difficulty of network training and over-fitting problems,the batch normalization(BN)layer and the dropout layer are added.After that,because the global average pooling layer(GAP)is affected by the size of the feature map,the network cannot be further deepened,so the convolution layer and maxpool layer are added to the R3D network.Finally,because LSTM has the ability to memorize information and can extract more abstract timing features,the LSTM network is introduced into the R3D network.Experimental results show that the R3D+LSTM network achieves 91%recognition rate on the UCF-101 dataset.
基金support from the Qatar National Research Fund through grant AICC05-0508-230001(Solar Trade(ST):An Equitable and Efficient Blockchain-Enabled Renewable Energy Ecosystem-“Oppor-tunities for Fintech to Scale up Green Finance for Clean Energy”)and from Qatar Environment and Energy Research Institute is gratefully acknowledged.
文摘Efficient energy management and grid stability strongly rely on accurate Short-Term Load Forecasting(STLF).Existing forecasting models,unfortunately,are often inaccurate and computationally demanding.To overcome these challenges,a novel hybrid model,combining both linear regression and machine learning techniques,is proposed in this study.The hybrid model,MLR-LSTM-FFNN,captures both temporal and non-linear de-pendencies in load data by integrating multi-linear regression(MLR)with long short-term memory(LSTM)networks and feed-forward neural networks(FFNN).Using datasets from Qatar,with 5 min,15 min,30 min,and 1 h time intervals and from Panama City with a 1 h interval,experiments were conducted to thoroughly test the robustness of the model.The results showed that the MLR-LSTM-FFNN hybrid model outperformed the baseline and state-of-the-art hybrid models for each of the datasets,in terms of lower RMSE,MAE,and MAPE values along with a faster training time.This superior performance across different datasets underscores the model’s scal-ability and reliability as an STLF approach,providing a practical solution to energy demand prediction tasks.The improvement in short-term forecasting accuracy provides utilities with a practical tool to optimize demand-side management,reduce operational costs,and enhance grid reliability.
基金supported by the National Key Research and Development Program of China (2023YFB4302403)the Research and Practical Innovation Program of NUAA (xcxjh20230735)。
文摘Current aero-engine life prediction areas typically focus on single-scale degradation features,and the existing methods are not comprehensive enough to capture the relationship within time series data.To address this problem,we propose a novel remaining useful life(RUL)estimation method based on the attention mechanism.Our approach designs a two-layer multi-scale feature extraction module that integrates degradation features at different scales.These features are then processed in parallel by a self-attention module and a three-layer long short-term memory(LSTM)network,which together capture long-term dependencies and adaptively weigh important feature.The integration of degradation patterns from both components into the attention module enhances the model’s ability to capture long-term dependencies.Visualizing the attention module’s weight matrices further improves model interpretability.Experimental results on the C-MAPSS dataset demonstrate that our approach outperforms the existing state-of-the-art methods.
基金supported by the National Natural Science Foundation of China(72061006)the research on the auxiliary diagnosis system of chronic injury of levator scapulae based on the concept of digital twin(Contract No:Qian Kehe Support[2023]General 117)Research on indoor intelligent assisted walking robot for the rehabilitation of walking ability of the elderly(Contract No:Qian kehe Support[2023]General 124).
文摘Stroke survivors often face significant challenges when performing daily self-care activities due to upper limb motor impairments.Traditional surface electromyography(sEMG)analysis typically focuses on isolated hand postures,overlooking the complexity of object-interactive behaviors that are crucial for promoting patient independence.This study introduces a novel framework that combines high-density sEMG(HD-sEMG)signals with an improved Whale Optimization Algorithm(IWOA)-optimized Long Short-Term Memory(LSTM)network to address this limitation.The key contributions of this work include:(1)the creation of a specialized HD-sEMG dataset that captures nine continuous self-care behaviors,along with time and posture markers,to better reflect real-world patient interactions;(2)the development of a multi-channel feature fusion module based on Pascal’s theorem,which enables efficient signal segmentation and spatial–temporal feature extraction;and(3)the enhancement of the IWOA algorithm,which integrates optimal point set initialization,a diversity-driven pooling mechanism,and cosine-based differential evolution to optimize LSTM hyperparameters,thereby improving convergence and global search capabilities.Experimental results demonstrate superior performance,achieving 99.58%accuracy in self-care behavior recognition and 86.19%accuracy for 17 continuous gestures on the Ninapro db2 benchmark.The framework operates with low latency,meeting the real-time requirements for assistive devices.By enabling precise,context-aware recognition of daily activities,this work advances personalized rehabilitation technologies,empowering stroke patients to regain autonomy in self-care tasks.The proposed methodology offers a robust,scalable solution for clinical applications,bridging the gap between laboratory-based gesture recognition and practical,patient-centered care.
文摘Missile acceleration saturation in a practical terminal guidance process may significantly reduce the interception performance.To solve this problem,this paper presents an anti-saturation guidance law with finite-time convergence for a three dimensional maneuvering interception.The finite time boundedness(FTB)theory and the input-output finite time stability(IO-FTS)theory are used,as well as the long short-term memory(LSTM)network.A sufficient condition for FTB and IO-FTS of a class of nonlinear systems is given.Then,an anti-acceleration saturation missile terminal guidance law based on LSTM,namely LSTM-ASGL,is designed.It can effectively suppress the effect of acceleration saturation to track the maneuvering target more accurately in the complex dynamic environment.The excellent performance of LSTM-ASGL in different maneuvering target scenarios is verified by simulation.The simulation results show that the guidance law successfully prevents acceleration saturation and improves the tracking ability of the missile system to the maneuvering target.It is also shown that LSTM-ASGL has good generalization and anti-jamming performance,and consumes less energy than the anti-acceleration saturation terminal guidance law.
