In dense pedestrian tracking,frequent object occlusions and close distances between objects cause difficulty when accurately estimating object trajectories.In this study,a conditional random field tracking model is es...In dense pedestrian tracking,frequent object occlusions and close distances between objects cause difficulty when accurately estimating object trajectories.In this study,a conditional random field tracking model is established by using a visual long short term memory network in the three-dimensional(3D)space and the motion estimations jointly performed on object trajectory segments.Object visual field information is added to the long short term memory network to improve the accuracy of the motion related object pair selection and motion estimation.To address the uncertainty of the length and interval of trajectory segments,a multimode long short term memory network is proposed for the object motion estimation.The tracking performance is evaluated using the PETS2009 dataset.The experimental results show that the proposed method achieves better performance than the tracking methods based on the independent motion estimation.展开更多
Speaker separation in complex acoustic environment is one of challenging tasks in speech separation.In practice,speakers are very often unmoving or moving slowly in normal communication.In this case,the spatial featur...Speaker separation in complex acoustic environment is one of challenging tasks in speech separation.In practice,speakers are very often unmoving or moving slowly in normal communication.In this case,the spatial features among the consecutive speech frames become highly correlated such that it is helpful for speaker separation by providing additional spatial information.To fully exploit this information,we design a separation system on Recurrent Neural Network(RNN)with long short-term memory(LSTM)which effectively learns the temporal dynamics of spatial features.In detail,a LSTM-based speaker separation algorithm is proposed to extract the spatial features in each time-frequency(TF)unit and form the corresponding feature vector.Then,we treat speaker separation as a supervised learning problem,where a modified ideal ratio mask(IRM)is defined as the training function during LSTM learning.Simulations show that the proposed system achieves attractive separation performance in noisy and reverberant environments.Specifically,during the untrained acoustic test with limited priors,e.g.,unmatched signal to noise ratio(SNR)and reverberation,the proposed LSTM based algorithm can still outperforms the existing DNN based method in the measures of PESQ and STOI.It indicates our method is more robust in untrained conditions.展开更多
Predicting wind speed accurately is essential to ensure the stability of the wind power system and improve the utilization rate of wind energy.However,owing to the stochastic and intermittent of wind speed,predicting ...Predicting wind speed accurately is essential to ensure the stability of the wind power system and improve the utilization rate of wind energy.However,owing to the stochastic and intermittent of wind speed,predicting wind speed accurately is difficult.A new hybrid deep learning model based on empirical wavelet transform,recurrent neural network and error correction for short-term wind speed prediction is proposed in this paper.The empirical wavelet transformation is applied to decompose the original wind speed series.The long short term memory network and the Elman neural network are adopted to predict low-frequency and high-frequency wind speed sub-layers respectively to balance the calculation efficiency and prediction accuracy.The error correction strategy based on deep long short term memory network is developed to modify the prediction errors.Four actual wind speed series are utilized to verify the effectiveness of the proposed model.The empirical results indicate that the method proposed in this paper has satisfactory performance in wind speed prediction.展开更多
In terms of the modular fuzzy neural network (MFNN) combining fuzzy c-mean (FCM) cluster and single-layer neural network, a short-term climate prediction model is developed. It is found from modeling results that the ...In terms of the modular fuzzy neural network (MFNN) combining fuzzy c-mean (FCM) cluster and single-layer neural network, a short-term climate prediction model is developed. It is found from modeling results that the MFNN model for short-term climate prediction has advantages of simple structure, no hidden layer and stable network parameters because of the assembling of sound functions of the self-adaptive learning, association and fuzzy information processing of fuzzy mathematics and neural network methods. The case computational results of Guangxi flood season (JJA) rainfall show that the mean absolute error (MAE) and mean relative error (MRE) of the prediction during 1998-2002 are 68.8 mm and 9.78%, and in comparison with the regression method, under the conditions of the same predictors and period they are 97.8 mm and 12.28% respectively. Furthermore, it is also found from the stability analysis of the modular model that the change of the prediction results of independent samples with training times in the stably convergent interval of the model is less than 1.3 mm. The obvious oscillation phenomenon of prediction results with training times, such as in the common back-propagation neural network (BPNN) model, does not occur, indicating a better practical application potential of the MFNN model.展开更多
With the rapid development of mechanical equipment, the mechanical health monitoring field has entered the era of big data. However, the method of manual feature extraction has the disadvantages of low efficiency and ...With the rapid development of mechanical equipment, the mechanical health monitoring field has entered the era of big data. However, the method of manual feature extraction has the disadvantages of low efficiency and poor accuracy, when handling big data. In this study, the research object was the asynchronous motor in the drivetrain diagnostics simulator system. The vibration signals of different fault motors were collected. The raw signal was pretreated using short time Fourier transform （STFT） to obtain the corresponding time-frequency map. Then, the feature of the time-frequency map was adap- tively extracted by using a convolutional neural network （CNN）. The effects of the pretreatment method, and the hyper parameters of network diagnostic accuracy, were investigated experimentally. The experimental results showed that the influence of the preprocessing method is small, and that the batch-size is the main factor affecting accuracy and training efficiency. By investigating feature visualization, it was shown that, in the case of big data, the extracted CNN features can represent complex mapping relationships between signal and health status, and can also overcome the prior knowledge and engineering experience requirement for feature extraction, which is used by tra- ditional diagnosis methods. This paper proposes a new method, based on STFT and CNN, which can complete motor fault diagnosis tasks more intelligently and accurately.展开更多
In recent years, introduction of a renewable energy source such as solar energy is expected. However, solar radiation is not constant and power output of photovoltaic (PV) system is influenced by weather conditions. I...In recent years, introduction of a renewable energy source such as solar energy is expected. However, solar radiation is not constant and power output of photovoltaic (PV) system is influenced by weather conditions. It is difficult for getting to know accurate power output of PV system. In order to forecast the power output of PV system as accurate as possible, this paper proposes a decision technique of forecasting model for short-term-ahead power output of PV system based on solar radiation prediction. Application of Recurrent Neural Network (RNN) is shown for solar radiation prediction in this paper. The proposed method in this paper does not require complicated calculation, but mathematical model with only useful weather data. The validity of the proposed RNN is confirmed by comparing simulation results of solar radiation forecasting with that obtained from other展开更多
In the electricity market,fluctuations in real-time prices are unstable,and changes in short-term load are determined by many factors.By studying the timing of charging and discharging,as well as the economic benefits...In the electricity market,fluctuations in real-time prices are unstable,and changes in short-term load are determined by many factors.By studying the timing of charging and discharging,as well as the economic benefits of energy storage in the process of participating in the power market,this paper takes energy storage scheduling as merely one factor affecting short-term power load,which affects short-term load time series along with time-of-use price,holidays,and temperature.A deep learning network is used to predict the short-term load,a convolutional neural network(CNN)is used to extract the features,and a long short-term memory(LSTM)network is used to learn the temporal characteristics of the load value,which can effectively improve prediction accuracy.Taking the load data of a certain region as an example,the CNN-LSTM prediction model is compared with the single LSTM prediction model.The experimental results show that the CNN-LSTM deep learning network with the participation of energy storage in dispatching can have high prediction accuracy for short-term power load forecasting.展开更多
A Long Short-Term Memory(LSTM) Recurrent Neural Network(RNN) has driven tremendous improvements on an acoustic model based on Gaussian Mixture Model(GMM). However, these models based on a hybrid method require a force...A Long Short-Term Memory(LSTM) Recurrent Neural Network(RNN) has driven tremendous improvements on an acoustic model based on Gaussian Mixture Model(GMM). However, these models based on a hybrid method require a forced aligned Hidden Markov Model(HMM) state sequence obtained from the GMM-based acoustic model. Therefore, it requires a long computation time for training both the GMM-based acoustic model and a deep learning-based acoustic model. In order to solve this problem, an acoustic model using CTC algorithm is proposed. CTC algorithm does not require the GMM-based acoustic model because it does not use the forced aligned HMM state sequence. However, previous works on a LSTM RNN-based acoustic model using CTC used a small-scale training corpus. In this paper, the LSTM RNN-based acoustic model using CTC is trained on a large-scale training corpus and its performance is evaluated. The implemented acoustic model has a performance of 6.18% and 15.01% in terms of Word Error Rate(WER) for clean speech and noisy speech, respectively. This is similar to a performance of the acoustic model based on the hybrid method.展开更多
This paper develops a nonlinear mathematical model to simulate the dynamic motion behavior of the barge equipped with the portable outboard Dynamic Positioning （DP） system in short-crested waves. The self-tuning Pro...This paper develops a nonlinear mathematical model to simulate the dynamic motion behavior of the barge equipped with the portable outboard Dynamic Positioning （DP） system in short-crested waves. The self-tuning Proportional- Derivative （PD） controller based on the neural network algorithm is applied to control the thrusters for optimal adjustment of the barge position in waves. In addition to the wave, the current, the wind and the nonlinear drift force are also considered in the calculations. The time domain simulations for the six-degree-of-freedom motions of the barge with the DP system are solved by the 4th order Runge-Kutta method which can compromise the efficiency and the accuracy of the simulations. The technique of the portable alternative DP system developed here can serve as a practical tool to assist those ships without being equipped with the DP facility while the dynamic positioning missions are needed.展开更多
An accurate short-term forecasting method for load of electric power system can help the electric power system’s operator to reduce the risk of unreliability of electricity supply. This paper proposed a radial basis ...An accurate short-term forecasting method for load of electric power system can help the electric power system’s operator to reduce the risk of unreliability of electricity supply. This paper proposed a radial basis function (RBF) neural network method to forecast the short-term load of electric power system. To demonstrate the effectiveness of the proposed method, the method is tested on the practical load data information of the Tai power system. The good agreements between the realistic values and forecasting values are obtained;the numerical results show that the proposed forecasting method is accurate and reliable.展开更多
The fuzzy neural network is applied to the short-term load forecasting. The fuzzy rules and fuzzy membership functions of the network are obtained through fuzzy neural network learming. Three inference algorithms, i.e...The fuzzy neural network is applied to the short-term load forecasting. The fuzzy rules and fuzzy membership functions of the network are obtained through fuzzy neural network learming. Three inference algorithms, i.e. themultiplicative inference, the maximum inference and the minimum inference, are used for comparison. The learningalgorithms corresponding to the inference methods are derived from back-propagation algorithm. To validate the fuzzyneural network model, the network is used to Predict short-term load by compaing the network output against the realload data from a local power system supplying electricity to a large steel manufacturer. The experimental results aresatisfactory.展开更多
In this article, we are initiating the hypothesis that improvements in short term energy load forecasting may rely on inclusion of data from new information sources generated outside the power grid and weather related...In this article, we are initiating the hypothesis that improvements in short term energy load forecasting may rely on inclusion of data from new information sources generated outside the power grid and weather related systems. Other relevant domains of data include scheduled activities on a grid, large events and conventions in the area, equipment duty cycle schedule, data from call centers, real-time traffic, Facebook, Twitter, and other social networks feeds, and variety of city or region websites. All these distributed data sources pose information collection, integration and analysis challenges. Our approach is concentrated on complex non-cyclic events detection where detected events have a human crowd magnitude that is influencing power requirements. The proposed methodology deals with computation, transformation, modeling, and patterns detection over large volumes of partially ordered, internet based streaming multimedia signals or text messages. We are claiming that traditional approaches can be complemented and enhanced by new streaming data inclusion and analyses, where complex event detection combined with Webbased technologies improves short term load forecasting. Some preliminary experimental results, using Gowalla social network dataset, confirmed our hypothesis as a proof-of-concept, and they paved the way for further improvements by giving new dimensions of short term load forecasting process in a smart grid.展开更多
This paper presents an artificial neural network, ANN, based approach for estimating short-term wholesale electricity prices using past price and demand data. The objective is to utilize the piecewise continuous na-tu...This paper presents an artificial neural network, ANN, based approach for estimating short-term wholesale electricity prices using past price and demand data. The objective is to utilize the piecewise continuous na-ture of electricity prices on the time domain by clustering the input data into time ranges where the variation trends are maintained. Due to the imprecise nature of cluster boundaries a fuzzy inference technique is em-ployed to handle data that lies at the intersections. As a necessary step in forecasting prices the anticipated electricity demand at the target time is estimated first using a separate ANN. The Australian New-South Wales electricity market data was used to test the system. The developed system shows considerable im-provement in performance compared with approaches that regard price data as a single continuous time se-ries, achieving MAPE of less than 2% for hours with steady prices and 8% for the clusters covering time pe-riods with price spikes.展开更多
文摘In dense pedestrian tracking,frequent object occlusions and close distances between objects cause difficulty when accurately estimating object trajectories.In this study,a conditional random field tracking model is established by using a visual long short term memory network in the three-dimensional(3D)space and the motion estimations jointly performed on object trajectory segments.Object visual field information is added to the long short term memory network to improve the accuracy of the motion related object pair selection and motion estimation.To address the uncertainty of the length and interval of trajectory segments,a multimode long short term memory network is proposed for the object motion estimation.The tracking performance is evaluated using the PETS2009 dataset.The experimental results show that the proposed method achieves better performance than the tracking methods based on the independent motion estimation.
基金This work is supported by the National Nature Science Foundation of China(NSFC)under Grant Nos.61571106,61501169,41706103the Fundamental Research Funds for the Central Universities under Grant No.2242013K30010.
文摘Speaker separation in complex acoustic environment is one of challenging tasks in speech separation.In practice,speakers are very often unmoving or moving slowly in normal communication.In this case,the spatial features among the consecutive speech frames become highly correlated such that it is helpful for speaker separation by providing additional spatial information.To fully exploit this information,we design a separation system on Recurrent Neural Network(RNN)with long short-term memory(LSTM)which effectively learns the temporal dynamics of spatial features.In detail,a LSTM-based speaker separation algorithm is proposed to extract the spatial features in each time-frequency(TF)unit and form the corresponding feature vector.Then,we treat speaker separation as a supervised learning problem,where a modified ideal ratio mask(IRM)is defined as the training function during LSTM learning.Simulations show that the proposed system achieves attractive separation performance in noisy and reverberant environments.Specifically,during the untrained acoustic test with limited priors,e.g.,unmatched signal to noise ratio(SNR)and reverberation,the proposed LSTM based algorithm can still outperforms the existing DNN based method in the measures of PESQ and STOI.It indicates our method is more robust in untrained conditions.
基金the Gansu Province Soft Scientific Research Projects(No.2015GS06516)the Funds for Distinguished Young Scientists of Lanzhou University of Technology,China(No.J201304)。
文摘Predicting wind speed accurately is essential to ensure the stability of the wind power system and improve the utilization rate of wind energy.However,owing to the stochastic and intermittent of wind speed,predicting wind speed accurately is difficult.A new hybrid deep learning model based on empirical wavelet transform,recurrent neural network and error correction for short-term wind speed prediction is proposed in this paper.The empirical wavelet transformation is applied to decompose the original wind speed series.The long short term memory network and the Elman neural network are adopted to predict low-frequency and high-frequency wind speed sub-layers respectively to balance the calculation efficiency and prediction accuracy.The error correction strategy based on deep long short term memory network is developed to modify the prediction errors.Four actual wind speed series are utilized to verify the effectiveness of the proposed model.The empirical results indicate that the method proposed in this paper has satisfactory performance in wind speed prediction.
基金This reasearch was supported by the Science Foundation of Guangxi under grant No.0339025the Natural Sciences Foundation of China under grant No.40075021.
文摘In terms of the modular fuzzy neural network (MFNN) combining fuzzy c-mean (FCM) cluster and single-layer neural network, a short-term climate prediction model is developed. It is found from modeling results that the MFNN model for short-term climate prediction has advantages of simple structure, no hidden layer and stable network parameters because of the assembling of sound functions of the self-adaptive learning, association and fuzzy information processing of fuzzy mathematics and neural network methods. The case computational results of Guangxi flood season (JJA) rainfall show that the mean absolute error (MAE) and mean relative error (MRE) of the prediction during 1998-2002 are 68.8 mm and 9.78%, and in comparison with the regression method, under the conditions of the same predictors and period they are 97.8 mm and 12.28% respectively. Furthermore, it is also found from the stability analysis of the modular model that the change of the prediction results of independent samples with training times in the stably convergent interval of the model is less than 1.3 mm. The obvious oscillation phenomenon of prediction results with training times, such as in the common back-propagation neural network (BPNN) model, does not occur, indicating a better practical application potential of the MFNN model.
基金Supported by National Natural Science Foundation of China(Grant No.51405241,51505234,51575283)
文摘With the rapid development of mechanical equipment, the mechanical health monitoring field has entered the era of big data. However, the method of manual feature extraction has the disadvantages of low efficiency and poor accuracy, when handling big data. In this study, the research object was the asynchronous motor in the drivetrain diagnostics simulator system. The vibration signals of different fault motors were collected. The raw signal was pretreated using short time Fourier transform （STFT） to obtain the corresponding time-frequency map. Then, the feature of the time-frequency map was adap- tively extracted by using a convolutional neural network （CNN）. The effects of the pretreatment method, and the hyper parameters of network diagnostic accuracy, were investigated experimentally. The experimental results showed that the influence of the preprocessing method is small, and that the batch-size is the main factor affecting accuracy and training efficiency. By investigating feature visualization, it was shown that, in the case of big data, the extracted CNN features can represent complex mapping relationships between signal and health status, and can also overcome the prior knowledge and engineering experience requirement for feature extraction, which is used by tra- ditional diagnosis methods. This paper proposes a new method, based on STFT and CNN, which can complete motor fault diagnosis tasks more intelligently and accurately.
文摘In recent years, introduction of a renewable energy source such as solar energy is expected. However, solar radiation is not constant and power output of photovoltaic (PV) system is influenced by weather conditions. It is difficult for getting to know accurate power output of PV system. In order to forecast the power output of PV system as accurate as possible, this paper proposes a decision technique of forecasting model for short-term-ahead power output of PV system based on solar radiation prediction. Application of Recurrent Neural Network (RNN) is shown for solar radiation prediction in this paper. The proposed method in this paper does not require complicated calculation, but mathematical model with only useful weather data. The validity of the proposed RNN is confirmed by comparing simulation results of solar radiation forecasting with that obtained from other
基金supported by a State Grid Zhejiang Electric Power Co.,Ltd.Economic and Technical Research Institute Project(Key Technologies and Empirical Research of Diversified Integrated Operation of User-Side Energy Storage in Power Market Environment,No.5211JY19000W)supported by the National Natural Science Foundation of China(Research on Power Market Management to Promote Large-Scale New Energy Consumption,No.71804045).
文摘In the electricity market,fluctuations in real-time prices are unstable,and changes in short-term load are determined by many factors.By studying the timing of charging and discharging,as well as the economic benefits of energy storage in the process of participating in the power market,this paper takes energy storage scheduling as merely one factor affecting short-term power load,which affects short-term load time series along with time-of-use price,holidays,and temperature.A deep learning network is used to predict the short-term load,a convolutional neural network(CNN)is used to extract the features,and a long short-term memory(LSTM)network is used to learn the temporal characteristics of the load value,which can effectively improve prediction accuracy.Taking the load data of a certain region as an example,the CNN-LSTM prediction model is compared with the single LSTM prediction model.The experimental results show that the CNN-LSTM deep learning network with the participation of energy storage in dispatching can have high prediction accuracy for short-term power load forecasting.
基金supported by the Ministry of Trade,Industry & Energy(MOTIE,Korea) under Industrial Technology Innovation Program (No.10063424,'development of distant speech recognition and multi-task dialog processing technologies for in-door conversational robots')
文摘A Long Short-Term Memory(LSTM) Recurrent Neural Network(RNN) has driven tremendous improvements on an acoustic model based on Gaussian Mixture Model(GMM). However, these models based on a hybrid method require a forced aligned Hidden Markov Model(HMM) state sequence obtained from the GMM-based acoustic model. Therefore, it requires a long computation time for training both the GMM-based acoustic model and a deep learning-based acoustic model. In order to solve this problem, an acoustic model using CTC algorithm is proposed. CTC algorithm does not require the GMM-based acoustic model because it does not use the forced aligned HMM state sequence. However, previous works on a LSTM RNN-based acoustic model using CTC used a small-scale training corpus. In this paper, the LSTM RNN-based acoustic model using CTC is trained on a large-scale training corpus and its performance is evaluated. The implemented acoustic model has a performance of 6.18% and 15.01% in terms of Word Error Rate(WER) for clean speech and noisy speech, respectively. This is similar to a performance of the acoustic model based on the hybrid method.
基金financially supported by the Science Council Taiwan (Grant No. NSC-96-2221-E006-329-MY3)partly supported by the Research Center of Ocean Environment and Technology NCKU
文摘This paper develops a nonlinear mathematical model to simulate the dynamic motion behavior of the barge equipped with the portable outboard Dynamic Positioning （DP） system in short-crested waves. The self-tuning Proportional- Derivative （PD） controller based on the neural network algorithm is applied to control the thrusters for optimal adjustment of the barge position in waves. In addition to the wave, the current, the wind and the nonlinear drift force are also considered in the calculations. The time domain simulations for the six-degree-of-freedom motions of the barge with the DP system are solved by the 4th order Runge-Kutta method which can compromise the efficiency and the accuracy of the simulations. The technique of the portable alternative DP system developed here can serve as a practical tool to assist those ships without being equipped with the DP facility while the dynamic positioning missions are needed.
文摘An accurate short-term forecasting method for load of electric power system can help the electric power system’s operator to reduce the risk of unreliability of electricity supply. This paper proposed a radial basis function (RBF) neural network method to forecast the short-term load of electric power system. To demonstrate the effectiveness of the proposed method, the method is tested on the practical load data information of the Tai power system. The good agreements between the realistic values and forecasting values are obtained;the numerical results show that the proposed forecasting method is accurate and reliable.
文摘The fuzzy neural network is applied to the short-term load forecasting. The fuzzy rules and fuzzy membership functions of the network are obtained through fuzzy neural network learming. Three inference algorithms, i.e. themultiplicative inference, the maximum inference and the minimum inference, are used for comparison. The learningalgorithms corresponding to the inference methods are derived from back-propagation algorithm. To validate the fuzzyneural network model, the network is used to Predict short-term load by compaing the network output against the realload data from a local power system supplying electricity to a large steel manufacturer. The experimental results aresatisfactory.
文摘In this article, we are initiating the hypothesis that improvements in short term energy load forecasting may rely on inclusion of data from new information sources generated outside the power grid and weather related systems. Other relevant domains of data include scheduled activities on a grid, large events and conventions in the area, equipment duty cycle schedule, data from call centers, real-time traffic, Facebook, Twitter, and other social networks feeds, and variety of city or region websites. All these distributed data sources pose information collection, integration and analysis challenges. Our approach is concentrated on complex non-cyclic events detection where detected events have a human crowd magnitude that is influencing power requirements. The proposed methodology deals with computation, transformation, modeling, and patterns detection over large volumes of partially ordered, internet based streaming multimedia signals or text messages. We are claiming that traditional approaches can be complemented and enhanced by new streaming data inclusion and analyses, where complex event detection combined with Webbased technologies improves short term load forecasting. Some preliminary experimental results, using Gowalla social network dataset, confirmed our hypothesis as a proof-of-concept, and they paved the way for further improvements by giving new dimensions of short term load forecasting process in a smart grid.
文摘This paper presents an artificial neural network, ANN, based approach for estimating short-term wholesale electricity prices using past price and demand data. The objective is to utilize the piecewise continuous na-ture of electricity prices on the time domain by clustering the input data into time ranges where the variation trends are maintained. Due to the imprecise nature of cluster boundaries a fuzzy inference technique is em-ployed to handle data that lies at the intersections. As a necessary step in forecasting prices the anticipated electricity demand at the target time is estimated first using a separate ANN. The Australian New-South Wales electricity market data was used to test the system. The developed system shows considerable im-provement in performance compared with approaches that regard price data as a single continuous time se-ries, achieving MAPE of less than 2% for hours with steady prices and 8% for the clusters covering time pe-riods with price spikes.
