Traffic forecasting with high precision aids Intelligent Transport Systems(ITS)in formulating and optimizing traffic management strategies.The algorithms used for tuning the hyperparameters of the deep learning models...Traffic forecasting with high precision aids Intelligent Transport Systems(ITS)in formulating and optimizing traffic management strategies.The algorithms used for tuning the hyperparameters of the deep learning models often have accurate results at the expense of high computational complexity.To address this problem,this paper uses the Tree-structured Parzen Estimator(TPE)to tune the hyperparameters of the Long Short-term Memory(LSTM)deep learning framework.The Tree-structured Parzen Estimator(TPE)uses a probabilistic approach with an adaptive searching mechanism by classifying the objective function values into good and bad samples.This ensures fast convergence in tuning the hyperparameter values in the deep learning model for performing prediction while still maintaining a certain degree of accuracy.It also overcomes the problem of converging to local optima and avoids timeconsuming random search and,therefore,avoids high computational complexity in prediction accuracy.The proposed scheme first performs data smoothing and normalization on the input data,which is then fed to the input of the TPE for tuning the hyperparameters.The traffic data is then input to the LSTM model with tuned parameters to perform the traffic prediction.The three optimizers:Adaptive Moment Estimation(Adam),Root Mean Square Propagation(RMSProp),and Stochastic Gradient Descend with Momentum(SGDM)are also evaluated for accuracy prediction and the best optimizer is then chosen for final traffic prediction in TPE-LSTM model.Simulation results verify the effectiveness of the proposed model in terms of accuracy of prediction over the benchmark schemes.展开更多
Anaerobic process is regarded as a green and sustainable process due to low carbon emission and minimal energy consumption in wastewater treatment plants(WWTPs).However,some water quality metrics are not measurable in...Anaerobic process is regarded as a green and sustainable process due to low carbon emission and minimal energy consumption in wastewater treatment plants(WWTPs).However,some water quality metrics are not measurable in real time,thus influencing the judgment of the operators and may increase energy consumption and carbon emission.One of the solutions is using a soft-sensor prediction technique.This article introduces a water quality soft-sensor prediction method based on Bidirectional Gated Recurrent Unit(BiGRU)combined with Gaussian Progress Regression(GPR)optimized by Tree-structured Parzen Estimator(TPE).TPE automatically optimizes the hyperparameters of BiGRU,and BiGRU is trained to obtain the point prediction with GPR for the interval prediction.Then,a case study applying this prediction method for an actual anaerobic process(2500 m^(3)/d)is carried out.Results show that TPE effectively optimizes the hyperparameters of BiGRU.For point prediction of CODeff and biogas yield,R^(2)values of BiGRU,which are 0.973 and 0.939,respectively,are increased by 1.03%–7.61%and 1.28%–10.33%,compared with those of other models,and the valid prediction interval can be obtained.Besides,the proposed model is assessed as a reliable model for anaerobic process through the probability prediction and reliable evaluation.It is expected to provide high accuracy and reliable water quality prediction to offer basis for operators in WWTPs to control the reactor and minimize carbon emission and energy consumption.展开更多
--This paper presents a novel time delay estimation （TDE） method using the concept of entropy. The relative delay is estimated by minimizing the estimated joint entropy of multiple sensor output signals. When estima...--This paper presents a novel time delay estimation （TDE） method using the concept of entropy. The relative delay is estimated by minimizing the estimated joint entropy of multiple sensor output signals. When estimating the entropy, the information about the prior distribution of the source signal is not required. Instead, the Parzen window estimator is employed to estimate the density function of the source signal from multiple sensor output signals. Meanwhile, based on the Parzen window estimator, the Renyi＇s quadratic entropy （RQE） is incorporated to effectively and efficiently estimate the high-dimensional joint entropy of the multichannel outputs. Furthermore, a modified form of the joint entropy for embedding information about reverberation （multipath reflections） for speech signals is introduced to enhance the estimator＇s robustness against reverberation.展开更多
文摘Traffic forecasting with high precision aids Intelligent Transport Systems(ITS)in formulating and optimizing traffic management strategies.The algorithms used for tuning the hyperparameters of the deep learning models often have accurate results at the expense of high computational complexity.To address this problem,this paper uses the Tree-structured Parzen Estimator(TPE)to tune the hyperparameters of the Long Short-term Memory(LSTM)deep learning framework.The Tree-structured Parzen Estimator(TPE)uses a probabilistic approach with an adaptive searching mechanism by classifying the objective function values into good and bad samples.This ensures fast convergence in tuning the hyperparameter values in the deep learning model for performing prediction while still maintaining a certain degree of accuracy.It also overcomes the problem of converging to local optima and avoids timeconsuming random search and,therefore,avoids high computational complexity in prediction accuracy.The proposed scheme first performs data smoothing and normalization on the input data,which is then fed to the input of the TPE for tuning the hyperparameters.The traffic data is then input to the LSTM model with tuned parameters to perform the traffic prediction.The three optimizers:Adaptive Moment Estimation(Adam),Root Mean Square Propagation(RMSProp),and Stochastic Gradient Descend with Momentum(SGDM)are also evaluated for accuracy prediction and the best optimizer is then chosen for final traffic prediction in TPE-LSTM model.Simulation results verify the effectiveness of the proposed model in terms of accuracy of prediction over the benchmark schemes.
基金This research was supported by the National Natural Science Foundation of China(Nos.41977300 and 41907297)the Science and Technology Program of Guangzhou(China)(No.202002020055)the Fujian Provincial Natural Science Foundation(China)(No.2020I1001).
文摘Anaerobic process is regarded as a green and sustainable process due to low carbon emission and minimal energy consumption in wastewater treatment plants(WWTPs).However,some water quality metrics are not measurable in real time,thus influencing the judgment of the operators and may increase energy consumption and carbon emission.One of the solutions is using a soft-sensor prediction technique.This article introduces a water quality soft-sensor prediction method based on Bidirectional Gated Recurrent Unit(BiGRU)combined with Gaussian Progress Regression(GPR)optimized by Tree-structured Parzen Estimator(TPE).TPE automatically optimizes the hyperparameters of BiGRU,and BiGRU is trained to obtain the point prediction with GPR for the interval prediction.Then,a case study applying this prediction method for an actual anaerobic process(2500 m^(3)/d)is carried out.Results show that TPE effectively optimizes the hyperparameters of BiGRU.For point prediction of CODeff and biogas yield,R^(2)values of BiGRU,which are 0.973 and 0.939,respectively,are increased by 1.03%–7.61%and 1.28%–10.33%,compared with those of other models,and the valid prediction interval can be obtained.Besides,the proposed model is assessed as a reliable model for anaerobic process through the probability prediction and reliable evaluation.It is expected to provide high accuracy and reliable water quality prediction to offer basis for operators in WWTPs to control the reactor and minimize carbon emission and energy consumption.
基金supported by the National Natural Science Foundation of China under Grant No.61172140‘985’ Key Projects for Excellent Teaching Team Supporting (postgraduate) under Grant No.A1098522-02
文摘--This paper presents a novel time delay estimation （TDE） method using the concept of entropy. The relative delay is estimated by minimizing the estimated joint entropy of multiple sensor output signals. When estimating the entropy, the information about the prior distribution of the source signal is not required. Instead, the Parzen window estimator is employed to estimate the density function of the source signal from multiple sensor output signals. Meanwhile, based on the Parzen window estimator, the Renyi＇s quadratic entropy （RQE） is incorporated to effectively and efficiently estimate the high-dimensional joint entropy of the multichannel outputs. Furthermore, a modified form of the joint entropy for embedding information about reverberation （multipath reflections） for speech signals is introduced to enhance the estimator＇s robustness against reverberation.
