Traffic forecasting with high precision aids Intelligent Transport Systems(ITS)in formulating and optimizing traffic management strategies.The algorithms used for tuning the hyperparameters of the deep learning models...Traffic forecasting with high precision aids Intelligent Transport Systems(ITS)in formulating and optimizing traffic management strategies.The algorithms used for tuning the hyperparameters of the deep learning models often have accurate results at the expense of high computational complexity.To address this problem,this paper uses the Tree-structured Parzen Estimator(TPE)to tune the hyperparameters of the Long Short-term Memory(LSTM)deep learning framework.The Tree-structured Parzen Estimator(TPE)uses a probabilistic approach with an adaptive searching mechanism by classifying the objective function values into good and bad samples.This ensures fast convergence in tuning the hyperparameter values in the deep learning model for performing prediction while still maintaining a certain degree of accuracy.It also overcomes the problem of converging to local optima and avoids timeconsuming random search and,therefore,avoids high computational complexity in prediction accuracy.The proposed scheme first performs data smoothing and normalization on the input data,which is then fed to the input of the TPE for tuning the hyperparameters.The traffic data is then input to the LSTM model with tuned parameters to perform the traffic prediction.The three optimizers:Adaptive Moment Estimation(Adam),Root Mean Square Propagation(RMSProp),and Stochastic Gradient Descend with Momentum(SGDM)are also evaluated for accuracy prediction and the best optimizer is then chosen for final traffic prediction in TPE-LSTM model.Simulation results verify the effectiveness of the proposed model in terms of accuracy of prediction over the benchmark schemes.展开更多
Anaerobic process is regarded as a green and sustainable process due to low carbon emission and minimal energy consumption in wastewater treatment plants(WWTPs).However,some water quality metrics are not measurable in...Anaerobic process is regarded as a green and sustainable process due to low carbon emission and minimal energy consumption in wastewater treatment plants(WWTPs).However,some water quality metrics are not measurable in real time,thus influencing the judgment of the operators and may increase energy consumption and carbon emission.One of the solutions is using a soft-sensor prediction technique.This article introduces a water quality soft-sensor prediction method based on Bidirectional Gated Recurrent Unit(BiGRU)combined with Gaussian Progress Regression(GPR)optimized by Tree-structured Parzen Estimator(TPE).TPE automatically optimizes the hyperparameters of BiGRU,and BiGRU is trained to obtain the point prediction with GPR for the interval prediction.Then,a case study applying this prediction method for an actual anaerobic process(2500 m^(3)/d)is carried out.Results show that TPE effectively optimizes the hyperparameters of BiGRU.For point prediction of CODeff and biogas yield,R^(2)values of BiGRU,which are 0.973 and 0.939,respectively,are increased by 1.03%–7.61%and 1.28%–10.33%,compared with those of other models,and the valid prediction interval can be obtained.Besides,the proposed model is assessed as a reliable model for anaerobic process through the probability prediction and reliable evaluation.It is expected to provide high accuracy and reliable water quality prediction to offer basis for operators in WWTPs to control the reactor and minimize carbon emission and energy consumption.展开更多
文摘Traffic forecasting with high precision aids Intelligent Transport Systems(ITS)in formulating and optimizing traffic management strategies.The algorithms used for tuning the hyperparameters of the deep learning models often have accurate results at the expense of high computational complexity.To address this problem,this paper uses the Tree-structured Parzen Estimator(TPE)to tune the hyperparameters of the Long Short-term Memory(LSTM)deep learning framework.The Tree-structured Parzen Estimator(TPE)uses a probabilistic approach with an adaptive searching mechanism by classifying the objective function values into good and bad samples.This ensures fast convergence in tuning the hyperparameter values in the deep learning model for performing prediction while still maintaining a certain degree of accuracy.It also overcomes the problem of converging to local optima and avoids timeconsuming random search and,therefore,avoids high computational complexity in prediction accuracy.The proposed scheme first performs data smoothing and normalization on the input data,which is then fed to the input of the TPE for tuning the hyperparameters.The traffic data is then input to the LSTM model with tuned parameters to perform the traffic prediction.The three optimizers:Adaptive Moment Estimation(Adam),Root Mean Square Propagation(RMSProp),and Stochastic Gradient Descend with Momentum(SGDM)are also evaluated for accuracy prediction and the best optimizer is then chosen for final traffic prediction in TPE-LSTM model.Simulation results verify the effectiveness of the proposed model in terms of accuracy of prediction over the benchmark schemes.
基金This research was supported by the National Natural Science Foundation of China(Nos.41977300 and 41907297)the Science and Technology Program of Guangzhou(China)(No.202002020055)the Fujian Provincial Natural Science Foundation(China)(No.2020I1001).
文摘Anaerobic process is regarded as a green and sustainable process due to low carbon emission and minimal energy consumption in wastewater treatment plants(WWTPs).However,some water quality metrics are not measurable in real time,thus influencing the judgment of the operators and may increase energy consumption and carbon emission.One of the solutions is using a soft-sensor prediction technique.This article introduces a water quality soft-sensor prediction method based on Bidirectional Gated Recurrent Unit(BiGRU)combined with Gaussian Progress Regression(GPR)optimized by Tree-structured Parzen Estimator(TPE).TPE automatically optimizes the hyperparameters of BiGRU,and BiGRU is trained to obtain the point prediction with GPR for the interval prediction.Then,a case study applying this prediction method for an actual anaerobic process(2500 m^(3)/d)is carried out.Results show that TPE effectively optimizes the hyperparameters of BiGRU.For point prediction of CODeff and biogas yield,R^(2)values of BiGRU,which are 0.973 and 0.939,respectively,are increased by 1.03%–7.61%and 1.28%–10.33%,compared with those of other models,and the valid prediction interval can be obtained.Besides,the proposed model is assessed as a reliable model for anaerobic process through the probability prediction and reliable evaluation.It is expected to provide high accuracy and reliable water quality prediction to offer basis for operators in WWTPs to control the reactor and minimize carbon emission and energy consumption.