Intelligent maintenance of roads and highways requires accurate deterioration evaluation and performance prediction of asphalt pavement.To this end,we develop a time series long short-term memory(LSTM)model to predict...Intelligent maintenance of roads and highways requires accurate deterioration evaluation and performance prediction of asphalt pavement.To this end,we develop a time series long short-term memory(LSTM)model to predict key performance indicators(PIs)of pavement,namely the international roughness index(IRI)and rutting depth(RD).Subsequently,we propose a comprehensive performance indicator for the pavement quality index(PQI),which leverages the highway performance assessment standard method,entropy weight method,and fuzzy comprehensive evaluation method.This indicator can evaluate the overall performance condition of the pavement.The data used for the model development and analysis are extracted from tests on two full-scale accelerated test tracks,called MnRoad and RIOHTrack.Six variables are used as predictors,including temperature,precipitation,total traffic volume,asphalt surface layer thickness,pavement age,and maintenance condition.Furthermore,wavelet denoising is performed to analyze the impact of missing or abnormal data on the LSTM model accuracy.In comparison to a traditional autoregressive integrated moving average(ARIMAX)model,the proposed LSTM model performs better in terms of PI prediction and resiliency to noise.Finally,the overall prediction accuracy of our proposed performance indicator PQI is 93.8%.展开更多
Traffic flow prediction,as the basis of signal coordination and travel time prediction,has become a research point in the field of transportation.For traffic flow prediction,researchers have proposed a variety of meth...Traffic flow prediction,as the basis of signal coordination and travel time prediction,has become a research point in the field of transportation.For traffic flow prediction,researchers have proposed a variety of methods,but most of these methods only use the time domain information of traffic flow data to predict the traffic flow,ignoring the impact of spatial correlation on the prediction of target road segment flow,which leads to poor prediction accuracy.In this paper,a traffic flow prediction model called as long short time memory and random forest(LSTM-RF)was proposed based on the combination model.In the process of traffic flow prediction,the long short time memory(LSTM)model was used to extract the time sequence features of the predicted target road segment.Then,the predicted value of LSTM and the collected information of adjacent upstream and downstream sections were simultaneously used as the input features of the random forest model to analyze the spatial-temporal correlation of traffic flow,so as to obtain the final prediction results.The traffic flow data of 132 urban road sections collected by the license plate recognition system in Guiyang City were tested and verified.The results show that the method is better than the single model in prediction accuracy,and the prediction error is obviously reduced compared with the single model.展开更多
Determining which variables affect price realized volatility has always been challenging.This paper proposes to explain how financial assets influence realized volatility by developing an optimal day-to-day forecast.T...Determining which variables affect price realized volatility has always been challenging.This paper proposes to explain how financial assets influence realized volatility by developing an optimal day-to-day forecast.The methodological proposal is based on using the best econometric and machine learning models to forecast realized volatility.In particular,the best forecasting from heterogeneous autoregressive and long short-term memory models are used to determine the influence of the Standard and Poor’s 500 index,euro-US dollar exchange rate,price of gold,and price of Brent crude oil on the realized volatility of natural gas.These financial assets influenced the realized volatility of natural gas in 87.4% of the days analyzed;the euro-US dollar exchange rate was the primary financial asset and explained 40.1% of the influence.The results of the proposed daily analysis differed from those of the methodology used to study the entire period.The traditional model,which studies the entire period,cannot determine temporal effects,whereas the proposed methodology can.The proposed methodology allows us to distinguish the effects for each day,week,or month rather than averages for entire periods,with the flexibility to analyze different frequencies and periods.This methodological capability is key to analyzing influences and making decisions about realized volatility.展开更多
The state of charge(SOC)estimation of lithium-ion battery is an important function in the battery management system(BMS)of electric vehicles.The long short term memory(LSTM)model can be employed for SOC estimation,whi...The state of charge(SOC)estimation of lithium-ion battery is an important function in the battery management system(BMS)of electric vehicles.The long short term memory(LSTM)model can be employed for SOC estimation,which is capable of estimating the future changing states of a nonlinear system.Since the BMS usually works under complicated operating conditions,i.e the real measurement data used for model training may be corrupted by non-Gaussian noise,and thus the performance of the original LSTM with the mean square error(MSE)loss may deteriorate.Therefore,a novel LSTM with mixture kernel mean p-power error(MKMPE)loss,called MKMPE-LSTM,is developed by using the MKMPE loss to replace the MSE as the learning criterion in LSTM framework,which can achieve robust SOC estimation under the measurement data contaminated with non-Gaussian noises(or outliers)because of the MKMPE containing the p-order moments of the error distribution.In addition,a meta-heuristic algorithm,called heap-based-optimizer(HBO),is employed to optimize the hyper-parameters(mainly including learning rate,number of hidden layer neuron and value of p in MKMPE)of the proposed MKMPE-LSTM model to further improve its flexibility and generalization performance,and a novel hybrid model(HBO-MKMPE-LSTM)is established for SOC estimation under non-Gaussian noise cases.Finally,several tests are performed under various cases through a benchmark to evaluate the performance of the proposed HBO-MKMPE-LSTM model,and the results demonstrate that the proposed hybrid method can provide a good robustness and accuracy under different non-Gaussian measurement noises,and the SOC estimation results in terms of mean square error(MSE),root MSE(RMSE),mean absolute relative error(MARE),and determination coefficient R2are less than 0.05%,3%,3%,and above 99.8%at 25℃,respectively.展开更多
Objective: To predict the daily incidence and fatality rates based on long short-term memory(LSTM) in 4 age groups of COVID-19 patients in Mazandaran Province, Iran.Methods: To predict the daily incidence and fatality...Objective: To predict the daily incidence and fatality rates based on long short-term memory(LSTM) in 4 age groups of COVID-19 patients in Mazandaran Province, Iran.Methods: To predict the daily incidence and fatality rates by age groups, this epidemiological study was conducted based on the LSTM model. All data of COVID-19 disease were collected daily for training the LSTM model from February 22, 2020 to April 10, 2021 in the Mazandaran University of Medical Sciences. We defined 4 age groups, i.e., patients under 29, between 30 and 49, between 50 and 59, and over 60 years old. Then, LSTM models were applied to predict the trend of daily incidence and fatality rates from 14 to 40 days in different age groups. The results of different methods were compared with each other.Results: This study evaluated 5 0826 patients and 5 109 deaths with COVID-19 daily in 20 cities of Mazandaran Province. Among the patients, 25 240 were females(49.7%), and 25 586 were males(50.3%). The predicted daily incidence rates on April 11, 2021 were 91.76, 155.84, 150.03, and 325.99 per 100 000 people, respectively;for the fourteenth day April 24, 2021, the predicted daily incidence rates were 35.91, 92.90, 83.74, and 225.68 in each group per 100 000 people. Furthermore, the predicted average daily incidence rates in 40 days for the 4 age groups were 34.25, 95.68, 76.43, and 210.80 per 100 000 people, and the daily fatality rates were 8.38, 4.18, 3.40, 22.53 per 100 000 people according to the established LSTM model. The findings demonstrated the daily incidence and fatality rates of 417.16 and 38.49 per 100 000 people for all age groups over the next 40 days. Conclusions: The results highlighted the proper performance of the LSTM model for predicting the daily incidence and fatality rates. It can clarify the path of spread or decline of the COVID-19 outbreak and the priority of vaccination in age groups.展开更多
Prompt and accurate traffic flow forecasting is a key foundation of urban traffic management.However,the flows in different areas and feature channels(inflow/outflow)may correspond to different degrees of importance i...Prompt and accurate traffic flow forecasting is a key foundation of urban traffic management.However,the flows in different areas and feature channels(inflow/outflow)may correspond to different degrees of importance in forecasting flows.Many forecasting models inadequately consider this heterogeneity,resulting in decreased predictive accuracy.To overcome this problem,an attention-based hybrid spatiotemporal residual model assisted by spatial and channel information is proposed in this study.By assigning different weights(attention levels)to different regions,the spatial attention module selects relatively important locations from all inputs in the modeling process.Similarly,the channel attention module selects relatively important channels from the multichannel feature map in the modeling process by assigning different weights.The proposed model provides effective selection and attention results for key areas and channels,respectively,during the forecasting process,thereby decreasing the computational overhead and increasing the accuracy.In the case involving Beijing,the proposed model exhibits a 3.7%lower prediction error,and its runtime is 60.9%less the model without attention,indicating that the spatial and channel attention modules are instrumental in increasing the forecasting efficiency.Moreover,in the case involving Shanghai,the proposed model outperforms other models in terms of generalizability and practicality.展开更多
Vehicle velocity forecast is an important clue in improving the performance of energy management in hybrid electric vehicles(HEV). This paper presents a new combined model for predicting vehicle’s velocity time serie...Vehicle velocity forecast is an important clue in improving the performance of energy management in hybrid electric vehicles(HEV). This paper presents a new combined model for predicting vehicle’s velocity time series. The main features of the model are to combine the feature extraction capability of deep restricted Boltzmann machines(DBM) and sequence pattern predicting capability of bidirectional long short-term memory(BLSTM). Hence, the model is named as DBMBLSTM. In addition, the DRMBLSTM model utilizes the vehicle driving information and roadside infrastructure information provided respectively through vehicle-to-vehicle(V2V) and vehicle-to-infrastructure(V2I) communication channels to predict vehicle velocity at various length of prediction horizon. Furthermore, the predictions results of this study are compared with the state of the art of vehicle velocity forecasts. The root mean square error(RMSE) is used as an evaluation criteria of predictions accuracy. Finally,these compared prediction model are applied in model predictive control(MPC) energy management strategy for the verifications of fuel economy improvement of a HEV. Simulation results confirm that the proposed combined deep learning model performs better than other five prediction methods. Therefore, it is a means of arriving at a reliable forecast model for HEV.展开更多
Sentence Boundary Disambiguation(SBD)is a preprocessing step for natural language processing.Segmenting text into sentences is essential for Deep Learning(DL)and pretraining language models.Tibetan punctuation marks m...Sentence Boundary Disambiguation(SBD)is a preprocessing step for natural language processing.Segmenting text into sentences is essential for Deep Learning(DL)and pretraining language models.Tibetan punctuation marks may involve ambiguity about the sentences’beginnings and endings.Hence,the ambiguous punctuation marks must be distinguished,and the sentence structure must be correctly encoded in language models.This study proposed a component-level Tibetan SBD approach based on the DL model.The models can reduce the error amplification caused by word segmentation and part-of-speech tagging.Although most SBD methods have only considered text on the left side of punctuation marks,this study considers the text on both sides.In this study,465669 Tibetan sentences are adopted,and a Bidirectional Long Short-Term Memory(Bi-LSTM)model is used to perform SBD.The experimental results show that the F1-score of the Bi-LSTM model reached 96%,the most efficient among the six models.Experiments are performed on low-resource languages such as Turkish and Romanian,and high-resource languages such as English and German,to verify the models’generalization.展开更多
基金supported by the National Key Research and Development Program of China(No.2021YFB2600300).
文摘Intelligent maintenance of roads and highways requires accurate deterioration evaluation and performance prediction of asphalt pavement.To this end,we develop a time series long short-term memory(LSTM)model to predict key performance indicators(PIs)of pavement,namely the international roughness index(IRI)and rutting depth(RD).Subsequently,we propose a comprehensive performance indicator for the pavement quality index(PQI),which leverages the highway performance assessment standard method,entropy weight method,and fuzzy comprehensive evaluation method.This indicator can evaluate the overall performance condition of the pavement.The data used for the model development and analysis are extracted from tests on two full-scale accelerated test tracks,called MnRoad and RIOHTrack.Six variables are used as predictors,including temperature,precipitation,total traffic volume,asphalt surface layer thickness,pavement age,and maintenance condition.Furthermore,wavelet denoising is performed to analyze the impact of missing or abnormal data on the LSTM model accuracy.In comparison to a traditional autoregressive integrated moving average(ARIMAX)model,the proposed LSTM model performs better in terms of PI prediction and resiliency to noise.Finally,the overall prediction accuracy of our proposed performance indicator PQI is 93.8%.
文摘Traffic flow prediction,as the basis of signal coordination and travel time prediction,has become a research point in the field of transportation.For traffic flow prediction,researchers have proposed a variety of methods,but most of these methods only use the time domain information of traffic flow data to predict the traffic flow,ignoring the impact of spatial correlation on the prediction of target road segment flow,which leads to poor prediction accuracy.In this paper,a traffic flow prediction model called as long short time memory and random forest(LSTM-RF)was proposed based on the combination model.In the process of traffic flow prediction,the long short time memory(LSTM)model was used to extract the time sequence features of the predicted target road segment.Then,the predicted value of LSTM and the collected information of adjacent upstream and downstream sections were simultaneously used as the input features of the random forest model to analyze the spatial-temporal correlation of traffic flow,so as to obtain the final prediction results.The traffic flow data of 132 urban road sections collected by the license plate recognition system in Guiyang City were tested and verified.The results show that the method is better than the single model in prediction accuracy,and the prediction error is obviously reduced compared with the single model.
文摘Determining which variables affect price realized volatility has always been challenging.This paper proposes to explain how financial assets influence realized volatility by developing an optimal day-to-day forecast.The methodological proposal is based on using the best econometric and machine learning models to forecast realized volatility.In particular,the best forecasting from heterogeneous autoregressive and long short-term memory models are used to determine the influence of the Standard and Poor’s 500 index,euro-US dollar exchange rate,price of gold,and price of Brent crude oil on the realized volatility of natural gas.These financial assets influenced the realized volatility of natural gas in 87.4% of the days analyzed;the euro-US dollar exchange rate was the primary financial asset and explained 40.1% of the influence.The results of the proposed daily analysis differed from those of the methodology used to study the entire period.The traditional model,which studies the entire period,cannot determine temporal effects,whereas the proposed methodology can.The proposed methodology allows us to distinguish the effects for each day,week,or month rather than averages for entire periods,with the flexibility to analyze different frequencies and periods.This methodological capability is key to analyzing influences and making decisions about realized volatility.
基金supported by the National Key R.D Program of China(2021YFB2401904)the Joint Fund project of the National Natural Science Foundation of China(U21A20485)+1 种基金the National Natural Science Foundation of China(61976175)the Key Laboratory Project of Shaanxi Provincial Education Department Scientific Research Projects(20JS109)。
文摘The state of charge(SOC)estimation of lithium-ion battery is an important function in the battery management system(BMS)of electric vehicles.The long short term memory(LSTM)model can be employed for SOC estimation,which is capable of estimating the future changing states of a nonlinear system.Since the BMS usually works under complicated operating conditions,i.e the real measurement data used for model training may be corrupted by non-Gaussian noise,and thus the performance of the original LSTM with the mean square error(MSE)loss may deteriorate.Therefore,a novel LSTM with mixture kernel mean p-power error(MKMPE)loss,called MKMPE-LSTM,is developed by using the MKMPE loss to replace the MSE as the learning criterion in LSTM framework,which can achieve robust SOC estimation under the measurement data contaminated with non-Gaussian noises(or outliers)because of the MKMPE containing the p-order moments of the error distribution.In addition,a meta-heuristic algorithm,called heap-based-optimizer(HBO),is employed to optimize the hyper-parameters(mainly including learning rate,number of hidden layer neuron and value of p in MKMPE)of the proposed MKMPE-LSTM model to further improve its flexibility and generalization performance,and a novel hybrid model(HBO-MKMPE-LSTM)is established for SOC estimation under non-Gaussian noise cases.Finally,several tests are performed under various cases through a benchmark to evaluate the performance of the proposed HBO-MKMPE-LSTM model,and the results demonstrate that the proposed hybrid method can provide a good robustness and accuracy under different non-Gaussian measurement noises,and the SOC estimation results in terms of mean square error(MSE),root MSE(RMSE),mean absolute relative error(MARE),and determination coefficient R2are less than 0.05%,3%,3%,and above 99.8%at 25℃,respectively.
文摘Objective: To predict the daily incidence and fatality rates based on long short-term memory(LSTM) in 4 age groups of COVID-19 patients in Mazandaran Province, Iran.Methods: To predict the daily incidence and fatality rates by age groups, this epidemiological study was conducted based on the LSTM model. All data of COVID-19 disease were collected daily for training the LSTM model from February 22, 2020 to April 10, 2021 in the Mazandaran University of Medical Sciences. We defined 4 age groups, i.e., patients under 29, between 30 and 49, between 50 and 59, and over 60 years old. Then, LSTM models were applied to predict the trend of daily incidence and fatality rates from 14 to 40 days in different age groups. The results of different methods were compared with each other.Results: This study evaluated 5 0826 patients and 5 109 deaths with COVID-19 daily in 20 cities of Mazandaran Province. Among the patients, 25 240 were females(49.7%), and 25 586 were males(50.3%). The predicted daily incidence rates on April 11, 2021 were 91.76, 155.84, 150.03, and 325.99 per 100 000 people, respectively;for the fourteenth day April 24, 2021, the predicted daily incidence rates were 35.91, 92.90, 83.74, and 225.68 in each group per 100 000 people. Furthermore, the predicted average daily incidence rates in 40 days for the 4 age groups were 34.25, 95.68, 76.43, and 210.80 per 100 000 people, and the daily fatality rates were 8.38, 4.18, 3.40, 22.53 per 100 000 people according to the established LSTM model. The findings demonstrated the daily incidence and fatality rates of 417.16 and 38.49 per 100 000 people for all age groups over the next 40 days. Conclusions: The results highlighted the proper performance of the LSTM model for predicting the daily incidence and fatality rates. It can clarify the path of spread or decline of the COVID-19 outbreak and the priority of vaccination in age groups.
基金supported by National Key R&D Program of China:[grant number 2017YFB0503605].
文摘Prompt and accurate traffic flow forecasting is a key foundation of urban traffic management.However,the flows in different areas and feature channels(inflow/outflow)may correspond to different degrees of importance in forecasting flows.Many forecasting models inadequately consider this heterogeneity,resulting in decreased predictive accuracy.To overcome this problem,an attention-based hybrid spatiotemporal residual model assisted by spatial and channel information is proposed in this study.By assigning different weights(attention levels)to different regions,the spatial attention module selects relatively important locations from all inputs in the modeling process.Similarly,the channel attention module selects relatively important channels from the multichannel feature map in the modeling process by assigning different weights.The proposed model provides effective selection and attention results for key areas and channels,respectively,during the forecasting process,thereby decreasing the computational overhead and increasing the accuracy.In the case involving Beijing,the proposed model exhibits a 3.7%lower prediction error,and its runtime is 60.9%less the model without attention,indicating that the spatial and channel attention modules are instrumental in increasing the forecasting efficiency.Moreover,in the case involving Shanghai,the proposed model outperforms other models in terms of generalizability and practicality.
基金supported by the National Natural Science Foundation of China(Grant No.61703318)Natural Science Foundation of Hubei Province(Grant No.2017CFB130)
文摘Vehicle velocity forecast is an important clue in improving the performance of energy management in hybrid electric vehicles(HEV). This paper presents a new combined model for predicting vehicle’s velocity time series. The main features of the model are to combine the feature extraction capability of deep restricted Boltzmann machines(DBM) and sequence pattern predicting capability of bidirectional long short-term memory(BLSTM). Hence, the model is named as DBMBLSTM. In addition, the DRMBLSTM model utilizes the vehicle driving information and roadside infrastructure information provided respectively through vehicle-to-vehicle(V2V) and vehicle-to-infrastructure(V2I) communication channels to predict vehicle velocity at various length of prediction horizon. Furthermore, the predictions results of this study are compared with the state of the art of vehicle velocity forecasts. The root mean square error(RMSE) is used as an evaluation criteria of predictions accuracy. Finally,these compared prediction model are applied in model predictive control(MPC) energy management strategy for the verifications of fuel economy improvement of a HEV. Simulation results confirm that the proposed combined deep learning model performs better than other five prediction methods. Therefore, it is a means of arriving at a reliable forecast model for HEV.
基金supported by the National Key R&D Program of China(No.2020YFC0832500)the Ministry of Education-China Mobile Research Foundation(No.MCM20170206)+5 种基金the Fundamental Research Funds for the Central Universities(Nos.lzujbky-2022-kb12,lzujbky-2021-sp43,lzujbky-2020-sp02,lzujbky-2019-kb51,and lzujbky-2018-k12)the National Natural Science Foundation of China(No.61402210)the Science and Technology Plan of Qinghai Province(No.2020-GX-164)the Google Research Awards and Google Faculty Award,the Provincial Science and Technology Plan(Major Science and Technology Projects-Open Solicitation)(No.22ZD6GA048)the Gansu Provincial Science and Technology Major Special Innovation Consortium Project(No.21ZD3GA002)the Gansu Province Green and Smart Highway Key Technology Research and Demonstration。
文摘Sentence Boundary Disambiguation(SBD)is a preprocessing step for natural language processing.Segmenting text into sentences is essential for Deep Learning(DL)and pretraining language models.Tibetan punctuation marks may involve ambiguity about the sentences’beginnings and endings.Hence,the ambiguous punctuation marks must be distinguished,and the sentence structure must be correctly encoded in language models.This study proposed a component-level Tibetan SBD approach based on the DL model.The models can reduce the error amplification caused by word segmentation and part-of-speech tagging.Although most SBD methods have only considered text on the left side of punctuation marks,this study considers the text on both sides.In this study,465669 Tibetan sentences are adopted,and a Bidirectional Long Short-Term Memory(Bi-LSTM)model is used to perform SBD.The experimental results show that the F1-score of the Bi-LSTM model reached 96%,the most efficient among the six models.Experiments are performed on low-resource languages such as Turkish and Romanian,and high-resource languages such as English and German,to verify the models’generalization.
