Temporal knowledge graph completion(TKGC),which merges temporal information into traditional static knowledge graph completion(SKGC),has garnered increasing attention recently.Among numerous emerging approaches,transl...Temporal knowledge graph completion(TKGC),which merges temporal information into traditional static knowledge graph completion(SKGC),has garnered increasing attention recently.Among numerous emerging approaches,translation-based embedding models constitute a prominent approach in TKGC research.However,existing translation-based methods typically incorporate timestamps into entities or relations,rather than utilizing them independently.This practice fails to fully exploit the rich semantics inherent in temporal information,thereby weakening the expressive capability of models.To address this limitation,we propose embedding timestamps,like entities and relations,in one or more dedicated semantic spaces.After projecting all embeddings into a shared space,we use the relation-timestamp pair instead of the conventional relation embedding as the translation vector between head and tail entities.Our method elevates timestamps to the same representational significance as entities and relations.Based on this strategy,we introduce two novel translation-based embedding models:TE-TransR and TE-TransT.With the independent representation of timestamps,our method not only enhances capabilities in link prediction but also facilitates a relatively underexplored task,namely time prediction.To further bolster the precision and reliability of time prediction,we introduce a granular,time unit-based timestamp setting and a relation-specific evaluation protocol.Extensive experiments demonstrate that our models achieve strong performance on link prediction benchmarks,with TE-TransR outperforming existing baselines in the time prediction task.展开更多
As a category of recurrent neural networks,echo state networks(ESNs)have been the topic of in-depth investigations and extensive applications in a diverse array of fields,with spectacular triumphs achieved.Nevertheles...As a category of recurrent neural networks,echo state networks(ESNs)have been the topic of in-depth investigations and extensive applications in a diverse array of fields,with spectacular triumphs achieved.Nevertheless,the traditional ESN and the majority of its variants are devised in the light of the second-order statistical information of data(e.g.,variance and covariance),while more information is neglected.In the context of information theoretic learning,correntropy demonstrates the capacity to grab more information from data.Therefore,under the guidelines of the maximum correntropy criterion,this paper proposes a correntropy-based echo state network(CESN)in which the first-order and higher-order information of data is captured,promoting robustness to noise.Furthermore,an incremental learning algorithm for the CESN is presented,which has the expertise to update the CESN when new data arrives,eliminating the need to retrain the network from scratch.Finally,experiments on benchmark problems and comparisons with existing works are provided to verify the effectiveness and superiority of the proposed CESN.展开更多
Accurate wind speed measurements on maritime vessels are crucial for weather forecasting,sea state prediction,and safe navigation.However,vessel motion and challenging environmental conditions often affect measurement...Accurate wind speed measurements on maritime vessels are crucial for weather forecasting,sea state prediction,and safe navigation.However,vessel motion and challenging environmental conditions often affect measurement precision.To address this issue,this study proposes an innovative framework for correcting and predicting shipborne wind speed.By integrating a main network with a momentum updating network,the proposed framework effectively extracts features from the time and frequency domains,thereby allowing for precise adjustments and predictions of shipborne wind speed data.Validation using real sensor data collected at the Qingdao Oceanographic Institute demonstrates that the proposed method outperforms existing approaches in single-and multi-step predictions compared to existing methods,achieving higher accuracy in wind speed forecasting.The proposed innovative approach offers a promising direction for future validation in more realistic maritime onboard scenarios.展开更多
Tunnel surrounding rock(TSR)deformation exhibits time-and space-dependent behavior,making it challenging for a single prediction model to capture these characteristics over extended periods.Utilizing 8 years of TSR de...Tunnel surrounding rock(TSR)deformation exhibits time-and space-dependent behavior,making it challenging for a single prediction model to capture these characteristics over extended periods.Utilizing 8 years of TSR deformation data from the Beishan exploration tunnel(BET)test platform,the metaheuristic algorithm crested porcupine optimizer(CPO)was applied for the first time to optimize the time series of TSR deformation,and an integrated model incorporating convolutional neural network(CNN),long short-term memory network(LSTM),and attention mechanism(ATT)was proposed.This model integrates the strong feature extraction capabilities of CNN,the superior sequence prediction performance of LSTM,and the effective attention mechanism of ATT.The results show that during blasting excavation,the internal displacement of TSR exhibits a stepwise change pattern.After excavation,the internal displacement enters a phase of gradual increase,ultimately reaching a stable convergence stage.The CPO-CNN-LSTM-ATT(CPO-CLA)integrated model demonstrated excellent predictive accuracy and stability across various evaluation metrics,achieving a determination coefficient(R^(2))of 0.985.Compared to the CNN-LSTM-ATT(CLA)model,the CPO-CLA model showed a 14.1%increase in R^(2),a 61.5%decrease in root mean square error(RMSE),and a 72.9%decrease in mean absolute error(MAE).In comparison with current mainstream metaheuristic integrated models,the CPO-CLA model is better suited for predicting long-term TSR deformation.It offers high computational efficiency,accurate predictions,and expertise in optimizing large datasets.展开更多
The uneven distribution of the temperature field in the track structure,caused by various meteorological factors such as extremely low temperatures and snowfall,leads to significant temperature loads and is the primar...The uneven distribution of the temperature field in the track structure,caused by various meteorological factors such as extremely low temperatures and snowfall,leads to significant temperature loads and is the primary cause of damage to China Railway Track System(CRTS)III ballastless tracks in cold regions during service.In this study,to predict the temperature of the track structure accurately,we analyzed meteorological data collected from Shenyang,China,and identified the factors that had the most effect on the track temperature field.We propose a temporal convolutional network(TCN)-based temperature field prediction model for ballastless tracks(TCN-Track model),which enhances the ability to extract and fuse local and global features from complex long-term meteorological data.The results indicate that the proposed TCN-Track model performs well in predicting track temperature fields from meteorological data,with a mean absolute error(MAE)ranging from 0.26 to 0.39,a root mean square error(RMSE)ranging from 0.32 to 0.50,and correlation coefficient(R)values ranging from 0.888 to 0.985.Compared with a long short-term memory(LSTM)model,the MAE of the TCN-Track model is reduced by 89.17%and the RMSE by 88.51%.This method offers a new solution for accurately predicting the temperature field of ballastless tracks in cold regions,aiding in predicting and preventing track damage caused by low temperatures.展开更多
A new method of predicting chaotic time series is presented based on a local Lyapunov exponent, by quantitatively measuring the exponential rate of separation or attraction of two infinitely close trajectories in stat...A new method of predicting chaotic time series is presented based on a local Lyapunov exponent, by quantitatively measuring the exponential rate of separation or attraction of two infinitely close trajectories in state space. After recon- structing state space from one-dimensional chaotic time series, neighboring multiple-state vectors of the predicting point are selected to deduce the prediction formula by using the definition of the locaI Lyapunov exponent. Numerical simulations are carded out to test its effectiveness and verify its higher precision over two older methods. The effects of the number of referential state vectors and added noise on forecasting accuracy are also studied numerically.展开更多
Time series prediction has been successfully used in several application areas, such as meteoro-logical forecasting, market prediction, network traffic forecasting, etc. , and a number of techniques have been develop...Time series prediction has been successfully used in several application areas, such as meteoro-logical forecasting, market prediction, network traffic forecasting, etc. , and a number of techniques have been developed for modeling and predicting time series. In the traditional exponential smoothing method, a fixed weight is assigned to data history, and the trend changes of time series are ignored. In this paper, an uncertainty reasoning method, based on cloud model, is employed in time series prediction, which uses cloud logic controller to adjust the smoothing coefficient of the simple exponential smoothing method dynamically to fit the current trend of the time series. The validity of this solution was proved by experiments on various data sets.展开更多
The chaotic characteristics and maximum predictable time scale of the observation series of hourly water consumption in Hangzhou were investigated using the advanced algorithm presented here is based on the convention...The chaotic characteristics and maximum predictable time scale of the observation series of hourly water consumption in Hangzhou were investigated using the advanced algorithm presented here is based on the conventional Wolf's algorithm for the largest Lyapunov exponent. For comparison, the largest Lyapunov exponents of water consumption series with one-hour and 24-hour intervals were calculated respectively. The results indicated that chaotic characteristics obviously exist in the hourly water consumption system; and that observation series with 24-hour interval have longer maximum predictable scale than hourly series. These findings could have significant practical application for better prediction of urban hourly water consumption.展开更多
Three functional models, polynomial, spectral analysis, and modified AR model, are studied and compared in fitting and predicting clock deviation based on the data sequence derived from two-way satellite time and freq...Three functional models, polynomial, spectral analysis, and modified AR model, are studied and compared in fitting and predicting clock deviation based on the data sequence derived from two-way satellite time and frequency transfer. A robust equivalent weight is applied, which controls the significant influence of outlying observations. Some conclusions show that the prediction precision of robust estimation is better than that of LS. The prediction precision calculated from smoothed observations is higher than that calculated from sampling observations. As a count of the obvious period variations in the clock deviation sequence, the predicted values of polynomial model are implausible. The prediction precision of spectral analysis model is very low, but the principal periods can be determined. The prediction RMS of 6-hour extrapolation interval is Ins or so, when modified AR model is used.展开更多
To investigate the travel time prediction method of the freeway, a model based on the gradient boosting decision tree (GBDT) is proposed. Eleven variables (namely, travel time in current period T i , traffic flow in c...To investigate the travel time prediction method of the freeway, a model based on the gradient boosting decision tree (GBDT) is proposed. Eleven variables (namely, travel time in current period T i , traffic flow in current period Q i , speed in current period V i , density in current period K i , the number of vehicles in current period N i , occupancy in current period R i , traffic state parameter in current period X i , travel time in previous time period T i -1 , etc.) are selected to predict the travel time for 10 min ahead in the proposed model. Data obtained from VISSIM simulation is used to train and test the model. The results demonstrate that the prediction error of the GBDT model is smaller than those of the back propagation (BP) neural network model and the support vector machine (SVM) model. Travel time in current period T i is the most important variable among all variables in the GBDT model. The GBDT model can produce more accurate prediction results and mine the hidden nonlinear relationships deeply between variables and the predicted travel time.展开更多
The accurate prediction of travel time along roadway provides valuable traffic information for travelers and traffic managers. Aiming at short-term travel time forecasting on urban arterials,a prediction model( PSOSVM...The accurate prediction of travel time along roadway provides valuable traffic information for travelers and traffic managers. Aiming at short-term travel time forecasting on urban arterials,a prediction model( PSOSVM) combining support vector machine( SVM) and particle swarm optimization( PSO) is developed. Travel time data collected with Bluetooth devices are used to calibrate the proposed model. Field experiments show that the PSO-SVM model 's error indicators are lower than the single SVM model and the BP neural network( BPNN) model. Particularly,the mean-absolute percentage error( MAPE) of PSO-SVM is only 9. 453 4 %which is less than that of the single SVM model( 12. 230 2 %) and the BPNN model( 15. 314 7 %). The results indicate that the proposed PSO-SVM model is feasible and more effective than other models for shortterm travel time prediction on urban arterials.展开更多
On the assumption that random interruptions in the observation process are modeled by a sequence of independent Bernoulli random variables, we firstly generalize two kinds of nonlinear filtering methods with random in...On the assumption that random interruptions in the observation process are modeled by a sequence of independent Bernoulli random variables, we firstly generalize two kinds of nonlinear filtering methods with random interruption failures in the observation based on the extended Kalman filtering （EKF） and the unscented Kalman filtering （UKF）, which were shortened as GEKF and CUKF in this paper, respectively. Then the nonlinear filtering model is established by using the radial basis function neural network （RBFNN） prototypes and the network weights as state equation and the output of RBFNN to present the observation equation. Finally, we take the filtering problem under missing observed data as a special case of nonlinear filtering with random intermittent failures by setting each missing data to be zero without needing to pre-estimate the missing data, and use the GEKF-based RBFNN and the GUKF-based RBFNN to predict the ground radioactivity time series with missing data. Experimental results demonstrate that the prediction results of GUKF-based RBFNN accord well with the real ground radioactivity time series while the prediction results of GEKF-based RBFNN are divergent.展开更多
The prediction methods and its applications of the nonlinear dynamic systems determined from chaotic time series of low-dimension are discussed mainly. Based on the work of the foreign researchers, the chaotic time se...The prediction methods and its applications of the nonlinear dynamic systems determined from chaotic time series of low-dimension are discussed mainly. Based on the work of the foreign researchers, the chaotic time series in the phase space adopting one kind of nonlinear chaotic model were reconstructed. At first, the model parameters were estimated by using the improved least square method. Then as the precision was satisfied, the optimization method was used to estimate these parameters. At the end by using the obtained chaotic model, the future data of the chaotic time series in the phase space was predicted. Some representative experimental examples were analyzed to testify the models and the algorithms developed in this paper. ne results show that if the algorithms developed here are adopted, the parameters of the corresponding chaotic model will be easily calculated well and true. Predictions of chaotic series in phase space make the traditional methods change from outer iteration to interpolations. And if the optimal model rank is chosen, the prediction precision will increase notably. Long term superior predictability of nonlinear chaotic models is proved to be irrational and unreasonable.展开更多
This study presents a time series prediction model with output self feedback which is implemented based on online sequential extreme learning machine. The output variables derived from multilayer perception can feedba...This study presents a time series prediction model with output self feedback which is implemented based on online sequential extreme learning machine. The output variables derived from multilayer perception can feedback to the network input layer to create a temporal relation between the current node inputs and the lagged node outputs while overcoming the limitation of memory which is a vital port for any time-series prediction application. The model can overcome the static prediction problem with most time series prediction models and can effectively cope with the dynamic properties of time series data. A linear and a nonlinear forecasting algorithms based on online extreme learning machine are proposed to implement the output feedback forecasting model. They are both recursive estimator and have two distinct phases： Predict and Update. The proposed model was tested against different kinds of time series data and the results indicate that the model outperforms the original static model without feedback.展开更多
It is crucial to predict the outputs of a thickening system,including the underflow concentration(UC)and mud pressure,for optimal control of the process.The proliferation of industrial sensors and the availability of ...It is crucial to predict the outputs of a thickening system,including the underflow concentration(UC)and mud pressure,for optimal control of the process.The proliferation of industrial sensors and the availability of thickening-system data make this possible.However,the unique properties of thickening systems,such as the non-linearities,long-time delays,partially observed data,and continuous time evolution pose challenges on building data-driven predictive models.To address the above challenges,we establish an integrated,deep-learning,continuous time network structure that consists of a sequential encoder,a state decoder,and a derivative module to learn the deterministic state space model from thickening systems.Using a case study,we examine our methods with a tailing thickener manufactured by the FLSmidth installed with massive sensors and obtain extensive experimental results.The results demonstrate that the proposed continuous-time model with the sequential encoder achieves better prediction performances than the existing discrete-time models and reduces the negative effects from long time delays by extracting features from historical system trajectories.The proposed method also demonstrates outstanding performances for both short and long term prediction tasks with the two proposed derivative types.展开更多
Deficiencies of applying the traditional least squares support vector machine （LS-SVM） to time series online prediction were specified. According to the kernel function matrix＇s property and using the recursive cal...Deficiencies of applying the traditional least squares support vector machine （LS-SVM） to time series online prediction were specified. According to the kernel function matrix＇s property and using the recursive calculation of block matrix, a new time series online prediction algorithm based on improved LS-SVM was proposed. The historical training results were fully utilized and the computing speed of LS-SVM was enhanced. Then, the improved algorithm was applied to timc series online prediction. Based on the operational data provided by the Northwest Power Grid of China, the method was used in the transient stability prediction of electric power system. The results show that, compared with the calculation time of the traditional LS-SVM（75 1 600 ms）, that of the proposed method in different time windows is 40-60 ms, proposed method is above 0.8. So the improved method is online prediction. and the prediction accuracy（normalized root mean squared error） of the better than the traditional LS-SVM and more suitable for time series online prediction.展开更多
Support vector machines （SVM） have been widely used in chaotic time series predictions in recent years. In order to enhance the prediction efficiency of this method and implement it in hardware, the sigmoid kernel i...Support vector machines （SVM） have been widely used in chaotic time series predictions in recent years. In order to enhance the prediction efficiency of this method and implement it in hardware, the sigmoid kernel in SVM is drawn in a more natural way by using the fuzzy logic method proposed in this paper. This method provides easy hardware implementation and straightforward interpretability. Experiments on two typical chaotic time series predictions have been carried out and the obtained results show that the average CPU time can be reduced significantly at the cost of a small decrease in prediction accuracy, which is favourable for the hardware implementation for chaotic time series prediction.展开更多
How to predict the bus arrival time accurately is a crucial problem to be solved in Internet of Vehicle. Existed methods cannot solve the problem effectively for ignoring the traffic delay jitter. In this paper,a thre...How to predict the bus arrival time accurately is a crucial problem to be solved in Internet of Vehicle. Existed methods cannot solve the problem effectively for ignoring the traffic delay jitter. In this paper,a three-stage mixed model is proposed for bus arrival time prediction. The first stage is pattern training. In this stage,the traffic delay jitter patterns(TDJP)are mined by K nearest neighbor and K-means in the historical traffic time data. The second stage is the single-step prediction,which is based on real-time adjusted Kalman filter with a modification of historical TDJP. In the third stage,as the influence of historical law is increasing in long distance prediction,we combine the single-step prediction dynamically with Markov historical transfer model to conduct the multi-step prediction. The experimental results show that the proposed single-step prediction model performs better in accuracy and efficiency than short-term traffic flow prediction and dynamic Kalman filter. The multi-step prediction provides a higher level veracity and reliability in travel time forecasting than short-term traffic flow and historical traffic pattern prediction models.展开更多
Historically,landslides have been the primary type of geological disaster worldwide.Generally,the stability of reservoir banks is primarily affected by rainfall and reservoir water level fluctuations.Moreover,the stab...Historically,landslides have been the primary type of geological disaster worldwide.Generally,the stability of reservoir banks is primarily affected by rainfall and reservoir water level fluctuations.Moreover,the stability of reservoir banks changes with the long-term dynamics of external disastercausing factors.Thus,assessing the time-varying reliability of reservoir landslides remains a challenge.In this paper,a machine learning(ML)based approach is proposed to analyze the long-term reliability of reservoir bank landslides in spatially variable soils through time series prediction.This study systematically investigated the prediction performances of three ML algorithms,i.e.multilayer perceptron(MLP),convolutional neural network(CNN),and long short-term memory(LSTM).Additionally,the effects of the data quantity and data ratio on the predictive power of deep learning models are considered.The results show that all three ML models can accurately depict the changes in the time-varying failure probability of reservoir landslides.The CNN model outperforms both the MLP and LSTM models in predicting the failure probability.Furthermore,selecting the right data ratio can improve the prediction accuracy of the failure probability obtained by ML models.展开更多
In order to study dynamic laws of surface movements over coal mines due to mining activities,a dynamic prediction model of surface movements was established,based on the theory of support vector machines(SVM) and time...In order to study dynamic laws of surface movements over coal mines due to mining activities,a dynamic prediction model of surface movements was established,based on the theory of support vector machines(SVM) and times-series analysis.An engineering application was used to verify the correctness of the model.Measurements from observation stations were analyzed and processed to obtain equal-time interval surface movement data and subjected to tests of stationary,zero means and normality.Then the data were used to train the SVM model.A time series model was established to predict mining subsidence by rational choices of embedding dimensions and SVM parameters.MAPE and WIA were used as indicators to evaluate the accuracy of the model and for generalization performance.In the end,the model was used to predict future surface movements.Data from observation stations in Huaibei coal mining area were used as an example.The results show that the maximum absolute error of subsidence is 9 mm,the maximum relative error 1.5%,the maximum absolute error of displacement 7 mm and the maximum relative error 1.8%.The accuracy and reliability of the model meet the requirements of on-site engineering.The results of the study provide a new approach to investigate the dynamics of surface movements.展开更多
基金supported by the National Natural Science Foundation of China under Grant No.72293575.
文摘Temporal knowledge graph completion(TKGC),which merges temporal information into traditional static knowledge graph completion(SKGC),has garnered increasing attention recently.Among numerous emerging approaches,translation-based embedding models constitute a prominent approach in TKGC research.However,existing translation-based methods typically incorporate timestamps into entities or relations,rather than utilizing them independently.This practice fails to fully exploit the rich semantics inherent in temporal information,thereby weakening the expressive capability of models.To address this limitation,we propose embedding timestamps,like entities and relations,in one or more dedicated semantic spaces.After projecting all embeddings into a shared space,we use the relation-timestamp pair instead of the conventional relation embedding as the translation vector between head and tail entities.Our method elevates timestamps to the same representational significance as entities and relations.Based on this strategy,we introduce two novel translation-based embedding models:TE-TransR and TE-TransT.With the independent representation of timestamps,our method not only enhances capabilities in link prediction but also facilitates a relatively underexplored task,namely time prediction.To further bolster the precision and reliability of time prediction,we introduce a granular,time unit-based timestamp setting and a relation-specific evaluation protocol.Extensive experiments demonstrate that our models achieve strong performance on link prediction benchmarks,with TE-TransR outperforming existing baselines in the time prediction task.
基金supported in part by the National Natural Science Foundation of China(62176109,62476115)the Fundamental Research Funds for the Central Universities(lzujbky-2023-ey07,lzujbky-2023-it14)+1 种基金the Natural Science Foundation of Gansu Province(24JRRA488)the Supercomputing Center of Lanzhou University
文摘As a category of recurrent neural networks,echo state networks(ESNs)have been the topic of in-depth investigations and extensive applications in a diverse array of fields,with spectacular triumphs achieved.Nevertheless,the traditional ESN and the majority of its variants are devised in the light of the second-order statistical information of data(e.g.,variance and covariance),while more information is neglected.In the context of information theoretic learning,correntropy demonstrates the capacity to grab more information from data.Therefore,under the guidelines of the maximum correntropy criterion,this paper proposes a correntropy-based echo state network(CESN)in which the first-order and higher-order information of data is captured,promoting robustness to noise.Furthermore,an incremental learning algorithm for the CESN is presented,which has the expertise to update the CESN when new data arrives,eliminating the need to retrain the network from scratch.Finally,experiments on benchmark problems and comparisons with existing works are provided to verify the effectiveness and superiority of the proposed CESN.
基金supported by the Major Innovation Project for the Integration of Science,Education,and Industry of Qilu University of Technology(Shandong Academy of Sciences)(Nos.2023HYZX01,2023JBZ02)the Open Project of Key Laboratory of Computing Power Network and Information Security,Ministry of Education,Qilu University of Technology(Shandong Academy of Sciences)(No.2023ZD007)+2 种基金the Talent Research Projects of Qilu University of Technology(Shandong Academy of Sciences)(No.2023RCKY136)the Technology and Innovation Major Project of the Ministry of Science and Technology of China(No.2022ZD0118600)the Jinan‘20 New Colleges and Universities’Funded Project(No.202333043)。
文摘Accurate wind speed measurements on maritime vessels are crucial for weather forecasting,sea state prediction,and safe navigation.However,vessel motion and challenging environmental conditions often affect measurement precision.To address this issue,this study proposes an innovative framework for correcting and predicting shipborne wind speed.By integrating a main network with a momentum updating network,the proposed framework effectively extracts features from the time and frequency domains,thereby allowing for precise adjustments and predictions of shipborne wind speed data.Validation using real sensor data collected at the Qingdao Oceanographic Institute demonstrates that the proposed method outperforms existing approaches in single-and multi-step predictions compared to existing methods,achieving higher accuracy in wind speed forecasting.The proposed innovative approach offers a promising direction for future validation in more realistic maritime onboard scenarios.
基金supported by the China Atomic Energy Authority(CAEA)for China’s URL Development Program and the Geological Disposal Program(Grant No.FZ2105)the National Natural Science Foundation of China(Grant No.52278420).
文摘Tunnel surrounding rock(TSR)deformation exhibits time-and space-dependent behavior,making it challenging for a single prediction model to capture these characteristics over extended periods.Utilizing 8 years of TSR deformation data from the Beishan exploration tunnel(BET)test platform,the metaheuristic algorithm crested porcupine optimizer(CPO)was applied for the first time to optimize the time series of TSR deformation,and an integrated model incorporating convolutional neural network(CNN),long short-term memory network(LSTM),and attention mechanism(ATT)was proposed.This model integrates the strong feature extraction capabilities of CNN,the superior sequence prediction performance of LSTM,and the effective attention mechanism of ATT.The results show that during blasting excavation,the internal displacement of TSR exhibits a stepwise change pattern.After excavation,the internal displacement enters a phase of gradual increase,ultimately reaching a stable convergence stage.The CPO-CNN-LSTM-ATT(CPO-CLA)integrated model demonstrated excellent predictive accuracy and stability across various evaluation metrics,achieving a determination coefficient(R^(2))of 0.985.Compared to the CNN-LSTM-ATT(CLA)model,the CPO-CLA model showed a 14.1%increase in R^(2),a 61.5%decrease in root mean square error(RMSE),and a 72.9%decrease in mean absolute error(MAE).In comparison with current mainstream metaheuristic integrated models,the CPO-CLA model is better suited for predicting long-term TSR deformation.It offers high computational efficiency,accurate predictions,and expertise in optimizing large datasets.
基金supported by the National Natural Science Foundation of China(Nos.52278461,52308467,and 52425213).
文摘The uneven distribution of the temperature field in the track structure,caused by various meteorological factors such as extremely low temperatures and snowfall,leads to significant temperature loads and is the primary cause of damage to China Railway Track System(CRTS)III ballastless tracks in cold regions during service.In this study,to predict the temperature of the track structure accurately,we analyzed meteorological data collected from Shenyang,China,and identified the factors that had the most effect on the track temperature field.We propose a temporal convolutional network(TCN)-based temperature field prediction model for ballastless tracks(TCN-Track model),which enhances the ability to extract and fuse local and global features from complex long-term meteorological data.The results indicate that the proposed TCN-Track model performs well in predicting track temperature fields from meteorological data,with a mean absolute error(MAE)ranging from 0.26 to 0.39,a root mean square error(RMSE)ranging from 0.32 to 0.50,and correlation coefficient(R)values ranging from 0.888 to 0.985.Compared with a long short-term memory(LSTM)model,the MAE of the TCN-Track model is reduced by 89.17%and the RMSE by 88.51%.This method offers a new solution for accurately predicting the temperature field of ballastless tracks in cold regions,aiding in predicting and preventing track damage caused by low temperatures.
基金Project supported by the National Natural Science Foundation of China (Grant No. 61201452)
文摘A new method of predicting chaotic time series is presented based on a local Lyapunov exponent, by quantitatively measuring the exponential rate of separation or attraction of two infinitely close trajectories in state space. After recon- structing state space from one-dimensional chaotic time series, neighboring multiple-state vectors of the predicting point are selected to deduce the prediction formula by using the definition of the locaI Lyapunov exponent. Numerical simulations are carded out to test its effectiveness and verify its higher precision over two older methods. The effects of the number of referential state vectors and added noise on forecasting accuracy are also studied numerically.
文摘Time series prediction has been successfully used in several application areas, such as meteoro-logical forecasting, market prediction, network traffic forecasting, etc. , and a number of techniques have been developed for modeling and predicting time series. In the traditional exponential smoothing method, a fixed weight is assigned to data history, and the trend changes of time series are ignored. In this paper, an uncertainty reasoning method, based on cloud model, is employed in time series prediction, which uses cloud logic controller to adjust the smoothing coefficient of the simple exponential smoothing method dynamically to fit the current trend of the time series. The validity of this solution was proved by experiments on various data sets.
基金Project (No. 50078048) supported by the National Natural Science Foundation of China
文摘The chaotic characteristics and maximum predictable time scale of the observation series of hourly water consumption in Hangzhou were investigated using the advanced algorithm presented here is based on the conventional Wolf's algorithm for the largest Lyapunov exponent. For comparison, the largest Lyapunov exponents of water consumption series with one-hour and 24-hour intervals were calculated respectively. The results indicated that chaotic characteristics obviously exist in the hourly water consumption system; and that observation series with 24-hour interval have longer maximum predictable scale than hourly series. These findings could have significant practical application for better prediction of urban hourly water consumption.
基金Supported by the National Natural Science Foundations of China （No. 40474001, No. 40274002, No. 40604003）.
文摘Three functional models, polynomial, spectral analysis, and modified AR model, are studied and compared in fitting and predicting clock deviation based on the data sequence derived from two-way satellite time and frequency transfer. A robust equivalent weight is applied, which controls the significant influence of outlying observations. Some conclusions show that the prediction precision of robust estimation is better than that of LS. The prediction precision calculated from smoothed observations is higher than that calculated from sampling observations. As a count of the obvious period variations in the clock deviation sequence, the predicted values of polynomial model are implausible. The prediction precision of spectral analysis model is very low, but the principal periods can be determined. The prediction RMS of 6-hour extrapolation interval is Ins or so, when modified AR model is used.
基金The National Natural Science Foundation of China(No.51478114,51778136)
文摘To investigate the travel time prediction method of the freeway, a model based on the gradient boosting decision tree (GBDT) is proposed. Eleven variables (namely, travel time in current period T i , traffic flow in current period Q i , speed in current period V i , density in current period K i , the number of vehicles in current period N i , occupancy in current period R i , traffic state parameter in current period X i , travel time in previous time period T i -1 , etc.) are selected to predict the travel time for 10 min ahead in the proposed model. Data obtained from VISSIM simulation is used to train and test the model. The results demonstrate that the prediction error of the GBDT model is smaller than those of the back propagation (BP) neural network model and the support vector machine (SVM) model. Travel time in current period T i is the most important variable among all variables in the GBDT model. The GBDT model can produce more accurate prediction results and mine the hidden nonlinear relationships deeply between variables and the predicted travel time.
基金Sponsored by the National Natural Science Foundation of China(Grant No.71101109)
文摘The accurate prediction of travel time along roadway provides valuable traffic information for travelers and traffic managers. Aiming at short-term travel time forecasting on urban arterials,a prediction model( PSOSVM) combining support vector machine( SVM) and particle swarm optimization( PSO) is developed. Travel time data collected with Bluetooth devices are used to calibrate the proposed model. Field experiments show that the PSO-SVM model 's error indicators are lower than the single SVM model and the BP neural network( BPNN) model. Particularly,the mean-absolute percentage error( MAPE) of PSO-SVM is only 9. 453 4 %which is less than that of the single SVM model( 12. 230 2 %) and the BPNN model( 15. 314 7 %). The results indicate that the proposed PSO-SVM model is feasible and more effective than other models for shortterm travel time prediction on urban arterials.
基金Project supported by the State Key Program of the National Natural Science of China (Grant No. 60835004)the Natural Science Foundation of Jiangsu Province of China (Grant No. BK2009727)+1 种基金the Natural Science Foundation of Higher Education Institutions of Jiangsu Province of China (Grant No. 10KJB510004)the National Natural Science Foundation of China (Grant No. 61075028)
文摘On the assumption that random interruptions in the observation process are modeled by a sequence of independent Bernoulli random variables, we firstly generalize two kinds of nonlinear filtering methods with random interruption failures in the observation based on the extended Kalman filtering （EKF） and the unscented Kalman filtering （UKF）, which were shortened as GEKF and CUKF in this paper, respectively. Then the nonlinear filtering model is established by using the radial basis function neural network （RBFNN） prototypes and the network weights as state equation and the output of RBFNN to present the observation equation. Finally, we take the filtering problem under missing observed data as a special case of nonlinear filtering with random intermittent failures by setting each missing data to be zero without needing to pre-estimate the missing data, and use the GEKF-based RBFNN and the GUKF-based RBFNN to predict the ground radioactivity time series with missing data. Experimental results demonstrate that the prediction results of GUKF-based RBFNN accord well with the real ground radioactivity time series while the prediction results of GEKF-based RBFNN are divergent.
文摘The prediction methods and its applications of the nonlinear dynamic systems determined from chaotic time series of low-dimension are discussed mainly. Based on the work of the foreign researchers, the chaotic time series in the phase space adopting one kind of nonlinear chaotic model were reconstructed. At first, the model parameters were estimated by using the improved least square method. Then as the precision was satisfied, the optimization method was used to estimate these parameters. At the end by using the obtained chaotic model, the future data of the chaotic time series in the phase space was predicted. Some representative experimental examples were analyzed to testify the models and the algorithms developed in this paper. ne results show that if the algorithms developed here are adopted, the parameters of the corresponding chaotic model will be easily calculated well and true. Predictions of chaotic series in phase space make the traditional methods change from outer iteration to interpolations. And if the optimal model rank is chosen, the prediction precision will increase notably. Long term superior predictability of nonlinear chaotic models is proved to be irrational and unreasonable.
基金Foundation item： the National Natural Science Foundation of China （No. 61203337）
文摘This study presents a time series prediction model with output self feedback which is implemented based on online sequential extreme learning machine. The output variables derived from multilayer perception can feedback to the network input layer to create a temporal relation between the current node inputs and the lagged node outputs while overcoming the limitation of memory which is a vital port for any time-series prediction application. The model can overcome the static prediction problem with most time series prediction models and can effectively cope with the dynamic properties of time series data. A linear and a nonlinear forecasting algorithms based on online extreme learning machine are proposed to implement the output feedback forecasting model. They are both recursive estimator and have two distinct phases： Predict and Update. The proposed model was tested against different kinds of time series data and the results indicate that the model outperforms the original static model without feedback.
基金supported by National Key Research and Development Program of China(2019YFC0605300)the National Natural Science Foundation of China(61873299,61902022,61972028)+2 种基金Scientific and Technological Innovation Foundation of Shunde Graduate School,University of Science and Technology Beijing(BK21BF002)Macao Science and Technology Development Fund under Macao Funding Scheme for Key R&D Projects(0025/2019/AKP)Macao Science and Technology Development Fund(0015/2020/AMJ)。
文摘It is crucial to predict the outputs of a thickening system,including the underflow concentration(UC)and mud pressure,for optimal control of the process.The proliferation of industrial sensors and the availability of thickening-system data make this possible.However,the unique properties of thickening systems,such as the non-linearities,long-time delays,partially observed data,and continuous time evolution pose challenges on building data-driven predictive models.To address the above challenges,we establish an integrated,deep-learning,continuous time network structure that consists of a sequential encoder,a state decoder,and a derivative module to learn the deterministic state space model from thickening systems.Using a case study,we examine our methods with a tailing thickener manufactured by the FLSmidth installed with massive sensors and obtain extensive experimental results.The results demonstrate that the proposed continuous-time model with the sequential encoder achieves better prediction performances than the existing discrete-time models and reduces the negative effects from long time delays by extracting features from historical system trajectories.The proposed method also demonstrates outstanding performances for both short and long term prediction tasks with the two proposed derivative types.
基金Project (SGKJ[200301-16]) supported by the State Grid Cooperation of China
文摘Deficiencies of applying the traditional least squares support vector machine （LS-SVM） to time series online prediction were specified. According to the kernel function matrix＇s property and using the recursive calculation of block matrix, a new time series online prediction algorithm based on improved LS-SVM was proposed. The historical training results were fully utilized and the computing speed of LS-SVM was enhanced. Then, the improved algorithm was applied to timc series online prediction. Based on the operational data provided by the Northwest Power Grid of China, the method was used in the transient stability prediction of electric power system. The results show that, compared with the calculation time of the traditional LS-SVM（75 1 600 ms）, that of the proposed method in different time windows is 40-60 ms, proposed method is above 0.8. So the improved method is online prediction. and the prediction accuracy（normalized root mean squared error） of the better than the traditional LS-SVM and more suitable for time series online prediction.
文摘Support vector machines （SVM） have been widely used in chaotic time series predictions in recent years. In order to enhance the prediction efficiency of this method and implement it in hardware, the sigmoid kernel in SVM is drawn in a more natural way by using the fuzzy logic method proposed in this paper. This method provides easy hardware implementation and straightforward interpretability. Experiments on two typical chaotic time series predictions have been carried out and the obtained results show that the average CPU time can be reduced significantly at the cost of a small decrease in prediction accuracy, which is favourable for the hardware implementation for chaotic time series prediction.
基金National Science and Technology Major Project(2016ZX03001025-003)Special Found for Beijing Common Construction Project
文摘How to predict the bus arrival time accurately is a crucial problem to be solved in Internet of Vehicle. Existed methods cannot solve the problem effectively for ignoring the traffic delay jitter. In this paper,a three-stage mixed model is proposed for bus arrival time prediction. The first stage is pattern training. In this stage,the traffic delay jitter patterns(TDJP)are mined by K nearest neighbor and K-means in the historical traffic time data. The second stage is the single-step prediction,which is based on real-time adjusted Kalman filter with a modification of historical TDJP. In the third stage,as the influence of historical law is increasing in long distance prediction,we combine the single-step prediction dynamically with Markov historical transfer model to conduct the multi-step prediction. The experimental results show that the proposed single-step prediction model performs better in accuracy and efficiency than short-term traffic flow prediction and dynamic Kalman filter. The multi-step prediction provides a higher level veracity and reliability in travel time forecasting than short-term traffic flow and historical traffic pattern prediction models.
基金supported by the National Natural Science Foundation of China(Grant No.52308340)the Innovative Projects of Universities in Guangdong(Grant No.2022KTSCX208)Sichuan Transportation Science and Technology Project(Grant No.2018-ZL-01).
文摘Historically,landslides have been the primary type of geological disaster worldwide.Generally,the stability of reservoir banks is primarily affected by rainfall and reservoir water level fluctuations.Moreover,the stability of reservoir banks changes with the long-term dynamics of external disastercausing factors.Thus,assessing the time-varying reliability of reservoir landslides remains a challenge.In this paper,a machine learning(ML)based approach is proposed to analyze the long-term reliability of reservoir bank landslides in spatially variable soils through time series prediction.This study systematically investigated the prediction performances of three ML algorithms,i.e.multilayer perceptron(MLP),convolutional neural network(CNN),and long short-term memory(LSTM).Additionally,the effects of the data quantity and data ratio on the predictive power of deep learning models are considered.The results show that all three ML models can accurately depict the changes in the time-varying failure probability of reservoir landslides.The CNN model outperforms both the MLP and LSTM models in predicting the failure probability.Furthermore,selecting the right data ratio can improve the prediction accuracy of the failure probability obtained by ML models.
基金supported by the Research and Innovation Program for College and University Graduate Students in Jiangsu Province (No.CX10B-141Z)the National Natural Science Foundation of China (No. 41071273)
文摘In order to study dynamic laws of surface movements over coal mines due to mining activities,a dynamic prediction model of surface movements was established,based on the theory of support vector machines(SVM) and times-series analysis.An engineering application was used to verify the correctness of the model.Measurements from observation stations were analyzed and processed to obtain equal-time interval surface movement data and subjected to tests of stationary,zero means and normality.Then the data were used to train the SVM model.A time series model was established to predict mining subsidence by rational choices of embedding dimensions and SVM parameters.MAPE and WIA were used as indicators to evaluate the accuracy of the model and for generalization performance.In the end,the model was used to predict future surface movements.Data from observation stations in Huaibei coal mining area were used as an example.The results show that the maximum absolute error of subsidence is 9 mm,the maximum relative error 1.5%,the maximum absolute error of displacement 7 mm and the maximum relative error 1.8%.The accuracy and reliability of the model meet the requirements of on-site engineering.The results of the study provide a new approach to investigate the dynamics of surface movements.
