With the rapid development of mechanical equipment, the mechanical health monitoring field has entered the era of big data. However, the method of manual feature extraction has the disadvantages of low efficiency and ...With the rapid development of mechanical equipment, the mechanical health monitoring field has entered the era of big data. However, the method of manual feature extraction has the disadvantages of low efficiency and poor accuracy, when handling big data. In this study, the research object was the asynchronous motor in the drivetrain diagnostics simulator system. The vibration signals of different fault motors were collected. The raw signal was pretreated using short time Fourier transform （STFT） to obtain the corresponding time-frequency map. Then, the feature of the time-frequency map was adap- tively extracted by using a convolutional neural network （CNN）. The effects of the pretreatment method, and the hyper parameters of network diagnostic accuracy, were investigated experimentally. The experimental results showed that the influence of the preprocessing method is small, and that the batch-size is the main factor affecting accuracy and training efficiency. By investigating feature visualization, it was shown that, in the case of big data, the extracted CNN features can represent complex mapping relationships between signal and health status, and can also overcome the prior knowledge and engineering experience requirement for feature extraction, which is used by tra- ditional diagnosis methods. This paper proposes a new method, based on STFT and CNN, which can complete motor fault diagnosis tasks more intelligently and accurately.展开更多
One of the technical bottlenecks of traditional laser-induced breakdown spectroscopy(LIBS) is the difficulty in quantitative detection caused by the matrix effect. To troubleshoot this problem,this paper investigated ...One of the technical bottlenecks of traditional laser-induced breakdown spectroscopy(LIBS) is the difficulty in quantitative detection caused by the matrix effect. To troubleshoot this problem,this paper investigated a combination of time-resolved LIBS and convolutional neural networks(CNNs) to improve K determination in soil. The time-resolved LIBS contained the information of both wavelength and time dimension. The spectra of wavelength dimension showed the characteristic emission lines of elements, and those of time dimension presented the plasma decay trend. The one-dimensional data of LIBS intensity from the emission line at 766.49 nm were extracted and correlated with the K concentration, showing a poor correlation of R_c^2?=?0.0967, which is caused by the matrix effect of heterogeneous soil. For the wavelength dimension, the two-dimensional data of traditional integrated LIBS were extracted and analyzed by an artificial neural network(ANN), showing R_v^2?=?0.6318 and the root mean square error of validation(RMSEV)?=?0.6234. For the time dimension, the two-dimensional data of time-decay LIBS were extracted and analyzed by ANN, showing R_v^2?=?0.7366 and RMSEV?=?0.7855.These higher determination coefficients reveal that both the non-K emission lines of wavelength dimension and the spectral decay of time dimension could assist in quantitative detection of K.However, due to limited calibration samples, the two-dimensional models presented over-fitting.The three-dimensional data of time-resolved LIBS were analyzed by CNNs, which extracted and integrated the information of both the wavelength and time dimension, showing the R_v^2?=?0.9968 and RMSEV?=?0.0785. CNN analysis of time-resolved LIBS is capable of improving the determination of K in soil.展开更多
Time series forecasting plays an important role in various fields, such as energy, finance, transport, and weather. Temporal convolutional networks (TCNs) based on dilated causal convolution have been widely used in t...Time series forecasting plays an important role in various fields, such as energy, finance, transport, and weather. Temporal convolutional networks (TCNs) based on dilated causal convolution have been widely used in time series forecasting. However, two problems weaken the performance of TCNs. One is that in dilated casual convolution, causal convolution leads to the receptive fields of outputs being concentrated in the earlier part of the input sequence, whereas the recent input information will be severely lost. The other is that the distribution shift problem in time series has not been adequately solved. To address the first problem, we propose a subsequence-based dilated convolution method (SDC). By using multiple convolutional filters to convolve elements of neighboring subsequences, the method extracts temporal features from a growing receptive field via a growing subsequence rather than a single element. Ultimately, the receptive field of each output element can cover the whole input sequence. To address the second problem, we propose a difference and compensation method (DCM). The method reduces the discrepancies between and within the input sequences by difference operations and then compensates the outputs for the information lost due to difference operations. Based on SDC and DCM, we further construct a temporal subsequence-based convolutional network with difference (TSCND) for time series forecasting. The experimental results show that TSCND can reduce prediction mean squared error by 7.3% and save runtime, compared with state-of-the-art models and vanilla TCN.展开更多
The prediction for Multivariate Time Series(MTS)explores the interrelationships among variables at historical moments,extracts their relevant characteristics,and is widely used in finance,weather,complex industries an...The prediction for Multivariate Time Series(MTS)explores the interrelationships among variables at historical moments,extracts their relevant characteristics,and is widely used in finance,weather,complex industries and other fields.Furthermore,it is important to construct a digital twin system.However,existing methods do not take full advantage of the potential properties of variables,which results in poor predicted accuracy.In this paper,we propose the Adaptive Fused Spatial-Temporal Graph Convolutional Network(AFSTGCN).First,to address the problem of the unknown spatial-temporal structure,we construct the Adaptive Fused Spatial-Temporal Graph(AFSTG)layer.Specifically,we fuse the spatial-temporal graph based on the interrelationship of spatial graphs.Simultaneously,we construct the adaptive adjacency matrix of the spatial-temporal graph using node embedding methods.Subsequently,to overcome the insufficient extraction of disordered correlation features,we construct the Adaptive Fused Spatial-Temporal Graph Convolutional(AFSTGC)module.The module forces the reordering of disordered temporal,spatial and spatial-temporal dependencies into rule-like data.AFSTGCN dynamically and synchronously acquires potential temporal,spatial and spatial-temporal correlations,thereby fully extracting rich hierarchical feature information to enhance the predicted accuracy.Experiments on different types of MTS datasets demonstrate that the model achieves state-of-the-art single-step and multi-step performance compared with eight other deep learning models.展开更多
Since the oil production of single well in water flooding reservoir varies greatly and is hard to predict, an oil production prediction method of single well based on temporal convolutional network(TCN) is proposed an...Since the oil production of single well in water flooding reservoir varies greatly and is hard to predict, an oil production prediction method of single well based on temporal convolutional network(TCN) is proposed and verified. This method is started from data processing, the correspondence between water injectors and oil producers is determined according to the influence radius of the water injectors, the influence degree of a water injector on an oil producer in the month concerned is added as a model feature, and a Random Forest(RF) model is built to fill the dynamic data of water flooding. The single well history is divided into 4 stages according to its water cut, that is, low water cut, middle water cut, high water cut and extra-high water cut stages. In each stage, a TCN based prediction model is established, hyperparameters of the model are optimized by the Sparrow Search Algorithm(SSA). Finally, the models of the 4 stages are integrated into one whole-life model of the well for production prediction. The application of this method in Daqing Oilfield, NE China shows that:(1) Compared with conventional data processing methods, the data obtained by this processing method are more close to the actual production, and the data set obtained is more authentic and complete.(2) The TCN model has higher prediction accuracy than other 11 models such as Long Short Term Memory(LSTM).(3) Compared with the conventional full-life-cycle models, the model of integrated stages can significantly reduce the error of production prediction.展开更多
In order to directly construct the mapping between multiple state parameters and remaining useful life(RUL),and reduce the interference of random error on prediction accuracy,a RUL prediction model of aeroengine based...In order to directly construct the mapping between multiple state parameters and remaining useful life(RUL),and reduce the interference of random error on prediction accuracy,a RUL prediction model of aeroengine based on principal component analysis(PCA)and one-dimensional convolution neural network(1D-CNN)is proposed in this paper.Firstly,multiple state parameters corresponding to massive cycles of aeroengine are collected and brought into PCA for dimensionality reduction,and principal components are extracted for further time series prediction.Secondly,the 1D-CNN model is constructed to directly study the mapping between principal components and RUL.Multiple convolution and pooling operations are applied for deep feature extraction,and the end-to-end RUL prediction of aeroengine can be realized.Experimental results show that the most effective principal component from the multiple state parameters can be obtained by PCA,and the long time series of multiple state parameters can be directly mapped to RUL by 1D-CNN,so as to improve the efficiency and accuracy of RUL prediction.Compared with other traditional models,the proposed method also has lower prediction error and better robustness.展开更多
As COVID-19 poses a major threat to people’s health and economy,there is an urgent need for forecasting methodologies that can anticipate its trajectory efficiently.In non-stationary time series forecasting jobs,ther...As COVID-19 poses a major threat to people’s health and economy,there is an urgent need for forecasting methodologies that can anticipate its trajectory efficiently.In non-stationary time series forecasting jobs,there is frequently a hysteresis in the anticipated values relative to the real values.The multilayer deep-time convolutional network and a feature fusion network are combined in this paper’s proposal of an enhanced Multilayer Deep Time Convolutional Neural Network(MDTCNet)for COVID-19 prediction to address this problem.In particular,it is possible to record the deep features and temporal dependencies in uncertain time series,and the features may then be combined using a feature fusion network and a multilayer perceptron.Last but not least,the experimental verification is conducted on the prediction task of COVID-19 real daily confirmed cases in the world and the United States with uncertainty,realizing the short-term and long-term prediction of COVID-19 daily confirmed cases,and verifying the effectiveness and accuracy of the suggested prediction method,as well as reducing the hysteresis of the prediction results.展开更多
Time series prediction has always been an important problem in the field of machine learning.Among them,power load forecasting plays a crucial role in identifying the behavior of photovoltaic power plants and regulati...Time series prediction has always been an important problem in the field of machine learning.Among them,power load forecasting plays a crucial role in identifying the behavior of photovoltaic power plants and regulating their control strategies.Traditional power load forecasting often has poor feature extraction performance for long time series.In this paper,a new deep learning framework Residual Stacked Temporal Long Short-Term Memory(RST-LSTM)is proposed,which combines wavelet decomposition and time convolutional memory network to solve the problem of feature extraction for long sequences.The network framework of RST-LSTM consists of two parts:one is a stacked time convolutional memory unit module for global and local feature extraction,and the other is a residual combination optimization module to reduce model redundancy.Finally,this paper demonstrates through various experimental indicators that RST-LSTM achieves significant performance improvements in both overall and local prediction accuracy compared to some state-of-the-art baseline methods.展开更多
针对部分场景下标签较少、样本不均衡的时序数据,为了更好的捕捉序列之间的逐步依赖关系,本文一方面使用具有因果关系属性的时域卷积网络构建生成对抗网络,另一方面使用长短期记忆网络构建嵌入网络和复现网络,以实现模型同时处理短期依...针对部分场景下标签较少、样本不均衡的时序数据,为了更好的捕捉序列之间的逐步依赖关系,本文一方面使用具有因果关系属性的时域卷积网络构建生成对抗网络,另一方面使用长短期记忆网络构建嵌入网络和复现网络,以实现模型同时处理短期依存项和长期依存项,从而提出一种基于时域卷积网络和长短期记忆网络的时间序列生成对抗网络(A Time-series Generative Adversarial Network based on Temporal convolutional network and Long-short term memory network, TL-TimeGAN)。采用覆盖性、有用性和相似度检验的综合分析方法作为合成数据质量的评价指标,进一步全面地评价合成数据的覆盖性、预测程度和相似性。最终,基于以太坊欺诈检测数据集,使用Tabnet网络对扩增数据进行异常检测并获得局部特征重要性以及全局特征重要性,以增强扩增数据应用于实际工作的实践指导价值。展开更多
Skin cancer is the abnormal development of cells on the surface of the skin and is one of the most fatal diseases in humans.It usually appears in locations that are exposed to the sun,but can also appear in areas that...Skin cancer is the abnormal development of cells on the surface of the skin and is one of the most fatal diseases in humans.It usually appears in locations that are exposed to the sun,but can also appear in areas that are not regularly exposed to the sun.Due to the striking similarities between benign and malignant lesions,skin cancer detection remains a problem,even for expert dermatologists.Considering the inability of dermatologists to di-agnose skin cancer accurately,a convolutional neural network(CNN)approach was used for skin cancer diag-nosis.However,the CNN model requires a significant number of image datasets for better performance;thus,image augmentation and transfer learning techniques have been used in this study to boost the number of images and the performance of the model,because there are a limited number of medical images.This study proposes an ensemble transfer-learning-based model that can efficiently classify skin lesions into one of seven categories to aid dermatologists in skin cancer detection:(i)actinic keratoses,(ii)basal cell carcinoma,(iii)benign keratosis,(iv)dermatofibroma,(v)melanocytic nevi,(vi)melanoma,and(vii)vascular skin lesions.Five transfer learning models were used as the basis of the ensemble:MobileNet,EfficientNetV2B2,Xception,ResNeXt101,and Den-seNet201.In addition to the stratified 10-fold cross-validation,the results of each individual model were fused to achieve greater classification accuracy.An annealing learning rate scheduler and test time augmentation(TTA)were also used to increase the performance of the model during the training and testing stages.A total of 10,015 publicly available dermoscopy images from the HAM10000(Human Against Machine)dataset,which contained samples from the seven common skin lesion categories,were used to train and evaluate the models.The proposed technique attained 94.49%accuracy on the dataset.These results suggest that this strategy can be useful for improving the accuracy of skin cancer classification.However,the weighted average of F1-score,recall,and precision were obtained to be 94.68%,94.49%,and 95.07%,respectively.展开更多
Extracting typical operational scenarios is essential for making flexible decisions in the dispatch of a new power system.A novel deep time series aggregation scheme(DTSAs)is proposed to generate typical operational s...Extracting typical operational scenarios is essential for making flexible decisions in the dispatch of a new power system.A novel deep time series aggregation scheme(DTSAs)is proposed to generate typical operational scenarios,considering the large amount of historical operational snapshot data.Specifically,DTSAs analyse the intrinsic mechanisms of different scheduling operational scenario switching to mathematically represent typical operational scenarios.A Gramian angular summation field-based operational scenario image encoder was designed to convert operational scenario sequences into highdimensional spaces.This enables DTSAs to fully capture the spatiotemporal characteristics of new power systems using deep feature iterative aggregation models.The encoder also facilitates the generation of typical operational scenarios that conform to historical data distributions while ensuring the integrity of grid operational snapshots.Case studies demonstrate that the proposed method extracted new fine-grained power system dispatch schemes and outperformed the latest high-dimensional feature-screening methods.In addition,experiments with different new energy access ratios were conducted to verify the robustness of the proposed method.DTSAs enable dispatchers to master the operation experience of the power system in advance,and actively respond to the dynamic changes of the operation scenarios under the high access rate of new energy.展开更多
Air pollution,specifically fine particulate matter(PM2.5),represents a critical environmental and public health concern due to its adverse effects on respiratory and cardiovascular systems.Accurate forecasting of PM2....Air pollution,specifically fine particulate matter(PM2.5),represents a critical environmental and public health concern due to its adverse effects on respiratory and cardiovascular systems.Accurate forecasting of PM2.5 concentrations is essential for mitigating health risks;however,the inherent nonlinearity and dynamic variability of air quality data present significant challenges.This study conducts a systematic evaluation of deep learning algorithms including Convolutional Neural Network(CNN),Long Short-Term Memory(LSTM),and the hybrid CNN-LSTM as well as statistical models,AutoRegressive Integrated Moving Average(ARIMA)and Maximum Likelihood Estimation(MLE)for hourly PM2.5 forecasting.Model performance is quantified using Root Mean Squared Error(RMSE),Mean Absolute Error(MAE),Mean Absolute Percentage Error(MAPE),and the Coefficient of Determination(R^(2))metrics.The comparative analysis identifies optimal predictive approaches for air quality modeling,emphasizing computational efficiency and accuracy.Additionally,CNN classification performance is evaluated using a confusion matrix,accuracy,precision,and F1-score.The results demonstrate that the Hybrid CNN-LSTM model outperforms standalone models,exhibiting lower error rates and higher R^(2) values,thereby highlighting the efficacy of deep learning-based hybrid architectures in achieving robust and precise PM2.5 forecasting.This study underscores the potential of advanced computational techniques in enhancing air quality prediction systems for environmental and public health applications.展开更多
Time series classification is related to many dif- ferent domains, such as health informatics, finance, and bioinformatics. Due to its broad applications, researchers have developed many algorithms for this kind of ta...Time series classification is related to many dif- ferent domains, such as health informatics, finance, and bioinformatics. Due to its broad applications, researchers have developed many algorithms for this kind of tasks, e.g., multivariate time series classification. Among the classifi- cation algorithms, k-nearest neighbor （k-NN） classification （particularly 1-NN） combined with dynamic time warping （DTW） achieves the state of the art performance. The defi- ciency is that when the data set grows large, the time con- sumption of 1-NN with DTW will be very expensive. In con- trast to 1-NN with DTW, it is more efficient but less ef- fective for feature-based classification methods since their performance usually depends on the quality of hand-crafted features. In this paper, we aim to improve the performance of traditional feature-based approaches through the feature learning techniques. Specifically, we propose a novel deep learning framework, multi-channels deep convolutional neu- ral networks （MC-DCNN）, for multivariate time series classi- fication. This model first learns features from individual uni- variate time series in each channel, and combines information from all channels as feature representation at the final layer. Then, the learnt features are applied into a multilayer percep- tron （MLP） for classification. Finally, the extensive experi- ments on real-world data sets show that our model is not only more efficient than the state of the art but also competitive in accuracy. This study implies that feature learning is worth to be investigated for the problem of time series classification.展开更多
With the continuous increase in the number of flights,the use of airport collaborative decision-making(ACDM)systems has been more and more widely spread.The accuracy of the taxi time prediction has an important effect...With the continuous increase in the number of flights,the use of airport collaborative decision-making(ACDM)systems has been more and more widely spread.The accuracy of the taxi time prediction has an important effect on the A-CDM calculation of the departure aircraft’s take-off queue and the accurate time for the aircraft blockout.The spatial-temporal-environment deep learning(STEDL)model is presented to improve the prediction accuracy of departure aircraft taxi-out time.The model is composed of time-flow sub-model(airport capacity,number of taxiing aircraft,and different time periods),spatial sub-model(taxiing distance)and environmental sub-model(weather,air traffic control,runway configuration,and aircraft category).The STEDL model is used to predict the taxi time of departure aircraft at Hong Kong Airport and the results show that the STEDL method has a prediction accuracy of 95.4%.The proposed model also greatly reduces the prediction error rate compared with the other machine learning methods.展开更多
Time series classification(TSC)has attracted various attention in the community of machine learning and data mining and has many successful applications such as fault detection and product identification in the proces...Time series classification(TSC)has attracted various attention in the community of machine learning and data mining and has many successful applications such as fault detection and product identification in the process of building a smart factory.However,it is still challenging for the efficiency and accuracy of classification due to complexity,multi-dimension of time series.This paper presents a new approach for time series classification based on convolutional neural networks(CNN).The proposed method contains three parts:short-time gap feature extraction,multi-scale local feature learning,and global feature learning.In the process of short-time gap feature extraction,large kernel filters are employed to extract the features within the short-time gap from the raw time series.Then,a multi-scale feature extraction technique is applied in the process of multi-scale local feature learning to obtain detailed representations.The global convolution operation with giant stride is to obtain a robust and global feature representation.The comprehension features used for classifying are a fusion of short time gap feature representations,local multi-scale feature representations,and global feature representations.To test the efficiency of the proposed method named multi-scale feature fusion convolutional neural networks(MSFFCNN),we designed,trained MSFFCNN on some public sensors,device,and simulated control time series data sets.The comparative studies indicate our proposed MSFFCNN outperforms other alternatives,and we also provided a detailed analysis of the proposed MSFFCNN.展开更多
基金Supported by National Natural Science Foundation of China(Grant No.51405241,51505234,51575283)
文摘With the rapid development of mechanical equipment, the mechanical health monitoring field has entered the era of big data. However, the method of manual feature extraction has the disadvantages of low efficiency and poor accuracy, when handling big data. In this study, the research object was the asynchronous motor in the drivetrain diagnostics simulator system. The vibration signals of different fault motors were collected. The raw signal was pretreated using short time Fourier transform （STFT） to obtain the corresponding time-frequency map. Then, the feature of the time-frequency map was adap- tively extracted by using a convolutional neural network （CNN）. The effects of the pretreatment method, and the hyper parameters of network diagnostic accuracy, were investigated experimentally. The experimental results showed that the influence of the preprocessing method is small, and that the batch-size is the main factor affecting accuracy and training efficiency. By investigating feature visualization, it was shown that, in the case of big data, the extracted CNN features can represent complex mapping relationships between signal and health status, and can also overcome the prior knowledge and engineering experience requirement for feature extraction, which is used by tra- ditional diagnosis methods. This paper proposes a new method, based on STFT and CNN, which can complete motor fault diagnosis tasks more intelligently and accurately.
基金supported by National Natural Science Foundation of China (Grant No. 61505253)National Key Research and Development Plan of China (Project No. 2016YFD0200601)
文摘One of the technical bottlenecks of traditional laser-induced breakdown spectroscopy(LIBS) is the difficulty in quantitative detection caused by the matrix effect. To troubleshoot this problem,this paper investigated a combination of time-resolved LIBS and convolutional neural networks(CNNs) to improve K determination in soil. The time-resolved LIBS contained the information of both wavelength and time dimension. The spectra of wavelength dimension showed the characteristic emission lines of elements, and those of time dimension presented the plasma decay trend. The one-dimensional data of LIBS intensity from the emission line at 766.49 nm were extracted and correlated with the K concentration, showing a poor correlation of R_c^2?=?0.0967, which is caused by the matrix effect of heterogeneous soil. For the wavelength dimension, the two-dimensional data of traditional integrated LIBS were extracted and analyzed by an artificial neural network(ANN), showing R_v^2?=?0.6318 and the root mean square error of validation(RMSEV)?=?0.6234. For the time dimension, the two-dimensional data of time-decay LIBS were extracted and analyzed by ANN, showing R_v^2?=?0.7366 and RMSEV?=?0.7855.These higher determination coefficients reveal that both the non-K emission lines of wavelength dimension and the spectral decay of time dimension could assist in quantitative detection of K.However, due to limited calibration samples, the two-dimensional models presented over-fitting.The three-dimensional data of time-resolved LIBS were analyzed by CNNs, which extracted and integrated the information of both the wavelength and time dimension, showing the R_v^2?=?0.9968 and RMSEV?=?0.0785. CNN analysis of time-resolved LIBS is capable of improving the determination of K in soil.
基金supported by the National Key Research and Development Program of China(No.2018YFB2101300)the National Natural Science Foundation of China(Grant No.61871186)the Dean’s Fund of Engineering Research Center of Software/Hardware Co-Design Technology and Application,Ministry of Education(East China Normal University).
文摘Time series forecasting plays an important role in various fields, such as energy, finance, transport, and weather. Temporal convolutional networks (TCNs) based on dilated causal convolution have been widely used in time series forecasting. However, two problems weaken the performance of TCNs. One is that in dilated casual convolution, causal convolution leads to the receptive fields of outputs being concentrated in the earlier part of the input sequence, whereas the recent input information will be severely lost. The other is that the distribution shift problem in time series has not been adequately solved. To address the first problem, we propose a subsequence-based dilated convolution method (SDC). By using multiple convolutional filters to convolve elements of neighboring subsequences, the method extracts temporal features from a growing receptive field via a growing subsequence rather than a single element. Ultimately, the receptive field of each output element can cover the whole input sequence. To address the second problem, we propose a difference and compensation method (DCM). The method reduces the discrepancies between and within the input sequences by difference operations and then compensates the outputs for the information lost due to difference operations. Based on SDC and DCM, we further construct a temporal subsequence-based convolutional network with difference (TSCND) for time series forecasting. The experimental results show that TSCND can reduce prediction mean squared error by 7.3% and save runtime, compared with state-of-the-art models and vanilla TCN.
基金supported by the China Scholarship Council and the CERNET Innovation Project under grant No.20170111.
文摘The prediction for Multivariate Time Series(MTS)explores the interrelationships among variables at historical moments,extracts their relevant characteristics,and is widely used in finance,weather,complex industries and other fields.Furthermore,it is important to construct a digital twin system.However,existing methods do not take full advantage of the potential properties of variables,which results in poor predicted accuracy.In this paper,we propose the Adaptive Fused Spatial-Temporal Graph Convolutional Network(AFSTGCN).First,to address the problem of the unknown spatial-temporal structure,we construct the Adaptive Fused Spatial-Temporal Graph(AFSTG)layer.Specifically,we fuse the spatial-temporal graph based on the interrelationship of spatial graphs.Simultaneously,we construct the adaptive adjacency matrix of the spatial-temporal graph using node embedding methods.Subsequently,to overcome the insufficient extraction of disordered correlation features,we construct the Adaptive Fused Spatial-Temporal Graph Convolutional(AFSTGC)module.The module forces the reordering of disordered temporal,spatial and spatial-temporal dependencies into rule-like data.AFSTGCN dynamically and synchronously acquires potential temporal,spatial and spatial-temporal correlations,thereby fully extracting rich hierarchical feature information to enhance the predicted accuracy.Experiments on different types of MTS datasets demonstrate that the model achieves state-of-the-art single-step and multi-step performance compared with eight other deep learning models.
基金Major Unified Construction Project of Petro China(2019-40210-000020-02)。
文摘Since the oil production of single well in water flooding reservoir varies greatly and is hard to predict, an oil production prediction method of single well based on temporal convolutional network(TCN) is proposed and verified. This method is started from data processing, the correspondence between water injectors and oil producers is determined according to the influence radius of the water injectors, the influence degree of a water injector on an oil producer in the month concerned is added as a model feature, and a Random Forest(RF) model is built to fill the dynamic data of water flooding. The single well history is divided into 4 stages according to its water cut, that is, low water cut, middle water cut, high water cut and extra-high water cut stages. In each stage, a TCN based prediction model is established, hyperparameters of the model are optimized by the Sparrow Search Algorithm(SSA). Finally, the models of the 4 stages are integrated into one whole-life model of the well for production prediction. The application of this method in Daqing Oilfield, NE China shows that:(1) Compared with conventional data processing methods, the data obtained by this processing method are more close to the actual production, and the data set obtained is more authentic and complete.(2) The TCN model has higher prediction accuracy than other 11 models such as Long Short Term Memory(LSTM).(3) Compared with the conventional full-life-cycle models, the model of integrated stages can significantly reduce the error of production prediction.
基金supported by Jiangsu Social Science Foundation(No.20GLD008)Science,Technology Projects of Jiangsu Provincial Department of Communications(No.2020Y14)Joint Fund for Civil Aviation Research(No.U1933202)。
文摘In order to directly construct the mapping between multiple state parameters and remaining useful life(RUL),and reduce the interference of random error on prediction accuracy,a RUL prediction model of aeroengine based on principal component analysis(PCA)and one-dimensional convolution neural network(1D-CNN)is proposed in this paper.Firstly,multiple state parameters corresponding to massive cycles of aeroengine are collected and brought into PCA for dimensionality reduction,and principal components are extracted for further time series prediction.Secondly,the 1D-CNN model is constructed to directly study the mapping between principal components and RUL.Multiple convolution and pooling operations are applied for deep feature extraction,and the end-to-end RUL prediction of aeroengine can be realized.Experimental results show that the most effective principal component from the multiple state parameters can be obtained by PCA,and the long time series of multiple state parameters can be directly mapped to RUL by 1D-CNN,so as to improve the efficiency and accuracy of RUL prediction.Compared with other traditional models,the proposed method also has lower prediction error and better robustness.
基金supported by the major scientific and technological research project of Chongqing Education Commission(KJZD-M202000802)The first batch of Industrial and Informatization Key Special Fund Support Projects in Chongqing in 2022(2022000537).
文摘As COVID-19 poses a major threat to people’s health and economy,there is an urgent need for forecasting methodologies that can anticipate its trajectory efficiently.In non-stationary time series forecasting jobs,there is frequently a hysteresis in the anticipated values relative to the real values.The multilayer deep-time convolutional network and a feature fusion network are combined in this paper’s proposal of an enhanced Multilayer Deep Time Convolutional Neural Network(MDTCNet)for COVID-19 prediction to address this problem.In particular,it is possible to record the deep features and temporal dependencies in uncertain time series,and the features may then be combined using a feature fusion network and a multilayer perceptron.Last but not least,the experimental verification is conducted on the prediction task of COVID-19 real daily confirmed cases in the world and the United States with uncertainty,realizing the short-term and long-term prediction of COVID-19 daily confirmed cases,and verifying the effectiveness and accuracy of the suggested prediction method,as well as reducing the hysteresis of the prediction results.
基金funded by NARI Group’s Independent Project of China(Granted No.524609230125)the foundation of NARI-TECH Nanjing Control System Ltd.of China(Granted No.0914202403120020).
文摘Time series prediction has always been an important problem in the field of machine learning.Among them,power load forecasting plays a crucial role in identifying the behavior of photovoltaic power plants and regulating their control strategies.Traditional power load forecasting often has poor feature extraction performance for long time series.In this paper,a new deep learning framework Residual Stacked Temporal Long Short-Term Memory(RST-LSTM)is proposed,which combines wavelet decomposition and time convolutional memory network to solve the problem of feature extraction for long sequences.The network framework of RST-LSTM consists of two parts:one is a stacked time convolutional memory unit module for global and local feature extraction,and the other is a residual combination optimization module to reduce model redundancy.Finally,this paper demonstrates through various experimental indicators that RST-LSTM achieves significant performance improvements in both overall and local prediction accuracy compared to some state-of-the-art baseline methods.
文摘针对部分场景下标签较少、样本不均衡的时序数据,为了更好的捕捉序列之间的逐步依赖关系,本文一方面使用具有因果关系属性的时域卷积网络构建生成对抗网络,另一方面使用长短期记忆网络构建嵌入网络和复现网络,以实现模型同时处理短期依存项和长期依存项,从而提出一种基于时域卷积网络和长短期记忆网络的时间序列生成对抗网络(A Time-series Generative Adversarial Network based on Temporal convolutional network and Long-short term memory network, TL-TimeGAN)。采用覆盖性、有用性和相似度检验的综合分析方法作为合成数据质量的评价指标,进一步全面地评价合成数据的覆盖性、预测程度和相似性。最终,基于以太坊欺诈检测数据集,使用Tabnet网络对扩增数据进行异常检测并获得局部特征重要性以及全局特征重要性,以增强扩增数据应用于实际工作的实践指导价值。
文摘Skin cancer is the abnormal development of cells on the surface of the skin and is one of the most fatal diseases in humans.It usually appears in locations that are exposed to the sun,but can also appear in areas that are not regularly exposed to the sun.Due to the striking similarities between benign and malignant lesions,skin cancer detection remains a problem,even for expert dermatologists.Considering the inability of dermatologists to di-agnose skin cancer accurately,a convolutional neural network(CNN)approach was used for skin cancer diag-nosis.However,the CNN model requires a significant number of image datasets for better performance;thus,image augmentation and transfer learning techniques have been used in this study to boost the number of images and the performance of the model,because there are a limited number of medical images.This study proposes an ensemble transfer-learning-based model that can efficiently classify skin lesions into one of seven categories to aid dermatologists in skin cancer detection:(i)actinic keratoses,(ii)basal cell carcinoma,(iii)benign keratosis,(iv)dermatofibroma,(v)melanocytic nevi,(vi)melanoma,and(vii)vascular skin lesions.Five transfer learning models were used as the basis of the ensemble:MobileNet,EfficientNetV2B2,Xception,ResNeXt101,and Den-seNet201.In addition to the stratified 10-fold cross-validation,the results of each individual model were fused to achieve greater classification accuracy.An annealing learning rate scheduler and test time augmentation(TTA)were also used to increase the performance of the model during the training and testing stages.A total of 10,015 publicly available dermoscopy images from the HAM10000(Human Against Machine)dataset,which contained samples from the seven common skin lesion categories,were used to train and evaluate the models.The proposed technique attained 94.49%accuracy on the dataset.These results suggest that this strategy can be useful for improving the accuracy of skin cancer classification.However,the weighted average of F1-score,recall,and precision were obtained to be 94.68%,94.49%,and 95.07%,respectively.
基金The Key R&D Project of Jilin Province,Grant/Award Number:20230201067GX。
文摘Extracting typical operational scenarios is essential for making flexible decisions in the dispatch of a new power system.A novel deep time series aggregation scheme(DTSAs)is proposed to generate typical operational scenarios,considering the large amount of historical operational snapshot data.Specifically,DTSAs analyse the intrinsic mechanisms of different scheduling operational scenario switching to mathematically represent typical operational scenarios.A Gramian angular summation field-based operational scenario image encoder was designed to convert operational scenario sequences into highdimensional spaces.This enables DTSAs to fully capture the spatiotemporal characteristics of new power systems using deep feature iterative aggregation models.The encoder also facilitates the generation of typical operational scenarios that conform to historical data distributions while ensuring the integrity of grid operational snapshots.Case studies demonstrate that the proposed method extracted new fine-grained power system dispatch schemes and outperformed the latest high-dimensional feature-screening methods.In addition,experiments with different new energy access ratios were conducted to verify the robustness of the proposed method.DTSAs enable dispatchers to master the operation experience of the power system in advance,and actively respond to the dynamic changes of the operation scenarios under the high access rate of new energy.
文摘Air pollution,specifically fine particulate matter(PM2.5),represents a critical environmental and public health concern due to its adverse effects on respiratory and cardiovascular systems.Accurate forecasting of PM2.5 concentrations is essential for mitigating health risks;however,the inherent nonlinearity and dynamic variability of air quality data present significant challenges.This study conducts a systematic evaluation of deep learning algorithms including Convolutional Neural Network(CNN),Long Short-Term Memory(LSTM),and the hybrid CNN-LSTM as well as statistical models,AutoRegressive Integrated Moving Average(ARIMA)and Maximum Likelihood Estimation(MLE)for hourly PM2.5 forecasting.Model performance is quantified using Root Mean Squared Error(RMSE),Mean Absolute Error(MAE),Mean Absolute Percentage Error(MAPE),and the Coefficient of Determination(R^(2))metrics.The comparative analysis identifies optimal predictive approaches for air quality modeling,emphasizing computational efficiency and accuracy.Additionally,CNN classification performance is evaluated using a confusion matrix,accuracy,precision,and F1-score.The results demonstrate that the Hybrid CNN-LSTM model outperforms standalone models,exhibiting lower error rates and higher R^(2) values,thereby highlighting the efficacy of deep learning-based hybrid architectures in achieving robust and precise PM2.5 forecasting.This study underscores the potential of advanced computational techniques in enhancing air quality prediction systems for environmental and public health applications.
文摘Time series classification is related to many dif- ferent domains, such as health informatics, finance, and bioinformatics. Due to its broad applications, researchers have developed many algorithms for this kind of tasks, e.g., multivariate time series classification. Among the classifi- cation algorithms, k-nearest neighbor （k-NN） classification （particularly 1-NN） combined with dynamic time warping （DTW） achieves the state of the art performance. The defi- ciency is that when the data set grows large, the time con- sumption of 1-NN with DTW will be very expensive. In con- trast to 1-NN with DTW, it is more efficient but less ef- fective for feature-based classification methods since their performance usually depends on the quality of hand-crafted features. In this paper, we aim to improve the performance of traditional feature-based approaches through the feature learning techniques. Specifically, we propose a novel deep learning framework, multi-channels deep convolutional neu- ral networks （MC-DCNN）, for multivariate time series classi- fication. This model first learns features from individual uni- variate time series in each channel, and combines information from all channels as feature representation at the final layer. Then, the learnt features are applied into a multilayer percep- tron （MLP） for classification. Finally, the extensive experi- ments on real-world data sets show that our model is not only more efficient than the state of the art but also competitive in accuracy. This study implies that feature learning is worth to be investigated for the problem of time series classification.
基金This work was supported by the National Natural Science Foundation of China(Nos.U1833103,71801215)the China Civil Aviation Environment and Sustainable Development Research Center Open Fund(No.CESCA2019Y04).
文摘With the continuous increase in the number of flights,the use of airport collaborative decision-making(ACDM)systems has been more and more widely spread.The accuracy of the taxi time prediction has an important effect on the A-CDM calculation of the departure aircraft’s take-off queue and the accurate time for the aircraft blockout.The spatial-temporal-environment deep learning(STEDL)model is presented to improve the prediction accuracy of departure aircraft taxi-out time.The model is composed of time-flow sub-model(airport capacity,number of taxiing aircraft,and different time periods),spatial sub-model(taxiing distance)and environmental sub-model(weather,air traffic control,runway configuration,and aircraft category).The STEDL model is used to predict the taxi time of departure aircraft at Hong Kong Airport and the results show that the STEDL method has a prediction accuracy of 95.4%.The proposed model also greatly reduces the prediction error rate compared with the other machine learning methods.
基金This work was supported by the Technology Innovation Program(20004205,The development of smart collaboration manufacturing innovation service platform in textile industry by producer-buyer B2B connection funded By the Ministry of Trade,Industry&Energy(MOTIE,Korea)).
文摘Time series classification(TSC)has attracted various attention in the community of machine learning and data mining and has many successful applications such as fault detection and product identification in the process of building a smart factory.However,it is still challenging for the efficiency and accuracy of classification due to complexity,multi-dimension of time series.This paper presents a new approach for time series classification based on convolutional neural networks(CNN).The proposed method contains three parts:short-time gap feature extraction,multi-scale local feature learning,and global feature learning.In the process of short-time gap feature extraction,large kernel filters are employed to extract the features within the short-time gap from the raw time series.Then,a multi-scale feature extraction technique is applied in the process of multi-scale local feature learning to obtain detailed representations.The global convolution operation with giant stride is to obtain a robust and global feature representation.The comprehension features used for classifying are a fusion of short time gap feature representations,local multi-scale feature representations,and global feature representations.To test the efficiency of the proposed method named multi-scale feature fusion convolutional neural networks(MSFFCNN),we designed,trained MSFFCNN on some public sensors,device,and simulated control time series data sets.The comparative studies indicate our proposed MSFFCNN outperforms other alternatives,and we also provided a detailed analysis of the proposed MSFFCNN.
