Time series anomaly detection is an important task in many applications,and deep learning based time series anomaly detection has made great progress.However,due to complex device interactions,time series exhibit dive...Time series anomaly detection is an important task in many applications,and deep learning based time series anomaly detection has made great progress.However,due to complex device interactions,time series exhibit diverse abnormal signal shapes,subtle anomalies,and imbalanced abnormal instances,which make anomaly detection in time series still a challenge.Fusion and analysis of multivariate time series can help uncover their intrinsic spatio-temporal characteristics,and contribute to the discovery of complex and subtle anomalies.In this paper,we propose a novel approach named Multi-scale Convolution Fusion and Memory-augmented Adversarial AutoEncoder(MCFMAAE)for multivariate time series anomaly detection.It is an encoder-decoder-based framework with four main components.Multi-scale convolution fusion module fuses multi-sensor signals and captures various scales of temporal information.Self-attention-based encoder adopts the multi-head attention mechanism for sequence modeling to capture global context information.Memory module is introduced to explore the internal structure of normal samples,capturing it into the latent space,and thus remembering the typical pattern.Finally,the decoder is used to reconstruct the signals,and then a process is coming to calculate the anomaly score.Moreover,an additional discriminator is added to the model,which enhances the representation ability of autoencoder and avoids overfitting.Experiments on public datasets demonstrate that MCFMAAE improves the performance compared to other state-of-the-art methods,which provides an effective solution for multivariate time series anomaly detection.展开更多
Long-term multivariate time series forecasting is an important task in engineering applications. It helps grasp the future development trend of data in real-time, which is of great significance for a wide variety of f...Long-term multivariate time series forecasting is an important task in engineering applications. It helps grasp the future development trend of data in real-time, which is of great significance for a wide variety of fields. Due to the non-linear and unstable characteristics of multivariate time series, the existing methods encounter difficulties in analyzing complex high-dimensional data and capturing latent relationships between multivariates in time series, thus affecting the performance of long-term prediction. In this paper, we propose a novel time series forecasting model based on multilayer perceptron that combines spatio-temporal decomposition and doubly residual stacking, namely Spatio-Temporal Decomposition Neural Network (STDNet). We decompose the originally complex and unstable time series into two parts, temporal term and spatial term. We design temporal module based on auto-correlation mechanism to discover temporal dependencies at the sub-series level, and spatial module based on convolutional neural network and self-attention mechanism to integrate multivariate information from two dimensions, global and local, respectively. Then we integrate the results obtained from the different modules to get the final forecast. Extensive experiments on four real-world datasets show that STDNet significantly outperforms other state-of-the-art methods, which provides an effective solution for long-term time series forecasting.展开更多
基金supported by the National Key Research and Development Program of China(No.2021YFB3300503)the Regional Innovation and Development Joint Fund of NSFC(No.U22A20167).
文摘Time series anomaly detection is an important task in many applications,and deep learning based time series anomaly detection has made great progress.However,due to complex device interactions,time series exhibit diverse abnormal signal shapes,subtle anomalies,and imbalanced abnormal instances,which make anomaly detection in time series still a challenge.Fusion and analysis of multivariate time series can help uncover their intrinsic spatio-temporal characteristics,and contribute to the discovery of complex and subtle anomalies.In this paper,we propose a novel approach named Multi-scale Convolution Fusion and Memory-augmented Adversarial AutoEncoder(MCFMAAE)for multivariate time series anomaly detection.It is an encoder-decoder-based framework with four main components.Multi-scale convolution fusion module fuses multi-sensor signals and captures various scales of temporal information.Self-attention-based encoder adopts the multi-head attention mechanism for sequence modeling to capture global context information.Memory module is introduced to explore the internal structure of normal samples,capturing it into the latent space,and thus remembering the typical pattern.Finally,the decoder is used to reconstruct the signals,and then a process is coming to calculate the anomaly score.Moreover,an additional discriminator is added to the model,which enhances the representation ability of autoencoder and avoids overfitting.Experiments on public datasets demonstrate that MCFMAAE improves the performance compared to other state-of-the-art methods,which provides an effective solution for multivariate time series anomaly detection.
基金supported by the National Key Research and Development Program of China (No. 2021YFB3300503)Regional Innovation and Development Joint Fund of National Natural Science Foundation of China (No. U22A20167)National Natural Science Foundation of China (No. 61872260).
文摘Long-term multivariate time series forecasting is an important task in engineering applications. It helps grasp the future development trend of data in real-time, which is of great significance for a wide variety of fields. Due to the non-linear and unstable characteristics of multivariate time series, the existing methods encounter difficulties in analyzing complex high-dimensional data and capturing latent relationships between multivariates in time series, thus affecting the performance of long-term prediction. In this paper, we propose a novel time series forecasting model based on multilayer perceptron that combines spatio-temporal decomposition and doubly residual stacking, namely Spatio-Temporal Decomposition Neural Network (STDNet). We decompose the originally complex and unstable time series into two parts, temporal term and spatial term. We design temporal module based on auto-correlation mechanism to discover temporal dependencies at the sub-series level, and spatial module based on convolutional neural network and self-attention mechanism to integrate multivariate information from two dimensions, global and local, respectively. Then we integrate the results obtained from the different modules to get the final forecast. Extensive experiments on four real-world datasets show that STDNet significantly outperforms other state-of-the-art methods, which provides an effective solution for long-term time series forecasting.
