Geochemical survey data are essential across Earth Science disciplines but are often affected by noise,which can obscure important geological signals and compromise subsequent prediction and interpretation.Quantifying...Geochemical survey data are essential across Earth Science disciplines but are often affected by noise,which can obscure important geological signals and compromise subsequent prediction and interpretation.Quantifying prediction uncertainty is hence crucial for robust geoscientific decision-making.This study proposes a novel deep learning framework,the Spatially Constrained Variational Autoencoder(SC-VAE),for denoising geochemical survey data with integrated uncertainty quantification.The SC-VAE incorporates spatial regularization,which enforces spatial coherence by modeling inter-sample relationships directly within the latent space.The performance of the SC-VAE was systematically evaluated against a standard Variational Autoencoder(VAE)using geochemical data from the gold polymetallic district in the northwestern part of Sichuan Province,China.Both models were optimized using Bayesian optimization,with objective functions specifically designed to maintain essential geostatistical characteristics.Evaluation metrics include variogram analysis,quantitative measures of spatial interpolation accuracy,visual assessment of denoised maps,and statistical analysis of data distributions,as well as decomposition of uncertainties.Results show that the SC-VAE achieves superior noise suppression and better preservation of spatial structure compared to the standard VAE,as demonstrated by a significant reduction in the variogram nugget effect and an increased partial sill.The SC-VAE produces denoised maps with clearer anomaly delineation and more regularized data distributions,effectively mitigating outliers and reducing kurtosis.Additionally,it delivers improved interpolation accuracy and spatially explicit uncertainty estimates,facilitating more reliable and interpretable assessments of prediction confidence.The SC-VAE framework thus provides a robust,geostatistically informed solution for enhancing the quality and interpretability of geochemical data,with broad applicability in mineral exploration,environmental geochemistry,and other Earth Science domains.展开更多
Seismic data denoising is a critical process usually applied at various stages of the seismic processing workflow,as our ability to mitigate noise in seismic data affects the quality of our subsequent analyses.However...Seismic data denoising is a critical process usually applied at various stages of the seismic processing workflow,as our ability to mitigate noise in seismic data affects the quality of our subsequent analyses.However,finding an optimal balance between preserving seismic signals and effectively reducing seismic noise presents a substantial challenge.In this study,we introduce a multi-stage deep learning model,trained in a self-supervised manner,designed specifically to suppress seismic noise while minimizing signal leakage.This model operates as a patch-based approach,extracting overlapping patches from the noisy data and converting them into 1D vectors for input.It consists of two identical sub-networks,each configured differently.Inspired by the transformer architecture,each sub-network features an embedded block that comprises two fully connected layers,which are utilized for feature extraction from the input patches.After reshaping,a multi-head attention module enhances the model’s focus on significant features by assigning higher attention weights to them.The key difference between the two sub-networks lies in the number of neurons within their fully connected layers.The first sub-network serves as a strong denoiser with a small number of neurons,effectively attenuating seismic noise;in contrast,the second sub-network functions as a signal-add-back model,using a larger number of neurons to retrieve some of the signal that was not preserved in the output of the first sub-network.The proposed model produces two outputs,each corresponding to one of the sub-networks,and both sub-networks are optimized simultaneously using the noisy data as the label for both outputs.Evaluations conducted on both synthetic and field data demonstrate the model’s effectiveness in suppressing seismic noise with minimal signal leakage,outperforming some benchmark methods.展开更多
Accurate prediction of road traffic flow is a significant part in the intelligent transportation systems.Accurate prediction can alleviate traffic congestion,and reduce environmental pollution.For the management depar...Accurate prediction of road traffic flow is a significant part in the intelligent transportation systems.Accurate prediction can alleviate traffic congestion,and reduce environmental pollution.For the management department,it can make effective use of road resources.For individuals,it can help people plan their own travel paths,avoid congestion,and save time.Owing to complex factors on the road,such as damage to the detector and disturbances from environment,the measured traffic volume can contain noise.Reducing the influence of noise on traffic flow prediction is a piece of very important work.Therefore,in this paper we propose a combination algorithm of denoising and BILSTM to effectively improve the performance of traffic flow prediction.At the same time,three denoising algorithms are compared to find the best combination mode.In this paper,the wavelet(WL) denoising scheme,the empirical mode decomposition(EMD) denoising scheme,and the ensemble empirical mode decomposition(EEMD) denoising scheme are all introduced to suppress outliers in traffic flow data.In addition,we combine the denoising schemes with bidirectional long short-term memory(BILSTM)network to predict the traffic flow.The data in this paper are cited from performance measurement system(PeMS).We choose three kinds of road data(mainline,off ramp,on ramp) to predict traffic flow.The results for mainline show that data denoising can improve prediction accuracy.Moreover,prediction accuracy of BILSTM+EEMD scheme is the highest in the three methods(BILSTM+WL,BILSTM+EMD,BILSTM+EEMD).The results for off ramp and on ramp show the same performance as the results for mainline.It is indicated that this model is suitable for different road sections and long-term prediction.展开更多
Low-field nuclear magnetic resonance(NMR)has broad application prospects in the explo-ration and development of unconventional oil and gas reservoirs.However,NMR instruments tend to acquire echo signals with relativel...Low-field nuclear magnetic resonance(NMR)has broad application prospects in the explo-ration and development of unconventional oil and gas reservoirs.However,NMR instruments tend to acquire echo signals with relatively low signal-to-noise ratio(SNR),resulting in poor accuracy of T2 spectrum inversion.It is crucial to preprocess the low SNR data with denoising methods before inversion.In this paper,a hybrid NMR data denoising method combining empirical mode decomposition-singular value decomposition(EMD-SVD)was proposed.Firstly,the echo data were decomposed with the EMD method to low-and high-frequency intrinsic mode function(IMF)components as well as a residual.Next,the SVD method was employed for the high-frequency IMF components denoising.Finally,the low-frequency IMF components,the denoised high-frequency IMF components,and the residual are summed to form the denoised signal.To validate the effectiveness and feasibility of the EMD-SVDmethod,numerical simulations,experimental data,and NMR log data processingwere conducted.The results indicate that the inverted NMR spectra with the EMD-SVD denoising method exhibit higher quality compared to the EMD method and the SVD method.展开更多
To address the issue of low denoising accuracy of unmanned aerial vehicle(UAV)sensor data in a nonlinear non-Gaussian system,an adaptive central error entropy(CEE)—strong tracking cubature Kalman filter(STCKF)algorit...To address the issue of low denoising accuracy of unmanned aerial vehicle(UAV)sensor data in a nonlinear non-Gaussian system,an adaptive central error entropy(CEE)—strong tracking cubature Kalman filter(STCKF)algorithm based on fuzzy broad learning system(fuzzy-BLS)is proposed in this paper.Although entropy algorithms are known to be effective for denoising in non-Gaussian systems,their application in nonlinear systems is still limited.To address this issue,this study combines the central error entropy criterion with the STCKF algorithm.This approach is boosted by the denoising capabilities of the STCKF algorithm for nonlinear systems,thereby compensating for the shortcomings of the CEE criterion for nonlinear systems and leveraging the advantages of CEE in non-Gaussian systems.Thus,the new algorithm has enhanced robustness and accuracy for nonlinear non-Gaussian systems.To further optimize this algorithm,a parameter update method based on fuzzyBLS is adopted to address the problem of excessive reliance on experience and lack of dependency in the selection of parameters,such as weight and kernel width,in the fusion of the CEE criterion.This method can dynamically adjust the optimal parameter template obtained from offline training online to minimize the root mean square error of the denoising results and provide adaptive denoising capability.Simulation and actual data denoising experiments confirmed that the proposed data denoising method accurately addresses the denoising problem of UAV sensor data in nonlinear non-Gaussian systems.展开更多
In this paper, multi-scaled morphology is introduced into the digital processing domain for land seismic data. First, we describe the basic theory of multi-scaled morphology image decomposition of exploration seismic ...In this paper, multi-scaled morphology is introduced into the digital processing domain for land seismic data. First, we describe the basic theory of multi-scaled morphology image decomposition of exploration seismic waves; second, we illustrate how to use multi-scaled morphology for seismic data processing using two real examples. The first example demonstrates suppressing the surface waves in pre-stack seismic records using multi-scaled morphology decomposition and reconstitution and the other example demonstrates filtering different interference waves on the seismic record. Multi-scaled morphology filtering separates signal from noise by the detailed differences of the wave shapes. The successful applications suggest that multi-scaled morphology has a promising application in seismic data processing.展开更多
Successful modeling of hydroenvironmental processes widely relies on quantity and quality of accessible data,and noisy data can affect the modeling performance.On the other hand in training phase of any Artificial Int...Successful modeling of hydroenvironmental processes widely relies on quantity and quality of accessible data,and noisy data can affect the modeling performance.On the other hand in training phase of any Artificial Intelligence(AI) based model,each training data set is usually a limited sample of possible patterns of the process and hence,might not show the behavior of whole population.Accordingly,in the present paper,wavelet-based denoising method was used to smooth hydrological time series.Thereafter,small normally distributed noises with the mean of zero and various standard deviations were generated and added to the smooth time series to form different denoised-jittered data sets.Finally,the obtained pre-processed data were imposed into Artificial Neural Network(ANN) and Adaptive Neuro-Fuzzy Inference System(ANFIS)models for daily runoff-sediment modeling of the Minnesota River.To evaluate the modeling performance,the outcomes were compared with results of multi linear regression(MLR) and Auto Regressive Integrated Moving Average(ARIMA)models.The comparison showed that the proposed data processing approach which serves both denoising and jittering techniques could enhance the performance of ANN and ANFIS based runoffsediment modeling of the case study up to 34%and 25%in the verification phase,respectively.展开更多
Accurate short-term load forecasting is essential to modern power systems and smart grids. The utility can better implement demand-side management and operate power system stably with a reliable load forecasting syste...Accurate short-term load forecasting is essential to modern power systems and smart grids. The utility can better implement demand-side management and operate power system stably with a reliable load forecasting system. The load demand contains a variety of different load components, and different loads operate with different frequencies. The conventional load forecasting methods, e.g., linear regression(LR), auto-regressive integrated moving average(ARIMA), deep neural network, ignore the frequency domain and can only use time-domain load demand as inputs. To make full use of both time-domain and frequency-domain features of the load demand, a load forecasting method based on hybrid empirical wavelet transform(EWT) and deep neural network is proposed in this paper. The proposed method first filters noises via wavelet-based denoising technique, and then decomposes the original load demand into several sub-layers to show the frequency features while the time-domain information is preserved as well. Then, a bidirectional long short-term memory(LSTM) method is trained for each sub-layer independently. In order to better tune the hyperparameters, a Bayesian hyperparameter optimization(BHO) algorithm is adopted in this paper. Three case studies are designed to evaluate the performance of the proposed method.From the results, it is found that the proposed method improves the prediction accuracy compared with other load forecasting method.展开更多
基金supported by the National Natural Science Foundation of China(Nos.42530801,42425208)the Natural Science Foundation of Hubei Province(China)(No.2023AFA001)+1 种基金the MOST Special Fund from State Key Laboratory of Geological Processes and Mineral Resources,China University of Geosciences(No.MSFGPMR2025-401)the China Scholarship Council(No.202306410181)。
文摘Geochemical survey data are essential across Earth Science disciplines but are often affected by noise,which can obscure important geological signals and compromise subsequent prediction and interpretation.Quantifying prediction uncertainty is hence crucial for robust geoscientific decision-making.This study proposes a novel deep learning framework,the Spatially Constrained Variational Autoencoder(SC-VAE),for denoising geochemical survey data with integrated uncertainty quantification.The SC-VAE incorporates spatial regularization,which enforces spatial coherence by modeling inter-sample relationships directly within the latent space.The performance of the SC-VAE was systematically evaluated against a standard Variational Autoencoder(VAE)using geochemical data from the gold polymetallic district in the northwestern part of Sichuan Province,China.Both models were optimized using Bayesian optimization,with objective functions specifically designed to maintain essential geostatistical characteristics.Evaluation metrics include variogram analysis,quantitative measures of spatial interpolation accuracy,visual assessment of denoised maps,and statistical analysis of data distributions,as well as decomposition of uncertainties.Results show that the SC-VAE achieves superior noise suppression and better preservation of spatial structure compared to the standard VAE,as demonstrated by a significant reduction in the variogram nugget effect and an increased partial sill.The SC-VAE produces denoised maps with clearer anomaly delineation and more regularized data distributions,effectively mitigating outliers and reducing kurtosis.Additionally,it delivers improved interpolation accuracy and spatially explicit uncertainty estimates,facilitating more reliable and interpretable assessments of prediction confidence.The SC-VAE framework thus provides a robust,geostatistically informed solution for enhancing the quality and interpretability of geochemical data,with broad applicability in mineral exploration,environmental geochemistry,and other Earth Science domains.
基金supported by the King Abdullah University of Science and Technology(KAUST)。
文摘Seismic data denoising is a critical process usually applied at various stages of the seismic processing workflow,as our ability to mitigate noise in seismic data affects the quality of our subsequent analyses.However,finding an optimal balance between preserving seismic signals and effectively reducing seismic noise presents a substantial challenge.In this study,we introduce a multi-stage deep learning model,trained in a self-supervised manner,designed specifically to suppress seismic noise while minimizing signal leakage.This model operates as a patch-based approach,extracting overlapping patches from the noisy data and converting them into 1D vectors for input.It consists of two identical sub-networks,each configured differently.Inspired by the transformer architecture,each sub-network features an embedded block that comprises two fully connected layers,which are utilized for feature extraction from the input patches.After reshaping,a multi-head attention module enhances the model’s focus on significant features by assigning higher attention weights to them.The key difference between the two sub-networks lies in the number of neurons within their fully connected layers.The first sub-network serves as a strong denoiser with a small number of neurons,effectively attenuating seismic noise;in contrast,the second sub-network functions as a signal-add-back model,using a larger number of neurons to retrieve some of the signal that was not preserved in the output of the first sub-network.The proposed model produces two outputs,each corresponding to one of the sub-networks,and both sub-networks are optimized simultaneously using the noisy data as the label for both outputs.Evaluations conducted on both synthetic and field data demonstrate the model’s effectiveness in suppressing seismic noise with minimal signal leakage,outperforming some benchmark methods.
基金Project supported by the Program of Humanities and Social Science of the Education Ministry of China(Grant No.20YJA630008)the Natural Science Foundation of Zhejiang Province,China(Grant No.LY20G010004)the K C Wong Magna Fund in Ningbo University,China。
文摘Accurate prediction of road traffic flow is a significant part in the intelligent transportation systems.Accurate prediction can alleviate traffic congestion,and reduce environmental pollution.For the management department,it can make effective use of road resources.For individuals,it can help people plan their own travel paths,avoid congestion,and save time.Owing to complex factors on the road,such as damage to the detector and disturbances from environment,the measured traffic volume can contain noise.Reducing the influence of noise on traffic flow prediction is a piece of very important work.Therefore,in this paper we propose a combination algorithm of denoising and BILSTM to effectively improve the performance of traffic flow prediction.At the same time,three denoising algorithms are compared to find the best combination mode.In this paper,the wavelet(WL) denoising scheme,the empirical mode decomposition(EMD) denoising scheme,and the ensemble empirical mode decomposition(EEMD) denoising scheme are all introduced to suppress outliers in traffic flow data.In addition,we combine the denoising schemes with bidirectional long short-term memory(BILSTM)network to predict the traffic flow.The data in this paper are cited from performance measurement system(PeMS).We choose three kinds of road data(mainline,off ramp,on ramp) to predict traffic flow.The results for mainline show that data denoising can improve prediction accuracy.Moreover,prediction accuracy of BILSTM+EEMD scheme is the highest in the three methods(BILSTM+WL,BILSTM+EMD,BILSTM+EEMD).The results for off ramp and on ramp show the same performance as the results for mainline.It is indicated that this model is suitable for different road sections and long-term prediction.
基金supported by the National Natural Science Foundation of China(grant no.42304118)the Young Elite Scientist Sponsorship Program by BAST(grant no.BYESS2023027)the Science Foundation of China University of Petroleum,Beijing(grant no.2462022QNXZ001).
文摘Low-field nuclear magnetic resonance(NMR)has broad application prospects in the explo-ration and development of unconventional oil and gas reservoirs.However,NMR instruments tend to acquire echo signals with relatively low signal-to-noise ratio(SNR),resulting in poor accuracy of T2 spectrum inversion.It is crucial to preprocess the low SNR data with denoising methods before inversion.In this paper,a hybrid NMR data denoising method combining empirical mode decomposition-singular value decomposition(EMD-SVD)was proposed.Firstly,the echo data were decomposed with the EMD method to low-and high-frequency intrinsic mode function(IMF)components as well as a residual.Next,the SVD method was employed for the high-frequency IMF components denoising.Finally,the low-frequency IMF components,the denoised high-frequency IMF components,and the residual are summed to form the denoised signal.To validate the effectiveness and feasibility of the EMD-SVDmethod,numerical simulations,experimental data,and NMR log data processingwere conducted.The results indicate that the inverted NMR spectra with the EMD-SVD denoising method exhibit higher quality compared to the EMD method and the SVD method.
基金partially supported by the National Natural Science Foundation of China(Grant Nos.62033010,U23B2061)the Qing Lan Project of Jiangsu Province of China(Grant No.R2023Q07)the Joint Fund of Zhejiang Provincial Natural Science Foundation of China(Grant No.ZJMD25D050002)。
文摘To address the issue of low denoising accuracy of unmanned aerial vehicle(UAV)sensor data in a nonlinear non-Gaussian system,an adaptive central error entropy(CEE)—strong tracking cubature Kalman filter(STCKF)algorithm based on fuzzy broad learning system(fuzzy-BLS)is proposed in this paper.Although entropy algorithms are known to be effective for denoising in non-Gaussian systems,their application in nonlinear systems is still limited.To address this issue,this study combines the central error entropy criterion with the STCKF algorithm.This approach is boosted by the denoising capabilities of the STCKF algorithm for nonlinear systems,thereby compensating for the shortcomings of the CEE criterion for nonlinear systems and leveraging the advantages of CEE in non-Gaussian systems.Thus,the new algorithm has enhanced robustness and accuracy for nonlinear non-Gaussian systems.To further optimize this algorithm,a parameter update method based on fuzzyBLS is adopted to address the problem of excessive reliance on experience and lack of dependency in the selection of parameters,such as weight and kernel width,in the fusion of the CEE criterion.This method can dynamically adjust the optimal parameter template obtained from offline training online to minimize the root mean square error of the denoising results and provide adaptive denoising capability.Simulation and actual data denoising experiments confirmed that the proposed data denoising method accurately addresses the denoising problem of UAV sensor data in nonlinear non-Gaussian systems.
文摘In this paper, multi-scaled morphology is introduced into the digital processing domain for land seismic data. First, we describe the basic theory of multi-scaled morphology image decomposition of exploration seismic waves; second, we illustrate how to use multi-scaled morphology for seismic data processing using two real examples. The first example demonstrates suppressing the surface waves in pre-stack seismic records using multi-scaled morphology decomposition and reconstitution and the other example demonstrates filtering different interference waves on the seismic record. Multi-scaled morphology filtering separates signal from noise by the detailed differences of the wave shapes. The successful applications suggest that multi-scaled morphology has a promising application in seismic data processing.
基金financially supported by a grant from Research Affairs of Najafabad Branch,Islamic Azad University,Iran
文摘Successful modeling of hydroenvironmental processes widely relies on quantity and quality of accessible data,and noisy data can affect the modeling performance.On the other hand in training phase of any Artificial Intelligence(AI) based model,each training data set is usually a limited sample of possible patterns of the process and hence,might not show the behavior of whole population.Accordingly,in the present paper,wavelet-based denoising method was used to smooth hydrological time series.Thereafter,small normally distributed noises with the mean of zero and various standard deviations were generated and added to the smooth time series to form different denoised-jittered data sets.Finally,the obtained pre-processed data were imposed into Artificial Neural Network(ANN) and Adaptive Neuro-Fuzzy Inference System(ANFIS)models for daily runoff-sediment modeling of the Minnesota River.To evaluate the modeling performance,the outcomes were compared with results of multi linear regression(MLR) and Auto Regressive Integrated Moving Average(ARIMA)models.The comparison showed that the proposed data processing approach which serves both denoising and jittering techniques could enhance the performance of ANN and ANFIS based runoffsediment modeling of the case study up to 34%and 25%in the verification phase,respectively.
文摘Accurate short-term load forecasting is essential to modern power systems and smart grids. The utility can better implement demand-side management and operate power system stably with a reliable load forecasting system. The load demand contains a variety of different load components, and different loads operate with different frequencies. The conventional load forecasting methods, e.g., linear regression(LR), auto-regressive integrated moving average(ARIMA), deep neural network, ignore the frequency domain and can only use time-domain load demand as inputs. To make full use of both time-domain and frequency-domain features of the load demand, a load forecasting method based on hybrid empirical wavelet transform(EWT) and deep neural network is proposed in this paper. The proposed method first filters noises via wavelet-based denoising technique, and then decomposes the original load demand into several sub-layers to show the frequency features while the time-domain information is preserved as well. Then, a bidirectional long short-term memory(LSTM) method is trained for each sub-layer independently. In order to better tune the hyperparameters, a Bayesian hyperparameter optimization(BHO) algorithm is adopted in this paper. Three case studies are designed to evaluate the performance of the proposed method.From the results, it is found that the proposed method improves the prediction accuracy compared with other load forecasting method.
