The converter steelmaking process represents a pivotal aspect of steel metallurgical production,with the characteristics of the flame at the furnace mouth serving as an indirect indicator of the internal smelting stag...The converter steelmaking process represents a pivotal aspect of steel metallurgical production,with the characteristics of the flame at the furnace mouth serving as an indirect indicator of the internal smelting stage.Effectively identifying and predicting the smelt-ing stage poses a significant challenge within industrial production.Traditional image-based methodologies,which rely on a single static flame image as input,demonstrate low recognition accuracy and inadequately extract the dynamic changes in smelting stage.To address this issue,the present study introduces an innovative recognition model that preprocesses flame video sequences from the furnace mouth and then employs a convolutional recurrent neural network(CRNN)to extract spatiotemporal features and derive recognition outputs.Ad-ditionally,we adopt feature layer visualization techniques to verify the model’s effectiveness and further enhance model performance by integrating the Bayesian optimization algorithm.The results indicate that the ResNet18 with convolutional block attention module(CBAM)in the convolutional layer demonstrates superior image feature extraction capabilities,achieving an accuracy of 90.70%and an area under the curve of 98.05%.The constructed Bayesian optimization-CRNN(BO-CRNN)model exhibits a significant improvement in comprehensive performance,with an accuracy of 97.01%and an area under the curve of 99.85%.Furthermore,statistics on the model’s average recognition time,computational complexity,and parameter quantity(Average recognition time:5.49 ms,floating-point opera-tions per second:18260.21 M(1 M=1×10^(6)),parameters:11.58 M)demonstrate superior performance.Through extensive repeated ex-periments on real-world datasets,the proposed CRNN model is capable of rapidly and accurately identifying smelting stages,offering a novel approach for converter smelting endpoint control.展开更多
In this paper,a new study concerning the usage of artificial neural networks in the control application is given.It is shown,that the data gathered during proper operation of a given control plant can be used in the l...In this paper,a new study concerning the usage of artificial neural networks in the control application is given.It is shown,that the data gathered during proper operation of a given control plant can be used in the learning process to fully embrace the control pattern.Interestingly,the instances driven by neural networks have the ability to outperform the original analytically driven scenarios.Three different control schemes,namely perfect,linear-quadratic,and generalized predictive controllers were used in the theoretical study.In addition,the nonlinear recurrent neural network-based generalized predictive controller with the radial basis function-originated predictor was obtained to exemplify the main results of the paper regarding the real-world application.展开更多
Electric vehicles(EVs)are gradually being deployed in the transportation sector.Although they have a high impact on reducing greenhouse gas emissions,their penetration is challenged by their random energy demand and d...Electric vehicles(EVs)are gradually being deployed in the transportation sector.Although they have a high impact on reducing greenhouse gas emissions,their penetration is challenged by their random energy demand and difficult scheduling of their optimal charging.To cope with these problems,this paper presents a novel approach for photovoltaic grid-connected microgrid EV charging station energy demand forecasting.The present study is part of a comprehensive framework involving emerging technologies such as drones and artificial intelligence designed to support the EVs’charging scheduling task.By using predictive algorithms for solar generation and load demand estimation,this approach aimed at ensuring dynamic and efficient energy flow between the solar energy source,the grid and the electric vehicles.The main contribution of this paper lies in developing an intelligent approach based on deep recurrent neural networks to forecast the energy demand using only its previous records.Therefore,various forecasters based on Long Short-term Memory,Gated Recurrent Unit,and their bi-directional and stacked variants were investigated using a real dataset collected from an EV charging station located at Trieste University(Italy).The developed forecasters have been evaluated and compared according to different metrics,including R,RMSE,MAE,and MAPE.We found that the obtained R values for both PV power generation and energy demand ranged between 97%and 98%.These study findings can be used for reliable and efficient decision-making on the management side of the optimal scheduling of the charging operations.展开更多
This study presents CGB-Net,a novel deep learning architecture specifically developed for classifying twelve distinct sleep positions using a single abdominal accelerometer,with direct applicability to gastroesophagea...This study presents CGB-Net,a novel deep learning architecture specifically developed for classifying twelve distinct sleep positions using a single abdominal accelerometer,with direct applicability to gastroesophageal reflux disease(GERD)monitoring.Unlike conventional approaches limited to four basic postures,CGB-Net enables fine-grained classification of twelve clinically relevant sleep positions,providing enhanced resolution for personalized health assessment.The architecture introduces a unique integration of three complementary components:1D Convolutional Neural Networks(1D-CNN)for efficient local spatial feature extraction,Gated Recurrent Units(GRU)to capture short-termtemporal dependencieswith reduced computational complexity,and Bidirectional Long Short-Term Memory(Bi-LSTM)networks for modeling long-term temporal context in both forward and backward directions.This complementary integration allows the model to better represent dynamic and contextual information inherent in the sensor data,surpassing the performance of simpler or previously published hybrid models.Experiments were conducted on a benchmark dataset consisting of 18 volunteers(age range:19–24 years,mean 20.56±1.1 years;height 164.78±8.18 cm;weight 55.39±8.30 kg;BMI 20.24±2.04),monitored via a single abdominal accelerometer.A subjectindependent evaluation protocol with multiple random splits was employed to ensure robustness and generalizability.The proposed model achieves an average Accuracy of 87.60% and F1-score of 83.38%,both reported with standard deviations over multiple runs,outperforming several baseline and state-of-the-art methods.By releasing the dataset publicly and detailing themodel design,this work aims to facilitate reproducibility and advance research in sleep posture classification for clinical applications.展开更多
In the pharmaceutical industry,model-based prediction is a crucial stage in process development that allows pharmaceutical companies to simulate different scenarios toward improving process efficiency,reducing costs,a...In the pharmaceutical industry,model-based prediction is a crucial stage in process development that allows pharmaceutical companies to simulate different scenarios toward improving process efficiency,reducing costs,and enhancing product quality.Nevertheless,ensuring the quality of formulated pharmaceutical products through the management of raw material variations has always been a challenging task.In this work,data-driven chance-constrained recurrent neural networks(CCRNNs)are developed to address the issue arising from raw material uncertainty.Our goal is to explore how,by proactively incorporating uncertainty into the model training process,more accurate predictions and enhanced robustness can be realized.The proposed approach is tested on a fluid bed dryer(FBD)from a continuous pharmaceutical manufacturing pilot plant.The results demonstrate that CCRNN models offer more robust and accurate predictions for the critical quality attribute(CQA)-in this case,moisture content-when material variations occur,compared with conventional recurrent neural network-based models.展开更多
The task of detecting fraud in credit card transactions is crucial to ensure the security and stability of a financial system,as well as to enforce customer confidence in digital payment systems.Historically,credit ca...The task of detecting fraud in credit card transactions is crucial to ensure the security and stability of a financial system,as well as to enforce customer confidence in digital payment systems.Historically,credit card companies have used rulebased approaches to detect fraudulent transactions,but these have proven inadequate due to the complexity of fraud strategies and have been replaced by much more powerful solutions based on machine learning or deep learning algorithms.Despite significant progress,the current approaches to fraud detection suffer from a number of limitations:for example,it is unclear whether some transaction features are more effective than others in discriminating fraudulent transactions,and they often neglect possible correlations among transactions,even though they could reveal illicit behaviour.In this paper,we propose a novel credit card fraud detection(CCFD)method based on a transaction behaviour-based hierarchical gated network.First,we introduce a feature-oriented extraction module capable of identifying key features from original transactions,and such analysis is effective in revealing the behavioural characteristics of fraudsters.Second,we design a transaction-oriented extraction module capable of capturing the correlation between users’historical and current transactional behaviour.Such information is crucial for revealing users’sequential behaviour patterns.Our approach,called transactional-behaviour-based hierarchical gated network model(TbHGN),extracts two types of new transactional features,which are then combined in a feature interaction module to learn the final transactional representations used for CCFD.We have conducted extensive experiments on a real-world credit card transaction dataset with an increase in average F1 between 1.42%and 6.53%and an improvement in average AUC between 0.63%and 2.78%over the state of the art.展开更多
Accelerating urbanization and the rapid development of intelligent transportation systems have rendered shortterm traffic flow prediction an important research field.Accurate prediction of traffic flow is beneficial f...Accelerating urbanization and the rapid development of intelligent transportation systems have rendered shortterm traffic flow prediction an important research field.Accurate prediction of traffic flow is beneficial for the optimization of traffic planning,improvement of road utilization,reduction of traffic congestion,and reduction in the incidence of traffic accidents.However,data pertaining to traffic flow are typically influenced by a multitude of factors,resulting in data that exhibit a considerable degree of nonlinearity and complexity.To address the issue of noise in raw traffic flow data,this study proposes a hybrid model that combines variational mode decomposition(VMD),a bidirectional long short-term memory network(BiLSTM),and a gated recurrent unit(GRU)for short-term traffic flow prediction.To validate the effectiveness of the model,an experimental validation was conducted based on traffic flow data from UK highways,and the performance of the model was compared with common benchmark models.The experimental results demonstrate that the proposed method yields superior prediction results in terms of mean absolute error,coefficient of determination,and root-mean-square error compared to existing prediction techniques,thereby substantiating its efficacy in short-term traffic flow prediction.展开更多
目的实时渲染图形程序(如游戏、虚拟现实等)对高分辨率和高刷新率的要求越来越高,因此,针对渲染图像的实时超分辨率技术在实时渲染中非常必要。然而,现有的视频超分算法和实时渲染处于不同的数据处理管线之中,这导致其难以直接应用到实...目的实时渲染图形程序(如游戏、虚拟现实等)对高分辨率和高刷新率的要求越来越高,因此,针对渲染图像的实时超分辨率技术在实时渲染中非常必要。然而,现有的视频超分算法和实时渲染处于不同的数据处理管线之中,这导致其难以直接应用到实时渲染管线里。方法对此,提出了一个基于帧循环结构的实时神经超采样方法。充分利用实时渲染管线中生成的低分辨场景几何数据,以提升超采样网络对于三维空间信息的感知力;将帧循环框架结合到超采样方法中,通过引入先前帧重建结果的特征来改善当前帧的重建结果,从而实现时间尺度上的稳定性;将重加权网络和注意力网络置于特征提取模块中,以提升提取到的特征的有效性。此外,本文还提出了一个面向神经超采样的实时渲染流程,该流程能够将超采样网络部署至图形计算管线之上,并与实时渲染管线相结合。结果与同样能够实时且效果较好的基准方法面向实时渲染的神经超采样(neural super-sampling for real-time rendering,NSRR)比较,本文方法在速度少许提升的前提下,图像质量指标峰值信噪比(peak signal to noise ratio,PSNR)平均提升了0.4 dB,并在部署到实时渲染管线后,通过轻量化裁剪继续保持实时性且部分场景效果仍然优于非实时的部署后NSRR;在网络模块的消融实验中也证明了各个子模块对于神经超采样任务的有效性。结论本文提出的神经超采样网络模型与搭建的神经超采样渲染流程,在取得更好效果的同时具有一定的实用价值。展开更多
基金financially supported by the National Natural Science Foundation of China(No.52374320).
文摘The converter steelmaking process represents a pivotal aspect of steel metallurgical production,with the characteristics of the flame at the furnace mouth serving as an indirect indicator of the internal smelting stage.Effectively identifying and predicting the smelt-ing stage poses a significant challenge within industrial production.Traditional image-based methodologies,which rely on a single static flame image as input,demonstrate low recognition accuracy and inadequately extract the dynamic changes in smelting stage.To address this issue,the present study introduces an innovative recognition model that preprocesses flame video sequences from the furnace mouth and then employs a convolutional recurrent neural network(CRNN)to extract spatiotemporal features and derive recognition outputs.Ad-ditionally,we adopt feature layer visualization techniques to verify the model’s effectiveness and further enhance model performance by integrating the Bayesian optimization algorithm.The results indicate that the ResNet18 with convolutional block attention module(CBAM)in the convolutional layer demonstrates superior image feature extraction capabilities,achieving an accuracy of 90.70%and an area under the curve of 98.05%.The constructed Bayesian optimization-CRNN(BO-CRNN)model exhibits a significant improvement in comprehensive performance,with an accuracy of 97.01%and an area under the curve of 99.85%.Furthermore,statistics on the model’s average recognition time,computational complexity,and parameter quantity(Average recognition time:5.49 ms,floating-point opera-tions per second:18260.21 M(1 M=1×10^(6)),parameters:11.58 M)demonstrate superior performance.Through extensive repeated ex-periments on real-world datasets,the proposed CRNN model is capable of rapidly and accurately identifying smelting stages,offering a novel approach for converter smelting endpoint control.
文摘In this paper,a new study concerning the usage of artificial neural networks in the control application is given.It is shown,that the data gathered during proper operation of a given control plant can be used in the learning process to fully embrace the control pattern.Interestingly,the instances driven by neural networks have the ability to outperform the original analytically driven scenarios.Three different control schemes,namely perfect,linear-quadratic,and generalized predictive controllers were used in the theoretical study.In addition,the nonlinear recurrent neural network-based generalized predictive controller with the radial basis function-originated predictor was obtained to exemplify the main results of the paper regarding the real-world application.
基金University of Jeddah,Jeddah,Saudi Arabia,grant No.(UJ-23-SRP-10).
文摘Electric vehicles(EVs)are gradually being deployed in the transportation sector.Although they have a high impact on reducing greenhouse gas emissions,their penetration is challenged by their random energy demand and difficult scheduling of their optimal charging.To cope with these problems,this paper presents a novel approach for photovoltaic grid-connected microgrid EV charging station energy demand forecasting.The present study is part of a comprehensive framework involving emerging technologies such as drones and artificial intelligence designed to support the EVs’charging scheduling task.By using predictive algorithms for solar generation and load demand estimation,this approach aimed at ensuring dynamic and efficient energy flow between the solar energy source,the grid and the electric vehicles.The main contribution of this paper lies in developing an intelligent approach based on deep recurrent neural networks to forecast the energy demand using only its previous records.Therefore,various forecasters based on Long Short-term Memory,Gated Recurrent Unit,and their bi-directional and stacked variants were investigated using a real dataset collected from an EV charging station located at Trieste University(Italy).The developed forecasters have been evaluated and compared according to different metrics,including R,RMSE,MAE,and MAPE.We found that the obtained R values for both PV power generation and energy demand ranged between 97%and 98%.These study findings can be used for reliable and efficient decision-making on the management side of the optimal scheduling of the charging operations.
基金funded by Vietnam National Foundation for Science and Technology Development(NAFOSTED)under grant number:NCUD.02-2024.11.
文摘This study presents CGB-Net,a novel deep learning architecture specifically developed for classifying twelve distinct sleep positions using a single abdominal accelerometer,with direct applicability to gastroesophageal reflux disease(GERD)monitoring.Unlike conventional approaches limited to four basic postures,CGB-Net enables fine-grained classification of twelve clinically relevant sleep positions,providing enhanced resolution for personalized health assessment.The architecture introduces a unique integration of three complementary components:1D Convolutional Neural Networks(1D-CNN)for efficient local spatial feature extraction,Gated Recurrent Units(GRU)to capture short-termtemporal dependencieswith reduced computational complexity,and Bidirectional Long Short-Term Memory(Bi-LSTM)networks for modeling long-term temporal context in both forward and backward directions.This complementary integration allows the model to better represent dynamic and contextual information inherent in the sensor data,surpassing the performance of simpler or previously published hybrid models.Experiments were conducted on a benchmark dataset consisting of 18 volunteers(age range:19–24 years,mean 20.56±1.1 years;height 164.78±8.18 cm;weight 55.39±8.30 kg;BMI 20.24±2.04),monitored via a single abdominal accelerometer.A subjectindependent evaluation protocol with multiple random splits was employed to ensure robustness and generalizability.The proposed model achieves an average Accuracy of 87.60% and F1-score of 83.38%,both reported with standard deviations over multiple runs,outperforming several baseline and state-of-the-art methods.By releasing the dataset publicly and detailing themodel design,this work aims to facilitate reproducibility and advance research in sleep posture classification for clinical applications.
基金Financial support from the Engineering and Physical Sciences Research Council grant EP/V034723/1(RiFTMaP)is gratefully acknowledged.
文摘In the pharmaceutical industry,model-based prediction is a crucial stage in process development that allows pharmaceutical companies to simulate different scenarios toward improving process efficiency,reducing costs,and enhancing product quality.Nevertheless,ensuring the quality of formulated pharmaceutical products through the management of raw material variations has always been a challenging task.In this work,data-driven chance-constrained recurrent neural networks(CCRNNs)are developed to address the issue arising from raw material uncertainty.Our goal is to explore how,by proactively incorporating uncertainty into the model training process,more accurate predictions and enhanced robustness can be realized.The proposed approach is tested on a fluid bed dryer(FBD)from a continuous pharmaceutical manufacturing pilot plant.The results demonstrate that CCRNN models offer more robust and accurate predictions for the critical quality attribute(CQA)-in this case,moisture content-when material variations occur,compared with conventional recurrent neural network-based models.
基金supported in part by the National Natural Science Foundation of China(61972241)the Natural Science Foundation of Shanghai(24ZR1427500,22ZR1427100)+1 种基金the Key Projects of Natural Science Research in Anhui Higher Education Institutions(2022AH051909)Bengbu University 2021 High-Level Scientific Research and Cultivation Project(2021pyxm04).
文摘The task of detecting fraud in credit card transactions is crucial to ensure the security and stability of a financial system,as well as to enforce customer confidence in digital payment systems.Historically,credit card companies have used rulebased approaches to detect fraudulent transactions,but these have proven inadequate due to the complexity of fraud strategies and have been replaced by much more powerful solutions based on machine learning or deep learning algorithms.Despite significant progress,the current approaches to fraud detection suffer from a number of limitations:for example,it is unclear whether some transaction features are more effective than others in discriminating fraudulent transactions,and they often neglect possible correlations among transactions,even though they could reveal illicit behaviour.In this paper,we propose a novel credit card fraud detection(CCFD)method based on a transaction behaviour-based hierarchical gated network.First,we introduce a feature-oriented extraction module capable of identifying key features from original transactions,and such analysis is effective in revealing the behavioural characteristics of fraudsters.Second,we design a transaction-oriented extraction module capable of capturing the correlation between users’historical and current transactional behaviour.Such information is crucial for revealing users’sequential behaviour patterns.Our approach,called transactional-behaviour-based hierarchical gated network model(TbHGN),extracts two types of new transactional features,which are then combined in a feature interaction module to learn the final transactional representations used for CCFD.We have conducted extensive experiments on a real-world credit card transaction dataset with an increase in average F1 between 1.42%and 6.53%and an improvement in average AUC between 0.63%and 2.78%over the state of the art.
基金supported by the Enterprise Innovation Consortium Project under the Major Special Science and Technology Project of Gansu Province(Grant No.22ZD6GA010).
文摘Accelerating urbanization and the rapid development of intelligent transportation systems have rendered shortterm traffic flow prediction an important research field.Accurate prediction of traffic flow is beneficial for the optimization of traffic planning,improvement of road utilization,reduction of traffic congestion,and reduction in the incidence of traffic accidents.However,data pertaining to traffic flow are typically influenced by a multitude of factors,resulting in data that exhibit a considerable degree of nonlinearity and complexity.To address the issue of noise in raw traffic flow data,this study proposes a hybrid model that combines variational mode decomposition(VMD),a bidirectional long short-term memory network(BiLSTM),and a gated recurrent unit(GRU)for short-term traffic flow prediction.To validate the effectiveness of the model,an experimental validation was conducted based on traffic flow data from UK highways,and the performance of the model was compared with common benchmark models.The experimental results demonstrate that the proposed method yields superior prediction results in terms of mean absolute error,coefficient of determination,and root-mean-square error compared to existing prediction techniques,thereby substantiating its efficacy in short-term traffic flow prediction.
文摘目的实时渲染图形程序(如游戏、虚拟现实等)对高分辨率和高刷新率的要求越来越高,因此,针对渲染图像的实时超分辨率技术在实时渲染中非常必要。然而,现有的视频超分算法和实时渲染处于不同的数据处理管线之中,这导致其难以直接应用到实时渲染管线里。方法对此,提出了一个基于帧循环结构的实时神经超采样方法。充分利用实时渲染管线中生成的低分辨场景几何数据,以提升超采样网络对于三维空间信息的感知力;将帧循环框架结合到超采样方法中,通过引入先前帧重建结果的特征来改善当前帧的重建结果,从而实现时间尺度上的稳定性;将重加权网络和注意力网络置于特征提取模块中,以提升提取到的特征的有效性。此外,本文还提出了一个面向神经超采样的实时渲染流程,该流程能够将超采样网络部署至图形计算管线之上,并与实时渲染管线相结合。结果与同样能够实时且效果较好的基准方法面向实时渲染的神经超采样(neural super-sampling for real-time rendering,NSRR)比较,本文方法在速度少许提升的前提下,图像质量指标峰值信噪比(peak signal to noise ratio,PSNR)平均提升了0.4 dB,并在部署到实时渲染管线后,通过轻量化裁剪继续保持实时性且部分场景效果仍然优于非实时的部署后NSRR;在网络模块的消融实验中也证明了各个子模块对于神经超采样任务的有效性。结论本文提出的神经超采样网络模型与搭建的神经超采样渲染流程,在取得更好效果的同时具有一定的实用价值。
