Next-generation fire safety systems demand precise detection and motion recognition of flames.In-sensor computing,which integrates sensing,memory,and processing capabilities,has emerged as a key technology in flame de...Next-generation fire safety systems demand precise detection and motion recognition of flames.In-sensor computing,which integrates sensing,memory,and processing capabilities,has emerged as a key technology in flame detection.However,the implementation of hardware-level functional demonstrations based on artificial vision systems in the solar-blind ultraviolet(UV)band(200-280 nm)is hindered by the weak detection capability.Here,we propose Ga_(2)O_(3)/In_(2)Se_(3) heterojunctions for the ferroelectric(abbreviation:Fe)optoelectronic sensor(abbreviation:OES)array(5×5 pixels),which is capable of ultraweak UV light detection with an ultrahigh detectivity through ferroelectric regulation and features in configurable multimode functionality.The Fe-OES array can directly sense different flame motions and simulate the non-spiking gradient neurons of insect visual system.Moreover,the flame signal can be effectively amplified in combination with leaky integration-and-fire neuron hardware.Using this Fe-OES system and neuromorphic hardware,we successfully demonstrate three flame processing tasks:achieving efficient flame detection across all time periods with terminal and cloud-based alarms;flame motion recognition with a lightweight convolutional neural network achieving 96.47%accuracy;and flame light recognition with 90.51%accuracy by means of a photosensitive artificial neural system.This work provides effective tools and approaches for addressing a variety of complex flame detection tasks.展开更多
The converter steelmaking process represents a pivotal aspect of steel metallurgical production,with the characteristics of the flame at the furnace mouth serving as an indirect indicator of the internal smelting stag...The converter steelmaking process represents a pivotal aspect of steel metallurgical production,with the characteristics of the flame at the furnace mouth serving as an indirect indicator of the internal smelting stage.Effectively identifying and predicting the smelt-ing stage poses a significant challenge within industrial production.Traditional image-based methodologies,which rely on a single static flame image as input,demonstrate low recognition accuracy and inadequately extract the dynamic changes in smelting stage.To address this issue,the present study introduces an innovative recognition model that preprocesses flame video sequences from the furnace mouth and then employs a convolutional recurrent neural network(CRNN)to extract spatiotemporal features and derive recognition outputs.Ad-ditionally,we adopt feature layer visualization techniques to verify the model’s effectiveness and further enhance model performance by integrating the Bayesian optimization algorithm.The results indicate that the ResNet18 with convolutional block attention module(CBAM)in the convolutional layer demonstrates superior image feature extraction capabilities,achieving an accuracy of 90.70%and an area under the curve of 98.05%.The constructed Bayesian optimization-CRNN(BO-CRNN)model exhibits a significant improvement in comprehensive performance,with an accuracy of 97.01%and an area under the curve of 99.85%.Furthermore,statistics on the model’s average recognition time,computational complexity,and parameter quantity(Average recognition time:5.49 ms,floating-point opera-tions per second:18260.21 M(1 M=1×10^(6)),parameters:11.58 M)demonstrate superior performance.Through extensive repeated ex-periments on real-world datasets,the proposed CRNN model is capable of rapidly and accurately identifying smelting stages,offering a novel approach for converter smelting endpoint control.展开更多
基金supported by the Major Program(JD)of Hubei Province under Grant No.2023BAA009the National Natural Science Foundation of China(Grant No.22105162)+1 种基金the Natural Science Foundation of Hubei Province(Grant No.2023AFB623)the Original Exploration Seed Fund of Hubei University。
文摘Next-generation fire safety systems demand precise detection and motion recognition of flames.In-sensor computing,which integrates sensing,memory,and processing capabilities,has emerged as a key technology in flame detection.However,the implementation of hardware-level functional demonstrations based on artificial vision systems in the solar-blind ultraviolet(UV)band(200-280 nm)is hindered by the weak detection capability.Here,we propose Ga_(2)O_(3)/In_(2)Se_(3) heterojunctions for the ferroelectric(abbreviation:Fe)optoelectronic sensor(abbreviation:OES)array(5×5 pixels),which is capable of ultraweak UV light detection with an ultrahigh detectivity through ferroelectric regulation and features in configurable multimode functionality.The Fe-OES array can directly sense different flame motions and simulate the non-spiking gradient neurons of insect visual system.Moreover,the flame signal can be effectively amplified in combination with leaky integration-and-fire neuron hardware.Using this Fe-OES system and neuromorphic hardware,we successfully demonstrate three flame processing tasks:achieving efficient flame detection across all time periods with terminal and cloud-based alarms;flame motion recognition with a lightweight convolutional neural network achieving 96.47%accuracy;and flame light recognition with 90.51%accuracy by means of a photosensitive artificial neural system.This work provides effective tools and approaches for addressing a variety of complex flame detection tasks.
基金financially supported by the National Natural Science Foundation of China(No.52374320).
文摘The converter steelmaking process represents a pivotal aspect of steel metallurgical production,with the characteristics of the flame at the furnace mouth serving as an indirect indicator of the internal smelting stage.Effectively identifying and predicting the smelt-ing stage poses a significant challenge within industrial production.Traditional image-based methodologies,which rely on a single static flame image as input,demonstrate low recognition accuracy and inadequately extract the dynamic changes in smelting stage.To address this issue,the present study introduces an innovative recognition model that preprocesses flame video sequences from the furnace mouth and then employs a convolutional recurrent neural network(CRNN)to extract spatiotemporal features and derive recognition outputs.Ad-ditionally,we adopt feature layer visualization techniques to verify the model’s effectiveness and further enhance model performance by integrating the Bayesian optimization algorithm.The results indicate that the ResNet18 with convolutional block attention module(CBAM)in the convolutional layer demonstrates superior image feature extraction capabilities,achieving an accuracy of 90.70%and an area under the curve of 98.05%.The constructed Bayesian optimization-CRNN(BO-CRNN)model exhibits a significant improvement in comprehensive performance,with an accuracy of 97.01%and an area under the curve of 99.85%.Furthermore,statistics on the model’s average recognition time,computational complexity,and parameter quantity(Average recognition time:5.49 ms,floating-point opera-tions per second:18260.21 M(1 M=1×10^(6)),parameters:11.58 M)demonstrate superior performance.Through extensive repeated ex-periments on real-world datasets,the proposed CRNN model is capable of rapidly and accurately identifying smelting stages,offering a novel approach for converter smelting endpoint control.
