Deep neural networks(DNNs)have drawn great attention as they perform the state-of-the-art results on many tasks.Compared to DNNs,spiking neural networks(SNNs),which are considered as the new generation of neural netwo...Deep neural networks(DNNs)have drawn great attention as they perform the state-of-the-art results on many tasks.Compared to DNNs,spiking neural networks(SNNs),which are considered as the new generation of neural networks,fail to achieve comparable performance especially on tasks with large problem sizes.Many previous work tried to close the gap between DNNs and SNNs but used small networks on simple tasks.This work proposes a simple but effective way to construct deep spiking neural networks(DSNNs)by transferring the learned ability of DNNs to SNNs.DSNNs achieve comparable accuracy on large networks and complex datasets.展开更多
Spiking Neural Network(SNN)inspired by the biological triggering mechanism of neurons to provide a novel solution for plant disease detection,offering enhanced performance and efficiency in contrast to Artificial Neur...Spiking Neural Network(SNN)inspired by the biological triggering mechanism of neurons to provide a novel solution for plant disease detection,offering enhanced performance and efficiency in contrast to Artificial Neural Networks(ANN).Unlike conventional ANNs,which process static images without fully capturing the inherent temporal dynamics,our approach represents the first implementation of SNNs tailored explicitly for agricultural disease classification,integrating an encoding method to convert static RGB plant images into temporally encoded spike trains.Additionally,while Bernoulli trials and standard deep learning architectures likeConvolutionalNeuralNetworks(CNNs)and Fully Connected Neural Networks(FCNNs)have been used extensively,our work is the first to integrate these trials within an SNN framework specifically for agricultural applications.This integration not only refines spike regulation and reduces computational overhead by 30%but also delivers superior accuracy(93.4%)in plant disease classification,marking a significant advancement in precision agriculture that has not been previously explored.Our approach uniquely transforms static plant leaf images into time-dependent representations,leveraging SNNs’intrinsic temporal processing capabilities.This approach aligns with the inherent ability of SNNs to capture dynamic,timedependent patterns,making them more suitable for detecting disease activations in plants than conventional ANNs that treat inputs as static entities.Unlike prior works,our hybrid encoding scheme dynamically adapts to pixel intensity variations(via threshold),enabling robust feature extraction under diverse agricultural conditions.The dual-stage preprocessing customizes the SNN’s behavior in two ways:the encoding threshold is derived from pixel distributions in diseased regions,and Bernoulli trials selectively reduce redundant spikes to ensure energy efficiency on low-power devices.We used a comprehensive dataset of 87,000 RGB images of plant leaves,which included 38 distinct classes of healthy and unhealthy leaves.To train and evaluate three distinct neural network architectures,DeepSNN,SimpleCNN,and SimpleFCNN,the dataset was rigorously preprocessed,including stochastic rotation,horizontal flip,resizing,and normalization.Moreover,by integrating Bernoulli trials to regulate spike generation,ourmethod focuses on extracting themost relevant featureswhile reducingcomputational overhead.Using a comprehensivedatasetof87,000RGB images across 38 classes,we rigorously preprocessed the data and evaluated three architectures:DeepSNN,SimpleCNN,and SimpleFCNN.The results demonstrate that DeepSNN outperforms the other models,achieving superior accuracy,efficient feature extraction,and robust spike management,thereby establishing the potential of SNNs for real-time,energy-efficient agricultural applications.展开更多
The event-based vision sensor(EVS),which can generate efficient spiking data streams by exclusively detecting motion,exemplifies neuromorphic vision methodologies.Generally,its inherent lack of texture features limits...The event-based vision sensor(EVS),which can generate efficient spiking data streams by exclusively detecting motion,exemplifies neuromorphic vision methodologies.Generally,its inherent lack of texture features limits effectiveness in complex vision processing tasks,necessitating supplementary visual information.However,to date,no event-based hybrid vision solution has been developed that preserves the characteristics of complete spike data streams to support synchronous computation architectures based on spiking neural network(SNN).In this paper,we present a novel spike-based sensor with digitized pixels,which integrates the event detection structure with the pulse frequency modulation(PFM)circuit.This design enables the simultaneous output of spiking data that encodes both temporal changes and texture information.Fabricated in 180 nm process,the proposed sensor achieves a resolution of 128×128,a maximum event rate of 960 Meps,a grayscale frame rate of 117.1 kfps,and a measured power consumption of 60.1 mW,which is suited for high-speed,low-latency,edge SNNbased vision computing systems.展开更多
基金the National Natural Science Foundation of China(No.61732007)Strategic Priority Research Program of Chinese Academy of Sciences(XDB32050200,XDC01020000).
文摘Deep neural networks(DNNs)have drawn great attention as they perform the state-of-the-art results on many tasks.Compared to DNNs,spiking neural networks(SNNs),which are considered as the new generation of neural networks,fail to achieve comparable performance especially on tasks with large problem sizes.Many previous work tried to close the gap between DNNs and SNNs but used small networks on simple tasks.This work proposes a simple but effective way to construct deep spiking neural networks(DSNNs)by transferring the learned ability of DNNs to SNNs.DSNNs achieve comparable accuracy on large networks and complex datasets.
基金supported in part by the Basic Science Research Program through the National Research Foundation of Korea(NRF),funded by the Ministry of Education(NRF-2021R1A6A1A03039493).
文摘Spiking Neural Network(SNN)inspired by the biological triggering mechanism of neurons to provide a novel solution for plant disease detection,offering enhanced performance and efficiency in contrast to Artificial Neural Networks(ANN).Unlike conventional ANNs,which process static images without fully capturing the inherent temporal dynamics,our approach represents the first implementation of SNNs tailored explicitly for agricultural disease classification,integrating an encoding method to convert static RGB plant images into temporally encoded spike trains.Additionally,while Bernoulli trials and standard deep learning architectures likeConvolutionalNeuralNetworks(CNNs)and Fully Connected Neural Networks(FCNNs)have been used extensively,our work is the first to integrate these trials within an SNN framework specifically for agricultural applications.This integration not only refines spike regulation and reduces computational overhead by 30%but also delivers superior accuracy(93.4%)in plant disease classification,marking a significant advancement in precision agriculture that has not been previously explored.Our approach uniquely transforms static plant leaf images into time-dependent representations,leveraging SNNs’intrinsic temporal processing capabilities.This approach aligns with the inherent ability of SNNs to capture dynamic,timedependent patterns,making them more suitable for detecting disease activations in plants than conventional ANNs that treat inputs as static entities.Unlike prior works,our hybrid encoding scheme dynamically adapts to pixel intensity variations(via threshold),enabling robust feature extraction under diverse agricultural conditions.The dual-stage preprocessing customizes the SNN’s behavior in two ways:the encoding threshold is derived from pixel distributions in diseased regions,and Bernoulli trials selectively reduce redundant spikes to ensure energy efficiency on low-power devices.We used a comprehensive dataset of 87,000 RGB images of plant leaves,which included 38 distinct classes of healthy and unhealthy leaves.To train and evaluate three distinct neural network architectures,DeepSNN,SimpleCNN,and SimpleFCNN,the dataset was rigorously preprocessed,including stochastic rotation,horizontal flip,resizing,and normalization.Moreover,by integrating Bernoulli trials to regulate spike generation,ourmethod focuses on extracting themost relevant featureswhile reducingcomputational overhead.Using a comprehensivedatasetof87,000RGB images across 38 classes,we rigorously preprocessed the data and evaluated three architectures:DeepSNN,SimpleCNN,and SimpleFCNN.The results demonstrate that DeepSNN outperforms the other models,achieving superior accuracy,efficient feature extraction,and robust spike management,thereby establishing the potential of SNNs for real-time,energy-efficient agricultural applications.
基金supported in part by the National Key Research and Development Program of China(Grant No.2022YFB2804401)the National Natural Science Foundation of China(Grant Nos.62334008,62134004,62404218)+1 种基金the Beijing Natural Science Foundation(Grant No.Z220005)Chinese Academy of Sciences(Grant No.ZDBS-LY-JSC008).
文摘The event-based vision sensor(EVS),which can generate efficient spiking data streams by exclusively detecting motion,exemplifies neuromorphic vision methodologies.Generally,its inherent lack of texture features limits effectiveness in complex vision processing tasks,necessitating supplementary visual information.However,to date,no event-based hybrid vision solution has been developed that preserves the characteristics of complete spike data streams to support synchronous computation architectures based on spiking neural network(SNN).In this paper,we present a novel spike-based sensor with digitized pixels,which integrates the event detection structure with the pulse frequency modulation(PFM)circuit.This design enables the simultaneous output of spiking data that encodes both temporal changes and texture information.Fabricated in 180 nm process,the proposed sensor achieves a resolution of 128×128,a maximum event rate of 960 Meps,a grayscale frame rate of 117.1 kfps,and a measured power consumption of 60.1 mW,which is suited for high-speed,low-latency,edge SNNbased vision computing systems.
