Synaptic pruning is a crucial process in synaptic refinement,eliminating unstable synaptic connections in neural circuits.This process is triggered and regulated primarily by spontaneous neural activity and experience...Synaptic pruning is a crucial process in synaptic refinement,eliminating unstable synaptic connections in neural circuits.This process is triggered and regulated primarily by spontaneous neural activity and experience-dependent mechanisms.The pruning process involves multiple molecular signals and a series of regulatory activities governing the“eat me”and“don't eat me”states.Under physiological conditions,the interaction between glial cells and neurons results in the clearance of unnecessary synapses,maintaining normal neural circuit functionality via synaptic pruning.Alterations in genetic and environmental factors can lead to imbalanced synaptic pruning,thus promoting the occurrence and development of autism spectrum disorder,schizophrenia,Alzheimer's disease,and other neurological disorders.In this review,we investigated the molecular mechanisms responsible for synaptic pruning during neural development.We focus on how synaptic pruning can regulate neural circuits and its association with neurological disorders.Furthermore,we discuss the application of emerging optical and imaging technologies to observe synaptic structure and function,as well as their potential for clinical translation.Our aim was to enhance our understanding of synaptic pruning during neural development,including the molecular basis underlying the regulation of synaptic function and the dynamic changes in synaptic density,and to investigate the potential role of these mechanisms in the pathophysiology of neurological diseases,thus providing a theoretical foundation for the treatment of neurological disorders.展开更多
The surge of large-scale models in recent years has led to breakthroughs in numerous fields,but it has also introduced higher computational costs and more complex network architectures.These increasingly large and int...The surge of large-scale models in recent years has led to breakthroughs in numerous fields,but it has also introduced higher computational costs and more complex network architectures.These increasingly large and intricate networks pose challenges for deployment and execution while also exacerbating the issue of network over-parameterization.To address this issue,various network compression techniques have been developed,such as network pruning.A typical pruning algorithm follows a three-step pipeline involving training,pruning,and retraining.Existing methods often directly set the pruned filters to zero during retraining,significantly reducing the parameter space.However,this direct pruning strategy frequently results in irreversible information loss.In the early stages of training,a network still contains much uncertainty,and evaluating filter importance may not be sufficiently rigorous.To manage the pruning process effectively,this paper proposes a flexible neural network pruning algorithm based on the logistic growth differential equation,considering the characteristics of network training.Unlike other pruning algorithms that directly reduce filter weights,this algorithm introduces a three-stage adaptive weight decay strategy inspired by the logistic growth differential equation.It employs a gentle decay rate in the initial training stage,a rapid decay rate during the intermediate stage,and a slower decay rate in the network convergence stage.Additionally,the decay rate is adjusted adaptively based on the filter weights at each stage.By controlling the adaptive decay rate at each stage,the pruning of neural network filters can be effectively managed.In experiments conducted on the CIFAR-10 and ILSVRC-2012 datasets,the pruning of neural networks significantly reduces the floating-point operations while maintaining the same pruning rate.Specifically,when implementing a 30%pruning rate on the ResNet-110 network,the pruned neural network not only decreases floating-point operations by 40.8%but also enhances the classification accuracy by 0.49%compared to the original network.展开更多
The rapid growth of digital data necessitates advanced natural language processing(NLP)models like BERT(Bidi-rectional Encoder Representations from Transformers),known for its superior performance in text classificati...The rapid growth of digital data necessitates advanced natural language processing(NLP)models like BERT(Bidi-rectional Encoder Representations from Transformers),known for its superior performance in text classification.However,BERT’s size and computational demands limit its practicality,especially in resource-constrained settings.This research compresses the BERT base model for Bengali emotion classification through knowledge distillation(KD),pruning,and quantization techniques.Despite Bengali being the sixth most spoken language globally,NLP research in this area is limited.Our approach addresses this gap by creating an efficient BERT-based model for Bengali text.We have explored 20 combinations for KD,quantization,and pruning,resulting in improved speedup,fewer parameters,and reduced memory size.Our best results demonstrate significant improvements in both speed and efficiency.For instance,in the case of mBERT,we achieved a 3.87×speedup and 4×compression ratio with a combination of Distil+Prune+Quant that reduced parameters from 178 to 46 M,while the memory size decreased from 711 to 178 MB.These results offer scalable solutions for NLP tasks in various languages and advance the field of model compression,making these models suitable for real-world applications in resource-limited environments.展开更多
Accurate traffic flow prediction(TFP)is vital for efficient and sustainable transportation management and the development of intelligent traffic systems.However,missing data in real-world traffic datasets poses a sign...Accurate traffic flow prediction(TFP)is vital for efficient and sustainable transportation management and the development of intelligent traffic systems.However,missing data in real-world traffic datasets poses a significant challenge to maintaining prediction precision.This study introduces REPTF-TMDI,a novel method that combines a Reduced Error Pruning Tree Forest(REPTree Forest)with a newly proposed Time-based Missing Data Imputation(TMDI)approach.The REP Tree Forest,an ensemble learning approach,is tailored for time-related traffic data to enhance predictive accuracy and support the evolution of sustainable urbanmobility solutions.Meanwhile,the TMDI approach exploits temporal patterns to estimate missing values reliably whenever empty fields are encountered.The proposed method was evaluated using hourly traffic flow data from a major U.S.roadway spanning 2012-2018,incorporating temporal features(e.g.,hour,day,month,year,weekday),holiday indicator,and weather conditions(temperature,rain,snow,and cloud coverage).Experimental results demonstrated that the REPTF-TMDI method outperformed conventional imputation techniques across various missing data ratios by achieving an average 11.76%improvement in terms of correlation coefficient(R).Furthermore,REPTree Forest achieved improvements of 68.62%in RMSE and 70.52%in MAE compared to existing state-of-the-art models.These findings highlight the method’s ability to significantly boost traffic flow prediction accuracy,even in the presence of missing data,thereby contributing to the broader objectives of sustainable urban transportation systems.展开更多
The dynamic routing mechanism in evolvable networks enables adaptive reconfiguration of topol-ogical structures and transmission pathways based on real-time task requirements and data character-istics.However,the heig...The dynamic routing mechanism in evolvable networks enables adaptive reconfiguration of topol-ogical structures and transmission pathways based on real-time task requirements and data character-istics.However,the heightened architectural complexity and expanded parameter dimensionality in evolvable networks present significant implementation challenges when deployed in resource-con-strained environments.Due to the critical paths ignored,traditional pruning strategies cannot get a desired trade-off between accuracy and efficiency.For this reason,a critical path retention pruning(CPRP)method is proposed.By deeply traversing the computational graph,the dependency rela-tionship among nodes is derived.Then the nodes are grouped and sorted according to their contribu-tion value.The redundant operations are removed as much as possible while ensuring that the criti-cal path is not affected.As a result,computational efficiency is improved while a higher accuracy is maintained.On the CIFAR benchmark,the experimental results demonstrate that CPRP-induced pruning incurs accuracy degradation below 4.00%,while outperforming traditional feature-agnostic grouping methods by an average 8.98%accuracy improvement.Simultaneously,the pruned model attains a 2.41 times inference acceleration while achieving 48.92%parameter compression and 53.40%floating-point operations(FLOPs)reduction.展开更多
End-to-end object detection Transformer(DETR)successfully established the paradigm of the Transformer architecture in the field of object detection.Its end-to-end detection process and the idea of set prediction have ...End-to-end object detection Transformer(DETR)successfully established the paradigm of the Transformer architecture in the field of object detection.Its end-to-end detection process and the idea of set prediction have become one of the hottest network architectures in recent years.There has been an abundance of work improving upon DETR.However,DETR and its variants require a substantial amount of memory resources and computational costs,and the vast number of parameters in these networks is unfavorable for model deployment.To address this issue,a greedy pruning(GP)algorithm is proposed,applied to a variant denoising-DETR(DN-DETR),which can eliminate redundant parameters in the Transformer architecture of DN-DETR.Considering the different roles of the multi-head attention(MHA)module and the feed-forward network(FFN)module in the Transformer architecture,a modular greedy pruning(MGP)algorithm is proposed.This algorithm separates the two modules and applies their respective optimal strategies and parameters.The effectiveness of the proposed algorithm is validated on the COCO 2017 dataset.The model obtained through the MGP algorithm reduces the parameters by 49%and the number of floating point operations(FLOPs)by 44%compared to the Transformer architecture of DN-DETR.At the same time,the mean average precision(mAP)of the model increases from 44.1%to 45.3%.展开更多
3D sparse convolution has emerged as a pivotal technique for efficient voxel-based perception in autonomous systems,enabling selective feature extraction from non-empty voxels while suppressing computational waste.Des...3D sparse convolution has emerged as a pivotal technique for efficient voxel-based perception in autonomous systems,enabling selective feature extraction from non-empty voxels while suppressing computational waste.Despite its theoretical efficiency advantages,practical implementations face under-explored limitations:the fixed geometric patterns of conventional sparse convolutional kernels inevitably process non-contributory positions during sliding-window operations,particularly in regions with uneven point cloud density.To address this,we propose Hierarchical Shape Pruning for 3D Sparse Convolution(HSP-S),which dynamically eliminates redundant kernel stripes through layer-adaptive thresholding.Unlike static soft pruning methods,HSP-S maintains trainable sparsity patterns by progressively adjusting pruning thresholds during optimization,enlarging original parameter search space while removing redundant operations.Extensive experiments validate effectiveness of HSP-S acrossmajor autonomous driving benchmarks.On KITTI’s 3D object detection task,our method reduces 93.47%redundant kernel computations whilemaintaining comparable accuracy(1.56%mAP drop).Remarkably,on themore complexNuScenes benchmark,HSP-S achieves simultaneous computation reduction(21.94%sparsity)and accuracy gains(1.02%mAP(mean Average Precision)and 0.47%NDS(nuScenes detection score)improvement),demonstrating its scalability to diverse perception scenarios.This work establishes the first learnable shape pruning framework that simultaneously enhances computational efficiency and preserves detection accuracy in 3D perception systems.展开更多
Microglia are the main non-neuronal cells in the central nervous system that have important roles in brain development and functional connectivity of neural circuits.In brain physiology,highly dynamic microglial proce...Microglia are the main non-neuronal cells in the central nervous system that have important roles in brain development and functional connectivity of neural circuits.In brain physiology,highly dynamic microglial processes are facilitated to sense the surrounding environment and stimuli.Once the brain switches its functional states,microglia are recruited to specific sites to exert their immune functions,including the release of cytokines and phagocytosis of cellular debris.The crosstalk of microglia between neurons,neural stem cells,endothelial cells,oligodendrocytes,and astrocytes contributes to their functions in synapse pruning,neurogenesis,vascularization,myelination,and blood-brain barrier permeability.In this review,we highlight the neuron-derived“find-me,”“eat-me,”and“don't eat-me”molecular signals that drive microglia in response to changes in neuronal activity for synapse refinement during brain development.This review reveals the molecular mechanism of neuron-microglia interaction in synaptic pruning and presents novel ideas for the synaptic pruning of microglia in disease,thereby providing important clues for discovery of target drugs and development of nervous system disease treatment methods targeting synaptic dysfunction.展开更多
In this study,vine pruning wastes(VPW)were used as raw material to develop an alternative activated carbon(VPW-AC)for adsorbing and concentrating rare earth elements cerium(Ce(Ⅲ))and lanthanum(La(Ⅲ))from synthetic a...In this study,vine pruning wastes(VPW)were used as raw material to develop an alternative activated carbon(VPW-AC)for adsorbing and concentrating rare earth elements cerium(Ce(Ⅲ))and lanthanum(La(Ⅲ))from synthetic and real leachate solutions.The Ce and La adsorption studies evaluated the effects of VPW-AC dosage,pH,contact time,rare earth initial concentration,and temperature.The VPW-AC adsorbent was subjected to many physicochemical characterization methods to correlate and understand its adsorptive performance.The characterization data indicate a carbonaceous adsorbent with a specific surface area of 467 m^(2)/g.Zeta potential indicates a material with a negatively charged surface at a pH higher than 3.1,which is extremely beneficial to cations removal.For both rare earths elements(REEs),the adsorption capacity increases with the increase of the pH,reaching its maximum at pH 4-6.The kinetic data are well fitted by Avrami-fractional o rder,while the Liu model agreeably fits equilibrium data.The maximum adsorption capacities for Ce(Ⅲ)and La(Ⅲ)are 48.45 and 53.65 mg/g at 298 K,respectively.The thermodynamic studies suggest that the adsorption process is favorable,spontaneous,and exothermic for both REEs.Pore filling,surface complexation,and ion exchange are the dominant mechanisms.Finally,the VPW-AC was subjected to the recovery of REEs from real phosphogypsum leachate,and it is proved that it can be successfully used to recover REEs in a real process.展开更多
Clinical researches including the Mayo Anesthesia Safety in Kids (MASK) study have found that children undergoing multiple anesthesia may have a higher risk of fne motor control difculties. However, the underlying mec...Clinical researches including the Mayo Anesthesia Safety in Kids (MASK) study have found that children undergoing multiple anesthesia may have a higher risk of fne motor control difculties. However, the underlying mechanisms remain elusive. Here, we report that erythropoietin receptor (EPOR), a microglial receptor associated with phagocytic activity, was signifcantly downregulated in the medial prefrontal cortex of young mice after multiple sevofurane anesthesia exposure. Importantly, we found that the inhibited erythropoietin (EPO)/EPOR signaling axis led to microglial polarization, excessive excitatory synaptic pruning, and abnormal fne motor control skills in mice with multiple anesthesia exposure, and those above-mentioned situations were fully reversed by supplementing EPO-derived peptide ARA290 by intraperitoneal injection. Together, the microglial EPOR was identifed as a key mediator regulating early synaptic development in this study, which impacted sevoflurane-induced fine motor dysfunction. Moreover, ARA290 might serve as a new treatment against neurotoxicity induced by general anesthesia in clinical practice by targeting the EPO/EPOR signaling pathway.展开更多
The rapidly advancing Convolutional Neural Networks(CNNs)have brought about a paradigm shift in various computer vision tasks,while also garnering increasing interest and application in sensor-based Human Activity Rec...The rapidly advancing Convolutional Neural Networks(CNNs)have brought about a paradigm shift in various computer vision tasks,while also garnering increasing interest and application in sensor-based Human Activity Recognition(HAR)efforts.However,the significant computational demands and memory requirements hinder the practical deployment of deep networks in resource-constrained systems.This paper introduces a novel network pruning method based on the energy spectral density of data in the frequency domain,which reduces the model’s depth and accelerates activity inference.Unlike traditional pruning methods that focus on the spatial domain and the importance of filters,this method converts sensor data,such as HAR data,to the frequency domain for analysis.It emphasizes the low-frequency components by calculating their energy spectral density values.Subsequently,filters that meet the predefined thresholds are retained,and redundant filters are removed,leading to a significant reduction in model size without compromising performance or incurring additional computational costs.Notably,the proposed algorithm’s effectiveness is empirically validated on a standard five-layer CNNs backbone architecture.The computational feasibility and data sensitivity of the proposed scheme are thoroughly examined.Impressively,the classification accuracy on three benchmark HAR datasets UCI-HAR,WISDM,and PAMAP2 reaches 96.20%,98.40%,and 92.38%,respectively.Concurrently,our strategy achieves a reduction in Floating Point Operations(FLOPs)by 90.73%,93.70%,and 90.74%,respectively,along with a corresponding decrease in memory consumption by 90.53%,93.43%,and 90.05%.展开更多
Prunusmumehas high ornamental value,and its maintenance and management should be more meticulous,with pruning being an important task.Pruning can make P.mume more robust,reduce the occurrence of diseases and pests,mai...Prunusmumehas high ornamental value,and its maintenance and management should be more meticulous,with pruning being an important task.Pruning can make P.mume more robust,reduce the occurrence of diseases and pests,maintain a good shape,and promote more flowering,further improving its ornamental value.The difficulty of pruning lies in flexibly adopting suitable pruning methods according to the time of the tree,which requires understanding the impact of pruning operations on the growth and flowering of P.mume,as well as some techniques in pruning operations.This paper introduces the botanical characteristics of P.mume,common pruning methods and achievable effects of P.mume,and suitable time for using various methods,and analyzes the possible consequences and reasons of some incorrect operations.Moreover,corresponding correct practices are provided,which can provide reference for standardized pruning of P.mume,thereby reducing or avoiding losses caused by improper operation.展开更多
Almond pruning biomass is an important agricultural residue that has been scarcely studied for the co-production of sugars and solid biofuels.In this work,the production of monosaccharides from almond prunings was opt...Almond pruning biomass is an important agricultural residue that has been scarcely studied for the co-production of sugars and solid biofuels.In this work,the production of monosaccharides from almond prunings was optimised by a two-step process scheme:pretreatment with dilute sulphuric acid(0.025 M,at 185.9-214.1℃for 0.8-9.2 min)followed by enzyme saccharification of the pretreated cellulose.The application of a response surface methodology enabled the mathematical modelling of the process,establishing pretreatment conditions to maximise both the amount of sugar in the acid prehydrolysate(23.4 kg/100 kg raw material,at 195.7℃for 3.5 min)and the enzymatic digestibility of the pretreated cellulose(45.4%,at 210.0℃for 8.0 min).The highest overall sugar yield(36.8 kg/100 kg raw material,equivalent to 64.3%of all sugars in the feedstock)was obtained with a pretreatment carried out at 197.0℃for 4.0 min.Under these conditions,moreover,the final solids showed better properties for thermochemical utilisation(22.0 MJ/kg heating value,0.87%ash content,and 72.1 mg/g moisture adsorption capacity)compared to those of the original prunings.展开更多
[Objectives]This study was conducted to screen out reasonable pruning methods of walnut,and provide practical guidance for high-yield cultivation of walnut.[Methods]Xinfeng and Xinguang were used to study the effects ...[Objectives]This study was conducted to screen out reasonable pruning methods of walnut,and provide practical guidance for high-yield cultivation of walnut.[Methods]Xinfeng and Xinguang were used to study the effects of mechanical and artificial pruning methods on shoot growth,chlorophyll content in leaves,net photosynthetic rate and fruit quality.[Results]The results showed that:①the pruning method had a significant impact on the number of new shoots,and the number of new shoots of mechanical pruning was significantly higher than that of manual pruning;②the pruning method had a significant impact on the chlorophyll content,and the chlorophyll content of Xinguang of mechanical pruning was significantly higher than that of manual pruning;③the pruning method had a significant impact on the net photosynthetic rate of leaves,and the net photosynthetic rate of manual pruning was significantly higher than that of manual pruning;④Pruning methods had a significant effect on the number of walnut fruit,and the fruit trees pruned manually were significantly higher than those pruned mechanically;⑤the pruning method had no significant impact on the single fruit weight;⑥Pruning methods had a significant effect on the shell yield of a single walnut plant.The shell yield of single walnut plant pruned manually was significantly higher than that pruned mechanically;⑦pruning mode had a significant impact on the yield of walnut per plant,and the yield of artificially pruned walnut per plant was significantly higher than that of mechanical pruning;and⑧Xinfeng s chlorophyll content,net photosynthetic rate,fruit number,shell yield per plant and kernel yield per plant were all better than that of Xinguang,in addition,the growth and development of new shoots,the fruit quantity and quality of fruit also were affected by the interaction effect of genotype and pruning mode×variety.[Conclusions]It can be seen that different pruning methods have significant effects on the growth and development of new shoots and fruit yield and quality of walnut.Artificial pruning is more suitable for walnut cultivation by adjusting photosynthesis and improving the yield and quality of walnut;and Xinfeng is more suitable for popularization and production.展开更多
In the Yangtze River region, thepepper long-season cultivation needs oversummer pruning. Inorder to study the effects of different pruning treatments on growth of over-summer grown pepper, three differentpruning treat...In the Yangtze River region, thepepper long-season cultivation needs oversummer pruning. Inorder to study the effects of different pruning treatments on growth of over-summer grown pepper, three differentpruning treatments were applied to pepper seedlings, such as treatment one（re-growth pruning）, treatment two（four stems） and treatment three（multi-stem pruning） with no pruning as control（CK）.The results showed that themulti-stem pruning treatment enabling the plant to maintain the good plant type for high yield and reduce thevirus disease to improve the marketability of pepper fruits, compared with the other two pruning treatments;andthe yield and economic benefit were increased by 15.8% and 19%, compared with the control, respectively. Ingeneral the multi-stem pruning was the best for over-summer pepper cultivation.展开更多
Jujube(Ziziphus jujube Mill.)is a traditional economic forest crop and is widely cultivated in hilly areas of the Loess Plateau,China.However,soil desiccation was discovered in jujube plantations.Pruning is recognized...Jujube(Ziziphus jujube Mill.)is a traditional economic forest crop and is widely cultivated in hilly areas of the Loess Plateau,China.However,soil desiccation was discovered in jujube plantations.Pruning is recognized as a water-saving method that can reduces soil water consumption.In this study,we monitored the jujube plots with control(CK),light(C1),medium(C2)and high(C3)pruning intensities during the jujube growing period of 2012-2015 to explore the effect of pruning intensity on soil moisture and water use efficiency(WUE)of jujube plantations in the hilly Loess Plateau Region.The results showed that pruning is an effective method for soil water conservation in jujube plantations.Soil moisture increased with increasing pruning intensity during the jujube growing period of 2012-2015.C1,C2 and C3 pruning intensities increased soil water storage by 6.1-18.3,14.4-40.0 and 24.3-63.3 mm,respectively,compared to CK pruning intensity.Pruning promoted soil moisture infiltration to deeper soil layer.Soil moisture infiltrated to soil depths of 240,280 and>300 cm under C3 pruning intensity,220,260 and 260 cm under C2 pruning intensity,200,240 and 220 cm under C1 pruning intensity,and 180,200 and 160 cm under CK pruning intensity in 2013,2014 and 2015,respectively.Soil water deficit was alleviated by higher pruning intensity.In 2013-2015,soil water change was positive under C2(6.4 mm)and C3(26.8 mm)pruning intensities but negative under C1(-20.5 mm)and CK(-40.6 mm)pruning intensities.Moreover,pruning significantly improved fresh fruit yield and WUE of jujube plants.Fresh fruit yields were highest under C1 pruning intensity with the values of 6897.1-13,059.3 kg/hm^2,which were 2758.4-4712.8,385.7-1432.1 and 802.8-2331.5 kg/hm2 higher than those under CK,C2,and C3 pruning intensities during the jujube growing period of 2012-2015,respectively.However,C3 pruning intensity had the highest WUE values of 2.92-3.13 kg/m3,which were 1.6-2.0,1.1-1.2 and 1.0-1.1 times greater than those under CK,C1 and C2 pruning intensities,respectively.Therefore,C3 pruning intensity is recommended to jujube plantations for its economic and ecological benefits.These results provide an alternative strategy to mitigate soil desiccation in jujube plantations in the hilly Loess Plateau Region,which is critical for sustainable cultivation of economic forest trees in this region.展开更多
With the increment of the number of Gaussian components, the computation cost increases in the Gaussian mixture probability hypothesis density(GM-PHD) filter. Based on the theory of Chen et al, we propose an improved ...With the increment of the number of Gaussian components, the computation cost increases in the Gaussian mixture probability hypothesis density(GM-PHD) filter. Based on the theory of Chen et al, we propose an improved pruning algorithm for the GM-PHD filter, which utilizes not only the Gaussian components’ means and covariance, but their weights as a new criterion to improve the estimate accuracy of the conventional pruning algorithm for tracking very closely proximity targets. Moreover, it solves the end-less while-loop problem without the need of a second merging step. Simulation results show that this improved algorithm is easier to implement and more robust than the formal ones.展开更多
基金supported by the National Natural Science Foundation of China,No.31760290,82160688the Key Development Areas Project of Ganzhou Science and Technology,No.2022B-SF9554(all to XL)。
文摘Synaptic pruning is a crucial process in synaptic refinement,eliminating unstable synaptic connections in neural circuits.This process is triggered and regulated primarily by spontaneous neural activity and experience-dependent mechanisms.The pruning process involves multiple molecular signals and a series of regulatory activities governing the“eat me”and“don't eat me”states.Under physiological conditions,the interaction between glial cells and neurons results in the clearance of unnecessary synapses,maintaining normal neural circuit functionality via synaptic pruning.Alterations in genetic and environmental factors can lead to imbalanced synaptic pruning,thus promoting the occurrence and development of autism spectrum disorder,schizophrenia,Alzheimer's disease,and other neurological disorders.In this review,we investigated the molecular mechanisms responsible for synaptic pruning during neural development.We focus on how synaptic pruning can regulate neural circuits and its association with neurological disorders.Furthermore,we discuss the application of emerging optical and imaging technologies to observe synaptic structure and function,as well as their potential for clinical translation.Our aim was to enhance our understanding of synaptic pruning during neural development,including the molecular basis underlying the regulation of synaptic function and the dynamic changes in synaptic density,and to investigate the potential role of these mechanisms in the pathophysiology of neurological diseases,thus providing a theoretical foundation for the treatment of neurological disorders.
基金supported by the National Natural Science Foundation of China under Grant No.62172132.
文摘The surge of large-scale models in recent years has led to breakthroughs in numerous fields,but it has also introduced higher computational costs and more complex network architectures.These increasingly large and intricate networks pose challenges for deployment and execution while also exacerbating the issue of network over-parameterization.To address this issue,various network compression techniques have been developed,such as network pruning.A typical pruning algorithm follows a three-step pipeline involving training,pruning,and retraining.Existing methods often directly set the pruned filters to zero during retraining,significantly reducing the parameter space.However,this direct pruning strategy frequently results in irreversible information loss.In the early stages of training,a network still contains much uncertainty,and evaluating filter importance may not be sufficiently rigorous.To manage the pruning process effectively,this paper proposes a flexible neural network pruning algorithm based on the logistic growth differential equation,considering the characteristics of network training.Unlike other pruning algorithms that directly reduce filter weights,this algorithm introduces a three-stage adaptive weight decay strategy inspired by the logistic growth differential equation.It employs a gentle decay rate in the initial training stage,a rapid decay rate during the intermediate stage,and a slower decay rate in the network convergence stage.Additionally,the decay rate is adjusted adaptively based on the filter weights at each stage.By controlling the adaptive decay rate at each stage,the pruning of neural network filters can be effectively managed.In experiments conducted on the CIFAR-10 and ILSVRC-2012 datasets,the pruning of neural networks significantly reduces the floating-point operations while maintaining the same pruning rate.Specifically,when implementing a 30%pruning rate on the ResNet-110 network,the pruned neural network not only decreases floating-point operations by 40.8%but also enhances the classification accuracy by 0.49%compared to the original network.
文摘The rapid growth of digital data necessitates advanced natural language processing(NLP)models like BERT(Bidi-rectional Encoder Representations from Transformers),known for its superior performance in text classification.However,BERT’s size and computational demands limit its practicality,especially in resource-constrained settings.This research compresses the BERT base model for Bengali emotion classification through knowledge distillation(KD),pruning,and quantization techniques.Despite Bengali being the sixth most spoken language globally,NLP research in this area is limited.Our approach addresses this gap by creating an efficient BERT-based model for Bengali text.We have explored 20 combinations for KD,quantization,and pruning,resulting in improved speedup,fewer parameters,and reduced memory size.Our best results demonstrate significant improvements in both speed and efficiency.For instance,in the case of mBERT,we achieved a 3.87×speedup and 4×compression ratio with a combination of Distil+Prune+Quant that reduced parameters from 178 to 46 M,while the memory size decreased from 711 to 178 MB.These results offer scalable solutions for NLP tasks in various languages and advance the field of model compression,making these models suitable for real-world applications in resource-limited environments.
文摘Accurate traffic flow prediction(TFP)is vital for efficient and sustainable transportation management and the development of intelligent traffic systems.However,missing data in real-world traffic datasets poses a significant challenge to maintaining prediction precision.This study introduces REPTF-TMDI,a novel method that combines a Reduced Error Pruning Tree Forest(REPTree Forest)with a newly proposed Time-based Missing Data Imputation(TMDI)approach.The REP Tree Forest,an ensemble learning approach,is tailored for time-related traffic data to enhance predictive accuracy and support the evolution of sustainable urbanmobility solutions.Meanwhile,the TMDI approach exploits temporal patterns to estimate missing values reliably whenever empty fields are encountered.The proposed method was evaluated using hourly traffic flow data from a major U.S.roadway spanning 2012-2018,incorporating temporal features(e.g.,hour,day,month,year,weekday),holiday indicator,and weather conditions(temperature,rain,snow,and cloud coverage).Experimental results demonstrated that the REPTF-TMDI method outperformed conventional imputation techniques across various missing data ratios by achieving an average 11.76%improvement in terms of correlation coefficient(R).Furthermore,REPTree Forest achieved improvements of 68.62%in RMSE and 70.52%in MAE compared to existing state-of-the-art models.These findings highlight the method’s ability to significantly boost traffic flow prediction accuracy,even in the presence of missing data,thereby contributing to the broader objectives of sustainable urban transportation systems.
基金Supported by the National Key Research and Development Program of China(No.2022ZD0119003)and the National Natural Science Founda-tion of China(No.61834005).
文摘The dynamic routing mechanism in evolvable networks enables adaptive reconfiguration of topol-ogical structures and transmission pathways based on real-time task requirements and data character-istics.However,the heightened architectural complexity and expanded parameter dimensionality in evolvable networks present significant implementation challenges when deployed in resource-con-strained environments.Due to the critical paths ignored,traditional pruning strategies cannot get a desired trade-off between accuracy and efficiency.For this reason,a critical path retention pruning(CPRP)method is proposed.By deeply traversing the computational graph,the dependency rela-tionship among nodes is derived.Then the nodes are grouped and sorted according to their contribu-tion value.The redundant operations are removed as much as possible while ensuring that the criti-cal path is not affected.As a result,computational efficiency is improved while a higher accuracy is maintained.On the CIFAR benchmark,the experimental results demonstrate that CPRP-induced pruning incurs accuracy degradation below 4.00%,while outperforming traditional feature-agnostic grouping methods by an average 8.98%accuracy improvement.Simultaneously,the pruned model attains a 2.41 times inference acceleration while achieving 48.92%parameter compression and 53.40%floating-point operations(FLOPs)reduction.
基金Shanghai Municipal Commission of Economy and Information Technology,China(No.202301054)。
文摘End-to-end object detection Transformer(DETR)successfully established the paradigm of the Transformer architecture in the field of object detection.Its end-to-end detection process and the idea of set prediction have become one of the hottest network architectures in recent years.There has been an abundance of work improving upon DETR.However,DETR and its variants require a substantial amount of memory resources and computational costs,and the vast number of parameters in these networks is unfavorable for model deployment.To address this issue,a greedy pruning(GP)algorithm is proposed,applied to a variant denoising-DETR(DN-DETR),which can eliminate redundant parameters in the Transformer architecture of DN-DETR.Considering the different roles of the multi-head attention(MHA)module and the feed-forward network(FFN)module in the Transformer architecture,a modular greedy pruning(MGP)algorithm is proposed.This algorithm separates the two modules and applies their respective optimal strategies and parameters.The effectiveness of the proposed algorithm is validated on the COCO 2017 dataset.The model obtained through the MGP algorithm reduces the parameters by 49%and the number of floating point operations(FLOPs)by 44%compared to the Transformer architecture of DN-DETR.At the same time,the mean average precision(mAP)of the model increases from 44.1%to 45.3%.
文摘3D sparse convolution has emerged as a pivotal technique for efficient voxel-based perception in autonomous systems,enabling selective feature extraction from non-empty voxels while suppressing computational waste.Despite its theoretical efficiency advantages,practical implementations face under-explored limitations:the fixed geometric patterns of conventional sparse convolutional kernels inevitably process non-contributory positions during sliding-window operations,particularly in regions with uneven point cloud density.To address this,we propose Hierarchical Shape Pruning for 3D Sparse Convolution(HSP-S),which dynamically eliminates redundant kernel stripes through layer-adaptive thresholding.Unlike static soft pruning methods,HSP-S maintains trainable sparsity patterns by progressively adjusting pruning thresholds during optimization,enlarging original parameter search space while removing redundant operations.Extensive experiments validate effectiveness of HSP-S acrossmajor autonomous driving benchmarks.On KITTI’s 3D object detection task,our method reduces 93.47%redundant kernel computations whilemaintaining comparable accuracy(1.56%mAP drop).Remarkably,on themore complexNuScenes benchmark,HSP-S achieves simultaneous computation reduction(21.94%sparsity)and accuracy gains(1.02%mAP(mean Average Precision)and 0.47%NDS(nuScenes detection score)improvement),demonstrating its scalability to diverse perception scenarios.This work establishes the first learnable shape pruning framework that simultaneously enhances computational efficiency and preserves detection accuracy in 3D perception systems.
基金supported by the National Natural Science Foundation of ChinaNo.32200778(to QC)+5 种基金the Natural Science Foundation of Jiangsu ProvinceNo.BK20220494(to QC)Suzhou Medical and Health Technology Innovation ProjectNo.SKY2022107(to QC)a grant from the Clinical Research Center of Neurological Disease in The Second Affiliated Hospital of Soochow UniversityNos.ND2022A04(to QC)and ND2023B06(to JS)。
文摘Microglia are the main non-neuronal cells in the central nervous system that have important roles in brain development and functional connectivity of neural circuits.In brain physiology,highly dynamic microglial processes are facilitated to sense the surrounding environment and stimuli.Once the brain switches its functional states,microglia are recruited to specific sites to exert their immune functions,including the release of cytokines and phagocytosis of cellular debris.The crosstalk of microglia between neurons,neural stem cells,endothelial cells,oligodendrocytes,and astrocytes contributes to their functions in synapse pruning,neurogenesis,vascularization,myelination,and blood-brain barrier permeability.In this review,we highlight the neuron-derived“find-me,”“eat-me,”and“don't eat-me”molecular signals that drive microglia in response to changes in neuronal activity for synapse refinement during brain development.This review reveals the molecular mechanism of neuron-microglia interaction in synaptic pruning and presents novel ideas for the synaptic pruning of microglia in disease,thereby providing important clues for discovery of target drugs and development of nervous system disease treatment methods targeting synaptic dysfunction.
基金Project supported by the Brazilian National Council for Scientific and Technological Development/CNPq(405982/2022—4,303992/2021-2)。
文摘In this study,vine pruning wastes(VPW)were used as raw material to develop an alternative activated carbon(VPW-AC)for adsorbing and concentrating rare earth elements cerium(Ce(Ⅲ))and lanthanum(La(Ⅲ))from synthetic and real leachate solutions.The Ce and La adsorption studies evaluated the effects of VPW-AC dosage,pH,contact time,rare earth initial concentration,and temperature.The VPW-AC adsorbent was subjected to many physicochemical characterization methods to correlate and understand its adsorptive performance.The characterization data indicate a carbonaceous adsorbent with a specific surface area of 467 m^(2)/g.Zeta potential indicates a material with a negatively charged surface at a pH higher than 3.1,which is extremely beneficial to cations removal.For both rare earths elements(REEs),the adsorption capacity increases with the increase of the pH,reaching its maximum at pH 4-6.The kinetic data are well fitted by Avrami-fractional o rder,while the Liu model agreeably fits equilibrium data.The maximum adsorption capacities for Ce(Ⅲ)and La(Ⅲ)are 48.45 and 53.65 mg/g at 298 K,respectively.The thermodynamic studies suggest that the adsorption process is favorable,spontaneous,and exothermic for both REEs.Pore filling,surface complexation,and ion exchange are the dominant mechanisms.Finally,the VPW-AC was subjected to the recovery of REEs from real phosphogypsum leachate,and it is proved that it can be successfully used to recover REEs in a real process.
基金supported by grants from the National Natural Science Foundation of China(82101534,82171170,and 82201414)the Natural Science Foundation of Shaanxi Provence(2024JCYBMS659)the Science and Technology Plan in Xi’an of China(23YXYJ0134)。
文摘Clinical researches including the Mayo Anesthesia Safety in Kids (MASK) study have found that children undergoing multiple anesthesia may have a higher risk of fne motor control difculties. However, the underlying mechanisms remain elusive. Here, we report that erythropoietin receptor (EPOR), a microglial receptor associated with phagocytic activity, was signifcantly downregulated in the medial prefrontal cortex of young mice after multiple sevofurane anesthesia exposure. Importantly, we found that the inhibited erythropoietin (EPO)/EPOR signaling axis led to microglial polarization, excessive excitatory synaptic pruning, and abnormal fne motor control skills in mice with multiple anesthesia exposure, and those above-mentioned situations were fully reversed by supplementing EPO-derived peptide ARA290 by intraperitoneal injection. Together, the microglial EPOR was identifed as a key mediator regulating early synaptic development in this study, which impacted sevoflurane-induced fine motor dysfunction. Moreover, ARA290 might serve as a new treatment against neurotoxicity induced by general anesthesia in clinical practice by targeting the EPO/EPOR signaling pathway.
基金supported by National Natural Science Foundation of China(Nos.61902158 and 62202210).
文摘The rapidly advancing Convolutional Neural Networks(CNNs)have brought about a paradigm shift in various computer vision tasks,while also garnering increasing interest and application in sensor-based Human Activity Recognition(HAR)efforts.However,the significant computational demands and memory requirements hinder the practical deployment of deep networks in resource-constrained systems.This paper introduces a novel network pruning method based on the energy spectral density of data in the frequency domain,which reduces the model’s depth and accelerates activity inference.Unlike traditional pruning methods that focus on the spatial domain and the importance of filters,this method converts sensor data,such as HAR data,to the frequency domain for analysis.It emphasizes the low-frequency components by calculating their energy spectral density values.Subsequently,filters that meet the predefined thresholds are retained,and redundant filters are removed,leading to a significant reduction in model size without compromising performance or incurring additional computational costs.Notably,the proposed algorithm’s effectiveness is empirically validated on a standard five-layer CNNs backbone architecture.The computational feasibility and data sensitivity of the proposed scheme are thoroughly examined.Impressively,the classification accuracy on three benchmark HAR datasets UCI-HAR,WISDM,and PAMAP2 reaches 96.20%,98.40%,and 92.38%,respectively.Concurrently,our strategy achieves a reduction in Floating Point Operations(FLOPs)by 90.73%,93.70%,and 90.74%,respectively,along with a corresponding decrease in memory consumption by 90.53%,93.43%,and 90.05%.
文摘Prunusmumehas high ornamental value,and its maintenance and management should be more meticulous,with pruning being an important task.Pruning can make P.mume more robust,reduce the occurrence of diseases and pests,maintain a good shape,and promote more flowering,further improving its ornamental value.The difficulty of pruning lies in flexibly adopting suitable pruning methods according to the time of the tree,which requires understanding the impact of pruning operations on the growth and flowering of P.mume,as well as some techniques in pruning operations.This paper introduces the botanical characteristics of P.mume,common pruning methods and achievable effects of P.mume,and suitable time for using various methods,and analyzes the possible consequences and reasons of some incorrect operations.Moreover,corresponding correct practices are provided,which can provide reference for standardized pruning of P.mume,thereby reducing or avoiding losses caused by improper operation.
基金supported by the Operative Program FEDER Andalucía 2014-2020(Junta de Andalucía-MINECO-FEDER)by the grant funded 2021/00591/001using the support to the research Action 1 of University of Jaén.
文摘Almond pruning biomass is an important agricultural residue that has been scarcely studied for the co-production of sugars and solid biofuels.In this work,the production of monosaccharides from almond prunings was optimised by a two-step process scheme:pretreatment with dilute sulphuric acid(0.025 M,at 185.9-214.1℃for 0.8-9.2 min)followed by enzyme saccharification of the pretreated cellulose.The application of a response surface methodology enabled the mathematical modelling of the process,establishing pretreatment conditions to maximise both the amount of sugar in the acid prehydrolysate(23.4 kg/100 kg raw material,at 195.7℃for 3.5 min)and the enzymatic digestibility of the pretreated cellulose(45.4%,at 210.0℃for 8.0 min).The highest overall sugar yield(36.8 kg/100 kg raw material,equivalent to 64.3%of all sugars in the feedstock)was obtained with a pretreatment carried out at 197.0℃for 4.0 min.Under these conditions,moreover,the final solids showed better properties for thermochemical utilisation(22.0 MJ/kg heating value,0.87%ash content,and 72.1 mg/g moisture adsorption capacity)compared to those of the original prunings.
基金the Project of Demonstration of Walnut Fine Variety Promotion and Standardized Management Technology in the Technology Promotion Demonstration Project of Central Finance Forest and Grass Science in 2020[Xin[2020]No.TG12].
文摘[Objectives]This study was conducted to screen out reasonable pruning methods of walnut,and provide practical guidance for high-yield cultivation of walnut.[Methods]Xinfeng and Xinguang were used to study the effects of mechanical and artificial pruning methods on shoot growth,chlorophyll content in leaves,net photosynthetic rate and fruit quality.[Results]The results showed that:①the pruning method had a significant impact on the number of new shoots,and the number of new shoots of mechanical pruning was significantly higher than that of manual pruning;②the pruning method had a significant impact on the chlorophyll content,and the chlorophyll content of Xinguang of mechanical pruning was significantly higher than that of manual pruning;③the pruning method had a significant impact on the net photosynthetic rate of leaves,and the net photosynthetic rate of manual pruning was significantly higher than that of manual pruning;④Pruning methods had a significant effect on the number of walnut fruit,and the fruit trees pruned manually were significantly higher than those pruned mechanically;⑤the pruning method had no significant impact on the single fruit weight;⑥Pruning methods had a significant effect on the shell yield of a single walnut plant.The shell yield of single walnut plant pruned manually was significantly higher than that pruned mechanically;⑦pruning mode had a significant impact on the yield of walnut per plant,and the yield of artificially pruned walnut per plant was significantly higher than that of mechanical pruning;and⑧Xinfeng s chlorophyll content,net photosynthetic rate,fruit number,shell yield per plant and kernel yield per plant were all better than that of Xinguang,in addition,the growth and development of new shoots,the fruit quantity and quality of fruit also were affected by the interaction effect of genotype and pruning mode×variety.[Conclusions]It can be seen that different pruning methods have significant effects on the growth and development of new shoots and fruit yield and quality of walnut.Artificial pruning is more suitable for walnut cultivation by adjusting photosynthesis and improving the yield and quality of walnut;and Xinfeng is more suitable for popularization and production.
基金Supported by National Key Technology R&D Program(2014BAD05B04)The Expert Program of Cultivation Post for Hunan Vegetable Industry Technology System基金项目国家科技支撑课题(2014BAD-05B04)~~
文摘In the Yangtze River region, thepepper long-season cultivation needs oversummer pruning. Inorder to study the effects of different pruning treatments on growth of over-summer grown pepper, three differentpruning treatments were applied to pepper seedlings, such as treatment one（re-growth pruning）, treatment two（four stems） and treatment three（multi-stem pruning） with no pruning as control（CK）.The results showed that themulti-stem pruning treatment enabling the plant to maintain the good plant type for high yield and reduce thevirus disease to improve the marketability of pepper fruits, compared with the other two pruning treatments;andthe yield and economic benefit were increased by 15.8% and 19%, compared with the control, respectively. Ingeneral the multi-stem pruning was the best for over-summer pepper cultivation.
基金supported by the China National Support Program(2015BAC01B03)the Shaanxi Co-ordination Program(2016KTZDNY0105)the National Key Research and Development Program of China(2016YED0300201)
文摘Jujube(Ziziphus jujube Mill.)is a traditional economic forest crop and is widely cultivated in hilly areas of the Loess Plateau,China.However,soil desiccation was discovered in jujube plantations.Pruning is recognized as a water-saving method that can reduces soil water consumption.In this study,we monitored the jujube plots with control(CK),light(C1),medium(C2)and high(C3)pruning intensities during the jujube growing period of 2012-2015 to explore the effect of pruning intensity on soil moisture and water use efficiency(WUE)of jujube plantations in the hilly Loess Plateau Region.The results showed that pruning is an effective method for soil water conservation in jujube plantations.Soil moisture increased with increasing pruning intensity during the jujube growing period of 2012-2015.C1,C2 and C3 pruning intensities increased soil water storage by 6.1-18.3,14.4-40.0 and 24.3-63.3 mm,respectively,compared to CK pruning intensity.Pruning promoted soil moisture infiltration to deeper soil layer.Soil moisture infiltrated to soil depths of 240,280 and>300 cm under C3 pruning intensity,220,260 and 260 cm under C2 pruning intensity,200,240 and 220 cm under C1 pruning intensity,and 180,200 and 160 cm under CK pruning intensity in 2013,2014 and 2015,respectively.Soil water deficit was alleviated by higher pruning intensity.In 2013-2015,soil water change was positive under C2(6.4 mm)and C3(26.8 mm)pruning intensities but negative under C1(-20.5 mm)and CK(-40.6 mm)pruning intensities.Moreover,pruning significantly improved fresh fruit yield and WUE of jujube plants.Fresh fruit yields were highest under C1 pruning intensity with the values of 6897.1-13,059.3 kg/hm^2,which were 2758.4-4712.8,385.7-1432.1 and 802.8-2331.5 kg/hm2 higher than those under CK,C2,and C3 pruning intensities during the jujube growing period of 2012-2015,respectively.However,C3 pruning intensity had the highest WUE values of 2.92-3.13 kg/m3,which were 1.6-2.0,1.1-1.2 and 1.0-1.1 times greater than those under CK,C1 and C2 pruning intensities,respectively.Therefore,C3 pruning intensity is recommended to jujube plantations for its economic and ecological benefits.These results provide an alternative strategy to mitigate soil desiccation in jujube plantations in the hilly Loess Plateau Region,which is critical for sustainable cultivation of economic forest trees in this region.
基金supported by the National Natural Science Foundation of China(61703228)
文摘With the increment of the number of Gaussian components, the computation cost increases in the Gaussian mixture probability hypothesis density(GM-PHD) filter. Based on the theory of Chen et al, we propose an improved pruning algorithm for the GM-PHD filter, which utilizes not only the Gaussian components’ means and covariance, but their weights as a new criterion to improve the estimate accuracy of the conventional pruning algorithm for tracking very closely proximity targets. Moreover, it solves the end-less while-loop problem without the need of a second merging step. Simulation results show that this improved algorithm is easier to implement and more robust than the formal ones.
