A four-dimensional variational （4D-Var） data assimilation method is implemented in an improved intermediate coupled model （ICM） of the tropical Pacific. A twin experiment is designed to evaluate the impact of the ...A four-dimensional variational （4D-Var） data assimilation method is implemented in an improved intermediate coupled model （ICM） of the tropical Pacific. A twin experiment is designed to evaluate the impact of the 4D-Var data assimilation algorithm on ENSO analysis and prediction based on the ICM. The model error is assumed to arise only from the parameter uncertainty. The ＂observation＂ of the SST anomaly, which is sampled from a ＂truth＂ model simulation that takes default parameter values and has Gaussian noise added, is directly assimilated into the assimilation model with its parameters set erroneously. Results show that 4D-Var effectively reduces the error of ENSO analysis and therefore improves the prediction skill of ENSO events compared with the non-assimilation case. These results provide a promising way for the ICM to achieve better real-time ENSO prediction.展开更多
Aircraft ground movement plays a key role in improving airport efficiency,as it acts as a link to all other ground operations.Finding novel approaches to coordinate the movements of a fleet of aircraft at an airport i...Aircraft ground movement plays a key role in improving airport efficiency,as it acts as a link to all other ground operations.Finding novel approaches to coordinate the movements of a fleet of aircraft at an airport in order to improve system resilience to disruptions with increasing autonomy is at the center of many key studies for airport airside operations.Moreover,autonomous taxiing is envisioned as a key component in future digitalized airports.However,state-of-the-art routing and scheduling algorithms for airport ground movements do not consider high-fidelity aircraft models at both the proactive and reactive planning phases.The majority of such algorithms do not actively seek to optimize fuel efficiency and reduce harmful greenhouse gas emissions.This paper proposes a new approach for generating efficient four-dimensional trajectories(4DTs)on the basis of a high-fidelity aircraft model and gainscheduling control strategy.Working in conjunction with a routing and scheduling algorithm that determines the taxi route,waypoints,and time deadlines,the proposed approach generates fuel-efficient 4DTs in real time,while respecting operational constraints.The proposed approach can be used in two contexts:①as a reactive decision support tool to generate new trajectories that can resolve unprecedented events;and②as an autopilot system for both partial and fully autonomous taxiing.The proposed methodology is realistic and simple to implement.Moreover,simulation studies show that the proposed approach is capable of providing an up to 11%reduction in the fuel consumed during the taxiing of a large Boeing 747-100 jumbo jet.展开更多
Formal state space models of quantum control systems are deduced and a scheme to establish formal state space models via quantization could been obtained for quantum control systems is proposed. State evolution of qua...Formal state space models of quantum control systems are deduced and a scheme to establish formal state space models via quantization could been obtained for quantum control systems is proposed. State evolution of quantum control systems must accord with Schrdinger equations, so it is foremost to obtain Hamiltonian operators of systems. There are corresponding relations between operators of quantum systems and corresponding physical quantities of classical systems, such as momentum, energy and Hamiltonian, so Schrdinger equation models of corresponding quantum control systems via quantization could been obtained from classical control systems, and then establish formal state space models through the suitable transformation from Schrdinger equations for these quantum control systems. This method provides a new kind of path for modeling in quantum control.展开更多
Large-scale Language Models(LLMs)have achieved significant breakthroughs in Natural Language Processing(NLP),driven by the pre-training and fine-tuning paradigm.While this approach allows models to specialize in speci...Large-scale Language Models(LLMs)have achieved significant breakthroughs in Natural Language Processing(NLP),driven by the pre-training and fine-tuning paradigm.While this approach allows models to specialize in specific tasks with reduced training costs,the substantial memory requirements during fine-tuning present a barrier to broader deployment.Parameter-Efficient Fine-Tuning(PEFT)techniques,such as Low-Rank Adaptation(LoRA),and parameter quantization methods have emerged as solutions to address these challenges by optimizing memory usage and computational efficiency.Among these,QLoRA,which combines PEFT and quantization,has demonstrated notable success in reducing memory footprints during fine-tuning,prompting the development of various QLoRA variants.Despite these advancements,the quantitative impact of key variables on the fine-tuning performance of quantized LLMs remains underexplored.This study presents a comprehensive analysis of these key variables,focusing on their influence across different layer types and depths within LLM architectures.Our investigation uncovers several critical findings:(1)Larger layers,such as MLP layers,can maintain performance despite reductions in adapter rank,while smaller layers,like self-attention layers,aremore sensitive to such changes;(2)The effectiveness of balancing factors depends more on specific values rather than layer type or depth;(3)In quantization-aware fine-tuning,larger layers can effectively utilize smaller adapters,whereas smaller layers struggle to do so.These insights suggest that layer type is a more significant determinant of fine-tuning success than layer depth when optimizing quantized LLMs.Moreover,for the same discount of trainable parameters,reducing the trainable parameters in a larger layer is more effective in preserving fine-tuning accuracy than in a smaller one.This study provides valuable guidance for more efficient fine-tuning strategies and opens avenues for further research into optimizing LLM fine-tuning in resource-constrained environments.展开更多
Quantization noise caused by analog-to-digital converter(ADC)gives rise to the reliability performance degradation of communication systems.In this paper,a quantized non-Hermitian symmetry(NHS)orthogonal frequency-div...Quantization noise caused by analog-to-digital converter(ADC)gives rise to the reliability performance degradation of communication systems.In this paper,a quantized non-Hermitian symmetry(NHS)orthogonal frequency-division multiplexing-based visible light communication(OFDM-VLC)system is presented.In order to analyze the effect of the resolution of ADC on NHS OFDM-VLC,a quantized mathematical model of NHS OFDM-VLC is established.Based on the proposed quantized model,a closed-form bit error rate(BER)expression is derived.The theoretical analysis and simulation results both confirm the effectiveness of the obtained BER formula in high-resolution ADC.In addition,channel coding is helpful in compensating for the BER performance loss due to the utilization of lower resolution ADC.展开更多
The rapid growth of digital data necessitates advanced natural language processing(NLP)models like BERT(Bidi-rectional Encoder Representations from Transformers),known for its superior performance in text classificati...The rapid growth of digital data necessitates advanced natural language processing(NLP)models like BERT(Bidi-rectional Encoder Representations from Transformers),known for its superior performance in text classification.However,BERT’s size and computational demands limit its practicality,especially in resource-constrained settings.This research compresses the BERT base model for Bengali emotion classification through knowledge distillation(KD),pruning,and quantization techniques.Despite Bengali being the sixth most spoken language globally,NLP research in this area is limited.Our approach addresses this gap by creating an efficient BERT-based model for Bengali text.We have explored 20 combinations for KD,quantization,and pruning,resulting in improved speedup,fewer parameters,and reduced memory size.Our best results demonstrate significant improvements in both speed and efficiency.For instance,in the case of mBERT,we achieved a 3.87×speedup and 4×compression ratio with a combination of Distil+Prune+Quant that reduced parameters from 178 to 46 M,while the memory size decreased from 711 to 178 MB.These results offer scalable solutions for NLP tasks in various languages and advance the field of model compression,making these models suitable for real-world applications in resource-limited environments.展开更多
A half-harmonic oscillator, which gets its name because the position coordinate is strictly positive, has been quantized and determined that it was a physically correct quantization. This positive result was found usi...A half-harmonic oscillator, which gets its name because the position coordinate is strictly positive, has been quantized and determined that it was a physically correct quantization. This positive result was found using affine quantization (AQ). The main purpose of this paper is to compare results of this new quantization procedure with those of canonical quantization (CQ). Using Ashtekar-like classical variables and CQ, we quantize the same toy model. While these two quantizations lead to different results, they both would reduce to the same classical Hamiltonian if ħ→ 0. Since these two quantizations have differing results, only one of the quantizations can be physically correct. Two brief sections also illustrate how AQ can correctly help quantum gravity and the quantization of most field theory problems.展开更多
As coal mining progresses to greater depths,controlling the stability of surrounding rock in deep roadways has become an increasingly complex challenge.Although four-dimensional(4D)support theoretically offers unique ...As coal mining progresses to greater depths,controlling the stability of surrounding rock in deep roadways has become an increasingly complex challenge.Although four-dimensional(4D)support theoretically offers unique advantages in maintaining the stability of rock mass,the disaster evolution processes and multi-source information response characteristics in deep roadways with 4D support remain unclear.Consequently,a large-scale physical model testing system and self-designed 4D support components were employed to conduct similarity model tests on the surrounding rock failure process under unsupported(U-1),traditional bolt-mesh-cable support(T-2),and 4D support(4D-R-3)conditions.Combined with multi-source monitoring techniques,including stress–strain,digital image correlation(DIC),acoustic emission(AE),microseismic(MS),parallel electric(PE),and electromagnetic radiation(EMR),the mechanical behavior and multi-source information responses were comprehensively analyzed.The results show that the peak stress and displacement of the models are positively correlated with the support strength.The multi-source information exhibits distinct response characteristics under different supports.The response frequency,energy,and fluctuationsof AE,MS,and EMR signals,along with the apparent resistivity(AR)high-resistivity zone,follow the trend U-1>T-2>4D-R-3.Furthermore,multi-source information exhibits significantdifferences in sensitivity across different phases.The AE,MS,and EMR signals exhibit active responses to rock mass activity at each phase.However,AR signals are only sensitive to the fracture propagation during the plastic yield and failure phases.In summary,the 4D support significantlyenhances the bearing capacity and plastic deformation of the models,while substantially reducing the frequency,energy,and fluctuationsof multi-source signals.展开更多
Cross-cultural management is often regarded as a discipline of international management focusing on cultural encounters between the organization and the nation-state, and providing tools to tackle cultural difl＇erenc...Cross-cultural management is often regarded as a discipline of international management focusing on cultural encounters between the organization and the nation-state, and providing tools to tackle cultural difl＇erences seen as sources of conflict, friction or misunderstanding. Based on Greet Hofstede＇ s Cultural Model, this paper attempts to shed some light on effective corporation management through cultural analysis of the difl＇erences between China and western countries. The paper puts more emphasis on the impact of cultural compatibility on effective corporation man- agement through the case study of China, Japan, Germany and America. The author argues that managers and employ- ees involved in companies with diverse cultural backgrounds should be integrated and developed into a specific local context through interlocking their cultural identifications and the organizational practices.展开更多
Using the Faddeev-Jackiw （FJ） quantization method, this paper treats the CP^1nonlinear sigma model with ChernSimons term. The generalized FJ brackets are obtained in the framework of this quantization method, which ...Using the Faddeev-Jackiw （FJ） quantization method, this paper treats the CP^1nonlinear sigma model with ChernSimons term. The generalized FJ brackets are obtained in the framework of this quantization method, which agree with the results obtained by using the Dirac＇s method.展开更多
Massive computational complexity and memory requirement of artificial intelligence models impede their deploy-ability on edge computing devices of the Internet of Things(IoT).While Power-of-Two(PoT)quantization is pro...Massive computational complexity and memory requirement of artificial intelligence models impede their deploy-ability on edge computing devices of the Internet of Things(IoT).While Power-of-Two(PoT)quantization is pro-posed to improve the efficiency for edge inference of Deep Neural Networks(DNNs),existing PoT schemes require a huge amount of bit-wise manipulation and have large memory overhead,and their efficiency is bounded by the bottleneck of computation latency and memory footprint.To tackle this challenge,we present an efficient inference approach on the basis of PoT quantization and model compression.An integer-only scalar PoT quantization(IOS-PoT)is designed jointly with a distribution loss regularizer,wherein the regularizer minimizes quantization errors and training disturbances.Additionally,two-stage model compression is developed to effectively reduce memory requirement,and alleviate bandwidth usage in communications of networked heterogenous learning systems.The product look-up table(P-LUT)inference scheme is leveraged to replace bit-shifting with only indexing and addition operations for achieving low-latency computation and implementing efficient edge accelerators.Finally,comprehensive experiments on Residual Networks(ResNets)and efficient architectures with Canadian Institute for Advanced Research(CIFAR),ImageNet,and Real-world Affective Faces Database(RAF-DB)datasets,indicate that our approach achieves 2×∼10×improvement in the reduction of both weight size and computation cost in comparison to state-of-the-art methods.A P-LUT accelerator prototype is implemented on the Xilinx KV260 Field Programmable Gate Array(FPGA)platform for accelerating convolution operations,with performance results showing that P-LUT reduces memory footprint by 1.45×,achieves more than 3×power efficiency and 2×resource efficiency,compared to the conventional bit-shifting scheme.展开更多
At the present time,the Industrial Internet of Things(IIoT)has swiftly evolved and emerged,and picture data that is collected by terminal devices or IoT nodes are tied to the user's private data.The use of image s...At the present time,the Industrial Internet of Things(IIoT)has swiftly evolved and emerged,and picture data that is collected by terminal devices or IoT nodes are tied to the user's private data.The use of image sensors as an automa-tion tool for the IIoT is increasingly becoming more common.Due to the fact that this organisation transfers an enormous number of photographs at any one time,one of the most significant issues that it has is reducing the total quantity of data that is sent and,as a result,the available bandwidth,without compromising the image quality.Image compression in the sensor,on the other hand,expedites the transfer of data while simultaneously reducing bandwidth use.The traditional method of protecting sensitive data is rendered less effective in an environment dominated by IoT owing to the involvement of third parties.The image encryp-tion model provides a safe and adaptable method to protect the confidentiality of picture transformation and storage inside an IIoT system.This helps to ensure that image datasets are kept safe.The Linde–Buzo–Gray(LBG)methodology is an example of a vector quantization algorithm that is extensively used and a rela-tively new form of picture reduction known as vector quantization(VQ).As a result,the purpose of this research is to create an artificial humming bird optimi-zation approach that combines LBG-enabled codebook creation and encryption(AHBO-LBGCCE)for use in an IIoT setting.In the beginning,the AHBO-LBGCCE method used the LBG model in conjunction with the AHBO algorithm in order to construct the VQ.The Burrows-Wheeler Transform(BWT)model is used in order to accomplish codebook compression.In addition,the Blowfish algorithm is used in order to carry out the encryption procedure so that security may be attained.A comprehensive experimental investigation is carried out in order to verify the effectiveness of the proposed algorithm in comparison to other algorithms.The experimental values ensure that the suggested approach and the outcomes are examined in a variety of different perspectives in order to further enhance them.展开更多
In order to overcome data-quantization, networked-induced delay, network packet dropouts and wrong sequences in the nonlinear networked control system, a novel nonlinear networked control system model is built by the ...In order to overcome data-quantization, networked-induced delay, network packet dropouts and wrong sequences in the nonlinear networked control system, a novel nonlinear networked control system model is built by the T-S fuzzy method. Two time-varying quantizers are added in the model. The key analysis steps in the method are to construct an improved interval-delay-dependent Lyapunov functional and to introduce the free-weighting matrix. By making use of the parallel distributed compensation technology and the convexity of the matrix function, the improved criteria of the stabilization and stability are obtained. Simulation experiments show that the parameters of the controllers and quantizers satisfying a certain performance can be obtained by solving a set of LMIs. The application of the nonlinear mass-spring system is provided to show that the proposed method is effective.展开更多
This study examines the performance of coupling the deterministic four-dimensional variational assimilation system （4DVAR） with an ensemble Kalman filter （EnKF） to produce a superior hybrid approach for data assim...This study examines the performance of coupling the deterministic four-dimensional variational assimilation system （4DVAR） with an ensemble Kalman filter （EnKF） to produce a superior hybrid approach for data assimilation. The coupled assimilation scheme （E4DVAR） benefits from using the state-dependent uncertainty provided by EnKF while taking advantage of 4DVAR in preventing filter divergence： the 4DVAR analysis produces posterior maximum likelihood solutions through minimization of a cost function about which the ensemble perturbations are transformed, and the resulting ensemble analysis can be propagated forward both for the next assimilation cycle and as a basis for ensemble forecasting. The feasibility and effectiveness of this coupled approach are demonstrated in an idealized model with simulated observations. It is found that the E4DVAR is capable of outperforming both 4DVAR and the EnKF under both perfect- and imperfect-model scenarios. The performance of the coupled scheme is also less sensitive to either the ensemble size or the assimilation window length than those for standard EnKF or 4DVAR implementations.展开更多
This paper addresses a modified auxiliary model stochastic gradient recursive parameter identification algorithm(M-AM-SGRPIA)for a class of single input single output(SISO)linear output error models with multi-thresho...This paper addresses a modified auxiliary model stochastic gradient recursive parameter identification algorithm(M-AM-SGRPIA)for a class of single input single output(SISO)linear output error models with multi-threshold quantized observations.It proves the convergence of the designed algorithm.A pattern-moving-based system dynamics description method with hybrid metrics is proposed for a kind of practical single input multiple output(SIMO)or SISO nonlinear systems,and a SISO linear output error model with multi-threshold quantized observations is adopted to approximate the unknown system.The system input design is accomplished using the measurement technology of random repeatability test,and the probabilistic characteristic of the explicit metric value is employed to estimate the implicit metric value of the pattern class variable.A modified auxiliary model stochastic gradient recursive algorithm(M-AM-SGRA)is designed to identify the model parameters,and the contraction mapping principle proves its convergence.Two numerical examples are given to demonstrate the feasibility and effectiveness of the achieved identification algorithm.展开更多
We justify and extend the standard model of elementary particle physics by generalizing the theory of relativity and quantum mechanics. The usual assumption that space and time are continuous implies, indeed, that it ...We justify and extend the standard model of elementary particle physics by generalizing the theory of relativity and quantum mechanics. The usual assumption that space and time are continuous implies, indeed, that it should be possible to measure arbitrarily small intervals of space and time, but we ignore if that is true or not. It is thus more realistic to consider an extremely small “quantum of length” of yet unknown value <em>a</em>. It is only required to be a universal constant for all inertial frames, like<em> c</em> and <em>h</em>. This yields a logically consistent theory and accounts for elementary particles by means of four new quantum numbers. They define “particle states” in terms of modulations of wave functions at the smallest possible scale in space-time. The resulting classification of elementary particles accounts also for dark matter. Antiparticles are redefined, without needing negative energy states and recently observed “anomalies” can be explained.展开更多
In this paper, a new amplitude quantization synthesis method for ultralow sidelobe phased arrays is proposed, which is based on the constrained nonlinear optimization algorithm. By introducing a set of critical constr...In this paper, a new amplitude quantization synthesis method for ultralow sidelobe phased arrays is proposed, which is based on the constrained nonlinear optimization algorithm. By introducing a set of critical constraint conditions into the optimization model, we can directly quantize the amplitude distribution instead of replacing it with a continuous equivalent aperture antenna. The mutual coupling and the element patterns are also considered in the quantization synthesis. Finally, some array simulation results are given to show the effectiveness of the method.展开更多
An analytical model has been developed to study inversion layer quantization in the ultra thin oxide MOS （metal oxide semiconductor） structures using variation and triangular well approaches.Accurate modeling of the...An analytical model has been developed to study inversion layer quantization in the ultra thin oxide MOS （metal oxide semiconductor） structures using variation and triangular well approaches.Accurate modeling of the inversion charge density using the continuous surface potential equations has been done.No approximation has been taken to model the inversion layer quantization process.The results show that the variation approach describes inversion layer quantization process accurately as it matches well with the BSIM 5 （Berkeley short channel insulated gate field effect transistor model 5） results more closely compared with triangular well approach.展开更多
The quantization algorithm compresses the original network by reducing the numerical bit width of the model,which improves the computation speed. Because different layers have different redundancy and sensitivity to d...The quantization algorithm compresses the original network by reducing the numerical bit width of the model,which improves the computation speed. Because different layers have different redundancy and sensitivity to databit width. Reducing the data bit width will result in a loss of accuracy. Therefore, it is difficult to determinethe optimal bit width for different parts of the network with guaranteed accuracy. Mixed precision quantizationcan effectively reduce the amount of computation while keeping the model accuracy basically unchanged. In thispaper, a hardware-aware mixed precision quantization strategy optimal assignment algorithm adapted to low bitwidth is proposed, and reinforcement learning is used to automatically predict the mixed precision that meets theconstraints of hardware resources. In the state-space design, the standard deviation of weights is used to measurethe distribution difference of data, the execution speed feedback of simulated neural network accelerator inferenceis used as the environment to limit the action space of the agent, and the accuracy of the quantization model afterretraining is used as the reward function to guide the agent to carry out deep reinforcement learning training. Theexperimental results show that the proposed method obtains a suitable model layer-by-layer quantization strategyunder the condition that the computational resources are satisfied, and themodel accuracy is effectively improved.The proposed method has strong intelligence and certain universality and has strong application potential in thefield of mixed precision quantization and embedded neural network model deployment.展开更多
Asynchronous federated learning(AsynFL)can effectivelymitigate the impact of heterogeneity of edge nodes on joint training while satisfying participant user privacy protection and data security.However,the frequent ex...Asynchronous federated learning(AsynFL)can effectivelymitigate the impact of heterogeneity of edge nodes on joint training while satisfying participant user privacy protection and data security.However,the frequent exchange of massive data can lead to excess communication overhead between edge and central nodes regardless of whether the federated learning(FL)algorithm uses synchronous or asynchronous aggregation.Therefore,there is an urgent need for a method that can simultaneously take into account device heterogeneity and edge node energy consumption reduction.This paper proposes a novel Fixed-point Asynchronous Federated Learning(FixedAsynFL)algorithm,which could mitigate the resource consumption caused by frequent data communication while alleviating the effect of device heterogeneity.FixedAsynFL uses fixed-point quantization to compress the local and global models in AsynFL.In order to balance energy consumption and learning accuracy,this paper proposed a quantization scale selection mechanism.This paper examines the mathematical relationship between the quantization scale and energy consumption of the computation/communication process in the FixedAsynFL.Based on considering the upper bound of quantization noise,this paper optimizes the quantization scale by minimizing communication and computation consumption.This paper performs pertinent experiments on the MNIST dataset with several edge nodes of different computing efficiency.The results show that the FixedAsynFL algorithm with an 8-bit quantization can significantly reduce the communication data size by 81.3%and save the computation energy in the training phase by 74.9%without significant loss of accuracy.According to the experimental results,we can see that the proposed AsynFixedFL algorithm can effectively solve the problem of device heterogeneity and energy consumption limitation of edge nodes.展开更多
基金supported by the National Natural Science Foundation of China(Grant Nos.41490644,41475101 and 41421005)the CAS Strategic Priority Project(the Western Pacific Ocean System+2 种基金Project Nos.XDA11010105,XDA11020306 and XDA11010301)the NSFC-Shandong Joint Fund for Marine Science Research Centers(Grant No.U1406401)the NSFC Innovative Group Grant(Project No.41421005)
文摘A four-dimensional variational （4D-Var） data assimilation method is implemented in an improved intermediate coupled model （ICM） of the tropical Pacific. A twin experiment is designed to evaluate the impact of the 4D-Var data assimilation algorithm on ENSO analysis and prediction based on the ICM. The model error is assumed to arise only from the parameter uncertainty. The ＂observation＂ of the SST anomaly, which is sampled from a ＂truth＂ model simulation that takes default parameter values and has Gaussian noise added, is directly assimilated into the assimilation model with its parameters set erroneously. Results show that 4D-Var effectively reduces the error of ENSO analysis and therefore improves the prediction skill of ENSO events compared with the non-assimilation case. These results provide a promising way for the ICM to achieve better real-time ENSO prediction.
基金This work was funded by the UK Engineering and Physical Sciences Research Council(EP/N029496/1,EP/N029496/2,EP/N029356/1,EP/N029577/1,and EP/N029577/2).
文摘Aircraft ground movement plays a key role in improving airport efficiency,as it acts as a link to all other ground operations.Finding novel approaches to coordinate the movements of a fleet of aircraft at an airport in order to improve system resilience to disruptions with increasing autonomy is at the center of many key studies for airport airside operations.Moreover,autonomous taxiing is envisioned as a key component in future digitalized airports.However,state-of-the-art routing and scheduling algorithms for airport ground movements do not consider high-fidelity aircraft models at both the proactive and reactive planning phases.The majority of such algorithms do not actively seek to optimize fuel efficiency and reduce harmful greenhouse gas emissions.This paper proposes a new approach for generating efficient four-dimensional trajectories(4DTs)on the basis of a high-fidelity aircraft model and gainscheduling control strategy.Working in conjunction with a routing and scheduling algorithm that determines the taxi route,waypoints,and time deadlines,the proposed approach generates fuel-efficient 4DTs in real time,while respecting operational constraints.The proposed approach can be used in two contexts:①as a reactive decision support tool to generate new trajectories that can resolve unprecedented events;and②as an autopilot system for both partial and fully autonomous taxiing.The proposed methodology is realistic and simple to implement.Moreover,simulation studies show that the proposed approach is capable of providing an up to 11%reduction in the fuel consumed during the taxiing of a large Boeing 747-100 jumbo jet.
文摘Formal state space models of quantum control systems are deduced and a scheme to establish formal state space models via quantization could been obtained for quantum control systems is proposed. State evolution of quantum control systems must accord with Schrdinger equations, so it is foremost to obtain Hamiltonian operators of systems. There are corresponding relations between operators of quantum systems and corresponding physical quantities of classical systems, such as momentum, energy and Hamiltonian, so Schrdinger equation models of corresponding quantum control systems via quantization could been obtained from classical control systems, and then establish formal state space models through the suitable transformation from Schrdinger equations for these quantum control systems. This method provides a new kind of path for modeling in quantum control.
基金supported by the National Key R&D Program of China(No.2021YFB0301200)National Natural Science Foundation of China(No.62025208).
文摘Large-scale Language Models(LLMs)have achieved significant breakthroughs in Natural Language Processing(NLP),driven by the pre-training and fine-tuning paradigm.While this approach allows models to specialize in specific tasks with reduced training costs,the substantial memory requirements during fine-tuning present a barrier to broader deployment.Parameter-Efficient Fine-Tuning(PEFT)techniques,such as Low-Rank Adaptation(LoRA),and parameter quantization methods have emerged as solutions to address these challenges by optimizing memory usage and computational efficiency.Among these,QLoRA,which combines PEFT and quantization,has demonstrated notable success in reducing memory footprints during fine-tuning,prompting the development of various QLoRA variants.Despite these advancements,the quantitative impact of key variables on the fine-tuning performance of quantized LLMs remains underexplored.This study presents a comprehensive analysis of these key variables,focusing on their influence across different layer types and depths within LLM architectures.Our investigation uncovers several critical findings:(1)Larger layers,such as MLP layers,can maintain performance despite reductions in adapter rank,while smaller layers,like self-attention layers,aremore sensitive to such changes;(2)The effectiveness of balancing factors depends more on specific values rather than layer type or depth;(3)In quantization-aware fine-tuning,larger layers can effectively utilize smaller adapters,whereas smaller layers struggle to do so.These insights suggest that layer type is a more significant determinant of fine-tuning success than layer depth when optimizing quantized LLMs.Moreover,for the same discount of trainable parameters,reducing the trainable parameters in a larger layer is more effective in preserving fine-tuning accuracy than in a smaller one.This study provides valuable guidance for more efficient fine-tuning strategies and opens avenues for further research into optimizing LLM fine-tuning in resource-constrained environments.
基金supported by the National Natural Science Foundation of China(No.62201508)the Zhejiang Provincial Natural Science Foundation of China(Nos.LZ21F010001 and LQ23F010004)the State Key Laboratory of Millimeter Waves of Southeast University,China(No.K202212).
文摘Quantization noise caused by analog-to-digital converter(ADC)gives rise to the reliability performance degradation of communication systems.In this paper,a quantized non-Hermitian symmetry(NHS)orthogonal frequency-division multiplexing-based visible light communication(OFDM-VLC)system is presented.In order to analyze the effect of the resolution of ADC on NHS OFDM-VLC,a quantized mathematical model of NHS OFDM-VLC is established.Based on the proposed quantized model,a closed-form bit error rate(BER)expression is derived.The theoretical analysis and simulation results both confirm the effectiveness of the obtained BER formula in high-resolution ADC.In addition,channel coding is helpful in compensating for the BER performance loss due to the utilization of lower resolution ADC.
文摘The rapid growth of digital data necessitates advanced natural language processing(NLP)models like BERT(Bidi-rectional Encoder Representations from Transformers),known for its superior performance in text classification.However,BERT’s size and computational demands limit its practicality,especially in resource-constrained settings.This research compresses the BERT base model for Bengali emotion classification through knowledge distillation(KD),pruning,and quantization techniques.Despite Bengali being the sixth most spoken language globally,NLP research in this area is limited.Our approach addresses this gap by creating an efficient BERT-based model for Bengali text.We have explored 20 combinations for KD,quantization,and pruning,resulting in improved speedup,fewer parameters,and reduced memory size.Our best results demonstrate significant improvements in both speed and efficiency.For instance,in the case of mBERT,we achieved a 3.87×speedup and 4×compression ratio with a combination of Distil+Prune+Quant that reduced parameters from 178 to 46 M,while the memory size decreased from 711 to 178 MB.These results offer scalable solutions for NLP tasks in various languages and advance the field of model compression,making these models suitable for real-world applications in resource-limited environments.
文摘A half-harmonic oscillator, which gets its name because the position coordinate is strictly positive, has been quantized and determined that it was a physically correct quantization. This positive result was found using affine quantization (AQ). The main purpose of this paper is to compare results of this new quantization procedure with those of canonical quantization (CQ). Using Ashtekar-like classical variables and CQ, we quantize the same toy model. While these two quantizations lead to different results, they both would reduce to the same classical Hamiltonian if ħ→ 0. Since these two quantizations have differing results, only one of the quantizations can be physically correct. Two brief sections also illustrate how AQ can correctly help quantum gravity and the quantization of most field theory problems.
基金supported by the National Natural Science Foundation of China(Grant Nos.U22A20598 and 52104107)the"Qinglan Project"of Jiangsu Colleges and Universities,Young Elite Scientists Sponsorship Program of Jiangsu Province(Grant No.TJ-2023-086).
文摘As coal mining progresses to greater depths,controlling the stability of surrounding rock in deep roadways has become an increasingly complex challenge.Although four-dimensional(4D)support theoretically offers unique advantages in maintaining the stability of rock mass,the disaster evolution processes and multi-source information response characteristics in deep roadways with 4D support remain unclear.Consequently,a large-scale physical model testing system and self-designed 4D support components were employed to conduct similarity model tests on the surrounding rock failure process under unsupported(U-1),traditional bolt-mesh-cable support(T-2),and 4D support(4D-R-3)conditions.Combined with multi-source monitoring techniques,including stress–strain,digital image correlation(DIC),acoustic emission(AE),microseismic(MS),parallel electric(PE),and electromagnetic radiation(EMR),the mechanical behavior and multi-source information responses were comprehensively analyzed.The results show that the peak stress and displacement of the models are positively correlated with the support strength.The multi-source information exhibits distinct response characteristics under different supports.The response frequency,energy,and fluctuationsof AE,MS,and EMR signals,along with the apparent resistivity(AR)high-resistivity zone,follow the trend U-1>T-2>4D-R-3.Furthermore,multi-source information exhibits significantdifferences in sensitivity across different phases.The AE,MS,and EMR signals exhibit active responses to rock mass activity at each phase.However,AR signals are only sensitive to the fracture propagation during the plastic yield and failure phases.In summary,the 4D support significantlyenhances the bearing capacity and plastic deformation of the models,while substantially reducing the frequency,energy,and fluctuationsof multi-source signals.
文摘Cross-cultural management is often regarded as a discipline of international management focusing on cultural encounters between the organization and the nation-state, and providing tools to tackle cultural difl＇erences seen as sources of conflict, friction or misunderstanding. Based on Greet Hofstede＇ s Cultural Model, this paper attempts to shed some light on effective corporation management through cultural analysis of the difl＇erences between China and western countries. The paper puts more emphasis on the impact of cultural compatibility on effective corporation man- agement through the case study of China, Japan, Germany and America. The author argues that managers and employ- ees involved in companies with diverse cultural backgrounds should be integrated and developed into a specific local context through interlocking their cultural identifications and the organizational practices.
文摘Using the Faddeev-Jackiw （FJ） quantization method, this paper treats the CP^1nonlinear sigma model with ChernSimons term. The generalized FJ brackets are obtained in the framework of this quantization method, which agree with the results obtained by using the Dirac＇s method.
基金This work was supported by Open Fund Project of State Key Laboratory of Intelligent Vehicle Safety Technology by Grant with No.IVSTSKL-202311Key Projects of Science and Technology Research Programme of Chongqing Municipal Education Commission by Grant with No.KJZD-K202301505+1 种基金Cooperation Project between Chongqing Municipal Undergraduate Universities and Institutes Affiliated to the Chinese Academy of Sciences in 2021 by Grant with No.HZ2021015Chongqing Graduate Student Research Innovation Program by Grant with No.CYS240801.
文摘Massive computational complexity and memory requirement of artificial intelligence models impede their deploy-ability on edge computing devices of the Internet of Things(IoT).While Power-of-Two(PoT)quantization is pro-posed to improve the efficiency for edge inference of Deep Neural Networks(DNNs),existing PoT schemes require a huge amount of bit-wise manipulation and have large memory overhead,and their efficiency is bounded by the bottleneck of computation latency and memory footprint.To tackle this challenge,we present an efficient inference approach on the basis of PoT quantization and model compression.An integer-only scalar PoT quantization(IOS-PoT)is designed jointly with a distribution loss regularizer,wherein the regularizer minimizes quantization errors and training disturbances.Additionally,two-stage model compression is developed to effectively reduce memory requirement,and alleviate bandwidth usage in communications of networked heterogenous learning systems.The product look-up table(P-LUT)inference scheme is leveraged to replace bit-shifting with only indexing and addition operations for achieving low-latency computation and implementing efficient edge accelerators.Finally,comprehensive experiments on Residual Networks(ResNets)and efficient architectures with Canadian Institute for Advanced Research(CIFAR),ImageNet,and Real-world Affective Faces Database(RAF-DB)datasets,indicate that our approach achieves 2×∼10×improvement in the reduction of both weight size and computation cost in comparison to state-of-the-art methods.A P-LUT accelerator prototype is implemented on the Xilinx KV260 Field Programmable Gate Array(FPGA)platform for accelerating convolution operations,with performance results showing that P-LUT reduces memory footprint by 1.45×,achieves more than 3×power efficiency and 2×resource efficiency,compared to the conventional bit-shifting scheme.
文摘At the present time,the Industrial Internet of Things(IIoT)has swiftly evolved and emerged,and picture data that is collected by terminal devices or IoT nodes are tied to the user's private data.The use of image sensors as an automa-tion tool for the IIoT is increasingly becoming more common.Due to the fact that this organisation transfers an enormous number of photographs at any one time,one of the most significant issues that it has is reducing the total quantity of data that is sent and,as a result,the available bandwidth,without compromising the image quality.Image compression in the sensor,on the other hand,expedites the transfer of data while simultaneously reducing bandwidth use.The traditional method of protecting sensitive data is rendered less effective in an environment dominated by IoT owing to the involvement of third parties.The image encryp-tion model provides a safe and adaptable method to protect the confidentiality of picture transformation and storage inside an IIoT system.This helps to ensure that image datasets are kept safe.The Linde–Buzo–Gray(LBG)methodology is an example of a vector quantization algorithm that is extensively used and a rela-tively new form of picture reduction known as vector quantization(VQ).As a result,the purpose of this research is to create an artificial humming bird optimi-zation approach that combines LBG-enabled codebook creation and encryption(AHBO-LBGCCE)for use in an IIoT setting.In the beginning,the AHBO-LBGCCE method used the LBG model in conjunction with the AHBO algorithm in order to construct the VQ.The Burrows-Wheeler Transform(BWT)model is used in order to accomplish codebook compression.In addition,the Blowfish algorithm is used in order to carry out the encryption procedure so that security may be attained.A comprehensive experimental investigation is carried out in order to verify the effectiveness of the proposed algorithm in comparison to other algorithms.The experimental values ensure that the suggested approach and the outcomes are examined in a variety of different perspectives in order to further enhance them.
基金The National Natural Science Foundation of China(No.60474049,60835001)Specialized Research Fund for Doctoral Program of Higher Education(No.20090092120027)
文摘In order to overcome data-quantization, networked-induced delay, network packet dropouts and wrong sequences in the nonlinear networked control system, a novel nonlinear networked control system model is built by the T-S fuzzy method. Two time-varying quantizers are added in the model. The key analysis steps in the method are to construct an improved interval-delay-dependent Lyapunov functional and to introduce the free-weighting matrix. By making use of the parallel distributed compensation technology and the convexity of the matrix function, the improved criteria of the stabilization and stability are obtained. Simulation experiments show that the parameters of the controllers and quantizers satisfying a certain performance can be obtained by solving a set of LMIs. The application of the nonlinear mass-spring system is provided to show that the proposed method is effective.
基金sponsored by the U.S. National Science Foundation (Grant No.ATM0205599)the U.S. Offce of Navy Research under Grant N000140410471Dr. James A. Hansen was partially supported by US Offce of Naval Research (Grant No. N00014-06-1-0500)
文摘This study examines the performance of coupling the deterministic four-dimensional variational assimilation system （4DVAR） with an ensemble Kalman filter （EnKF） to produce a superior hybrid approach for data assimilation. The coupled assimilation scheme （E4DVAR） benefits from using the state-dependent uncertainty provided by EnKF while taking advantage of 4DVAR in preventing filter divergence： the 4DVAR analysis produces posterior maximum likelihood solutions through minimization of a cost function about which the ensemble perturbations are transformed, and the resulting ensemble analysis can be propagated forward both for the next assimilation cycle and as a basis for ensemble forecasting. The feasibility and effectiveness of this coupled approach are demonstrated in an idealized model with simulated observations. It is found that the E4DVAR is capable of outperforming both 4DVAR and the EnKF under both perfect- and imperfect-model scenarios. The performance of the coupled scheme is also less sensitive to either the ensemble size or the assimilation window length than those for standard EnKF or 4DVAR implementations.
基金This work was supported by the National Natural Science Foundation of China(62076025).
文摘This paper addresses a modified auxiliary model stochastic gradient recursive parameter identification algorithm(M-AM-SGRPIA)for a class of single input single output(SISO)linear output error models with multi-threshold quantized observations.It proves the convergence of the designed algorithm.A pattern-moving-based system dynamics description method with hybrid metrics is proposed for a kind of practical single input multiple output(SIMO)or SISO nonlinear systems,and a SISO linear output error model with multi-threshold quantized observations is adopted to approximate the unknown system.The system input design is accomplished using the measurement technology of random repeatability test,and the probabilistic characteristic of the explicit metric value is employed to estimate the implicit metric value of the pattern class variable.A modified auxiliary model stochastic gradient recursive algorithm(M-AM-SGRA)is designed to identify the model parameters,and the contraction mapping principle proves its convergence.Two numerical examples are given to demonstrate the feasibility and effectiveness of the achieved identification algorithm.
文摘We justify and extend the standard model of elementary particle physics by generalizing the theory of relativity and quantum mechanics. The usual assumption that space and time are continuous implies, indeed, that it should be possible to measure arbitrarily small intervals of space and time, but we ignore if that is true or not. It is thus more realistic to consider an extremely small “quantum of length” of yet unknown value <em>a</em>. It is only required to be a universal constant for all inertial frames, like<em> c</em> and <em>h</em>. This yields a logically consistent theory and accounts for elementary particles by means of four new quantum numbers. They define “particle states” in terms of modulations of wave functions at the smallest possible scale in space-time. The resulting classification of elementary particles accounts also for dark matter. Antiparticles are redefined, without needing negative energy states and recently observed “anomalies” can be explained.
文摘In this paper, a new amplitude quantization synthesis method for ultralow sidelobe phased arrays is proposed, which is based on the constrained nonlinear optimization algorithm. By introducing a set of critical constraint conditions into the optimization model, we can directly quantize the amplitude distribution instead of replacing it with a continuous equivalent aperture antenna. The mutual coupling and the element patterns are also considered in the quantization synthesis. Finally, some array simulation results are given to show the effectiveness of the method.
文摘An analytical model has been developed to study inversion layer quantization in the ultra thin oxide MOS （metal oxide semiconductor） structures using variation and triangular well approaches.Accurate modeling of the inversion charge density using the continuous surface potential equations has been done.No approximation has been taken to model the inversion layer quantization process.The results show that the variation approach describes inversion layer quantization process accurately as it matches well with the BSIM 5 （Berkeley short channel insulated gate field effect transistor model 5） results more closely compared with triangular well approach.
文摘The quantization algorithm compresses the original network by reducing the numerical bit width of the model,which improves the computation speed. Because different layers have different redundancy and sensitivity to databit width. Reducing the data bit width will result in a loss of accuracy. Therefore, it is difficult to determinethe optimal bit width for different parts of the network with guaranteed accuracy. Mixed precision quantizationcan effectively reduce the amount of computation while keeping the model accuracy basically unchanged. In thispaper, a hardware-aware mixed precision quantization strategy optimal assignment algorithm adapted to low bitwidth is proposed, and reinforcement learning is used to automatically predict the mixed precision that meets theconstraints of hardware resources. In the state-space design, the standard deviation of weights is used to measurethe distribution difference of data, the execution speed feedback of simulated neural network accelerator inferenceis used as the environment to limit the action space of the agent, and the accuracy of the quantization model afterretraining is used as the reward function to guide the agent to carry out deep reinforcement learning training. Theexperimental results show that the proposed method obtains a suitable model layer-by-layer quantization strategyunder the condition that the computational resources are satisfied, and themodel accuracy is effectively improved.The proposed method has strong intelligence and certain universality and has strong application potential in thefield of mixed precision quantization and embedded neural network model deployment.
基金This work was funded by National Key R&D Program of China(Grant No.2020YFB0906003).
文摘Asynchronous federated learning(AsynFL)can effectivelymitigate the impact of heterogeneity of edge nodes on joint training while satisfying participant user privacy protection and data security.However,the frequent exchange of massive data can lead to excess communication overhead between edge and central nodes regardless of whether the federated learning(FL)algorithm uses synchronous or asynchronous aggregation.Therefore,there is an urgent need for a method that can simultaneously take into account device heterogeneity and edge node energy consumption reduction.This paper proposes a novel Fixed-point Asynchronous Federated Learning(FixedAsynFL)algorithm,which could mitigate the resource consumption caused by frequent data communication while alleviating the effect of device heterogeneity.FixedAsynFL uses fixed-point quantization to compress the local and global models in AsynFL.In order to balance energy consumption and learning accuracy,this paper proposed a quantization scale selection mechanism.This paper examines the mathematical relationship between the quantization scale and energy consumption of the computation/communication process in the FixedAsynFL.Based on considering the upper bound of quantization noise,this paper optimizes the quantization scale by minimizing communication and computation consumption.This paper performs pertinent experiments on the MNIST dataset with several edge nodes of different computing efficiency.The results show that the FixedAsynFL algorithm with an 8-bit quantization can significantly reduce the communication data size by 81.3%and save the computation energy in the training phase by 74.9%without significant loss of accuracy.According to the experimental results,we can see that the proposed AsynFixedFL algorithm can effectively solve the problem of device heterogeneity and energy consumption limitation of edge nodes.
