We consider a relativistic two-fluid model of superfluidity,in which the superfluid is described by an order parameter that is a complex scalar field satisfying the nonlinear Klein-Gordon equation(NLKG).The coupling t...We consider a relativistic two-fluid model of superfluidity,in which the superfluid is described by an order parameter that is a complex scalar field satisfying the nonlinear Klein-Gordon equation(NLKG).The coupling to the normal fluid is introduced via a covariant current-current interaction,which results in the addition of an effective potential,whose imaginary part describes particle transfer between superfluid and normal fluid.Quantized vorticity arises in a class of singular solutions and the related vortex dynamics is incorporated in the modified NLKG,facilitating numerical analysis which is usually very complicated in the phenomenology of vortex filaments.The dual transformation to a string theory description(Kalb-Ramond)of quantum vorticity,the Magnus force,and the mutual friction between quantized vortices and normal fluid are also studied.展开更多
Large-scale Language Models(LLMs)have achieved significant breakthroughs in Natural Language Processing(NLP),driven by the pre-training and fine-tuning paradigm.While this approach allows models to specialize in speci...Large-scale Language Models(LLMs)have achieved significant breakthroughs in Natural Language Processing(NLP),driven by the pre-training and fine-tuning paradigm.While this approach allows models to specialize in specific tasks with reduced training costs,the substantial memory requirements during fine-tuning present a barrier to broader deployment.Parameter-Efficient Fine-Tuning(PEFT)techniques,such as Low-Rank Adaptation(LoRA),and parameter quantization methods have emerged as solutions to address these challenges by optimizing memory usage and computational efficiency.Among these,QLoRA,which combines PEFT and quantization,has demonstrated notable success in reducing memory footprints during fine-tuning,prompting the development of various QLoRA variants.Despite these advancements,the quantitative impact of key variables on the fine-tuning performance of quantized LLMs remains underexplored.This study presents a comprehensive analysis of these key variables,focusing on their influence across different layer types and depths within LLM architectures.Our investigation uncovers several critical findings:(1)Larger layers,such as MLP layers,can maintain performance despite reductions in adapter rank,while smaller layers,like self-attention layers,aremore sensitive to such changes;(2)The effectiveness of balancing factors depends more on specific values rather than layer type or depth;(3)In quantization-aware fine-tuning,larger layers can effectively utilize smaller adapters,whereas smaller layers struggle to do so.These insights suggest that layer type is a more significant determinant of fine-tuning success than layer depth when optimizing quantized LLMs.Moreover,for the same discount of trainable parameters,reducing the trainable parameters in a larger layer is more effective in preserving fine-tuning accuracy than in a smaller one.This study provides valuable guidance for more efficient fine-tuning strategies and opens avenues for further research into optimizing LLM fine-tuning in resource-constrained environments.展开更多
In this tutorial paper, we explore the field of quantized feedback control, which has gained significant attention due to the growing prevalence of networked control systems. These systems require the transmission of ...In this tutorial paper, we explore the field of quantized feedback control, which has gained significant attention due to the growing prevalence of networked control systems. These systems require the transmission of feedback information, such as measurements and control signals, over digital networks, presenting novel challenges in estimation and control design. Our examination encompasses various topics, including the minimal information needed for effective feedback control, the design of quantizers, strategies for quantized control design and estimation,achieving consensus control with quantized data, and the pursuit of high-precision tracking using quantized measurements.展开更多
This paper is concerned with distributed Nash equi librium seeking strategies under quantized communication. In the proposed seeking strategy, a projection operator is synthesized with a gradient search method to achi...This paper is concerned with distributed Nash equi librium seeking strategies under quantized communication. In the proposed seeking strategy, a projection operator is synthesized with a gradient search method to achieve the optimization o players' objective functions while restricting their actions within required non-empty, convex and compact domains. In addition, a leader-following consensus protocol, in which quantized informa tion flows are utilized, is employed for information sharing among players. More specifically, logarithmic quantizers and uniform quantizers are investigated under both undirected and connected communication graphs and strongly connected digraphs, respec tively. Through Lyapunov stability analysis, it is shown that play ers' actions can be steered to a neighborhood of the Nash equilib rium with logarithmic and uniform quantizers, and the quanti fied convergence error depends on the parameter of the quan tizer for both undirected and directed cases. A numerical exam ple is given to verify the theoretical results.展开更多
The nanoscale confinement is of great important for the industrial applications of molecular sieve,desalination,and also essential in bio-logical transport systems.Massive efforts have been devoted to the influence of...The nanoscale confinement is of great important for the industrial applications of molecular sieve,desalination,and also essential in bio-logical transport systems.Massive efforts have been devoted to the influence of restricted spaces on the properties of confined fluids.However,the situation of channel-wall is crucial but attracts less attention and remains unknown.To fundamentally understand the mechanism of channel-walls in nanoconfinement,we investigated the interaction between the counter-force of the liquid and interlamellar spacing of nanochannel walls by considering the effect of both spatial confinement and surface wettability.The results reveal that the nanochannel stables at only a few discrete spacing states when its confinement is within 1.4 nm.The quantized interlayer spacing is attributed to water molecules becoming laminated structures,and the stable states are corresponding to the monolayer,bilayer and trilayer water configurations,respectively.The results can potentially help to understand the characterized interlayers spacing of graphene oxide membrane in water.Our findings are hold great promise in design of ion filtration membrane and artificial water/ion channels.展开更多
In networked system identification,how to effectively use communication resources and improve convergence speed is the focus of attention.However,there is an inherent contradiction between the two tasks.In this paper,...In networked system identification,how to effectively use communication resources and improve convergence speed is the focus of attention.However,there is an inherent contradiction between the two tasks.In this paper,the event-driven communication is used to save communication resources for the identification of finite impulse response systems,and the input design is carried out to meet the requirements of convergence speed.First,a difference-driven communication is proposed.Then,the performance of the communication mechanism is analyzed,and the calculation method of its communication rate is given.After that,according to the communication rate and the convergence rate of the identification algorithm,the input design problem is transformed into a constrained optimization problem,and the algorithm for finding the optimal solution is given.In addition,considering the case that the output is quantized by multiple thresholds,the way to calculate its communication rate is given and the influence of threshold number on communication rate is discussed.Finally,the effectiveness of the algorithm is verified by simulation.展开更多
Quantized training has been proven to be a prominent method to achieve deep neural network training under limited computational resources.It uses low bit-width arithmetics with a proper scaling factor to achieve negli...Quantized training has been proven to be a prominent method to achieve deep neural network training under limited computational resources.It uses low bit-width arithmetics with a proper scaling factor to achieve negligible accuracy loss.Cambricon-Q is the ASIC design proposed to efficiently support quantized training,and achieves significant performance improvement.However,there are still two caveats in the design.First,Cambricon-Q with different hardware specifications may lead to different numerical errors,resulting in non-reproducible behaviors which may become a major concern in critical applications.Second,Cambricon-Q cannot leverage data sparsity,where considerable cycles could still be squeezed out.To address the caveats,the acceleration core of Cambricon-Q is redesigned to support fine-grained irregular data processing.The new design not only enables acceleration on sparse data,but also enables performing local dynamic quantization by contiguous value ranges(which is hardware independent),instead of contiguous addresses(which is dependent on hardware factors).Experimental results show that the accuracy loss of the method still keeps negligible,and the accelerator achieves 1.61×performance improvement over Cambricon-Q,with about 10%energy increase.展开更多
In this paper,we innovatively associate the mutual information with the frame error rate(FER)performance and propose novel quantized decoders for polar codes.Based on the optimal quantizer of binary-input discrete mem...In this paper,we innovatively associate the mutual information with the frame error rate(FER)performance and propose novel quantized decoders for polar codes.Based on the optimal quantizer of binary-input discrete memoryless channels(BDMCs),the proposed decoders quantize the virtual subchannels of polar codes to maximize mutual information(MMI)between source bits and quantized symbols.The nested structure of polar codes ensures that the MMI quantization can be implemented stage by stage.Simulation results show that the proposed MMI decoders with 4 quantization bits outperform the existing nonuniform quantized decoders that minimize mean-squared error(MMSE)with 4 quantization bits,and yield even better performance than uniform MMI quantized decoders with 5 quantization bits.Furthermore,the proposed 5-bit quantized MMI decoders approach the floating-point decoders with negligible performance loss.展开更多
Quantized control systems design is motivated by the convergence of controls and communications to address modern engineering applications involving the use of information technology. This paper presents an overview o...Quantized control systems design is motivated by the convergence of controls and communications to address modern engineering applications involving the use of information technology. This paper presents an overview of recent developments on the control of linear and nonlinear systems when the control input is subject to quantization or the quantized states or outputs are used as feedback measurements. The co-existence of high-dimeasionality, quantization, nonlinearity and uncertainty poses great challenges to quantized control of nonlinear systems and thus calls for new ideas and techniques. The field of quantized nonlinear control is still at its infancy. Preliminary results in our recent work based on input-to-state stability and cyclic-small-gain theorems are reviewed. The open problems in quantized nonlinear control are also outlined.展开更多
Quantized kernel least mean square(QKLMS) algorithm is an effective nonlinear adaptive online learning algorithm with good performance in constraining the growth of network size through the use of quantization for inp...Quantized kernel least mean square(QKLMS) algorithm is an effective nonlinear adaptive online learning algorithm with good performance in constraining the growth of network size through the use of quantization for input space. It can serve as a powerful tool to perform complex computing for network service and application. With the purpose of compressing the input to further improve learning performance, this article proposes a novel QKLMS with entropy-guided learning, called EQ-KLMS. Under the consecutive square entropy learning framework, the basic idea of entropy-guided learning technique is to measure the uncertainty of the input vectors used for QKLMS, and delete those data with larger uncertainty, which are insignificant or easy to cause learning errors. Then, the dataset is compressed. Consequently, by using square entropy, the learning performance of proposed EQ-KLMS is improved with high precision and low computational cost. The proposed EQ-KLMS is validated using a weather-related dataset, and the results demonstrate the desirable performance of our scheme.展开更多
The Major ana zero mode(MZM), which manifests as an exotic neutral excitation in superconductors, is the building block of topological quantum computing. It has recently been found in the vortices of several iron-base...The Major ana zero mode(MZM), which manifests as an exotic neutral excitation in superconductors, is the building block of topological quantum computing. It has recently been found in the vortices of several iron-based superconductors as a zero-bias conductance peak in tunneling spectroscopy. In particular, a clean and robust MZM has been observed in the cores of free vortices in(Li_(0.84)Fe_(0.16))OHFeSe. Here using scanning tunneling spectroscopy, we demonstrate that Major ana-induced resonant Andreev reflection occurs between the STM tip and this zero-bias bound state,and consequently, the conductance at zero bias is quantized as 2e^2/h. Our results present a hallmark signature of the MZM in the vortex of an intrinsic topological superconductor, together with its intriguing behavior.展开更多
This paper addresses a modified auxiliary model stochastic gradient recursive parameter identification algorithm(M-AM-SGRPIA)for a class of single input single output(SISO)linear output error models with multi-thresho...This paper addresses a modified auxiliary model stochastic gradient recursive parameter identification algorithm(M-AM-SGRPIA)for a class of single input single output(SISO)linear output error models with multi-threshold quantized observations.It proves the convergence of the designed algorithm.A pattern-moving-based system dynamics description method with hybrid metrics is proposed for a kind of practical single input multiple output(SIMO)or SISO nonlinear systems,and a SISO linear output error model with multi-threshold quantized observations is adopted to approximate the unknown system.The system input design is accomplished using the measurement technology of random repeatability test,and the probabilistic characteristic of the explicit metric value is employed to estimate the implicit metric value of the pattern class variable.A modified auxiliary model stochastic gradient recursive algorithm(M-AM-SGRA)is designed to identify the model parameters,and the contraction mapping principle proves its convergence.Two numerical examples are given to demonstrate the feasibility and effectiveness of the achieved identification algorithm.展开更多
For a class of high-order nonlinear multi-agent systems with input hysteresis,an adaptive consensus output-feedback quantized control scheme with full state constraints is investigated.The major properties of the prop...For a class of high-order nonlinear multi-agent systems with input hysteresis,an adaptive consensus output-feedback quantized control scheme with full state constraints is investigated.The major properties of the proposed control scheme are:1)According to the different hysteresis input characteristics of each agent in the multi-agent system,a hysteresis quantization inverse compensator is designed to eliminate the influence of hysteresis characteristics on the system while ensuring that the quantized signal maintains the desired value.2)A barrier Lyapunov function is introduced for the first time in the hysteretic multi-agent system.By constructing state constraint control strategy for the hysteretic multi-agent system,it ensures that all the states of the system are always maintained within a predetermined range.3)The designed adaptive consensus output-feedback quantization control scheme allows the hysteretic system to have unknown parameters and unknown disturbance,and ensures that the input signal transmitted between agents is the quantization value,and the introduced quantizer is implemented under the condition that only its sector bound property is required.The stability analysis has proved that all signals of the closed-loop are semi-globally uniformly bounded.The Star Sim hardware-in-the-loop simulation certificates the effectiveness of the proposed adaptive quantized control scheme.展开更多
Quantized H_∞ fault-tolerant control for networked control systems (NCSs) with partial actuator fault with respect to actuators is concerned in this paper. Considering transmission delay, packet dropout and quantizat...Quantized H_∞ fault-tolerant control for networked control systems (NCSs) with partial actuator fault with respect to actuators is concerned in this paper. Considering transmission delay, packet dropout and quantization, a synthesis model with partial actuator fault is established. The piecewise constant controller is adopted to model NCS with the transmission delay and packet dropout. Due to data transmitted in practical NCSs should be quantized before they are sent to the next network node, the logarithmic static and time-invariant quantizers at the sensor and controller sides are proposed in the paper. For the established model, an appropriate type of Lyapunov functions is provided to investigate the delay-dependent H_∞ control problem. According to an optimal problem, the controller that makes the system achieve the best performance is designed. Finally, an illustrative example is given to demonstrate the effectiveness of the proposed approach.展开更多
Constructive nonlinear control design has undergone rapid and significant progress over the last three decades. In this paper, a review of recent results in this important field is presented with a focus on interdisci...Constructive nonlinear control design has undergone rapid and significant progress over the last three decades. In this paper, a review of recent results in this important field is presented with a focus on interdisciplinary topics at the interface of control,computing and communications. In particular, it is shown that the nonlinear small-gain theory provides a unified framework for solving problems of quantized feedback stabilization and event-triggered control for nonlinear systems. Some open questions in quantized and networked nonlinear control systems are discussed.展开更多
The problem of the quantized dynamic output feedback controller design for networked control systems is mainly discussed. By using the quantized information of the system measurement output and the control input, a no...The problem of the quantized dynamic output feedback controller design for networked control systems is mainly discussed. By using the quantized information of the system measurement output and the control input, a novel networked control system model is described. This model includes many networkinduced features, such as multi-rate sampled-data, quantized signal, time-varying delay and packet dropout. By constructing suitable Lyapunov-Krasovskii functional, a less conservative stabilization criterion is established in terms of linear matrix inequalities. The quantized control strategy involves the updating values of the quantizer parameters μi（i = 1, 2）（μi take on countable sets of values which dependent on the information of the system measurement outputs and the control inputs）. Furthermore, a numerical example is given to illustrate the effectiveness of the proposed method.展开更多
In order to overcome data-quantization, networked-induced delay, network packet dropouts and wrong sequences in the nonlinear networked control system, a novel nonlinear networked control system model is built by the ...In order to overcome data-quantization, networked-induced delay, network packet dropouts and wrong sequences in the nonlinear networked control system, a novel nonlinear networked control system model is built by the T-S fuzzy method. Two time-varying quantizers are added in the model. The key analysis steps in the method are to construct an improved interval-delay-dependent Lyapunov functional and to introduce the free-weighting matrix. By making use of the parallel distributed compensation technology and the convexity of the matrix function, the improved criteria of the stabilization and stability are obtained. Simulation experiments show that the parameters of the controllers and quantizers satisfying a certain performance can be obtained by solving a set of LMIs. The application of the nonlinear mass-spring system is provided to show that the proposed method is effective.展开更多
We investigate the quasi-synchronization of fractional-order complex networks(FCNs) with random coupling via quantized control. Firstly, based on the logarithmic quantizer theory and the Lyapunov stability theory, a n...We investigate the quasi-synchronization of fractional-order complex networks(FCNs) with random coupling via quantized control. Firstly, based on the logarithmic quantizer theory and the Lyapunov stability theory, a new quantized feedback controller, which can make all nodes of complex networks quasi-synchronization and eliminate the disturbance of random coupling in the system state, is designed under non-delay conditions. Secondly, we extend the theoretical results under non-delay conditions to time-varying delay conditions and design another form of quantization feedback controller to ensure that the network achieves quasi-synchronization. Furthermore, the error bound of quasi-synchronization is obtained.Finally, we verify the accuracy of our results using two numerical simulation examples.展开更多
Spectrum access approach and power allocation scheme are important techniques in cognitive radio(CR) system,which not only affect communication performance of CR user(secondary user,SU) but also play decisive role for...Spectrum access approach and power allocation scheme are important techniques in cognitive radio(CR) system,which not only affect communication performance of CR user(secondary user,SU) but also play decisive role for protection of primary user(PU).In this study,we propose a power allocation scheme for SU based on the status sensing of PU in a single-input single-output(SISO) CR network.Instead of the conventional binary primary transmit power strategy,namely the sensed PU has only present or absent status,we consider a more practical scenario when PU transmits with multiple levels of power and quantized side information known by SU in advance as a primary quantized codebook.The secondary power allocation scheme to maximize the average throughput under the rate loss constraint(RLC) of PU is parameterized by the sensing results for PU,the primary quantized codebook and the channel state information(CSI) of SU.Furthermore,Differential Evolution(DE) algorithm is used to solve this non-convex power allocation problem.Simulation results show the performance and effectiveness of our proposed scheme under more practical communication conditions.展开更多
We employ the parallel computing technology to study numerically the three-dimensional structure of quantized vortices of Bose-Einstein condensates, For anisotropic cases, the bending process of vortices is described ...We employ the parallel computing technology to study numerically the three-dimensional structure of quantized vortices of Bose-Einstein condensates, For anisotropic cases, the bending process of vortices is described in detail by the decrease of Gross-Pitaevskii energy. A completely straight vortex and the steady and symmetrical multiple-vortex configurations are obtained. We analyse the effect of initial conditions and angular velocity on the number and shape of vortices.展开更多
文摘We consider a relativistic two-fluid model of superfluidity,in which the superfluid is described by an order parameter that is a complex scalar field satisfying the nonlinear Klein-Gordon equation(NLKG).The coupling to the normal fluid is introduced via a covariant current-current interaction,which results in the addition of an effective potential,whose imaginary part describes particle transfer between superfluid and normal fluid.Quantized vorticity arises in a class of singular solutions and the related vortex dynamics is incorporated in the modified NLKG,facilitating numerical analysis which is usually very complicated in the phenomenology of vortex filaments.The dual transformation to a string theory description(Kalb-Ramond)of quantum vorticity,the Magnus force,and the mutual friction between quantized vortices and normal fluid are also studied.
基金supported by the National Key R&D Program of China(No.2021YFB0301200)National Natural Science Foundation of China(No.62025208).
文摘Large-scale Language Models(LLMs)have achieved significant breakthroughs in Natural Language Processing(NLP),driven by the pre-training and fine-tuning paradigm.While this approach allows models to specialize in specific tasks with reduced training costs,the substantial memory requirements during fine-tuning present a barrier to broader deployment.Parameter-Efficient Fine-Tuning(PEFT)techniques,such as Low-Rank Adaptation(LoRA),and parameter quantization methods have emerged as solutions to address these challenges by optimizing memory usage and computational efficiency.Among these,QLoRA,which combines PEFT and quantization,has demonstrated notable success in reducing memory footprints during fine-tuning,prompting the development of various QLoRA variants.Despite these advancements,the quantitative impact of key variables on the fine-tuning performance of quantized LLMs remains underexplored.This study presents a comprehensive analysis of these key variables,focusing on their influence across different layer types and depths within LLM architectures.Our investigation uncovers several critical findings:(1)Larger layers,such as MLP layers,can maintain performance despite reductions in adapter rank,while smaller layers,like self-attention layers,aremore sensitive to such changes;(2)The effectiveness of balancing factors depends more on specific values rather than layer type or depth;(3)In quantization-aware fine-tuning,larger layers can effectively utilize smaller adapters,whereas smaller layers struggle to do so.These insights suggest that layer type is a more significant determinant of fine-tuning success than layer depth when optimizing quantized LLMs.Moreover,for the same discount of trainable parameters,reducing the trainable parameters in a larger layer is more effective in preserving fine-tuning accuracy than in a smaller one.This study provides valuable guidance for more efficient fine-tuning strategies and opens avenues for further research into optimizing LLM fine-tuning in resource-constrained environments.
基金partially supported by National Natura Science Foundation of China (62350710214, U23A20325)Shenzhen Key Laboratory of Control Theory and Intelligent Systems (ZDSYS20220330161800001)。
文摘In this tutorial paper, we explore the field of quantized feedback control, which has gained significant attention due to the growing prevalence of networked control systems. These systems require the transmission of feedback information, such as measurements and control signals, over digital networks, presenting novel challenges in estimation and control design. Our examination encompasses various topics, including the minimal information needed for effective feedback control, the design of quantizers, strategies for quantized control design and estimation,achieving consensus control with quantized data, and the pursuit of high-precision tracking using quantized measurements.
基金supported by the National Natural Science Foundation of China (NSFC)(62222308, 62173181, 62073171, 62221004)the Natural Science Foundation of Jiangsu Province (BK20200744, BK20220139)+3 种基金Jiangsu Specially-Appointed Professor (RK043STP19001)the Young Elite Scientists Sponsorship Program by CAST (2021QNRC001)1311 Talent Plan of Nanjing University of Posts and Telecommunicationsthe Fundamental Research Funds for the Central Universities (30920032203)。
文摘This paper is concerned with distributed Nash equi librium seeking strategies under quantized communication. In the proposed seeking strategy, a projection operator is synthesized with a gradient search method to achieve the optimization o players' objective functions while restricting their actions within required non-empty, convex and compact domains. In addition, a leader-following consensus protocol, in which quantized informa tion flows are utilized, is employed for information sharing among players. More specifically, logarithmic quantizers and uniform quantizers are investigated under both undirected and connected communication graphs and strongly connected digraphs, respec tively. Through Lyapunov stability analysis, it is shown that play ers' actions can be steered to a neighborhood of the Nash equilib rium with logarithmic and uniform quantizers, and the quanti fied convergence error depends on the parameter of the quan tizer for both undirected and directed cases. A numerical exam ple is given to verify the theoretical results.
基金support from the National Natural Science Foundation of China(Grant Nos.12372327,12372109,11972171)National Key R&D Program of China(Grant No.2023YFB4605101).
文摘The nanoscale confinement is of great important for the industrial applications of molecular sieve,desalination,and also essential in bio-logical transport systems.Massive efforts have been devoted to the influence of restricted spaces on the properties of confined fluids.However,the situation of channel-wall is crucial but attracts less attention and remains unknown.To fundamentally understand the mechanism of channel-walls in nanoconfinement,we investigated the interaction between the counter-force of the liquid and interlamellar spacing of nanochannel walls by considering the effect of both spatial confinement and surface wettability.The results reveal that the nanochannel stables at only a few discrete spacing states when its confinement is within 1.4 nm.The quantized interlayer spacing is attributed to water molecules becoming laminated structures,and the stable states are corresponding to the monolayer,bilayer and trilayer water configurations,respectively.The results can potentially help to understand the characterized interlayers spacing of graphene oxide membrane in water.Our findings are hold great promise in design of ion filtration membrane and artificial water/ion channels.
基金supported in part by the National Natural Science Foundation of China(No.62173030)in part by the Beijing Natural Science Foundation(No.4222050).
文摘In networked system identification,how to effectively use communication resources and improve convergence speed is the focus of attention.However,there is an inherent contradiction between the two tasks.In this paper,the event-driven communication is used to save communication resources for the identification of finite impulse response systems,and the input design is carried out to meet the requirements of convergence speed.First,a difference-driven communication is proposed.Then,the performance of the communication mechanism is analyzed,and the calculation method of its communication rate is given.After that,according to the communication rate and the convergence rate of the identification algorithm,the input design problem is transformed into a constrained optimization problem,and the algorithm for finding the optimal solution is given.In addition,considering the case that the output is quantized by multiple thresholds,the way to calculate its communication rate is given and the influence of threshold number on communication rate is discussed.Finally,the effectiveness of the algorithm is verified by simulation.
基金the National Key Research and Devecopment Program of China(No.2022YFB4501601)the National Natural Science Foundation of China(No.62102398,U20A20227,62222214,62002338,U22A2028,U19B2019)+1 种基金the Chinese Academy of Sciences Project for Young Scientists in Basic Research(YSBR-029)Youth Innovation Promotion Association Chinese Academy of Sciences。
文摘Quantized training has been proven to be a prominent method to achieve deep neural network training under limited computational resources.It uses low bit-width arithmetics with a proper scaling factor to achieve negligible accuracy loss.Cambricon-Q is the ASIC design proposed to efficiently support quantized training,and achieves significant performance improvement.However,there are still two caveats in the design.First,Cambricon-Q with different hardware specifications may lead to different numerical errors,resulting in non-reproducible behaviors which may become a major concern in critical applications.Second,Cambricon-Q cannot leverage data sparsity,where considerable cycles could still be squeezed out.To address the caveats,the acceleration core of Cambricon-Q is redesigned to support fine-grained irregular data processing.The new design not only enables acceleration on sparse data,but also enables performing local dynamic quantization by contiguous value ranges(which is hardware independent),instead of contiguous addresses(which is dependent on hardware factors).Experimental results show that the accuracy loss of the method still keeps negligible,and the accelerator achieves 1.61×performance improvement over Cambricon-Q,with about 10%energy increase.
基金financially supported in part by National Key R&D Program of China(No.2018YFB1801402)in part by Huawei Technologies Co.,Ltd.
文摘In this paper,we innovatively associate the mutual information with the frame error rate(FER)performance and propose novel quantized decoders for polar codes.Based on the optimal quantizer of binary-input discrete memoryless channels(BDMCs),the proposed decoders quantize the virtual subchannels of polar codes to maximize mutual information(MMI)between source bits and quantized symbols.The nested structure of polar codes ensures that the MMI quantization can be implemented stage by stage.Simulation results show that the proposed MMI decoders with 4 quantization bits outperform the existing nonuniform quantized decoders that minimize mean-squared error(MMSE)with 4 quantization bits,and yield even better performance than uniform MMI quantized decoders with 5 quantization bits.Furthermore,the proposed 5-bit quantized MMI decoders approach the floating-point decoders with negligible performance loss.
基金Supported by National Science Foundation of USA （DMS-0906659. ECCS-1230040）
文摘Quantized control systems design is motivated by the convergence of controls and communications to address modern engineering applications involving the use of information technology. This paper presents an overview of recent developments on the control of linear and nonlinear systems when the control input is subject to quantization or the quantized states or outputs are used as feedback measurements. The co-existence of high-dimeasionality, quantization, nonlinearity and uncertainty poses great challenges to quantized control of nonlinear systems and thus calls for new ideas and techniques. The field of quantized nonlinear control is still at its infancy. Preliminary results in our recent work based on input-to-state stability and cyclic-small-gain theorems are reviewed. The open problems in quantized nonlinear control are also outlined.
基金supported by the National Key Technologies R&D Program of China under Grant No. 2015BAK38B01the National Natural Science Foundation of China under Grant Nos. 61174103 and 61603032+4 种基金the National Key Research and Development Program of China under Grant Nos. 2016YFB0700502, 2016YFB1001404, and 2017YFB0702300the China Postdoctoral Science Foundation under Grant No. 2016M590048the Fundamental Research Funds for the Central Universities under Grant No. 06500025the University of Science and Technology Beijing - Taipei University of Technology Joint Research Program under Grant No. TW201610the Foundation from the Taipei University of Technology of Taiwan under Grant No. NTUT-USTB-105-4
文摘Quantized kernel least mean square(QKLMS) algorithm is an effective nonlinear adaptive online learning algorithm with good performance in constraining the growth of network size through the use of quantization for input space. It can serve as a powerful tool to perform complex computing for network service and application. With the purpose of compressing the input to further improve learning performance, this article proposes a novel QKLMS with entropy-guided learning, called EQ-KLMS. Under the consecutive square entropy learning framework, the basic idea of entropy-guided learning technique is to measure the uncertainty of the input vectors used for QKLMS, and delete those data with larger uncertainty, which are insignificant or easy to cause learning errors. Then, the dataset is compressed. Consequently, by using square entropy, the learning performance of proposed EQ-KLMS is improved with high precision and low computational cost. The proposed EQ-KLMS is validated using a weather-related dataset, and the results demonstrate the desirable performance of our scheme.
基金Supported by the National Natural Science Foundation of Chinathe National Key R&D Program of China under Grant Nos2016YFA0300200,2017YFA0303004 and 2017YFA0303003the Key Research of Frontier Sciences of CAS under Grant No QYZDY-SSW-SLH001
文摘The Major ana zero mode(MZM), which manifests as an exotic neutral excitation in superconductors, is the building block of topological quantum computing. It has recently been found in the vortices of several iron-based superconductors as a zero-bias conductance peak in tunneling spectroscopy. In particular, a clean and robust MZM has been observed in the cores of free vortices in(Li_(0.84)Fe_(0.16))OHFeSe. Here using scanning tunneling spectroscopy, we demonstrate that Major ana-induced resonant Andreev reflection occurs between the STM tip and this zero-bias bound state,and consequently, the conductance at zero bias is quantized as 2e^2/h. Our results present a hallmark signature of the MZM in the vortex of an intrinsic topological superconductor, together with its intriguing behavior.
基金This work was supported by the National Natural Science Foundation of China(62076025).
文摘This paper addresses a modified auxiliary model stochastic gradient recursive parameter identification algorithm(M-AM-SGRPIA)for a class of single input single output(SISO)linear output error models with multi-threshold quantized observations.It proves the convergence of the designed algorithm.A pattern-moving-based system dynamics description method with hybrid metrics is proposed for a kind of practical single input multiple output(SIMO)or SISO nonlinear systems,and a SISO linear output error model with multi-threshold quantized observations is adopted to approximate the unknown system.The system input design is accomplished using the measurement technology of random repeatability test,and the probabilistic characteristic of the explicit metric value is employed to estimate the implicit metric value of the pattern class variable.A modified auxiliary model stochastic gradient recursive algorithm(M-AM-SGRA)is designed to identify the model parameters,and the contraction mapping principle proves its convergence.Two numerical examples are given to demonstrate the feasibility and effectiveness of the achieved identification algorithm.
基金the National Natural Science Foundation of China(61673101,61973131,61733006,U1813201)the Science and Technology Project of Jilin Province(20210509053RQ)the Fourteenth Five Year Science Research Plan of Jilin Province(JJKH20220115KJ)。
文摘For a class of high-order nonlinear multi-agent systems with input hysteresis,an adaptive consensus output-feedback quantized control scheme with full state constraints is investigated.The major properties of the proposed control scheme are:1)According to the different hysteresis input characteristics of each agent in the multi-agent system,a hysteresis quantization inverse compensator is designed to eliminate the influence of hysteresis characteristics on the system while ensuring that the quantized signal maintains the desired value.2)A barrier Lyapunov function is introduced for the first time in the hysteretic multi-agent system.By constructing state constraint control strategy for the hysteretic multi-agent system,it ensures that all the states of the system are always maintained within a predetermined range.3)The designed adaptive consensus output-feedback quantization control scheme allows the hysteretic system to have unknown parameters and unknown disturbance,and ensures that the input signal transmitted between agents is the quantization value,and the introduced quantizer is implemented under the condition that only its sector bound property is required.The stability analysis has proved that all signals of the closed-loop are semi-globally uniformly bounded.The Star Sim hardware-in-the-loop simulation certificates the effectiveness of the proposed adaptive quantized control scheme.
基金supported by National Basic Research Program of China (973 Program) (No.2010CB731800)National Natural Science Foundation of China (No.60704009)+1 种基金Key Project for Natural Science Research of Hebei Education Department (No.ZD200908)Doctor Fun of Yanshan University (No.B203)
文摘Quantized H_∞ fault-tolerant control for networked control systems (NCSs) with partial actuator fault with respect to actuators is concerned in this paper. Considering transmission delay, packet dropout and quantization, a synthesis model with partial actuator fault is established. The piecewise constant controller is adopted to model NCS with the transmission delay and packet dropout. Due to data transmitted in practical NCSs should be quantized before they are sent to the next network node, the logarithmic static and time-invariant quantizers at the sensor and controller sides are proposed in the paper. For the established model, an appropriate type of Lyapunov functions is provided to investigate the delay-dependent H_∞ control problem. According to an optimal problem, the controller that makes the system achieve the best performance is designed. Finally, an illustrative example is given to demonstrate the effectiveness of the proposed approach.
基金supported by National Natural Science Foundation of China(No.61374042)the Fundamental Research Funds for the Central Universities in China(No.N130108001)
文摘Constructive nonlinear control design has undergone rapid and significant progress over the last three decades. In this paper, a review of recent results in this important field is presented with a focus on interdisciplinary topics at the interface of control,computing and communications. In particular, it is shown that the nonlinear small-gain theory provides a unified framework for solving problems of quantized feedback stabilization and event-triggered control for nonlinear systems. Some open questions in quantized and networked nonlinear control systems are discussed.
基金supported by the National Natural Science Foundation of China (60574011)College Research Project of Liaoning Province(L2010522)
文摘The problem of the quantized dynamic output feedback controller design for networked control systems is mainly discussed. By using the quantized information of the system measurement output and the control input, a novel networked control system model is described. This model includes many networkinduced features, such as multi-rate sampled-data, quantized signal, time-varying delay and packet dropout. By constructing suitable Lyapunov-Krasovskii functional, a less conservative stabilization criterion is established in terms of linear matrix inequalities. The quantized control strategy involves the updating values of the quantizer parameters μi（i = 1, 2）（μi take on countable sets of values which dependent on the information of the system measurement outputs and the control inputs）. Furthermore, a numerical example is given to illustrate the effectiveness of the proposed method.
基金The National Natural Science Foundation of China(No.60474049,60835001)Specialized Research Fund for Doctoral Program of Higher Education(No.20090092120027)
文摘In order to overcome data-quantization, networked-induced delay, network packet dropouts and wrong sequences in the nonlinear networked control system, a novel nonlinear networked control system model is built by the T-S fuzzy method. Two time-varying quantizers are added in the model. The key analysis steps in the method are to construct an improved interval-delay-dependent Lyapunov functional and to introduce the free-weighting matrix. By making use of the parallel distributed compensation technology and the convexity of the matrix function, the improved criteria of the stabilization and stability are obtained. Simulation experiments show that the parameters of the controllers and quantizers satisfying a certain performance can be obtained by solving a set of LMIs. The application of the nonlinear mass-spring system is provided to show that the proposed method is effective.
基金supported by the Anhui Provincial Development and Reform Commission New Energy Vehicles and Intelligent Connected Automobile Industry Technology Innovation Project。
文摘We investigate the quasi-synchronization of fractional-order complex networks(FCNs) with random coupling via quantized control. Firstly, based on the logarithmic quantizer theory and the Lyapunov stability theory, a new quantized feedback controller, which can make all nodes of complex networks quasi-synchronization and eliminate the disturbance of random coupling in the system state, is designed under non-delay conditions. Secondly, we extend the theoretical results under non-delay conditions to time-varying delay conditions and design another form of quantization feedback controller to ensure that the network achieves quasi-synchronization. Furthermore, the error bound of quasi-synchronization is obtained.Finally, we verify the accuracy of our results using two numerical simulation examples.
基金supported by the National Natural Science Foundation of China(Grant No.61571209)
文摘Spectrum access approach and power allocation scheme are important techniques in cognitive radio(CR) system,which not only affect communication performance of CR user(secondary user,SU) but also play decisive role for protection of primary user(PU).In this study,we propose a power allocation scheme for SU based on the status sensing of PU in a single-input single-output(SISO) CR network.Instead of the conventional binary primary transmit power strategy,namely the sensed PU has only present or absent status,we consider a more practical scenario when PU transmits with multiple levels of power and quantized side information known by SU in advance as a primary quantized codebook.The secondary power allocation scheme to maximize the average throughput under the rate loss constraint(RLC) of PU is parameterized by the sensing results for PU,the primary quantized codebook and the channel state information(CSI) of SU.Furthermore,Differential Evolution(DE) algorithm is used to solve this non-convex power allocation problem.Simulation results show the performance and effectiveness of our proposed scheme under more practical communication conditions.
基金Project supported partly by the National Natural Science Foundation of China （Grant Nos 10301034 and 40574069）, The authors thank Professor Du Q very much for his important discussions.
文摘We employ the parallel computing technology to study numerically the three-dimensional structure of quantized vortices of Bose-Einstein condensates, For anisotropic cases, the bending process of vortices is described in detail by the decrease of Gross-Pitaevskii energy. A completely straight vortex and the steady and symmetrical multiple-vortex configurations are obtained. We analyse the effect of initial conditions and angular velocity on the number and shape of vortices.
