In this paper, the leader-following tracking problem of fractional-order multi-agent systems is addressed. The dynamics of each agent may be heterogeneous and has unknown nonlinearities. By assumptions that the intera...In this paper, the leader-following tracking problem of fractional-order multi-agent systems is addressed. The dynamics of each agent may be heterogeneous and has unknown nonlinearities. By assumptions that the interaction topology is undirected and connected and the unknown nonlinear uncertain dynamics can be parameterized by a neural network, an adaptive learning law is proposed to deal with unknown nonlinear dynamics, based on which a kind of cooperative tracking protocols are constructed. The feedback gain matrix is obtained to solve an algebraic Riccati equation. To construct the fully distributed cooperative tracking protocols, the adaptive law is also adopted to adjust the coupling weight. With the developed control laws,we can prove that all signals in the closed-loop systems are guaranteed to be uniformly ultimately bounded. Finally, a simple simulation example is provided to illustrate the established result.展开更多
In this paper,we study some new fractional-order multi-agent systems with current and delay states (FMASCD).Using the generalized Nyquist's stability criterion and Gerschgorin's circle theorem,we obtain the bo...In this paper,we study some new fractional-order multi-agent systems with current and delay states (FMASCD).Using the generalized Nyquist's stability criterion and Gerschgorin's circle theorem,we obtain the bounded input-bounded output (BIBO) stability and asymptotical consensus of the FMASCD under mild conditions.Moreover,we give some numerical examples to illustrate our main results.展开更多
Leader-following consensus of fractional order multi-agent systems is investigated. The agents are considered as discrete-time fractional order integrators or fractional order double-integrators. Moreover, the interac...Leader-following consensus of fractional order multi-agent systems is investigated. The agents are considered as discrete-time fractional order integrators or fractional order double-integrators. Moreover, the interaction between the agents is described with an undirected communication graph with a fixed topology. It is shown that the leader-following consensus problem for the considered agents could be converted to the asymptotic stability analysis of a discrete-time fractional order system. Based on this idea, sufficient conditions to reach the leader-following consensus in terms of the controller parameters are extracted. This leads to an appropriate region in the controller parameters space. Numerical simulations are provided to show the performance of the proposed leader-following consensus approach.展开更多
Aiming at the consensus of relative position considering obstacle avoidance for fractional-order multi-agent system,a novel distributed control algorithm is proposed in this paper.Firstly,a synthetic error of each age...Aiming at the consensus of relative position considering obstacle avoidance for fractional-order multi-agent system,a novel distributed control algorithm is proposed in this paper.Firstly,a synthetic error of each agent under the influence of obstacles is introduced.The consensus pro-tocols are designed based on this eror according to sliding mode theory for the order increasing and decreasing,respectively.Then,the Lyapunov function is used to prove the stable convergence of the protocols.Finally,the simulation results show that the protocols can not only prevent the agents from colliding with obstacles,but also enable the agents to quickly recover the expected formation and achieve consensus of the relative position.展开更多
This paper investigates adaptive containment control for a class of fractional-order multi-agent systems(FOMASs)with time-varying parameters and disturbances.By using the bounded estimation method,the difficulty gener...This paper investigates adaptive containment control for a class of fractional-order multi-agent systems(FOMASs)with time-varying parameters and disturbances.By using the bounded estimation method,the difficulty generated by the timevarying parameters and disturbances is overcome.The command filter is introduced to solve the complexity problem inherent in adaptive backstepping control.Meanwhile,in order to eliminate the effect of filter errors,a novel distributed error compensating scheme is constructed,in which only the local information from the neighbor agents is utilized.Then,a distributed adaptive containment control scheme for FOMASs is developed based on backstepping to guarantee that the outputs of all the followers are steered to the convex hull spanned by the leaders.Based on the extension of Barbalat's lemma to fractional-order integrals,it can be proven that the containment errors and the compensating signals have asymptotic convergence.Finally,three simulation examples are given to show the feasibility and effectiveness of the proposed control method.展开更多
This study focuses on implementing consensus tracking using both open-loop and closed-loop Dα-type iterative learning control(ILC)schemes,for fractional-order multi-agent systems(FOMASs)with state-delays.The desired ...This study focuses on implementing consensus tracking using both open-loop and closed-loop Dα-type iterative learning control(ILC)schemes,for fractional-order multi-agent systems(FOMASs)with state-delays.The desired trajectory is constructed by introducing a virtual leader,and the fixed communication topology is considered and only a subset of followers can access the desired trajectory.For each control scheme,one controller is designed for one agent individually.According to the tracking error between the agent and the virtual leader,and the tracking errors between the agent and neighboring agents during the last iteration(for open-loop scheme)or the current running(for closed-loop scheme),each controller continuously corrects the last control law by a combination of communication weights in the topology to obtain the ideal control law.Through the rigorous analysis,sufficient conditions for both control schemes are established to ensure that all agents can achieve the asymptotically consistent output along the iteration axis within a finite-time interval.Sufficient numerical simulation results demonstrate the effectiveness of the control schemes,and provide some meaningful comparison results.展开更多
Investigating the combined effects of mining damage and creep damage on slope stability is crucial,as it can comprehensively reveal the non-linear deformation characteristics of rock under their joint influence.This s...Investigating the combined effects of mining damage and creep damage on slope stability is crucial,as it can comprehensively reveal the non-linear deformation characteristics of rock under their joint influence.This study develops a fractional-order nonlinear creep constitutive model that incorporates the double damage effect and implements a non-linear creep subroutine for soft rock using the threedimensional finite difference method on the FLAC3D platform.Comparative analysis of the theoretical,numerical,and experimental results reveals that the fractional-order constitutive model,which incorporates the double damage effect,accurately reflects the distinct deformation stages of green mudstone during creep failure and effectively captures the non-linear deformation in the accelerated creep phase.The numerical results show a fitting accuracy exceeding 97%with the creep test curves,significantly outperforming the 61%accuracy of traditional creep models.展开更多
Cooperative multi-agent reinforcement learning(MARL)is a key technology for enabling cooperation in complex multi-agent systems.It has achieved remarkable progress in areas such as gaming,autonomous driving,and multi-...Cooperative multi-agent reinforcement learning(MARL)is a key technology for enabling cooperation in complex multi-agent systems.It has achieved remarkable progress in areas such as gaming,autonomous driving,and multi-robot control.Empowering cooperative MARL with multi-task decision-making capabilities is expected to further broaden its application scope.In multi-task scenarios,cooperative MARL algorithms need to address 3 types of multi-task problems:reward-related multi-task,arising from different reward functions;multi-domain multi-task,caused by differences in state and action spaces,state transition functions;and scalability-related multi-task,resulting from the dynamic variation in the number of agents.Most existing studies focus on scalability-related multitask problems.However,with the increasing integration between large language models(LLMs)and multi-agent systems,a growing number of LLM-based multi-agent systems have emerged,enabling more complex multi-task cooperation.This paper provides a comprehensive review of the latest advances in this field.By combining multi-task reinforcement learning with cooperative MARL,we categorize and analyze the 3 major types of multi-task problems under multi-agent settings,offering more fine-grained classifications and summarizing key insights for each.In addition,we summarize commonly used benchmarks and discuss future directions of research in this area,which hold promise for further enhancing the multi-task cooperation capabilities of multi-agent systems and expanding their practical applications in the real world.展开更多
This paper addresses the consensus problem of nonlinear multi-agent systems subject to external disturbances and uncertainties under denial-ofservice(DoS)attacks.Firstly,an observer-based state feedback control method...This paper addresses the consensus problem of nonlinear multi-agent systems subject to external disturbances and uncertainties under denial-ofservice(DoS)attacks.Firstly,an observer-based state feedback control method is employed to achieve secure control by estimating the system's state in real time.Secondly,by combining a memory-based adaptive eventtriggered mechanism with neural networks,the paper aims to approximate the nonlinear terms in the networked system and efficiently conserve system resources.Finally,based on a two-degree-of-freedom model of a vehicle affected by crosswinds,this paper constructs a multi-unmanned ground vehicle(Multi-UGV)system to validate the effectiveness of the proposed method.Simulation results show that the proposed control strategy can effectively handle external disturbances such as crosswinds in practical applications,ensuring the stability and reliable operation of the Multi-UGV system.展开更多
This paper investigates the challenges associated with Unmanned Aerial Vehicle (UAV) collaborative search and target tracking in dynamic and unknown environments characterized by limited field of view. The primary obj...This paper investigates the challenges associated with Unmanned Aerial Vehicle (UAV) collaborative search and target tracking in dynamic and unknown environments characterized by limited field of view. The primary objective is to explore the unknown environments to locate and track targets effectively. To address this problem, we propose a novel Multi-Agent Reinforcement Learning (MARL) method based on Graph Neural Network (GNN). Firstly, a method is introduced for encoding continuous-space multi-UAV problem data into spatial graphs which establish essential relationships among agents, obstacles, and targets. Secondly, a Graph AttenTion network (GAT) model is presented, which focuses exclusively on adjacent nodes, learns attention weights adaptively and allows agents to better process information in dynamic environments. Reward functions are specifically designed to tackle exploration challenges in environments with sparse rewards. By introducing a framework that integrates centralized training and distributed execution, the advancement of models is facilitated. Simulation results show that the proposed method outperforms the existing MARL method in search rate and tracking performance with less collisions. The experiments show that the proposed method can be extended to applications with a larger number of agents, which provides a potential solution to the challenging problem of multi-UAV autonomous tracking in dynamic unknown environments.展开更多
Due to the characteristics of line-of-sight(LoS)communication in unmanned aerial vehicle(UAV)networks,these systems are highly susceptible to eavesdropping and surveillance.To effectively address the security concerns...Due to the characteristics of line-of-sight(LoS)communication in unmanned aerial vehicle(UAV)networks,these systems are highly susceptible to eavesdropping and surveillance.To effectively address the security concerns in UAV communication,covert communication methods have been adopted.This paper explores the joint optimization problem of trajectory and transmission power in a multi-hop UAV relay covert communication system.Considering the communication covertness,power constraints,and trajectory limitations,an algorithm based on multi-agent proximal policy optimization(MAPPO),named covert-MAPPO(C-MAPPO),is proposed.The proposed method leverages the strengths of both optimization algorithms and reinforcement learning to analyze and make joint decisions on the transmission power and flight trajectory strategies for UAVs to achieve cooperation.Simulation results demonstrate that the proposed method can maximize the system throughput while satisfying covertness constraints,and it outperforms benchmark algorithms in terms of system throughput and reward convergence speed.展开更多
In this paper,a fractional-order kinematic model is utilized to capture the size-dependent static bending and free vibration responses of piezoelectric nanobeams.The general nonlocal strains in the Euler-Bernoulli pie...In this paper,a fractional-order kinematic model is utilized to capture the size-dependent static bending and free vibration responses of piezoelectric nanobeams.The general nonlocal strains in the Euler-Bernoulli piezoelectric beam are defined by a frame-invariant and dimensionally consistent Riesz-Caputo fractional-order derivatives.The strain energy,the work done by external loads,and the kinetic energy based on the fractional-order kinematic model are derived and expressed in explicit forms.The boundary conditions for the nonlocal Euler-Bernoulli beam are derived through variational principles.Furthermore,a finite element model for the fractional-order system is developed in order to obtain the numerical solutions to the integro-differential equations.The effects of the fractional order and the vibration order on the static bending and vibration responses of the Euler-Bernoulli piezoelectric beams are investigated numerically.The results from the present model are validated against the existing results in the literature,and it is demonstrated that they are theoretically consistent.Although this fractional finite element method(FEM)is presented in the context of a one-dimensional(1D)beam,it can be extended to higher dimensional fractional-order boundary value problems.展开更多
The collective dynamic of a fractional-order globally coupled system with time delays and fluctuating frequency is investigated.The power-law memory of the system is characterized using the Caputo fractional derivativ...The collective dynamic of a fractional-order globally coupled system with time delays and fluctuating frequency is investigated.The power-law memory of the system is characterized using the Caputo fractional derivative operator.Additionally,time delays in the potential field force and coupling force transmission are both considered.Firstly,based on the delay decoupling formula,combined with statistical mean method and the fractional-order Shapiro–Loginov formula,the“statistic synchronization”among particles is obtained,revealing the statistical equivalence between the mean field behavior of the system and the behavior of individual particles.Due to the existence of the coupling delay,the impact of the coupling force on synchronization exhibits non-monotonic,which is different from the previous monotonic effects.Then,two kinds of theoretical expression of output amplitude gains G and G are derived by time-delay decoupling formula and small delay approximation theorem,respectively.Compared to G,G is an exact theoretical solution,which means that G is not only more accurate in the region of small delay,but also applies to the region of large delay.Finally,the study of the output amplitude gain G and its resonance behavior are explored.Due to the presence of the potential field delay,a new resonance phenomenon termed“periodic resonance”is discovered,which arises from the periodic matching between the potential field delay and the driving frequency.This resonance phenomenon is analyzed qualitatively and quantitatively,uncovering undiscovered characteristics in previous studies.展开更多
Multi-agent systems(MASs)have demonstrated significant achievements in a wide range of tasks,leveraging their capacity for coordination and adaptation within complex environments.Moreover,the enhancement of their inte...Multi-agent systems(MASs)have demonstrated significant achievements in a wide range of tasks,leveraging their capacity for coordination and adaptation within complex environments.Moreover,the enhancement of their intelligent functionalities is crucial for tackling increasingly challenging tasks.This goal resonates with a paradigm shift within the artificial intelligence(AI)community,from“internet AI”to“embodied AI”,and the MASs with embodied AI are referred to as embodied multi-agent systems(EMASs).An EMAS has the potential to acquire generalized competencies through interactions with environments,enabling it to effectively address a variety of tasks and thereby make a substantial contribution to the quest for artificial general intelligence.Despite the burgeoning interest in this domain,a comprehensive review of EMAS has been lacking.This paper offers analysis and synthesis for EMASs from a control perspective,conceptualizing each embodied agent as an entity equipped with a“brain”for decision and a“body”for environmental interaction.System designs are classified into open-loop,closed-loop,and double-loop categories,and EMAS implementations are discussed.Additionally,the current applications and challenges faced by EMASs are summarized and potential avenues for future research in this field are provided.展开更多
Breast cancer’s heterogeneous progression demands innovative tools for accurate prediction.We present a hybrid framework that integrates machine learning(ML)and fractional-order dynamics to predict tumor growth acros...Breast cancer’s heterogeneous progression demands innovative tools for accurate prediction.We present a hybrid framework that integrates machine learning(ML)and fractional-order dynamics to predict tumor growth across diagnostic and temporal scales.On the Wisconsin Diagnostic Breast Cancer dataset,seven ML algorithms were evaluated,with deep neural networks(DNNs)achieving the highest accuracy(97.72%).Key morphological features(area,radius,texture,and concavity)were identified as top malignancy predictors,aligning with clinical intuition.Beyond static classification,we developed a fractional-order dynamical model using Caputo derivatives to capture memory-driven tumor progression.The model revealed clinically interpretable patterns:lower fractional orders correlated with prolonged aggressive growth,while higher orders indicated rapid stabilization,mimicking indolent subtypes.Theoretical analyses were rigorously proven,and numerical simulations closely fit clinical data.The framework’s clinical utility is demonstrated through an interactive graphics user interface(GUI)that integrates real-time risk assessment with growth trajectory simulations.展开更多
The dynamics of chaotic memristor-based systems offer promising potential for secure communication.However,existing solutions frequently suffer from drawbacks such as slow synchronization,low key diversity,and poor no...The dynamics of chaotic memristor-based systems offer promising potential for secure communication.However,existing solutions frequently suffer from drawbacks such as slow synchronization,low key diversity,and poor noise resistance.To overcome these issues,a novel fractional-order chaotic system incorporating a memristor emulator derived from the Shinriki oscillator is proposed.The main contribution lies in the enhanced dynamic complexity and flexibility of the proposed architecture,making it suitable for cryptographic applications.Furthermore,the feasibility of synchronization to ensure secure data transmission is demonstrated through the validation of two strategies:an active control method ensuring asymptotic convergence,and a finite-time control method enabling faster stabilization.The robustness of the scheme is confirmed by simulation results on a color image:χ^(2)=253/237/267(R/G/B);entropy≈7.993;correlations between adjacent pixels in all directions are close to zero(e.g.,-0.0318 vertically);and high number of pixel change rate and unified average changing intensity(e.g.,33.40%and 99.61%,respectively).Peak signal-to-noise ratio analysis shows that resilience to noise and external disturbances is maintained.It is shown that multiple fractional orders further enrich the chaotic behavior,increasing the systems suitability for secure communication in embedded environments.These findings highlight the relevance of fractional-order chaotic memristive systems for lightweight secure transmission applications.展开更多
This paper mainly focuses on the velocity-constrained consensus problem of discrete-time heterogeneous multi-agent systems with nonconvex constraints and arbitrarily switching topologies,where each agent has first-ord...This paper mainly focuses on the velocity-constrained consensus problem of discrete-time heterogeneous multi-agent systems with nonconvex constraints and arbitrarily switching topologies,where each agent has first-order or second-order dynamics.To solve this problem,a distributed algorithm is proposed based on a contraction operator.By employing the properties of the stochastic matrix,it is shown that all agents’position states could converge to a common point and second-order agents’velocity states could remain in corresponding nonconvex constraint sets and converge to zero as long as the joint communication topology has one directed spanning tree.Finally,the numerical simulation results are provided to verify the effectiveness of the proposed algorithms.展开更多
The development of chassis active safety control technology has improved vehicle stability under extreme conditions.However,its cross-system and multi-functional characteristics make the controller difficult to achiev...The development of chassis active safety control technology has improved vehicle stability under extreme conditions.However,its cross-system and multi-functional characteristics make the controller difficult to achieve cooperative goals.In addition,the chassis system,which has high complexity,numerous subsystems,and strong coupling,will also lead to low computing efficiency and poor control effect of the controller.Therefore,this paper proposes a scenario-driven hybrid distributed model predictive control algorithm with variable control topology.This algorithm divides multiple stability regions based on the vehicle’s β−γ phase plane,forming a mapping relationship between the control structure and the vehicle’s state.A control input fusion mechanism within the transition domain is designed to mitigate the problems of system state oscillation and control input jitter caused by switching control structures.Then,a distributed state-space equation with state coupling and input coupling characteristics is constructed,and a weighted local agent cost function in quadratic programming is derived.Through cost coupling,local agents can coordinate global performance goals.Finally,through Simulink/CarSim joint simulation and hardware-in-the-loop(HIL)test,the proposed algorithm is validated to improve vehicle stability while ensuring trajectory tracking accuracy and has good applicability for multi-objective coordinated control.This paper combines the advantages of distributed MPC and decentralized MPC,achieving a balance between approximating the global optimal results and the solution’s efficiency.展开更多
基金supported by the National Natural Science Foundation of China(61303211)Zhejiang Provincial Natural Science Foundation of China(LY17F030003,LY15F030009)
文摘In this paper, the leader-following tracking problem of fractional-order multi-agent systems is addressed. The dynamics of each agent may be heterogeneous and has unknown nonlinearities. By assumptions that the interaction topology is undirected and connected and the unknown nonlinear uncertain dynamics can be parameterized by a neural network, an adaptive learning law is proposed to deal with unknown nonlinear dynamics, based on which a kind of cooperative tracking protocols are constructed. The feedback gain matrix is obtained to solve an algebraic Riccati equation. To construct the fully distributed cooperative tracking protocols, the adaptive law is also adopted to adjust the coupling weight. With the developed control laws,we can prove that all signals in the closed-loop systems are guaranteed to be uniformly ultimately bounded. Finally, a simple simulation example is provided to illustrate the established result.
基金Project supported by the National Natural Science Foundation of China(Nos.11471230 and11671282)
文摘In this paper,we study some new fractional-order multi-agent systems with current and delay states (FMASCD).Using the generalized Nyquist's stability criterion and Gerschgorin's circle theorem,we obtain the bounded input-bounded output (BIBO) stability and asymptotical consensus of the FMASCD under mild conditions.Moreover,we give some numerical examples to illustrate our main results.
文摘Leader-following consensus of fractional order multi-agent systems is investigated. The agents are considered as discrete-time fractional order integrators or fractional order double-integrators. Moreover, the interaction between the agents is described with an undirected communication graph with a fixed topology. It is shown that the leader-following consensus problem for the considered agents could be converted to the asymptotic stability analysis of a discrete-time fractional order system. Based on this idea, sufficient conditions to reach the leader-following consensus in terms of the controller parameters are extracted. This leads to an appropriate region in the controller parameters space. Numerical simulations are provided to show the performance of the proposed leader-following consensus approach.
基金supported in part by the Natural Science Foundation of Shaanxi Province(2024JC-YBMS-451,2024JC-YBQN-0398).
文摘Aiming at the consensus of relative position considering obstacle avoidance for fractional-order multi-agent system,a novel distributed control algorithm is proposed in this paper.Firstly,a synthetic error of each agent under the influence of obstacles is introduced.The consensus pro-tocols are designed based on this eror according to sliding mode theory for the order increasing and decreasing,respectively.Then,the Lyapunov function is used to prove the stable convergence of the protocols.Finally,the simulation results show that the protocols can not only prevent the agents from colliding with obstacles,but also enable the agents to quickly recover the expected formation and achieve consensus of the relative position.
基金National Key R&D Program of China(2018YFA0702200)National Natural Science Foundation of China(61627809,62173080)Liaoning Revitalization Talents Program(XLYC1801005)。
文摘This paper investigates adaptive containment control for a class of fractional-order multi-agent systems(FOMASs)with time-varying parameters and disturbances.By using the bounded estimation method,the difficulty generated by the timevarying parameters and disturbances is overcome.The command filter is introduced to solve the complexity problem inherent in adaptive backstepping control.Meanwhile,in order to eliminate the effect of filter errors,a novel distributed error compensating scheme is constructed,in which only the local information from the neighbor agents is utilized.Then,a distributed adaptive containment control scheme for FOMASs is developed based on backstepping to guarantee that the outputs of all the followers are steered to the convex hull spanned by the leaders.Based on the extension of Barbalat's lemma to fractional-order integrals,it can be proven that the containment errors and the compensating signals have asymptotic convergence.Finally,three simulation examples are given to show the feasibility and effectiveness of the proposed control method.
基金supported by the National Natural Science Foundation of China(51777170)the Natural Science Basic Research Plan in Shaanxi Province of China(2020JM-151)the Fundamental Research Funds for the Central Universities(3102020ZX006)。
文摘This study focuses on implementing consensus tracking using both open-loop and closed-loop Dα-type iterative learning control(ILC)schemes,for fractional-order multi-agent systems(FOMASs)with state-delays.The desired trajectory is constructed by introducing a virtual leader,and the fixed communication topology is considered and only a subset of followers can access the desired trajectory.For each control scheme,one controller is designed for one agent individually.According to the tracking error between the agent and the virtual leader,and the tracking errors between the agent and neighboring agents during the last iteration(for open-loop scheme)or the current running(for closed-loop scheme),each controller continuously corrects the last control law by a combination of communication weights in the topology to obtain the ideal control law.Through the rigorous analysis,sufficient conditions for both control schemes are established to ensure that all agents can achieve the asymptotically consistent output along the iteration axis within a finite-time interval.Sufficient numerical simulation results demonstrate the effectiveness of the control schemes,and provide some meaningful comparison results.
基金support from the National Natural Science Foundation of China(No.52308316)the Scientific Research Foundation of Weifang University(Grant No.2024BS42)+2 种基金China Postdoctoral Science Foundation(No.2022M721885)the Key Laboratory of Rock Mechanics and Geohazards of Zhejiang Province(No.ZJRMG-2022-01)supported by Open Research Fund of State Key Laboratory of Geomechanics and Geotechnical Engineering,Institute of Rock and Soil Mechanics,Chinese Academy of Sciences(NO.SKLGME023017).
文摘Investigating the combined effects of mining damage and creep damage on slope stability is crucial,as it can comprehensively reveal the non-linear deformation characteristics of rock under their joint influence.This study develops a fractional-order nonlinear creep constitutive model that incorporates the double damage effect and implements a non-linear creep subroutine for soft rock using the threedimensional finite difference method on the FLAC3D platform.Comparative analysis of the theoretical,numerical,and experimental results reveals that the fractional-order constitutive model,which incorporates the double damage effect,accurately reflects the distinct deformation stages of green mudstone during creep failure and effectively captures the non-linear deformation in the accelerated creep phase.The numerical results show a fitting accuracy exceeding 97%with the creep test curves,significantly outperforming the 61%accuracy of traditional creep models.
基金The National Natural Science Foundation of China(62136008,62293541)The Beijing Natural Science Foundation(4232056)The Beijing Nova Program(20240484514).
文摘Cooperative multi-agent reinforcement learning(MARL)is a key technology for enabling cooperation in complex multi-agent systems.It has achieved remarkable progress in areas such as gaming,autonomous driving,and multi-robot control.Empowering cooperative MARL with multi-task decision-making capabilities is expected to further broaden its application scope.In multi-task scenarios,cooperative MARL algorithms need to address 3 types of multi-task problems:reward-related multi-task,arising from different reward functions;multi-domain multi-task,caused by differences in state and action spaces,state transition functions;and scalability-related multi-task,resulting from the dynamic variation in the number of agents.Most existing studies focus on scalability-related multitask problems.However,with the increasing integration between large language models(LLMs)and multi-agent systems,a growing number of LLM-based multi-agent systems have emerged,enabling more complex multi-task cooperation.This paper provides a comprehensive review of the latest advances in this field.By combining multi-task reinforcement learning with cooperative MARL,we categorize and analyze the 3 major types of multi-task problems under multi-agent settings,offering more fine-grained classifications and summarizing key insights for each.In addition,we summarize commonly used benchmarks and discuss future directions of research in this area,which hold promise for further enhancing the multi-task cooperation capabilities of multi-agent systems and expanding their practical applications in the real world.
基金The National Natural Science Foundation of China(W2431048)The Science and Technology Research Program of Chongqing Municipal Education Commission,China(KJZDK202300807)The Chongqing Natural Science Foundation,China(CSTB2024NSCQQCXMX0052).
文摘This paper addresses the consensus problem of nonlinear multi-agent systems subject to external disturbances and uncertainties under denial-ofservice(DoS)attacks.Firstly,an observer-based state feedback control method is employed to achieve secure control by estimating the system's state in real time.Secondly,by combining a memory-based adaptive eventtriggered mechanism with neural networks,the paper aims to approximate the nonlinear terms in the networked system and efficiently conserve system resources.Finally,based on a two-degree-of-freedom model of a vehicle affected by crosswinds,this paper constructs a multi-unmanned ground vehicle(Multi-UGV)system to validate the effectiveness of the proposed method.Simulation results show that the proposed control strategy can effectively handle external disturbances such as crosswinds in practical applications,ensuring the stability and reliable operation of the Multi-UGV system.
基金supported by the National Natural Science Foundation of China(Nos.12272104,U22B2013).
文摘This paper investigates the challenges associated with Unmanned Aerial Vehicle (UAV) collaborative search and target tracking in dynamic and unknown environments characterized by limited field of view. The primary objective is to explore the unknown environments to locate and track targets effectively. To address this problem, we propose a novel Multi-Agent Reinforcement Learning (MARL) method based on Graph Neural Network (GNN). Firstly, a method is introduced for encoding continuous-space multi-UAV problem data into spatial graphs which establish essential relationships among agents, obstacles, and targets. Secondly, a Graph AttenTion network (GAT) model is presented, which focuses exclusively on adjacent nodes, learns attention weights adaptively and allows agents to better process information in dynamic environments. Reward functions are specifically designed to tackle exploration challenges in environments with sparse rewards. By introducing a framework that integrates centralized training and distributed execution, the advancement of models is facilitated. Simulation results show that the proposed method outperforms the existing MARL method in search rate and tracking performance with less collisions. The experiments show that the proposed method can be extended to applications with a larger number of agents, which provides a potential solution to the challenging problem of multi-UAV autonomous tracking in dynamic unknown environments.
基金supported by the Natural Science Foundation of Jiangsu Province,China(No.BK20240200)in part by the National Natural Science Foundation of China(Nos.62271501,62071488,62471489 and U22B2002)+1 种基金in part by the Key Technologies R&D Program of Jiangsu,China(Prospective and Key Technologies for Industry)(Nos.BE2023022 and BE2023022-4)in part by the Post-doctoral Fellowship Program of CPSF,China(No.GZB20240996).
文摘Due to the characteristics of line-of-sight(LoS)communication in unmanned aerial vehicle(UAV)networks,these systems are highly susceptible to eavesdropping and surveillance.To effectively address the security concerns in UAV communication,covert communication methods have been adopted.This paper explores the joint optimization problem of trajectory and transmission power in a multi-hop UAV relay covert communication system.Considering the communication covertness,power constraints,and trajectory limitations,an algorithm based on multi-agent proximal policy optimization(MAPPO),named covert-MAPPO(C-MAPPO),is proposed.The proposed method leverages the strengths of both optimization algorithms and reinforcement learning to analyze and make joint decisions on the transmission power and flight trajectory strategies for UAVs to achieve cooperation.Simulation results demonstrate that the proposed method can maximize the system throughput while satisfying covertness constraints,and it outperforms benchmark algorithms in terms of system throughput and reward convergence speed.
基金Project supported by the National Natural Science Foundation of China(No.12172169)。
文摘In this paper,a fractional-order kinematic model is utilized to capture the size-dependent static bending and free vibration responses of piezoelectric nanobeams.The general nonlocal strains in the Euler-Bernoulli piezoelectric beam are defined by a frame-invariant and dimensionally consistent Riesz-Caputo fractional-order derivatives.The strain energy,the work done by external loads,and the kinetic energy based on the fractional-order kinematic model are derived and expressed in explicit forms.The boundary conditions for the nonlocal Euler-Bernoulli beam are derived through variational principles.Furthermore,a finite element model for the fractional-order system is developed in order to obtain the numerical solutions to the integro-differential equations.The effects of the fractional order and the vibration order on the static bending and vibration responses of the Euler-Bernoulli piezoelectric beams are investigated numerically.The results from the present model are validated against the existing results in the literature,and it is demonstrated that they are theoretically consistent.Although this fractional finite element method(FEM)is presented in the context of a one-dimensional(1D)beam,it can be extended to higher dimensional fractional-order boundary value problems.
基金supported by the Natural Science Foundation of Sichuan Province,China(Youth Science Foundation)(Grant No.2022NSFSC1952).
文摘The collective dynamic of a fractional-order globally coupled system with time delays and fluctuating frequency is investigated.The power-law memory of the system is characterized using the Caputo fractional derivative operator.Additionally,time delays in the potential field force and coupling force transmission are both considered.Firstly,based on the delay decoupling formula,combined with statistical mean method and the fractional-order Shapiro–Loginov formula,the“statistic synchronization”among particles is obtained,revealing the statistical equivalence between the mean field behavior of the system and the behavior of individual particles.Due to the existence of the coupling delay,the impact of the coupling force on synchronization exhibits non-monotonic,which is different from the previous monotonic effects.Then,two kinds of theoretical expression of output amplitude gains G and G are derived by time-delay decoupling formula and small delay approximation theorem,respectively.Compared to G,G is an exact theoretical solution,which means that G is not only more accurate in the region of small delay,but also applies to the region of large delay.Finally,the study of the output amplitude gain G and its resonance behavior are explored.Due to the presence of the potential field delay,a new resonance phenomenon termed“periodic resonance”is discovered,which arises from the periodic matching between the potential field delay and the driving frequency.This resonance phenomenon is analyzed qualitatively and quantitatively,uncovering undiscovered characteristics in previous studies.
基金supported in part by National Natural Science Foundation of China(62495095,62088101).
文摘Multi-agent systems(MASs)have demonstrated significant achievements in a wide range of tasks,leveraging their capacity for coordination and adaptation within complex environments.Moreover,the enhancement of their intelligent functionalities is crucial for tackling increasingly challenging tasks.This goal resonates with a paradigm shift within the artificial intelligence(AI)community,from“internet AI”to“embodied AI”,and the MASs with embodied AI are referred to as embodied multi-agent systems(EMASs).An EMAS has the potential to acquire generalized competencies through interactions with environments,enabling it to effectively address a variety of tasks and thereby make a substantial contribution to the quest for artificial general intelligence.Despite the burgeoning interest in this domain,a comprehensive review of EMAS has been lacking.This paper offers analysis and synthesis for EMASs from a control perspective,conceptualizing each embodied agent as an entity equipped with a“brain”for decision and a“body”for environmental interaction.System designs are classified into open-loop,closed-loop,and double-loop categories,and EMAS implementations are discussed.Additionally,the current applications and challenges faced by EMASs are summarized and potential avenues for future research in this field are provided.
文摘Breast cancer’s heterogeneous progression demands innovative tools for accurate prediction.We present a hybrid framework that integrates machine learning(ML)and fractional-order dynamics to predict tumor growth across diagnostic and temporal scales.On the Wisconsin Diagnostic Breast Cancer dataset,seven ML algorithms were evaluated,with deep neural networks(DNNs)achieving the highest accuracy(97.72%).Key morphological features(area,radius,texture,and concavity)were identified as top malignancy predictors,aligning with clinical intuition.Beyond static classification,we developed a fractional-order dynamical model using Caputo derivatives to capture memory-driven tumor progression.The model revealed clinically interpretable patterns:lower fractional orders correlated with prolonged aggressive growth,while higher orders indicated rapid stabilization,mimicking indolent subtypes.Theoretical analyses were rigorously proven,and numerical simulations closely fit clinical data.The framework’s clinical utility is demonstrated through an interactive graphics user interface(GUI)that integrates real-time risk assessment with growth trajectory simulations.
文摘The dynamics of chaotic memristor-based systems offer promising potential for secure communication.However,existing solutions frequently suffer from drawbacks such as slow synchronization,low key diversity,and poor noise resistance.To overcome these issues,a novel fractional-order chaotic system incorporating a memristor emulator derived from the Shinriki oscillator is proposed.The main contribution lies in the enhanced dynamic complexity and flexibility of the proposed architecture,making it suitable for cryptographic applications.Furthermore,the feasibility of synchronization to ensure secure data transmission is demonstrated through the validation of two strategies:an active control method ensuring asymptotic convergence,and a finite-time control method enabling faster stabilization.The robustness of the scheme is confirmed by simulation results on a color image:χ^(2)=253/237/267(R/G/B);entropy≈7.993;correlations between adjacent pixels in all directions are close to zero(e.g.,-0.0318 vertically);and high number of pixel change rate and unified average changing intensity(e.g.,33.40%and 99.61%,respectively).Peak signal-to-noise ratio analysis shows that resilience to noise and external disturbances is maintained.It is shown that multiple fractional orders further enrich the chaotic behavior,increasing the systems suitability for secure communication in embedded environments.These findings highlight the relevance of fractional-order chaotic memristive systems for lightweight secure transmission applications.
基金2024 Jiangsu Province Youth Science and Technology Talent Support Project2024 Yancheng Key Research and Development Plan(Social Development)projects,“Research and Application of Multi Agent Offline Distributed Trust Perception Virtual Wireless Sensor Network Algorithm”and“Research and Application of a New Type of Fishery Ship Safety Production Monitoring Equipment”。
文摘This paper mainly focuses on the velocity-constrained consensus problem of discrete-time heterogeneous multi-agent systems with nonconvex constraints and arbitrarily switching topologies,where each agent has first-order or second-order dynamics.To solve this problem,a distributed algorithm is proposed based on a contraction operator.By employing the properties of the stochastic matrix,it is shown that all agents’position states could converge to a common point and second-order agents’velocity states could remain in corresponding nonconvex constraint sets and converge to zero as long as the joint communication topology has one directed spanning tree.Finally,the numerical simulation results are provided to verify the effectiveness of the proposed algorithms.
基金Supported by National Natural Science Foundation of China(Grant Nos.52225212,52272418,U22A20100)National Key Research and Development Program of China(Grant No.2022YFB2503302).
文摘The development of chassis active safety control technology has improved vehicle stability under extreme conditions.However,its cross-system and multi-functional characteristics make the controller difficult to achieve cooperative goals.In addition,the chassis system,which has high complexity,numerous subsystems,and strong coupling,will also lead to low computing efficiency and poor control effect of the controller.Therefore,this paper proposes a scenario-driven hybrid distributed model predictive control algorithm with variable control topology.This algorithm divides multiple stability regions based on the vehicle’s β−γ phase plane,forming a mapping relationship between the control structure and the vehicle’s state.A control input fusion mechanism within the transition domain is designed to mitigate the problems of system state oscillation and control input jitter caused by switching control structures.Then,a distributed state-space equation with state coupling and input coupling characteristics is constructed,and a weighted local agent cost function in quadratic programming is derived.Through cost coupling,local agents can coordinate global performance goals.Finally,through Simulink/CarSim joint simulation and hardware-in-the-loop(HIL)test,the proposed algorithm is validated to improve vehicle stability while ensuring trajectory tracking accuracy and has good applicability for multi-objective coordinated control.This paper combines the advantages of distributed MPC and decentralized MPC,achieving a balance between approximating the global optimal results and the solution’s efficiency.
