This paper proposes a Multi-Agent Attention Proximal Policy Optimization(MA2PPO)algorithm aiming at the problems such as credit assignment,low collaboration efficiency and weak strategy generalization ability existing...This paper proposes a Multi-Agent Attention Proximal Policy Optimization(MA2PPO)algorithm aiming at the problems such as credit assignment,low collaboration efficiency and weak strategy generalization ability existing in the cooperative pursuit tasks of multiple unmanned aerial vehicles(UAVs).Traditional algorithms often fail to effectively identify critical cooperative relationships in such tasks,leading to low capture efficiency and a significant decline in performance when the scale expands.To tackle these issues,based on the proximal policy optimization(PPO)algorithm,MA2PPO adopts the centralized training with decentralized execution(CTDE)framework and introduces a dynamic decoupling mechanism,that is,sharing the multi-head attention(MHA)mechanism for critics during centralized training to solve the credit assignment problem.This method enables the pursuers to identify highly correlated interactions with their teammates,effectively eliminate irrelevant and weakly relevant interactions,and decompose large-scale cooperation problems into decoupled sub-problems,thereby enhancing the collaborative efficiency and policy stability among multiple agents.Furthermore,a reward function has been devised to facilitate the pursuers to encircle the escapee by combining a formation reward with a distance reward,which incentivizes UAVs to develop sophisticated cooperative pursuit strategies.Experimental results demonstrate the effectiveness of the proposed algorithm in achieving multi-UAV cooperative pursuit and inducing diverse cooperative pursuit behaviors among UAVs.Moreover,experiments on scalability have demonstrated that the algorithm is suitable for large-scale multi-UAV systems.展开更多
In multiple Unmanned Aerial Vehicles(UAV)systems,achieving efficient navigation is essential for executing complex tasks and enhancing autonomy.Traditional navigation methods depend on predefined control strategies an...In multiple Unmanned Aerial Vehicles(UAV)systems,achieving efficient navigation is essential for executing complex tasks and enhancing autonomy.Traditional navigation methods depend on predefined control strategies and trajectory planning and often perform poorly in complex environments.To improve the UAV-environment interaction efficiency,this study proposes a multi-UAV integrated navigation algorithm based on Deep Reinforcement Learning(DRL).This algorithm integrates the Inertial Navigation System(INS),Global Navigation Satellite System(GNSS),and Visual Navigation System(VNS)for comprehensive information fusion.Specifically,an improved multi-UAV integrated navigation algorithm called Information Fusion with MultiAgent Deep Deterministic Policy Gradient(IF-MADDPG)was developed.This algorithm enables UAVs to learn collaboratively and optimize their flight trajectories in real time.Through simulations and experiments,test scenarios in GNSS-denied environments were constructed to evaluate the effectiveness of the algorithm.The experimental results demonstrate that the IF-MADDPG algorithm significantly enhances the collaborative navigation capabilities of multiple UAVs in formation maintenance and GNSS-denied environments.Additionally,it has advantages in terms of mission completion time.This study provides a novel approach for efficient collaboration in multi-UAV systems,which significantly improves the robustness and adaptability of navigation systems.展开更多
This paper studies the countermeasure design problems of distributed resilient time-varying formation-tracking control for multi-UAV systems with single-way communications against composite attacks,including denial-of...This paper studies the countermeasure design problems of distributed resilient time-varying formation-tracking control for multi-UAV systems with single-way communications against composite attacks,including denial-of-services(DoS)attacks,false-data injection attacks,camouflage attacks,and actuation attacks(AAs).Inspired by the concept of digital twin,a new two-layered protocol equipped with a safe and private twin layer(TL)is proposed,which decouples the above problems into the defense scheme against DoS attacks on the TL and the defense scheme against AAs on the cyber-physical layer.First,a topologyrepairing strategy against frequency-constrained DoS attacks is implemented via a Zeno-free event-triggered estimation scheme,which saves communication resources considerably.The upper bound of the reaction time needed to launch the repaired topology after the occurrence of DoS attacks is calculated.Second,a decentralized adaptive and chattering-relief controller against potentially unbounded AAs is designed.Moreover,this novel adaptive controller can achieve uniformly ultimately bounded convergence,whose error bound can be given explicitly.The practicability and validity of this new two-layered protocol are shown via a simulation example and a UAV swarm experiment equipped with both Ultra-WideBand and WiFi communication channels.展开更多
This paper investigates subcarrier and power allocation in a multi-UAV OFDM system.The study considers a practical scenario,where certain subcarriers are unavailable for dynamic subcarrier allocation,on account of pre...This paper investigates subcarrier and power allocation in a multi-UAV OFDM system.The study considers a practical scenario,where certain subcarriers are unavailable for dynamic subcarrier allocation,on account of pre-allocation for burst transmissions.We first propose a novel iterative algorithm to jointly optimize subcarrier and power allocation,so as to maximize the sum rate of the uplink transmission in the multiUAV OFDM system.The key idea behind our solution is converting the nontrivial allocation problem into a weighted mean square error(MSE) problem.By this means,the allocation problem can be solved by the alternating optimization method.Besides,aiming at a lower-complexity solution,we propose a heuristic allocation scheme,where subcarrier allocation and transmit power allocation are separately optimized.In the heuristic scheme,closedform solution can be obtained for power allocation.Simulation results demonstrate that in the presence of stretched subcarrier resource,the proposed iterative joint optimization algorithm can significantly outperform the heuristic scheme,offering a higher sum rate.展开更多
With the continuous advancement and maturation of technologies such as big data,artificial intelligence,virtual reality,robotics,human-machine collaboration,and augmented reality,many enterprises are finding new avenu...With the continuous advancement and maturation of technologies such as big data,artificial intelligence,virtual reality,robotics,human-machine collaboration,and augmented reality,many enterprises are finding new avenues for digital transformation and intelligent upgrading.Industry 5.0,a further extension and development of Industry 4.0,has become an important development trend in industry with more emphasis on human-centered sustainability and flexibility.Accordingly,both the industrial metaverse and digital twins have attracted much attention in this new era.However,the relationship between them is not clear enough.In this paper,a comparison between digital twins and the metaverse in industry is made firstly.Then,we propose the concept and framework of Digital Twin Systems Engineering(DTSE)to demonstrate how digital twins support the industrial metaverse in the era of Industry 5.0 by integrating systems engineering principles.Furthermore,we discuss the key technologies and challenges of DTSE,in particular how artificial intelligence enhances the application of DTSE.Finally,a specific application scenario in the aviation field is presented to illustrate the application prospects of DTSE.展开更多
Dear Editor,In this letter,a constrained networked predictive control strategy is proposed for the optimal control problem of complex nonlinear highorder fully actuated(HOFA)systems with noises.The method can effectiv...Dear Editor,In this letter,a constrained networked predictive control strategy is proposed for the optimal control problem of complex nonlinear highorder fully actuated(HOFA)systems with noises.The method can effectively deal with nonlinearities,constraints,and noises in the system,optimize the performance metric,and present an upper bound on the stable output of the system.展开更多
This paper addresses the consensus problem of nonlinear multi-agent systems subject to external disturbances and uncertainties under denial-ofservice(DoS)attacks.Firstly,an observer-based state feedback control method...This paper addresses the consensus problem of nonlinear multi-agent systems subject to external disturbances and uncertainties under denial-ofservice(DoS)attacks.Firstly,an observer-based state feedback control method is employed to achieve secure control by estimating the system's state in real time.Secondly,by combining a memory-based adaptive eventtriggered mechanism with neural networks,the paper aims to approximate the nonlinear terms in the networked system and efficiently conserve system resources.Finally,based on a two-degree-of-freedom model of a vehicle affected by crosswinds,this paper constructs a multi-unmanned ground vehicle(Multi-UGV)system to validate the effectiveness of the proposed method.Simulation results show that the proposed control strategy can effectively handle external disturbances such as crosswinds in practical applications,ensuring the stability and reliable operation of the Multi-UGV system.展开更多
A composite anti-disturbance predictive control strategy employing a Multi-dimensional Taylor Network(MTN)is presented for unmanned systems subject to time-delay and multi-source disturbances.First,the multi-source di...A composite anti-disturbance predictive control strategy employing a Multi-dimensional Taylor Network(MTN)is presented for unmanned systems subject to time-delay and multi-source disturbances.First,the multi-source disturbances are addressed according to their specific characteristics as follows:(A)an MTN data-driven model,which is used for uncertainty description,is designed accompanied with the mechanism model to represent the unmanned systems;(B)an adaptive MTN filter is used to remove the influence of the internal disturbance;(C)an MTN disturbance observer is constructed to estimate and compensate for the influence of the external disturbance;(D)the Extended Kalman Filter(EKF)algorithm is utilized as the learning mechanism for MTNs.Second,to address the time-delay effect,a recursiveτstep-ahead MTN predictive model is designed utilizing recursive technology,aiming to mitigate the impact of time-delay,and the EKF algorithm is employed as its learning mechanism.Then,the MTN predictive control law is designed based on the quadratic performance index.By implementing the proposed composite controller to unmanned systems,simultaneous feedforward compensation and feedback suppression to the multi-source disturbances are conducted.Finally,the convergence of the MTN and the stability of the closed-loop system are established utilizing the Lyapunov theorem.Two exemplary applications of unmanned systems involving unmanned vehicle and rigid spacecraft are presented to validate the effectiveness of the proposed approach.展开更多
Understanding the factors triggering slope failure is essential to ensure the safety of buildings and transportation infrastructure on slopes. Specifically,the failure of stabilizing piles due to groundwater migration...Understanding the factors triggering slope failure is essential to ensure the safety of buildings and transportation infrastructure on slopes. Specifically,the failure of stabilizing piles due to groundwater migration and freeze–thaw(FT) cycles is a significant factor causing slope failure. This study aims to investigate the transmedia seepage characteristics at slope–concrete stabilizing pile interface systems by using silty clay and concrete with varying microstructure characteristics under FT cycles. To this end, a self-developed indoor test device for transmedia water migration, combined with a macro-meso-micro multiscale testing approach, was used to analyze the laws and mechanisms of transmedia seepage at the interface systems. The effect of the medium's microstructure characteristics on the transmedia seepage behavior at the interface systems under FT cycles was also assessed. Results indicated that the transmedia water migration exhibited particularity due to the migration of soil particles and the low permeability characteristics of concrete. The water content in the media increased significantly within the range of 1/3–2/3 of the height from the interface for soil and within 5 mm from the interface for concrete.FT cycles promoted the increase and penetration of cracks within the medium, enhancing the permeability of the slope-concrete stabilizing pile interface systems.With the increase in FT cycles, the porosity inside the medium first decreased and then increased, and the porosity reached the minimum after 25 FT cycles and the maximum after 75 FT cycles, and the water content of the medium after water migration was positively correlated with the porosity. FT cycles also significantly influenced the temporal variation characteristics of soil moisture and the migration path of water in concrete. The study results could serve as a reference for related research on slope stability assessment.展开更多
The 7 ka old Qixiangzhan lava flow(QXZ,Tianchi volcano)represents the last eruptive event before the 946 CE,caldera-forming‘Millennium’eruption(ME).Petrographic,whole rock,mineral composition,Sr-Nd isotopic data on ...The 7 ka old Qixiangzhan lava flow(QXZ,Tianchi volcano)represents the last eruptive event before the 946 CE,caldera-forming‘Millennium’eruption(ME).Petrographic,whole rock,mineral composition,Sr-Nd isotopic data on QXZ show that:(a)the lava consists of two components,constituted by comenditic obsidian fragments immersed in a continuous,aphanitic component;(b)both components have the same geochemical and isotopic variations of the ME magma.The QXZ and ME comendites result from fractional crystallization and crustal assimilation processes.The temperature of the QXZ magma was about 790℃ and the depth of the magma reservoir around 7 km,the same values as estimated for ME.QXZ had a viscosity of 10^(5.5)-10^(9) Pa s and a velocity of 3-10 km/yr.The emplacement time was 0.5-1.6yr and the flow rate 0.48-1.50 m^(3)/s.These values lie within the range estimated for other rhyolitic flows worldwide.The QXZ lava originated through a mixed explosive-effusive activity with the obsidian resulting from the ascent of undercooling,degassing and the fragmentation of magma along the conduit walls,whereas the aphanitic component testifies to the less undercooled and segregated flow at the center of the conduit.The QXZ lava demonstrates the extensive history of the ME magma chamber.展开更多
Modern aircraft tend to use fuel thermal management systems to cool onboard heat sources.However,the design of heat transfer architectures for fuel thermal management systems relies on the experience of the engineers ...Modern aircraft tend to use fuel thermal management systems to cool onboard heat sources.However,the design of heat transfer architectures for fuel thermal management systems relies on the experience of the engineers and lacks theoretical guidance.This paper proposes a concise graph representation method based on graph theory for fuel thermal management systems,which can represent all possible connections between subsystems.A generalized optimization algorithm is proposed for fuel thermal management system architecture to minimize the heat sink.This algorithm can autonomously arrange subsystems with heat production differences and efficiently utilize the architecture of the fuel heat sink.At the same time,two evaluation indices are proposed from the perspective of subsystems.These indices intuitively and clearly show that the reason for the high efficiency of heat sink utilization is the balanced and moderate cooling of each subsystem and verify the rationality of the architecture optimization method.A set of simulations are also conducted,which demonstrate that the fuel tank temperature has no effect on the performance of the architecture.This paper provides a reference for the architectural design of aircraft fuel thermal management systems.The metrics used in this paper can also be utilized to evaluate the existing architecture.展开更多
River ethics,a significant advancement inspired by Chinese President XI Jinping's ecological civilization thought,embodies the philosophical essence of river governance and represents a legacy of innovation by gen...River ethics,a significant advancement inspired by Chinese President XI Jinping's ecological civilization thought,embodies the philosophical essence of river governance and represents a legacy of innovation by generations of water resources professionals.Rooted in river ecology,it offers a framework for advancing modern water governance systems and capabilities.This paper examines eight dimensions of river ethics to provide actionable recommendations:enhancing knowledge systems on water,rivers,and lakes;addressing critical challenges in water governance to strengthen the foundational role of water authorities in ensuring water security,resource management,ecological sustainability and environmental protection;optimizing water project planning to mitigate ecological impacts;ensuring high standards in the lifecycle management of water projects;refining water diversion strategies for precise scheduling;utilizing ecosystem complexity for river and lake restoration;implementing tiered management of water-related disasters;and driving reforms to modernize water governance systems and mechanisms.展开更多
To address the issue of coordinated control of multiple hydrogen and battery storage units to suppress the grid-injected power deviation of wind farms,an online optimization strategy for Battery-hydrogen hybrid energy...To address the issue of coordinated control of multiple hydrogen and battery storage units to suppress the grid-injected power deviation of wind farms,an online optimization strategy for Battery-hydrogen hybrid energy storage systems based on measurement feedback is proposed.First,considering the high charge/discharge losses of hydrogen storage and the low energy density of battery storage,an operational optimization objective is established to enable adaptive energy adjustment in the Battery-hydrogen hybrid energy storage system.Next,an online optimization model minimizing the operational cost of the hybrid system is constructed to suppress grid-injected power deviations with satisfying the operational constraints of hydrogen storage and batteries.Finally,utilizing the online measurement of the energy states of hydrogen storage and batteries,an online optimization strategy based on measurement feedback is designed.Case study results show:before and after smoothing the fluctuations in wind power,the time when the power exceeded the upper and lower limits of the grid-injected power accounted for 24.1%and 1.45%of the total time,respectively,the proposed strategy can effectively keep the grid-injected power deviations of wind farms within the allowable range.Hydrogen storage and batteries respectively undertake long-term and short-term charge/discharge tasks,effectively reducing charge/discharge losses of the Battery-hydrogen hybrid energy storage systems and improving its operational efficiency.展开更多
Renewable Energy Systems(RES)provide a sustainable solution to climate warming and environmental pollution by enhancing stability and reliability through status acquisition and analysis on cloud platforms and intellig...Renewable Energy Systems(RES)provide a sustainable solution to climate warming and environmental pollution by enhancing stability and reliability through status acquisition and analysis on cloud platforms and intelligent processing on edge servers(ES).However,securely distributing encrypted data stored in the cloud to terminals that meet decryption requirements has become a prominent research topic.Additionally,managing attributes,including addition,deletion,and modification,is a crucial issue in the access control scheme for RES.To address these security concerns,a trust-based ciphertext-policy attribute-based encryption(CP-ABE)device access control scheme is proposed for RES(TB-CP-ABE).This scheme effectivelymanages the distribution and control of encrypted data on the cloud through robust attribute key management.By introducing trust management mechanisms and outsourced decryption technology,the ES system can effectively assess and manage the trust worthiness of terminal devices,ensuring that only trusted devices can participate in data exchange and access sensitive information.Besides,the ES system dynamically evaluates trust scores to set decryption trust thresholds,thereby regulating device data access permissions and enhancing the system’s security.To validate the security of the proposed TB-CP-ABE against chosen plaintext attacks,a comprehensive formal security analysis is conducted using the widely accepted random oraclemodel under the decisional q-Bilinear Diffie-Hellman Exponent(q-BDHE)assumption.Finally,comparative analysis with other schemes demonstrates that the TB-CP-ABE scheme cuts energy/communication costs by 43%,and scaleswell with rising terminals,maintaining average latency below 50ms,ensuring real-time service feasibility.The proposed scheme not only provides newinsights for the secure management of RES but also lays a foundation for future secure energy solutions.展开更多
In this paper,we propose a neural network approach to learn the parameters of a class of stochastic Lotka-Volterra systems.Approximations of the mean and covariance matrix of the observational variables are obtained f...In this paper,we propose a neural network approach to learn the parameters of a class of stochastic Lotka-Volterra systems.Approximations of the mean and covariance matrix of the observational variables are obtained from the Euler-Maruyama discretization of the underlying stochastic differential equations(SDEs),based on which the loss function is built.The stochastic gradient descent method is applied in the neural network training.Numerical experiments demonstrate the effectiveness of our method.展开更多
The development of sustainable electrode materials for energy storage systems has become very important and porous carbons derived from biomass have become an important candidate because of their tunable pore structur...The development of sustainable electrode materials for energy storage systems has become very important and porous carbons derived from biomass have become an important candidate because of their tunable pore structure,environmental friendliness,and cost-effectiveness.Recent advances in controlling the pore structure of these carbons and its relationship between to is energy storage performance are discussed,emphasizing the critical role of a balanced distribution of micropores,mesopores and macropores in determining electrochemical behavior.Particular attention is given to how the intrinsic components of biomass precursors(lignin,cellulose,and hemicellulose)influence pore formation during carbonization.Carbonization and activation strategies to precisely control the pore structure are introduced.Finally,key challenges in the industrial production of these carbons are outlined,and future research directions are proposed.These include the establishment of a database of biomass intrinsic structures and machine learning-assisted pore structure engineering,aimed at providing guidance for the design of high-performance carbon materials for next-generation energy storage devices.展开更多
Maintaining the integrity and longevity of structures is essential in many industries,such as aerospace,nuclear,and petroleum.To achieve the cost-effectiveness of large-scale systems in petroleum drilling,a strong emp...Maintaining the integrity and longevity of structures is essential in many industries,such as aerospace,nuclear,and petroleum.To achieve the cost-effectiveness of large-scale systems in petroleum drilling,a strong emphasis on structural durability and monitoring is required.This study focuses on the mechanical vibrations that occur in rotary drilling systems,which have a substantial impact on the structural integrity of drilling equipment.The study specifically investigates axial,torsional,and lateral vibrations,which might lead to negative consequences such as bit-bounce,chaotic whirling,and high-frequency stick-slip.These events not only hinder the efficiency of drilling but also lead to exhaustion and harm to the system’s components since they are difficult to be detected and controlled in real time.The study investigates the dynamic interactions of these vibrations,specifically in their high-frequency modes,usingfield data obtained from measurement while drilling.Thefindings have demonstrated the effect of strong coupling between the high-frequency modes of these vibrations on drilling sys-tem performance.The obtained results highlight the importance of considering the interconnected impacts of these vibrations when designing and implementing robust control systems.Therefore,integrating these compo-nents can increase the durability of drill bits and drill strings,as well as improve the ability to monitor and detect damage.Moreover,by exploiting thesefindings,the assessment of structural resilience in rotary drilling systems can be enhanced.Furthermore,the study demonstrates the capacity of structural health monitoring to improve the quality,dependability,and efficiency of rotary drilling systems in the petroleum industry.展开更多
Car manufacturers aim to enhance the use of two-factor authentication (2FA) to protect keyless entry systems in contemporary cars. Despite providing significant ease for users, keyless entry systems have become more s...Car manufacturers aim to enhance the use of two-factor authentication (2FA) to protect keyless entry systems in contemporary cars. Despite providing significant ease for users, keyless entry systems have become more susceptible to appealing attacks like relay attacks and critical fob hacking. These weaknesses present considerable security threats, resulting in unauthorized entry and car theft. The suggested approach combines a conventional keyless entry feature with an extra security measure. Implementing multi-factor authentication significantly improves the security of systems that allow keyless entry by reducing the likelihood of unauthorized access. Research shows that the benefits of using two-factor authentication, such as a substantial increase in security, far outweigh any minor drawbacks.展开更多
Schizophrenia is characterized by psychotic symptoms,negative symptoms,and cognitive deficits,profoundly affecting individuals and their families.The etiology is multifactorial,involving genetic,endocrine,and immunolo...Schizophrenia is characterized by psychotic symptoms,negative symptoms,and cognitive deficits,profoundly affecting individuals and their families.The etiology is multifactorial,involving genetic,endocrine,and immunological risk factors.It is thought that schizophrenia is exclusively linked to alterations in brain structure and function,while the relationship between the brain and many organs may lack sufficient attention.Increasing evidence indicates abnormalities of the interactions between the brain and many organs in patients with schizophrenia.Inter-organ crosstalk affects the onset,course,and management of schizophrenia.Besides,the complex relationship between autonomic nervous system,endocrine system,and immune system further facilitates the development of schizophrenia.The present review summarizes the relationships between the brain and multiple organ systems in schizophrenia,providing new perspectives on the underlying pathophysiological mechanisms of schizophrenia.展开更多
In this paper,a new technique is introduced to construct higher-order iterative methods for solving nonlinear systems.The order of convergence of some iterative methods can be improved by three at the cost of introduc...In this paper,a new technique is introduced to construct higher-order iterative methods for solving nonlinear systems.The order of convergence of some iterative methods can be improved by three at the cost of introducing only one additional evaluation of the function in each step.Furthermore,some new efficient methods with a higher-order of convergence are obtained by using only a single matrix inversion in each iteration.Analyses of convergence properties and computational efficiency of these new methods are made and testified by several numerical problems.By comparison,the new schemes are more efficient than the corresponding existing ones,particularly for large problem sizes.展开更多
基金supported by the National Research and Development Program of China under Grant JCKY2018607C019in part by the Key Laboratory Fund of UAV of Northwestern Polytechnical University under Grant 2021JCJQLB0710L.
文摘This paper proposes a Multi-Agent Attention Proximal Policy Optimization(MA2PPO)algorithm aiming at the problems such as credit assignment,low collaboration efficiency and weak strategy generalization ability existing in the cooperative pursuit tasks of multiple unmanned aerial vehicles(UAVs).Traditional algorithms often fail to effectively identify critical cooperative relationships in such tasks,leading to low capture efficiency and a significant decline in performance when the scale expands.To tackle these issues,based on the proximal policy optimization(PPO)algorithm,MA2PPO adopts the centralized training with decentralized execution(CTDE)framework and introduces a dynamic decoupling mechanism,that is,sharing the multi-head attention(MHA)mechanism for critics during centralized training to solve the credit assignment problem.This method enables the pursuers to identify highly correlated interactions with their teammates,effectively eliminate irrelevant and weakly relevant interactions,and decompose large-scale cooperation problems into decoupled sub-problems,thereby enhancing the collaborative efficiency and policy stability among multiple agents.Furthermore,a reward function has been devised to facilitate the pursuers to encircle the escapee by combining a formation reward with a distance reward,which incentivizes UAVs to develop sophisticated cooperative pursuit strategies.Experimental results demonstrate the effectiveness of the proposed algorithm in achieving multi-UAV cooperative pursuit and inducing diverse cooperative pursuit behaviors among UAVs.Moreover,experiments on scalability have demonstrated that the algorithm is suitable for large-scale multi-UAV systems.
基金co-supported by the National Natural Science Foundation of China(Nos.92371201 and 52192633)the Natural Science Foundation of Shaanxi Province of China(No.2022JC-03)the Aeronautical Science Foundation of China(No.ASFC-20220019070002)。
文摘In multiple Unmanned Aerial Vehicles(UAV)systems,achieving efficient navigation is essential for executing complex tasks and enhancing autonomy.Traditional navigation methods depend on predefined control strategies and trajectory planning and often perform poorly in complex environments.To improve the UAV-environment interaction efficiency,this study proposes a multi-UAV integrated navigation algorithm based on Deep Reinforcement Learning(DRL).This algorithm integrates the Inertial Navigation System(INS),Global Navigation Satellite System(GNSS),and Visual Navigation System(VNS)for comprehensive information fusion.Specifically,an improved multi-UAV integrated navigation algorithm called Information Fusion with MultiAgent Deep Deterministic Policy Gradient(IF-MADDPG)was developed.This algorithm enables UAVs to learn collaboratively and optimize their flight trajectories in real time.Through simulations and experiments,test scenarios in GNSS-denied environments were constructed to evaluate the effectiveness of the algorithm.The experimental results demonstrate that the IF-MADDPG algorithm significantly enhances the collaborative navigation capabilities of multiple UAVs in formation maintenance and GNSS-denied environments.Additionally,it has advantages in terms of mission completion time.This study provides a novel approach for efficient collaboration in multi-UAV systems,which significantly improves the robustness and adaptability of navigation systems.
基金This work was supported in part by the National Natural Science Foundation of China(61903258)Guangdong Basic and Applied Basic Research Foundation(2022A1515010234)+1 种基金the Project of Department of Education of Guangdong Province(2022KTSCX105)Qatar National Research Fund(NPRP12C-0814-190012).
文摘This paper studies the countermeasure design problems of distributed resilient time-varying formation-tracking control for multi-UAV systems with single-way communications against composite attacks,including denial-of-services(DoS)attacks,false-data injection attacks,camouflage attacks,and actuation attacks(AAs).Inspired by the concept of digital twin,a new two-layered protocol equipped with a safe and private twin layer(TL)is proposed,which decouples the above problems into the defense scheme against DoS attacks on the TL and the defense scheme against AAs on the cyber-physical layer.First,a topologyrepairing strategy against frequency-constrained DoS attacks is implemented via a Zeno-free event-triggered estimation scheme,which saves communication resources considerably.The upper bound of the reaction time needed to launch the repaired topology after the occurrence of DoS attacks is calculated.Second,a decentralized adaptive and chattering-relief controller against potentially unbounded AAs is designed.Moreover,this novel adaptive controller can achieve uniformly ultimately bounded convergence,whose error bound can be given explicitly.The practicability and validity of this new two-layered protocol are shown via a simulation example and a UAV swarm experiment equipped with both Ultra-WideBand and WiFi communication channels.
基金supported by China NSF Grants(61631020)the Fundamental Research Funds for the Central Universities(NP2018103,NE2017103,NC2017003)
文摘This paper investigates subcarrier and power allocation in a multi-UAV OFDM system.The study considers a practical scenario,where certain subcarriers are unavailable for dynamic subcarrier allocation,on account of pre-allocation for burst transmissions.We first propose a novel iterative algorithm to jointly optimize subcarrier and power allocation,so as to maximize the sum rate of the uplink transmission in the multiUAV OFDM system.The key idea behind our solution is converting the nontrivial allocation problem into a weighted mean square error(MSE) problem.By this means,the allocation problem can be solved by the alternating optimization method.Besides,aiming at a lower-complexity solution,we propose a heuristic allocation scheme,where subcarrier allocation and transmit power allocation are separately optimized.In the heuristic scheme,closedform solution can be obtained for power allocation.Simulation results demonstrate that in the presence of stretched subcarrier resource,the proposed iterative joint optimization algorithm can significantly outperform the heuristic scheme,offering a higher sum rate.
基金Supported by Beijing Municipal Natural Science Foundation of China(Grant No.24JL002)China Postdoctoral Science Foundation(Grant No.2024M754054)+2 种基金National Natural Science Foundation of China(Grant No.52120105008)Beijing Municipal Outstanding Young Scientis Program of Chinathe New Cornerstone Science Foundation through the XPLORER PRIZE。
文摘With the continuous advancement and maturation of technologies such as big data,artificial intelligence,virtual reality,robotics,human-machine collaboration,and augmented reality,many enterprises are finding new avenues for digital transformation and intelligent upgrading.Industry 5.0,a further extension and development of Industry 4.0,has become an important development trend in industry with more emphasis on human-centered sustainability and flexibility.Accordingly,both the industrial metaverse and digital twins have attracted much attention in this new era.However,the relationship between them is not clear enough.In this paper,a comparison between digital twins and the metaverse in industry is made firstly.Then,we propose the concept and framework of Digital Twin Systems Engineering(DTSE)to demonstrate how digital twins support the industrial metaverse in the era of Industry 5.0 by integrating systems engineering principles.Furthermore,we discuss the key technologies and challenges of DTSE,in particular how artificial intelligence enhances the application of DTSE.Finally,a specific application scenario in the aviation field is presented to illustrate the application prospects of DTSE.
基金supported in part by the National Natural Science Foundation of China(62173255,62188101)Shenzhen Key Laboratory of Control Theory and Intelligent Systems(ZDSYS20220330161800001)
文摘Dear Editor,In this letter,a constrained networked predictive control strategy is proposed for the optimal control problem of complex nonlinear highorder fully actuated(HOFA)systems with noises.The method can effectively deal with nonlinearities,constraints,and noises in the system,optimize the performance metric,and present an upper bound on the stable output of the system.
基金The National Natural Science Foundation of China(W2431048)The Science and Technology Research Program of Chongqing Municipal Education Commission,China(KJZDK202300807)The Chongqing Natural Science Foundation,China(CSTB2024NSCQQCXMX0052).
文摘This paper addresses the consensus problem of nonlinear multi-agent systems subject to external disturbances and uncertainties under denial-ofservice(DoS)attacks.Firstly,an observer-based state feedback control method is employed to achieve secure control by estimating the system's state in real time.Secondly,by combining a memory-based adaptive eventtriggered mechanism with neural networks,the paper aims to approximate the nonlinear terms in the networked system and efficiently conserve system resources.Finally,based on a two-degree-of-freedom model of a vehicle affected by crosswinds,this paper constructs a multi-unmanned ground vehicle(Multi-UGV)system to validate the effectiveness of the proposed method.Simulation results show that the proposed control strategy can effectively handle external disturbances such as crosswinds in practical applications,ensuring the stability and reliable operation of the Multi-UGV system.
基金co-supported by the National Key R&D Program of China(No.2023YFB4704400)the Zhejiang Provincial Natural Science Foundation of China(No.LQ24F030012)the National Natural Science Foundation of China General Project(No.62373033)。
文摘A composite anti-disturbance predictive control strategy employing a Multi-dimensional Taylor Network(MTN)is presented for unmanned systems subject to time-delay and multi-source disturbances.First,the multi-source disturbances are addressed according to their specific characteristics as follows:(A)an MTN data-driven model,which is used for uncertainty description,is designed accompanied with the mechanism model to represent the unmanned systems;(B)an adaptive MTN filter is used to remove the influence of the internal disturbance;(C)an MTN disturbance observer is constructed to estimate and compensate for the influence of the external disturbance;(D)the Extended Kalman Filter(EKF)algorithm is utilized as the learning mechanism for MTNs.Second,to address the time-delay effect,a recursiveτstep-ahead MTN predictive model is designed utilizing recursive technology,aiming to mitigate the impact of time-delay,and the EKF algorithm is employed as its learning mechanism.Then,the MTN predictive control law is designed based on the quadratic performance index.By implementing the proposed composite controller to unmanned systems,simultaneous feedforward compensation and feedback suppression to the multi-source disturbances are conducted.Finally,the convergence of the MTN and the stability of the closed-loop system are established utilizing the Lyapunov theorem.Two exemplary applications of unmanned systems involving unmanned vehicle and rigid spacecraft are presented to validate the effectiveness of the proposed approach.
基金financially supported by Jilin Provincial Natural Science Foundation (No.20220101164JC)。
文摘Understanding the factors triggering slope failure is essential to ensure the safety of buildings and transportation infrastructure on slopes. Specifically,the failure of stabilizing piles due to groundwater migration and freeze–thaw(FT) cycles is a significant factor causing slope failure. This study aims to investigate the transmedia seepage characteristics at slope–concrete stabilizing pile interface systems by using silty clay and concrete with varying microstructure characteristics under FT cycles. To this end, a self-developed indoor test device for transmedia water migration, combined with a macro-meso-micro multiscale testing approach, was used to analyze the laws and mechanisms of transmedia seepage at the interface systems. The effect of the medium's microstructure characteristics on the transmedia seepage behavior at the interface systems under FT cycles was also assessed. Results indicated that the transmedia water migration exhibited particularity due to the migration of soil particles and the low permeability characteristics of concrete. The water content in the media increased significantly within the range of 1/3–2/3 of the height from the interface for soil and within 5 mm from the interface for concrete.FT cycles promoted the increase and penetration of cracks within the medium, enhancing the permeability of the slope-concrete stabilizing pile interface systems.With the increase in FT cycles, the porosity inside the medium first decreased and then increased, and the porosity reached the minimum after 25 FT cycles and the maximum after 75 FT cycles, and the water content of the medium after water migration was positively correlated with the porosity. FT cycles also significantly influenced the temporal variation characteristics of soil moisture and the migration path of water in concrete. The study results could serve as a reference for related research on slope stability assessment.
基金funded by the National Natural Science Foundation of China(Grant Nos.41972313 and 41790453)the Engineering Research Center of Geothermal Resources Development Technology and Equipment,Ministry of Education,Jilin University。
文摘The 7 ka old Qixiangzhan lava flow(QXZ,Tianchi volcano)represents the last eruptive event before the 946 CE,caldera-forming‘Millennium’eruption(ME).Petrographic,whole rock,mineral composition,Sr-Nd isotopic data on QXZ show that:(a)the lava consists of two components,constituted by comenditic obsidian fragments immersed in a continuous,aphanitic component;(b)both components have the same geochemical and isotopic variations of the ME magma.The QXZ and ME comendites result from fractional crystallization and crustal assimilation processes.The temperature of the QXZ magma was about 790℃ and the depth of the magma reservoir around 7 km,the same values as estimated for ME.QXZ had a viscosity of 10^(5.5)-10^(9) Pa s and a velocity of 3-10 km/yr.The emplacement time was 0.5-1.6yr and the flow rate 0.48-1.50 m^(3)/s.These values lie within the range estimated for other rhyolitic flows worldwide.The QXZ lava originated through a mixed explosive-effusive activity with the obsidian resulting from the ascent of undercooling,degassing and the fragmentation of magma along the conduit walls,whereas the aphanitic component testifies to the less undercooled and segregated flow at the center of the conduit.The QXZ lava demonstrates the extensive history of the ME magma chamber.
文摘Modern aircraft tend to use fuel thermal management systems to cool onboard heat sources.However,the design of heat transfer architectures for fuel thermal management systems relies on the experience of the engineers and lacks theoretical guidance.This paper proposes a concise graph representation method based on graph theory for fuel thermal management systems,which can represent all possible connections between subsystems.A generalized optimization algorithm is proposed for fuel thermal management system architecture to minimize the heat sink.This algorithm can autonomously arrange subsystems with heat production differences and efficiently utilize the architecture of the fuel heat sink.At the same time,two evaluation indices are proposed from the perspective of subsystems.These indices intuitively and clearly show that the reason for the high efficiency of heat sink utilization is the balanced and moderate cooling of each subsystem and verify the rationality of the architecture optimization method.A set of simulations are also conducted,which demonstrate that the fuel tank temperature has no effect on the performance of the architecture.This paper provides a reference for the architectural design of aircraft fuel thermal management systems.The metrics used in this paper can also be utilized to evaluate the existing architecture.
基金Three Gorges Follow-up Work Fund,Grant/Award Number:WE0161A042024National Key Research Program of China,Grant/Award Number:2024YFC3210900。
文摘River ethics,a significant advancement inspired by Chinese President XI Jinping's ecological civilization thought,embodies the philosophical essence of river governance and represents a legacy of innovation by generations of water resources professionals.Rooted in river ecology,it offers a framework for advancing modern water governance systems and capabilities.This paper examines eight dimensions of river ethics to provide actionable recommendations:enhancing knowledge systems on water,rivers,and lakes;addressing critical challenges in water governance to strengthen the foundational role of water authorities in ensuring water security,resource management,ecological sustainability and environmental protection;optimizing water project planning to mitigate ecological impacts;ensuring high standards in the lifecycle management of water projects;refining water diversion strategies for precise scheduling;utilizing ecosystem complexity for river and lake restoration;implementing tiered management of water-related disasters;and driving reforms to modernize water governance systems and mechanisms.
基金Supported by State Grid Zhejiang Electric Power Co.,Ltd.Science and Technology Project Funding(No.B311DS230005).
文摘To address the issue of coordinated control of multiple hydrogen and battery storage units to suppress the grid-injected power deviation of wind farms,an online optimization strategy for Battery-hydrogen hybrid energy storage systems based on measurement feedback is proposed.First,considering the high charge/discharge losses of hydrogen storage and the low energy density of battery storage,an operational optimization objective is established to enable adaptive energy adjustment in the Battery-hydrogen hybrid energy storage system.Next,an online optimization model minimizing the operational cost of the hybrid system is constructed to suppress grid-injected power deviations with satisfying the operational constraints of hydrogen storage and batteries.Finally,utilizing the online measurement of the energy states of hydrogen storage and batteries,an online optimization strategy based on measurement feedback is designed.Case study results show:before and after smoothing the fluctuations in wind power,the time when the power exceeded the upper and lower limits of the grid-injected power accounted for 24.1%and 1.45%of the total time,respectively,the proposed strategy can effectively keep the grid-injected power deviations of wind farms within the allowable range.Hydrogen storage and batteries respectively undertake long-term and short-term charge/discharge tasks,effectively reducing charge/discharge losses of the Battery-hydrogen hybrid energy storage systems and improving its operational efficiency.
基金supported by the Science and Technology Project of the State Grid Corporation of China,Grant number 5700-202223189A-1-1-ZN.
文摘Renewable Energy Systems(RES)provide a sustainable solution to climate warming and environmental pollution by enhancing stability and reliability through status acquisition and analysis on cloud platforms and intelligent processing on edge servers(ES).However,securely distributing encrypted data stored in the cloud to terminals that meet decryption requirements has become a prominent research topic.Additionally,managing attributes,including addition,deletion,and modification,is a crucial issue in the access control scheme for RES.To address these security concerns,a trust-based ciphertext-policy attribute-based encryption(CP-ABE)device access control scheme is proposed for RES(TB-CP-ABE).This scheme effectivelymanages the distribution and control of encrypted data on the cloud through robust attribute key management.By introducing trust management mechanisms and outsourced decryption technology,the ES system can effectively assess and manage the trust worthiness of terminal devices,ensuring that only trusted devices can participate in data exchange and access sensitive information.Besides,the ES system dynamically evaluates trust scores to set decryption trust thresholds,thereby regulating device data access permissions and enhancing the system’s security.To validate the security of the proposed TB-CP-ABE against chosen plaintext attacks,a comprehensive formal security analysis is conducted using the widely accepted random oraclemodel under the decisional q-Bilinear Diffie-Hellman Exponent(q-BDHE)assumption.Finally,comparative analysis with other schemes demonstrates that the TB-CP-ABE scheme cuts energy/communication costs by 43%,and scaleswell with rising terminals,maintaining average latency below 50ms,ensuring real-time service feasibility.The proposed scheme not only provides newinsights for the secure management of RES but also lays a foundation for future secure energy solutions.
基金Supported by the National Natural Science Foundation of China(11971458,11471310)。
文摘In this paper,we propose a neural network approach to learn the parameters of a class of stochastic Lotka-Volterra systems.Approximations of the mean and covariance matrix of the observational variables are obtained from the Euler-Maruyama discretization of the underlying stochastic differential equations(SDEs),based on which the loss function is built.The stochastic gradient descent method is applied in the neural network training.Numerical experiments demonstrate the effectiveness of our method.
文摘The development of sustainable electrode materials for energy storage systems has become very important and porous carbons derived from biomass have become an important candidate because of their tunable pore structure,environmental friendliness,and cost-effectiveness.Recent advances in controlling the pore structure of these carbons and its relationship between to is energy storage performance are discussed,emphasizing the critical role of a balanced distribution of micropores,mesopores and macropores in determining electrochemical behavior.Particular attention is given to how the intrinsic components of biomass precursors(lignin,cellulose,and hemicellulose)influence pore formation during carbonization.Carbonization and activation strategies to precisely control the pore structure are introduced.Finally,key challenges in the industrial production of these carbons are outlined,and future research directions are proposed.These include the establishment of a database of biomass intrinsic structures and machine learning-assisted pore structure engineering,aimed at providing guidance for the design of high-performance carbon materials for next-generation energy storage devices.
文摘Maintaining the integrity and longevity of structures is essential in many industries,such as aerospace,nuclear,and petroleum.To achieve the cost-effectiveness of large-scale systems in petroleum drilling,a strong emphasis on structural durability and monitoring is required.This study focuses on the mechanical vibrations that occur in rotary drilling systems,which have a substantial impact on the structural integrity of drilling equipment.The study specifically investigates axial,torsional,and lateral vibrations,which might lead to negative consequences such as bit-bounce,chaotic whirling,and high-frequency stick-slip.These events not only hinder the efficiency of drilling but also lead to exhaustion and harm to the system’s components since they are difficult to be detected and controlled in real time.The study investigates the dynamic interactions of these vibrations,specifically in their high-frequency modes,usingfield data obtained from measurement while drilling.Thefindings have demonstrated the effect of strong coupling between the high-frequency modes of these vibrations on drilling sys-tem performance.The obtained results highlight the importance of considering the interconnected impacts of these vibrations when designing and implementing robust control systems.Therefore,integrating these compo-nents can increase the durability of drill bits and drill strings,as well as improve the ability to monitor and detect damage.Moreover,by exploiting thesefindings,the assessment of structural resilience in rotary drilling systems can be enhanced.Furthermore,the study demonstrates the capacity of structural health monitoring to improve the quality,dependability,and efficiency of rotary drilling systems in the petroleum industry.
文摘Car manufacturers aim to enhance the use of two-factor authentication (2FA) to protect keyless entry systems in contemporary cars. Despite providing significant ease for users, keyless entry systems have become more susceptible to appealing attacks like relay attacks and critical fob hacking. These weaknesses present considerable security threats, resulting in unauthorized entry and car theft. The suggested approach combines a conventional keyless entry feature with an extra security measure. Implementing multi-factor authentication significantly improves the security of systems that allow keyless entry by reducing the likelihood of unauthorized access. Research shows that the benefits of using two-factor authentication, such as a substantial increase in security, far outweigh any minor drawbacks.
基金Supported by Beijing Traditional Chinese Medicine Scientific and Technological Development Fund Project,No.BJZYYB-2023-66Beijing Natural Science Foundation,No.7212050the Capital’s Funds for Health Improvement and Research,No.2020-4-2126.
文摘Schizophrenia is characterized by psychotic symptoms,negative symptoms,and cognitive deficits,profoundly affecting individuals and their families.The etiology is multifactorial,involving genetic,endocrine,and immunological risk factors.It is thought that schizophrenia is exclusively linked to alterations in brain structure and function,while the relationship between the brain and many organs may lack sufficient attention.Increasing evidence indicates abnormalities of the interactions between the brain and many organs in patients with schizophrenia.Inter-organ crosstalk affects the onset,course,and management of schizophrenia.Besides,the complex relationship between autonomic nervous system,endocrine system,and immune system further facilitates the development of schizophrenia.The present review summarizes the relationships between the brain and multiple organ systems in schizophrenia,providing new perspectives on the underlying pathophysiological mechanisms of schizophrenia.
基金Supported by the National Natural Science Foundation of China(12061048)NSF of Jiangxi Province(20232BAB201026,20232BAB201018)。
文摘In this paper,a new technique is introduced to construct higher-order iterative methods for solving nonlinear systems.The order of convergence of some iterative methods can be improved by three at the cost of introducing only one additional evaluation of the function in each step.Furthermore,some new efficient methods with a higher-order of convergence are obtained by using only a single matrix inversion in each iteration.Analyses of convergence properties and computational efficiency of these new methods are made and testified by several numerical problems.By comparison,the new schemes are more efficient than the corresponding existing ones,particularly for large problem sizes.
