Reinforcement learning(RL)has been widely studied as an efficient class of machine learning methods for adaptive optimal control under uncertainties.In recent years,the applications of RL in optimised decision-making ...Reinforcement learning(RL)has been widely studied as an efficient class of machine learning methods for adaptive optimal control under uncertainties.In recent years,the applications of RL in optimised decision-making and motion control of intelligent vehicles have received increasing attention.Due to the complex and dynamic operating environments of intelligent vehicles,it is necessary to improve the learning efficiency and generalisation ability of RL-based decision and control algorithms under different conditions.This survey systematically examines the theoretical foundations,algorithmic advancements and practical challenges of applying RL to intelligent vehicle systems operating in complex and dynamic environments.The major algorithm frameworks of RL are first introduced,and the recent advances in RL-based decision-making and control of intelligent vehicles are overviewed.In addition to self-learning decision and control approaches using state measurements,the developments of DRL methods for end-to-end driving control of intelligent vehicles are summarised.The open problems and directions for further research works are also discussed.展开更多
The randomness and uncertainty of renewable energy generation are expected to significantly change the optimal decision-making of trans-provincial electricity market subjects.Therefore,it is beneficial to optimize the...The randomness and uncertainty of renewable energy generation are expected to significantly change the optimal decision-making of trans-provincial electricity market subjects.Therefore,it is beneficial to optimize the interests of each of these subjects,considering the unpredictable risks of renewable energy under the renewable portfolio standards(RPS)and researching their effects on the optimal decision-making of transprovincial electricity market multi-subjects.First,we develop a trans-provincial trading market mechanism for renewable energy and clarify the electricity supply and demand relation and the green certificates supply and demand relation of trans-provincial electricitymarketmulti-subjects.Then,under the RPS,we construct a multi-subject game model of the power supply chain that recognizes the risks,and adopt the reverse induction method to discuss the optimum risk-taking judgment of each subject in the trans-provincial electricity market.Finally,we useMATLAB to verify the viability and efficacy of the proposed gamemodel,and obtain a certain reference value for the optimal decision-making of trans-provincial electricity market subjects.In summary,we consider the uncertainty risks of renewable energy under RPS,study the effects of the green certificate price and risk aversion coefficient in the RPS mechanism on the optimal decisionmaking of trans-provincial electricity market subjects,and obtain the changing trends of two different power products and those of different electricity market subjects under the influence of the green certificate price and risk aversion coefficient,which have a certain reference value for studying the factors affecting the optimal decision-making of trans-provincial electricity market subjects.展开更多
Mining activities may cause serious damages to the river ecological environment in mining areas. It has been realized that challenging is faced for optimal decision-making on the river ecological restoration resulting...Mining activities may cause serious damages to the river ecological environment in mining areas. It has been realized that challenging is faced for optimal decision-making on the river ecological restoration resulting from system complexity, multi-objectives, long term restoration in which multiple stages may be needed to take, and difficulty in detailed process quan- tification. By analyzing and fully reflecting the differences between the central zone and surrounding zones of the restored river passing through the mining area, the comprehensive evaluation index systems of the central zone and surrounding zones are separately suggested firstly. Then a scenario-based optimization decision-making model for river ecological restoration in min- ing areas was established with taking advantages of spatial divisions and following procedure of first going through optimiza- tion by sub-region level, then optimizing by integration. Then, a framework for scenario-based optimal decision-making on water-deficient river ecological restoration in mining areas is proposed in which a multi-objective and multi-stage spatial division optimization method is considered to improve decision-making efficiency and enhance its practicability. It is indicated that this optimization framework is reasonable and practical, which is expected to offer reliable decision support in identifying the effective solutions on optimal management of the water-deficient river ecological restoration in mining areas. At the same time, it has implications in general land reclamation and ecological restoration in the mining areas.展开更多
Digital twins and the physical assets of electric power systems face the potential risk of data loss and monitoring failures owing to catastrophic events,causing surveillance and energy loss.This study aims to refine ...Digital twins and the physical assets of electric power systems face the potential risk of data loss and monitoring failures owing to catastrophic events,causing surveillance and energy loss.This study aims to refine maintenance strategies for the monitoring of an electric power digital twin system post disasters.Initially,the research delineates the physical electric power system along with its digital counterpart and post-disaster restoration processes.Subsequently,it delves into communication and data processing mechanisms,specifically focusing on central data processing(CDP),communication routers(CRs),and phasor measurement units(PMUs),to re-establish an equipment recovery model based on these data transmission methodologies.Furthermore,it introduces a mathematical optimization model designed to enhance the digital twin system’s post-disaster monitoring efficacy by employing the branch-and-bound method for its resolution.The efficacy of the proposed model was corroborated by analyzing an IEEE-14 system.The findings suggest that the proposed branch-and-bound algorithm significantly augments the observational capabilities of a power system with limited resources,thereby bolstering its stability and emergency response mechanisms.展开更多
In the remote sensing survey of the country land, cost and accuracy are a pair of conflicts, for which spatial sampling is a preferable solution with the aim of an optimal balance between economic input and accuracy o...In the remote sensing survey of the country land, cost and accuracy are a pair of conflicts, for which spatial sampling is a preferable solution with the aim of an optimal balance between economic input and accuracy of results, or in other words, acquirement of higher ac-curacy at less cost. Counter to drawbacks of previous application models, e.g. lack of compre-hensive and quantitative-comparison, the optimal decision-making model of spatial sampling is proposed. This model first acquires the possible accuracy-cost diagrams of multiple schemes through initial spatial exploration, then regresses them and standardizes them into a unified ref-erence frame, and finally produces the relatively optimal sampling scheme by using the discrete decision-making function (built by this paper) and comparing them in combination with the dia-grams. According to the test result in the survey of the arable land using remotely sensed data, the Sandwich model, while applied in the survey of the thin-feature and cultivated land areas with aerial photos, can better realize the goal of the best balance between investment and accuracy. With this case and other cases, it is shown that the optimal decision-making model of spatial sampling is a good choice in the survey of the farm areas using remote sensing, with its distin-guished benefit of higher precision at less cost or vice versa. In order to extensively apply the model in the surveys of natural resources, including arable farm areas, this paper proposes the prototype of development using the component technology, that could considerably improve the analysis efficiency by insetting program components within the software environment of GIS and RS.展开更多
Fuzzy similar priority ratio is adopted to select the optimal variety from 6 city flower candidates in a certain city,i.e.Nelumbo nucifera x1,Prunus persica Batsch.var.duplex Rehd.x2,Rosa chinensis Jacq.x3,Dendranthem...Fuzzy similar priority ratio is adopted to select the optimal variety from 6 city flower candidates in a certain city,i.e.Nelumbo nucifera x1,Prunus persica Batsch.var.duplex Rehd.x2,Rosa chinensis Jacq.x3,Dendranthema morifolium x4,Jassminum nudiflorum Lindl.x5 and Prunus mume x6.The results show that the priority sequence of 6 candidates was x1,x6,x5,x3,x4 and x2.展开更多
In this paper,we consider the maximal positive definite solution of the nonlinear matrix equation.By using the idea of Algorithm 2.1 in ZHANG(2013),a new inversion-free method with a stepsize parameter is proposed to ...In this paper,we consider the maximal positive definite solution of the nonlinear matrix equation.By using the idea of Algorithm 2.1 in ZHANG(2013),a new inversion-free method with a stepsize parameter is proposed to obtain the maximal positive definite solution of nonlinear matrix equation X+A^(*)X|^(-α)A=Q with the case 0<α≤1.Based on this method,a new iterative algorithm is developed,and its convergence proof is given.Finally,two numerical examples are provided to show the effectiveness of the proposed method.展开更多
With the increasing complexity of industrial automation,planetary gearboxes play a vital role in largescale equipment transmission systems,directly impacting operational efficiency and safety.Traditional maintenance s...With the increasing complexity of industrial automation,planetary gearboxes play a vital role in largescale equipment transmission systems,directly impacting operational efficiency and safety.Traditional maintenance strategies often struggle to accurately predict the degradation process of equipment,leading to excessive maintenance costs or potential failure risks.However,existing prediction methods based on statistical models are difficult to adapt to nonlinear degradation processes.To address these challenges,this study proposes a novel condition-based maintenance framework for planetary gearboxes.A comprehensive full-lifecycle degradation experiment was conducted to collect raw vibration signals,which were then processed using a temporal convolutional network autoencoder with multi-scale perception capability to extract deep temporal degradation features,enabling the collaborative extraction of longperiod meshing frequencies and short-term impact features from the vibration signals.Kernel principal component analysis was employed to fuse and normalize these features,enhancing the characterization of degradation progression.A nonlinear Wiener process was used to model the degradation trajectory,with a threshold decay function introduced to dynamically adjust maintenance strategies,and model parameters optimized through maximum likelihood estimation.Meanwhile,the maintenance strategy was optimized to minimize costs per unit time,determining the optimal maintenance timing and preventive maintenance threshold.The comprehensive indicator of degradation trends extracted by this method reaches 0.756,which is 41.2%higher than that of traditional time-domain features;the dynamic threshold strategy reduces the maintenance cost per unit time to 55.56,which is 8.9%better than that of the static threshold optimization.Experimental results demonstrate significant reductions in maintenance costs while enhancing system reliability and safety.This study realizes the organic integration of deep learning and reliability theory in the maintenance of planetary gearboxes,provides an interpretable solution for the predictive maintenance of complex mechanical systems,and promotes the development of condition-based maintenance strategies for planetary gearboxes.展开更多
In recent years,three-dimensional reconstruction technologies that employ multiple cameras have continued to evolve significantly,enabling remote collaboration among users in extended Reality(XR)environments.In additi...In recent years,three-dimensional reconstruction technologies that employ multiple cameras have continued to evolve significantly,enabling remote collaboration among users in extended Reality(XR)environments.In addition,methods for deploying multiple cameras for motion capture of users(e.g.,performers)are widely used in computer graphics.As the need to minimize and optimize the number of cameras grows to reduce costs,various technologies and research approaches focused on Optimal Camera Placement(OCP)are continually being proposed.However,as most existing studies assume homogeneous camera setups,there is a growing demand for studies on heterogeneous camera setups.For instance,technical demands keep emerging in scenarios with minimal camera configurations,especially regarding cost factors,the physical placement of cameras given the spatial structure,and image capture strategies for heterogeneous cameras,such as high-resolution RGB cameras and depth cameras.In this study,we propose a pre-visualization and simulation method for the optimal placement of heterogeneous cameras in XR environments,accounting for both the specifications of heterogeneous cameras(e.g.,field of view)and the physical configuration(e.g.,wall configuration)in real-world spaces.The proposed method performs a visibility analysis of cameras by considering each camera’s field-of-view volume,resolution,and unique characteristics,along with physicalspace constraints.This approach enables the optimal position and rotation of each camera to be recommended,along with the minimum number of cameras required.In the results of our study conducted in heterogeneous camera combinations,the proposed method achieved 81.7%~82.7%coverage of the target visual information using only 2~3 cameras.In contrast,single(or homogeneous)-typed cameras were required to use 11 cameras for 81.6%coverage.Accordingly,we found that camera deployment resources can be reduced with the proposed approaches.展开更多
The augmented evolution equation is established under the framework of the Variation Evolving Method(VEM)that seeks optimal solutions by solving the transformed Initial-Value Problems(IVPs).To improve the numerical pe...The augmented evolution equation is established under the framework of the Variation Evolving Method(VEM)that seeks optimal solutions by solving the transformed Initial-Value Problems(IVPs).To improve the numerical performance,its compact form is developed herein.Through replacing the states and costates variation evolution with that of the controls,the dimension-reduced Evolution Partial Differential Equation(EPDE)only solves the control variables along the variation time to get the optimal solution,and the initial conditions for the definite solution may be arbitrary.With this equation,the scale of the resulting IVPs,obtained via the semi-discrete method,is significantly reduced and they may be solved with common Ordinary Differential Equation(ODE)integration methods conveniently.Meanwhile,the state and the costate dynamics share consistent stability in the numerical computation and this avoids the intrinsic numerical difficulty as in the indirect methods.Numerical examples are solved and it is shown that the compact form evolution equation outperforms the primary form in the precision,and the efficiency may be higher for the dense discretization.Actually,it is uncovered that the compact form of the augmented evolution equation is a continuous realization of the Newton type iteration mechanism.展开更多
Virtual power plant(VPP)integrates a variety of distributed renewable energy and energy storage to participate in electricity market transactions,promote the consumption of renewable energy,and improve economic effici...Virtual power plant(VPP)integrates a variety of distributed renewable energy and energy storage to participate in electricity market transactions,promote the consumption of renewable energy,and improve economic efficiency.In this paper,aiming at the uncertainty of distributed wind power and photovoltaic output,considering the coupling relationship between power,carbon trading,and green cardmarket,the optimal operationmodel and bidding scheme of VPP in spot market,carbon trading market,and green card market are established.On this basis,through the Shapley value and independent risk contribution theory in cooperative game theory,the quantitative analysis of the total income and risk contribution of various distributed resources in the virtual power plant is realized.Moreover,the scheduling strategies of virtual power plants under different risk preferences are systematically compared,and the feasibility and accuracy of the combination of Shapley value and independent risk contribution theory in ensuring fair income distribution and reasonable risk assessment are emphasized.A comprehensive solution for virtual power plants in the multi-market environment is constructed,which integrates operation strategy,income distribution mechanism,and risk control system into a unified analysis framework.Through the simulation of multi-scenario examples,the CPLEXsolver inMATLAB software is used to optimize themodel.The proposed joint optimization scheme can increase the profit of VPP participating in carbon trading and green certificate market by 29%.The total revenue of distributed resources managed by VPP is 9%higher than that of individual participation.展开更多
The concept of hybrid ships has gained significant attention in recent years,as they offer an effective means of enhancing energy utilization and reducing environmental pollution.However,the navigational environments ...The concept of hybrid ships has gained significant attention in recent years,as they offer an effective means of enhancing energy utilization and reducing environmental pollution.However,the navigational environments of ships are often subject to changes,which in turn affect their energy efficiency in a complex manner.It is therefore evident that enhancing the energy efficiency of hybrid ships is a worthwhile goal.In this study,we take a diesel-electric hybrid ship navigating in inland waterways as the research object,and propose a hierarchical optimization method for ship energy efficiency.The upper-layer control establishes a predictive model for propulsion motor speed and fuel consumption through multivariate time series predictions,and employs the model predictive control(MPC)method to optimize the propulsion motor speed.The lower-layer control utilizes an equivalent fuel consumption minimization method,which is based on improving the equivalence factor.This involves combining the variation of the supercapacitor’s state of charge(SOC)with the propulsion motor speed obtained from the MPC optimization in the upper-layer control.Furthermore,a proportional integral(PI)controller is used to adjust the equivalence factor,in order to adapt the equivalent fuel consumption minimization method to the working conditions.Our results demonstrate that the proposed hierarchical optimization method can reduce the energy efficiency operating indicator(EEOI)by approximately 11.54%and the fuel consumption by approximately 9.47%in comparison to the pre-optimization scenario.展开更多
Trajectory tracking for nonlinear robotic systems remains a fundamental yet challenging problem in control engineering,particularly when both precision and efficiency must be ensured.Conventional control methods are o...Trajectory tracking for nonlinear robotic systems remains a fundamental yet challenging problem in control engineering,particularly when both precision and efficiency must be ensured.Conventional control methods are often effective for stabilization but may not directly optimize long-term performance.To address this limitation,this study develops an integrated framework that combines optimal control principles with reinforcement learning for a single-link robotic manipulator.The proposed scheme adopts an actor–critic structure,where the critic network approximates the value function associated with the Hamilton–Jacobi–Bellman equation,and the actor network generates near-optimal control signals in real time.This dual adaptation enables the controller to refine its policy online without explicit system knowledge.Stability of the closed-loop system is analyzed through Lyapunov theory,ensuring boundedness of the tracking error.Numerical simulations on the single-link manipulator demonstrate that themethod achieves accurate trajectory followingwhile maintaining lowcontrol effort.The results further showthat the actor–critic learning mechanism accelerates convergence of the control policy compared with conventional optimization-based strategies.This work highlights the potential of reinforcement learning integrated with optimal control for robotic manipulators and provides a foundation for future extensions to more complex multi-degree-of-freedom systems.The proposed controller is further validated in a physics-based virtual Gazebo environment,demonstrating stable adaptation and real-time feasibility.展开更多
In the wireless energy transmission service composition optimization problem,a key challenge is accurately capturing users’preferences for service criteria under complex influencing factors,and optimally selecting a ...In the wireless energy transmission service composition optimization problem,a key challenge is accurately capturing users’preferences for service criteria under complex influencing factors,and optimally selecting a composition solution under their budget constraints.Existing studies typically evaluate satisfaction solely based on energy transmission capacity,while overlooking critical factors such as price and trustworthiness of the provider,leading to a mismatch between optimization outcomes and user needs.To address this gap,we construct a user satisfaction evaluation model for multi-user and multi-provider scenarios,systematically incorporating service price,transmission capacity,and trustworthiness into the satisfaction assessment framework.Furthermore,we propose a Budget-Aware Preference Adjustment Model that predicts users’baseline preference weights from historical data and dynamically adjusts them according to budget levels,thereby reflecting user preferences more realistically under varying budget constraints.In addition,to tackle the composition optimization problem,we develop a ReflectiveEvolutionary Large Language Model—Guided Ant Colony Optimization algorithm,which leverages the reflective evolution capability of large language models to iteratively generate and refine heuristic information that guides the search process.Experimental results demonstrate that the proposed framework effectively integrates personalized preferences with budget sensitivity,accurately predicts users’preferences,and significantly enhances their satisfaction under complex constraints.展开更多
In real industrial microgrids(MGs),the length of the primary delivery feeder to the connection point of the main substation is sometimes long.This reduces the power factor and increases reactive power absorption along...In real industrial microgrids(MGs),the length of the primary delivery feeder to the connection point of the main substation is sometimes long.This reduces the power factor and increases reactive power absorption along the primary delivery feeder from the external network.Besides,the giant induction electro-motors as the working horse of industries requires remarkable amounts of reactive power for electro-mechanical energy conversions.To reduce power losses and operating costs of the MG as well as to improve the voltage quality,this study aims at providing an insightful model for optimal placement and sizing of reactive power compensation capacitors in an industrial MG.In the presented model,the objective function considers voltage profile and network power factor improvement at the MG connection point.Also,it realizes power flow equations within which all operational security constraints are considered.Various reactive power compensation strategies including distributed group compensation,centralized compensation at the main substation,and distributed compensation along the primary delivery feeder are scrutinized.A real industrial MG,say as Urmia Petrochemical plant,is considered in numerical validations.The obtained results in each scenario are discussed in depth.As seen,the best performance is obtained when the optimal location and sizing of capacitors are simultaneously determined at the main buses of the industrial plants,at the main substation of the MG,and alongside the primary delivery feeder.In this way,74.81%improvement in power losses reduction,1.3%lower active power import from the main grid,23.5%improvement in power factor,and 37.5%improvement in network voltage deviation summation are seen in this case compared to the base case.展开更多
Thermal storage electric heating(TSEH),as a prevalent variable load resource,offers significant potential for enhancing system flexibility when aggregated into a cluster.To address the uncertainties of renewable energ...Thermal storage electric heating(TSEH),as a prevalent variable load resource,offers significant potential for enhancing system flexibility when aggregated into a cluster.To address the uncertainties of renewable energy and load forecasting in active distribution networks(ADN),this paper proposes a multi-timescale coordinated optimal dispatch strategy that incorporates TSEH clusters.It utilizes the thermal storage characteristics and short-term regulation capabilities of TSEH,along with the rapid and gradual response characteristics of resources in active distribution grids,to develop a coordinated optimization dispatch mechanism for day-ahead,intraday,and real-time stages.It provides a coordinated optimized dispatch technique across several timescales for active distribution grids,taking into account the integration of TSEH clusters.The proposed method is validated on a modified IEEE 33-node system.Simulation results demonstrate that the participation of TSEH in collaborative optimization significantly reduces the total system operating cost by 8.71%compared to the scenario without TSEH.This cost reduction is attributed to a 10.84%decrease in interaction costs with the main grid and a 47.41%reduction in network loss costs,validating effective peak shaving and valley filling.The multi-timescale framework further enhances economic efficiency,with overall operating costs progressively decreasing by 3.91%(intraday)and 4.59%(real-time),and interaction costs further reduced by 5.34%and 9.25%,respectively.Moreover,the approach enhances system stability by effectively suppressing node voltage fluctuations and ensuring all voltages remain within safe operating limits during real-time operation.Therefore,the proposed approach achieves rational coordination of diverse resources,significantly improving the economic efficiency and stability of ADNs.展开更多
Ensuring reliable power supply in urban distribution networks is a complex and critical task.To address the increased demand during extreme scenarios,this paper proposes an optimal dispatch strategy that considers the...Ensuring reliable power supply in urban distribution networks is a complex and critical task.To address the increased demand during extreme scenarios,this paper proposes an optimal dispatch strategy that considers the coordination with virtual power plants(VPPs).The proposed strategy improves systemflexibility and responsiveness by optimizing the power adjustment of flexible resources.In the proposed strategy,theGaussian Process Regression(GPR)is firstly employed to determine the adjustable range of aggregated power within the VPP,facilitating an assessment of its potential contribution to power supply support.Then,an optimal dispatch model based on a leader-follower game is developed to maximize the benefits of the VPP and flexible resources while guaranteeing the power balance at the same time.To solve the proposed optimal dispatch model efficiently,the constraints of the problem are reformulated and resolved using the Karush-Kuhn-Tucker(KKT)optimality conditions and linear programming duality theorem.The effectiveness of the strategy is illustrated through a detailed case study.展开更多
In the rapidly evolving technological landscape,state-owned enterprises(SOEs)encounter significant challenges in sustaining their competitiveness through efficient R&D management.Integrated Product Development(IPD...In the rapidly evolving technological landscape,state-owned enterprises(SOEs)encounter significant challenges in sustaining their competitiveness through efficient R&D management.Integrated Product Development(IPD),with its emphasis on cross-functional teamwork,concurrent engineering,and data-driven decision-making,has been widely recognized for enhancing R&D efficiency and product quality.However,the unique characteristics of SOEs pose challenges to the effective implementation of IPD.The advancement of big data and artificial intelligence technologies offers new opportunities for optimizing IPD R&D management through data-driven decision-making models.This paper constructs and validates a data-driven decision-making model tailored to the IPD R&D management of SOEs.By integrating data mining,machine learning,and other advanced analytical techniques,the model serves as a scientific and efficient decision-making tool.It aids SOEs in optimizing R&D resource allocation,shortening product development cycles,reducing R&D costs,and improving product quality and innovation.Moreover,this study contributes to a deeper theoretical understanding of the value of data-driven decision-making in the context of IPD.展开更多
In tunnel construction,tunnel boring machine(TBM)tunnelling typically relies on manual experience with sub-optimal control parameters,which can easily lead to inefficiency and high costs.This study proposed an intelli...In tunnel construction,tunnel boring machine(TBM)tunnelling typically relies on manual experience with sub-optimal control parameters,which can easily lead to inefficiency and high costs.This study proposed an intelligent decision-making method for TBM tunnelling control parameters based on multiobjective optimization(MOO).First,the effective TBM operation dataset is obtained through data preprocessing of the Songhua River(YS)tunnel project in China.Next,the proposed method begins with developing machine learning models for predicting TBM tunnelling performance parameters(i.e.total thrust and cutterhead torque),rock mass classification,and hazard risks(i.e.tunnel collapse and shield jamming).Then,considering three optimal objectives,(i.e.,penetration rate,rock-breaking energy consumption,and cutterhead hob wear),the MOO framework and corresponding mathematical expression are established.The Pareto optimal front is solved using DE-NSGA-II algorithm.Finally,the optimal control parameters(i.e.,advance rate and cutterhead rotation speed)are obtained by the satisfactory solution determination criterion,which can balance construction safety and efficiency with satisfaction.Furthermore,the proposed method is validated through 50 cases of TBM tunnelling,showing promising potential of application.展开更多
Gastrointestinal tumors require personalized treatment strategies due to their heterogeneity and complexity.Multimodal artificial intelligence(AI)addresses this challenge by integrating diverse data sources-including ...Gastrointestinal tumors require personalized treatment strategies due to their heterogeneity and complexity.Multimodal artificial intelligence(AI)addresses this challenge by integrating diverse data sources-including computed tomography(CT),magnetic resonance imaging(MRI),endoscopic imaging,and genomic profiles-to enable intelligent decision-making for individualized therapy.This approach leverages AI algorithms to fuse imaging,endoscopic,and omics data,facilitating comprehensive characterization of tumor biology,prediction of treatment response,and optimization of therapeutic strategies.By combining CT and MRI for structural assessment,endoscopic data for real-time visual inspection,and genomic information for molecular profiling,multimodal AI enhances the accuracy of patient stratification and treatment personalization.The clinical implementation of this technology demonstrates potential for improving patient outcomes,advancing precision oncology,and supporting individualized care in gastrointestinal cancers.Ultimately,multimodal AI serves as a transformative tool in oncology,bridging data integration with clinical application to effectively tailor therapies.展开更多
基金supported by the National Natural Science Foundation of China under Grant T2521006,Grant 62403483,Grant 62533021 and Grant U24A20279.
文摘Reinforcement learning(RL)has been widely studied as an efficient class of machine learning methods for adaptive optimal control under uncertainties.In recent years,the applications of RL in optimised decision-making and motion control of intelligent vehicles have received increasing attention.Due to the complex and dynamic operating environments of intelligent vehicles,it is necessary to improve the learning efficiency and generalisation ability of RL-based decision and control algorithms under different conditions.This survey systematically examines the theoretical foundations,algorithmic advancements and practical challenges of applying RL to intelligent vehicle systems operating in complex and dynamic environments.The major algorithm frameworks of RL are first introduced,and the recent advances in RL-based decision-making and control of intelligent vehicles are overviewed.In addition to self-learning decision and control approaches using state measurements,the developments of DRL methods for end-to-end driving control of intelligent vehicles are summarised.The open problems and directions for further research works are also discussed.
基金This work was supported by Project of Philosophy and Social Science Foundation of Shanghai,China(Grant No.2020BGL011).
文摘The randomness and uncertainty of renewable energy generation are expected to significantly change the optimal decision-making of trans-provincial electricity market subjects.Therefore,it is beneficial to optimize the interests of each of these subjects,considering the unpredictable risks of renewable energy under the renewable portfolio standards(RPS)and researching their effects on the optimal decision-making of transprovincial electricity market multi-subjects.First,we develop a trans-provincial trading market mechanism for renewable energy and clarify the electricity supply and demand relation and the green certificates supply and demand relation of trans-provincial electricitymarketmulti-subjects.Then,under the RPS,we construct a multi-subject game model of the power supply chain that recognizes the risks,and adopt the reverse induction method to discuss the optimum risk-taking judgment of each subject in the trans-provincial electricity market.Finally,we useMATLAB to verify the viability and efficacy of the proposed gamemodel,and obtain a certain reference value for the optimal decision-making of trans-provincial electricity market subjects.In summary,we consider the uncertainty risks of renewable energy under RPS,study the effects of the green certificate price and risk aversion coefficient in the RPS mechanism on the optimal decisionmaking of trans-provincial electricity market subjects,and obtain the changing trends of two different power products and those of different electricity market subjects under the influence of the green certificate price and risk aversion coefficient,which have a certain reference value for studying the factors affecting the optimal decision-making of trans-provincial electricity market subjects.
文摘Mining activities may cause serious damages to the river ecological environment in mining areas. It has been realized that challenging is faced for optimal decision-making on the river ecological restoration resulting from system complexity, multi-objectives, long term restoration in which multiple stages may be needed to take, and difficulty in detailed process quan- tification. By analyzing and fully reflecting the differences between the central zone and surrounding zones of the restored river passing through the mining area, the comprehensive evaluation index systems of the central zone and surrounding zones are separately suggested firstly. Then a scenario-based optimization decision-making model for river ecological restoration in min- ing areas was established with taking advantages of spatial divisions and following procedure of first going through optimiza- tion by sub-region level, then optimizing by integration. Then, a framework for scenario-based optimal decision-making on water-deficient river ecological restoration in mining areas is proposed in which a multi-objective and multi-stage spatial division optimization method is considered to improve decision-making efficiency and enhance its practicability. It is indicated that this optimization framework is reasonable and practical, which is expected to offer reliable decision support in identifying the effective solutions on optimal management of the water-deficient river ecological restoration in mining areas. At the same time, it has implications in general land reclamation and ecological restoration in the mining areas.
基金supported by the State Grid Jilin Province Electric Power Co,Ltd-Research and Application of Power Grid Resilience Assessment and Coordinated Emergency Technology of Supply and Network for the Development of New Power System in Alpine Region(Project Number is B32342210001).
文摘Digital twins and the physical assets of electric power systems face the potential risk of data loss and monitoring failures owing to catastrophic events,causing surveillance and energy loss.This study aims to refine maintenance strategies for the monitoring of an electric power digital twin system post disasters.Initially,the research delineates the physical electric power system along with its digital counterpart and post-disaster restoration processes.Subsequently,it delves into communication and data processing mechanisms,specifically focusing on central data processing(CDP),communication routers(CRs),and phasor measurement units(PMUs),to re-establish an equipment recovery model based on these data transmission methodologies.Furthermore,it introduces a mathematical optimization model designed to enhance the digital twin system’s post-disaster monitoring efficacy by employing the branch-and-bound method for its resolution.The efficacy of the proposed model was corroborated by analyzing an IEEE-14 system.The findings suggest that the proposed branch-and-bound algorithm significantly augments the observational capabilities of a power system with limited resources,thereby bolstering its stability and emergency response mechanisms.
基金the National Key Fundamental Research Development Planning Project(Grant No.KZCX1-Y-02)the High-tech Research and Development(863)Programme of the Ministry of Science and Technology(Grant No.2002AA135230)+1 种基金the Projects of the Chinese Academy of Sciences(Grant Nos.KZ951-A1-302,KZ951-A1-203, KJ951-B1-703) the National Natural Science Foundation of China(Grant Nos.49871064 , 69896250).
文摘In the remote sensing survey of the country land, cost and accuracy are a pair of conflicts, for which spatial sampling is a preferable solution with the aim of an optimal balance between economic input and accuracy of results, or in other words, acquirement of higher ac-curacy at less cost. Counter to drawbacks of previous application models, e.g. lack of compre-hensive and quantitative-comparison, the optimal decision-making model of spatial sampling is proposed. This model first acquires the possible accuracy-cost diagrams of multiple schemes through initial spatial exploration, then regresses them and standardizes them into a unified ref-erence frame, and finally produces the relatively optimal sampling scheme by using the discrete decision-making function (built by this paper) and comparing them in combination with the dia-grams. According to the test result in the survey of the arable land using remotely sensed data, the Sandwich model, while applied in the survey of the thin-feature and cultivated land areas with aerial photos, can better realize the goal of the best balance between investment and accuracy. With this case and other cases, it is shown that the optimal decision-making model of spatial sampling is a good choice in the survey of the farm areas using remote sensing, with its distin-guished benefit of higher precision at less cost or vice versa. In order to extensively apply the model in the surveys of natural resources, including arable farm areas, this paper proposes the prototype of development using the component technology, that could considerably improve the analysis efficiency by insetting program components within the software environment of GIS and RS.
文摘Fuzzy similar priority ratio is adopted to select the optimal variety from 6 city flower candidates in a certain city,i.e.Nelumbo nucifera x1,Prunus persica Batsch.var.duplex Rehd.x2,Rosa chinensis Jacq.x3,Dendranthema morifolium x4,Jassminum nudiflorum Lindl.x5 and Prunus mume x6.The results show that the priority sequence of 6 candidates was x1,x6,x5,x3,x4 and x2.
基金Supported in part by Natural Science Foundation of Guangxi(2023GXNSFAA026246)in part by the Central Government's Guide to Local Science and Technology Development Fund(GuikeZY23055044)in part by the National Natural Science Foundation of China(62363003)。
文摘In this paper,we consider the maximal positive definite solution of the nonlinear matrix equation.By using the idea of Algorithm 2.1 in ZHANG(2013),a new inversion-free method with a stepsize parameter is proposed to obtain the maximal positive definite solution of nonlinear matrix equation X+A^(*)X|^(-α)A=Q with the case 0<α≤1.Based on this method,a new iterative algorithm is developed,and its convergence proof is given.Finally,two numerical examples are provided to show the effectiveness of the proposed method.
基金funded by scientific research projects under Grant JY2024B011.
文摘With the increasing complexity of industrial automation,planetary gearboxes play a vital role in largescale equipment transmission systems,directly impacting operational efficiency and safety.Traditional maintenance strategies often struggle to accurately predict the degradation process of equipment,leading to excessive maintenance costs or potential failure risks.However,existing prediction methods based on statistical models are difficult to adapt to nonlinear degradation processes.To address these challenges,this study proposes a novel condition-based maintenance framework for planetary gearboxes.A comprehensive full-lifecycle degradation experiment was conducted to collect raw vibration signals,which were then processed using a temporal convolutional network autoencoder with multi-scale perception capability to extract deep temporal degradation features,enabling the collaborative extraction of longperiod meshing frequencies and short-term impact features from the vibration signals.Kernel principal component analysis was employed to fuse and normalize these features,enhancing the characterization of degradation progression.A nonlinear Wiener process was used to model the degradation trajectory,with a threshold decay function introduced to dynamically adjust maintenance strategies,and model parameters optimized through maximum likelihood estimation.Meanwhile,the maintenance strategy was optimized to minimize costs per unit time,determining the optimal maintenance timing and preventive maintenance threshold.The comprehensive indicator of degradation trends extracted by this method reaches 0.756,which is 41.2%higher than that of traditional time-domain features;the dynamic threshold strategy reduces the maintenance cost per unit time to 55.56,which is 8.9%better than that of the static threshold optimization.Experimental results demonstrate significant reductions in maintenance costs while enhancing system reliability and safety.This study realizes the organic integration of deep learning and reliability theory in the maintenance of planetary gearboxes,provides an interpretable solution for the predictive maintenance of complex mechanical systems,and promotes the development of condition-based maintenance strategies for planetary gearboxes.
基金supported by the 2024 Research Fund of University of Ulsan.
文摘In recent years,three-dimensional reconstruction technologies that employ multiple cameras have continued to evolve significantly,enabling remote collaboration among users in extended Reality(XR)environments.In addition,methods for deploying multiple cameras for motion capture of users(e.g.,performers)are widely used in computer graphics.As the need to minimize and optimize the number of cameras grows to reduce costs,various technologies and research approaches focused on Optimal Camera Placement(OCP)are continually being proposed.However,as most existing studies assume homogeneous camera setups,there is a growing demand for studies on heterogeneous camera setups.For instance,technical demands keep emerging in scenarios with minimal camera configurations,especially regarding cost factors,the physical placement of cameras given the spatial structure,and image capture strategies for heterogeneous cameras,such as high-resolution RGB cameras and depth cameras.In this study,we propose a pre-visualization and simulation method for the optimal placement of heterogeneous cameras in XR environments,accounting for both the specifications of heterogeneous cameras(e.g.,field of view)and the physical configuration(e.g.,wall configuration)in real-world spaces.The proposed method performs a visibility analysis of cameras by considering each camera’s field-of-view volume,resolution,and unique characteristics,along with physicalspace constraints.This approach enables the optimal position and rotation of each camera to be recommended,along with the minimum number of cameras required.In the results of our study conducted in heterogeneous camera combinations,the proposed method achieved 81.7%~82.7%coverage of the target visual information using only 2~3 cameras.In contrast,single(or homogeneous)-typed cameras were required to use 11 cameras for 81.6%coverage.Accordingly,we found that camera deployment resources can be reduced with the proposed approaches.
基金supported by the National Nature Science Foundation of China under Grant No.11902332。
文摘The augmented evolution equation is established under the framework of the Variation Evolving Method(VEM)that seeks optimal solutions by solving the transformed Initial-Value Problems(IVPs).To improve the numerical performance,its compact form is developed herein.Through replacing the states and costates variation evolution with that of the controls,the dimension-reduced Evolution Partial Differential Equation(EPDE)only solves the control variables along the variation time to get the optimal solution,and the initial conditions for the definite solution may be arbitrary.With this equation,the scale of the resulting IVPs,obtained via the semi-discrete method,is significantly reduced and they may be solved with common Ordinary Differential Equation(ODE)integration methods conveniently.Meanwhile,the state and the costate dynamics share consistent stability in the numerical computation and this avoids the intrinsic numerical difficulty as in the indirect methods.Numerical examples are solved and it is shown that the compact form evolution equation outperforms the primary form in the precision,and the efficiency may be higher for the dense discretization.Actually,it is uncovered that the compact form of the augmented evolution equation is a continuous realization of the Newton type iteration mechanism.
基金funded by the Department of Education of Liaoning Province and was supported by the Basic Scientific Research Project of the Department of Education of Liaoning Province(Grant No.LJ222411632051)and(Grant No.LJKQZ2021085)Natural Science Foundation Project of Liaoning Province(Grant No.2022-BS-222).
文摘Virtual power plant(VPP)integrates a variety of distributed renewable energy and energy storage to participate in electricity market transactions,promote the consumption of renewable energy,and improve economic efficiency.In this paper,aiming at the uncertainty of distributed wind power and photovoltaic output,considering the coupling relationship between power,carbon trading,and green cardmarket,the optimal operationmodel and bidding scheme of VPP in spot market,carbon trading market,and green card market are established.On this basis,through the Shapley value and independent risk contribution theory in cooperative game theory,the quantitative analysis of the total income and risk contribution of various distributed resources in the virtual power plant is realized.Moreover,the scheduling strategies of virtual power plants under different risk preferences are systematically compared,and the feasibility and accuracy of the combination of Shapley value and independent risk contribution theory in ensuring fair income distribution and reasonable risk assessment are emphasized.A comprehensive solution for virtual power plants in the multi-market environment is constructed,which integrates operation strategy,income distribution mechanism,and risk control system into a unified analysis framework.Through the simulation of multi-scenario examples,the CPLEXsolver inMATLAB software is used to optimize themodel.The proposed joint optimization scheme can increase the profit of VPP participating in carbon trading and green certificate market by 29%.The total revenue of distributed resources managed by VPP is 9%higher than that of individual participation.
基金supported by the National Natural Science Foundation of China(No.52571367)and the Commissions Project of China(No.CBG4N21).
文摘The concept of hybrid ships has gained significant attention in recent years,as they offer an effective means of enhancing energy utilization and reducing environmental pollution.However,the navigational environments of ships are often subject to changes,which in turn affect their energy efficiency in a complex manner.It is therefore evident that enhancing the energy efficiency of hybrid ships is a worthwhile goal.In this study,we take a diesel-electric hybrid ship navigating in inland waterways as the research object,and propose a hierarchical optimization method for ship energy efficiency.The upper-layer control establishes a predictive model for propulsion motor speed and fuel consumption through multivariate time series predictions,and employs the model predictive control(MPC)method to optimize the propulsion motor speed.The lower-layer control utilizes an equivalent fuel consumption minimization method,which is based on improving the equivalence factor.This involves combining the variation of the supercapacitor’s state of charge(SOC)with the propulsion motor speed obtained from the MPC optimization in the upper-layer control.Furthermore,a proportional integral(PI)controller is used to adjust the equivalence factor,in order to adapt the equivalent fuel consumption minimization method to the working conditions.Our results demonstrate that the proposed hierarchical optimization method can reduce the energy efficiency operating indicator(EEOI)by approximately 11.54%and the fuel consumption by approximately 9.47%in comparison to the pre-optimization scenario.
基金supported in part by the National Science and Technology Council under Grant NSTC 114-2221-E-027-104.
文摘Trajectory tracking for nonlinear robotic systems remains a fundamental yet challenging problem in control engineering,particularly when both precision and efficiency must be ensured.Conventional control methods are often effective for stabilization but may not directly optimize long-term performance.To address this limitation,this study develops an integrated framework that combines optimal control principles with reinforcement learning for a single-link robotic manipulator.The proposed scheme adopts an actor–critic structure,where the critic network approximates the value function associated with the Hamilton–Jacobi–Bellman equation,and the actor network generates near-optimal control signals in real time.This dual adaptation enables the controller to refine its policy online without explicit system knowledge.Stability of the closed-loop system is analyzed through Lyapunov theory,ensuring boundedness of the tracking error.Numerical simulations on the single-link manipulator demonstrate that themethod achieves accurate trajectory followingwhile maintaining lowcontrol effort.The results further showthat the actor–critic learning mechanism accelerates convergence of the control policy compared with conventional optimization-based strategies.This work highlights the potential of reinforcement learning integrated with optimal control for robotic manipulators and provides a foundation for future extensions to more complex multi-degree-of-freedom systems.The proposed controller is further validated in a physics-based virtual Gazebo environment,demonstrating stable adaptation and real-time feasibility.
基金supported by the National Natural Science Foundation of China under Grant 62472264the Natural Science Distinguished Youth Foundation of Shandong Province under Grant ZR2025QA13。
文摘In the wireless energy transmission service composition optimization problem,a key challenge is accurately capturing users’preferences for service criteria under complex influencing factors,and optimally selecting a composition solution under their budget constraints.Existing studies typically evaluate satisfaction solely based on energy transmission capacity,while overlooking critical factors such as price and trustworthiness of the provider,leading to a mismatch between optimization outcomes and user needs.To address this gap,we construct a user satisfaction evaluation model for multi-user and multi-provider scenarios,systematically incorporating service price,transmission capacity,and trustworthiness into the satisfaction assessment framework.Furthermore,we propose a Budget-Aware Preference Adjustment Model that predicts users’baseline preference weights from historical data and dynamically adjusts them according to budget levels,thereby reflecting user preferences more realistically under varying budget constraints.In addition,to tackle the composition optimization problem,we develop a ReflectiveEvolutionary Large Language Model—Guided Ant Colony Optimization algorithm,which leverages the reflective evolution capability of large language models to iteratively generate and refine heuristic information that guides the search process.Experimental results demonstrate that the proposed framework effectively integrates personalized preferences with budget sensitivity,accurately predicts users’preferences,and significantly enhances their satisfaction under complex constraints.
文摘In real industrial microgrids(MGs),the length of the primary delivery feeder to the connection point of the main substation is sometimes long.This reduces the power factor and increases reactive power absorption along the primary delivery feeder from the external network.Besides,the giant induction electro-motors as the working horse of industries requires remarkable amounts of reactive power for electro-mechanical energy conversions.To reduce power losses and operating costs of the MG as well as to improve the voltage quality,this study aims at providing an insightful model for optimal placement and sizing of reactive power compensation capacitors in an industrial MG.In the presented model,the objective function considers voltage profile and network power factor improvement at the MG connection point.Also,it realizes power flow equations within which all operational security constraints are considered.Various reactive power compensation strategies including distributed group compensation,centralized compensation at the main substation,and distributed compensation along the primary delivery feeder are scrutinized.A real industrial MG,say as Urmia Petrochemical plant,is considered in numerical validations.The obtained results in each scenario are discussed in depth.As seen,the best performance is obtained when the optimal location and sizing of capacitors are simultaneously determined at the main buses of the industrial plants,at the main substation of the MG,and alongside the primary delivery feeder.In this way,74.81%improvement in power losses reduction,1.3%lower active power import from the main grid,23.5%improvement in power factor,and 37.5%improvement in network voltage deviation summation are seen in this case compared to the base case.
基金supported by Integrated Distribution Network Planning and Operational Enhancement Using Flexibility Domains Under Deep Human-Vehicle-Charger-Road-Grid Coupling(U22B20105).
文摘Thermal storage electric heating(TSEH),as a prevalent variable load resource,offers significant potential for enhancing system flexibility when aggregated into a cluster.To address the uncertainties of renewable energy and load forecasting in active distribution networks(ADN),this paper proposes a multi-timescale coordinated optimal dispatch strategy that incorporates TSEH clusters.It utilizes the thermal storage characteristics and short-term regulation capabilities of TSEH,along with the rapid and gradual response characteristics of resources in active distribution grids,to develop a coordinated optimization dispatch mechanism for day-ahead,intraday,and real-time stages.It provides a coordinated optimized dispatch technique across several timescales for active distribution grids,taking into account the integration of TSEH clusters.The proposed method is validated on a modified IEEE 33-node system.Simulation results demonstrate that the participation of TSEH in collaborative optimization significantly reduces the total system operating cost by 8.71%compared to the scenario without TSEH.This cost reduction is attributed to a 10.84%decrease in interaction costs with the main grid and a 47.41%reduction in network loss costs,validating effective peak shaving and valley filling.The multi-timescale framework further enhances economic efficiency,with overall operating costs progressively decreasing by 3.91%(intraday)and 4.59%(real-time),and interaction costs further reduced by 5.34%and 9.25%,respectively.Moreover,the approach enhances system stability by effectively suppressing node voltage fluctuations and ensuring all voltages remain within safe operating limits during real-time operation.Therefore,the proposed approach achieves rational coordination of diverse resources,significantly improving the economic efficiency and stability of ADNs.
基金supported by the Science and Technology Project of Sichuan Electric Power Company“Power Supply Guarantee Strategy for Urban Distribution Networks Considering Coordination with Virtual Power Plant during Extreme Weather Event”(No.521920230003).
文摘Ensuring reliable power supply in urban distribution networks is a complex and critical task.To address the increased demand during extreme scenarios,this paper proposes an optimal dispatch strategy that considers the coordination with virtual power plants(VPPs).The proposed strategy improves systemflexibility and responsiveness by optimizing the power adjustment of flexible resources.In the proposed strategy,theGaussian Process Regression(GPR)is firstly employed to determine the adjustable range of aggregated power within the VPP,facilitating an assessment of its potential contribution to power supply support.Then,an optimal dispatch model based on a leader-follower game is developed to maximize the benefits of the VPP and flexible resources while guaranteeing the power balance at the same time.To solve the proposed optimal dispatch model efficiently,the constraints of the problem are reformulated and resolved using the Karush-Kuhn-Tucker(KKT)optimality conditions and linear programming duality theorem.The effectiveness of the strategy is illustrated through a detailed case study.
文摘In the rapidly evolving technological landscape,state-owned enterprises(SOEs)encounter significant challenges in sustaining their competitiveness through efficient R&D management.Integrated Product Development(IPD),with its emphasis on cross-functional teamwork,concurrent engineering,and data-driven decision-making,has been widely recognized for enhancing R&D efficiency and product quality.However,the unique characteristics of SOEs pose challenges to the effective implementation of IPD.The advancement of big data and artificial intelligence technologies offers new opportunities for optimizing IPD R&D management through data-driven decision-making models.This paper constructs and validates a data-driven decision-making model tailored to the IPD R&D management of SOEs.By integrating data mining,machine learning,and other advanced analytical techniques,the model serves as a scientific and efficient decision-making tool.It aids SOEs in optimizing R&D resource allocation,shortening product development cycles,reducing R&D costs,and improving product quality and innovation.Moreover,this study contributes to a deeper theoretical understanding of the value of data-driven decision-making in the context of IPD.
基金supported by the National Natural Science Foundation of China(Grant No.52179105)China Postdoctoral Science Foundation(Grant No.2024M762193)。
文摘In tunnel construction,tunnel boring machine(TBM)tunnelling typically relies on manual experience with sub-optimal control parameters,which can easily lead to inefficiency and high costs.This study proposed an intelligent decision-making method for TBM tunnelling control parameters based on multiobjective optimization(MOO).First,the effective TBM operation dataset is obtained through data preprocessing of the Songhua River(YS)tunnel project in China.Next,the proposed method begins with developing machine learning models for predicting TBM tunnelling performance parameters(i.e.total thrust and cutterhead torque),rock mass classification,and hazard risks(i.e.tunnel collapse and shield jamming).Then,considering three optimal objectives,(i.e.,penetration rate,rock-breaking energy consumption,and cutterhead hob wear),the MOO framework and corresponding mathematical expression are established.The Pareto optimal front is solved using DE-NSGA-II algorithm.Finally,the optimal control parameters(i.e.,advance rate and cutterhead rotation speed)are obtained by the satisfactory solution determination criterion,which can balance construction safety and efficiency with satisfaction.Furthermore,the proposed method is validated through 50 cases of TBM tunnelling,showing promising potential of application.
基金Supported by Xuhui District Health Commission,No.SHXH202214.
文摘Gastrointestinal tumors require personalized treatment strategies due to their heterogeneity and complexity.Multimodal artificial intelligence(AI)addresses this challenge by integrating diverse data sources-including computed tomography(CT),magnetic resonance imaging(MRI),endoscopic imaging,and genomic profiles-to enable intelligent decision-making for individualized therapy.This approach leverages AI algorithms to fuse imaging,endoscopic,and omics data,facilitating comprehensive characterization of tumor biology,prediction of treatment response,and optimization of therapeutic strategies.By combining CT and MRI for structural assessment,endoscopic data for real-time visual inspection,and genomic information for molecular profiling,multimodal AI enhances the accuracy of patient stratification and treatment personalization.The clinical implementation of this technology demonstrates potential for improving patient outcomes,advancing precision oncology,and supporting individualized care in gastrointestinal cancers.Ultimately,multimodal AI serves as a transformative tool in oncology,bridging data integration with clinical application to effectively tailor therapies.
