As the types of traffic requests increase,the elastic optical network(EON)is considered as a promising architecture to carry multiple types of traffic requests simultaneously,including immediate reservation(IR)and adv...As the types of traffic requests increase,the elastic optical network(EON)is considered as a promising architecture to carry multiple types of traffic requests simultaneously,including immediate reservation(IR)and advance reservation(AR).Various resource allocation schemes for IR/AR requests have been designed in EON to reduce bandwidth blocking probability(BBP).However,these schemes do not consider different transmission requirements of IR requests and cannot maintain a low BBP for high-priority requests.In this paper,multi-priority is considered in the hybrid IR/AR request scenario.We modify the asynchronous advantage actor critic(A3C)model and propose an A3C-assisted priority resource allocation(APRA)algorithm.The APRA integrates priority and transmission quality of IR requests to design the A3C reward function,then dynamically allocates dedicated resources for different IR requests according to the time-varying requirements.By maximizing the reward,the transmission quality of IR requests can be matched with the priority,and lower BBP for high-priority IR requests can be ensured.Simulation results show that the APRA reduces the BBP of high-priority IR requests from 0.0341 to0.0138,and the overall network operation gain is improved by 883 compared to the scheme without considering the priority.展开更多
Efficient resource management within Internet of Things(IoT)environments remains a pressing challenge due to the increasing number of devices and their diverse functionalities.This study introduces a neural network-ba...Efficient resource management within Internet of Things(IoT)environments remains a pressing challenge due to the increasing number of devices and their diverse functionalities.This study introduces a neural network-based model that uses Long-Short-Term Memory(LSTM)to optimize resource allocation under dynam-ically changing conditions.Designed to monitor the workload on individual IoT nodes,the model incorporates long-term data dependencies,enabling adaptive resource distribution in real time.The training process utilizes Min-Max normalization and grid search for hyperparameter tuning,ensuring high resource utilization and consistent performance.The simulation results demonstrate the effectiveness of the proposed method,outperforming the state-of-the-art approaches,including Dynamic and Efficient Enhanced Load-Balancing(DEELB),Optimized Scheduling and Collaborative Active Resource-management(OSCAR),Convolutional Neural Network with Monarch Butterfly Optimization(CNN-MBO),and Autonomic Workload Prediction and Resource Allocation for Fog(AWPR-FOG).For example,in scenarios with low system utilization,the model achieved a resource utilization efficiency of 95%while maintaining a latency of just 15 ms,significantly exceeding the performance of comparative methods.展开更多
In the current trend of educational digitization,online learning platforms have proliferated,making the visual design of digital learning resources increasingly critical.However,existing visual designs for online lear...In the current trend of educational digitization,online learning platforms have proliferated,making the visual design of digital learning resources increasingly critical.However,existing visual designs for online learning resources face numerous challenges.The emergence of AIGC(Artificial Intelligence-Generated Content)technology offers innovative solutions to these issues.This paper explores the application of AIGC technology in enhancing the“new quality productive forces”of visual design for online learning resources.It emphasizes the need to balance technological innovation with humanistic care and highlights the importance of human intervention in the design process.展开更多
Vehicular Edge Computing(VEC)enhances the quality of user services by deploying wealth of resources near vehicles.However,due to highly dynamic and complex nature of vehicular networks,centralized decisionmaking for r...Vehicular Edge Computing(VEC)enhances the quality of user services by deploying wealth of resources near vehicles.However,due to highly dynamic and complex nature of vehicular networks,centralized decisionmaking for resource allocation proves inadequate within VECs.Conversely,allocating resources via distributed decision-making consumes vehicular resources.To improve the quality of user service,we formulate a problem of latency minimization,further subdividing this problem into two subproblems to be solved through distributed decision-making.To mitigate the resource consumption caused by distributed decision-making,we propose Reinforcement Learning(RL)algorithm based on sequential alternating multi-agent system mechanism,which effectively reduces the dimensionality of action space without losing the informational content of action,achieving network lightweighting.We discuss the rationality,generalizability,and inherent advantages of proposed mechanism.Simulation results indicate that our proposed mechanism outperforms traditional RL algorithms in terms of stability,generalizability,and adaptability to scenarios with invalid actions,all while achieving network lightweighting.展开更多
This paper introduces a quantum-enhanced edge computing framework that synergizes quantuminspired algorithms with advanced machine learning techniques to optimize real-time task offloading in edge computing environmen...This paper introduces a quantum-enhanced edge computing framework that synergizes quantuminspired algorithms with advanced machine learning techniques to optimize real-time task offloading in edge computing environments.This innovative approach not only significantly improves the system’s real-time responsiveness and resource utilization efficiency but also addresses critical challenges in Internet of Things(IoT)ecosystems—such as high demand variability,resource allocation uncertainties,and data privacy concerns—through practical solutions.Initially,the framework employs an adaptive adjustment mechanism to dynamically manage task and resource states,complemented by online learning models for precise predictive analytics.Secondly,it accelerates the search for optimal solutions using Grover’s algorithm while efficiently evaluating complex constraints through multi-controlled Toffoli gates,thereby markedly enhancing the practicality and robustness of the proposed solution.Furthermore,to bolster the system’s adaptability and response speed in dynamic environments,an efficientmonitoring mechanism and event-driven architecture are incorporated,ensuring timely responses to environmental changes and maintaining synchronization between internal and external systems.Experimental evaluations confirm that the proposed algorithm demonstrates superior performance in complex application scenarios,characterized by faster convergence,enhanced stability,and superior data privacy protection,alongside notable reductions in latency and optimized resource utilization.This research paves the way for transformative advancements in edge computing and IoT technologies,driving smart edge computing towards unprecedented levels of intelligence and automation.展开更多
In Heterogeneous Vehicle-to-Everything Networks(HVNs),multiple users such as vehicles and handheld devices and infrastructure can communicate with each other to obtain more advanced services.However,the increasing num...In Heterogeneous Vehicle-to-Everything Networks(HVNs),multiple users such as vehicles and handheld devices and infrastructure can communicate with each other to obtain more advanced services.However,the increasing number of entities accessing HVNs presents a huge technical challenge to allocate the limited wireless resources.Traditional model-driven resource allocation approaches are no longer applicable because of rich data and the interference problem of multiple communication modes reusing resources in HVNs.In this paper,we investigate a wireless resource allocation scheme including power control and spectrum allocation based on the resource block reuse strategy.To meet the high capacity of cellular users and the high reliability of Vehicle-to-Vehicle(V2V)user pairs,we propose a data-driven Multi-Agent Deep Reinforcement Learning(MADRL)resource allocation scheme for the HVN.Simulation results demonstrate that compared to existing algorithms,the proposed MADRL-based scheme achieves a high sum capacity and probability of successful V2V transmission,while providing close-to-limit performance.展开更多
The rapid development of the Internet of Vehicles(IoVs)underscores the importance of Vehicle-to-Everything(V2X)communication for ensuring driving safety.V2X supports control systems by providing reliable and real-time...The rapid development of the Internet of Vehicles(IoVs)underscores the importance of Vehicle-to-Everything(V2X)communication for ensuring driving safety.V2X supports control systems by providing reliable and real-time information,while the control system's decisions,in turn,affect the communication topology and channel state.Depending on the coupling between communication and control,radio resource allocation(RRA)should be controlaware.However,current RRA methods often focus on optimizing communication metrics,neglecting the needs of the control system.To promote the co-design of communication and control,this paper proposes a novel RRA method that integrates both communication and control considerations.From the communication perspective,the Age of Information(AoI)is introduced to measure the freshness of packets.From the control perspective,a weighted utility function based on Time-to-Collision(TTC)and driving distance is designed,emphasizing the neighboring importance and potentially dangerous vehicles.By synthesizing these two metrics,an optimization objective minimizing weighted AoI based on TTC and driving distance is formulated.The RRA process is modeled as a partially observable Markov decision process,and a multi-agent reinforcement learning algorithm incorporating positional encoding and attention mechanisms(PAMARL)is proposed.Simulation results show that PAMARL can reduce Collision Risk(CR)with better Packet Delivery Ratio(PDR)than others.展开更多
Sixth-generation(6G)communication system promises unprecedented data density and transformative applications over different industries.However,managing heterogeneous data with different distributions in 6G-enabled mul...Sixth-generation(6G)communication system promises unprecedented data density and transformative applications over different industries.However,managing heterogeneous data with different distributions in 6G-enabled multi-access edge cloud networks presents challenges for efficient Machine Learning(ML)training and aggregation,often leading to increased energy consumption and reduced model generalization.To solve this problem,this research proposes a Weighted Proximal Policy-based Federated Learning approach integrated with Res Net50 and Scaled Exponential Linear Unit activation function(WPPFL-RS).The proposed method optimizes resource allocation such as CPU and memory,through enhancing the Cyber-twin technology to estimate the computing capacities of edge clouds.The proposed WPPFL-RS approach significantly minimizes the latency and energy consumption,solving complex challenges in 6G-enabled edge computing.This makes sure that efficient resource utilization and enhanced performance in heterogeneous edge networks.The proposed WPPFL-RS achieves a minimum latency of 8.20 s on 100 tasks,a significant improvement over the baseline Deep Reinforcement Learning(DRL),which recorded 11.39 s.This approach highlights its potential to enhance resource utilization and performance in 6G edge networks.展开更多
Although 6G networks combined with artificial intelligence present revolutionary prospects for healthcare delivery,resource management in dense medical device networks stays a basic issue.Reliable communication direct...Although 6G networks combined with artificial intelligence present revolutionary prospects for healthcare delivery,resource management in dense medical device networks stays a basic issue.Reliable communication directly affects patient outcomes in these settings;nonetheless,current resource allocation techniques struggle with complicated interference patterns and different service needs of AI-native healthcare systems.In dense installations where conventional approaches fail,this paper tackles the challenge of combining network efficiency with medical care priority.Thus,we offer a Dueling Deep Q-Network(DDQN)-based resource allocation approach for AI-native healthcare systems in 6G dense networks.First,we create a point-line graph coloringbased interference model to capture the unique characteristics of medical device communications.Building on this foundation,we suggest a DDQN approach to optimal resource allocation over multiple medical services by combining advantage estimate with healthcare-aware state evaluation.Unlike traditional graph-based models,this one correctly depicts the overlapping coverage areas common in hospital environments.Building on this basis,our DDQN design allows the system to prioritize medical needs while distributing resources by separating healthcare state assessment from advantage estimation.Experimental findings show that the suggested DDQN outperforms state-of-the-art techniques in dense healthcare installations by 14.6%greater network throughput and 13.7%better resource use.The solution shows particularly strong in maintaining service quality under vital conditions with 5.5%greater Qo S satisfaction for emergency services and 8.2%quicker recovery from interruptions.展开更多
Intelligent Transportation Systems(ITS)leverage Integrated Sensing and Communications(ISAC)to enhance data exchange between vehicles and infrastructure in the Internet of Vehicles(IoV).This integration inevitably incr...Intelligent Transportation Systems(ITS)leverage Integrated Sensing and Communications(ISAC)to enhance data exchange between vehicles and infrastructure in the Internet of Vehicles(IoV).This integration inevitably increases computing demands,risking real-time system stability.Vehicle Edge Computing(VEC)addresses this by offloading tasks to Road Side Units(RSUs),ensuring timely services.Our previous work,the FLSimCo algorithm,which uses local resources for federated Self-Supervised Learning(SSL),has a limitation:vehicles often can’t complete all iteration tasks.Our improved algorithm offloads partial tasks to RSUs and optimizes energy consumption by adjusting transmission power,CPU frequency,and task assignment ratios,balancing local and RSU-based training.Meanwhile,setting an offloading threshold further prevents inefficiencies.Simulation results show that the enhanced algorithm reduces energy consumption and improves offloading efficiency and accuracy of federated SSL.展开更多
In the future smart cities,unmanned aerial vehicles(UAVs)or electric vertical take-off and landing aircraft(e VTOL)are widely employed for urban air mobility(UAM).Considering such real-world scenarios,a deep reinforce...In the future smart cities,unmanned aerial vehicles(UAVs)or electric vertical take-off and landing aircraft(e VTOL)are widely employed for urban air mobility(UAM).Considering such real-world scenarios,a deep reinforcement learning based communication resource allocation method is proposed for UAVs to provide communication services for e VTOL swarms to ensure their reliable communication and safe operation.To save energy consumption,UAVs can ride on a moving interaction station(MIS),such as an urban bus.By using UAV trajectory control and communication power allocation,a joint fair optimization problem is formulated to maximize the channel capacity while optimizing radar sensing performance.To address the optimization problem,a Point Cloud based deep Q-network(PCDQN)algorithm is proposed.It contains a point neural network that can determine the action space of the UAV directly originating from the threedimensional(3D)radar point clouds,and a deep reinforcement learning based decision model for deciding the action from action spaces.Simulation results demonstrate that the proposed method exhibits competitive performance compared to the benchmarks.展开更多
An ontology and metadata for online learning resource repository management is constructed. First, based on the analysis of the use-case diagram, the upper ontology is illustrated which includes resource library ontol...An ontology and metadata for online learning resource repository management is constructed. First, based on the analysis of the use-case diagram, the upper ontology is illustrated which includes resource library ontology and user ontology, and evaluated from its function and implementation; then the corresponding class diagram, resource description framework （RDF） schema and extensible markup language （XML） schema are given. Secondly, the metadata for online learning resource repository management is proposed based on the Dublin Core Metadata Initiative and the IEEE Learning Technologies Standards Committee Learning Object Metadata Working Group. Finally, the inference instance is shown, which proves the validity of ontology and metadata in online learning resource repository management.展开更多
The new curriculum standard points out that affection is one of the most important goals of fundamental education. The non-target language environment is easier to cause the affective change of middle school students ...The new curriculum standard points out that affection is one of the most important goals of fundamental education. The non-target language environment is easier to cause the affective change of middle school students who are changeable in their affective state. Based on the affective filter hypothesis, this paper deals with the adjustment to affective factors in English learning by using Internet English Curriculum Resource, such as attitude and motivation, anxiety and inhibition, self-esteem and self-confidence. At last, some suggestions are offered to judge Internet English Curriculum Resource.展开更多
Nowadays,advances in communication technology and cloud computing have spawned a variety of smart mobile devices,which will generate a great amount of computing-intensive businesses,and require corresponding resources...Nowadays,advances in communication technology and cloud computing have spawned a variety of smart mobile devices,which will generate a great amount of computing-intensive businesses,and require corresponding resources of computation and communication.Multiaccess edge computing(MEC)can offload computing-intensive tasks to the nearby edge servers,which alleviates the pressure of devices.Ultra-dense network(UDN)can provide effective spectrum resources by deploying a large number of micro base stations.Furthermore,network slicing can support various applications in different communication scenarios.Therefore,this paper integrates the ultra-dense network slicing and the MEC technology,and introduces a hybrid computing offloading strategy in order to satisfy various quality of service(QoS)of edge devices.In order to dynamically allocate limited resources,the above problem is formulated as multiagent distributed deep reinforcement learning(DRL),which will achieve low overhead computation offloading strategy and real-time resource allocation decisions.In this context,federated learning is added to train DRL agents in a distributed manner,where each agent is dedicated to exploring actions composed of offloading decisions and allocating resources,so as to jointly optimize system delay and energy consumption.Simulation results show that the proposed learning algorithm has better performance compared with other strategies in literature.展开更多
The purpose of this paper is to argue the effectiveness of self-regulated learning in English education in Chinese college classroom instruction. A study is given to show whether the introduction of self-regulated lea...The purpose of this paper is to argue the effectiveness of self-regulated learning in English education in Chinese college classroom instruction. A study is given to show whether the introduction of self-regulated learning can help improve Chinese college students' English learning, and help them perform better in the National English test-CET-4 (College English Test Level-4,).展开更多
The integration of Artificial Intelligence(AI)and Machine Learning(ML)into groundwater exploration and water resources management has emerged as a transformative approach to addressing global water challenges.This rev...The integration of Artificial Intelligence(AI)and Machine Learning(ML)into groundwater exploration and water resources management has emerged as a transformative approach to addressing global water challenges.This review explores key AI and ML concepts,methodologies,and their applications in hydrology,focusing on groundwater potential mapping,water quality prediction,and groundwater level forecasting.It discusses various data acquisition techniques,including remote sensing,geospatial analysis,and geophysical surveys,alongside preprocessing methods that are essential for enhancing model accuracy.The study highlights AI-driven solutions in water distribution,allocation optimization,and realtime resource management.Despite their advantages,the application of AI and ML in water sciences faces several challenges,including data scarcity,model reliability,and the integration of these tools with traditional water management systems.Ethical and regulatory concerns also demand careful consideration.The paper also outlines future research directions,emphasizing the need for improved data collection,interpretable models,real-time monitoring capabilities,and interdisciplinary collaboration.By leveraging AI and ML advancements,the water sector can enhance decision-making,optimize resource distribution,and support the development of sustainable water management strategies.展开更多
This study investigated the role of intentional self-regulation and the moderating role of peer relationship in the relationship between teacher-student relationship and learning engagement.The study sample comprised ...This study investigated the role of intentional self-regulation and the moderating role of peer relationship in the relationship between teacher-student relationship and learning engagement.The study sample comprised 540 Chinese senior secondary school students between the ages of 15–18(51.67%boys;Mage=16.56 years;SDage=0.90).They completed surveys on the Teacher-Student Relationship Scale,the Selection,Optimization,and Compensation(SOC)Scale,the Peer Relationship Scale for Children and Adolescents,and the Learning Engagement Scale.The results following regression analysis showed that teacher-student relationship predicted higher learning engagement among senior secondary school students.Intentional self-regulation partially mediated the link between teacher-student relationship and learning engagement for higher learning engagement.Peer relationship moderated the relationships between teacher-student relationship and learning engagement and moderated the relationship between teacher-student relationship and intentional self-regulation for higher learning engagement.Thesefindings imply learning engagement can be enhanced by optimizing teacher-student relationship and strengthening intentional self-regulation interventions.展开更多
Through integrating advanced communication and data processing technologies into smart vehicles and roadside infrastructures,the Intelligent Transportation System(ITS)has evolved as a promising paradigm for improving ...Through integrating advanced communication and data processing technologies into smart vehicles and roadside infrastructures,the Intelligent Transportation System(ITS)has evolved as a promising paradigm for improving safety,efficiency of the transportation system.However,the strict delay requirement of the safety-related applications is still a great challenge for the ITS,especially in dense traffic environment.In this paper,we introduce the metric called Perception-Reaction Time(PRT),which reflects the time consumption of safety-related applications and is closely related to road efficiency and security.With the integration of the incorporating information-centric networking technology and the fog virtualization approach,we propose a novel fog resource scheduling mechanism to minimize the PRT.Furthermore,we adopt a deep reinforcement learning approach to design an on-line optimal resource allocation scheme.Numerical results demonstrate that our proposed schemes is able to reduce about 70%of the RPT compared with the traditional approach.展开更多
Resource allocation in auctions is a challenging problem for cloud computing.However,the resource allocation problem is NP-hard and cannot be solved in polynomial time.The existing studies mainly use approximate algor...Resource allocation in auctions is a challenging problem for cloud computing.However,the resource allocation problem is NP-hard and cannot be solved in polynomial time.The existing studies mainly use approximate algorithms such as PTAS or heuristic algorithms to determine a feasible solution;however,these algorithms have the disadvantages of low computational efficiency or low allocate accuracy.In this paper,we use the classification of machine learning to model and analyze the multi-dimensional cloud resource allocation problem and propose two resource allocation prediction algorithms based on linear and logistic regressions.By learning a small-scale training set,the prediction model can guarantee that the social welfare,allocation accuracy,and resource utilization in the feasible solution are very close to those of the optimal allocation solution.The experimental results show that the proposed scheme has good effect on resource allocation in cloud computing.展开更多
Resource allocation is an important problem influencing the service quality of multi-beam satellite communications.In multi-beam satellite communications, the available frequency bandwidth is limited, users requiremen...Resource allocation is an important problem influencing the service quality of multi-beam satellite communications.In multi-beam satellite communications, the available frequency bandwidth is limited, users requirements vary rapidly, high service quality and joint allocation of multi-dimensional resources such as time and frequency are required. It is a difficult problem needs to be researched urgently for multi-beam satellite communications, how to obtain a higher comprehensive utilization rate of multidimensional resources, maximize the number of users and system throughput, and meet the demand of rapid allocation adapting dynamic changed the number of users under the condition of limited resources, with using an efficient and fast resource allocation algorithm.In order to solve the multi-dimensional resource allocation problem of multi-beam satellite communications, this paper establishes a multi-objective optimization model based on the maximum the number of users and system throughput joint optimization goal, and proposes a multi-objective deep reinforcement learning based time-frequency two-dimensional resource allocation(MODRL-TF) algorithm to adapt dynamic changed the number of users and the timeliness requirements. Simulation results show that the proposed algorithm could provide higher comprehensive utilization rate of multi-dimensional resources,and could achieve multi-objective joint optimization,and could obtain better timeliness than traditional heuristic algorithms, such as genetic algorithm(GA)and ant colony optimization algorithm(ACO).展开更多
文摘As the types of traffic requests increase,the elastic optical network(EON)is considered as a promising architecture to carry multiple types of traffic requests simultaneously,including immediate reservation(IR)and advance reservation(AR).Various resource allocation schemes for IR/AR requests have been designed in EON to reduce bandwidth blocking probability(BBP).However,these schemes do not consider different transmission requirements of IR requests and cannot maintain a low BBP for high-priority requests.In this paper,multi-priority is considered in the hybrid IR/AR request scenario.We modify the asynchronous advantage actor critic(A3C)model and propose an A3C-assisted priority resource allocation(APRA)algorithm.The APRA integrates priority and transmission quality of IR requests to design the A3C reward function,then dynamically allocates dedicated resources for different IR requests according to the time-varying requirements.By maximizing the reward,the transmission quality of IR requests can be matched with the priority,and lower BBP for high-priority IR requests can be ensured.Simulation results show that the APRA reduces the BBP of high-priority IR requests from 0.0341 to0.0138,and the overall network operation gain is improved by 883 compared to the scheme without considering the priority.
基金funding of the Deanship of Graduate Studies and Scientific Research,Jazan University,Saudi Arabia,through Project Number:ISP-2024.
文摘Efficient resource management within Internet of Things(IoT)environments remains a pressing challenge due to the increasing number of devices and their diverse functionalities.This study introduces a neural network-based model that uses Long-Short-Term Memory(LSTM)to optimize resource allocation under dynam-ically changing conditions.Designed to monitor the workload on individual IoT nodes,the model incorporates long-term data dependencies,enabling adaptive resource distribution in real time.The training process utilizes Min-Max normalization and grid search for hyperparameter tuning,ensuring high resource utilization and consistent performance.The simulation results demonstrate the effectiveness of the proposed method,outperforming the state-of-the-art approaches,including Dynamic and Efficient Enhanced Load-Balancing(DEELB),Optimized Scheduling and Collaborative Active Resource-management(OSCAR),Convolutional Neural Network with Monarch Butterfly Optimization(CNN-MBO),and Autonomic Workload Prediction and Resource Allocation for Fog(AWPR-FOG).For example,in scenarios with low system utilization,the model achieved a resource utilization efficiency of 95%while maintaining a latency of just 15 ms,significantly exceeding the performance of comparative methods.
文摘In the current trend of educational digitization,online learning platforms have proliferated,making the visual design of digital learning resources increasingly critical.However,existing visual designs for online learning resources face numerous challenges.The emergence of AIGC(Artificial Intelligence-Generated Content)technology offers innovative solutions to these issues.This paper explores the application of AIGC technology in enhancing the“new quality productive forces”of visual design for online learning resources.It emphasizes the need to balance technological innovation with humanistic care and highlights the importance of human intervention in the design process.
基金supported by the National Natural Science Foundation of China(62271096,U20A20157)Science and Technology Research Program of Chongqing Municipal Education Commission(KJQN202000626)+4 种基金Natural Science Foundation of Chongqing,China(cstc2020jcyjzdxmX0024)University Innovation Research Group of Chongqing(CXQT20017)Youth Innovation Group Support Program of ICE Discipline of CQUPT(SCIE-QN-2022-04)Chongqing Postdoctoral Science Special Foundation(2021XM3058)Chongqing Postgraduate Research and Innovation Project under grant(CYB22250).
文摘Vehicular Edge Computing(VEC)enhances the quality of user services by deploying wealth of resources near vehicles.However,due to highly dynamic and complex nature of vehicular networks,centralized decisionmaking for resource allocation proves inadequate within VECs.Conversely,allocating resources via distributed decision-making consumes vehicular resources.To improve the quality of user service,we formulate a problem of latency minimization,further subdividing this problem into two subproblems to be solved through distributed decision-making.To mitigate the resource consumption caused by distributed decision-making,we propose Reinforcement Learning(RL)algorithm based on sequential alternating multi-agent system mechanism,which effectively reduces the dimensionality of action space without losing the informational content of action,achieving network lightweighting.We discuss the rationality,generalizability,and inherent advantages of proposed mechanism.Simulation results indicate that our proposed mechanism outperforms traditional RL algorithms in terms of stability,generalizability,and adaptability to scenarios with invalid actions,all while achieving network lightweighting.
基金supported by National Natural Science Foundation of China(Nos.62071481 and 61501471).
文摘This paper introduces a quantum-enhanced edge computing framework that synergizes quantuminspired algorithms with advanced machine learning techniques to optimize real-time task offloading in edge computing environments.This innovative approach not only significantly improves the system’s real-time responsiveness and resource utilization efficiency but also addresses critical challenges in Internet of Things(IoT)ecosystems—such as high demand variability,resource allocation uncertainties,and data privacy concerns—through practical solutions.Initially,the framework employs an adaptive adjustment mechanism to dynamically manage task and resource states,complemented by online learning models for precise predictive analytics.Secondly,it accelerates the search for optimal solutions using Grover’s algorithm while efficiently evaluating complex constraints through multi-controlled Toffoli gates,thereby markedly enhancing the practicality and robustness of the proposed solution.Furthermore,to bolster the system’s adaptability and response speed in dynamic environments,an efficientmonitoring mechanism and event-driven architecture are incorporated,ensuring timely responses to environmental changes and maintaining synchronization between internal and external systems.Experimental evaluations confirm that the proposed algorithm demonstrates superior performance in complex application scenarios,characterized by faster convergence,enhanced stability,and superior data privacy protection,alongside notable reductions in latency and optimized resource utilization.This research paves the way for transformative advancements in edge computing and IoT technologies,driving smart edge computing towards unprecedented levels of intelligence and automation.
基金funded in part by the National Key Research and Development of China Project (2020YFB1807204)in part by National Natural Science Foundation of China (U2001213 and 61971191)+1 种基金in part by the Beijing Natural Science Foundation under Grant L201011in part by the key project of Natural Science Foundation of Jiangxi Province (20202ACBL202006)。
文摘In Heterogeneous Vehicle-to-Everything Networks(HVNs),multiple users such as vehicles and handheld devices and infrastructure can communicate with each other to obtain more advanced services.However,the increasing number of entities accessing HVNs presents a huge technical challenge to allocate the limited wireless resources.Traditional model-driven resource allocation approaches are no longer applicable because of rich data and the interference problem of multiple communication modes reusing resources in HVNs.In this paper,we investigate a wireless resource allocation scheme including power control and spectrum allocation based on the resource block reuse strategy.To meet the high capacity of cellular users and the high reliability of Vehicle-to-Vehicle(V2V)user pairs,we propose a data-driven Multi-Agent Deep Reinforcement Learning(MADRL)resource allocation scheme for the HVN.Simulation results demonstrate that compared to existing algorithms,the proposed MADRL-based scheme achieves a high sum capacity and probability of successful V2V transmission,while providing close-to-limit performance.
基金supported by Beijing Natural Science Foundation under Grant L202018the National Natural Science Foundation of China under Grant 61931005+1 种基金the Key Laboratory of Internet of Vehicle Technical Innovation and Testing(CAICT),Ministry of Industry and Information Technology under Grant No.KL-2023-001the High-performance Computing Platform of BUPT。
文摘The rapid development of the Internet of Vehicles(IoVs)underscores the importance of Vehicle-to-Everything(V2X)communication for ensuring driving safety.V2X supports control systems by providing reliable and real-time information,while the control system's decisions,in turn,affect the communication topology and channel state.Depending on the coupling between communication and control,radio resource allocation(RRA)should be controlaware.However,current RRA methods often focus on optimizing communication metrics,neglecting the needs of the control system.To promote the co-design of communication and control,this paper proposes a novel RRA method that integrates both communication and control considerations.From the communication perspective,the Age of Information(AoI)is introduced to measure the freshness of packets.From the control perspective,a weighted utility function based on Time-to-Collision(TTC)and driving distance is designed,emphasizing the neighboring importance and potentially dangerous vehicles.By synthesizing these two metrics,an optimization objective minimizing weighted AoI based on TTC and driving distance is formulated.The RRA process is modeled as a partially observable Markov decision process,and a multi-agent reinforcement learning algorithm incorporating positional encoding and attention mechanisms(PAMARL)is proposed.Simulation results show that PAMARL can reduce Collision Risk(CR)with better Packet Delivery Ratio(PDR)than others.
文摘Sixth-generation(6G)communication system promises unprecedented data density and transformative applications over different industries.However,managing heterogeneous data with different distributions in 6G-enabled multi-access edge cloud networks presents challenges for efficient Machine Learning(ML)training and aggregation,often leading to increased energy consumption and reduced model generalization.To solve this problem,this research proposes a Weighted Proximal Policy-based Federated Learning approach integrated with Res Net50 and Scaled Exponential Linear Unit activation function(WPPFL-RS).The proposed method optimizes resource allocation such as CPU and memory,through enhancing the Cyber-twin technology to estimate the computing capacities of edge clouds.The proposed WPPFL-RS approach significantly minimizes the latency and energy consumption,solving complex challenges in 6G-enabled edge computing.This makes sure that efficient resource utilization and enhanced performance in heterogeneous edge networks.The proposed WPPFL-RS achieves a minimum latency of 8.20 s on 100 tasks,a significant improvement over the baseline Deep Reinforcement Learning(DRL),which recorded 11.39 s.This approach highlights its potential to enhance resource utilization and performance in 6G edge networks.
基金supported by National Natural Science Foundation of China under Granted No.62202247。
文摘Although 6G networks combined with artificial intelligence present revolutionary prospects for healthcare delivery,resource management in dense medical device networks stays a basic issue.Reliable communication directly affects patient outcomes in these settings;nonetheless,current resource allocation techniques struggle with complicated interference patterns and different service needs of AI-native healthcare systems.In dense installations where conventional approaches fail,this paper tackles the challenge of combining network efficiency with medical care priority.Thus,we offer a Dueling Deep Q-Network(DDQN)-based resource allocation approach for AI-native healthcare systems in 6G dense networks.First,we create a point-line graph coloringbased interference model to capture the unique characteristics of medical device communications.Building on this foundation,we suggest a DDQN approach to optimal resource allocation over multiple medical services by combining advantage estimate with healthcare-aware state evaluation.Unlike traditional graph-based models,this one correctly depicts the overlapping coverage areas common in hospital environments.Building on this basis,our DDQN design allows the system to prioritize medical needs while distributing resources by separating healthcare state assessment from advantage estimation.Experimental findings show that the suggested DDQN outperforms state-of-the-art techniques in dense healthcare installations by 14.6%greater network throughput and 13.7%better resource use.The solution shows particularly strong in maintaining service quality under vital conditions with 5.5%greater Qo S satisfaction for emergency services and 8.2%quicker recovery from interruptions.
文摘Intelligent Transportation Systems(ITS)leverage Integrated Sensing and Communications(ISAC)to enhance data exchange between vehicles and infrastructure in the Internet of Vehicles(IoV).This integration inevitably increases computing demands,risking real-time system stability.Vehicle Edge Computing(VEC)addresses this by offloading tasks to Road Side Units(RSUs),ensuring timely services.Our previous work,the FLSimCo algorithm,which uses local resources for federated Self-Supervised Learning(SSL),has a limitation:vehicles often can’t complete all iteration tasks.Our improved algorithm offloads partial tasks to RSUs and optimizes energy consumption by adjusting transmission power,CPU frequency,and task assignment ratios,balancing local and RSU-based training.Meanwhile,setting an offloading threshold further prevents inefficiencies.Simulation results show that the enhanced algorithm reduces energy consumption and improves offloading efficiency and accuracy of federated SSL.
基金supported in part by the National Natural Science Foundation of China(No.62401032)in part by the Postdoctoral Fellowship Program of China Postdoctoral Science Foundation(CPSF)(No.GZC20242161)in part by the Open Project Program of State Key Laboratory of CNS/ATM,China(No.2024A03)。
文摘In the future smart cities,unmanned aerial vehicles(UAVs)or electric vertical take-off and landing aircraft(e VTOL)are widely employed for urban air mobility(UAM).Considering such real-world scenarios,a deep reinforcement learning based communication resource allocation method is proposed for UAVs to provide communication services for e VTOL swarms to ensure their reliable communication and safe operation.To save energy consumption,UAVs can ride on a moving interaction station(MIS),such as an urban bus.By using UAV trajectory control and communication power allocation,a joint fair optimization problem is formulated to maximize the channel capacity while optimizing radar sensing performance.To address the optimization problem,a Point Cloud based deep Q-network(PCDQN)algorithm is proposed.It contains a point neural network that can determine the action space of the UAV directly originating from the threedimensional(3D)radar point clouds,and a deep reinforcement learning based decision model for deciding the action from action spaces.Simulation results demonstrate that the proposed method exhibits competitive performance compared to the benchmarks.
基金The Advanced University Action Plan of the Minis-try of Education of China (2004XD-03).
文摘An ontology and metadata for online learning resource repository management is constructed. First, based on the analysis of the use-case diagram, the upper ontology is illustrated which includes resource library ontology and user ontology, and evaluated from its function and implementation; then the corresponding class diagram, resource description framework （RDF） schema and extensible markup language （XML） schema are given. Secondly, the metadata for online learning resource repository management is proposed based on the Dublin Core Metadata Initiative and the IEEE Learning Technologies Standards Committee Learning Object Metadata Working Group. Finally, the inference instance is shown, which proves the validity of ontology and metadata in online learning resource repository management.
文摘The new curriculum standard points out that affection is one of the most important goals of fundamental education. The non-target language environment is easier to cause the affective change of middle school students who are changeable in their affective state. Based on the affective filter hypothesis, this paper deals with the adjustment to affective factors in English learning by using Internet English Curriculum Resource, such as attitude and motivation, anxiety and inhibition, self-esteem and self-confidence. At last, some suggestions are offered to judge Internet English Curriculum Resource.
文摘Nowadays,advances in communication technology and cloud computing have spawned a variety of smart mobile devices,which will generate a great amount of computing-intensive businesses,and require corresponding resources of computation and communication.Multiaccess edge computing(MEC)can offload computing-intensive tasks to the nearby edge servers,which alleviates the pressure of devices.Ultra-dense network(UDN)can provide effective spectrum resources by deploying a large number of micro base stations.Furthermore,network slicing can support various applications in different communication scenarios.Therefore,this paper integrates the ultra-dense network slicing and the MEC technology,and introduces a hybrid computing offloading strategy in order to satisfy various quality of service(QoS)of edge devices.In order to dynamically allocate limited resources,the above problem is formulated as multiagent distributed deep reinforcement learning(DRL),which will achieve low overhead computation offloading strategy and real-time resource allocation decisions.In this context,federated learning is added to train DRL agents in a distributed manner,where each agent is dedicated to exploring actions composed of offloading decisions and allocating resources,so as to jointly optimize system delay and energy consumption.Simulation results show that the proposed learning algorithm has better performance compared with other strategies in literature.
文摘The purpose of this paper is to argue the effectiveness of self-regulated learning in English education in Chinese college classroom instruction. A study is given to show whether the introduction of self-regulated learning can help improve Chinese college students' English learning, and help them perform better in the National English test-CET-4 (College English Test Level-4,).
文摘The integration of Artificial Intelligence(AI)and Machine Learning(ML)into groundwater exploration and water resources management has emerged as a transformative approach to addressing global water challenges.This review explores key AI and ML concepts,methodologies,and their applications in hydrology,focusing on groundwater potential mapping,water quality prediction,and groundwater level forecasting.It discusses various data acquisition techniques,including remote sensing,geospatial analysis,and geophysical surveys,alongside preprocessing methods that are essential for enhancing model accuracy.The study highlights AI-driven solutions in water distribution,allocation optimization,and realtime resource management.Despite their advantages,the application of AI and ML in water sciences faces several challenges,including data scarcity,model reliability,and the integration of these tools with traditional water management systems.Ethical and regulatory concerns also demand careful consideration.The paper also outlines future research directions,emphasizing the need for improved data collection,interpretable models,real-time monitoring capabilities,and interdisciplinary collaboration.By leveraging AI and ML advancements,the water sector can enhance decision-making,optimize resource distribution,and support the development of sustainable water management strategies.
文摘This study investigated the role of intentional self-regulation and the moderating role of peer relationship in the relationship between teacher-student relationship and learning engagement.The study sample comprised 540 Chinese senior secondary school students between the ages of 15–18(51.67%boys;Mage=16.56 years;SDage=0.90).They completed surveys on the Teacher-Student Relationship Scale,the Selection,Optimization,and Compensation(SOC)Scale,the Peer Relationship Scale for Children and Adolescents,and the Learning Engagement Scale.The results following regression analysis showed that teacher-student relationship predicted higher learning engagement among senior secondary school students.Intentional self-regulation partially mediated the link between teacher-student relationship and learning engagement for higher learning engagement.Peer relationship moderated the relationships between teacher-student relationship and learning engagement and moderated the relationship between teacher-student relationship and intentional self-regulation for higher learning engagement.Thesefindings imply learning engagement can be enhanced by optimizing teacher-student relationship and strengthening intentional self-regulation interventions.
基金supported by National Key R&D Program of China(No.2018YFE010267)the Science and Technology Program of Sichuan Province,China(No.2019YFH0007)+2 种基金the National Natural Science Foundation of China(No.61601083)the Xi’an Key Laboratory of Mobile Edge Computing and Security(No.201805052-ZD-3CG36)the EU H2020 Project COSAFE(MSCA-RISE-2018-824019)
文摘Through integrating advanced communication and data processing technologies into smart vehicles and roadside infrastructures,the Intelligent Transportation System(ITS)has evolved as a promising paradigm for improving safety,efficiency of the transportation system.However,the strict delay requirement of the safety-related applications is still a great challenge for the ITS,especially in dense traffic environment.In this paper,we introduce the metric called Perception-Reaction Time(PRT),which reflects the time consumption of safety-related applications and is closely related to road efficiency and security.With the integration of the incorporating information-centric networking technology and the fog virtualization approach,we propose a novel fog resource scheduling mechanism to minimize the PRT.Furthermore,we adopt a deep reinforcement learning approach to design an on-line optimal resource allocation scheme.Numerical results demonstrate that our proposed schemes is able to reduce about 70%of the RPT compared with the traditional approach.
基金This research is supported by the National Natural Science Foundation of China(No.61472345,61762091 and 11663007)the Scientific Research Foundation of the Yunnan Provincial Department of Education(No.2017ZZX228)IRTSTYN,and Program for Excellent Young Talents,Yunnan University.
文摘Resource allocation in auctions is a challenging problem for cloud computing.However,the resource allocation problem is NP-hard and cannot be solved in polynomial time.The existing studies mainly use approximate algorithms such as PTAS or heuristic algorithms to determine a feasible solution;however,these algorithms have the disadvantages of low computational efficiency or low allocate accuracy.In this paper,we use the classification of machine learning to model and analyze the multi-dimensional cloud resource allocation problem and propose two resource allocation prediction algorithms based on linear and logistic regressions.By learning a small-scale training set,the prediction model can guarantee that the social welfare,allocation accuracy,and resource utilization in the feasible solution are very close to those of the optimal allocation solution.The experimental results show that the proposed scheme has good effect on resource allocation in cloud computing.
基金supported by the National Key Research and Development Program of China under No. 2019YFB1803200。
文摘Resource allocation is an important problem influencing the service quality of multi-beam satellite communications.In multi-beam satellite communications, the available frequency bandwidth is limited, users requirements vary rapidly, high service quality and joint allocation of multi-dimensional resources such as time and frequency are required. It is a difficult problem needs to be researched urgently for multi-beam satellite communications, how to obtain a higher comprehensive utilization rate of multidimensional resources, maximize the number of users and system throughput, and meet the demand of rapid allocation adapting dynamic changed the number of users under the condition of limited resources, with using an efficient and fast resource allocation algorithm.In order to solve the multi-dimensional resource allocation problem of multi-beam satellite communications, this paper establishes a multi-objective optimization model based on the maximum the number of users and system throughput joint optimization goal, and proposes a multi-objective deep reinforcement learning based time-frequency two-dimensional resource allocation(MODRL-TF) algorithm to adapt dynamic changed the number of users and the timeliness requirements. Simulation results show that the proposed algorithm could provide higher comprehensive utilization rate of multi-dimensional resources,and could achieve multi-objective joint optimization,and could obtain better timeliness than traditional heuristic algorithms, such as genetic algorithm(GA)and ant colony optimization algorithm(ACO).
