The load profile is a key characteristic of the power grid and lies at the basis for the power flow control and generation scheduling.However,due to the wide adoption of internet-of-things(IoT)-based metering infrastr...The load profile is a key characteristic of the power grid and lies at the basis for the power flow control and generation scheduling.However,due to the wide adoption of internet-of-things(IoT)-based metering infrastructure,the cyber vulnerability of load meters has attracted the adversary’s great attention.In this paper,we investigate the vulnerability of manipulating the nodal prices by injecting false load data into the meter measurements.By taking advantage of the changing properties of real-world load profile,we propose a deeply hidden load data attack(i.e.,DH-LDA)that can evade bad data detection,clustering-based detection,and price anomaly detection.The main contributions of this work are as follows:(i)We design a stealthy attack framework that exploits historical load patterns to generate load data with minimal statistical deviation from normalmeasurements,thereby maximizing concealment;(ii)We identify the optimal time window for data injection to ensure that the altered nodal prices follow natural fluctuations,enhancing the undetectability of the attack in real-time market operations;(iii)We develop a resilience evaluation metric and formulate an optimization-based approach to quantify the electricity market’s robustness against DH-LDAs.Our experiments show that the adversary can gain profits from the electricity market while remaining undetected.展开更多
Accurately filling in missing heating data is essential for ensuring data quality in applications such as energy management optimization and building efficiency analysis.Traditional machine learning methods use histor...Accurately filling in missing heating data is essential for ensuring data quality in applications such as energy management optimization and building efficiency analysis.Traditional machine learning methods use historical heating data as an input feature to predict the following missing data.However,when the duration of missing data is long,previous estimated values are inevitably used for further imputation,leading to error accumulation and a growing deviation from true values.To overcome this problem,this paper proposes a generative network that can fill missing data solely based on weather and temporal data,without using previous imputed values for further imputation.Our method outperformed the state of the art such as Seq2seq and Transformer,achieving relative normalized root mean square error(NRMSE)reductions of 1.65%to 41.38%,0.30%to 66.43%,and 14.84%to 50.22%across three different data sources.In addition,with our proposed method,the effect of selecting different weather variables on model performance,and the benefits of transfer learning under limited data were also demonstrated.The relative NRMSE reduction is between 3.88%to 15.85%in cold months and from 7.49%to 12.29%in warm months when applying transfer learning.展开更多
Providing highly efficient underwater transmission of mass multimedia data is challenging due to the particularities of the underwater environment. Although there are many schemes proposed to optimize the underwater a...Providing highly efficient underwater transmission of mass multimedia data is challenging due to the particularities of the underwater environment. Although there are many schemes proposed to optimize the underwater acoustic network communication protocols, from physical layer, data link layer, network layer to transport layer, the existing routing protocols for underwater wireless sensor network(UWSN) still cannot well deal with the problems in transmitting multimedia data because of the difficulties involved in high energy consumption, low transmission reliability or high transmission delay. It prevents us from applying underwater multimedia data to real-time monitoring of marine environment in practical application, especially in emergency search, rescue operation and military field. Therefore, the inefficient transmission of marine multimedia data has become a serious problem that needs to be solved urgently. In this paper, A Layered Load Balance Routing Protocol(L2-LBMT) is proposed for underwater multimedia data transmission. In L2-LBMT, we use layered and load-balance Ad Hoc Network to transmit data, and adopt segmented data reliable transfer(SDRT) protocol to improve the data transport reliability. And a 3-node variant of tornado(3-VT) code is also combined with the Ad Hoc Network to transmit little emergency data more quickly. The simulation results show that the proposed protocol can balance energy consumption of each node, effectively prolong the network lifetime and reduce transmission delay of marine multimedia data.展开更多
A new method of establishing rolling load distribution model was developed by online intelligent information-processing technology for plate rolling. The model combines knowledge model and mathematical model with usin...A new method of establishing rolling load distribution model was developed by online intelligent information-processing technology for plate rolling. The model combines knowledge model and mathematical model with using knowledge discovery in database （KDD） and data mining （DM） as the start. The online maintenance and optimization of the load model are realized. The effectiveness of this new method was testified by offline simulation and online application.展开更多
With the development of drone technology and oblique photogrammetry technology, the acquisition of oblique photogrammetry models and basemap becomes more and more convenient and quickly. The increase in the number of ...With the development of drone technology and oblique photogrammetry technology, the acquisition of oblique photogrammetry models and basemap becomes more and more convenient and quickly. The increase in the number of basemap leads to excessively redundant basemap tiles requests in 3D GIS when loading oblique photogrammetry models, which slows down the system. Aiming at improving the speed of running system, this paper proposes a dynamic strategy for loading basemap tiles. Different from existing 3D GIS which loading oblique photogrammetry models and basemap tiles inde-pendently, this strategy dynamically loads basemap tiles depending on different height of view and the range of loaded oblique photogrammetry models. We achieve dynamic loading of basemap tiles by predetermining whether the basemap tiles will be covered by the oblique photogrammetry models. The experimental results show that this strategy can greatly reduce the num-ber of redundant requests from the client to the server while ensuring the user’s visual requirements for the oblique photogrammetric model.展开更多
The backup requirement of data centres is tremendous as the size of data created by human is massive and is increasing exponentially.Single node deduplication cannot meet the increasing backup requirement of data cent...The backup requirement of data centres is tremendous as the size of data created by human is massive and is increasing exponentially.Single node deduplication cannot meet the increasing backup requirement of data centres.A feasible way is the deduplication cluster,which can meet it by adding storage nodes.The data routing strategy is the key of the deduplication cluster.DRSS（data routing strategy using semantics） improves the storage utilization of MCS（minimum chunk signature） data routing strategy a lot.However,for the large deduplication cluster,the load balance of DRSS is worse than MCS.To improve the load balance of DRSS,we propose a load balance strategy used for DRSS,namely DRSSLB.When a node is overloaded,DRSSLB iteratively migrates the current smallest container of the node to the smallest node in the deduplication cluster until this overloaded node becomes non-overloaded.A container is the minimum unit of data migration.Similar files sharing the same features or file names are stored in the same container.This ensures the similar data groups are still in the same node after rebalancing the nodes.We use the dataset from the real world to evaluate DRSSLB.Experimental results show that,for various numbers of nodes of the deduplication cluster,the data skews of DRSSLB are under predefined value while the storage utilizations of DRSSLB do not nearly increase compared with DRSS,with the low penalty（the data migration rate is only6.5% when the number of nodes is 64）.展开更多
With the continuous expansion of the data center network scale, changing network requirements, and increasing pressure on network bandwidth, the traditional network architecture can no longer meet people’s needs. The...With the continuous expansion of the data center network scale, changing network requirements, and increasing pressure on network bandwidth, the traditional network architecture can no longer meet people’s needs. The development of software defined networks has brought new opportunities and challenges to future networks. The data and control separation characteristics of SDN improve the performance of the entire network. Researchers have integrated SDN architecture into data centers to improve network resource utilization and performance. This paper first introduces the basic concepts of SDN and data center networks. Then it discusses SDN-based load balancing mechanisms for data centers from different perspectives. Finally, it summarizes and looks forward to the study on SDN-based load balancing mechanisms and its development trend.展开更多
In a data center network （DCN）, load balancing is required when servers transfer data on the same path. This is necessary to avoid congestion. Load balancing is challenged by the dynamic transferral of demands and c...In a data center network （DCN）, load balancing is required when servers transfer data on the same path. This is necessary to avoid congestion. Load balancing is challenged by the dynamic transferral of demands and complex routing control. Because of the distributed nature of a traditional network, previous research on load balancing has mostly focused on improving the performance of the local network; thus, the load has not been optimally balanced across the entire network. In this paper, we propose a novel dynamic load-balancing algorithm for fat-tree. This algorithm avoids congestions to the great possible extent by searching for non-conflicting paths in a centralized way. We implement the algorithm in the popular software-defined networking architecture and evaluate the algorithm＇ s performance on the Mininet platform. The results show that our algorithm has higher bisection band- width than the traditional equal-cost multi-path load-balancing algorithm and thus more effectively avoids congestion.展开更多
In data stream management systems (DSMSs), how to maintain the quality of queries is a difficult problem because both the processing cost and data arrival rates are highly unpredictable. When the system is overloaded,...In data stream management systems (DSMSs), how to maintain the quality of queries is a difficult problem because both the processing cost and data arrival rates are highly unpredictable. When the system is overloaded, quality degrades significantly and thus load shedding becomes necessary. Unlike processing overloading in the general way which is only by a feedback control (FB) loop to obtain a good and stable performance over data streams, a feedback plus feed-forward control (FFC) strategy is introduced in DSMSs, which have a good quality of service (QoS) in the aspects of miss ratio and processing delay. In this paper, a quality adaptation framework is proposed, in which the control-theory-based techniques are leveraged to adjust the application behavior with the considerations of the current system status. Compared to previous solutions, the FFC strategy achieves a good quality with a waste of fewer resources.展开更多
新型电力系统建设背景下,新能源渗透率不断提高造成电力系统灵活性需求剧增。针对电力系统灵活性供需失衡问题,提出含碳捕集电厂的源荷储资源数据驱动鲁棒优化调度模型。首先,基于碳捕集电厂、抽水蓄能等源荷储灵活性资源运行特性,刻画...新型电力系统建设背景下,新能源渗透率不断提高造成电力系统灵活性需求剧增。针对电力系统灵活性供需失衡问题,提出含碳捕集电厂的源荷储资源数据驱动鲁棒优化调度模型。首先,基于碳捕集电厂、抽水蓄能等源荷储灵活性资源运行特性,刻画电力系统灵活性供给能力;其次,采用数据驱动方法构建椭球不确定性集以刻画风电、光伏波动区间,根据各时刻边界值量化灵活性需求;进而,结合灵活性供需关系,提出源荷储资源数据驱动鲁棒优化模型,并采用改进列与约束生成算法(column and constraint generation,C&CG)进行求解。算例仿真表明,通过协同调度源荷储灵活性资源有助于支撑电力系统功率平衡,提高灵活性裕度,数据驱动鲁棒优化方法能够剔除传统盒式不确定集中的不实际恶劣场景,进而改善传统鲁棒优化模型过于保守的问题,并显著提升计算效率。展开更多
In a home energy management system(HEMS),appliances are becoming diversified and intelligent,so that certain simple maintenance work can be completed by appliances themselves.During the measurement,collection and tran...In a home energy management system(HEMS),appliances are becoming diversified and intelligent,so that certain simple maintenance work can be completed by appliances themselves.During the measurement,collection and transmission of electricity load data in a HEMS sensor network,however,problems can be caused on the data due to faulty sensing processes and/or lost links,etc.In order to ensure the quality of retrieved load data,different solutions have been presented,but suffered from low recognition rates and high complexity.In this paper,a validation and repair method is presented to detect potential failures and errors in a domestic energy management system,which can then recover determined load errors and losses.A Kernel Extreme Learning Machine(K-ELM)based model has been employed with a Radial Basis Function(RBF)and optimised parameters for verification and recognition;whilst a Dual-spline method is presented to repair missing load data.According to the experiment results,the method outperforms the traditional B-spline and Cubic-spline methods and can effectively deal with unexpected data losses and errors under variant loss rates in a practical home environment.展开更多
基金supported by the project Major Scientific and Technological Special Project of Guizhou Province([2024]014).
文摘The load profile is a key characteristic of the power grid and lies at the basis for the power flow control and generation scheduling.However,due to the wide adoption of internet-of-things(IoT)-based metering infrastructure,the cyber vulnerability of load meters has attracted the adversary’s great attention.In this paper,we investigate the vulnerability of manipulating the nodal prices by injecting false load data into the meter measurements.By taking advantage of the changing properties of real-world load profile,we propose a deeply hidden load data attack(i.e.,DH-LDA)that can evade bad data detection,clustering-based detection,and price anomaly detection.The main contributions of this work are as follows:(i)We design a stealthy attack framework that exploits historical load patterns to generate load data with minimal statistical deviation from normalmeasurements,thereby maximizing concealment;(ii)We identify the optimal time window for data injection to ensure that the altered nodal prices follow natural fluctuations,enhancing the undetectability of the attack in real-time market operations;(iii)We develop a resilience evaluation metric and formulate an optimization-based approach to quantify the electricity market’s robustness against DH-LDAs.Our experiments show that the adversary can gain profits from the electricity market while remaining undetected.
文摘Accurately filling in missing heating data is essential for ensuring data quality in applications such as energy management optimization and building efficiency analysis.Traditional machine learning methods use historical heating data as an input feature to predict the following missing data.However,when the duration of missing data is long,previous estimated values are inevitably used for further imputation,leading to error accumulation and a growing deviation from true values.To overcome this problem,this paper proposes a generative network that can fill missing data solely based on weather and temporal data,without using previous imputed values for further imputation.Our method outperformed the state of the art such as Seq2seq and Transformer,achieving relative normalized root mean square error(NRMSE)reductions of 1.65%to 41.38%,0.30%to 66.43%,and 14.84%to 50.22%across three different data sources.In addition,with our proposed method,the effect of selecting different weather variables on model performance,and the benefits of transfer learning under limited data were also demonstrated.The relative NRMSE reduction is between 3.88%to 15.85%in cold months and from 7.49%to 12.29%in warm months when applying transfer learning.
基金supported by the National Natural Science Foundation of China (No.61401413)the Digital Home Industry Cluster Oriented Technology Service Innovation Pilot Project in 2015
文摘Providing highly efficient underwater transmission of mass multimedia data is challenging due to the particularities of the underwater environment. Although there are many schemes proposed to optimize the underwater acoustic network communication protocols, from physical layer, data link layer, network layer to transport layer, the existing routing protocols for underwater wireless sensor network(UWSN) still cannot well deal with the problems in transmitting multimedia data because of the difficulties involved in high energy consumption, low transmission reliability or high transmission delay. It prevents us from applying underwater multimedia data to real-time monitoring of marine environment in practical application, especially in emergency search, rescue operation and military field. Therefore, the inefficient transmission of marine multimedia data has become a serious problem that needs to be solved urgently. In this paper, A Layered Load Balance Routing Protocol(L2-LBMT) is proposed for underwater multimedia data transmission. In L2-LBMT, we use layered and load-balance Ad Hoc Network to transmit data, and adopt segmented data reliable transfer(SDRT) protocol to improve the data transport reliability. And a 3-node variant of tornado(3-VT) code is also combined with the Ad Hoc Network to transmit little emergency data more quickly. The simulation results show that the proposed protocol can balance energy consumption of each node, effectively prolong the network lifetime and reduce transmission delay of marine multimedia data.
文摘A new method of establishing rolling load distribution model was developed by online intelligent information-processing technology for plate rolling. The model combines knowledge model and mathematical model with using knowledge discovery in database （KDD） and data mining （DM） as the start. The online maintenance and optimization of the load model are realized. The effectiveness of this new method was testified by offline simulation and online application.
文摘With the development of drone technology and oblique photogrammetry technology, the acquisition of oblique photogrammetry models and basemap becomes more and more convenient and quickly. The increase in the number of basemap leads to excessively redundant basemap tiles requests in 3D GIS when loading oblique photogrammetry models, which slows down the system. Aiming at improving the speed of running system, this paper proposes a dynamic strategy for loading basemap tiles. Different from existing 3D GIS which loading oblique photogrammetry models and basemap tiles inde-pendently, this strategy dynamically loads basemap tiles depending on different height of view and the range of loaded oblique photogrammetry models. We achieve dynamic loading of basemap tiles by predetermining whether the basemap tiles will be covered by the oblique photogrammetry models. The experimental results show that this strategy can greatly reduce the num-ber of redundant requests from the client to the server while ensuring the user’s visual requirements for the oblique photogrammetric model.
基金supported by the National Natural Science Foundation of China under Grant No.61373120the Aeronautical Science Foundation of China under Grant No.2014ZD53049
文摘The backup requirement of data centres is tremendous as the size of data created by human is massive and is increasing exponentially.Single node deduplication cannot meet the increasing backup requirement of data centres.A feasible way is the deduplication cluster,which can meet it by adding storage nodes.The data routing strategy is the key of the deduplication cluster.DRSS（data routing strategy using semantics） improves the storage utilization of MCS（minimum chunk signature） data routing strategy a lot.However,for the large deduplication cluster,the load balance of DRSS is worse than MCS.To improve the load balance of DRSS,we propose a load balance strategy used for DRSS,namely DRSSLB.When a node is overloaded,DRSSLB iteratively migrates the current smallest container of the node to the smallest node in the deduplication cluster until this overloaded node becomes non-overloaded.A container is the minimum unit of data migration.Similar files sharing the same features or file names are stored in the same container.This ensures the similar data groups are still in the same node after rebalancing the nodes.We use the dataset from the real world to evaluate DRSSLB.Experimental results show that,for various numbers of nodes of the deduplication cluster,the data skews of DRSSLB are under predefined value while the storage utilizations of DRSSLB do not nearly increase compared with DRSS,with the low penalty（the data migration rate is only6.5% when the number of nodes is 64）.
文摘With the continuous expansion of the data center network scale, changing network requirements, and increasing pressure on network bandwidth, the traditional network architecture can no longer meet people’s needs. The development of software defined networks has brought new opportunities and challenges to future networks. The data and control separation characteristics of SDN improve the performance of the entire network. Researchers have integrated SDN architecture into data centers to improve network resource utilization and performance. This paper first introduces the basic concepts of SDN and data center networks. Then it discusses SDN-based load balancing mechanisms for data centers from different perspectives. Finally, it summarizes and looks forward to the study on SDN-based load balancing mechanisms and its development trend.
基金supported by the National Basic Research Program of China(973 Program)(2012CB315903)the Key Science and Technology Innovation Team Project of Zhejiang Province(2011R50010-05)+3 种基金the National Science and Technology Support Program(2014BAH24F01)863 Program of China(2012AA01A507)the National Natural Science Foundation of China(61379118 and 61103200)sponsored by the Research Fund of ZTE Corporation
文摘In a data center network （DCN）, load balancing is required when servers transfer data on the same path. This is necessary to avoid congestion. Load balancing is challenged by the dynamic transferral of demands and complex routing control. Because of the distributed nature of a traditional network, previous research on load balancing has mostly focused on improving the performance of the local network; thus, the load has not been optimally balanced across the entire network. In this paper, we propose a novel dynamic load-balancing algorithm for fat-tree. This algorithm avoids congestions to the great possible extent by searching for non-conflicting paths in a centralized way. We implement the algorithm in the popular software-defined networking architecture and evaluate the algorithm＇ s performance on the Mininet platform. The results show that our algorithm has higher bisection band- width than the traditional equal-cost multi-path load-balancing algorithm and thus more effectively avoids congestion.
基金Supported by the National Key R&D Program of China(2016YFC1401900)the National Science Foundation of China(61173029,61672144)
文摘In data stream management systems (DSMSs), how to maintain the quality of queries is a difficult problem because both the processing cost and data arrival rates are highly unpredictable. When the system is overloaded, quality degrades significantly and thus load shedding becomes necessary. Unlike processing overloading in the general way which is only by a feedback control (FB) loop to obtain a good and stable performance over data streams, a feedback plus feed-forward control (FFC) strategy is introduced in DSMSs, which have a good quality of service (QoS) in the aspects of miss ratio and processing delay. In this paper, a quality adaptation framework is proposed, in which the control-theory-based techniques are leveraged to adjust the application behavior with the considerations of the current system status. Compared to previous solutions, the FFC strategy achieves a good quality with a waste of fewer resources.
文摘新型电力系统建设背景下,新能源渗透率不断提高造成电力系统灵活性需求剧增。针对电力系统灵活性供需失衡问题,提出含碳捕集电厂的源荷储资源数据驱动鲁棒优化调度模型。首先,基于碳捕集电厂、抽水蓄能等源荷储灵活性资源运行特性,刻画电力系统灵活性供给能力;其次,采用数据驱动方法构建椭球不确定性集以刻画风电、光伏波动区间,根据各时刻边界值量化灵活性需求;进而,结合灵活性供需关系,提出源荷储资源数据驱动鲁棒优化模型,并采用改进列与约束生成算法(column and constraint generation,C&CG)进行求解。算例仿真表明,通过协同调度源荷储灵活性资源有助于支撑电力系统功率平衡,提高灵活性裕度,数据驱动鲁棒优化方法能够剔除传统盒式不确定集中的不实际恶劣场景,进而改善传统鲁棒优化模型过于保守的问题,并显著提升计算效率。
文摘In a home energy management system(HEMS),appliances are becoming diversified and intelligent,so that certain simple maintenance work can be completed by appliances themselves.During the measurement,collection and transmission of electricity load data in a HEMS sensor network,however,problems can be caused on the data due to faulty sensing processes and/or lost links,etc.In order to ensure the quality of retrieved load data,different solutions have been presented,but suffered from low recognition rates and high complexity.In this paper,a validation and repair method is presented to detect potential failures and errors in a domestic energy management system,which can then recover determined load errors and losses.A Kernel Extreme Learning Machine(K-ELM)based model has been employed with a Radial Basis Function(RBF)and optimised parameters for verification and recognition;whilst a Dual-spline method is presented to repair missing load data.According to the experiment results,the method outperforms the traditional B-spline and Cubic-spline methods and can effectively deal with unexpected data losses and errors under variant loss rates in a practical home environment.
