Objective:Deep learning(DL)has become the prevailing method in chest radiograph analysis,yet its performance heavily depends on large quantities of annotated images.To mitigate the cost,cold-start active learning(AL),...Objective:Deep learning(DL)has become the prevailing method in chest radiograph analysis,yet its performance heavily depends on large quantities of annotated images.To mitigate the cost,cold-start active learning(AL),comprising an initialization followed by subsequent learning,selects a small subset of informative data points for labeling.Recent advancements in pretrained models by supervised or self-supervised learning tailored to chest radiograph have shown broad applicability to diverse downstream tasks.However,their potential in cold-start AL remains unexplored.Methods:To validate the efficacy of domain-specific pretraining,we compared two foundation models:supervised TXRV and self-supervised REMEDIS with their general domain counterparts pretrained on ImageNet.Model performance was evaluated at both initialization and subsequent learning stages on two diagnostic tasks:psychiatric pneumonia and COVID-19.For initialization,we assessed their integration with three strategies:diversity,uncertainty,and hybrid sampling.For subsequent learning,we focused on uncertainty sampling powered by different pretrained models.We also conducted statistical tests to compare the foundation models with ImageNet counterparts,investigate the relationship between initialization and subsequent learning,examine the performance of one-shot initialization against the full AL process,and investigate the influence of class balance in initialization samples on initialization and subsequent learning.Results:First,domain-specific foundation models failed to outperform ImageNet counterparts in six out of eight experiments on informative sample selection.Both domain-specific and general pretrained models were unable to generate representations that could substitute for the original images as model inputs in seven of the eight scenarios.However,pretrained model-based initialization surpassed random sampling,the default approach in cold-start AL.Second,initialization performance was positively correlated with subsequent learning performance,highlighting the importance of initialization strategies.Third,one-shot initialization performed comparably to the full AL process,demonstrating the potential of reducing experts'repeated waiting during AL iterations.Last,a U-shaped correlation was observed between the class balance of initialization samples and model performance,suggesting that the class balance is more strongly associated with performance at middle budget levels than at low or high budgets.Conclusions:In this study,we highlighted the limitations of medical pretraining compared to general pretraining in the context of cold-start AL.We also identified promising outcomes related to cold-start AL,including initialization based on pretrained models,the positive influence of initialization on subsequent learning,the potential for one-shot initialization,and the influence of class balance on middle-budget AL.Researchers are encouraged to improve medical pretraining for versatile DL foundations and explore novel AL methods.展开更多
The Co_(3)O_(4)nanoparticles,dominated by a catalytically active(110)lattice plane,were synthesized as a low-temperature NO_(x) adsorbent to control the cold start emissions from vehicles.These nanoparticles boast a s...The Co_(3)O_(4)nanoparticles,dominated by a catalytically active(110)lattice plane,were synthesized as a low-temperature NO_(x) adsorbent to control the cold start emissions from vehicles.These nanoparticles boast a substantial quantity of active chemisorbed oxygen and lattice oxygen,which exhibited a NO_(x) uptake capacity commensurate with Pd/SSZ-13 at 100℃.The primary NO_(x) release temperature falls within a temperature range of 200-350℃,making it perfectly suitable for diesel engines.The characterization results demonstrate that chemisorbed oxygen facilitate nitro/nitrites intermediates formation,contributing to the NO_(x) storage at 100℃,while the nitrites begin to decompose within the 150-200℃range.Fortunately,lattice oxygen likely becomes involved in the activation of nitrites into more stable nitrate within this particular temperature range.The concurrent processes of nitrites decomposition and its conversion to nitrates results in a minimal NO_(x) release between the temperatures of 150-200℃.The nitrate formed via lattice oxygen mainly induces the NO_(x) to be released as NO_(2) within a temperature range of 200-350℃,which is advantageous in enhancing the NO_(x) activity of downstream NH_(3)-SCR catalysts,by boosting the fast SCR reaction pathway.Thanks to its low cost,considerable NO_(x) absorption capacity,and optimal release temperature,Co_(3)O_(4)demonstrates potential as an effective material for passive NO_(x) adsorber applications.展开更多
Link prediction has attracted wide attention among interdisciplinaryresearchers as an important issue in complex network. It aims to predict the missing links in current networks and new links that will appear in futu...Link prediction has attracted wide attention among interdisciplinaryresearchers as an important issue in complex network. It aims to predict the missing links in current networks and new links that will appear in future networks.Despite the presence of missing links in the target network of link prediction studies, the network it processes remains macroscopically as a large connectedgraph. However, the complexity of the real world makes the complex networksabstracted from real systems often contain many isolated nodes. This phenomenon leads to existing link prediction methods not to efficiently implement the prediction of missing edges on isolated nodes. Therefore, the cold-start linkprediction is favored as one of the most valuable subproblems of traditional linkprediction. However, due to the loss of many links in the observation network, thetopological information available for completing the link prediction task is extremely scarce. This presents a severe challenge for the study of cold-start link prediction. Therefore, how to mine and fuse more available non-topologicalinformation from observed network becomes the key point to solve the problemof cold-start link prediction. In this paper, we propose a framework for solving thecold-start link prediction problem, a joint-weighted symmetric nonnegative matrixfactorization model fusing graph regularization information, based on low-rankapproximation algorithms in the field of machine learning. First, the nonlinear features in high-dimensional space of node attributes are captured by the designedgraph regularization term. Second, using a weighted matrix, we associate the attribute similarity and first order structure information of nodes and constrain eachother. Finally, a unified framework for implementing cold-start link prediction isconstructed by using a symmetric nonnegative matrix factorization model to integrate the multiple information extracted together. Extensive experimental validationon five real networks with attributes shows that the proposed model has very goodpredictive performance when predicting missing edges of isolated nodes.展开更多
In order to give accurate recommendations for cold-start user, researchers use social network to find similar users. These efforts assume that cold-start user’s social relationships are static. However social relatio...In order to give accurate recommendations for cold-start user, researchers use social network to find similar users. These efforts assume that cold-start user’s social relationships are static. However social relationships of cold-start user may change as time pass by. In order to give accurate and timely in manner recommendations for cold-start user, it is need to update social relationship continuously. In this paper, we proposed an incremental graph pattern matching based dynamic cold-start recommendation method (IGPMDCR), which updates similar users for cold-start user based on topology of social network, and gives recommendations based on the latest similar users’ records. The experimental results show that, IGPMDCR could give accurate and timely in manner recommendations for cold-start user.展开更多
In order to improve the cold start performance of heavy duty diesel engine, electronically controlling the preheating of intake air by flame was researched. According to simulation and thermodynamic analysis about th...In order to improve the cold start performance of heavy duty diesel engine, electronically controlling the preheating of intake air by flame was researched. According to simulation and thermodynamic analysis about the partial working processes of the diesel engine, the amount of heat energy, enough to make the fuel self ignite at the end of compression process at different temperatures of coolant and intake air, was calculated. Several HY20 preheating plugs were used to heat up the intake air. Meanwhile, an electronic control system based on 8 bit micro controller unit (MCS 8031) was designed to automatically control the process of heating intake air. According to the various temperatures of coolant and ambient air, one plug or two plugs can automatically be selected to heat intake air. The demo experiment validated that the total system could operate successfully and achieve the scheduled function.展开更多
In the rolling production of steel,predicting the performance of new products is challenging due to the low variety of data distributions resulting from standardized manufacturing processes and fixed product categorie...In the rolling production of steel,predicting the performance of new products is challenging due to the low variety of data distributions resulting from standardized manufacturing processes and fixed product categories.This scenario poses a significant hurdle for machine learning models,leading to what is commonly known as the“cold-start problem”.To address this issue,we propose a knowledge graph attention neural network for steel manufacturing(SteelKGAT).By leveraging expert knowledge and a multi-head attention mechanism,SteelKGAT aims to enhance prediction accuracy.Our experimental results demonstrate that the SteelKGAT model outperforms existing methods when generalizing to previously unseen products.Only the SteelKGAT model accurately captures the feature trend,thereby offering correct guidance in product tuning,which is of practical significance for new product development(NPD).Additionally,we employ the Integrated Gradients(IG)method to shed light on the model's predictions,revealing the relative importance of each feature within the knowledge graph.Notably,this work represents the first application of knowledge graph attention neural networks to address the cold-start problem in steel rolling production.By combining domain expertise and interpretable predictions,our knowledge-informed SteelKGAT model provides accurate insights into the mechanical properties of products even in cold-start scenarios.展开更多
【目的】抽水蓄能机组具有灰启动潜力,将其与综合能源系统(integrated energy system,IES)的多能互补优势相结合,可适用于系统在极端事件下恢复运行。为研究灾后IES的恢复机制,提出一种抽水蓄能灰启动下冷热电互补综合能源系统(cold-hea...【目的】抽水蓄能机组具有灰启动潜力,将其与综合能源系统(integrated energy system,IES)的多能互补优势相结合,可适用于系统在极端事件下恢复运行。为研究灾后IES的恢复机制,提出一种抽水蓄能灰启动下冷热电互补综合能源系统(cold-heat-electricity IES,CHEIES)优化调度模型。【方法】首先,通过随机场景优化处理风光冷热功率不确定性问题,采用拉丁超立方抽样生成大量随机风光冷热场景,并使用概率距离快速削减法对场景数量进行削减。然后,针对灰启动下的CHEIES,以抽水蓄能作为灰启动电源为热电联产机组提供启动电源,并以灰启动效益为核心考量因素,综合构建单目标优化调度模型,引入冷热电功率平衡约束,确保IES在各种负荷情况下的稳定运行。最后,对模型进行仿真求解,并分析了各种运行方案下的优化调度策略和经济效益。【结果】配置抽水蓄能灰启动的CHEIES在应对极端自然灾害情境下展现出较高的灵活性和运行效率,与未配置抽水蓄能灰启动的方案相比,系统运行成本降低了12.14%。【结论】所提方法可充分挖掘紧急状态下CHEIES的可靠性、经济性与灵活性,为极端事件灾后IES的快速恢复提供了策略支持。展开更多
文摘Objective:Deep learning(DL)has become the prevailing method in chest radiograph analysis,yet its performance heavily depends on large quantities of annotated images.To mitigate the cost,cold-start active learning(AL),comprising an initialization followed by subsequent learning,selects a small subset of informative data points for labeling.Recent advancements in pretrained models by supervised or self-supervised learning tailored to chest radiograph have shown broad applicability to diverse downstream tasks.However,their potential in cold-start AL remains unexplored.Methods:To validate the efficacy of domain-specific pretraining,we compared two foundation models:supervised TXRV and self-supervised REMEDIS with their general domain counterparts pretrained on ImageNet.Model performance was evaluated at both initialization and subsequent learning stages on two diagnostic tasks:psychiatric pneumonia and COVID-19.For initialization,we assessed their integration with three strategies:diversity,uncertainty,and hybrid sampling.For subsequent learning,we focused on uncertainty sampling powered by different pretrained models.We also conducted statistical tests to compare the foundation models with ImageNet counterparts,investigate the relationship between initialization and subsequent learning,examine the performance of one-shot initialization against the full AL process,and investigate the influence of class balance in initialization samples on initialization and subsequent learning.Results:First,domain-specific foundation models failed to outperform ImageNet counterparts in six out of eight experiments on informative sample selection.Both domain-specific and general pretrained models were unable to generate representations that could substitute for the original images as model inputs in seven of the eight scenarios.However,pretrained model-based initialization surpassed random sampling,the default approach in cold-start AL.Second,initialization performance was positively correlated with subsequent learning performance,highlighting the importance of initialization strategies.Third,one-shot initialization performed comparably to the full AL process,demonstrating the potential of reducing experts'repeated waiting during AL iterations.Last,a U-shaped correlation was observed between the class balance of initialization samples and model performance,suggesting that the class balance is more strongly associated with performance at middle budget levels than at low or high budgets.Conclusions:In this study,we highlighted the limitations of medical pretraining compared to general pretraining in the context of cold-start AL.We also identified promising outcomes related to cold-start AL,including initialization based on pretrained models,the positive influence of initialization on subsequent learning,the potential for one-shot initialization,and the influence of class balance on middle-budget AL.Researchers are encouraged to improve medical pretraining for versatile DL foundations and explore novel AL methods.
基金supported by the National Natural Science Foundation of China(22006044,22006043)External Cooperation Program of Science and Technology Planning of Fujian Province(2023I0018)+2 种基金the Fujian Province Science and Technology Program Funds(2020H6013)the National Engineering Laboratory for Mobile Source Emission Control Technology(NELMS2020A03)the Scientific Research Funds of Huaqiao University(605-50Y200270001)。
文摘The Co_(3)O_(4)nanoparticles,dominated by a catalytically active(110)lattice plane,were synthesized as a low-temperature NO_(x) adsorbent to control the cold start emissions from vehicles.These nanoparticles boast a substantial quantity of active chemisorbed oxygen and lattice oxygen,which exhibited a NO_(x) uptake capacity commensurate with Pd/SSZ-13 at 100℃.The primary NO_(x) release temperature falls within a temperature range of 200-350℃,making it perfectly suitable for diesel engines.The characterization results demonstrate that chemisorbed oxygen facilitate nitro/nitrites intermediates formation,contributing to the NO_(x) storage at 100℃,while the nitrites begin to decompose within the 150-200℃range.Fortunately,lattice oxygen likely becomes involved in the activation of nitrites into more stable nitrate within this particular temperature range.The concurrent processes of nitrites decomposition and its conversion to nitrates results in a minimal NO_(x) release between the temperatures of 150-200℃.The nitrate formed via lattice oxygen mainly induces the NO_(x) to be released as NO_(2) within a temperature range of 200-350℃,which is advantageous in enhancing the NO_(x) activity of downstream NH_(3)-SCR catalysts,by boosting the fast SCR reaction pathway.Thanks to its low cost,considerable NO_(x) absorption capacity,and optimal release temperature,Co_(3)O_(4)demonstrates potential as an effective material for passive NO_(x) adsorber applications.
基金supported by the Teaching Reform Research Project of Qinghai Minzu University,China(2021-JYYB-009)the“Chunhui Plan”Cooperative Scientific Research Project of the Ministry of Education of China(2018).
文摘Link prediction has attracted wide attention among interdisciplinaryresearchers as an important issue in complex network. It aims to predict the missing links in current networks and new links that will appear in future networks.Despite the presence of missing links in the target network of link prediction studies, the network it processes remains macroscopically as a large connectedgraph. However, the complexity of the real world makes the complex networksabstracted from real systems often contain many isolated nodes. This phenomenon leads to existing link prediction methods not to efficiently implement the prediction of missing edges on isolated nodes. Therefore, the cold-start linkprediction is favored as one of the most valuable subproblems of traditional linkprediction. However, due to the loss of many links in the observation network, thetopological information available for completing the link prediction task is extremely scarce. This presents a severe challenge for the study of cold-start link prediction. Therefore, how to mine and fuse more available non-topologicalinformation from observed network becomes the key point to solve the problemof cold-start link prediction. In this paper, we propose a framework for solving thecold-start link prediction problem, a joint-weighted symmetric nonnegative matrixfactorization model fusing graph regularization information, based on low-rankapproximation algorithms in the field of machine learning. First, the nonlinear features in high-dimensional space of node attributes are captured by the designedgraph regularization term. Second, using a weighted matrix, we associate the attribute similarity and first order structure information of nodes and constrain eachother. Finally, a unified framework for implementing cold-start link prediction isconstructed by using a symmetric nonnegative matrix factorization model to integrate the multiple information extracted together. Extensive experimental validationon five real networks with attributes shows that the proposed model has very goodpredictive performance when predicting missing edges of isolated nodes.
文摘In order to give accurate recommendations for cold-start user, researchers use social network to find similar users. These efforts assume that cold-start user’s social relationships are static. However social relationships of cold-start user may change as time pass by. In order to give accurate and timely in manner recommendations for cold-start user, it is need to update social relationship continuously. In this paper, we proposed an incremental graph pattern matching based dynamic cold-start recommendation method (IGPMDCR), which updates similar users for cold-start user based on topology of social network, and gives recommendations based on the latest similar users’ records. The experimental results show that, IGPMDCR could give accurate and timely in manner recommendations for cold-start user.
文摘In order to improve the cold start performance of heavy duty diesel engine, electronically controlling the preheating of intake air by flame was researched. According to simulation and thermodynamic analysis about the partial working processes of the diesel engine, the amount of heat energy, enough to make the fuel self ignite at the end of compression process at different temperatures of coolant and intake air, was calculated. Several HY20 preheating plugs were used to heat up the intake air. Meanwhile, an electronic control system based on 8 bit micro controller unit (MCS 8031) was designed to automatically control the process of heating intake air. According to the various temperatures of coolant and ambient air, one plug or two plugs can automatically be selected to heat intake air. The demo experiment validated that the total system could operate successfully and achieve the scheduled function.
基金supported by the National Key R&D Program(No.2021YFB3702404)National Natural Science Foundation of China(Nos.52311530082 and U22A20106)support provided by“Xingliao Talent Plan”project(Grant No.XLYC2203027)is gratefully acknowledged.
文摘In the rolling production of steel,predicting the performance of new products is challenging due to the low variety of data distributions resulting from standardized manufacturing processes and fixed product categories.This scenario poses a significant hurdle for machine learning models,leading to what is commonly known as the“cold-start problem”.To address this issue,we propose a knowledge graph attention neural network for steel manufacturing(SteelKGAT).By leveraging expert knowledge and a multi-head attention mechanism,SteelKGAT aims to enhance prediction accuracy.Our experimental results demonstrate that the SteelKGAT model outperforms existing methods when generalizing to previously unseen products.Only the SteelKGAT model accurately captures the feature trend,thereby offering correct guidance in product tuning,which is of practical significance for new product development(NPD).Additionally,we employ the Integrated Gradients(IG)method to shed light on the model's predictions,revealing the relative importance of each feature within the knowledge graph.Notably,this work represents the first application of knowledge graph attention neural networks to address the cold-start problem in steel rolling production.By combining domain expertise and interpretable predictions,our knowledge-informed SteelKGAT model provides accurate insights into the mechanical properties of products even in cold-start scenarios.
文摘【目的】抽水蓄能机组具有灰启动潜力,将其与综合能源系统(integrated energy system,IES)的多能互补优势相结合,可适用于系统在极端事件下恢复运行。为研究灾后IES的恢复机制,提出一种抽水蓄能灰启动下冷热电互补综合能源系统(cold-heat-electricity IES,CHEIES)优化调度模型。【方法】首先,通过随机场景优化处理风光冷热功率不确定性问题,采用拉丁超立方抽样生成大量随机风光冷热场景,并使用概率距离快速削减法对场景数量进行削减。然后,针对灰启动下的CHEIES,以抽水蓄能作为灰启动电源为热电联产机组提供启动电源,并以灰启动效益为核心考量因素,综合构建单目标优化调度模型,引入冷热电功率平衡约束,确保IES在各种负荷情况下的稳定运行。最后,对模型进行仿真求解,并分析了各种运行方案下的优化调度策略和经济效益。【结果】配置抽水蓄能灰启动的CHEIES在应对极端自然灾害情境下展现出较高的灵活性和运行效率,与未配置抽水蓄能灰启动的方案相比,系统运行成本降低了12.14%。【结论】所提方法可充分挖掘紧急状态下CHEIES的可靠性、经济性与灵活性,为极端事件灾后IES的快速恢复提供了策略支持。
