The“Opinions on Comprehensively Deepening Curriculum Reform to Fulfill the Fundamental Task of Strengthening Moral Education”,issued by China’s Ministry of Education in 2015,explicitly identified Project-Based Lear...The“Opinions on Comprehensively Deepening Curriculum Reform to Fulfill the Fundamental Task of Strengthening Moral Education”,issued by China’s Ministry of Education in 2015,explicitly identified Project-Based Learning(PBL)as a key strategy for cultivating students’core competencies.Since then,PBL has been widely implemented as a pilot initiative in primary and secondary schools,gaining increasing influence.Analyzing the intellectual foundations of PBL research in China can offer valuable insights into its theoretical and practical dimensions.This study uses CiteSpace to examine 156 PBL-related articles from the CSSCI database,revealing that the knowledge base of PBL research is primarily built on two major domains.The first is the theoretical foundation,characterized by frequently cited literature focusing on the conceptual framework,educational value,interdisciplinary approaches,core competency cultivation,and instructional objectives of PBL.The second is empirical research,where highly cited studies include case analyses across K–12 settings,general high schools,and higher education institutions.Moving forward,future research on PBL should explore its meaning and value from a dual-subject and integrated perspective,expand case studies to include vocational education,and further promote the interdisciplinary development of core competencies through PBL.展开更多
The increasing complexity of on-orbit tasks imposes great demands on the flexible operation of space robotic arms, prompting the development of space robots from single-arm manipulation to multi-arm collaboration. In ...The increasing complexity of on-orbit tasks imposes great demands on the flexible operation of space robotic arms, prompting the development of space robots from single-arm manipulation to multi-arm collaboration. In this paper, a combined approach of Learning from Demonstration (LfD) and Reinforcement Learning (RL) is proposed for space multi-arm collaborative skill learning. The combination effectively resolves the trade-off between learning efficiency and feasible solution in LfD, as well as the time-consuming pursuit of the optimal solution in RL. With the prior knowledge of LfD, space robotic arms can achieve efficient guided learning in high-dimensional state-action space. Specifically, an LfD approach with Probabilistic Movement Primitives (ProMP) is firstly utilized to encode and reproduce the demonstration actions, generating a distribution as the initialization of policy. Then in the RL stage, a Relative Entropy Policy Search (REPS) algorithm modified in continuous state-action space is employed for further policy improvement. More importantly, the learned behaviors can maintain and reflect the characteristics of demonstrations. In addition, a series of supplementary policy search mechanisms are designed to accelerate the exploration process. The effectiveness of the proposed method has been verified both theoretically and experimentally. Moreover, comparisons with state-of-the-art methods have confirmed the outperformance of the approach.展开更多
实现远程教育的关键是有机地组织各类教育资源和高效率的双向通信。 L earning Space4是可以有效地解决高效率有机组织教育资源、跟踪、评估学生的学习状况、非实时和实时教学等关键问题的一个优秀的网络远程教学和管理平台系统。介绍应...实现远程教育的关键是有机地组织各类教育资源和高效率的双向通信。 L earning Space4是可以有效地解决高效率有机组织教育资源、跟踪、评估学生的学习状况、非实时和实时教学等关键问题的一个优秀的网络远程教学和管理平台系统。介绍应用 L earning Space4创建远程教育教程的基本方法 ,并以《生理学》第四版为例介绍应用 L展开更多
Numerous c-mesenchymal-epithelial transition(c-MET)inhibitors have been reported as potential anticancer agents.However,most fail to enter clinical trials owing to poor efficacy or drug resistance.To date,the scaffold...Numerous c-mesenchymal-epithelial transition(c-MET)inhibitors have been reported as potential anticancer agents.However,most fail to enter clinical trials owing to poor efficacy or drug resistance.To date,the scaffold-based chemical space of small-molecule c-MET inhibitors has not been analyzed.In this study,we constructed the largest c-MET dataset,which included 2,278 molecules with different struc-tures,by inhibiting the half maximal inhibitory concentration(IC_(50))of kinase activity.No significant differences in drug-like properties were observed between active molecules(1,228)and inactive mol-ecules(1,050),including chemical space coverage,physicochemical properties,and absorption,distri-bution,metabolism,excretion,and toxicity(ADMET)profiles.The higher chemical diversity of the active molecules was downscaled using t-distributed stochastic neighbor embedding(t-SNE)high-dimensional data.Further clustering and chemical space networks(CSNs)analyses revealed commonly used scaffolds for c-MET inhibitors,such as M5,M7,and M8.Activity cliffs and structural alerts were used to reveal“dead ends”and“safe bets”for c-MET,as well as dominant structural fragments consisting of pyr-idazinones,triazoles,and pyrazines.Finally,the decision tree model precisely indicated the key structural features required to constitute active c-MET inhibitor molecules,including at least three aromatic het-erocycles,five aromatic nitrogen atoms,and eight nitrogeneoxygen atoms.Overall,our analyses revealed potential structure-activity relationship(SAR)patterns for c-MET inhibitors,which can inform the screening of new compounds and guide future optimization efforts.展开更多
Nonlinear transforms have significantly advanced learned image compression(LIC),particularly using residual blocks.This transform enhances the nonlinear expression ability and obtain compact feature representation by ...Nonlinear transforms have significantly advanced learned image compression(LIC),particularly using residual blocks.This transform enhances the nonlinear expression ability and obtain compact feature representation by enlarging the receptive field,which indicates how the convolution process extracts features in a high dimensional feature space.However,its functionality is restricted to the spatial dimension and network depth,limiting further improvements in network performance due to insufficient information interaction and representation.Crucially,the potential of high dimensional feature space in the channel dimension and the exploration of network width/resolution remain largely untapped.In this paper,we consider nonlinear transforms from the perspective of feature space,defining high-dimensional feature spaces in different dimensions and investigating the specific effects.Firstly,we introduce the dimension increasing and decreasing transforms in both channel and spatial dimensions to obtain high dimensional feature space and achieve better feature extraction.Secondly,we design a channel-spatial fusion residual transform(CSR),which incorporates multi-dimensional transforms for a more effective representation.Furthermore,we simplify the proposed fusion transform to obtain a slim architecture(CSR-sm),balancing network complexity and compression performance.Finally,we build the overall network with stacked CSR transforms to achieve better compression and reconstruction.Experimental results demonstrate that the proposed method can achieve superior ratedistortion performance compared to the existing LIC methods and traditional codecs.Specifically,our proposed method achieves 9.38%BD-rate reduction over VVC on Kodak dataset.展开更多
With the development of space exploration and space environment measurements,the numerous observations of solar,solar wind,and near Earth space environment have been obtained in last 20 years.The accumulation of multi...With the development of space exploration and space environment measurements,the numerous observations of solar,solar wind,and near Earth space environment have been obtained in last 20 years.The accumulation of multiple data makes it possible to better use machine learning technique,which has achieved unforeseen results in industrial applications in last decades,for developing new approaches and models in space weather investigation and prediction.In this paper,the efforts on the forecasting methods for space weather indices,events,and parameters using machine learning are briefly introduced based on the study works in recent years.These investigations indicate that machine learning,especially deep learning technique can be used in automatic characteristic identification,solar eruption prediction,space weather forecasting for solar and geomagnetic indices,and modeling of space environment parameters.展开更多
The optimization of process parameters in polyolefin production can bring significant economic benefits to the factory.However,due to small data sets,high costs associated with parameter verification cycles,and diffic...The optimization of process parameters in polyolefin production can bring significant economic benefits to the factory.However,due to small data sets,high costs associated with parameter verification cycles,and difficulty in establishing an optimization model,the optimization process is often restricted.To address this issue,we propose using a transfer learning Bayesian optimization strategy to improve the efficiency of parameter optimization while minimizing resource consumption.Specifically,we leverage Gaussian process(GP)regression models to establish an integrated model that incorporates both source and target grade production task data.We then measure the similarity weights of each model by comparing their predicted trends,and utilize these weights to accelerate the solution of optimal process parameters for producing target polyolefin grades.In order to enhance the accuracy of our approach,we acknowledge that measuring similarity in a global search space may not effectively capture local similarity characteristics.Therefore,we propose a novel method for transfer learning optimization that operates within a local space(LSTL-PBO).This method employs partial data acquired through random sampling from the target task data and utilizes Bayesian optimization techniques for model establishment.By focusing on a local search space,we aim to better discern and leverage the inherent similarities between source tasks and the target task.Additionally,we incorporate a parallel concept into our method to address multiple local search spaces simultaneously.By doing so,we can explore different regions of the parameter space in parallel,thereby increasing the chances of finding optimal process parameters.This localized approach allows us to improve the precision and effectiveness of our optimization process.The performance of our method is validated through experiments on benchmark problems,and we discuss the sensitivity of its hyperparameters.The results show that our proposed method can significantly improve the efficiency of process parameter optimization,reduce the dependence on source tasks,and enhance the method's robustness.This has great potential for optimizing processes in industrial environments.展开更多
We present the viewpoint that optimization problems encountered in machine learning can often be interpreted as minimizing a convex functional over a function space,but with a non-convex constraint set introduced by m...We present the viewpoint that optimization problems encountered in machine learning can often be interpreted as minimizing a convex functional over a function space,but with a non-convex constraint set introduced by model parameterization.This observation allows us to repose such problems via a suitable relaxation as convex optimization problems in the space of distributions over the training parameters.We derive some simple relationships between the distribution-space problem and the original problem,e.g.,a distribution-space solution is at least as good as a solution in the original space.Moreover,we develop a numerical algorithm based on mixture distributions to perform approximate optimization directly in the distribution space.Consistency of this approximation is established and the numerical efficacy of the proposed algorithm is illustrated in simple examples.In both theory and practice,this formulation provides an alternative approach to large-scale optimization in machine learning.展开更多
Precise control of machining deformation is crucial for improving the manufacturing quality of structural aerospace components.In the machining process,different batches of blanks have different residual stress distri...Precise control of machining deformation is crucial for improving the manufacturing quality of structural aerospace components.In the machining process,different batches of blanks have different residual stress distributions,which pose a significant challenge to machining deformation control.In this study,a reinforcement learning method for machining deformation control based on a meta-invariant feature space was developed.The proposed method uses a reinforcement-learning model to dynamically control the machining process by monitoring the deformation force.Moreover,combined with a meta-invariant feature space,the proposed method learns the internal relationship of the deformation control approaches under different stress distributions to achieve the machining deformation control of different batches of blanks.Finally,the experimental results show that the proposed method achieves better deformation control than the two existing benchmarking methods.展开更多
With the increasing demand of computational power in artificial intelligence(AI)algorithms,dedicated accelerators have become a necessity.However,the complexity of hardware architectures,vast design search space,and c...With the increasing demand of computational power in artificial intelligence(AI)algorithms,dedicated accelerators have become a necessity.However,the complexity of hardware architectures,vast design search space,and complex tasks of accelerators have posed significant challenges.Tra-ditional search methods can become prohibitively slow if the search space continues to be expanded.A design space exploration(DSE)method is proposed based on transfer learning,which reduces the time for repeated training and uses multi-task models for different tasks on the same processor.The proposed method accurately predicts the latency and energy consumption associated with neural net-work accelerator design parameters,enabling faster identification of optimal outcomes compared with traditional methods.And compared with other DSE methods by using multilayer perceptron(MLP),the required training time is shorter.Comparative experiments with other methods demonstrate that the proposed method improves the efficiency of DSE without compromising the accuracy of the re-sults.展开更多
Driven by the improvement of the smart grid,the active distribution network(ADN)has attracted much attention due to its characteristic of active management.By making full use of electricity price signals for optimal s...Driven by the improvement of the smart grid,the active distribution network(ADN)has attracted much attention due to its characteristic of active management.By making full use of electricity price signals for optimal scheduling,the total cost of the ADN can be reduced.However,the optimal dayahead scheduling problem is challenging since the future electricity price is unknown.Moreover,in ADN,some schedulable variables are continuous while some schedulable variables are discrete,which increases the difficulty of determining the optimal scheduling scheme.In this paper,the day-ahead scheduling problem of the ADN is formulated as a Markov decision process(MDP)with continuous-discrete hybrid action space.Then,an algorithm based on multi-agent hybrid reinforcement learning(HRL)is proposed to obtain the optimal scheduling scheme.The proposed algorithm adopts the structure of centralized training and decentralized execution,and different methods are applied to determine the selection policy of continuous scheduling variables and discrete scheduling variables.The simulation experiment results demonstrate the effectiveness of the algorithm.展开更多
Learning space management transformation is an inevitable guidance for learners’increasingly abundant learning needs and technological innovation.Learning space management should be transformed for students,teachers,...Learning space management transformation is an inevitable guidance for learners’increasingly abundant learning needs and technological innovation.Learning space management should be transformed for students,teachers,and schools to form a new pattern that centers on learners,which is led by professional teachers,and breaks the inherent shape of schools.The development of learning space management transformation needs top level design from top to bottom and basic level exploration from bottom to top,meantime combining the overall construction with key breakthroughs.The learning space sharing mechanism proposed in this research will provide references for the learning space management transformation.展开更多
L2 teaching and learning is a way of using language,but it happens in a particular space—the classroom space,which,to some extent,has a restriction to language using.This paper provides a valuable sight into L2 teach...L2 teaching and learning is a way of using language,but it happens in a particular space—the classroom space,which,to some extent,has a restriction to language using.This paper provides a valuable sight into L2 teaching and learning in the classroom space,and discusses the viewpoint of how to make an actual learning of L2 under the way of teaching.展开更多
The goal of zero-shot recognition is to classify classes it has never seen before, which needs to build a bridge between seen and unseen classes through semantic embedding space. Therefore, semantic embedding space le...The goal of zero-shot recognition is to classify classes it has never seen before, which needs to build a bridge between seen and unseen classes through semantic embedding space. Therefore, semantic embedding space learning plays an important role in zero-shot recognition. Among existing works, semantic embedding space is mainly taken by user-defined attribute vectors. However, the discriminative information included in the user-defined attribute vector is limited. In this paper, we propose to learn an extra latent attribute space automatically to produce a more generalized and discriminative semantic embedded space. To prevent the bias problem, both user-defined attribute vector and latent attribute space are optimized by adversarial learning with auto-encoders. We also propose to reconstruct semantic patterns produced by explanatory graphs, which can make semantic embedding space more sensitive to usefully semantic information and less sensitive to useless information. The proposed method is evaluated on the AwA2 and CUB dataset. These results show that our proposed method achieves superior performance.展开更多
In recent years, with the development of educational informatization, the network teaching mode has become an indispensable auxiliary teaching method in teaching. For teachers' teaching work, the network learning ...In recent years, with the development of educational informatization, the network teaching mode has become an indispensable auxiliary teaching method in teaching. For teachers' teaching work, the network learning space is not only a change in teaching methods, but also a deeper change in teachers' educational concepts and thoughts. Using online learning space to optimize classroom teaching has also become a help to improve classroom teaching efficiency and teaching quality. However, the integration of education and information technology in our country is getting closer and closer, and the means and methods of learning by using network technology are becoming more and more perfect. With the help of information technology and network environment, the network learning space provides teachers and students with relevant technologies and services they need to meet the teaching needs. Rational network application technology can promote the reform of school teaching and the in-depth integration of information technology and teaching.展开更多
Ordering based search methods have advantages over graph based search methods for structure learning of Bayesian networks in terms on the efficiency. With the aim of further increasing the accuracy of ordering based s...Ordering based search methods have advantages over graph based search methods for structure learning of Bayesian networks in terms on the efficiency. With the aim of further increasing the accuracy of ordering based search methods, we first propose to increase the search space, which can facilitate escaping from the local optima. We present our search operators with majorizations, which are easy to implement. Experiments show that the proposed algorithm can obtain significantly more accurate results. With regard to the problem of the decrease on efficiency due to the increase of the search space, we then propose to add path priors as constraints into the swap process. We analyze the coefficient which may influence the performance of the proposed algorithm, the experiments show that the constraints can enhance the efficiency greatly, while has little effect on the accuracy. The final experiments show that, compared to other competitive methods, the proposed algorithm can find better solutions while holding high efficiency at the same time on both synthetic and real data sets.展开更多
The feature space extracted from vibration signals with various faults is often nonlinear and of high dimension.Currently,nonlinear dimensionality reduction methods are available for extracting low-dimensional embeddi...The feature space extracted from vibration signals with various faults is often nonlinear and of high dimension.Currently,nonlinear dimensionality reduction methods are available for extracting low-dimensional embeddings,such as manifold learning.However,these methods are all based on manual intervention,which have some shortages in stability,and suppressing the disturbance noise.To extract features automatically,a manifold learning method with self-organization mapping is introduced for the first time.Under the non-uniform sample distribution reconstructed by the phase space,the expectation maximization(EM) iteration algorithm is used to divide the local neighborhoods adaptively without manual intervention.After that,the local tangent space alignment(LTSA) algorithm is adopted to compress the high-dimensional phase space into a more truthful low-dimensional representation.Finally,the signal is reconstructed by the kernel regression.Several typical states include the Lorenz system,engine fault with piston pin defect,and bearing fault with outer-race defect are analyzed.Compared with the LTSA and continuous wavelet transform,the results show that the background noise can be fully restrained and the entire periodic repetition of impact components is well separated and identified.A new way to automatically and precisely extract the impulsive components from mechanical signals is proposed.展开更多
This research proposes a method called enhanced collaborative andgeometric multi-kernel learning (E-CGMKL) that can enhance the CGMKLalgorithm which deals with multi-class classification problems with non-lineardata d...This research proposes a method called enhanced collaborative andgeometric multi-kernel learning (E-CGMKL) that can enhance the CGMKLalgorithm which deals with multi-class classification problems with non-lineardata distributions. CGMKL combines multiple kernel learning with softmaxfunction using the framework of multi empirical kernel learning (MEKL) inwhich empirical kernel mapping (EKM) provides explicit feature constructionin the high dimensional kernel space. CGMKL ensures the consistent outputof samples across kernel spaces and minimizes the within-class distance tohighlight geometric features of multiple classes. However, the kernels constructed by CGMKL do not have any explicit relationship among them andtry to construct high dimensional feature representations independently fromeach other. This could be disadvantageous for learning on datasets with complex hidden structures. To overcome this limitation, E-CGMKL constructskernel spaces from hidden layers of trained deep neural networks (DNN).Due to the nature of the DNN architecture, these kernel spaces not onlyprovide multiple feature representations but also inherit the compositionalhierarchy of the hidden layers, which might be beneficial for enhancing thepredictive performance of the CGMKL algorithm on complex data withnatural hierarchical structures, for example, image data. Furthermore, ourproposed scheme handles image data by constructing kernel spaces from aconvolutional neural network (CNN). Considering the effectiveness of CNNarchitecture on image data, these kernel spaces provide a major advantageover the CGMKL algorithm which does not exploit the CNN architecture forconstructing kernel spaces from image data. Additionally, outputs of hiddenlayers directly provide features for kernel spaces and unlike CGMKL, do notrequire an approximate MEKL framework. E-CGMKL combines the consistency and geometry preserving aspects of CGMKL with the compositionalhierarchy of kernel spaces extracted from DNN hidden layers to enhance the predictive performance of CGMKL significantly. The experimental results onvarious data sets demonstrate the superior performance of the E-CGMKLalgorithm compared to other competing methods including the benchmarkCGMKL.展开更多
基金Provincial-Level Quality Engineering Project,Preschool Education Teacher Training Base of Fuyang Normal University(Project No.:2023cyts023)University-Level Research Team Project,Collaborative Innovation Center for Basic Education in Northern Anhui(Project No.:kytd202418)。
文摘The“Opinions on Comprehensively Deepening Curriculum Reform to Fulfill the Fundamental Task of Strengthening Moral Education”,issued by China’s Ministry of Education in 2015,explicitly identified Project-Based Learning(PBL)as a key strategy for cultivating students’core competencies.Since then,PBL has been widely implemented as a pilot initiative in primary and secondary schools,gaining increasing influence.Analyzing the intellectual foundations of PBL research in China can offer valuable insights into its theoretical and practical dimensions.This study uses CiteSpace to examine 156 PBL-related articles from the CSSCI database,revealing that the knowledge base of PBL research is primarily built on two major domains.The first is the theoretical foundation,characterized by frequently cited literature focusing on the conceptual framework,educational value,interdisciplinary approaches,core competency cultivation,and instructional objectives of PBL.The second is empirical research,where highly cited studies include case analyses across K–12 settings,general high schools,and higher education institutions.Moving forward,future research on PBL should explore its meaning and value from a dual-subject and integrated perspective,expand case studies to include vocational education,and further promote the interdisciplinary development of core competencies through PBL.
基金co-supported by the National Natural Science Foundation of China(No.12372045)the Guangdong Basic and Applied Basic Research Foundation,China(No.2023B1515120018)the Shenzhen Science and Technology Program,China(No.JCYJ20220818102207015).
文摘The increasing complexity of on-orbit tasks imposes great demands on the flexible operation of space robotic arms, prompting the development of space robots from single-arm manipulation to multi-arm collaboration. In this paper, a combined approach of Learning from Demonstration (LfD) and Reinforcement Learning (RL) is proposed for space multi-arm collaborative skill learning. The combination effectively resolves the trade-off between learning efficiency and feasible solution in LfD, as well as the time-consuming pursuit of the optimal solution in RL. With the prior knowledge of LfD, space robotic arms can achieve efficient guided learning in high-dimensional state-action space. Specifically, an LfD approach with Probabilistic Movement Primitives (ProMP) is firstly utilized to encode and reproduce the demonstration actions, generating a distribution as the initialization of policy. Then in the RL stage, a Relative Entropy Policy Search (REPS) algorithm modified in continuous state-action space is employed for further policy improvement. More importantly, the learned behaviors can maintain and reflect the characteristics of demonstrations. In addition, a series of supplementary policy search mechanisms are designed to accelerate the exploration process. The effectiveness of the proposed method has been verified both theoretically and experimentally. Moreover, comparisons with state-of-the-art methods have confirmed the outperformance of the approach.
文摘实现远程教育的关键是有机地组织各类教育资源和高效率的双向通信。 L earning Space4是可以有效地解决高效率有机组织教育资源、跟踪、评估学生的学习状况、非实时和实时教学等关键问题的一个优秀的网络远程教学和管理平台系统。介绍应用 L earning Space4创建远程教育教程的基本方法 ,并以《生理学》第四版为例介绍应用 L
基金supported by the National Natural Science Foundation of China(Grant Nos.:82173699 and 32200531)Shanghai Jiao Tong University Trans-Med Awards Research,China(STAR Project No.:20230101)Shanghai Science and Technol-ogy Commission,China(Grant No.:23DZ2290600).
文摘Numerous c-mesenchymal-epithelial transition(c-MET)inhibitors have been reported as potential anticancer agents.However,most fail to enter clinical trials owing to poor efficacy or drug resistance.To date,the scaffold-based chemical space of small-molecule c-MET inhibitors has not been analyzed.In this study,we constructed the largest c-MET dataset,which included 2,278 molecules with different struc-tures,by inhibiting the half maximal inhibitory concentration(IC_(50))of kinase activity.No significant differences in drug-like properties were observed between active molecules(1,228)and inactive mol-ecules(1,050),including chemical space coverage,physicochemical properties,and absorption,distri-bution,metabolism,excretion,and toxicity(ADMET)profiles.The higher chemical diversity of the active molecules was downscaled using t-distributed stochastic neighbor embedding(t-SNE)high-dimensional data.Further clustering and chemical space networks(CSNs)analyses revealed commonly used scaffolds for c-MET inhibitors,such as M5,M7,and M8.Activity cliffs and structural alerts were used to reveal“dead ends”and“safe bets”for c-MET,as well as dominant structural fragments consisting of pyr-idazinones,triazoles,and pyrazines.Finally,the decision tree model precisely indicated the key structural features required to constitute active c-MET inhibitor molecules,including at least three aromatic het-erocycles,five aromatic nitrogen atoms,and eight nitrogeneoxygen atoms.Overall,our analyses revealed potential structure-activity relationship(SAR)patterns for c-MET inhibitors,which can inform the screening of new compounds and guide future optimization efforts.
基金supported by the Key Program of the National Natural Science Foundation of China(Grant No.62031013)Guangdong Province Key Construction Discipline Scientific Research Capacity Improvement Project(Grant No.2022ZDJS117).
文摘Nonlinear transforms have significantly advanced learned image compression(LIC),particularly using residual blocks.This transform enhances the nonlinear expression ability and obtain compact feature representation by enlarging the receptive field,which indicates how the convolution process extracts features in a high dimensional feature space.However,its functionality is restricted to the spatial dimension and network depth,limiting further improvements in network performance due to insufficient information interaction and representation.Crucially,the potential of high dimensional feature space in the channel dimension and the exploration of network width/resolution remain largely untapped.In this paper,we consider nonlinear transforms from the perspective of feature space,defining high-dimensional feature spaces in different dimensions and investigating the specific effects.Firstly,we introduce the dimension increasing and decreasing transforms in both channel and spatial dimensions to obtain high dimensional feature space and achieve better feature extraction.Secondly,we design a channel-spatial fusion residual transform(CSR),which incorporates multi-dimensional transforms for a more effective representation.Furthermore,we simplify the proposed fusion transform to obtain a slim architecture(CSR-sm),balancing network complexity and compression performance.Finally,we build the overall network with stacked CSR transforms to achieve better compression and reconstruction.Experimental results demonstrate that the proposed method can achieve superior ratedistortion performance compared to the existing LIC methods and traditional codecs.Specifically,our proposed method achieves 9.38%BD-rate reduction over VVC on Kodak dataset.
基金Supported by National Natural Science Foundation of China(41574181)。
文摘With the development of space exploration and space environment measurements,the numerous observations of solar,solar wind,and near Earth space environment have been obtained in last 20 years.The accumulation of multiple data makes it possible to better use machine learning technique,which has achieved unforeseen results in industrial applications in last decades,for developing new approaches and models in space weather investigation and prediction.In this paper,the efforts on the forecasting methods for space weather indices,events,and parameters using machine learning are briefly introduced based on the study works in recent years.These investigations indicate that machine learning,especially deep learning technique can be used in automatic characteristic identification,solar eruption prediction,space weather forecasting for solar and geomagnetic indices,and modeling of space environment parameters.
基金supported by National Natural Science Foundation of China(62394343)Major Program of Qingyuan Innovation Laboratory(00122002)+1 种基金Major Science and Technology Projects of Longmen Laboratory(231100220600)Shanghai Committee of Science and Technology(23ZR1416000)and Shanghai AI Lab.
文摘The optimization of process parameters in polyolefin production can bring significant economic benefits to the factory.However,due to small data sets,high costs associated with parameter verification cycles,and difficulty in establishing an optimization model,the optimization process is often restricted.To address this issue,we propose using a transfer learning Bayesian optimization strategy to improve the efficiency of parameter optimization while minimizing resource consumption.Specifically,we leverage Gaussian process(GP)regression models to establish an integrated model that incorporates both source and target grade production task data.We then measure the similarity weights of each model by comparing their predicted trends,and utilize these weights to accelerate the solution of optimal process parameters for producing target polyolefin grades.In order to enhance the accuracy of our approach,we acknowledge that measuring similarity in a global search space may not effectively capture local similarity characteristics.Therefore,we propose a novel method for transfer learning optimization that operates within a local space(LSTL-PBO).This method employs partial data acquired through random sampling from the target task data and utilizes Bayesian optimization techniques for model establishment.By focusing on a local search space,we aim to better discern and leverage the inherent similarities between source tasks and the target task.Additionally,we incorporate a parallel concept into our method to address multiple local search spaces simultaneously.By doing so,we can explore different regions of the parameter space in parallel,thereby increasing the chances of finding optimal process parameters.This localized approach allows us to improve the precision and effectiveness of our optimization process.The performance of our method is validated through experiments on benchmark problems,and we discuss the sensitivity of its hyperparameters.The results show that our proposed method can significantly improve the efficiency of process parameter optimization,reduce the dependence on source tasks,and enhance the method's robustness.This has great potential for optimizing processes in industrial environments.
基金supported by the National Natural Science Foundation of China(Grant No.12201053)supported by the National Research Foundation,Singapore,under the NRF fellowship(Project No.NRF-NRFF13-2021-0005).
文摘We present the viewpoint that optimization problems encountered in machine learning can often be interpreted as minimizing a convex functional over a function space,but with a non-convex constraint set introduced by model parameterization.This observation allows us to repose such problems via a suitable relaxation as convex optimization problems in the space of distributions over the training parameters.We derive some simple relationships between the distribution-space problem and the original problem,e.g.,a distribution-space solution is at least as good as a solution in the original space.Moreover,we develop a numerical algorithm based on mixture distributions to perform approximate optimization directly in the distribution space.Consistency of this approximation is established and the numerical efficacy of the proposed algorithm is illustrated in simple examples.In both theory and practice,this formulation provides an alternative approach to large-scale optimization in machine learning.
基金This work is supported by National Key R&D Programs of China,No.2021YFB3301302the National Natural Science Foundation of China,No.52175467the National Science Fund of China for Distinguished Young Scholars,No.51925505。
文摘Precise control of machining deformation is crucial for improving the manufacturing quality of structural aerospace components.In the machining process,different batches of blanks have different residual stress distributions,which pose a significant challenge to machining deformation control.In this study,a reinforcement learning method for machining deformation control based on a meta-invariant feature space was developed.The proposed method uses a reinforcement-learning model to dynamically control the machining process by monitoring the deformation force.Moreover,combined with a meta-invariant feature space,the proposed method learns the internal relationship of the deformation control approaches under different stress distributions to achieve the machining deformation control of different batches of blanks.Finally,the experimental results show that the proposed method achieves better deformation control than the two existing benchmarking methods.
基金the National Key R&D Program of China(No.2018AAA0103300)the National Natural Science Foundation of China(No.61925208,U20A20227,U22A2028)+1 种基金the Chinese Academy of Sciences Project for Young Scientists in Basic Research(No.YSBR-029)the Youth Innovation Promotion Association Chinese Academy of Sciences.
文摘With the increasing demand of computational power in artificial intelligence(AI)algorithms,dedicated accelerators have become a necessity.However,the complexity of hardware architectures,vast design search space,and complex tasks of accelerators have posed significant challenges.Tra-ditional search methods can become prohibitively slow if the search space continues to be expanded.A design space exploration(DSE)method is proposed based on transfer learning,which reduces the time for repeated training and uses multi-task models for different tasks on the same processor.The proposed method accurately predicts the latency and energy consumption associated with neural net-work accelerator design parameters,enabling faster identification of optimal outcomes compared with traditional methods.And compared with other DSE methods by using multilayer perceptron(MLP),the required training time is shorter.Comparative experiments with other methods demonstrate that the proposed method improves the efficiency of DSE without compromising the accuracy of the re-sults.
基金This work was supported by the National Key R&D Program of China(2018AAA0101400)the National Natural Science Foundation of China(62173251,61921004,U1713209)the Natural Science Foundation of Jiangsu Province of China(BK20202006).
文摘Driven by the improvement of the smart grid,the active distribution network(ADN)has attracted much attention due to its characteristic of active management.By making full use of electricity price signals for optimal scheduling,the total cost of the ADN can be reduced.However,the optimal dayahead scheduling problem is challenging since the future electricity price is unknown.Moreover,in ADN,some schedulable variables are continuous while some schedulable variables are discrete,which increases the difficulty of determining the optimal scheduling scheme.In this paper,the day-ahead scheduling problem of the ADN is formulated as a Markov decision process(MDP)with continuous-discrete hybrid action space.Then,an algorithm based on multi-agent hybrid reinforcement learning(HRL)is proposed to obtain the optimal scheduling scheme.The proposed algorithm adopts the structure of centralized training and decentralized execution,and different methods are applied to determine the selection policy of continuous scheduling variables and discrete scheduling variables.The simulation experiment results demonstrate the effectiveness of the algorithm.
文摘Learning space management transformation is an inevitable guidance for learners’increasingly abundant learning needs and technological innovation.Learning space management should be transformed for students,teachers,and schools to form a new pattern that centers on learners,which is led by professional teachers,and breaks the inherent shape of schools.The development of learning space management transformation needs top level design from top to bottom and basic level exploration from bottom to top,meantime combining the overall construction with key breakthroughs.The learning space sharing mechanism proposed in this research will provide references for the learning space management transformation.
基金a part of the project,"The Research of the New Type of College English Teaching Group"(No.Y-B/2011/04),supported by 2011"12.5"Program of Jiansu Education Science Research~~
文摘L2 teaching and learning is a way of using language,but it happens in a particular space—the classroom space,which,to some extent,has a restriction to language using.This paper provides a valuable sight into L2 teaching and learning in the classroom space,and discusses the viewpoint of how to make an actual learning of L2 under the way of teaching.
文摘The goal of zero-shot recognition is to classify classes it has never seen before, which needs to build a bridge between seen and unseen classes through semantic embedding space. Therefore, semantic embedding space learning plays an important role in zero-shot recognition. Among existing works, semantic embedding space is mainly taken by user-defined attribute vectors. However, the discriminative information included in the user-defined attribute vector is limited. In this paper, we propose to learn an extra latent attribute space automatically to produce a more generalized and discriminative semantic embedded space. To prevent the bias problem, both user-defined attribute vector and latent attribute space are optimized by adversarial learning with auto-encoders. We also propose to reconstruct semantic patterns produced by explanatory graphs, which can make semantic embedding space more sensitive to usefully semantic information and less sensitive to useless information. The proposed method is evaluated on the AwA2 and CUB dataset. These results show that our proposed method achieves superior performance.
文摘In recent years, with the development of educational informatization, the network teaching mode has become an indispensable auxiliary teaching method in teaching. For teachers' teaching work, the network learning space is not only a change in teaching methods, but also a deeper change in teachers' educational concepts and thoughts. Using online learning space to optimize classroom teaching has also become a help to improve classroom teaching efficiency and teaching quality. However, the integration of education and information technology in our country is getting closer and closer, and the means and methods of learning by using network technology are becoming more and more perfect. With the help of information technology and network environment, the network learning space provides teachers and students with relevant technologies and services they need to meet the teaching needs. Rational network application technology can promote the reform of school teaching and the in-depth integration of information technology and teaching.
基金supported by the National Natural Science Fundation of China(61573285)the Doctoral Fundation of China(2013ZC53037)
文摘Ordering based search methods have advantages over graph based search methods for structure learning of Bayesian networks in terms on the efficiency. With the aim of further increasing the accuracy of ordering based search methods, we first propose to increase the search space, which can facilitate escaping from the local optima. We present our search operators with majorizations, which are easy to implement. Experiments show that the proposed algorithm can obtain significantly more accurate results. With regard to the problem of the decrease on efficiency due to the increase of the search space, we then propose to add path priors as constraints into the swap process. We analyze the coefficient which may influence the performance of the proposed algorithm, the experiments show that the constraints can enhance the efficiency greatly, while has little effect on the accuracy. The final experiments show that, compared to other competitive methods, the proposed algorithm can find better solutions while holding high efficiency at the same time on both synthetic and real data sets.
基金supported by National Natural Science Foundation of China(Grant No.51075323)
文摘The feature space extracted from vibration signals with various faults is often nonlinear and of high dimension.Currently,nonlinear dimensionality reduction methods are available for extracting low-dimensional embeddings,such as manifold learning.However,these methods are all based on manual intervention,which have some shortages in stability,and suppressing the disturbance noise.To extract features automatically,a manifold learning method with self-organization mapping is introduced for the first time.Under the non-uniform sample distribution reconstructed by the phase space,the expectation maximization(EM) iteration algorithm is used to divide the local neighborhoods adaptively without manual intervention.After that,the local tangent space alignment(LTSA) algorithm is adopted to compress the high-dimensional phase space into a more truthful low-dimensional representation.Finally,the signal is reconstructed by the kernel regression.Several typical states include the Lorenz system,engine fault with piston pin defect,and bearing fault with outer-race defect are analyzed.Compared with the LTSA and continuous wavelet transform,the results show that the background noise can be fully restrained and the entire periodic repetition of impact components is well separated and identified.A new way to automatically and precisely extract the impulsive components from mechanical signals is proposed.
文摘This research proposes a method called enhanced collaborative andgeometric multi-kernel learning (E-CGMKL) that can enhance the CGMKLalgorithm which deals with multi-class classification problems with non-lineardata distributions. CGMKL combines multiple kernel learning with softmaxfunction using the framework of multi empirical kernel learning (MEKL) inwhich empirical kernel mapping (EKM) provides explicit feature constructionin the high dimensional kernel space. CGMKL ensures the consistent outputof samples across kernel spaces and minimizes the within-class distance tohighlight geometric features of multiple classes. However, the kernels constructed by CGMKL do not have any explicit relationship among them andtry to construct high dimensional feature representations independently fromeach other. This could be disadvantageous for learning on datasets with complex hidden structures. To overcome this limitation, E-CGMKL constructskernel spaces from hidden layers of trained deep neural networks (DNN).Due to the nature of the DNN architecture, these kernel spaces not onlyprovide multiple feature representations but also inherit the compositionalhierarchy of the hidden layers, which might be beneficial for enhancing thepredictive performance of the CGMKL algorithm on complex data withnatural hierarchical structures, for example, image data. Furthermore, ourproposed scheme handles image data by constructing kernel spaces from aconvolutional neural network (CNN). Considering the effectiveness of CNNarchitecture on image data, these kernel spaces provide a major advantageover the CGMKL algorithm which does not exploit the CNN architecture forconstructing kernel spaces from image data. Additionally, outputs of hiddenlayers directly provide features for kernel spaces and unlike CGMKL, do notrequire an approximate MEKL framework. E-CGMKL combines the consistency and geometry preserving aspects of CGMKL with the compositionalhierarchy of kernel spaces extracted from DNN hidden layers to enhance the predictive performance of CGMKL significantly. The experimental results onvarious data sets demonstrate the superior performance of the E-CGMKLalgorithm compared to other competing methods including the benchmarkCGMKL.
