Considering the difficulty of integrating the depth points of nautical charts of the East China Sea into a global high-precision Grid Digital Elevation Model(Grid-DEM),we proposed a“Fusion based on Image Recognition(...Considering the difficulty of integrating the depth points of nautical charts of the East China Sea into a global high-precision Grid Digital Elevation Model(Grid-DEM),we proposed a“Fusion based on Image Recognition(FIR)”method for multi-sourced depth data fusion,and used it to merge the electronic nautical chart dataset(referred to as Chart2014 in this paper)with the global digital elevation dataset(referred to as Globalbath2002 in this paper).Compared to the traditional fusion of two datasets by direct combination and interpolation,the new Grid-DEM formed by FIR can better represent the data characteristics of Chart2014,reduce the calculation difficulty,and be more intuitive,and,the choice of different interpolation methods in FIR and the influence of the“exclusion radius R”parameter were discussed.FIR avoids complex calculations of spatial distances among points from different sources,and instead uses spatial exclusion map to perform one-step screening based on the exclusion radius R,which greatly improved the fusion status of a reliable dataset.The fusion results of different experiments were analyzed statistically with root mean square error and mean relative error,showing that the interpolation methods based on Delaunay triangulation are more suitable for the fusion of nautical chart depth of China,and factors such as the point density distribution of multiple source data,accuracy,interpolation method,and various terrain conditions should be fully considered when selecting the exclusion radius R.展开更多
Refined 3D modeling of mine slopes is pivotal for precise prediction of geological hazards.Aiming at the inadequacy of existing single modeling methods in comprehensively representing the overall and localized charact...Refined 3D modeling of mine slopes is pivotal for precise prediction of geological hazards.Aiming at the inadequacy of existing single modeling methods in comprehensively representing the overall and localized characteristics of mining slopes,this study introduces a new method that fuses model data from Unmanned aerial vehicles(UAV)tilt photogrammetry and 3D laser scanning through a data alignment algorithm based on control points.First,the mini batch K-Medoids algorithm is utilized to cluster the point cloud data from ground 3D laser scanning.Then,the elbow rule is applied to determine the optimal cluster number(K0),and the feature points are extracted.Next,the nearest neighbor point algorithm is employed to match the feature points obtained from UAV tilt photogrammetry,and the internal point coordinates are adjusted through the distanceweighted average to construct a 3D model.Finally,by integrating an engineering case study,the K0 value is determined to be 8,with a matching accuracy between the two model datasets ranging from 0.0669 to 1.0373 mm.Therefore,compared with the modeling method utilizing K-medoids clustering algorithm,the new modeling method significantly enhances the computational efficiency,the accuracy of selecting the optimal number of feature points in 3D laser scanning,and the precision of the 3D model derived from UAV tilt photogrammetry.This method provides a research foundation for constructing mine slope model.展开更多
Satellite remote sensing of inland water body requires a high spatial resolution and a multiband narrow spectral resolution, which makes the fusion between panchromatic(PAN) and multi-spectral(MS) images particularly ...Satellite remote sensing of inland water body requires a high spatial resolution and a multiband narrow spectral resolution, which makes the fusion between panchromatic(PAN) and multi-spectral(MS) images particularly important. Taking the Daquekou section of the Qiantang River as an observation target, four conventional fusion methods widely accepted in satellite image processing, including pan sharpening(PS), principal component analysis(PCA), Gram-Schmidt(GS), and wavelet fusion(WF), are utilized to fuse MS and PAN images of GF-1.The results of subjective and objective evaluation methods application indicate that GS performs the best,followed by the PCA, the WF and the PS in the order of descending. The existence of a large area of the water body is a dominant factor impacting the fusion performance. Meanwhile, the ability of retaining spatial and spectral informations is an important factor affecting the fusion performance of different fusion methods. The fundamental difference of reflectivity information acquisition between water and land is the reason for the failure of conventional fusion methods for land observation such as the PS to be used in the presence of the large water body. It is suggested that the adoption of the conventional fusion methods in the observing water body as the main target should be taken with caution. The performances of the fusion methods need re-assessment when the large-scale water body is present in the remote sensing image or when the research aims for the water body observation.展开更多
To aim at the problem that the horizontal directivity index of the vector hy- drophone vertical array is not higher than that of a vector hydrophone, the high-resolution azimuth estimation algorithm based on the data ...To aim at the problem that the horizontal directivity index of the vector hy- drophone vertical array is not higher than that of a vector hydrophone, the high-resolution azimuth estimation algorithm based on the data fusion method was presented. The proposed algorithnl first employs MUSIC algorithm to estimate the azimuth of each divided sub-band signal, and then the estimated azimuths of multiple hydrophones are processed by using the data fusion technique. The high-resolution estimated result is achieved finally by adopting the weighted histogram statistics method. The results of the simulation and sea trials indicated that the proposed algorithm has better azimuth estimation performance than MUSIC algorithm of a single vector hydrophone and the data fusion technique based on the acoustic energy flux method. The better performance is reflected in the aspects of the estimation precision, the probability of correct estimation, the capability to distinguish multi-objects and the inhibition of the noise sub-bands.展开更多
Agricultural applications of remote sensing data typically require high spatial resolution and frequent observations.The increasing availability of high spatial resolution imagery meets the spatial resolution requirem...Agricultural applications of remote sensing data typically require high spatial resolution and frequent observations.The increasing availability of high spatial resolution imagery meets the spatial resolution requirement well.However,the long revisit period and frequent cloud contamination severely compromise their ability to monitor crop growth,which is characterized by high temporal heterogeneity.Many spatiotemporal fusion methods have been developed to produce synthetic images with high spatial and temporal resolutions.However,these existing methods focus on fusing low and medium spatial resolution satellite data in terms of model development and validation.When it comes to fusing medium and high spatial resolution images,the applicability remains unknown and may face various challenges.To address this issue,we propose a novel spatiotemporal fusion method,the dual-stream spatiotemporal decoupling fusion architecture model,to fully realize the prediction of high spatial resolution images.Compared with other fusion methods,the model has distinct advantages:(a)It maintains high fusion accuracy and good spatial detail by combining deep-learning-based super-resolution method and partial least squares regression model through edge and color-based weighting loss function;and(b)it demonstrates improved transferability over time by introducing image gradient maps and partial least squares regression model.We tested the StarFusion model at 3 experimental sites and compared it with 4 traditional methods:STARFM(spatial and temporal adaptive reflectance fusion),FSDAF(flexible spatiotemporal data fusion),Fit-FC(regression model fitting,spatial filtering,and residual compensation),FIRST(fusion incorporating spectral autocorrelation),and a deep learning base method-super-resolution generative adversarial network.In addition,we also investigated the possibility of our method to use multiple pairs of coarse and fine images in the training process.The results show that multiple pairs of images provide better overall performance but both of them are better than other comparison methods.Considering the difficulty in obtaining multiple cloud-free image pairs in practice,our method is recommended to provide high-quality Gaofen-1 data with improved temporal resolution in most cases since the performance degradation of single pair is not significant.展开更多
While automatic image captioning systems have made notable progress in the past few years,generating captions that fully convey sentiment remains a considerable challenge.Although existing models achieve strong perfor...While automatic image captioning systems have made notable progress in the past few years,generating captions that fully convey sentiment remains a considerable challenge.Although existing models achieve strong performance in visual recognition and factual description,they often fail to account for the emotional context that is naturally present in human-generated captions.To address this gap,we propose the Sentiment-Driven Caption Generator(SDCG),which combines transformer-based visual and textual processing withmulti-level fusion.RoBERTa is used for extracting sentiment from textual input,while visual features are handled by the Vision Transformer(ViT).These features are fused using several fusion approaches,including Concatenation,Attention,Visual-Sentiment Co-Attention(VSCA),and Cross-Attention.Our experiments demonstrate that SDCG significantly outperforms baseline models such as the Generalized Image Transformer(GIT),which achieves 82.01%,and Bootstrapping Language-Image Pre-training(BLIP),which achieves 83.07%,in sentiment accuracy.While SDCG achieves 94.52%sentiment accuracy and improves scores in BLEU and ROUGE-L,the model demonstrates clear advantages.More importantly,the captions aremore natural,as they incorporate emotional cues and contextual awareness,making them resemble those written by a human.展开更多
The control rod drive mechanism(CRDM)is an essential part of the control and safety protection system of pressurized water reactors.Current CRDM simulations are mostly performed collectively using a single method,igno...The control rod drive mechanism(CRDM)is an essential part of the control and safety protection system of pressurized water reactors.Current CRDM simulations are mostly performed collectively using a single method,ignoring the influence of multiple motion units and the differences in various features among them,which strongly affect the efficiency and accuracy of the simulations.In this study,we constructed a flow field fusion simulation method based on model features by combining key motion unit analysis and various simulation methods and then applied the method to the CRDM simulation process.CRDM performs motion unit decomposition through the structural hierarchy of function-movement-action method,and the key meta-actions are identified as the nodes in the flow field simulation.We established a fused feature-based multimethod simulation process and processed the simulation methods and data according to the features of the fluid domain space and the structural complexity to obtain the fusion simulation results.Compared to traditional simulation methods and real measurements,the simulation method provides advantages in terms of simulation efficiency and accuracy.展开更多
Lithium-ion batteries are the main power supply equipment in many fields due to their advantages of no memory, high energy density, long cycle life and no pollution to the environment. Accurate prediction for the rema...Lithium-ion batteries are the main power supply equipment in many fields due to their advantages of no memory, high energy density, long cycle life and no pollution to the environment. Accurate prediction for the remaining useful life(RUL) of lithium-ion batteries can avoid serious economic and safety problems such as spontaneous combustion. At present, most of the RUL prediction studies ignore the lithium-ion battery capacity recovery phenomenon caused by the rest time between the charge and discharge cycles. In this paper, a fusion method based on Wasserstein generative adversarial network(GAN) is proposed. This method achieves a more reliable and accurate RUL prediction of lithium-ion batteries by combining the artificial neural network(ANN) model which takes the rest time between battery charging cycles into account and the empirical degradation models which provide the correct degradation trend. The weight of each model is calculated by the discriminator in the Wasserstein GAN model. Four data sets of lithium-ion battery provided by the National Aeronautics and Space Administration(NASA) Ames Research Center are used to prove the feasibility and accuracy of the proposed method.展开更多
Considering that there is no single full reference image quality assessment method that could give the best performance in all situations, some multi-method fusion metrics were proposed. Machine learning techniques ar...Considering that there is no single full reference image quality assessment method that could give the best performance in all situations, some multi-method fusion metrics were proposed. Machine learning techniques are often involved in such multi-method fusion metrics so that its output would be more consistent with human visual perceptions. On the other hand, the robustness and generalization ability of these multi-method fusion metrics are questioned because of the scarce of images with mean opinion scores. In order to comprehensively validate whether or not the generalization ability of such multi-method fusion IQA metrics are satisfying, we construct a new image database which contains up to 60 reference images. The newly built image database is then used to test the generalization ability of different multi-method fusion IQA metrics. Cross database validation experiment indicates that in our new image database, the performances of all the multi-method fusion IQA metrics have no statistical significant different with some single-method IQA metrics such as FSIM and MAD. In the end, a thorough analysis is given to explain why the performance of multi-method fusion IQA framework drop significantly in cross database validation.展开更多
The problem of the unmanned surface vessel (USV) path planning in static and dynamic obstacle environments is addressed in this paper. Multi-behavior fusion based potential field method is proposed, which contains thr...The problem of the unmanned surface vessel (USV) path planning in static and dynamic obstacle environments is addressed in this paper. Multi-behavior fusion based potential field method is proposed, which contains three behaviors: goal-seeking, boundary-memory following and dynamic-obstacle avoidance. Then, different activation conditions are designed to determine the current behavior. Meanwhile, information on the positions, velocities and the equation of motion for obstacles are detected and calculated by sensor data. Besides, memory information is introduced into the boundary following behavior to enhance cognition capability for the obstacles, and avoid local minima problem caused by the potential field method. Finally, the results of theoretical analysis and simulation show that the collision-free path can be generated for USV within different obstacle environments, and further validated the performance and effectiveness of the presented strategy.展开更多
The current life-prediction models for lithium-ion batteries have several problems, such as the construction of complex feature structures, a high number of feature dimensions, and inaccurate prediction results. To ov...The current life-prediction models for lithium-ion batteries have several problems, such as the construction of complex feature structures, a high number of feature dimensions, and inaccurate prediction results. To overcome these problems, this paper proposes a deep-learning model combining an autoencoder network and a long short-term memory network. First, this model applies the characteristics of the autoencoder to reduce the dimensionality of the high-dimensional features extracted from the battery data set and realize the fusion of complex time-domain features, which overcomes the problems of redundant model information and low computational efficiency. This model then uses a long short-term memory network that is sensitive to time-series data to solve the long-path dependence problem in the prediction of battery life. Lastly, the attention mechanism is used to give greater weight to features that have a greater impact on the target value, which enhances the learning effect of the model on the long input sequence. To verify the efficacy of the proposed model, this paper uses NASA's lithium-ion battery cycle life data set.展开更多
为提高热负荷预测的精度,提升基于负荷预测的供热系统调控效果,提出一种基于特征融合的供热系统预测调控方法。首先,采用偏自相关函数(partial autocorrelation function,PACF)、Pearson相关系数和最大信息系数(maximum information coe...为提高热负荷预测的精度,提升基于负荷预测的供热系统调控效果,提出一种基于特征融合的供热系统预测调控方法。首先,采用偏自相关函数(partial autocorrelation function,PACF)、Pearson相关系数和最大信息系数(maximum information coefficient,MIC)相结合的特征选择方法来确定预测模型的基本特征;然后,使用线性回归融合、指数融合和主成分分析融合对基本特征进行融合,应用递归MLR预测确定最佳融合方法,进一步对比在最佳融合策略下递归MLR、PSO-SVR、CNN和XGBoost中效果最优的预测方法;最后,将辨识出的融合方法和预测模型方法用于实际热力站调控。结果显示,基于线性回归融合的XGboost预测方法效果最好,可以提升训练精度并减少计算时间,同时可以有效指导调控,节热率达到4%以上。展开更多
The accurate estimation of parameters is the premise for establishing a high-fidelity simulation model of a valve-controlled cylinder system.Bench test data are easily obtained,but it is challenging to emulate actual ...The accurate estimation of parameters is the premise for establishing a high-fidelity simulation model of a valve-controlled cylinder system.Bench test data are easily obtained,but it is challenging to emulate actual loads in the research on parameter estimation of valve-controlled cylinder system.Despite the actual load information contained in the operating data of the control valve,its acquisition remains challenging.This paper proposes a method that fuses bench test and operating data for parameter estimation to address the aforementioned problems.The proposed method is based on Bayesian theory,and its core is a pool fusion of prior information from bench test and operating data.Firstly,a system model is established,and the parameters in the model are analysed.Secondly,the bench and operating data of the system are collected.Then,the model parameters and weight coefficients are estimated using the data fusion method.Finally,the estimated effects of the data fusion method,Bayesian method,and particle swarm optimisation(PSO)algorithm on system model parameters are compared.The research shows that the weight coefficient represents the contribution of different prior information to the parameter estimation result.The effect of parameter estimation based on the data fusion method is better than that of the Bayesian method and the PSO algorithm.Increasing load complexity leads to a decrease in model accuracy,highlighting the crucial role of the data fusion method in parameter estimation studies.展开更多
Human posture estimation is a prominent research topic in the fields of human-com-puter interaction,motion recognition,and other intelligent applications.However,achieving highaccuracy in key point localization,which ...Human posture estimation is a prominent research topic in the fields of human-com-puter interaction,motion recognition,and other intelligent applications.However,achieving highaccuracy in key point localization,which is crucial for intelligent applications,contradicts the lowdetection accuracy of human posture detection models in practical scenarios.To address this issue,a human pose estimation network called AT-HRNet has been proposed,which combines convolu-tional self-attention and cross-dimensional feature transformation.AT-HRNet captures significantfeature information from various regions in an adaptive manner,aggregating them through convolu-tional operations within the local receptive domain.The residual structures TripNeck and Trip-Block of the high-resolution network are designed to further refine the key point locations,wherethe attention weight is adjusted by a cross-dimensional interaction to obtain more features.To vali-date the effectiveness of this network,AT-HRNet was evaluated using the COCO2017 dataset.Theresults show that AT-HRNet outperforms HRNet by improving 3.2%in mAP,4.0%in AP75,and3.9%in AP^(M).This suggests that AT-HRNet can offer more beneficial solutions for human posture estimation.展开更多
Content-based medical image retrieval(CBMIR)is a technique for retrieving medical images based on automatically derived image features.There are many applications of CBMIR,such as teaching,research,diagnosis and elect...Content-based medical image retrieval(CBMIR)is a technique for retrieving medical images based on automatically derived image features.There are many applications of CBMIR,such as teaching,research,diagnosis and electronic patient records.Several methods are applied to enhance the retrieval performance of CBMIR systems.Developing new and effective similarity measure and features fusion methods are two of the most powerful and effective strategies for improving these systems.This study proposes the relative difference-based similarity measure(RDBSM)for CBMIR.The new measure was first used in the similarity calculation stage for the CBMIR using an unweighted fusion method of traditional color and texture features.Furthermore,the study also proposes a weighted fusion method for medical image features extracted using pre-trained convolutional neural networks(CNNs)models.Our proposed RDBSM has outperformed the standard well-known similarity and distance measures using two popular medical image datasets,Kvasir and PH2,in terms of recall and precision retrieval measures.The effectiveness and quality of our proposed similarity measure are also proved using a significant test and statistical confidence bound.展开更多
The development of network and information technology has brought changes to the production environment of scientific and technological information,leading to the integration of multi-type scien-tific and technologica...The development of network and information technology has brought changes to the production environment of scientific and technological information,leading to the integration of multi-type scien-tific and technological information,which has become one of the primary research focuses in the cur-rent field of scientific and technological information analysis.This article proposes a basic mode to realize the fusion of multi-type scientific and technological information,expounds the corresponding basic construction method,and applies it to the scientific and technological topics identification in the field of artificial intelligence(AI).The research results show that the multi-type scientific and technological information fusion mode proposed in this article has certain feasibility in specific appli-cation scenarios,which lays a foundation for the subsequent research work.展开更多
English is one of the core subjects in compulsory education. To carry out English teaching in a scientific and reasonable way is of great significance to the cultivation of primary school students' core qualities ...English is one of the core subjects in compulsory education. To carry out English teaching in a scientific and reasonable way is of great significance to the cultivation of primary school students' core qualities such as language ability, cultural awareness and learning ability. Using English picture books to carry out reading teaching is a new trend in English teaching in recent years. There are many stories with complete context in English picture books. Using these stories to carry out English teaching can on the one hand stimulate students' interest in learning English, and on the other hand help students get more language input. In view of this, it is very necessary to promote the integration of primary school English picture books reading and main textbooks. Therefore, based on my own teaching experience, the author explores the strategy of integrating English picture books with main textbooks in order to provide theoretical basis for primary school English teachers' teaching.展开更多
Effect of various spatial and energy distributions of fusion neutron sourceon the calculation of neutron wall loading of Tokamak D-D fusion device has been investigated bymeans of the 3-D Monte Carlo code MCNP. A real...Effect of various spatial and energy distributions of fusion neutron sourceon the calculation of neutron wall loading of Tokamak D-D fusion device has been investigated bymeans of the 3-D Monte Carlo code MCNP. A realistic Monte Carlo source model was developed based onthe accurate representation of the spatial distribution and energy spectrum of fusion neutrons tosolve the complicated problem of tokamak fusion neutron source modelling. The results show thatthose simplified source models will introduce significant uncertainties. For accurate estimation ofthe key nuclear responses of the tokamak design and analyses, the use of the realistic source isrecommended. In addition, the accumulation of tritium produced during D-D plasma operation should becarefully considered.展开更多
基金Supported by the National Key R&D Program of China (No.2023YFC3008100)the National Natural Science Foundation of China (No.U23A2033)
文摘Considering the difficulty of integrating the depth points of nautical charts of the East China Sea into a global high-precision Grid Digital Elevation Model(Grid-DEM),we proposed a“Fusion based on Image Recognition(FIR)”method for multi-sourced depth data fusion,and used it to merge the electronic nautical chart dataset(referred to as Chart2014 in this paper)with the global digital elevation dataset(referred to as Globalbath2002 in this paper).Compared to the traditional fusion of two datasets by direct combination and interpolation,the new Grid-DEM formed by FIR can better represent the data characteristics of Chart2014,reduce the calculation difficulty,and be more intuitive,and,the choice of different interpolation methods in FIR and the influence of the“exclusion radius R”parameter were discussed.FIR avoids complex calculations of spatial distances among points from different sources,and instead uses spatial exclusion map to perform one-step screening based on the exclusion radius R,which greatly improved the fusion status of a reliable dataset.The fusion results of different experiments were analyzed statistically with root mean square error and mean relative error,showing that the interpolation methods based on Delaunay triangulation are more suitable for the fusion of nautical chart depth of China,and factors such as the point density distribution of multiple source data,accuracy,interpolation method,and various terrain conditions should be fully considered when selecting the exclusion radius R.
基金funded by National Natural Science Foundation of China(Grant Nos.42272333,42277147).
文摘Refined 3D modeling of mine slopes is pivotal for precise prediction of geological hazards.Aiming at the inadequacy of existing single modeling methods in comprehensively representing the overall and localized characteristics of mining slopes,this study introduces a new method that fuses model data from Unmanned aerial vehicles(UAV)tilt photogrammetry and 3D laser scanning through a data alignment algorithm based on control points.First,the mini batch K-Medoids algorithm is utilized to cluster the point cloud data from ground 3D laser scanning.Then,the elbow rule is applied to determine the optimal cluster number(K0),and the feature points are extracted.Next,the nearest neighbor point algorithm is employed to match the feature points obtained from UAV tilt photogrammetry,and the internal point coordinates are adjusted through the distanceweighted average to construct a 3D model.Finally,by integrating an engineering case study,the K0 value is determined to be 8,with a matching accuracy between the two model datasets ranging from 0.0669 to 1.0373 mm.Therefore,compared with the modeling method utilizing K-medoids clustering algorithm,the new modeling method significantly enhances the computational efficiency,the accuracy of selecting the optimal number of feature points in 3D laser scanning,and the precision of the 3D model derived from UAV tilt photogrammetry.This method provides a research foundation for constructing mine slope model.
基金The National Key Research and Development Program of China under contract Nos 2016YFC1400901 and 2018YFC1406600the National Natural Science Foundation of China under contract No.40706057+1 种基金the Environmental Protection and Science and Technology Plan Project of Zhejiang Province of China under contract No.2013A021the Research Center for Air Pollution and Health of Zhejiang University
文摘Satellite remote sensing of inland water body requires a high spatial resolution and a multiband narrow spectral resolution, which makes the fusion between panchromatic(PAN) and multi-spectral(MS) images particularly important. Taking the Daquekou section of the Qiantang River as an observation target, four conventional fusion methods widely accepted in satellite image processing, including pan sharpening(PS), principal component analysis(PCA), Gram-Schmidt(GS), and wavelet fusion(WF), are utilized to fuse MS and PAN images of GF-1.The results of subjective and objective evaluation methods application indicate that GS performs the best,followed by the PCA, the WF and the PS in the order of descending. The existence of a large area of the water body is a dominant factor impacting the fusion performance. Meanwhile, the ability of retaining spatial and spectral informations is an important factor affecting the fusion performance of different fusion methods. The fundamental difference of reflectivity information acquisition between water and land is the reason for the failure of conventional fusion methods for land observation such as the PS to be used in the presence of the large water body. It is suggested that the adoption of the conventional fusion methods in the observing water body as the main target should be taken with caution. The performances of the fusion methods need re-assessment when the large-scale water body is present in the remote sensing image or when the research aims for the water body observation.
基金the leaders of the State Key Laboratory of Acoustics Institute of Acoustics,Chinese Academy of Sciences,for their project support
文摘To aim at the problem that the horizontal directivity index of the vector hy- drophone vertical array is not higher than that of a vector hydrophone, the high-resolution azimuth estimation algorithm based on the data fusion method was presented. The proposed algorithnl first employs MUSIC algorithm to estimate the azimuth of each divided sub-band signal, and then the estimated azimuths of multiple hydrophones are processed by using the data fusion technique. The high-resolution estimated result is achieved finally by adopting the weighted histogram statistics method. The results of the simulation and sea trials indicated that the proposed algorithm has better azimuth estimation performance than MUSIC algorithm of a single vector hydrophone and the data fusion technique based on the acoustic energy flux method. The better performance is reflected in the aspects of the estimation precision, the probability of correct estimation, the capability to distinguish multi-objects and the inhibition of the noise sub-bands.
基金supported by High-Resolution Earth Observation System(09-Y30F01-9001-20/22).
文摘Agricultural applications of remote sensing data typically require high spatial resolution and frequent observations.The increasing availability of high spatial resolution imagery meets the spatial resolution requirement well.However,the long revisit period and frequent cloud contamination severely compromise their ability to monitor crop growth,which is characterized by high temporal heterogeneity.Many spatiotemporal fusion methods have been developed to produce synthetic images with high spatial and temporal resolutions.However,these existing methods focus on fusing low and medium spatial resolution satellite data in terms of model development and validation.When it comes to fusing medium and high spatial resolution images,the applicability remains unknown and may face various challenges.To address this issue,we propose a novel spatiotemporal fusion method,the dual-stream spatiotemporal decoupling fusion architecture model,to fully realize the prediction of high spatial resolution images.Compared with other fusion methods,the model has distinct advantages:(a)It maintains high fusion accuracy and good spatial detail by combining deep-learning-based super-resolution method and partial least squares regression model through edge and color-based weighting loss function;and(b)it demonstrates improved transferability over time by introducing image gradient maps and partial least squares regression model.We tested the StarFusion model at 3 experimental sites and compared it with 4 traditional methods:STARFM(spatial and temporal adaptive reflectance fusion),FSDAF(flexible spatiotemporal data fusion),Fit-FC(regression model fitting,spatial filtering,and residual compensation),FIRST(fusion incorporating spectral autocorrelation),and a deep learning base method-super-resolution generative adversarial network.In addition,we also investigated the possibility of our method to use multiple pairs of coarse and fine images in the training process.The results show that multiple pairs of images provide better overall performance but both of them are better than other comparison methods.Considering the difficulty in obtaining multiple cloud-free image pairs in practice,our method is recommended to provide high-quality Gaofen-1 data with improved temporal resolution in most cases since the performance degradation of single pair is not significant.
基金funded by the Committee of Science of the Ministry of Science andHigher Education of the Republic of Kazakhstan(Grant No.BR24993166).
文摘While automatic image captioning systems have made notable progress in the past few years,generating captions that fully convey sentiment remains a considerable challenge.Although existing models achieve strong performance in visual recognition and factual description,they often fail to account for the emotional context that is naturally present in human-generated captions.To address this gap,we propose the Sentiment-Driven Caption Generator(SDCG),which combines transformer-based visual and textual processing withmulti-level fusion.RoBERTa is used for extracting sentiment from textual input,while visual features are handled by the Vision Transformer(ViT).These features are fused using several fusion approaches,including Concatenation,Attention,Visual-Sentiment Co-Attention(VSCA),and Cross-Attention.Our experiments demonstrate that SDCG significantly outperforms baseline models such as the Generalized Image Transformer(GIT),which achieves 82.01%,and Bootstrapping Language-Image Pre-training(BLIP),which achieves 83.07%,in sentiment accuracy.While SDCG achieves 94.52%sentiment accuracy and improves scores in BLEU and ROUGE-L,the model demonstrates clear advantages.More importantly,the captions aremore natural,as they incorporate emotional cues and contextual awareness,making them resemble those written by a human.
基金supported by the National Natural Science Foundation of China (No. 52075350)the Special City School Strategic Cooperation Project of Sichuan University and Zigong (No.2021CDZG-3)
文摘The control rod drive mechanism(CRDM)is an essential part of the control and safety protection system of pressurized water reactors.Current CRDM simulations are mostly performed collectively using a single method,ignoring the influence of multiple motion units and the differences in various features among them,which strongly affect the efficiency and accuracy of the simulations.In this study,we constructed a flow field fusion simulation method based on model features by combining key motion unit analysis and various simulation methods and then applied the method to the CRDM simulation process.CRDM performs motion unit decomposition through the structural hierarchy of function-movement-action method,and the key meta-actions are identified as the nodes in the flow field simulation.We established a fused feature-based multimethod simulation process and processed the simulation methods and data according to the features of the fluid domain space and the structural complexity to obtain the fusion simulation results.Compared to traditional simulation methods and real measurements,the simulation method provides advantages in terms of simulation efficiency and accuracy.
基金supported by the Project of the New Touch Integrated Display Module,New Intelligent Manufacturing Mode Application,Ministry of Industry and Information Technology, 2017.
文摘Lithium-ion batteries are the main power supply equipment in many fields due to their advantages of no memory, high energy density, long cycle life and no pollution to the environment. Accurate prediction for the remaining useful life(RUL) of lithium-ion batteries can avoid serious economic and safety problems such as spontaneous combustion. At present, most of the RUL prediction studies ignore the lithium-ion battery capacity recovery phenomenon caused by the rest time between the charge and discharge cycles. In this paper, a fusion method based on Wasserstein generative adversarial network(GAN) is proposed. This method achieves a more reliable and accurate RUL prediction of lithium-ion batteries by combining the artificial neural network(ANN) model which takes the rest time between battery charging cycles into account and the empirical degradation models which provide the correct degradation trend. The weight of each model is calculated by the discriminator in the Wasserstein GAN model. Four data sets of lithium-ion battery provided by the National Aeronautics and Space Administration(NASA) Ames Research Center are used to prove the feasibility and accuracy of the proposed method.
基金supported by “the Fundamental Research Funds for the Central Universities” No.2018CUCTJ081
文摘Considering that there is no single full reference image quality assessment method that could give the best performance in all situations, some multi-method fusion metrics were proposed. Machine learning techniques are often involved in such multi-method fusion metrics so that its output would be more consistent with human visual perceptions. On the other hand, the robustness and generalization ability of these multi-method fusion metrics are questioned because of the scarce of images with mean opinion scores. In order to comprehensively validate whether or not the generalization ability of such multi-method fusion IQA metrics are satisfying, we construct a new image database which contains up to 60 reference images. The newly built image database is then used to test the generalization ability of different multi-method fusion IQA metrics. Cross database validation experiment indicates that in our new image database, the performances of all the multi-method fusion IQA metrics have no statistical significant different with some single-method IQA metrics such as FSIM and MAD. In the end, a thorough analysis is given to explain why the performance of multi-method fusion IQA framework drop significantly in cross database validation.
基金financially supported by the National Natural Science Foundation of China(Grant No.51879049)DK-I Dynamic Positioning System Console Project
文摘The problem of the unmanned surface vessel (USV) path planning in static and dynamic obstacle environments is addressed in this paper. Multi-behavior fusion based potential field method is proposed, which contains three behaviors: goal-seeking, boundary-memory following and dynamic-obstacle avoidance. Then, different activation conditions are designed to determine the current behavior. Meanwhile, information on the positions, velocities and the equation of motion for obstacles are detected and calculated by sensor data. Besides, memory information is introduced into the boundary following behavior to enhance cognition capability for the obstacles, and avoid local minima problem caused by the potential field method. Finally, the results of theoretical analysis and simulation show that the collision-free path can be generated for USV within different obstacle environments, and further validated the performance and effectiveness of the presented strategy.
基金supported by the National Natural Science Foundation of China (No.61871350)the Zhejiang Science and Technology Plan Project (No.2019C011123)the Zhejiang Province Basic Public Welfare Research Project (No.LGG19F030011)。
文摘The current life-prediction models for lithium-ion batteries have several problems, such as the construction of complex feature structures, a high number of feature dimensions, and inaccurate prediction results. To overcome these problems, this paper proposes a deep-learning model combining an autoencoder network and a long short-term memory network. First, this model applies the characteristics of the autoencoder to reduce the dimensionality of the high-dimensional features extracted from the battery data set and realize the fusion of complex time-domain features, which overcomes the problems of redundant model information and low computational efficiency. This model then uses a long short-term memory network that is sensitive to time-series data to solve the long-path dependence problem in the prediction of battery life. Lastly, the attention mechanism is used to give greater weight to features that have a greater impact on the target value, which enhances the learning effect of the model on the long input sequence. To verify the efficacy of the proposed model, this paper uses NASA's lithium-ion battery cycle life data set.
文摘为提高热负荷预测的精度,提升基于负荷预测的供热系统调控效果,提出一种基于特征融合的供热系统预测调控方法。首先,采用偏自相关函数(partial autocorrelation function,PACF)、Pearson相关系数和最大信息系数(maximum information coefficient,MIC)相结合的特征选择方法来确定预测模型的基本特征;然后,使用线性回归融合、指数融合和主成分分析融合对基本特征进行融合,应用递归MLR预测确定最佳融合方法,进一步对比在最佳融合策略下递归MLR、PSO-SVR、CNN和XGBoost中效果最优的预测方法;最后,将辨识出的融合方法和预测模型方法用于实际热力站调控。结果显示,基于线性回归融合的XGboost预测方法效果最好,可以提升训练精度并减少计算时间,同时可以有效指导调控,节热率达到4%以上。
基金Supported by National Key R&D Program of China(Grant Nos.2020YFB1709901,2020YFB1709904)National Natural Science Foundation of China(Grant Nos.51975495,51905460)+1 种基金Guangdong Provincial Basic and Applied Basic Research Foundation of China(Grant No.2021-A1515012286)Science and Technology Plan Project of Fuzhou City of China(Grant No.2022-P-022).
文摘The accurate estimation of parameters is the premise for establishing a high-fidelity simulation model of a valve-controlled cylinder system.Bench test data are easily obtained,but it is challenging to emulate actual loads in the research on parameter estimation of valve-controlled cylinder system.Despite the actual load information contained in the operating data of the control valve,its acquisition remains challenging.This paper proposes a method that fuses bench test and operating data for parameter estimation to address the aforementioned problems.The proposed method is based on Bayesian theory,and its core is a pool fusion of prior information from bench test and operating data.Firstly,a system model is established,and the parameters in the model are analysed.Secondly,the bench and operating data of the system are collected.Then,the model parameters and weight coefficients are estimated using the data fusion method.Finally,the estimated effects of the data fusion method,Bayesian method,and particle swarm optimisation(PSO)algorithm on system model parameters are compared.The research shows that the weight coefficient represents the contribution of different prior information to the parameter estimation result.The effect of parameter estimation based on the data fusion method is better than that of the Bayesian method and the PSO algorithm.Increasing load complexity leads to a decrease in model accuracy,highlighting the crucial role of the data fusion method in parameter estimation studies.
基金the National Natural Science Foundation of China(No.61975015)the Research and Innovation Project for Graduate Students at Zhongyuan University of Technology(No.YKY2024ZK14).
文摘Human posture estimation is a prominent research topic in the fields of human-com-puter interaction,motion recognition,and other intelligent applications.However,achieving highaccuracy in key point localization,which is crucial for intelligent applications,contradicts the lowdetection accuracy of human posture detection models in practical scenarios.To address this issue,a human pose estimation network called AT-HRNet has been proposed,which combines convolu-tional self-attention and cross-dimensional feature transformation.AT-HRNet captures significantfeature information from various regions in an adaptive manner,aggregating them through convolu-tional operations within the local receptive domain.The residual structures TripNeck and Trip-Block of the high-resolution network are designed to further refine the key point locations,wherethe attention weight is adjusted by a cross-dimensional interaction to obtain more features.To vali-date the effectiveness of this network,AT-HRNet was evaluated using the COCO2017 dataset.Theresults show that AT-HRNet outperforms HRNet by improving 3.2%in mAP,4.0%in AP75,and3.9%in AP^(M).This suggests that AT-HRNet can offer more beneficial solutions for human posture estimation.
基金funded by the Deanship of Scientific Research (DSR)at King Abdulaziz University,Jeddah,Saudi Arabia,Under Grant No. (G:146-830-1441).
文摘Content-based medical image retrieval(CBMIR)is a technique for retrieving medical images based on automatically derived image features.There are many applications of CBMIR,such as teaching,research,diagnosis and electronic patient records.Several methods are applied to enhance the retrieval performance of CBMIR systems.Developing new and effective similarity measure and features fusion methods are two of the most powerful and effective strategies for improving these systems.This study proposes the relative difference-based similarity measure(RDBSM)for CBMIR.The new measure was first used in the similarity calculation stage for the CBMIR using an unweighted fusion method of traditional color and texture features.Furthermore,the study also proposes a weighted fusion method for medical image features extracted using pre-trained convolutional neural networks(CNNs)models.Our proposed RDBSM has outperformed the standard well-known similarity and distance measures using two popular medical image datasets,Kvasir and PH2,in terms of recall and precision retrieval measures.The effectiveness and quality of our proposed similarity measure are also proved using a significant test and statistical confidence bound.
基金Supported by the National Natural Science Foundation of China(No.72074201).
文摘The development of network and information technology has brought changes to the production environment of scientific and technological information,leading to the integration of multi-type scien-tific and technological information,which has become one of the primary research focuses in the cur-rent field of scientific and technological information analysis.This article proposes a basic mode to realize the fusion of multi-type scientific and technological information,expounds the corresponding basic construction method,and applies it to the scientific and technological topics identification in the field of artificial intelligence(AI).The research results show that the multi-type scientific and technological information fusion mode proposed in this article has certain feasibility in specific appli-cation scenarios,which lays a foundation for the subsequent research work.
文摘English is one of the core subjects in compulsory education. To carry out English teaching in a scientific and reasonable way is of great significance to the cultivation of primary school students' core qualities such as language ability, cultural awareness and learning ability. Using English picture books to carry out reading teaching is a new trend in English teaching in recent years. There are many stories with complete context in English picture books. Using these stories to carry out English teaching can on the one hand stimulate students' interest in learning English, and on the other hand help students get more language input. In view of this, it is very necessary to promote the integration of primary school English picture books reading and main textbooks. Therefore, based on my own teaching experience, the author explores the strategy of integrating English picture books with main textbooks in order to provide theoretical basis for primary school English teachers' teaching.
基金The project supported partly by the National Science Foundation of Anhui Province (No. 0104360)
文摘Effect of various spatial and energy distributions of fusion neutron sourceon the calculation of neutron wall loading of Tokamak D-D fusion device has been investigated bymeans of the 3-D Monte Carlo code MCNP. A realistic Monte Carlo source model was developed based onthe accurate representation of the spatial distribution and energy spectrum of fusion neutrons tosolve the complicated problem of tokamak fusion neutron source modelling. The results show thatthose simplified source models will introduce significant uncertainties. For accurate estimation ofthe key nuclear responses of the tokamak design and analyses, the use of the realistic source isrecommended. In addition, the accumulation of tritium produced during D-D plasma operation should becarefully considered.
