The purpose of remote sensing images fusion is to produce a fused image that contains more clear,accurate and comprehensive information than any single image.A novel fusion method is proposed in this paper based on no...The purpose of remote sensing images fusion is to produce a fused image that contains more clear,accurate and comprehensive information than any single image.A novel fusion method is proposed in this paper based on nonsubsampled contourlet transform(NSCT) and region segmentation.Firstly,the multispectral image is transformed to intensity-hue-saturation(IHS) system.Secondly,the panchromatic image and the component intensity of the multispectral image are decomposed by NSCT.Then the NSCT coefficients of high and low frequency subbands are fused by different rules,respectively.For the high frequency subbands,the fusion rules are also unalike in the smooth and edge regions.The two regions are segregated in the panchromatic image,and the segmentation is based on particle swarm optimization.Finally,the fusion image can be obtained by performing inverse NSCT and inverse IHS transform.The experimental results are evaluated by both subjective and objective criteria.It is shown that the proposed method can obtain superior results to others.展开更多
Image registration is an indispensable component in multi-source remote sensing image processing. In this paper, we put forward a remote sensing image registration method by including an improved multi-scale and multi...Image registration is an indispensable component in multi-source remote sensing image processing. In this paper, we put forward a remote sensing image registration method by including an improved multi-scale and multi-direction Harris algorithm and a novel compound feature. Multi-scale circle Gaussian combined invariant moments and multi-direction gray level co-occurrence matrix are extracted as features for image matching. The proposed algorithm is evaluated on numerous multi-source remote sensor images with noise and illumination changes. Extensive experimental studies prove that our proposed method is capable of receiving stable and even distribution of key points as well as obtaining robust and accurate correspondence matches. It is a promising scheme in multi-source remote sensing image registration.展开更多
Urban waterlogging probability assessment is critical to emergency response and policymaking.Remote Sensing(RS)is a rich and reliable data source for waterlogging monitoring and evaluation through water body extractio...Urban waterlogging probability assessment is critical to emergency response and policymaking.Remote Sensing(RS)is a rich and reliable data source for waterlogging monitoring and evaluation through water body extraction derived from the pre-and post-disaster RS images.However,RS images are usually limited to the revisit cycle and cloud cover.To solve this issue,social media data have been considered as another data source which are immune to the weather such as clouds and can reflect the real-time public response for disaster,which leads itself a compensation for RS images.In this paper,we propose a coarse-to-fine waterlogging probability assessment framework based on multisource data including real-time social media data,near real-time RS image and historical geographic information,in which a coarse waterlogging probability map is refined by using the real-time information extracted from social media data to acquire a more accurate waterlogging probability.Firstly,to generate a coarse waterlogging probability map,the historical inundated areas are derived from Digital Elevation Model(DEM)and historical waterlogging points,then the geographic features are extracted from DEM and RS image,which will be input to a Random Forest(RF)classifier to estimate the likelihood of hazards.Secondly,the real-time waterlogging-related information is extracted from social media data,where the Convolutional Neural Network(CNN)model is applied to exploit the semantic information of sentences by capturing the local and position-invariant features using convolution kernel.Finally,fine waterlogging probability map scan be generated based on morphological method,in which real-time waterlogging-related social media data are taken as isolated highlight point and used to refine the coarse waterlogging probability map by a gray dilation pattern considering the distance-decay effect.The 2016 Wuhan waterlogging and 2018 Chengdu water-logging are taken as case studies to demonstrate the effectiveness of the proposed framework.It can be concluded from the results that by integrating RS image and social media data,more accurate waterlogging probability maps can be generated,which can be further applied for inundated areas identification and disaster monitoring.展开更多
A new method based on resolution degradation model is proposed to improve both spatial and spectral quality of the synthetic images.Some ETM+panchromatic and multispectral images are used to assess the new method.Its ...A new method based on resolution degradation model is proposed to improve both spatial and spectral quality of the synthetic images.Some ETM+panchromatic and multispectral images are used to assess the new method.Its spatial and spectral effects are evaluated by qualitative and quantitative measures and the results are compared with those of IHS,PCA,Brovey,OWT(Orthogonal Wavelet Transform)and RWT(Redundant Wavelet Transform).The results show that the new method can keep almost the same spatial resolution as the panchromatic images,and the spectral effect of the new method is as good as those of wavelet-based methods.展开更多
The degradation of optical remote sensing images due to atmospheric haze poses a significant obstacle,profoundly impeding their effective utilization across various domains.Dehazing methodologies have emerged as pivot...The degradation of optical remote sensing images due to atmospheric haze poses a significant obstacle,profoundly impeding their effective utilization across various domains.Dehazing methodologies have emerged as pivotal components of image preprocessing,fostering an improvement in the quality of remote sensing imagery.This enhancement renders remote sensing data more indispensable,thereby enhancing the accuracy of target iden-tification.Conventional defogging techniques based on simplistic atmospheric degradation models have proven inadequate for mitigating non-uniform haze within remotely sensed images.In response to this challenge,a novel UNet Residual Attention Network(URA-Net)is proposed.This paradigmatic approach materializes as an end-to-end convolutional neural network distinguished by its utilization of multi-scale dense feature fusion clusters and gated jump connections.The essence of our methodology lies in local feature fusion within dense residual clusters,enabling the extraction of pertinent features from both preceding and current local data,depending on contextual demands.The intelligently orchestrated gated structures facilitate the propagation of these features to the decoder,resulting in superior outcomes in haze removal.Empirical validation through a plethora of experiments substantiates the efficacy of URA-Net,demonstrating its superior performance compared to existing methods when applied to established datasets for remote sensing image defogging.On the RICE-1 dataset,URA-Net achieves a Peak Signal-to-Noise Ratio(PSNR)of 29.07 dB,surpassing the Dark Channel Prior(DCP)by 11.17 dB,the All-in-One Network for Dehazing(AOD)by 7.82 dB,the Optimal Transmission Map and Adaptive Atmospheric Light For Dehazing(OTM-AAL)by 5.37 dB,the Unsupervised Single Image Dehazing(USID)by 8.0 dB,and the Superpixel-based Remote Sensing Image Dehazing(SRD)by 8.5 dB.Particularly noteworthy,on the SateHaze1k dataset,URA-Net attains preeminence in overall performance,yielding defogged images characterized by consistent visual quality.This underscores the contribution of the research to the advancement of remote sensing technology,providing a robust and efficient solution for alleviating the adverse effects of haze on image quality.展开更多
IHS （Intensity, Hue and Saturation） transform is one of the most commonly used tusion algonthm. But the matching error causes spectral distortion and degradation in processing of image fusion with IHS method. A stud...IHS （Intensity, Hue and Saturation） transform is one of the most commonly used tusion algonthm. But the matching error causes spectral distortion and degradation in processing of image fusion with IHS method. A study on IHS fusion indicates that the color distortion can＇t be avoided. Meanwhile, the statistical property of wavelet coefficient with wavelet decomposition reflects those significant features, such as edges, lines and regions. So, a united optimal fusion method, which uses the statistical property and IHS transform on pixel and feature levels, is proposed. That is, the high frequency of intensity component Ⅰ is fused on feature level with multi-resolution wavelet in IHS space. And the low frequency of intensity component Ⅰ is fused on pixel level with optimal weight coefficients. Spectral information and spatial resolution are two performance indexes of optimal weight coefficients. Experiment results with QuickBird data of Shanghai show that it is a practical and effective method.展开更多
Preserving biodiversity and maintaining ecological balance is essential in current environmental conditions.It is challenging to determine vegetation using traditional map classification approaches.The primary issue i...Preserving biodiversity and maintaining ecological balance is essential in current environmental conditions.It is challenging to determine vegetation using traditional map classification approaches.The primary issue in detecting vegetation pattern is that it appears with complex spatial structures and similar spectral properties.It is more demandable to determine the multiple spectral ana-lyses for improving the accuracy of vegetation mapping through remotely sensed images.The proposed framework is developed with the idea of ensembling three effective strategies to produce a robust architecture for vegetation mapping.The architecture comprises three approaches,feature-based approach,region-based approach,and texture-based approach for classifying the vegetation area.The novel Deep Meta fusion model(DMFM)is created with a unique fusion frame-work of residual stacking of convolution layers with Unique covariate features(UCF),Intensity features(IF),and Colour features(CF).The overhead issues in GPU utilization during Convolution neural network(CNN)models are reduced here with a lightweight architecture.The system considers detailing feature areas to improve classification accuracy and reduce processing time.The proposed DMFM model achieved 99%accuracy,with a maximum processing time of 130 s.The training,testing,and validation losses are degraded to a significant level that shows the performance quality with the DMFM model.The system acts as a standard analysis platform for dynamic datasets since all three different fea-tures,such as Unique covariate features(UCF),Intensity features(IF),and Colour features(CF),are considered very well.展开更多
In order to improve the accuracy of building structure identification using remote sensing images,a building structure classification method based on multi-feature fusion of UAV remote sensing image is proposed in thi...In order to improve the accuracy of building structure identification using remote sensing images,a building structure classification method based on multi-feature fusion of UAV remote sensing image is proposed in this paper.Three identification approaches of remote sensing images are integrated in this method:object-oriented,texture feature,and digital elevation based on DSM and DEM.So RGB threshold classification method is used to classify the identification results.The accuracy of building structure classification based on each feature and the multi-feature fusion are compared and analyzed.The results show that the building structure classification method is feasible and can accurately identify the structures in large-area remote sensing images.展开更多
As a means of copyright protection for multimedia data, digital watermarking technology has attracted more and more attention in various research fields. Researchers have begun to explore the feasibility of applying i...As a means of copyright protection for multimedia data, digital watermarking technology has attracted more and more attention in various research fields. Researchers have begun to explore the feasibility of applying it to remote sensing data recently. Because of the particularity of remote sensing image, higher requirements are put forward for its security and management, especially for the copyright protection, illegal use and authenticity identification of remote sensing image data. Therefore, this paper proposes to use image watermarking technology to achieve comprehensive security protection of remote sensing image data, while the use of cryptography technology increases the applicability and security of watermarking technology. The experimental results show that the scheme of remote sensing image digital watermarking technology has good performance in the imperceptibility and robustness of watermarking.展开更多
Semantic segmentation of remote sensing images is one of the core tasks of remote sensing image interpretation.With the continuous develop-ment of artificial intelligence technology,the use of deep learning methods fo...Semantic segmentation of remote sensing images is one of the core tasks of remote sensing image interpretation.With the continuous develop-ment of artificial intelligence technology,the use of deep learning methods for interpreting remote-sensing images has matured.Existing neural networks disregard the spatial relationship between two targets in remote sensing images.Semantic segmentation models that combine convolutional neural networks(CNNs)and graph convolutional neural networks(GCNs)cause a lack of feature boundaries,which leads to the unsatisfactory segmentation of various target feature boundaries.In this paper,we propose a new semantic segmentation model for remote sensing images(called DGCN hereinafter),which combines deep semantic segmentation networks(DSSN)and GCNs.In the GCN module,a loss function for boundary information is employed to optimize the learning of spatial relationship features between the target features and their relationships.A hierarchical fusion method is utilized for feature fusion and classification to optimize the spatial relationship informa-tion in the original feature information.Extensive experiments on ISPRS 2D and DeepGlobe semantic segmentation datasets show that compared with the existing semantic segmentation models of remote sensing images,the DGCN significantly optimizes the segmentation effect of feature boundaries,effectively reduces the noise in the segmentation results and improves the segmentation accuracy,which demonstrates the advancements of our model.展开更多
Indeed,a range of systems in the environment requires timely,spatially explicit,and credible information to support its environmental decision-making,but no one observing system can give the complete and reliable meas...Indeed,a range of systems in the environment requires timely,spatially explicit,and credible information to support its environmental decision-making,but no one observing system can give the complete and reliable measures of the Earth system across scales.This review summarizes how the realization of the Compute the Planet is underway in the form of machine learning,remote sensing,and sensor data fusion to generate decision-ready environmental insights.We use the application-first approach,which considers remote sensing,in situ and Internet of Things(IoT)sensing,and physics-based models as complementary streams of evidence with similar strengths and failures.We look critically at how an integrated system can convert heterogeneous observations to action products across three high impact application areas:atmosphere and air quality,water–land–ecosystem dynamics,and hazards.Rapid-response situational awareness,ecosystem condition metrics,drought and flood indicators,exposure maps,and hazard/extreme indicators are key products.The integrated systems to environment interface in three high impact application areas:atmosphere and air quality,water-land-ecosystem dynamics,and hazard Examine Our operational requirements can often determine real-life value such as latency,time stability,smooth degradation in the presence of missing or degraded inputs,and calibrated uncertainty usable in thresholdbased decisions.These pitfalls are common across fields:mismatch in the scale between a point sensor and a gridded product,objectives on proxies in remotely sensed measurements,domain shift in the extremes and changing baselines,and evaluation aspects,which overestimate generalization because of spatiotemporal autocorrelation.Based on these lessons,we present cross-domain proposals for strong validation,uncertainty quantification,provenance,and versioning,as well as fair performance evaluation.We conclude that the next era of environmental intelligence will see a reduction in average accuracy improvement and an increase in terms of robustness,transparency,and operational responsibility,thus allowing the integrated environmental intelligence system to be deployed,which may be relied on to monitor human health,resource allocation,and survival in a more climate-adapted world.展开更多
Global-scale land cover characterization has advanced from a spatial resolution of 1×1°in the mid-1990s to 30×30 m resolution to date.However,some mapping challenges exist persistently regardless of the...Global-scale land cover characterization has advanced from a spatial resolution of 1×1°in the mid-1990s to 30×30 m resolution to date.However,some mapping challenges exist persistently regardless of the increasing spatial resolution.Data fusion has been proved as an effective way of improving land cover characterization.Here we applied a machine learning-based data integration approach for improving global-scale forest cover characterization.The approach employed six coarse-resolution(250-1000 m)global land cover maps as input and various regional,higher-resolution land cover data-sets as reference to build regression tree models per continent.The average error of 10-fold cross validation of the regression tree models varied between 7.70 and 15.68% forest cover and the r2 varied between 0.76 and 0.94,indicating the robustness of the trained models.As a result of data fusion,the synthesized global forest cover map was more accurate than any input global product.We also showed that other major vegetative land cover types such as cropland,woodland,grassland,and wetland all exhibit similar magnitude of discrepancies as forest among existing land cover maps.Our developed method,because of its type-and scale-invariant feature,can be implemented for other land cover types for improving their global characterization.The ensemble approach can also be internalized for improving data quality when generating a global land cover product,where multiple versions can be produced and subsequently integrated.展开更多
The convolutional neural network(CNN)method based on DeepLabv3+has some problems in the semantic segmentation task of high-resolution remote sensing images,such as fixed receiving field size of feature extraction,lack...The convolutional neural network(CNN)method based on DeepLabv3+has some problems in the semantic segmentation task of high-resolution remote sensing images,such as fixed receiving field size of feature extraction,lack of semantic information,high decoder magnification,and insufficient detail retention ability.A hierarchical feature fusion network(HFFNet)was proposed.Firstly,a combination of transformer and CNN architectures was employed for feature extraction from images of varying resolutions.The extracted features were processed independently.Subsequently,the features from the transformer and CNN were fused under the guidance of features from different sources.This fusion process assisted in restoring information more comprehensively during the decoding stage.Furthermore,a spatial channel attention module was designed in the final stage of decoding to refine features and reduce the semantic gap between shallow CNN features and deep decoder features.The experimental results showed that HFFNet had superior performance on UAVid,LoveDA,Potsdam,and Vaihingen datasets,and its cross-linking index was better than DeepLabv3+and other competing methods,showing strong generalization ability.展开更多
We propose an adaptive regularized algorithm for remote sensing image fusion based on variational methods. In the algorithm, we integrate the inputs using a ＂grey world＂ assumption to achieve visual uniformity. We p...We propose an adaptive regularized algorithm for remote sensing image fusion based on variational methods. In the algorithm, we integrate the inputs using a ＂grey world＂ assumption to achieve visual uniformity. We propose a fusion operator that can automatically select the total variation （TV）-LI term for edges and L2-terms for non-edges. To implement our algorithm, we use the steepest descent method to solve the corresponding Euler-Lagrange equation. Experimental results show that the proposed algorithm achieves remarkable results.展开更多
In order to improve the quality of remote sensing image fusion,a new method combining nonsubsampled Laplacian pyramid(NLP)and bidimensional empirical mode decomposition(BEMD)is proposed.First,the high resolution panch...In order to improve the quality of remote sensing image fusion,a new method combining nonsubsampled Laplacian pyramid(NLP)and bidimensional empirical mode decomposition(BEMD)is proposed.First,the high resolution panchromatic image(PAN)is decomposed using NLP until the approximate component and the low resolution multispectral image(MS)contain features with a similar scale.Then,the approximation component and the MS are decomposed by BEMD,resulting in a number of bidimensional intrinsic mode functions(BIMF)and a residue respectively.The instantaneous frequency is computed in 4 directions of the BIMFs.Considering the positive or negative coefficients in the corresponding position,a weighted algorithm is designed for fusing the high frequency details using the instantaneous frequency and the coefficient absolute value of the BIMFs as fusion feature.The fused image is then obtained through inverse BEMD and NLP.Experimental results have illustrated the advantage of this method over the IHS,DWT andà-Trous wavelet in both spectral and spatial detail qualities.展开更多
Due to the data acquired by most optical earth observation satellite such as IKONOS, QuickBird-2 and GF-1 consist of a panchromatic image with high spatial resolution and multiple multispectral images with low spatial...Due to the data acquired by most optical earth observation satellite such as IKONOS, QuickBird-2 and GF-1 consist of a panchromatic image with high spatial resolution and multiple multispectral images with low spatial resolution. Many image fusion techniques have been developed to produce high resolution multispectral image. Considering panchromatic image and multispectral images contain the same spatial information with different accuracy, using the least square theory could estimate optimal spatial information. Compared with previous spatial details injection mode, this mode is more accurate and robust. In this paper, an image fusion method using Bidimensional Empirical Mode Decomposition (BEMD) and the least square theory is proposed to merge multispectral images and panchromatic image. After multi-spectral images were transformed from RGB space into IHS space, next I component and Panchromatic are decomposed by BEMD, then using the least squares theory to evaluate optimal spatial information and inject spatial information, finally completing fusion through inverse BEMD and inverse intensity-hue-saturation transform. Two data sets are used to evaluate the proposed fusion method, GF-1 images and QuickBird-2 images. The fusion images were evaluated visually and statistically. The evaluation results show the method proposed in this paper achieves the best performance compared with the conventional method.展开更多
Remote sensing image(RSI)with concurrently high spatial,temporal,and spectral resolutions cannot be produced by a single sensor.Multisource RSI fusion is a convenient technique to realize high spatial resolution multi...Remote sensing image(RSI)with concurrently high spatial,temporal,and spectral resolutions cannot be produced by a single sensor.Multisource RSI fusion is a convenient technique to realize high spatial resolution multispectral(MS)images(spatial spectral fusion,i.e.SSF)and high temporal and spatial resolution MS images(spatiotemporal fusion,i.e.STF).Currently,deep learning-based fusion models can only implement SSF or STF,lacking models that perform both SSF and STF.Multiresolution generative adversarial networks with bidirectional adaptive-stage progressive guided fusion(BAPGF)for RSI are proposed to implement both SSF and STF,namely BPF-MGAN.A bidirectional adaptive-stage feature extraction architecture infine-scale-to-coarse-scale and coarse-scale-to-fine-scale modes is introduced.The designed BAPGF introduces a previous fusion result-oriented cross-stage-level dual-residual attention fusion strategy to enhance critical information and suppress superfluous information.Adaptive resolution U-shaped discriminators are implemented to feed multiresolution context into the generator.A generalized multitask loss function unlimited by no-reference images is developed to strengthen the model via constraints on the multiscale feature,structural,and content similarities.The BPF-MGAN model is validated on SSF datasets and STF datasets.Compared with the state-of-the-art SSF and STF models,results demonstrate the superior performance of the proposed BPF-MGAN model in both subjective and objective evaluations.展开更多
Purpose:Classification of remote sensing images(RSI)is a challenging task in computer vision.Recently,researchers have proposed a variety of creative methods for automatic recognition of RSI,and feature fusion is a re...Purpose:Classification of remote sensing images(RSI)is a challenging task in computer vision.Recently,researchers have proposed a variety of creative methods for automatic recognition of RSI,and feature fusion is a research hotspot for its great potential to boost performance.However,RSI has a unique imaging condition and cluttered scenes with complicated backgrounds.This larger difference from nature images has made the previous feature fusion methods present insignificant performance improvements.Design/methodology/approach:This work proposed a two-convolutional neural network(CNN)fusion method named main and branch CNN fusion network(MBC-Net)as an improved solution for classifying RSI.In detail,the MBC-Net employs an EfficientNet-B3 as its main CNN stream and an EfficientNet-B0 as a branch,named MC-B3 and BC-B0,respectively.In particular,MBC-Net includes a long-range derivation(LRD)module,which is specially designed to learn the dependence of different features.Meanwhile,MBC-Net also uses some unique ideas to tackle the problems coming from the two-CNN fusion and the inherent nature of RSI.Findings:Extensive experiments on three RSI sets prove that MBC-Net outperforms the other 38 state-of-theart(STOA)methods published from 2020 to 2023,with a noticeable increase in overall accuracy(OA)values.MBC-Net not only presents a 0.7%increased OA value on the most confusing NWPU set but also has 62%fewer parameters compared to the leading approach that ranks first in the literature.Originality/value:MBC-Net is a more effective and efficient feature fusion approach compared to other STOA methods in the literature.Given the visualizations of grad class activation mapping(Grad-CAM),it reveals that MBC-Net can learn the long-range dependence of features that a single CNN cannot.Based on the tendency stochastic neighbor embedding(t-SNE)results,it demonstrates that the feature representation of MBC-Net is more effective than other methods.In addition,the ablation tests indicate that MBC-Net is effective and efficient for fusing features from two CNNs.展开更多
China has a vast territory with abundant crops,and how to collect crop information in China timely,objectively and accurately,is of great significance to the scientific guidance of agricultural development.In this pap...China has a vast territory with abundant crops,and how to collect crop information in China timely,objectively and accurately,is of great significance to the scientific guidance of agricultural development.In this paper,by selecting moderateresolution imaging spectroradiometer(MODIS)data as the main information source,on the basis of spectral and biological characteristics mechanism of the crop,and using the freely available advantage of hyperspectral temporal MODIS data,conduct large scale agricultural remote sensing monitoring research,develop applicable model and algorithm,which can achieve large scale remote sensing extraction and yield estimation of major crop type information,and improve the accuracy of crop quantitative remote sensing.Moreover,the present situation of global crop remote sensing monitoring based on MODIS data is analyzed.Meanwhile,the climate and environment grid agriculture information system using large-scale agricultural condition remote sensing monitoring has been attempted preliminary.展开更多
基金the National Natural Science Foundation of China (No.60872065)
文摘The purpose of remote sensing images fusion is to produce a fused image that contains more clear,accurate and comprehensive information than any single image.A novel fusion method is proposed in this paper based on nonsubsampled contourlet transform(NSCT) and region segmentation.Firstly,the multispectral image is transformed to intensity-hue-saturation(IHS) system.Secondly,the panchromatic image and the component intensity of the multispectral image are decomposed by NSCT.Then the NSCT coefficients of high and low frequency subbands are fused by different rules,respectively.For the high frequency subbands,the fusion rules are also unalike in the smooth and edge regions.The two regions are segregated in the panchromatic image,and the segmentation is based on particle swarm optimization.Finally,the fusion image can be obtained by performing inverse NSCT and inverse IHS transform.The experimental results are evaluated by both subjective and objective criteria.It is shown that the proposed method can obtain superior results to others.
基金supported by National Nature Science Foundation of China (Nos. 61462046 and 61762052)Natural Science Foundation of Jiangxi Province (Nos. 20161BAB202049 and 20161BAB204172)+2 种基金the Bidding Project of the Key Laboratory of Watershed Ecology and Geographical Environment Monitoring, NASG (Nos. WE2016003, WE2016013 and WE2016015)the Science and Technology Research Projects of Jiangxi Province Education Department (Nos. GJJ160741, GJJ170632 and GJJ170633)the Art Planning Project of Jiangxi Province (Nos. YG2016250 and YG2017381)
文摘Image registration is an indispensable component in multi-source remote sensing image processing. In this paper, we put forward a remote sensing image registration method by including an improved multi-scale and multi-direction Harris algorithm and a novel compound feature. Multi-scale circle Gaussian combined invariant moments and multi-direction gray level co-occurrence matrix are extracted as features for image matching. The proposed algorithm is evaluated on numerous multi-source remote sensor images with noise and illumination changes. Extensive experimental studies prove that our proposed method is capable of receiving stable and even distribution of key points as well as obtaining robust and accurate correspondence matches. It is a promising scheme in multi-source remote sensing image registration.
基金This project was supported by the China Postdoctoral Science Foundation[grant number 2017M622522].
文摘Urban waterlogging probability assessment is critical to emergency response and policymaking.Remote Sensing(RS)is a rich and reliable data source for waterlogging monitoring and evaluation through water body extraction derived from the pre-and post-disaster RS images.However,RS images are usually limited to the revisit cycle and cloud cover.To solve this issue,social media data have been considered as another data source which are immune to the weather such as clouds and can reflect the real-time public response for disaster,which leads itself a compensation for RS images.In this paper,we propose a coarse-to-fine waterlogging probability assessment framework based on multisource data including real-time social media data,near real-time RS image and historical geographic information,in which a coarse waterlogging probability map is refined by using the real-time information extracted from social media data to acquire a more accurate waterlogging probability.Firstly,to generate a coarse waterlogging probability map,the historical inundated areas are derived from Digital Elevation Model(DEM)and historical waterlogging points,then the geographic features are extracted from DEM and RS image,which will be input to a Random Forest(RF)classifier to estimate the likelihood of hazards.Secondly,the real-time waterlogging-related information is extracted from social media data,where the Convolutional Neural Network(CNN)model is applied to exploit the semantic information of sentences by capturing the local and position-invariant features using convolution kernel.Finally,fine waterlogging probability map scan be generated based on morphological method,in which real-time waterlogging-related social media data are taken as isolated highlight point and used to refine the coarse waterlogging probability map by a gray dilation pattern considering the distance-decay effect.The 2016 Wuhan waterlogging and 2018 Chengdu water-logging are taken as case studies to demonstrate the effectiveness of the proposed framework.It can be concluded from the results that by integrating RS image and social media data,more accurate waterlogging probability maps can be generated,which can be further applied for inundated areas identification and disaster monitoring.
文摘A new method based on resolution degradation model is proposed to improve both spatial and spectral quality of the synthetic images.Some ETM+panchromatic and multispectral images are used to assess the new method.Its spatial and spectral effects are evaluated by qualitative and quantitative measures and the results are compared with those of IHS,PCA,Brovey,OWT(Orthogonal Wavelet Transform)and RWT(Redundant Wavelet Transform).The results show that the new method can keep almost the same spatial resolution as the panchromatic images,and the spectral effect of the new method is as good as those of wavelet-based methods.
基金This project is supported by the National Natural Science Foundation of China(NSFC)(No.61902158).
文摘The degradation of optical remote sensing images due to atmospheric haze poses a significant obstacle,profoundly impeding their effective utilization across various domains.Dehazing methodologies have emerged as pivotal components of image preprocessing,fostering an improvement in the quality of remote sensing imagery.This enhancement renders remote sensing data more indispensable,thereby enhancing the accuracy of target iden-tification.Conventional defogging techniques based on simplistic atmospheric degradation models have proven inadequate for mitigating non-uniform haze within remotely sensed images.In response to this challenge,a novel UNet Residual Attention Network(URA-Net)is proposed.This paradigmatic approach materializes as an end-to-end convolutional neural network distinguished by its utilization of multi-scale dense feature fusion clusters and gated jump connections.The essence of our methodology lies in local feature fusion within dense residual clusters,enabling the extraction of pertinent features from both preceding and current local data,depending on contextual demands.The intelligently orchestrated gated structures facilitate the propagation of these features to the decoder,resulting in superior outcomes in haze removal.Empirical validation through a plethora of experiments substantiates the efficacy of URA-Net,demonstrating its superior performance compared to existing methods when applied to established datasets for remote sensing image defogging.On the RICE-1 dataset,URA-Net achieves a Peak Signal-to-Noise Ratio(PSNR)of 29.07 dB,surpassing the Dark Channel Prior(DCP)by 11.17 dB,the All-in-One Network for Dehazing(AOD)by 7.82 dB,the Optimal Transmission Map and Adaptive Atmospheric Light For Dehazing(OTM-AAL)by 5.37 dB,the Unsupervised Single Image Dehazing(USID)by 8.0 dB,and the Superpixel-based Remote Sensing Image Dehazing(SRD)by 8.5 dB.Particularly noteworthy,on the SateHaze1k dataset,URA-Net attains preeminence in overall performance,yielding defogged images characterized by consistent visual quality.This underscores the contribution of the research to the advancement of remote sensing technology,providing a robust and efficient solution for alleviating the adverse effects of haze on image quality.
基金Supported by the High Technology Research and Development Programme of China （2001AA135091） and the National Natural Science Foundation of China （60375008）.
文摘IHS （Intensity, Hue and Saturation） transform is one of the most commonly used tusion algonthm. But the matching error causes spectral distortion and degradation in processing of image fusion with IHS method. A study on IHS fusion indicates that the color distortion can＇t be avoided. Meanwhile, the statistical property of wavelet coefficient with wavelet decomposition reflects those significant features, such as edges, lines and regions. So, a united optimal fusion method, which uses the statistical property and IHS transform on pixel and feature levels, is proposed. That is, the high frequency of intensity component Ⅰ is fused on feature level with multi-resolution wavelet in IHS space. And the low frequency of intensity component Ⅰ is fused on pixel level with optimal weight coefficients. Spectral information and spatial resolution are two performance indexes of optimal weight coefficients. Experiment results with QuickBird data of Shanghai show that it is a practical and effective method.
文摘Preserving biodiversity and maintaining ecological balance is essential in current environmental conditions.It is challenging to determine vegetation using traditional map classification approaches.The primary issue in detecting vegetation pattern is that it appears with complex spatial structures and similar spectral properties.It is more demandable to determine the multiple spectral ana-lyses for improving the accuracy of vegetation mapping through remotely sensed images.The proposed framework is developed with the idea of ensembling three effective strategies to produce a robust architecture for vegetation mapping.The architecture comprises three approaches,feature-based approach,region-based approach,and texture-based approach for classifying the vegetation area.The novel Deep Meta fusion model(DMFM)is created with a unique fusion frame-work of residual stacking of convolution layers with Unique covariate features(UCF),Intensity features(IF),and Colour features(CF).The overhead issues in GPU utilization during Convolution neural network(CNN)models are reduced here with a lightweight architecture.The system considers detailing feature areas to improve classification accuracy and reduce processing time.The proposed DMFM model achieved 99%accuracy,with a maximum processing time of 130 s.The training,testing,and validation losses are degraded to a significant level that shows the performance quality with the DMFM model.The system acts as a standard analysis platform for dynamic datasets since all three different fea-tures,such as Unique covariate features(UCF),Intensity features(IF),and Colour features(CF),are considered very well.
基金sponsored by National Key R&D Program of China(2018YFC1504504)Youth Foundation of Yunnan Earthquake Agency(2021K01)Project of Yunnan Earthquake Agency“Chuan bang dai”(CQ3-2021001).
文摘In order to improve the accuracy of building structure identification using remote sensing images,a building structure classification method based on multi-feature fusion of UAV remote sensing image is proposed in this paper.Three identification approaches of remote sensing images are integrated in this method:object-oriented,texture feature,and digital elevation based on DSM and DEM.So RGB threshold classification method is used to classify the identification results.The accuracy of building structure classification based on each feature and the multi-feature fusion are compared and analyzed.The results show that the building structure classification method is feasible and can accurately identify the structures in large-area remote sensing images.
文摘As a means of copyright protection for multimedia data, digital watermarking technology has attracted more and more attention in various research fields. Researchers have begun to explore the feasibility of applying it to remote sensing data recently. Because of the particularity of remote sensing image, higher requirements are put forward for its security and management, especially for the copyright protection, illegal use and authenticity identification of remote sensing image data. Therefore, this paper proposes to use image watermarking technology to achieve comprehensive security protection of remote sensing image data, while the use of cryptography technology increases the applicability and security of watermarking technology. The experimental results show that the scheme of remote sensing image digital watermarking technology has good performance in the imperceptibility and robustness of watermarking.
基金funded by the Major Scientific and Technological Innovation Project of Shandong Province,Grant No.2022CXGC010609.
文摘Semantic segmentation of remote sensing images is one of the core tasks of remote sensing image interpretation.With the continuous develop-ment of artificial intelligence technology,the use of deep learning methods for interpreting remote-sensing images has matured.Existing neural networks disregard the spatial relationship between two targets in remote sensing images.Semantic segmentation models that combine convolutional neural networks(CNNs)and graph convolutional neural networks(GCNs)cause a lack of feature boundaries,which leads to the unsatisfactory segmentation of various target feature boundaries.In this paper,we propose a new semantic segmentation model for remote sensing images(called DGCN hereinafter),which combines deep semantic segmentation networks(DSSN)and GCNs.In the GCN module,a loss function for boundary information is employed to optimize the learning of spatial relationship features between the target features and their relationships.A hierarchical fusion method is utilized for feature fusion and classification to optimize the spatial relationship informa-tion in the original feature information.Extensive experiments on ISPRS 2D and DeepGlobe semantic segmentation datasets show that compared with the existing semantic segmentation models of remote sensing images,the DGCN significantly optimizes the segmentation effect of feature boundaries,effectively reduces the noise in the segmentation results and improves the segmentation accuracy,which demonstrates the advancements of our model.
文摘Indeed,a range of systems in the environment requires timely,spatially explicit,and credible information to support its environmental decision-making,but no one observing system can give the complete and reliable measures of the Earth system across scales.This review summarizes how the realization of the Compute the Planet is underway in the form of machine learning,remote sensing,and sensor data fusion to generate decision-ready environmental insights.We use the application-first approach,which considers remote sensing,in situ and Internet of Things(IoT)sensing,and physics-based models as complementary streams of evidence with similar strengths and failures.We look critically at how an integrated system can convert heterogeneous observations to action products across three high impact application areas:atmosphere and air quality,water–land–ecosystem dynamics,and hazards.Rapid-response situational awareness,ecosystem condition metrics,drought and flood indicators,exposure maps,and hazard/extreme indicators are key products.The integrated systems to environment interface in three high impact application areas:atmosphere and air quality,water-land-ecosystem dynamics,and hazard Examine Our operational requirements can often determine real-life value such as latency,time stability,smooth degradation in the presence of missing or degraded inputs,and calibrated uncertainty usable in thresholdbased decisions.These pitfalls are common across fields:mismatch in the scale between a point sensor and a gridded product,objectives on proxies in remotely sensed measurements,domain shift in the extremes and changing baselines,and evaluation aspects,which overestimate generalization because of spatiotemporal autocorrelation.Based on these lessons,we present cross-domain proposals for strong validation,uncertainty quantification,provenance,and versioning,as well as fair performance evaluation.We conclude that the next era of environmental intelligence will see a reduction in average accuracy improvement and an increase in terms of robustness,transparency,and operational responsibility,thus allowing the integrated environmental intelligence system to be deployed,which may be relied on to monitor human health,resource allocation,and survival in a more climate-adapted world.
基金funded by NASA’s Making Earth System Data Records for Use in Research Environments(MEaSUREs)Program[grant number NNX08AP33A]the NASA Earth and Space Science Fellowship(NESSF)Program[grant number NNX12AN92H].
文摘Global-scale land cover characterization has advanced from a spatial resolution of 1×1°in the mid-1990s to 30×30 m resolution to date.However,some mapping challenges exist persistently regardless of the increasing spatial resolution.Data fusion has been proved as an effective way of improving land cover characterization.Here we applied a machine learning-based data integration approach for improving global-scale forest cover characterization.The approach employed six coarse-resolution(250-1000 m)global land cover maps as input and various regional,higher-resolution land cover data-sets as reference to build regression tree models per continent.The average error of 10-fold cross validation of the regression tree models varied between 7.70 and 15.68% forest cover and the r2 varied between 0.76 and 0.94,indicating the robustness of the trained models.As a result of data fusion,the synthesized global forest cover map was more accurate than any input global product.We also showed that other major vegetative land cover types such as cropland,woodland,grassland,and wetland all exhibit similar magnitude of discrepancies as forest among existing land cover maps.Our developed method,because of its type-and scale-invariant feature,can be implemented for other land cover types for improving their global characterization.The ensemble approach can also be internalized for improving data quality when generating a global land cover product,where multiple versions can be produced and subsequently integrated.
基金supported by National Natural Science Foundation of China(No.52374155)Anhui Provincial Natural Science Foundation(No.2308085 MF218).
文摘The convolutional neural network(CNN)method based on DeepLabv3+has some problems in the semantic segmentation task of high-resolution remote sensing images,such as fixed receiving field size of feature extraction,lack of semantic information,high decoder magnification,and insufficient detail retention ability.A hierarchical feature fusion network(HFFNet)was proposed.Firstly,a combination of transformer and CNN architectures was employed for feature extraction from images of varying resolutions.The extracted features were processed independently.Subsequently,the features from the transformer and CNN were fused under the guidance of features from different sources.This fusion process assisted in restoring information more comprehensively during the decoding stage.Furthermore,a spatial channel attention module was designed in the final stage of decoding to refine features and reduce the semantic gap between shallow CNN features and deep decoder features.The experimental results showed that HFFNet had superior performance on UAVid,LoveDA,Potsdam,and Vaihingen datasets,and its cross-linking index was better than DeepLabv3+and other competing methods,showing strong generalization ability.
基金This work was supported by the National Basic Research Program of China （No. 2011 CB707104） and the National Natural Science Foundation of China （Grant No. 61273298）.
文摘We propose an adaptive regularized algorithm for remote sensing image fusion based on variational methods. In the algorithm, we integrate the inputs using a ＂grey world＂ assumption to achieve visual uniformity. We propose a fusion operator that can automatically select the total variation （TV）-LI term for edges and L2-terms for non-edges. To implement our algorithm, we use the steepest descent method to solve the corresponding Euler-Lagrange equation. Experimental results show that the proposed algorithm achieves remarkable results.
基金supported by the National Basic Research Program ofChina("973"Program)(Grant Nos.2006CB701300,2006CB701304)the China Postdoctoral Foundation(Grant No.2007041172),Hubei Natural Science Foundation(Grant No.2007ABA042)LIESMARS Special Research Fund and the Wuhan Key Scientific and Technological Project(Grant No.200810321144)
文摘In order to improve the quality of remote sensing image fusion,a new method combining nonsubsampled Laplacian pyramid(NLP)and bidimensional empirical mode decomposition(BEMD)is proposed.First,the high resolution panchromatic image(PAN)is decomposed using NLP until the approximate component and the low resolution multispectral image(MS)contain features with a similar scale.Then,the approximation component and the MS are decomposed by BEMD,resulting in a number of bidimensional intrinsic mode functions(BIMF)and a residue respectively.The instantaneous frequency is computed in 4 directions of the BIMFs.Considering the positive or negative coefficients in the corresponding position,a weighted algorithm is designed for fusing the high frequency details using the instantaneous frequency and the coefficient absolute value of the BIMFs as fusion feature.The fused image is then obtained through inverse BEMD and NLP.Experimental results have illustrated the advantage of this method over the IHS,DWT andà-Trous wavelet in both spectral and spatial detail qualities.
文摘Due to the data acquired by most optical earth observation satellite such as IKONOS, QuickBird-2 and GF-1 consist of a panchromatic image with high spatial resolution and multiple multispectral images with low spatial resolution. Many image fusion techniques have been developed to produce high resolution multispectral image. Considering panchromatic image and multispectral images contain the same spatial information with different accuracy, using the least square theory could estimate optimal spatial information. Compared with previous spatial details injection mode, this mode is more accurate and robust. In this paper, an image fusion method using Bidimensional Empirical Mode Decomposition (BEMD) and the least square theory is proposed to merge multispectral images and panchromatic image. After multi-spectral images were transformed from RGB space into IHS space, next I component and Panchromatic are decomposed by BEMD, then using the least squares theory to evaluate optimal spatial information and inject spatial information, finally completing fusion through inverse BEMD and inverse intensity-hue-saturation transform. Two data sets are used to evaluate the proposed fusion method, GF-1 images and QuickBird-2 images. The fusion images were evaluated visually and statistically. The evaluation results show the method proposed in this paper achieves the best performance compared with the conventional method.
基金funded by the National Key Research and Development Program of China under Grants 2020YFB2104400 and 2020YFB2104401the National Natural Science Foundation of China under Grant 82260362the Hainan Major Science and Technology Program of China under Grant ZDKJ202017.
文摘Remote sensing image(RSI)with concurrently high spatial,temporal,and spectral resolutions cannot be produced by a single sensor.Multisource RSI fusion is a convenient technique to realize high spatial resolution multispectral(MS)images(spatial spectral fusion,i.e.SSF)and high temporal and spatial resolution MS images(spatiotemporal fusion,i.e.STF).Currently,deep learning-based fusion models can only implement SSF or STF,lacking models that perform both SSF and STF.Multiresolution generative adversarial networks with bidirectional adaptive-stage progressive guided fusion(BAPGF)for RSI are proposed to implement both SSF and STF,namely BPF-MGAN.A bidirectional adaptive-stage feature extraction architecture infine-scale-to-coarse-scale and coarse-scale-to-fine-scale modes is introduced.The designed BAPGF introduces a previous fusion result-oriented cross-stage-level dual-residual attention fusion strategy to enhance critical information and suppress superfluous information.Adaptive resolution U-shaped discriminators are implemented to feed multiresolution context into the generator.A generalized multitask loss function unlimited by no-reference images is developed to strengthen the model via constraints on the multiscale feature,structural,and content similarities.The BPF-MGAN model is validated on SSF datasets and STF datasets.Compared with the state-of-the-art SSF and STF models,results demonstrate the superior performance of the proposed BPF-MGAN model in both subjective and objective evaluations.
基金funded by Hunan University of Arts and Science(No:16BSQD23).
文摘Purpose:Classification of remote sensing images(RSI)is a challenging task in computer vision.Recently,researchers have proposed a variety of creative methods for automatic recognition of RSI,and feature fusion is a research hotspot for its great potential to boost performance.However,RSI has a unique imaging condition and cluttered scenes with complicated backgrounds.This larger difference from nature images has made the previous feature fusion methods present insignificant performance improvements.Design/methodology/approach:This work proposed a two-convolutional neural network(CNN)fusion method named main and branch CNN fusion network(MBC-Net)as an improved solution for classifying RSI.In detail,the MBC-Net employs an EfficientNet-B3 as its main CNN stream and an EfficientNet-B0 as a branch,named MC-B3 and BC-B0,respectively.In particular,MBC-Net includes a long-range derivation(LRD)module,which is specially designed to learn the dependence of different features.Meanwhile,MBC-Net also uses some unique ideas to tackle the problems coming from the two-CNN fusion and the inherent nature of RSI.Findings:Extensive experiments on three RSI sets prove that MBC-Net outperforms the other 38 state-of-theart(STOA)methods published from 2020 to 2023,with a noticeable increase in overall accuracy(OA)values.MBC-Net not only presents a 0.7%increased OA value on the most confusing NWPU set but also has 62%fewer parameters compared to the leading approach that ranks first in the literature.Originality/value:MBC-Net is a more effective and efficient feature fusion approach compared to other STOA methods in the literature.Given the visualizations of grad class activation mapping(Grad-CAM),it reveals that MBC-Net can learn the long-range dependence of features that a single CNN cannot.Based on the tendency stochastic neighbor embedding(t-SNE)results,it demonstrates that the feature representation of MBC-Net is more effective than other methods.In addition,the ablation tests indicate that MBC-Net is effective and efficient for fusing features from two CNNs.
文摘China has a vast territory with abundant crops,and how to collect crop information in China timely,objectively and accurately,is of great significance to the scientific guidance of agricultural development.In this paper,by selecting moderateresolution imaging spectroradiometer(MODIS)data as the main information source,on the basis of spectral and biological characteristics mechanism of the crop,and using the freely available advantage of hyperspectral temporal MODIS data,conduct large scale agricultural remote sensing monitoring research,develop applicable model and algorithm,which can achieve large scale remote sensing extraction and yield estimation of major crop type information,and improve the accuracy of crop quantitative remote sensing.Moreover,the present situation of global crop remote sensing monitoring based on MODIS data is analyzed.Meanwhile,the climate and environment grid agriculture information system using large-scale agricultural condition remote sensing monitoring has been attempted preliminary.
