In the heterogeneous power internet of things(IoT)environment,data signals are acquired to support different business systems to realize advanced intelligent applications,with massive,multi-source,heterogeneous and ot...In the heterogeneous power internet of things(IoT)environment,data signals are acquired to support different business systems to realize advanced intelligent applications,with massive,multi-source,heterogeneous and other characteristics.Reliable perception of information and efficient transmission of energy in multi-source heterogeneous environments are crucial issues.Compressive sensing(CS),as an effective method of signal compression and transmission,can accurately recover the original signal only by very few sampling.In this paper,we study a new method of multi-source heterogeneous data signal reconstruction of power IoT based on compressive sensing technology.Based on the traditional compressive sensing technology to directly recover multi-source heterogeneous signals,we fully use the interference subspace information to design the measurement matrix,which directly and effectively eliminates the interference while making the measurement.The measure matrix is optimized by minimizing the average cross-coherence of the matrix,and the reconstruction performance of the new method is further improved.Finally,the effectiveness of the new method with different parameter settings under different multi-source heterogeneous data signal cases is verified by using orthogonal matching pursuit(OMP)and sparsity adaptive matching pursuit(SAMP)for considering the actual environment with prior information utilization of signal sparsity and no prior information utilization of signal sparsity.展开更多
Image registration is an indispensable component in multi-source remote sensing image processing. In this paper, we put forward a remote sensing image registration method by including an improved multi-scale and multi...Image registration is an indispensable component in multi-source remote sensing image processing. In this paper, we put forward a remote sensing image registration method by including an improved multi-scale and multi-direction Harris algorithm and a novel compound feature. Multi-scale circle Gaussian combined invariant moments and multi-direction gray level co-occurrence matrix are extracted as features for image matching. The proposed algorithm is evaluated on numerous multi-source remote sensor images with noise and illumination changes. Extensive experimental studies prove that our proposed method is capable of receiving stable and even distribution of key points as well as obtaining robust and accurate correspondence matches. It is a promising scheme in multi-source remote sensing image registration.展开更多
This paper aims at providing multi-source remote sensing images registered in geometric space for image fusion.Focusing on the characteristics and differences of multi-source remote sensing images,a feature-based regi...This paper aims at providing multi-source remote sensing images registered in geometric space for image fusion.Focusing on the characteristics and differences of multi-source remote sensing images,a feature-based registration algorithm is implemented.The key technologies include image scale-space for implementing multi-scale properties,Harris corner detection for keypoints extraction,and partial intensity invariant feature descriptor(PIIFD)for keypoints description.Eventually,a multi-scale Harris-PIIFD image registration algorithm framework is proposed.The experimental results of fifteen sets of representative real data show that the algorithm has excellent,stable performance in multi-source remote sensing image registration,and can achieve accurate spatial alignment,which has strong practical application value and certain generalization ability.展开更多
The salinity of the salt lake is an important factor to evaluate whether it contains some mineral resources or not,the fault buried in the salt lake could control the abundance of the salinity.Therefore,it is of great...The salinity of the salt lake is an important factor to evaluate whether it contains some mineral resources or not,the fault buried in the salt lake could control the abundance of the salinity.Therefore,it is of great geological importance to identify the fault buried in the salt lake.Taking the Gasikule Salt Lake in China for example,the paper established a new method to identify the fault buried in the salt lake based on the multi-source remote sensing data including Landsat TM,SPOT-5 and ASTER data.It includes the acquisition and selection of the multi-source remote sensing data,data preprocessing,lake waterfront extraction,spectrum extraction of brine with different salinity,salinity index construction,salinity separation,analysis of the abnormal salinity and identification of the fault buried in salt lake,temperature inversion of brine and the fault verification.As a result,the study identified an important fault buried in the east of the Gasikule Salt Lake that controls the highest salinity abnormal.Because the level of the salinity is positively correlated to the mineral abundance,the result provides the important reference to identify the water body rich in mineral resources in the salt lake.展开更多
The automatic registration of multi-source remote sensing images (RSI) is a research hotspot of remote sensing image preprocessing currently. A special automatic image registration module named the Image Autosync has ...The automatic registration of multi-source remote sensing images (RSI) is a research hotspot of remote sensing image preprocessing currently. A special automatic image registration module named the Image Autosync has been embedded into the ERDAS IMAGINE software of version 9.0 and above. The registration accuracies of the module verified for the remote sensing images obtained from different platforms or their different spatial resolution. Four tested registration experiments are discussed in this article to analyze the accuracy differences based on the remote sensing data which have different spatial resolution. The impact factors inducing the differences of registration accuracy are also analyzed.展开更多
The components of urban surface cover are diversified,and component temperature has greater physical significance and application values in the studies on urban thermal environment.Although the multi-angle retrieval a...The components of urban surface cover are diversified,and component temperature has greater physical significance and application values in the studies on urban thermal environment.Although the multi-angle retrieval algorithm of component temperature has been matured gradually,its application in the studies on urban thermal environment is restricted due to the difficulty in acquiring urban-scale multi-angle thermal infrared data.Therefore,based on the existing multi-source multi-band remote sensing data,access to appropriate urban-scale component temperature is an urgent issue to be solved in current studies on urban thermal infrared remote sensing.Then,a retrieval algorithm of urban component temperature by multi-source multi-band remote sensing data on the basis of MODIS and Landsat TM images was proposed with expectations achieved in this work,which was finally validated by the experiment on urban images of Changsha,China.The results show that：1） Mean temperatures of impervious surface components and vegetation components are the maximum and minimum,respectively,which are in accordance with the distribution laws of actual surface temperature; 2） High-accuracy retrieval results are obtained in vegetation component temperature.Moreover,through a contrast between retrieval results and measured data,it is found that the retrieval temperature of impervious surface component has the maximum deviation from measured temperature and its deviation is greater than 1 ℃,while the deviation in vegetation component temperature is relatively low at 0.5 ℃.展开更多
[Objective] The aim was to extract red tide information in Haizhou Bay on the basis of multi-source remote sensing data.[Method] Red tide in Haizhou Bay was studied based on multi-source remote sensing data,such as IR...[Objective] The aim was to extract red tide information in Haizhou Bay on the basis of multi-source remote sensing data.[Method] Red tide in Haizhou Bay was studied based on multi-source remote sensing data,such as IRS-P6 data on October 8,2005,Landsat 5-TM data on May 20,2006,MODIS 1B data on October 6,2006 and HY-1B second-grade data on April 22,2009,which were firstly preprocessed through geometric correction,atmospheric correction,image resizing and so on.At the same time,the synchronous environment monitoring data of red tide water were acquired.Then,band ratio method,chlorophyll-a concentration method and secondary filtering method were adopted to extract red tide information.[Result] On October 8,2005,the area of red tide was about 20.0 km2 in Haizhou Bay.There was no red tide in Haizhou bay on May 20,2006.On October 6,2006,large areas of red tide occurred in Haizhou bay,with area of 436.5 km2.On April 22,2009,red tide scattered in Haizhou bay,and its area was about 10.8 km2.[Conclusion] The research would provide technical ideas for the environmental monitoring department of Lianyungang to implement red tide forecast and warning effectively.展开更多
Source identification and deformation analysis of disaster bodies are the main contents of high-steep slope risk assessment,the establishment of high-precision model and the quantification of the fine geometric featur...Source identification and deformation analysis of disaster bodies are the main contents of high-steep slope risk assessment,the establishment of high-precision model and the quantification of the fine geometric features of the slope are the prerequisites for the above work.In this study,based on the UAV remote sensing technology in acquiring refined model and quantitative parameters,a semi-automatic dangerous rock identification method based on multi-source data is proposed.In terms of the periodicity UAV-based deformation monitoring,the monitoring accuracy is defined according to the relative accuracy of multi-temporal point cloud.Taking a high-steep slope as research object,the UAV equipped with special sensors was used to obtain multi-source and multitemporal data,including high-precision DOM and multi-temporal 3D point clouds.The geometric features of the outcrop were extracted and superimposed with DOM images to carry out semi-automatic identification of dangerous rock mass,realizes the closed-loop of identification and accuracy verification;changing detection of multi-temporal 3D point clouds was conducted to capture deformation of slope with centimeter accuracy.The results show that the multi-source data-based semiautomatic dangerous rock identification method can complement each other to improve the efficiency and accuracy of identification,and the UAV-based multi-temporal monitoring can reveal the near real-time deformation state of slopes.展开更多
Mudflat vegetation plays a crucial role in the ecological function of wetland environment,and obtaining its fine spatial distri-bution is of great significance for wetland protection and management.Remote sensing tech...Mudflat vegetation plays a crucial role in the ecological function of wetland environment,and obtaining its fine spatial distri-bution is of great significance for wetland protection and management.Remote sensing techniques can realize the rapid extraction of wetland vegetation over a large area.However,the imaging of optical sensors is easily restricted by weather conditions,and the backs-cattered information reflected by Synthetic Aperture Radar(SAR)images is easily disturbed by many factors.Although both data sources have been applied in wetland vegetation classification,there is a lack of comparative study on how the selection of data sources affects the classification effect.This study takes the vegetation of the tidal flat wetland in Chongming Island,Shanghai,China,in 2019,as the research subject.A total of 22 optical feature parameters and 11 SAR feature parameters were extracted from the optical data source(Sentinel-2)and SAR data source(Sentinel-1),respectively.The performance of optical and SAR data and their feature paramet-ers in wetland vegetation classification was quantitatively compared and analyzed by different feature combinations.Furthermore,by simulating the scenario of missing optical images,the impact of optical image missing on vegetation classification accuracy and the compensatory effect of integrating SAR data were revealed.Results show that:1)under the same classification algorithm,the Overall Accuracy(OA)of the combined use of optical and SAR images was the highest,reaching 95.50%.The OA of using only optical images was slightly lower,while using only SAR images yields the lowest accuracy,but still achieved 86.48%.2)Compared to using the spec-tral reflectance of optical data and the backscattering coefficient of SAR data directly,the constructed optical and SAR feature paramet-ers contributed to improving classification accuracy.The inclusion of optical(vegetation index,spatial texture,and phenology features)and SAR feature parameters(SAR index and SAR texture features)in the classification algorithm resulted in an OA improvement of 4.56%and 9.47%,respectively.SAR backscatter,SAR index,optical phenological features,and vegetation index were identified as the top-ranking important features.3)When the optical data were missing continuously for six months,the OA dropped to a minimum of 41.56%.However,when combined with SAR data,the OA could be improved to 71.62%.This indicates that the incorporation of SAR features can effectively compensate for the loss of accuracy caused by optical image missing,especially in regions with long-term cloud cover.展开更多
With the increasing frequency of floods,in-depth flood event analyses are essential for effective disaster relief and prevention.Satellite-based flood event datasets have become the primary data source for flood event...With the increasing frequency of floods,in-depth flood event analyses are essential for effective disaster relief and prevention.Satellite-based flood event datasets have become the primary data source for flood event analyses instead of limited disaster maps due to their enhanced availability.Nevertheless,despite the vast amount of available remote sensing images,existing flood event datasets continue to pose significant challenges in flood event analyses due to the uneven geographical distribution of data,the scarcity of time series data,and the limited availability of flood-related semantic information.There has been a surge in acceptance of deep learning models for flood event analyses,but some existing flood datasets do not align well with model training,and distinguishing flooded areas has proven difficult with limited data modalities and semantic information.Moreover,efficient retrieval and pre-screening of flood-related imagery from vast satellite data impose notable obstacles,particularly within large-scale analyses.To address these issues,we propose a Multimodal Flood Event Dataset(MFED)for deep-learning-based flood event analyses and data retrieval.It consists of 18 years of multi-source remote sensing imagery and heterogeneous textual information covering flood-prone areas worldwide.Incorporating optical and radar imagery can exploit the correlation and complementarity between distinct image modalities to capture the pixel features in flood imagery.It is worth noting that text modality data,including auxiliary hydrological information extracted from the Global Flood Database and text information refined from online news records,can also offer a semantic supplement to the images for flood event retrieval and analysis.To verify the applicability of the MFED in deep learning models,we carried out experiments with different models using a single modality and different combinations of modalities,which fully verified the effectiveness of the dataset.Furthermore,we also verify the efficiency of the MFED in comparative experiments with existing multimodal datasets and diverse neural network structures.展开更多
With the deterioration of the environment,it is imperative to protect coastal wetlands.Using multi-source remote sensing data and object-based hierarchical classification to classify coastal wetlands is an effective m...With the deterioration of the environment,it is imperative to protect coastal wetlands.Using multi-source remote sensing data and object-based hierarchical classification to classify coastal wetlands is an effective method.The object-based hierarchical classification using remote sensing indices(OBH-RSI)for coastal wetland is proposed to achieve fine classification of coastal wetland.First,the original categories are divided into four groups according to the category characteristics.Second,the training and test maps of each group are extracted according to the remote sensing indices.Third,four groups are passed through the classifier in order.Finally,the results of the four groups are combined to get the final classification result map.The experimental results demonstrate that the overall accuracy,average accuracy and kappa coefficient of the proposed strategy are over 94%using the Yellow River Delta dataset.展开更多
Accurate estimation of understory terrain has significant scientific importance for maintaining ecosystem balance and biodiversity conservation.Addressing the issue of inadequate representation of spatial heterogeneit...Accurate estimation of understory terrain has significant scientific importance for maintaining ecosystem balance and biodiversity conservation.Addressing the issue of inadequate representation of spatial heterogeneity when traditional forest topographic inversion methods consider the entire forest as the inversion unit,this study pro⁃poses a differentiated modeling approach to forest types based on refined land cover classification.Taking Puerto Ri⁃co and Maryland as study areas,a multi-dimensional feature system is constructed by integrating multi-source re⁃mote sensing data:ICESat-2 spaceborne LiDAR is used to obtain benchmark values for understory terrain,topo⁃graphic factors such as slope and aspect are extracted based on SRTM data,and vegetation cover characteristics are analyzed using Landsat-8 multispectral imagery.This study incorporates forest type as a classification modeling con⁃dition and applies the random forest algorithm to build differentiated topographic inversion models.Experimental re⁃sults indicate that,compared to traditional whole-area modeling methods(RMSE=5.06 m),forest type-based classi⁃fication modeling significantly improves the accuracy of understory terrain estimation(RMSE=2.94 m),validating the effectiveness of spatial heterogeneity modeling.Further sensitivity analysis reveals that canopy structure parame⁃ters(with RMSE variation reaching 4.11 m)exert a stronger regulatory effect on estimation accuracy compared to forest cover,providing important theoretical support for optimizing remote sensing models of forest topography.展开更多
Using the three-layer variable infiltration capacity （VIC-3L） hydrological model and the successive interpolation approach （SIA） of climate factors, the authors studied the effect of different land cover types on ...Using the three-layer variable infiltration capacity （VIC-3L） hydrological model and the successive interpolation approach （SIA） of climate factors, the authors studied the effect of different land cover types on the surface hydrological cycle. Daily climate data from 1992 to 2001 and remotely-sensed leaf area index （LAI） are used in the model. The model is applied to the Baohe River basin, a subbasin of the Yangtze River basin, China, with an area of 2500 km^2. The vegetation cover types in the Baohe River basin consist mostly of the mixed forest type （-85%）. Comparison of the modeled results with the observed discharge data suggests that： （1） Daily discharges over the period of 1992-2001 simulated with inputs of remotely-sensed land cover data and LAI data can generally produce observed discharge variations, and the modeled annual total discharge agrees with observations with a mean difference of 1.4%. The use of remote sensing images also makes the modeled spatial distributions of evapotranspiration physically meaningful. （2） The relative computing error （RCE） of the annual average discharge is -24.8% when the homogeneous broadleaf deciduous forestry cover is assumed for the watershed. The error is 21.8% when a homogeneous cropland cover is assumed and -14.32% when an REDC （Resource and Environment Database of China） land cover map is used. The error is reduced to 1.4% when a remotely-sensed land cover at 1000-m resolution is used.展开更多
Snow depth （SD） is a key parameter for research into global climate changes and land surface processes. A method was developed to obtain daily SD images at a higher 4 km spatial resolution and higher precision with ...Snow depth （SD） is a key parameter for research into global climate changes and land surface processes. A method was developed to obtain daily SD images at a higher 4 km spatial resolution and higher precision with SD measurements from in situ observations and passive microwave remote sensing of Advanced Microwave Scanning Radiometer-EOS （AMSR-E） and snow cover measurements of the Interactive Multisensor Snow and Ice Mapping System （IMS）. AMSR-E SD at 25 km spatial resolution was retrieved from AMSR-E products of snow density and snow water equivalent and then corrected using the SD from in situ observations and IMS snow cover. Corrected AMSR-E SD images were then resampled to act as ＂virtual＂ in situ observations to combine with the real in situ observations to interpolate at 4 km spatial resolution SD using the Cressman method. Finally, daily SD data generation for several regions of China demonstrated that the method is well suited to the generation of higher spatial resolution SD data in regions with a lower Digital Elevation Model （DEM） but not so well suited to regions at high altitude and with an undulating terrain, such as the Tibetan Plateau. Analysis of the longer time period SD data generation for January between 2003 and 2010 in northern Xinjiang also demonstrated the feasibility of the method.展开更多
Deep learning algorithms show good prospects for remote sensingflood monitoring.They mostly rely on huge amounts of labeled data.However,there is a lack of available labeled data in actual needs.In this paper,we propo...Deep learning algorithms show good prospects for remote sensingflood monitoring.They mostly rely on huge amounts of labeled data.However,there is a lack of available labeled data in actual needs.In this paper,we propose a high-resolution multi-source remote sensing dataset forflood area extraction:GF-FloodNet.GF-FloodNet contains 13388 samples from Gaofen-3(GF-3)and Gaofen-2(GF-2)images.We use a multi-level sample selection and interactive annotation strategy based on active learning to construct it.Compare with otherflood-related datasets,GF-FloodNet not only has a spatial resolution of up to 1.5 m and provides pixel-level labels,but also consists of multi-source remote sensing data.We thoroughly validate and evaluate the dataset using several deep learning models,including quantitative analysis,qualitative analysis,and validation on large-scale remote sensing data in real scenes.Experimental results reveal that GF-FloodNet has significant advantages by multi-source data.It can support different deep learning models for training to extractflood areas.There should be a potential optimal boundary for model training in any deep learning dataset.The boundary seems close to 4824 samples in GF-FloodNet.We provide GF-FloodNet at https://www.kaggle.com/datasets/pengliuair/gf-floodnet and https://pan.baidu.com/s/1vdUCGNAfFwG5UjZ9RLLFMQ?pwd=8v6o.展开更多
In this paper,we studied the effect of spatial distribution of soil parameters on passive soil moisture retrieval at pixel scale.First,we evaluated the forward microwave emission model and soil moisture retrieval algo...In this paper,we studied the effect of spatial distribution of soil parameters on passive soil moisture retrieval at pixel scale.First,we evaluated the forward microwave emission model and soil moisture retrieval algorithm accuracy through the observa-tion of field experiments.Then,we used soil parameters in different spatial distribution patterns,including random,normal,and uniform distribution,to determine the different levels of heterogeneity on soil moisture retrieval,in order to seek the rela-tionship between heterogeneity and soil moisture retrieval error.Finally,we conducted a controlled heterogeneity effect ex-periment measurements using a Truck-mounted Multi-frequency Radiometer(TMMR) to validate our simulation results.This work has proved that the soil moisture retrieval algorithm had a high accuracy(RMSE=0.049 cm3 cm 3) and can satisfy the need of this research.The simulation brightness temperatures match well with observations,with RMSE=9.89 K.At passive microwave remote sensing pixel scale,soil parameters with different spatial distribution patterns could have different levels of error on soil moisture estimation.Overall,we found that soil moisture with a random distribution in a satellite pixel scale can cause the largest error,with a normal distribution being the second,and a uniform distribution the least due to the smallest het-erogeneity.展开更多
East Rennell of Solomon Island is the first natural site under customary law to be inscribed on UNESCO’s World Heritage List.Potential threats due to logging,mining and agriculture led to the site being declared a Wo...East Rennell of Solomon Island is the first natural site under customary law to be inscribed on UNESCO’s World Heritage List.Potential threats due to logging,mining and agriculture led to the site being declared a World Heritage in Danger in 2013.For East Rennell World Heritage Site(ERWHS)to‘shed’its‘Danger’status the management must monitor forest cover both within and outside of ERWHS.We used satellite data from multiple sources to track forest cover changes for the entire East Rennell island since 1998.95%of the island is still covered by undisturbed forests;annual average normalized difference vegetation index(NDVI)for the whole island was above 0.91 in 2015.However,vegetation cover in the island has been slowly decreasing,at a rate of–0.0011 NDVI per year between 2000 and 2015.This decrease less pronounced inside ERWHS compared to areas outside.While potential threats due to forest clearing outside ERWHS remain the forest cover change from 2000 to 2015 has been below 15%.We suggest ways in which the Government of Solomon Islands could use our data as well as unmanned air vehicles and field surveys to monitor forest cover change and ensure the future conservation of ERWHS.展开更多
Land surface hydrothermal conditions(LSHCs) reflect land surface moisture and heat conditions, and play an important role in energy and water cycles in soil-plant-atmosphere continuum. Based on comparison of four eval...Land surface hydrothermal conditions(LSHCs) reflect land surface moisture and heat conditions, and play an important role in energy and water cycles in soil-plant-atmosphere continuum. Based on comparison of four evaluation methods(namely, the classic statistical method, geostatistical method, information theory method, and fractal method), this study proposed a new scheme for evaluating the spatial heterogeneity of LSHCs. This scheme incorporates diverse remotely sensed surface parameters, e.g., leaf area index-LAI, the normalized difference vegetation index-NDVI, net radiation-Rn, and land surface temperature-LST. The LSHCs can be classified into three categories, namely homogeneous, moderately heterogeneous and highly heterogeneous based on the remotely sensed LAI data with a 30 m spatial resolution and the combination of normalized information entropy(S’) and coefficient of variation(CV). Based on the evaluation scheme, the spatial heterogeneity of land surface hydrothermal conditions at six typical flux observation stations in the Heihe River Basin during the vegetation growing season were evaluated. The evaluation results were consistent with the land surface type characteristics exhibited by Google Earth imagery and spatial heterogeneity assessed by high resolution remote sensing evapotranspiration data. Impact factors such as precipitation and irrigation events, spatial resolutions of remote sensing data, heterogeneity in the vertical direction, topography and sparse vegetation could also affect the evaluation results. For instance, short-term changes(precipitation and irrigation events) in the spatial heterogeneity of LSHCs can be diagnosed by energy factors, while long-term changes can be indicated by vegetation factors. The spatial heterogeneity of LSHCs decreases when decreasing the spatial resolution of remote sensing data. The proposed evaluation scheme would be useful for the quantification of spatial heterogeneity of LSHCs over flux observation stations toward the global scale, and also contribute to the improvement of the accuracy of estimation and validation for remotely sensed(or model simulated) evapotranspiration.展开更多
Benthic habitat mapping is an emerging discipline in the international marine field in recent years,providing an effective tool for marine spatial planning,marine ecological management,and decision-making applications...Benthic habitat mapping is an emerging discipline in the international marine field in recent years,providing an effective tool for marine spatial planning,marine ecological management,and decision-making applications.Seabed sediment classification is one of the main contents of seabed habitat mapping.In response to the impact of remote sensing imaging quality and the limitations of acoustic measurement range,where a single data source does not fully reflect the substrate type,we proposed a high-precision seabed habitat sediment classification method that integrates data from multiple sources.Based on WorldView-2 multi-spectral remote sensing image data and multibeam bathymetry data,constructed a random forests(RF)classifier with optimal feature selection.A seabed sediment classification experiment integrating optical remote sensing and acoustic remote sensing data was carried out in the shallow water area of Wuzhizhou Island,Hainan,South China.Different seabed sediment types,such as sand,seagrass,and coral reefs were effectively identified,with an overall classification accuracy of 92%.Experimental results show that RF matrix optimized by fusing multi-source remote sensing data for feature selection were better than the classification results of simple combinations of data sources,which improved the accuracy of seabed sediment classification.Therefore,the method proposed in this paper can be effectively applied to high-precision seabed sediment classification and habitat mapping around islands and reefs.展开更多
目的随着视觉大模型的发展,利用多源无标注遥感影像预训练学习全局视觉特征,并在局部目标任务上进行迁移微调,已成为遥感影像领域自适应的一种新范式。然而,现有的全局预训练策略主要聚焦于学习低级的通用视觉特征,难以捕捉复杂、高层...目的随着视觉大模型的发展,利用多源无标注遥感影像预训练学习全局视觉特征,并在局部目标任务上进行迁移微调,已成为遥感影像领域自适应的一种新范式。然而,现有的全局预训练策略主要聚焦于学习低级的通用视觉特征,难以捕捉复杂、高层次的语义关联。此外,微调过程中使用的少量标注样本往往只反映目标域的特定场景,无法充分激活全局模型中与目标域匹配的领域知识。因此,面对复杂多变的遥感影像跨时空领域偏移,现有方法得到的全局模型与目标任务之间仍然存在巨大的语义鸿沟。为应对这一挑战,本文提出一种语言文本引导的“全局模型预训练—局部模型微调”的领域自适应框架。方法提出框架针对遥感数据的时空异质性特点,借助大型视觉语言助手LLaVA(large language and vision assistant)生成包含季节、地理区域及地物分布等时空信息的遥感影像文本描述。通过语言文本引导的学习帮助全局模型挖掘地物的时空分布规律,增强局部任务微调时相关领域知识的激活。结果在对比判别式、掩码生成式和扩散生成式3种不同全局预训练策略上设置了3组“全局—局部”跨时空领域自适应语义分割实验来验证提出框架的有效性。以全局→局部(长沙)为例,使用语言文本引导相比于无文本引导在3种不同预训练策略上分别提升了8.7%、4.4%和2.9%。同样地,提出框架在全局→局部(湘潭)和全局→局部(武汉)上也都有性能提升。结论证明了语言文本对准确理解跨时空遥感影像中的语义内容具有积极影响。与无文本引导的学习方法相比,提出框架显著提升了模型的迁移性能。展开更多
基金supported by National Natural Science Foundation of China(12174350)Science and Technology Project of State Grid Henan Electric Power Company(5217Q0240008).
文摘In the heterogeneous power internet of things(IoT)environment,data signals are acquired to support different business systems to realize advanced intelligent applications,with massive,multi-source,heterogeneous and other characteristics.Reliable perception of information and efficient transmission of energy in multi-source heterogeneous environments are crucial issues.Compressive sensing(CS),as an effective method of signal compression and transmission,can accurately recover the original signal only by very few sampling.In this paper,we study a new method of multi-source heterogeneous data signal reconstruction of power IoT based on compressive sensing technology.Based on the traditional compressive sensing technology to directly recover multi-source heterogeneous signals,we fully use the interference subspace information to design the measurement matrix,which directly and effectively eliminates the interference while making the measurement.The measure matrix is optimized by minimizing the average cross-coherence of the matrix,and the reconstruction performance of the new method is further improved.Finally,the effectiveness of the new method with different parameter settings under different multi-source heterogeneous data signal cases is verified by using orthogonal matching pursuit(OMP)and sparsity adaptive matching pursuit(SAMP)for considering the actual environment with prior information utilization of signal sparsity and no prior information utilization of signal sparsity.
基金supported by National Nature Science Foundation of China (Nos. 61462046 and 61762052)Natural Science Foundation of Jiangxi Province (Nos. 20161BAB202049 and 20161BAB204172)+2 种基金the Bidding Project of the Key Laboratory of Watershed Ecology and Geographical Environment Monitoring, NASG (Nos. WE2016003, WE2016013 and WE2016015)the Science and Technology Research Projects of Jiangxi Province Education Department (Nos. GJJ160741, GJJ170632 and GJJ170633)the Art Planning Project of Jiangxi Province (Nos. YG2016250 and YG2017381)
文摘Image registration is an indispensable component in multi-source remote sensing image processing. In this paper, we put forward a remote sensing image registration method by including an improved multi-scale and multi-direction Harris algorithm and a novel compound feature. Multi-scale circle Gaussian combined invariant moments and multi-direction gray level co-occurrence matrix are extracted as features for image matching. The proposed algorithm is evaluated on numerous multi-source remote sensor images with noise and illumination changes. Extensive experimental studies prove that our proposed method is capable of receiving stable and even distribution of key points as well as obtaining robust and accurate correspondence matches. It is a promising scheme in multi-source remote sensing image registration.
文摘This paper aims at providing multi-source remote sensing images registered in geometric space for image fusion.Focusing on the characteristics and differences of multi-source remote sensing images,a feature-based registration algorithm is implemented.The key technologies include image scale-space for implementing multi-scale properties,Harris corner detection for keypoints extraction,and partial intensity invariant feature descriptor(PIIFD)for keypoints description.Eventually,a multi-scale Harris-PIIFD image registration algorithm framework is proposed.The experimental results of fifteen sets of representative real data show that the algorithm has excellent,stable performance in multi-source remote sensing image registration,and can achieve accurate spatial alignment,which has strong practical application value and certain generalization ability.
基金This work was supported by the National Advance Research Program(Item No.Y1601-1).
文摘The salinity of the salt lake is an important factor to evaluate whether it contains some mineral resources or not,the fault buried in the salt lake could control the abundance of the salinity.Therefore,it is of great geological importance to identify the fault buried in the salt lake.Taking the Gasikule Salt Lake in China for example,the paper established a new method to identify the fault buried in the salt lake based on the multi-source remote sensing data including Landsat TM,SPOT-5 and ASTER data.It includes the acquisition and selection of the multi-source remote sensing data,data preprocessing,lake waterfront extraction,spectrum extraction of brine with different salinity,salinity index construction,salinity separation,analysis of the abnormal salinity and identification of the fault buried in salt lake,temperature inversion of brine and the fault verification.As a result,the study identified an important fault buried in the east of the Gasikule Salt Lake that controls the highest salinity abnormal.Because the level of the salinity is positively correlated to the mineral abundance,the result provides the important reference to identify the water body rich in mineral resources in the salt lake.
文摘The automatic registration of multi-source remote sensing images (RSI) is a research hotspot of remote sensing image preprocessing currently. A special automatic image registration module named the Image Autosync has been embedded into the ERDAS IMAGINE software of version 9.0 and above. The registration accuracies of the module verified for the remote sensing images obtained from different platforms or their different spatial resolution. Four tested registration experiments are discussed in this article to analyze the accuracy differences based on the remote sensing data which have different spatial resolution. The impact factors inducing the differences of registration accuracy are also analyzed.
基金Projects(41171326,40771198)supported by the National Natural Science Foundation of ChinaProject(08JJ6023)supported by the Natural Science Foundation of Hunan Province,China
文摘The components of urban surface cover are diversified,and component temperature has greater physical significance and application values in the studies on urban thermal environment.Although the multi-angle retrieval algorithm of component temperature has been matured gradually,its application in the studies on urban thermal environment is restricted due to the difficulty in acquiring urban-scale multi-angle thermal infrared data.Therefore,based on the existing multi-source multi-band remote sensing data,access to appropriate urban-scale component temperature is an urgent issue to be solved in current studies on urban thermal infrared remote sensing.Then,a retrieval algorithm of urban component temperature by multi-source multi-band remote sensing data on the basis of MODIS and Landsat TM images was proposed with expectations achieved in this work,which was finally validated by the experiment on urban images of Changsha,China.The results show that：1） Mean temperatures of impervious surface components and vegetation components are the maximum and minimum,respectively,which are in accordance with the distribution laws of actual surface temperature; 2） High-accuracy retrieval results are obtained in vegetation component temperature.Moreover,through a contrast between retrieval results and measured data,it is found that the retrieval temperature of impervious surface component has the maximum deviation from measured temperature and its deviation is greater than 1 ℃,while the deviation in vegetation component temperature is relatively low at 0.5 ℃.
基金Supported by Science and Technology Project of Lianyungang City(SH0917)
文摘[Objective] The aim was to extract red tide information in Haizhou Bay on the basis of multi-source remote sensing data.[Method] Red tide in Haizhou Bay was studied based on multi-source remote sensing data,such as IRS-P6 data on October 8,2005,Landsat 5-TM data on May 20,2006,MODIS 1B data on October 6,2006 and HY-1B second-grade data on April 22,2009,which were firstly preprocessed through geometric correction,atmospheric correction,image resizing and so on.At the same time,the synchronous environment monitoring data of red tide water were acquired.Then,band ratio method,chlorophyll-a concentration method and secondary filtering method were adopted to extract red tide information.[Result] On October 8,2005,the area of red tide was about 20.0 km2 in Haizhou Bay.There was no red tide in Haizhou bay on May 20,2006.On October 6,2006,large areas of red tide occurred in Haizhou bay,with area of 436.5 km2.On April 22,2009,red tide scattered in Haizhou bay,and its area was about 10.8 km2.[Conclusion] The research would provide technical ideas for the environmental monitoring department of Lianyungang to implement red tide forecast and warning effectively.
基金financially supported by the Youth Innovation Promotion Association CAS(No.2021325)the National Natural Science Foundation of China(Nos.52179117,U21A20159)the Research project of Panzhihua Iron and Steel Group Mining Co.,Ltd.(No.2021-P6-D2-05)。
文摘Source identification and deformation analysis of disaster bodies are the main contents of high-steep slope risk assessment,the establishment of high-precision model and the quantification of the fine geometric features of the slope are the prerequisites for the above work.In this study,based on the UAV remote sensing technology in acquiring refined model and quantitative parameters,a semi-automatic dangerous rock identification method based on multi-source data is proposed.In terms of the periodicity UAV-based deformation monitoring,the monitoring accuracy is defined according to the relative accuracy of multi-temporal point cloud.Taking a high-steep slope as research object,the UAV equipped with special sensors was used to obtain multi-source and multitemporal data,including high-precision DOM and multi-temporal 3D point clouds.The geometric features of the outcrop were extracted and superimposed with DOM images to carry out semi-automatic identification of dangerous rock mass,realizes the closed-loop of identification and accuracy verification;changing detection of multi-temporal 3D point clouds was conducted to capture deformation of slope with centimeter accuracy.The results show that the multi-source data-based semiautomatic dangerous rock identification method can complement each other to improve the efficiency and accuracy of identification,and the UAV-based multi-temporal monitoring can reveal the near real-time deformation state of slopes.
基金Under the auspices of the National Key Research and Development Program of China(No.2023YFC3208500)Shanghai Municipal Natural Science Foundation(No.22ZR1421500)+3 种基金National Natural Science Foundation of China(No.U2243207)National Science and Technology Basic Resources Survey Project(No.2023FY01001)Open Research Fund of State Key Laboratory of Estuarine and Coastal Research(No.SKLEC-KF202406)Project from Science and Technology Commission of Shanghai Municipality(No.22DZ1202700)。
文摘Mudflat vegetation plays a crucial role in the ecological function of wetland environment,and obtaining its fine spatial distri-bution is of great significance for wetland protection and management.Remote sensing techniques can realize the rapid extraction of wetland vegetation over a large area.However,the imaging of optical sensors is easily restricted by weather conditions,and the backs-cattered information reflected by Synthetic Aperture Radar(SAR)images is easily disturbed by many factors.Although both data sources have been applied in wetland vegetation classification,there is a lack of comparative study on how the selection of data sources affects the classification effect.This study takes the vegetation of the tidal flat wetland in Chongming Island,Shanghai,China,in 2019,as the research subject.A total of 22 optical feature parameters and 11 SAR feature parameters were extracted from the optical data source(Sentinel-2)and SAR data source(Sentinel-1),respectively.The performance of optical and SAR data and their feature paramet-ers in wetland vegetation classification was quantitatively compared and analyzed by different feature combinations.Furthermore,by simulating the scenario of missing optical images,the impact of optical image missing on vegetation classification accuracy and the compensatory effect of integrating SAR data were revealed.Results show that:1)under the same classification algorithm,the Overall Accuracy(OA)of the combined use of optical and SAR images was the highest,reaching 95.50%.The OA of using only optical images was slightly lower,while using only SAR images yields the lowest accuracy,but still achieved 86.48%.2)Compared to using the spec-tral reflectance of optical data and the backscattering coefficient of SAR data directly,the constructed optical and SAR feature paramet-ers contributed to improving classification accuracy.The inclusion of optical(vegetation index,spatial texture,and phenology features)and SAR feature parameters(SAR index and SAR texture features)in the classification algorithm resulted in an OA improvement of 4.56%and 9.47%,respectively.SAR backscatter,SAR index,optical phenological features,and vegetation index were identified as the top-ranking important features.3)When the optical data were missing continuously for six months,the OA dropped to a minimum of 41.56%.However,when combined with SAR data,the OA could be improved to 71.62%.This indicates that the incorporation of SAR features can effectively compensate for the loss of accuracy caused by optical image missing,especially in regions with long-term cloud cover.
基金supported by the National Natural Science Foundation of China[Grant No.42071413]the GHfund C[Grant No.202302039381].
文摘With the increasing frequency of floods,in-depth flood event analyses are essential for effective disaster relief and prevention.Satellite-based flood event datasets have become the primary data source for flood event analyses instead of limited disaster maps due to their enhanced availability.Nevertheless,despite the vast amount of available remote sensing images,existing flood event datasets continue to pose significant challenges in flood event analyses due to the uneven geographical distribution of data,the scarcity of time series data,and the limited availability of flood-related semantic information.There has been a surge in acceptance of deep learning models for flood event analyses,but some existing flood datasets do not align well with model training,and distinguishing flooded areas has proven difficult with limited data modalities and semantic information.Moreover,efficient retrieval and pre-screening of flood-related imagery from vast satellite data impose notable obstacles,particularly within large-scale analyses.To address these issues,we propose a Multimodal Flood Event Dataset(MFED)for deep-learning-based flood event analyses and data retrieval.It consists of 18 years of multi-source remote sensing imagery and heterogeneous textual information covering flood-prone areas worldwide.Incorporating optical and radar imagery can exploit the correlation and complementarity between distinct image modalities to capture the pixel features in flood imagery.It is worth noting that text modality data,including auxiliary hydrological information extracted from the Global Flood Database and text information refined from online news records,can also offer a semantic supplement to the images for flood event retrieval and analysis.To verify the applicability of the MFED in deep learning models,we carried out experiments with different models using a single modality and different combinations of modalities,which fully verified the effectiveness of the dataset.Furthermore,we also verify the efficiency of the MFED in comparative experiments with existing multimodal datasets and diverse neural network structures.
基金supported by the Beijing Natural Science Foundation(No.JQ20021)the National Natural Science Foundation of China(Nos.61922013,61421001 and U1833203)the Remote Sensing Monitoring Project of Geographical Elements in Shandong Yellow River Delta National Nature Reserve。
文摘With the deterioration of the environment,it is imperative to protect coastal wetlands.Using multi-source remote sensing data and object-based hierarchical classification to classify coastal wetlands is an effective method.The object-based hierarchical classification using remote sensing indices(OBH-RSI)for coastal wetland is proposed to achieve fine classification of coastal wetland.First,the original categories are divided into four groups according to the category characteristics.Second,the training and test maps of each group are extracted according to the remote sensing indices.Third,four groups are passed through the classifier in order.Finally,the results of the four groups are combined to get the final classification result map.The experimental results demonstrate that the overall accuracy,average accuracy and kappa coefficient of the proposed strategy are over 94%using the Yellow River Delta dataset.
基金Supported by the National Natural Science Foundation of China(42401488,42071351)the National Key Research and Development Program of China(2020YFA0608501,2017YFB0504204)+4 种基金the Liaoning Revitalization Talents Program(XLYC1802027)the Talent Recruited Program of the Chinese Academy of Science(Y938091)the Project Supported Discipline Innovation Team of the Liaoning Technical University(LNTU20TD-23)the Liaoning Province Doctoral Research Initiation Fund Program(2023-BS-202)the Basic Research Projects of Liaoning Department of Education(JYTQN2023202)。
文摘Accurate estimation of understory terrain has significant scientific importance for maintaining ecosystem balance and biodiversity conservation.Addressing the issue of inadequate representation of spatial heterogeneity when traditional forest topographic inversion methods consider the entire forest as the inversion unit,this study pro⁃poses a differentiated modeling approach to forest types based on refined land cover classification.Taking Puerto Ri⁃co and Maryland as study areas,a multi-dimensional feature system is constructed by integrating multi-source re⁃mote sensing data:ICESat-2 spaceborne LiDAR is used to obtain benchmark values for understory terrain,topo⁃graphic factors such as slope and aspect are extracted based on SRTM data,and vegetation cover characteristics are analyzed using Landsat-8 multispectral imagery.This study incorporates forest type as a classification modeling con⁃dition and applies the random forest algorithm to build differentiated topographic inversion models.Experimental re⁃sults indicate that,compared to traditional whole-area modeling methods(RMSE=5.06 m),forest type-based classi⁃fication modeling significantly improves the accuracy of understory terrain estimation(RMSE=2.94 m),validating the effectiveness of spatial heterogeneity modeling.Further sensitivity analysis reveals that canopy structure parame⁃ters(with RMSE variation reaching 4.11 m)exert a stronger regulatory effect on estimation accuracy compared to forest cover,providing important theoretical support for optimizing remote sensing models of forest topography.
文摘Using the three-layer variable infiltration capacity （VIC-3L） hydrological model and the successive interpolation approach （SIA） of climate factors, the authors studied the effect of different land cover types on the surface hydrological cycle. Daily climate data from 1992 to 2001 and remotely-sensed leaf area index （LAI） are used in the model. The model is applied to the Baohe River basin, a subbasin of the Yangtze River basin, China, with an area of 2500 km^2. The vegetation cover types in the Baohe River basin consist mostly of the mixed forest type （-85%）. Comparison of the modeled results with the observed discharge data suggests that： （1） Daily discharges over the period of 1992-2001 simulated with inputs of remotely-sensed land cover data and LAI data can generally produce observed discharge variations, and the modeled annual total discharge agrees with observations with a mean difference of 1.4%. The use of remote sensing images also makes the modeled spatial distributions of evapotranspiration physically meaningful. （2） The relative computing error （RCE） of the annual average discharge is -24.8% when the homogeneous broadleaf deciduous forestry cover is assumed for the watershed. The error is 21.8% when a homogeneous cropland cover is assumed and -14.32% when an REDC （Resource and Environment Database of China） land cover map is used. The error is reduced to 1.4% when a remotely-sensed land cover at 1000-m resolution is used.
基金Meteorological Research in the Public Interest,No.GYHY201106014Beijing Nova Program,No.2010B037China Special Fund for the National High Technology Research and Development Program of China(863 Program),No.412230
文摘Snow depth （SD） is a key parameter for research into global climate changes and land surface processes. A method was developed to obtain daily SD images at a higher 4 km spatial resolution and higher precision with SD measurements from in situ observations and passive microwave remote sensing of Advanced Microwave Scanning Radiometer-EOS （AMSR-E） and snow cover measurements of the Interactive Multisensor Snow and Ice Mapping System （IMS）. AMSR-E SD at 25 km spatial resolution was retrieved from AMSR-E products of snow density and snow water equivalent and then corrected using the SD from in situ observations and IMS snow cover. Corrected AMSR-E SD images were then resampled to act as ＂virtual＂ in situ observations to combine with the real in situ observations to interpolate at 4 km spatial resolution SD using the Cressman method. Finally, daily SD data generation for several regions of China demonstrated that the method is well suited to the generation of higher spatial resolution SD data in regions with a lower Digital Elevation Model （DEM） but not so well suited to regions at high altitude and with an undulating terrain, such as the Tibetan Plateau. Analysis of the longer time period SD data generation for January between 2003 and 2010 in northern Xinjiang also demonstrated the feasibility of the method.
基金supported by the National Natural Science Foundation of China under Grant number U2243222,42071413,and 41971397.
文摘Deep learning algorithms show good prospects for remote sensingflood monitoring.They mostly rely on huge amounts of labeled data.However,there is a lack of available labeled data in actual needs.In this paper,we propose a high-resolution multi-source remote sensing dataset forflood area extraction:GF-FloodNet.GF-FloodNet contains 13388 samples from Gaofen-3(GF-3)and Gaofen-2(GF-2)images.We use a multi-level sample selection and interactive annotation strategy based on active learning to construct it.Compare with otherflood-related datasets,GF-FloodNet not only has a spatial resolution of up to 1.5 m and provides pixel-level labels,but also consists of multi-source remote sensing data.We thoroughly validate and evaluate the dataset using several deep learning models,including quantitative analysis,qualitative analysis,and validation on large-scale remote sensing data in real scenes.Experimental results reveal that GF-FloodNet has significant advantages by multi-source data.It can support different deep learning models for training to extractflood areas.There should be a potential optimal boundary for model training in any deep learning dataset.The boundary seems close to 4824 samples in GF-FloodNet.We provide GF-FloodNet at https://www.kaggle.com/datasets/pengliuair/gf-floodnet and https://pan.baidu.com/s/1vdUCGNAfFwG5UjZ9RLLFMQ?pwd=8v6o.
基金supported by National Natural Science Foun-dation of China (Grant No.41030534)National Basic Research Program of China (Grant No. 2007CB714403)The European Commission Under FP7 Topic ENV.2007.4.1.4.2 "Improving Observing Systems for Water Resource Management"
文摘In this paper,we studied the effect of spatial distribution of soil parameters on passive soil moisture retrieval at pixel scale.First,we evaluated the forward microwave emission model and soil moisture retrieval algorithm accuracy through the observa-tion of field experiments.Then,we used soil parameters in different spatial distribution patterns,including random,normal,and uniform distribution,to determine the different levels of heterogeneity on soil moisture retrieval,in order to seek the rela-tionship between heterogeneity and soil moisture retrieval error.Finally,we conducted a controlled heterogeneity effect ex-periment measurements using a Truck-mounted Multi-frequency Radiometer(TMMR) to validate our simulation results.This work has proved that the soil moisture retrieval algorithm had a high accuracy(RMSE=0.049 cm3 cm 3) and can satisfy the need of this research.The simulation brightness temperatures match well with observations,with RMSE=9.89 K.At passive microwave remote sensing pixel scale,soil parameters with different spatial distribution patterns could have different levels of error on soil moisture estimation.Overall,we found that soil moisture with a random distribution in a satellite pixel scale can cause the largest error,with a normal distribution being the second,and a uniform distribution the least due to the smallest het-erogeneity.
基金supported by the National Key Research and Development Programs of China(Grant No.2016YFA0600302 and 2016YFB0501502)the Hainan Provincial key technology research and demonstration programs of farmland improvement(HNGDhs2015)+1 种基金the programs of the National Natural Science Foundation of China(Grant No.61801443 and 61401461)the Hainan Provincial Department of Science and Technology under the Grant No.ZDKJ2016021 and ZDKJ2016015-1.
文摘East Rennell of Solomon Island is the first natural site under customary law to be inscribed on UNESCO’s World Heritage List.Potential threats due to logging,mining and agriculture led to the site being declared a World Heritage in Danger in 2013.For East Rennell World Heritage Site(ERWHS)to‘shed’its‘Danger’status the management must monitor forest cover both within and outside of ERWHS.We used satellite data from multiple sources to track forest cover changes for the entire East Rennell island since 1998.95%of the island is still covered by undisturbed forests;annual average normalized difference vegetation index(NDVI)for the whole island was above 0.91 in 2015.However,vegetation cover in the island has been slowly decreasing,at a rate of–0.0011 NDVI per year between 2000 and 2015.This decrease less pronounced inside ERWHS compared to areas outside.While potential threats due to forest clearing outside ERWHS remain the forest cover change from 2000 to 2015 has been below 15%.We suggest ways in which the Government of Solomon Islands could use our data as well as unmanned air vehicles and field surveys to monitor forest cover change and ensure the future conservation of ERWHS.
基金the auspices of National Natural Science Foundation of China(No.41531174)National Basic Research Program of China(No.2015CB953702)。
文摘Land surface hydrothermal conditions(LSHCs) reflect land surface moisture and heat conditions, and play an important role in energy and water cycles in soil-plant-atmosphere continuum. Based on comparison of four evaluation methods(namely, the classic statistical method, geostatistical method, information theory method, and fractal method), this study proposed a new scheme for evaluating the spatial heterogeneity of LSHCs. This scheme incorporates diverse remotely sensed surface parameters, e.g., leaf area index-LAI, the normalized difference vegetation index-NDVI, net radiation-Rn, and land surface temperature-LST. The LSHCs can be classified into three categories, namely homogeneous, moderately heterogeneous and highly heterogeneous based on the remotely sensed LAI data with a 30 m spatial resolution and the combination of normalized information entropy(S’) and coefficient of variation(CV). Based on the evaluation scheme, the spatial heterogeneity of land surface hydrothermal conditions at six typical flux observation stations in the Heihe River Basin during the vegetation growing season were evaluated. The evaluation results were consistent with the land surface type characteristics exhibited by Google Earth imagery and spatial heterogeneity assessed by high resolution remote sensing evapotranspiration data. Impact factors such as precipitation and irrigation events, spatial resolutions of remote sensing data, heterogeneity in the vertical direction, topography and sparse vegetation could also affect the evaluation results. For instance, short-term changes(precipitation and irrigation events) in the spatial heterogeneity of LSHCs can be diagnosed by energy factors, while long-term changes can be indicated by vegetation factors. The spatial heterogeneity of LSHCs decreases when decreasing the spatial resolution of remote sensing data. The proposed evaluation scheme would be useful for the quantification of spatial heterogeneity of LSHCs over flux observation stations toward the global scale, and also contribute to the improvement of the accuracy of estimation and validation for remotely sensed(or model simulated) evapotranspiration.
基金Supported by the National Natural Science Foundation of China(Nos.42376185,41876111)the Shandong Provincial Natural Science Foundation(No.ZR2023MD073)。
文摘Benthic habitat mapping is an emerging discipline in the international marine field in recent years,providing an effective tool for marine spatial planning,marine ecological management,and decision-making applications.Seabed sediment classification is one of the main contents of seabed habitat mapping.In response to the impact of remote sensing imaging quality and the limitations of acoustic measurement range,where a single data source does not fully reflect the substrate type,we proposed a high-precision seabed habitat sediment classification method that integrates data from multiple sources.Based on WorldView-2 multi-spectral remote sensing image data and multibeam bathymetry data,constructed a random forests(RF)classifier with optimal feature selection.A seabed sediment classification experiment integrating optical remote sensing and acoustic remote sensing data was carried out in the shallow water area of Wuzhizhou Island,Hainan,South China.Different seabed sediment types,such as sand,seagrass,and coral reefs were effectively identified,with an overall classification accuracy of 92%.Experimental results show that RF matrix optimized by fusing multi-source remote sensing data for feature selection were better than the classification results of simple combinations of data sources,which improved the accuracy of seabed sediment classification.Therefore,the method proposed in this paper can be effectively applied to high-precision seabed sediment classification and habitat mapping around islands and reefs.
文摘目的随着视觉大模型的发展,利用多源无标注遥感影像预训练学习全局视觉特征,并在局部目标任务上进行迁移微调,已成为遥感影像领域自适应的一种新范式。然而,现有的全局预训练策略主要聚焦于学习低级的通用视觉特征,难以捕捉复杂、高层次的语义关联。此外,微调过程中使用的少量标注样本往往只反映目标域的特定场景,无法充分激活全局模型中与目标域匹配的领域知识。因此,面对复杂多变的遥感影像跨时空领域偏移,现有方法得到的全局模型与目标任务之间仍然存在巨大的语义鸿沟。为应对这一挑战,本文提出一种语言文本引导的“全局模型预训练—局部模型微调”的领域自适应框架。方法提出框架针对遥感数据的时空异质性特点,借助大型视觉语言助手LLaVA(large language and vision assistant)生成包含季节、地理区域及地物分布等时空信息的遥感影像文本描述。通过语言文本引导的学习帮助全局模型挖掘地物的时空分布规律,增强局部任务微调时相关领域知识的激活。结果在对比判别式、掩码生成式和扩散生成式3种不同全局预训练策略上设置了3组“全局—局部”跨时空领域自适应语义分割实验来验证提出框架的有效性。以全局→局部(长沙)为例,使用语言文本引导相比于无文本引导在3种不同预训练策略上分别提升了8.7%、4.4%和2.9%。同样地,提出框架在全局→局部(湘潭)和全局→局部(武汉)上也都有性能提升。结论证明了语言文本对准确理解跨时空遥感影像中的语义内容具有积极影响。与无文本引导的学习方法相比,提出框架显著提升了模型的迁移性能。
