摘要
遥感地物间的语义关系可以表征地物间的相互影响与结构信息,对地表的灾害检测与应急响应具有重要意义。然而,现有的遥感地物关系提取方法多依赖于目标检测,定位精度有限,且关系预测网络主要局限于注意力机制、卷积网络,难以有效建模复杂拓扑关系。此外,公开规范的遥感地物关系数据集的缺乏也进一步制约了该领域的发展。为了解决上述问题,该文建立了遥感地物语义关系数据集,并采用了一种基于图神经网络的关系预测模型,准确提取遥感场景中蕴含的地物关系。具体而言,首先针对地物实例定义了遥感地物关系描述体系,结合地物类别和拓扑信息标注地物间的语义关系,构建了遥感地物语义关系数据集。其次,引入先进的图神经网络模型进行关系预测,通过子图采样和超参数优化,有效提升了模型在遥感场景下的性能。通过上述方法,该文建立了一个小型的遥感地物语义关系数据集,探索了图神经网络在遥感地表异常场景中地物关系提取的应用。在遥感地物关系描述数据集上进行的实验结果表明,模型不仅在验证集的评估指标中表现出较强的竞争力,还在灾害异常场景中的实验中检测到灾害前后地物关系的显著变化,加强了对灾害场景地表异常的理解能力。
Objective The increasing frequency and severity of surface anomalies induced by natural processes and human activities has raised the demand for real-time,intelligent remote sensing systems for disaster monitoring and emergency response.Existing approaches to extracting geographic object relationships in remote sensing images primarily rely on object detection models.These approaches often lack sufficient localization precision and fail to capture topological dependencies between objects.Moreover,the absence of standardized,high-quality datasets restricts progress in model development.To address these limitations,this study proposes a framework that integrates graph-based representation with a Graph Neural Network(GNN)architecture to reason over geographic object relationships.The main objectives are to:(1)construct a semantically annotated dataset of geographic object relationships in remote sensing imagery;(2)develop a GNN-based model to improve relationship prediction accuracy;and(3)evaluate the model’s effectiveness in detecting and interpreting surface anomalies by analyzing pre-and post-disaster relationship patterns across a range of scenarios.Methods The methodology comprises three primary components:dataset construction,model development,and performance evaluation.To address the scarcity of labeled data,a semantic relationship dataset is constructed.Thirty high-resolution remote sensing images from the OpenEarthMap dataset are manually annotated using EISeg software,resulting in 17 object categories(Table 1)and five semantic relationships—contain,connect,on,along,and beside—defined through analysis of topological interactions(Table 2).Instance-level annotations are generated using connected component labeling,and relationship labels are assigned based on both topological configuration and object category.The resulting dataset includes 7,063 annotated entities and 13,273 relationship triplets.A GNN-based model is developed to predict semantic relationships,incorporating subgraph sampling and hyperparameter optimization.The model employs the Personalized PageRank(PPR)algorithm to extract query-relevant subgraphs,thereby reducing computational complexity while preserving essential topological structure.Message passing mechanisms from RED-GNN are used to propagate node features,and Bayesian optimization is applied to tune hyperparameters.Model performance is assessed using standard metrics:Mean Reciprocal Rank(MRR),HITS@1,and HITS@10.Results and Discussions Extensive experiments demonstrate the high performance of the proposed framework.On the constructed dataset,the model achieves an MRR of 0.9879 on the test set,with HITS@1 and HITS@10 scores of 97.03%and 99.96%,respectively,outperforming baseline methods such as RED-GNN and Grail(Table 5).Ablation studies confirm the effectiveness of the PPR sampling strategy,which outperforms random walk,breadth-first search,and standard PageRank in terms of both accuracy and efficiency(Table 6).Model generalizability is further assessed using pre-and post-disaster images from the xBD dataset.In hurricane-affected regions(Fig.6,Fig.7),abnormal relationships—such as“sea lake pond contain residential area”—emerge,reflecting the submergence of buildings and roads due to flooding.Frequency histograms(Fig.8,Fig.9)indicate a post-disaster decrease in relationship diversity and a shift toward water-related spatial associations.In wildfire scenarios(Fig.10–Fig.13),relationships such as"bareland contain rangeland"replace"tree beside rangeland,"suggesting vegetation loss and soil exposure.These findings demonstrate the model’s capacity to detect spatial and semantic shifts in geographic object relationships caused by disasters.Coarse anomaly localization is achieved through centroid-based node mapping,enabling interpretation of surface anomaly dynamics over time.Conclusions This study contributes to remote sensing-based surface anomaly detection through three main innovations.First,a high-quality semantic relationship dataset is constructed with pixel-level annotations and standardized relationship definitions,addressing the lack of labeled data in this area.The dataset includes 17 object categories and five topologically defined relationship types,offering a valuable benchmark for future research.Second,a novel GNN-based model is developed that advances relationship prediction by integrating PPR-based subgraph sampling with optimized message passing mechanisms.Third,the framework is extensively validated using real-world disaster scenarios,demonstrating its practical utility in detecting and interpreting surface anomalies through changes in object relationships.The model’s ability to produce interpretable relationship graphs while maintaining computational efficiency supports its application in time-sensitive emergency response contexts.Future work will focus on expanding image diversity,refining relationship definitions,and incorporating real-world noise to improve robustness.
作者
刘思琪
高智
陈泊安
路遥
朱军
李衍璋
王桥
LIU Siqi;GAO Zhi;CHEN Boan;LU Yao;ZHU Jun;LI Yanzhang;WANG Qiao(School of Remote Sensing and Information Engineering,Wuhan University,Wuhan 430072,China;Beijing Institute of Remote Sensing Information,Beijing 100000,China;DFH Satellite Co.,Ltd.,Beijing 100094,China;Beijing Normal University,Beijing 100091,China)
出处
《电子与信息学报》
北大核心
2025年第6期1690-1703,共14页
Journal of Electronics & Information Technology
基金
民用航天项目(D010206)。
关键词
图神经网络
遥感影像解译
语义关系
关系预测
拓扑关系
Graph Neural Network(GNN)
Remote sensing image interpretation
Semantic relationship
Relation prediction
Topological relationship
