摘要
虽然目前可以获取海量的多时相遥感数据,但是由于建筑物变化时间周期过长,难以获取充足的建筑物变化数据对来支撑数据驱动的深度学习变化检测模型构建,呈现多时相遥感建筑物变化检测处理精度差的问题。因此,为提升变化检测算法模型处理性能,该文从建筑物变化检测训练数据对生成开展研究,基于一致性对抗生成机理提出了多时相建筑物变化检测数据对生成网络(BAG-GAN)。其主要在多时相图像生成过程中采用对抗一致性损失函数约束,在保证生成图像和输入图像关联性的同时,保证了生成模型的多模态输出能力。此外,还通过重组原数据集中的变化标签和多时相遥感图像来进一步提升建筑物变化信息生成的多样性,解决了训练数据中有效建筑物变化信息占比少的问题,为变化监测算法模型的充分训练奠定了基础。最后,在LEVIR-CD和WHU-CD建筑物变化检测数据集上进行了数据生成实验,并使用生成扩充后的数据集训练了多种较为经典的遥感图像变化检测模型,实验结果表明该文提出的BAG-GAN多时相建筑物变化检测数据对生成网络及相应的生成策略可以有效提升变化检测模型的处理精度。
Objective Building change detection is an essential task in urban planning,disaster management,environmental monitoring,and other critical applications.Advances in multi-temporal remote sensing technology have provided vast amounts of data,enabling the monitoring of changes over large geographic areas and extended time frames.Despite this,significant challenges persist,particularly in acquiring sufficient labeled data pairs for training deep learning models.Building changes are typically characterized by long temporal cycles,leading to a scarcity of annotated data that is critical for training data-driven deep learning models.This scarcity severely limits the models'capacity to generalize and achieve high accuracy,particularly in complex and diverse scenarios.The performance of existing methods often suffers from poor generalization due to insufficient training data,reducing their applicability to practical tasks.To address these challenges,this study proposes a novel solution:the development of a multi-temporal building change detection data pair generation network,referred to as BAG-GAN.This network leverages a consistency adversarial generation mechanism to create diverse and semantically consistent data pairs.The aim is to enrich training datasets,thereby enhancing the learning capacity of deep learning models for detecting building changes.By addressing the bottleneck of insufficient labeled data,BAG-GAN provides a new pathway for improving the accuracy and robustness of multi-temporal building change detection.Methods BAG-GAN integrates Generative Adversarial Networks(GANs)with a specially designed consistency constraint mechanism,tailored for the generation of data pairs in multi-temporal building change detection tasks.The core innovation of this network lies in its adversarial consistency loss function.This loss function ensures that the generated images maintain semantic consistency with the corresponding input images while reflecting realistic and diverse changes.The consistency constraint is crucial for preserving the integrity of the generated data and ensuring its relevance to real-world scenarios.The network is composed of two main components:a generator and a discriminator,which work in tandem through an adversarial learning process.The generator aims to produce realistic and semantically consistent multi-temporal image pairs,while the discriminator evaluates the quality of the generated data,guiding the generator to improve iteratively.Additionally,BAG-GAN is equipped with multimodal output capabilities,enabling the generation of diverse building change data pairs.This diversity enhances the robustness of deep learning models by exposing them to a wider range of scenarios during training.To address the issue of limited training data,the study incorporates a data augmentation strategy.Original datasets,such as LEVIR-CD and WHU-CD,were reorganized by combining change labels with multi-temporal remote sensing images to create new synthetic datasets.These augmented datasets,along with the data generated by BAG-GAN,were used to train and evaluate several widely recognized deep learning models,including FC-EF,FC-Siam-Conc,and others.Comparative experiments were conducted to assess the effectiveness of BAG-GAN and its contribution to improving model performance in multi-temporal building change detection.Results and Discussions The experimental results demonstrate that BAG-GAN effectively addresses the challenges of insufficient labeled data in building change detection tasks.Models trained on the augmented datasets,which included BAG-GAN-generated data,achieved significant improvements in detection accuracy and robustness.For instance,classic models like FC-EF and FC-Siam-Conc showed substantial performance gains when trained on augmented datasets compared to their performance on the original datasets.These improvements validate the effectiveness of BAG-GAN in generating high-quality training data.BAG-GAN also excelled in producing diverse and multimodal building change data pairs visual comparisons between the generated data and the original datasets and highlighted the network's ability to create realistic and varied data,effectively enhancing the diversity of training datasets.This diversity is critical for addressing the imbalance in existing datasets,where effective building change information is underrepresented.By increasing the proportion of relevant change information in the training data,BAG-GAN improves the learning conditions for deep learning models,enabling them to better generalize across different scenarios.Further analysis revealed that BAG-GAN significantly enhances the ability of detection models to localize changes and recover fine-grained details of building modifications.This is particularly evident in complex scenarios involving subtle or small-scale changes.The adversarial consistency loss function played a pivotal role in ensuring the semantic relevance of the generated data,making BAG-GAN a reliable tool for data augmentation in remote sensing applications.Moreover,the network's ability to generate data pairs with high-quality and multimodal characteristics ensures its applicability to a wide range of remote sensing tasks beyond building change detection.Conclusions This study introduces BAG-GAN,a novel multi-temporal building change detection data pair generation network designed to overcome the limitations of insufficient labeled data in remote sensing.The network incorporates an adversarial consistency loss function,which ensures that the generated data is both semantically consistent and diverse.By leveraging a consistency adversarial generation mechanism,BAG-GAN enhances the quality and diversity of training datasets,addressing key bottlenecks in multi-temporal building change detection tasks.Through experiments on the LEVIR-CD and WHU-CD datasets,BAG-GAN demonstrated its ability to significantly improve the performance of classic remote sensing change detection models,such as FC-EF and FC-Siam-Conc.The results highlight the network's effectiveness in generating high-quality data pairs that enhance model training and detection accuracy.This research not only provides a robust methodological framework for improving multi-temporal building change detection but also offers a foundational tool for broader applications in remote sensing.The findings pave the way for future advancements in change detection techniques,offering valuable insights for researchers and practitioners in the field.
作者
陈昊
周光尧
王乾通
高斌
王文志
唐皓
CHEN Hao;ZHOU Guangyao;WANG Qiantong;GAO Bin;WANG Wenzhi;TANG Hao(Beijing Institute of Tracking and Communication Technology,Beijing 100094,China;Aerospace Information Innovation Research Institute,Chinese Academy of Sciences,Beijing 100094,China)
出处
《电子与信息学报》
北大核心
2025年第3期825-838,共14页
Journal of Electronics & Information Technology
关键词
多时相遥感
建筑物变化检测
对抗生成网络
数据对生成
Multi-temporal remote sensing
Change detection
Adversarial Generative Network(AGN)
Data pair generation
