90 / 2024-08-15 14:08:55
基于 LGGAN-Transformer 的遥感图像可见光红外转换算法
生成对抗网络,红外图像生成,Transformer,共享权重,物理约束
摘要待审
LianYuanfeng / Beijing;China University of Petroleum
LiuXuanhe / Beijing;China University of Petroleum
摘要 针对可见光红外遥感图像转换过程中由于复杂背景、光线干扰等因素引起的纹理和结构信息差的问题,提出了一种基于全局多尺度反射Transformer和局部边缘感知Transformer生成对抗网络(LGGAN-Transformer)的遥感图像可见光红外转换算法。首先设计物理反射系数提取模块提取短波红外图像特征。然后提出具有多层次共享策略的多尺度反射Transformer和边缘感知Transformer分别提取图像的全局特征和局部特征。最后将边缘引导模块嵌入到判别器中,提高生成器的边缘识别能力。在哨兵二号数据集和自建数据集上进行实验,MS-SSIM分别提高4.27%和5.71%。实验结果表明,本文方法在短波红外图像生成任务中有着较高的生成图片质量和较清晰的局部纹理。

Abstract Aiming at the problem of poor texture and structure information caused by complex background and light interference in the process of visible infrared remote sensing image conversion, a visible infrared conversion algorithm of remote sensing image based on global multi-scale reflection Transformer and local edge-aware Transformer generative adversarial network ( LGGAN-Transformer ) is proposed. Firstly, the physical reflection coefficient extraction module is designed to extract the features of shortwave infrared images. Then, a multi-scale reflection Transformer and an edge-aware Transformer with a multi-level sharing strategy are proposed to extract the global and local features of the image respectively. Finally, the edge guidance module is embedded into the discriminator to improve the edge recognition ability of the generator. Experiments on Sentinel-2 data set and self-built data set show that MS-SSIM increases by 4.27 % and 5.71 % respectively. The experimental results show that the proposed method has higher image quality and clearer local texture in the shortwave infrared image generation task.


 
重要日期
  • 会议日期

    09月20日

    2024

    09月22日

    2024

  • 08月30日 2024

    初稿截稿日期

  • 09月22日 2024

    注册截止日期

主办单位
山东省人民政府
中国电子学会
承办单位
中国科学院学部
中国科学院空天信创新研究所息
复旦大学
联系方式
移动端
在手机上打开
小程序
打开微信小程序
客服
扫码或点此咨询
Baidu
map