This study proposes a new component of the composite loss function minimised during training of the Super-Resolution(SR)algorithms—the normalised structural similarity index loss LSSIMN,which has the potential to imp...This study proposes a new component of the composite loss function minimised during training of the Super-Resolution(SR)algorithms—the normalised structural similarity index loss LSSIMN,which has the potential to improve the natural appearance of reconstructed images.Deep learning-based super-resolution(SR)algorithms reconstruct high-resolution images from low-resolution inputs,offering a practical means to enhance image quality without requiring superior imaging hardware,which is particularly important in medical applications where diagnostic accuracy is critical.Although recent SR methods employing convolutional and generative adversarial networks achieve high pixel fidelity,visual artefacts may persist,making the design of the loss function during training essential for ensuring reliable and naturalistic image reconstruction.Our research shows on two models—SR and Invertible Rescaling Neural Network(IRN)—trained on multiple benchmark datasets that the function LSSIMN significantly contributes to the visual quality,preserving the structural fidelity on the reference datasets.The quantitative analysis of results while incorporating LSSIMN shows that including this loss function component has a mean 2.88%impact on the improvement of the final structural similarity of the reconstructed images in the validation set,in comparison to leaving it out and 0.218%in comparison when this component is non-normalised.展开更多
为了解决红外制导研究中舰船图像样本数量不足的问题,提出一种面向舰船图像的改进的生成对抗网络(generative adversarial network,GAN),能够生成高质量的红外图像。首先转换可见光图像颜色空间以更好地捕捉夜间低亮度下图像的轮廓信息...为了解决红外制导研究中舰船图像样本数量不足的问题,提出一种面向舰船图像的改进的生成对抗网络(generative adversarial network,GAN),能够生成高质量的红外图像。首先转换可见光图像颜色空间以更好地捕捉夜间低亮度下图像的轮廓信息,然后引入残差块生成网络降低低像素的可见光图像对生成的红外图像的影响并加深网络层数以更好地学习深层映射关系,最后引入更平滑的损失函数加快收敛速度,提高生成红外图像目标边缘清晰程度。在制作的无人机拍摄的红外可见光配对的数据集进行测试,改进后的方法平均生成图像峰值信噪比(peak signal to noiseratio,PSNR)提升20.3%,结构相似性度量(structural similarity,SSIM)提升30.4%。结果表明改进的网络可以生成质量更高的红外仿真图像,用于目标检测等任务有更好的效果。展开更多
基金support from the following institutional grant.Internal Grant Agency of the Faculty of Economics and Management,Czech University of Life Sciences Prague,grant no.2023A0004(https://iga.pef.czu.cz/,accessed on 6 June 2025).
文摘This study proposes a new component of the composite loss function minimised during training of the Super-Resolution(SR)algorithms—the normalised structural similarity index loss LSSIMN,which has the potential to improve the natural appearance of reconstructed images.Deep learning-based super-resolution(SR)algorithms reconstruct high-resolution images from low-resolution inputs,offering a practical means to enhance image quality without requiring superior imaging hardware,which is particularly important in medical applications where diagnostic accuracy is critical.Although recent SR methods employing convolutional and generative adversarial networks achieve high pixel fidelity,visual artefacts may persist,making the design of the loss function during training essential for ensuring reliable and naturalistic image reconstruction.Our research shows on two models—SR and Invertible Rescaling Neural Network(IRN)—trained on multiple benchmark datasets that the function LSSIMN significantly contributes to the visual quality,preserving the structural fidelity on the reference datasets.The quantitative analysis of results while incorporating LSSIMN shows that including this loss function component has a mean 2.88%impact on the improvement of the final structural similarity of the reconstructed images in the validation set,in comparison to leaving it out and 0.218%in comparison when this component is non-normalised.
文摘为了解决红外制导研究中舰船图像样本数量不足的问题,提出一种面向舰船图像的改进的生成对抗网络(generative adversarial network,GAN),能够生成高质量的红外图像。首先转换可见光图像颜色空间以更好地捕捉夜间低亮度下图像的轮廓信息,然后引入残差块生成网络降低低像素的可见光图像对生成的红外图像的影响并加深网络层数以更好地学习深层映射关系,最后引入更平滑的损失函数加快收敛速度,提高生成红外图像目标边缘清晰程度。在制作的无人机拍摄的红外可见光配对的数据集进行测试,改进后的方法平均生成图像峰值信噪比(peak signal to noiseratio,PSNR)提升20.3%,结构相似性度量(structural similarity,SSIM)提升30.4%。结果表明改进的网络可以生成质量更高的红外仿真图像,用于目标检测等任务有更好的效果。
