摘要
近年来,我国海洋发展战略逐步兴起,水下成像技术在海洋工程、海洋资源开发及海洋环境保护等领域发挥日益重要的作用。同时,深度学习技术在图像处理领域获得广泛应用。本文在介绍深度学习基本概念的基础上,对其在水下成像技术中的最新应用研究进展进行了系统综述,针对深度学习在水下图像增强技术、水下图像复原技术、水下偏振成像技术、水下关联成像技术、水下光谱成像技术、水下压缩感知成像技术、水下激光成像技术及水下全息成像技术等典型水下成像场景中的应用特点及不足进行了分析对比,并对该技术的未来发展方向进行了展望。
Underwater imaging plays an increasingly important role in marine military,marine engineering,marine resource development,marine environmental protection,and so on,with the advantage of providing rich information,high resolution and high visibility underwater images.However,a large number of plankton and suspended particles in water environment,especially in the marine environment,causing strong scattering and absorption effects and resulting in image degradation problems such as blurring,short imaging distance,color distortion,low contrast,etc.Therefore,a series of underwater imaging methods have been proposed to solve the above problems.The underwater image enhancement technology can be used for image denoising,contrastimprovement and color distortioncorrection.The underwater image restoration uses the physical model of water degradation to restore the real image.The underwater polarization imaging uses the polarization difference between background and target to remove noise.The underwater ghost imaging and underwater compressed sensing imaging are used for imaging in scattering media.The underwater spectral imaging is used for color restoration.The underwater laser imaging is used for long-range and three-dimensional imaging.The underwater holographic imaging is used for water microorganism imaging,and so on.However,the above methods can only solve some image degradation problems,and there are some drawbacks,such as the subjectivity of underwater image enhancement technology,the dependence of underwater image recovery technology on prior information,and the computational load of underwater image correlation.The development of deep learning together with the development of hardware technology provides new solutions to the above problems,which makes the combination of deep learning and underwater imaging technology more and more widely used.As a powerful tool,neural network can extract similar features of different images using a wide range of datasets and convert them into high-level features,which can be used to process new input data,and completes a variety of complex tasks implicitly.It performs excellently in the field of image processing,and has made some achievements in the application of underwater imaging.Deep learning-basedimage restoration uses neural network to establish imageparameter mapping to estimate model parameters,avoiding human-dominant influence.Deep learningbased polarization imaging uses a neural network to map polarized images to clear images for image denoising.Deep learning-based spectral underwater imaging technology uses neural network to fuse multispectral images and hyperspectral images to obtain images with both high spatial resolution and hyperspectral resolution.However,some problems such as lack of datasets,poor generalization,and insufficient network interpretabilitystill exist,which need to be further solved.In this review,we discuss the characteristics of water environment and the various problems existing in underwater imaging,such as image blurring,short imaging distance,severe color distortion,and so on.The causes of the problem are analyzed and the underwater IFM model proposed by Jaffe-McGlamey is introduced.The latest application progress of various classic underwater imaging methods is systematically reviewed,including underwater image enhancement,underwater image restoration,underwater polarization imaging,underwater correlation imaging,underwater spectral imaging,underwater compression sensing imaging,underwater laser imaging and underwater holographic imaging.In addition,the basic concepts of deep learning,the composition of neural network and the structure of classical CNN network are introduced,and the latest application in combination with the above underwater imaging technology is systematically reviewed.At the same time,the application characteristics,deficiencies of traditional underwater imaging and the improvement by deep learning are analyzed and compared,and the applications of deep learning in various imaging methods are summarized.CNN network structure and MSE loss function are most commonly used due to its simplicity and efficiency.Finally,the future direction of underwater imaging technology based on deep learning is prospected.
作者
谢俊
邸江磊
秦玉文
XIE Jun;DI Jianglei;QIN Yuwen(Institute of Advanced Photonics Technology,School of Information Engineering,Guangdong Provincial Key Laboratory of Information Photonics Technology,Guangdong University of Technology,Guangzhou 510006,China)
出处
《光子学报》
EI
CAS
CSCD
北大核心
2022年第11期1-48,共48页
Acta Photonica Sinica
基金
国家自然科学基金(No.62075183)
广东省珠江人才计划引进创新创业团队项目(No.2019ZTO8X340)。
关键词
深度学习
水下成像
图像增强
图像重建
Deep learning
Underwater imaging
Image enhancement
Image restoration
