Side-scan sonar(SSS)is essential for acquiring high-resolution seafloor images over large areas,facilitat-ing the identification of subsea objects.However,military security restrictions and the scarcity of subsea targ...Side-scan sonar(SSS)is essential for acquiring high-resolution seafloor images over large areas,facilitat-ing the identification of subsea objects.However,military security restrictions and the scarcity of subsea targets limit the availability of SSS data,posing challenges for Automatic Target Recognition(ATR)research.This paper presents an approach that uses Cycle-Consistent Generative Adversarial Networks(CycleGAN)to augment SSS images of key subsea objects,such as shipwrecks,aircraft,and drowning victims.The process begins by constructing 3D models to generate rendered images with realistic shadows frommultiple angles.To enhance image quality,a shadowextractor and shadow region loss function are introduced to ensure consistent shadowrepresentation.Additionally,amulti-resolution learning structure enables effective training,even with limited data availability.The experimental results show that the generated data improved object detection accuracy when they were used for training and demonstrated the ability to generate clear shadow and background regions with stability.展开更多
Underwater shipwreck identification technology, as a crucial technique in the field of marine surveying, plays a significant role in areas such as the search and rescue of maritime disaster shipwrecks. When facing the...Underwater shipwreck identification technology, as a crucial technique in the field of marine surveying, plays a significant role in areas such as the search and rescue of maritime disaster shipwrecks. When facing the task of object detection in shipwreck side-scan sonar images, due to the complex seabed environment, it is difficult to extract object features, often leading to missed detections of shipwreck images and slow detection speed. To address these issues, this paper proposes an object detection algorithm, CSC-YOLO (Context Guided Block, Shared Conv_Group Normalization Detection, Cross Stage Partial with 2 Partial Convolution-You Only Look Once), based on YOLOv8n for shipwreck side-scan sonar images. Firstly, to tackle the problem of small samples in shipwreck side-scan sonar images, a new dataset was constructed through offline data augmentation to expand data and intuitively enhance sample diversity, with the Mosaic algorithm integrated to strengthen the network’s generalization to the dataset. Subsequently, the Context Guided Block (CGB) module was introduced into the backbone network model to enhance the network’s ability to learn and express image features. Additionally, by employing Group Normalization (GN) techniques and shared convolution operations, we constructed the Shared Conv_GN Detection (SCGD) head, which improves the localization and classification performance of the detection head while significantly reducing the number of parameters and computational load. Finally, the Partial Convolution (PConv) was introduced and the Cross Stage Partial with 2 PConv (C2PC) module was constructed to help the network maintain effective extraction of spatial features while reducing computational complexity. The improved CSC-YOLO model, compared with the YOLOv8n model on the validation set, mean Average Precision (mAP) increases by 3.1%, Recall (R) increases by 6.4%, and the F1-measure (F1) increases by 4.7%. Furthermore, in the improved algorithm, the number of parameters decreases by 20%, the computational complexity decreases by 23.2%, and Frames Per Second (FPS) increases by 17.6%. In addition, compared with the advanced popular model, the superiority of the proposed model is proved. The subsequent experiments on real side-scan sonar images of shipwrecks fully demonstrate that the CSC-YOLO algorithm meets the requirements for actual side-scan sonar detection of underwater shipwrecks.展开更多
Underwater target detection in forward-looking sonar(FLS)images is a challenging but promising endeavor.The existing neural-based methods yield notable progress but there remains room for improvement due to overlookin...Underwater target detection in forward-looking sonar(FLS)images is a challenging but promising endeavor.The existing neural-based methods yield notable progress but there remains room for improvement due to overlooking the unique characteristics of underwater environments.Considering the problems of low imaging resolution,complex background environment,and large changes in target imaging of underwater sonar images,this paper specifically designs a sonar images target detection Network based on Progressive sensitivity capture,named ProNet.It progressively captures the sensitive regions in the current image where potential effective targets may exist.Guided by this basic idea,the primary technical innovation of this paper is the introduction of a foundational module structure for constructing a sonar target detection backbone network.This structure employs a multi-subspace mixed convolution module that initially maps sonar images into different subspaces and extracts local contextual features using varying convolutional receptive fields within these heterogeneous subspaces.Subsequently,a Scale-aware aggregation module effectively aggregates the heterogeneous features extracted from different subspaces.Finally,the multi-scale attention structure further enhances the relational perception of the aggregated features.We evaluated ProNet on three FLS datasets of varying scenes,and experimental results indicate that ProNet outperforms the current state-of-the-art sonar image and general target detectors.展开更多
Side-scan sonar(SSS)is now a prevalent instrument for large-scale seafloor topography measurements,deployable on an autonomous underwater vehicle(AUV)to execute fully automated underwater acoustic scanning imaging alo...Side-scan sonar(SSS)is now a prevalent instrument for large-scale seafloor topography measurements,deployable on an autonomous underwater vehicle(AUV)to execute fully automated underwater acoustic scanning imaging along a predetermined trajectory.However,SSS images often suffer from speckle noise caused by mutual interference between echoes,and limited AUV computational resources further hinder noise suppression.Existing approaches for SSS image processing and speckle noise reduction rely heavily on complex network structures and fail to combine the benefits of deep learning and domain knowledge.To address the problem,Rep DNet,a novel and effective despeckling convolutional neural network is proposed.Rep DNet introduces two re-parameterized blocks:the Pixel Smoothing Block(PSB)and Edge Enhancement Block(EEB),preserving edge information while attenuating speckle noise.During training,PSB and EEB manifest as double-layered multi-branch structures,integrating first-order and secondorder derivatives and smoothing functions.During inference,the branches are re-parameterized into a 3×3 convolution,enabling efficient inference without sacrificing accuracy.Rep DNet comprises three computational operations:3×3 convolution,element-wise summation and Rectified Linear Unit activation.Evaluations on benchmark datasets,a real SSS dataset and Data collected at Lake Mulan aestablish Rep DNet as a well-balanced network,meeting the AUV computational constraints in terms of performance and latency.展开更多
The risk of gas leakage due to geological flaws in offshore carbon capture, utilization, and storage, as well as leakage from underwater oil or gas pipelines, highlights the need for underwater gas leakage monitoring ...The risk of gas leakage due to geological flaws in offshore carbon capture, utilization, and storage, as well as leakage from underwater oil or gas pipelines, highlights the need for underwater gas leakage monitoring technology. Remotely operated vehicles(ROVs) and autonomous underwater vehicles(AUVs) are equipped with high-resolution imaging sonar systems that have broad application potential in underwater gas and target detection tasks. However, some bubble clusters are relatively weak scatterers, so detecting and distinguishing them against the seabed reverberation in forward-looking sonar images are challenging. This study uses the dual-tree complex wavelet transform to extract the image features of multibeam forward-looking sonar. Underwater gas leakages with different flows are classified by combining deep learning theory. A pool experiment is designed to simulate gas leakage, where sonar images are obtained for further processing. Results demonstrate that this method can detect and classify underwater gas leakage streams with high classification accuracy. This performance indicates that the method can detect gas leakage from multibeam forward-looking sonar images and has the potential to predict gas leakage flow.展开更多
This article introduces an underwater robot inspection anomaly localization feedback system comprising a real-time water surface tracking,detection,and positioning system located on the water surface,while the underwa...This article introduces an underwater robot inspection anomaly localization feedback system comprising a real-time water surface tracking,detection,and positioning system located on the water surface,while the underwater robot inspection anomaly feedback system is housed within the underwater robot.The system facilitates the issuance of corresponding mechanical responses based on the water surface’s real-time tracking,detection,and positioning,enabling recognition and feedback of anomaly information.Through sonar technology,the underwater robot inspection anomaly feedback system monitors the underwater robot in real-time,triggering responsive actions upon encountering anomalies.The real-time tracking,detection,and positioning system from the water surface identifies abnormal conditions of underwater robots based on changes in sonar images,subsequently notifying personnel for necessary intervention.展开更多
Phase errors in synthetic aperture sonar (SAS) imaging must be reduced to less than one eighth of a wavelength so as to avoid image destruction. Most of the phase errors occur as a result of platform motion errors, fo...Phase errors in synthetic aperture sonar (SAS) imaging must be reduced to less than one eighth of a wavelength so as to avoid image destruction. Most of the phase errors occur as a result of platform motion errors, for example, sway yaw and surge that are the most important error sources. The phase error of a wide band synthetic aperture sonar is modeled and solutions to sway yaw and surge motion estimation based on the raw sonar echo data with a Displaced Phase Center Antenna (DPCA) method are proposed and their implementations are detailed in this paper. It is shown that the sway estimates can be obtained from the correlation lag and phase difference between the returns at coincident phase centers. An estimate of yaw is also possible if such a technique is applied to more than one overlapping phase center positions. Surge estimates can be obtained by identifying pairs of phase centers with a maximum correlation coefficient. The method works only if the platform velocity is low enough such that a number of phase centers from adjacent pings overlap.展开更多
Underwater terrain-aided navigation is used to complement the traditional inertial navigation employed by autonomous underwater vehicles during lengthy missions. It can provide fixed estimations by matching real-time ...Underwater terrain-aided navigation is used to complement the traditional inertial navigation employed by autonomous underwater vehicles during lengthy missions. It can provide fixed estimations by matching real-time depth data with a digital terrain map, This study presents the concept of using image processing techniques in the underwater terrain matching process. A traditional gray-scale histogram of an image is enriched by incorporation with spatial information in pixels. Edge comer pixels are then defined and used to construct an edge comer histogram, which employs as a template to scan the digital terrain map and estimate the fixes of the vehicle by searching the correlation peak. Simulations are performed to investigate the robustness of the proposed method, particularly in relation to its sensitivity to background noise, the scale of real-time images, and the travel direction of the vehicle. At an image resolution of 1 m2/pixel, the accuracy of localization is more than 10 meters.展开更多
The performance of a sonar system is closely related to the marine environment and the target characteristics. When dealing with the echoes of a traditional active sonar system, the sonar designers often do not take i...The performance of a sonar system is closely related to the marine environment and the target characteristics. When dealing with the echoes of a traditional active sonar system, the sonar designers often do not take into account the influence of the environmental information and prior knowledge perceived by sonar receivers, making it difficult to obtain desired processing results. Based on the basic principle and key technology of sonar, this paper proposed a cognition-based intelligent sonar system in theory--cognitive sonar. Cognitive sonar is capable of jointly optimizing the transmission waveform and receiver according to the changes of environment so that its detection and identification performance can be significantly improved.展开更多
For increasing the cross-track resolution, the multiple input multiple output (MIMO) technique is introduced into the swath bathymetry system and a new swath bathymetry approach using MIMO sonar is proposed. The MIM...For increasing the cross-track resolution, the multiple input multiple output (MIMO) technique is introduced into the swath bathymetry system and a new swath bathymetry approach using MIMO sonar is proposed. The MIMO sonar is composed of two parallel transmitting uniform linear arrays (ULAs) and a receiving ULA which is perpendicular to the former. The spacing between the two transmitting ULAs is equal to the product of the receiving sensor number and the receiving inter-sensor spacing. Furthermore, two narrowband linear frequency modulation (LFM) pulses, sharing the same frequency band but with opposite modulation slopes, are used as transmitting waveforms of the two transmitting ULAs. With such an array layout and transmitting signals, the MIMO sonar can sound a swath with the cross-track resolution doubling that of the traditional multibeam sonar using a Mills cross array. Numerical examples are provided to verify the effectiveness of the proposed approach.展开更多
The multibeam sonars can provide hydrographic quality depth data as well as hold the potential to provide calibrated measurements of the seafloor acoustic backscattering strength. There has been much interest in utili...The multibeam sonars can provide hydrographic quality depth data as well as hold the potential to provide calibrated measurements of the seafloor acoustic backscattering strength. There has been much interest in utilizing backscatters and images from multibeam sonar for seabed type identification and most results are obtained. This paper has presented a focused review of several main methods and recent developments of seafloor classification utilizing multibeam sonar data or/and images. These are including the power spectral analysis methods, the texture analysis, traditional Bayesian classification theory and the most active neural network approaches.展开更多
The disguised covert detection method that imitates whale calls has received great attention in recent years because it can solve the traditional problem of the trade-off between long-range detection and covert detect...The disguised covert detection method that imitates whale calls has received great attention in recent years because it can solve the traditional problem of the trade-off between long-range detection and covert detection.However,under strong reverberation conditions,traditional echo signal processing methods based on matched filtering will be greatly disturbed.Based on this,a disguised sonar signal waveform design is proposed based on imitating whale calls and computationally efficient anti-reverberation echo signal processing method.Firstly,this article proposed a disguised sonar signal waveform design method based on imitating whale calls.This method uses linear frequency modulation(LFM)signals to replace LFM-like segments in real whale calls,and extracts the envelope of the real whale call’s LFM-like segment to modify the LFM signal.Secondly,this article proposed an echo signal processing method of fractional Fourier transform(FrFT)based on target echo locating of synchronization signals.This method uses the synchronization signal to locate the target echo,and determines the step-size interval of the FrFT based on the information carried by the synchronization signal.Compared with the traditional FrFT,this method effectively reduces the amount of calculation and also improves the anti-reverberation ability.Finally,the excellent performance of the proposed method is verified by simulation results.展开更多
Multi-beam Sonar and Side-scan Sonar compensate each other. In order to fully utilize all information, it is necessary to fuse two kinds of image and data. And the image co-registration is an important and complicated...Multi-beam Sonar and Side-scan Sonar compensate each other. In order to fully utilize all information, it is necessary to fuse two kinds of image and data. And the image co-registration is an important and complicated job before fusion. This paper suggests combining bathymetric data with intensity image, obtaining the characteristic points through the minimal angles of lines, and then deciding the corresponding image points by the maximal correlate coefficient in searching space. Finally, the second order polynomial is applied to the deformation model. After the images have been co-registered, Wavelet is used to fuse the images. It is shown that this algorithm can be used in the flat seafloor or the isotropic seabed. Verification is made in the paper with the observed data.展开更多
Karst landforms are widely distributed in China,and are most common in Yunnan,Guizhou and Guangxi.If the development of karst caves at the bottom of the piles cannot be accurately ascertained before the construction o...Karst landforms are widely distributed in China,and are most common in Yunnan,Guizhou and Guangxi.If the development of karst caves at the bottom of the piles cannot be accurately ascertained before the construction of bridge pile foundations,accidents such as hole collapse,slurry leakage,and drill sticking will easily occur.In this paper,the principle and method of sonar detection for detecting karst caves at the bottom of bridge piles was introduced,and the sonar detection data and the cave situation at the bottom of the pile during the construction process in combination with the case of Yunnan Zhenguo Highway Project was analyzed,which verifies the practicability and reliability of sonar detection method reliability.展开更多
A new monostatic array system taking advantage of diverse waveforms to improve the performance of underwater tar- get localization is proposed. Unlike the coherent signals between different elements in common active a...A new monostatic array system taking advantage of diverse waveforms to improve the performance of underwater tar- get localization is proposed. Unlike the coherent signals between different elements in common active array, the transmitted signals from different elements here are spatially orthogonal waveforms which allow for array processing in the transit mode and result in an extension of array aperture. The mathematical derivation of Capon estimator for this sonar system is described in detail. And the performance of this orthogonal-waveform based sonar is an- alyzed and compared with that of its phased-array counterpart by water tank experiments. Experimental results show that this sonar system could achieve 12 dB-15 dB additional array gain over its phased-array counterpart, which means a doubling of maximum detection range. Moreover, the angular resolution is significantly improved at lower SNR.展开更多
The maximum likelihood (ML) estimator demonstrates remarkable performance in direction of arrival (DOA) estimation for the multiple input multiple output (MIMO) sonar. However, this advantage comes with prohibit...The maximum likelihood (ML) estimator demonstrates remarkable performance in direction of arrival (DOA) estimation for the multiple input multiple output (MIMO) sonar. However, this advantage comes with prohibitive computational complexity. In order to solve this problem, an ant colony optimization (ACO) is incorporated into the MIMO ML DOA estimator. Based on the ACO, a novel MIMO ML DOA estimator named the MIMO ACO ML (ML DOA estimator based on ACO for MIMO sonar) with even lower computational complexity is proposed. By extending the pheromone remaining process to the pheromone Gaussian kernel probability distribution function in the continuous space, the pro- posed algorithm achieves the global optimum value of the MIMO ML DOA estimator. Simulations and experimental results show that the computational cost of MIMO ACO ML is only 1/6 of the MIMO ML algorithm, while maintaining similar performance with the MIMO ML method.展开更多
Sound pressure amplitude will be attenuated with propagation distance in a certain rule when sound wave is propagated in shallow sea.When processing the attenuated signal,time-variant gain circuit is usually used to c...Sound pressure amplitude will be attenuated with propagation distance in a certain rule when sound wave is propagated in shallow sea.When processing the attenuated signal,time-variant gain circuit is usually used to compensate its diffusion loss.In this paper,spherical diffusion loss is compensated by digital potentiometer and operational circuit and further investigation is also made on compensation of cylindrical diffusion loss and transition from spherical diffusion loss to cylindrical diffusion loss.Finally,a new compensation model is proposed for unknown propagation loss for the purpose of adjusting the dynamic range of signal to meet the requirement of A/D conversion.展开更多
A method of underwater simultaneous localization and mapping(SLAM)based on on-board looking forward sonar is proposed.The real-time data flow is obtained to form the underwater acoustic images and these images are pre...A method of underwater simultaneous localization and mapping(SLAM)based on on-board looking forward sonar is proposed.The real-time data flow is obtained to form the underwater acoustic images and these images are pre-processed and positions of objects are extracted for SLAM.Extended Kalman filter(EKF)is selected as the kernel approach to enable the underwater vehicle to construct a feature map,and the EKF can locate the underwater vehicle through the map.In order to improve the association effciency,a novel association method based on ant colony algorithm is introduced.Results obtained on simulation data and real acoustic vision data in tank are displayed and discussed.The proposed method maintains better association effciency and reduces navigation error,and is effective and feasible.展开更多
基金supported by the National Research Foundation of Korea(NRF)grant funded by the Korea government(MSIT)(No.RS-2024-00334159)the Korea Institute of Ocean Science and Technology(KIOST)project entitled“Development of Maritime Domain Awareness Technology for Sea Power Enhancement”(PEA0332).
文摘Side-scan sonar(SSS)is essential for acquiring high-resolution seafloor images over large areas,facilitat-ing the identification of subsea objects.However,military security restrictions and the scarcity of subsea targets limit the availability of SSS data,posing challenges for Automatic Target Recognition(ATR)research.This paper presents an approach that uses Cycle-Consistent Generative Adversarial Networks(CycleGAN)to augment SSS images of key subsea objects,such as shipwrecks,aircraft,and drowning victims.The process begins by constructing 3D models to generate rendered images with realistic shadows frommultiple angles.To enhance image quality,a shadowextractor and shadow region loss function are introduced to ensure consistent shadowrepresentation.Additionally,amulti-resolution learning structure enables effective training,even with limited data availability.The experimental results show that the generated data improved object detection accuracy when they were used for training and demonstrated the ability to generate clear shadow and background regions with stability.
基金supported in part by the Hainan Provincial Natural Science Foundation(Grant No.420CXTD439)Sanya Science and Technology Special Fund(Grant No.2022KJCX83)+1 种基金Institute and Local Cooperation Foundation of Sanya in China(Grant No.2019YD08)National Natural Science Foundation of China(Grant No.61661038).
文摘Underwater shipwreck identification technology, as a crucial technique in the field of marine surveying, plays a significant role in areas such as the search and rescue of maritime disaster shipwrecks. When facing the task of object detection in shipwreck side-scan sonar images, due to the complex seabed environment, it is difficult to extract object features, often leading to missed detections of shipwreck images and slow detection speed. To address these issues, this paper proposes an object detection algorithm, CSC-YOLO (Context Guided Block, Shared Conv_Group Normalization Detection, Cross Stage Partial with 2 Partial Convolution-You Only Look Once), based on YOLOv8n for shipwreck side-scan sonar images. Firstly, to tackle the problem of small samples in shipwreck side-scan sonar images, a new dataset was constructed through offline data augmentation to expand data and intuitively enhance sample diversity, with the Mosaic algorithm integrated to strengthen the network’s generalization to the dataset. Subsequently, the Context Guided Block (CGB) module was introduced into the backbone network model to enhance the network’s ability to learn and express image features. Additionally, by employing Group Normalization (GN) techniques and shared convolution operations, we constructed the Shared Conv_GN Detection (SCGD) head, which improves the localization and classification performance of the detection head while significantly reducing the number of parameters and computational load. Finally, the Partial Convolution (PConv) was introduced and the Cross Stage Partial with 2 PConv (C2PC) module was constructed to help the network maintain effective extraction of spatial features while reducing computational complexity. The improved CSC-YOLO model, compared with the YOLOv8n model on the validation set, mean Average Precision (mAP) increases by 3.1%, Recall (R) increases by 6.4%, and the F1-measure (F1) increases by 4.7%. Furthermore, in the improved algorithm, the number of parameters decreases by 20%, the computational complexity decreases by 23.2%, and Frames Per Second (FPS) increases by 17.6%. In addition, compared with the advanced popular model, the superiority of the proposed model is proved. The subsequent experiments on real side-scan sonar images of shipwrecks fully demonstrate that the CSC-YOLO algorithm meets the requirements for actual side-scan sonar detection of underwater shipwrecks.
基金supported in part by Youth Innovation Promotion Association,Chinese Academy of Sciences under Grant 2022022in part by South China Sea Nova project of Hainan Province under Grant NHXXRCXM202340in part by the Scientific Research Foundation Project of Hainan Acoustics Laboratory under grant ZKNZ2024001.
文摘Underwater target detection in forward-looking sonar(FLS)images is a challenging but promising endeavor.The existing neural-based methods yield notable progress but there remains room for improvement due to overlooking the unique characteristics of underwater environments.Considering the problems of low imaging resolution,complex background environment,and large changes in target imaging of underwater sonar images,this paper specifically designs a sonar images target detection Network based on Progressive sensitivity capture,named ProNet.It progressively captures the sensitive regions in the current image where potential effective targets may exist.Guided by this basic idea,the primary technical innovation of this paper is the introduction of a foundational module structure for constructing a sonar target detection backbone network.This structure employs a multi-subspace mixed convolution module that initially maps sonar images into different subspaces and extracts local contextual features using varying convolutional receptive fields within these heterogeneous subspaces.Subsequently,a Scale-aware aggregation module effectively aggregates the heterogeneous features extracted from different subspaces.Finally,the multi-scale attention structure further enhances the relational perception of the aggregated features.We evaluated ProNet on three FLS datasets of varying scenes,and experimental results indicate that ProNet outperforms the current state-of-the-art sonar image and general target detectors.
基金supported by the National Key R&D Program of China(Grant No.2023YFC3010803)the National Nature Science Foundation of China(Grant No.52272424)+1 种基金the Key R&D Program of Hubei Province of China(Grant No.2023BCB123)the Fundamental Research Funds for the Central Universities(Grant No.WUT:2023IVB079)。
文摘Side-scan sonar(SSS)is now a prevalent instrument for large-scale seafloor topography measurements,deployable on an autonomous underwater vehicle(AUV)to execute fully automated underwater acoustic scanning imaging along a predetermined trajectory.However,SSS images often suffer from speckle noise caused by mutual interference between echoes,and limited AUV computational resources further hinder noise suppression.Existing approaches for SSS image processing and speckle noise reduction rely heavily on complex network structures and fail to combine the benefits of deep learning and domain knowledge.To address the problem,Rep DNet,a novel and effective despeckling convolutional neural network is proposed.Rep DNet introduces two re-parameterized blocks:the Pixel Smoothing Block(PSB)and Edge Enhancement Block(EEB),preserving edge information while attenuating speckle noise.During training,PSB and EEB manifest as double-layered multi-branch structures,integrating first-order and secondorder derivatives and smoothing functions.During inference,the branches are re-parameterized into a 3×3 convolution,enabling efficient inference without sacrificing accuracy.Rep DNet comprises three computational operations:3×3 convolution,element-wise summation and Rectified Linear Unit activation.Evaluations on benchmark datasets,a real SSS dataset and Data collected at Lake Mulan aestablish Rep DNet as a well-balanced network,meeting the AUV computational constraints in terms of performance and latency.
文摘The risk of gas leakage due to geological flaws in offshore carbon capture, utilization, and storage, as well as leakage from underwater oil or gas pipelines, highlights the need for underwater gas leakage monitoring technology. Remotely operated vehicles(ROVs) and autonomous underwater vehicles(AUVs) are equipped with high-resolution imaging sonar systems that have broad application potential in underwater gas and target detection tasks. However, some bubble clusters are relatively weak scatterers, so detecting and distinguishing them against the seabed reverberation in forward-looking sonar images are challenging. This study uses the dual-tree complex wavelet transform to extract the image features of multibeam forward-looking sonar. Underwater gas leakages with different flows are classified by combining deep learning theory. A pool experiment is designed to simulate gas leakage, where sonar images are obtained for further processing. Results demonstrate that this method can detect and classify underwater gas leakage streams with high classification accuracy. This performance indicates that the method can detect gas leakage from multibeam forward-looking sonar images and has the potential to predict gas leakage flow.
文摘This article introduces an underwater robot inspection anomaly localization feedback system comprising a real-time water surface tracking,detection,and positioning system located on the water surface,while the underwater robot inspection anomaly feedback system is housed within the underwater robot.The system facilitates the issuance of corresponding mechanical responses based on the water surface’s real-time tracking,detection,and positioning,enabling recognition and feedback of anomaly information.Through sonar technology,the underwater robot inspection anomaly feedback system monitors the underwater robot in real-time,triggering responsive actions upon encountering anomalies.The real-time tracking,detection,and positioning system from the water surface identifies abnormal conditions of underwater robots based on changes in sonar images,subsequently notifying personnel for necessary intervention.
文摘Phase errors in synthetic aperture sonar (SAS) imaging must be reduced to less than one eighth of a wavelength so as to avoid image destruction. Most of the phase errors occur as a result of platform motion errors, for example, sway yaw and surge that are the most important error sources. The phase error of a wide band synthetic aperture sonar is modeled and solutions to sway yaw and surge motion estimation based on the raw sonar echo data with a Displaced Phase Center Antenna (DPCA) method are proposed and their implementations are detailed in this paper. It is shown that the sway estimates can be obtained from the correlation lag and phase difference between the returns at coincident phase centers. An estimate of yaw is also possible if such a technique is applied to more than one overlapping phase center positions. Surge estimates can be obtained by identifying pairs of phase centers with a maximum correlation coefficient. The method works only if the platform velocity is low enough such that a number of phase centers from adjacent pings overlap.
基金Supported by the National Natural Nature Science Foundation of China (Grant No. 41376102), Fundamental Research Funds for the Central Universities (Gant No. HEUCF150514) and Chinese Scholarship Council (Grant No. 201406680029).
文摘Underwater terrain-aided navigation is used to complement the traditional inertial navigation employed by autonomous underwater vehicles during lengthy missions. It can provide fixed estimations by matching real-time depth data with a digital terrain map, This study presents the concept of using image processing techniques in the underwater terrain matching process. A traditional gray-scale histogram of an image is enriched by incorporation with spatial information in pixels. Edge comer pixels are then defined and used to construct an edge comer histogram, which employs as a template to scan the digital terrain map and estimate the fixes of the vehicle by searching the correlation peak. Simulations are performed to investigate the robustness of the proposed method, particularly in relation to its sensitivity to background noise, the scale of real-time images, and the travel direction of the vehicle. At an image resolution of 1 m2/pixel, the accuracy of localization is more than 10 meters.
基金Supported by Research Foundation of Shaanxi Province Returned Overseas Students No.SLZ2008006
文摘The performance of a sonar system is closely related to the marine environment and the target characteristics. When dealing with the echoes of a traditional active sonar system, the sonar designers often do not take into account the influence of the environmental information and prior knowledge perceived by sonar receivers, making it difficult to obtain desired processing results. Based on the basic principle and key technology of sonar, this paper proposed a cognition-based intelligent sonar system in theory--cognitive sonar. Cognitive sonar is capable of jointly optimizing the transmission waveform and receiver according to the changes of environment so that its detection and identification performance can be significantly improved.
基金supported by the National Natural Science Foundation of China(11104222)the Doctorate Foundation of Northwestern Polytechnical University(CX201101)
文摘For increasing the cross-track resolution, the multiple input multiple output (MIMO) technique is introduced into the swath bathymetry system and a new swath bathymetry approach using MIMO sonar is proposed. The MIMO sonar is composed of two parallel transmitting uniform linear arrays (ULAs) and a receiving ULA which is perpendicular to the former. The spacing between the two transmitting ULAs is equal to the product of the receiving sensor number and the receiving inter-sensor spacing. Furthermore, two narrowband linear frequency modulation (LFM) pulses, sharing the same frequency band but with opposite modulation slopes, are used as transmitting waveforms of the two transmitting ULAs. With such an array layout and transmitting signals, the MIMO sonar can sound a swath with the cross-track resolution doubling that of the traditional multibeam sonar using a Mills cross array. Numerical examples are provided to verify the effectiveness of the proposed approach.
文摘The multibeam sonars can provide hydrographic quality depth data as well as hold the potential to provide calibrated measurements of the seafloor acoustic backscattering strength. There has been much interest in utilizing backscatters and images from multibeam sonar for seabed type identification and most results are obtained. This paper has presented a focused review of several main methods and recent developments of seafloor classification utilizing multibeam sonar data or/and images. These are including the power spectral analysis methods, the texture analysis, traditional Bayesian classification theory and the most active neural network approaches.
基金National Natural Science Foundations of China under Grant(Nos.61971307,61905175,51775377)National Key Research and Development Plan Project(No.2020YFB2010800)+5 种基金Fok Ying Tung Education Foundation(No.171055)China Postdoctoral Science Foundation(No.2020M680878)Guangdong Province Key Research and Development Plan Project(No.2020B0404030001)Tianjin Science and Technology Plan Project(No.20YDTPJC01660)Foreign Affairs Committee of China Aviation Development Sichuan Gas Turbine Research Institute(Nos.GJCZ-2020-0040,GJCZ-2020-0041)Science and Technology on Underwater Information and Control Laboratory under Grant(No.6142218081811)。
文摘The disguised covert detection method that imitates whale calls has received great attention in recent years because it can solve the traditional problem of the trade-off between long-range detection and covert detection.However,under strong reverberation conditions,traditional echo signal processing methods based on matched filtering will be greatly disturbed.Based on this,a disguised sonar signal waveform design is proposed based on imitating whale calls and computationally efficient anti-reverberation echo signal processing method.Firstly,this article proposed a disguised sonar signal waveform design method based on imitating whale calls.This method uses linear frequency modulation(LFM)signals to replace LFM-like segments in real whale calls,and extracts the envelope of the real whale call’s LFM-like segment to modify the LFM signal.Secondly,this article proposed an echo signal processing method of fractional Fourier transform(FrFT)based on target echo locating of synchronization signals.This method uses the synchronization signal to locate the target echo,and determines the step-size interval of the FrFT based on the information carried by the synchronization signal.Compared with the traditional FrFT,this method effectively reduces the amount of calculation and also improves the anti-reverberation ability.Finally,the excellent performance of the proposed method is verified by simulation results.
文摘Multi-beam Sonar and Side-scan Sonar compensate each other. In order to fully utilize all information, it is necessary to fuse two kinds of image and data. And the image co-registration is an important and complicated job before fusion. This paper suggests combining bathymetric data with intensity image, obtaining the characteristic points through the minimal angles of lines, and then deciding the corresponding image points by the maximal correlate coefficient in searching space. Finally, the second order polynomial is applied to the deformation model. After the images have been co-registered, Wavelet is used to fuse the images. It is shown that this algorithm can be used in the flat seafloor or the isotropic seabed. Verification is made in the paper with the observed data.
文摘Karst landforms are widely distributed in China,and are most common in Yunnan,Guizhou and Guangxi.If the development of karst caves at the bottom of the piles cannot be accurately ascertained before the construction of bridge pile foundations,accidents such as hole collapse,slurry leakage,and drill sticking will easily occur.In this paper,the principle and method of sonar detection for detecting karst caves at the bottom of bridge piles was introduced,and the sonar detection data and the cave situation at the bottom of the pile during the construction process in combination with the case of Yunnan Zhenguo Highway Project was analyzed,which verifies the practicability and reliability of sonar detection method reliability.
基金supported by the National Natural Science Foundation of China(60572098)
文摘A new monostatic array system taking advantage of diverse waveforms to improve the performance of underwater tar- get localization is proposed. Unlike the coherent signals between different elements in common active array, the transmitted signals from different elements here are spatially orthogonal waveforms which allow for array processing in the transit mode and result in an extension of array aperture. The mathematical derivation of Capon estimator for this sonar system is described in detail. And the performance of this orthogonal-waveform based sonar is an- alyzed and compared with that of its phased-array counterpart by water tank experiments. Experimental results show that this sonar system could achieve 12 dB-15 dB additional array gain over its phased-array counterpart, which means a doubling of maximum detection range. Moreover, the angular resolution is significantly improved at lower SNR.
基金supported by the National Natural Science Foundation of China (60972152)the National Laboratory Foundation of China (9140C2304080607)+1 种基金the Aviation Science Fund (2009ZC53031)the Doctoral Foundation of Northwestern Polytechnical University (CX201002)
文摘The maximum likelihood (ML) estimator demonstrates remarkable performance in direction of arrival (DOA) estimation for the multiple input multiple output (MIMO) sonar. However, this advantage comes with prohibitive computational complexity. In order to solve this problem, an ant colony optimization (ACO) is incorporated into the MIMO ML DOA estimator. Based on the ACO, a novel MIMO ML DOA estimator named the MIMO ACO ML (ML DOA estimator based on ACO for MIMO sonar) with even lower computational complexity is proposed. By extending the pheromone remaining process to the pheromone Gaussian kernel probability distribution function in the continuous space, the pro- posed algorithm achieves the global optimum value of the MIMO ML DOA estimator. Simulations and experimental results show that the computational cost of MIMO ACO ML is only 1/6 of the MIMO ML algorithm, while maintaining similar performance with the MIMO ML method.
文摘Sound pressure amplitude will be attenuated with propagation distance in a certain rule when sound wave is propagated in shallow sea.When processing the attenuated signal,time-variant gain circuit is usually used to compensate its diffusion loss.In this paper,spherical diffusion loss is compensated by digital potentiometer and operational circuit and further investigation is also made on compensation of cylindrical diffusion loss and transition from spherical diffusion loss to cylindrical diffusion loss.Finally,a new compensation model is proposed for unknown propagation loss for the purpose of adjusting the dynamic range of signal to meet the requirement of A/D conversion.
基金the National Natural Science Foundation of China(No.51009040)the Fund of National Defence Key Laboratory of Autonomous Underwater Vehicle Technology(No.2008002)the Scientific Service Special Fund of University in China(No.E091002)
文摘A method of underwater simultaneous localization and mapping(SLAM)based on on-board looking forward sonar is proposed.The real-time data flow is obtained to form the underwater acoustic images and these images are pre-processed and positions of objects are extracted for SLAM.Extended Kalman filter(EKF)is selected as the kernel approach to enable the underwater vehicle to construct a feature map,and the EKF can locate the underwater vehicle through the map.In order to improve the association effciency,a novel association method based on ant colony algorithm is introduced.Results obtained on simulation data and real acoustic vision data in tank are displayed and discussed.The proposed method maintains better association effciency and reduces navigation error,and is effective and feasible.