Mangroves are indispensable to coastlines,maintaining biodiversity,and mitigating climate change.Therefore,improving the accuracy of mangrove information identification is crucial for their ecological protection.Aimin...Mangroves are indispensable to coastlines,maintaining biodiversity,and mitigating climate change.Therefore,improving the accuracy of mangrove information identification is crucial for their ecological protection.Aiming at the limited morphological information of synthetic aperture radar(SAR)images,which is greatly interfered by noise,and the susceptibility of optical images to weather and lighting conditions,this paper proposes a pixel-level weighted fusion method for SAR and optical images.Image fusion enhanced the target features and made mangrove monitoring more comprehensive and accurate.To address the problem of high similarity between mangrove forests and other forests,this paper is based on the U-Net convolutional neural network,and an attention mechanism is added in the feature extraction stage to make the model pay more attention to the mangrove vegetation area in the image.In order to accelerate the convergence and normalize the input,batch normalization(BN)layer and Dropout layer are added after each convolutional layer.Since mangroves are a minority class in the image,an improved cross-entropy loss function is introduced in this paper to improve the model’s ability to recognize mangroves.The AttU-Net model for mangrove recognition in high similarity environments is thus constructed based on the fused images.Through comparison experiments,the overall accuracy of the improved U-Net model trained from the fused images to recognize the predicted regions is significantly improved.Based on the fused images,the recognition results of the AttU-Net model proposed in this paper are compared with its benchmark model,U-Net,and the Dense-Net,Res-Net,and Seg-Net methods.The AttU-Net model captured mangroves’complex structures and textural features in images more effectively.The average OA,F1-score,and Kappa coefficient in the four tested regions were 94.406%,90.006%,and 84.045%,which were significantly higher than several other methods.This method can provide some technical support for the monitoring and protection of mangrove ecosystems.展开更多
We propose an optical image watermarking scheme based on orbital angular momentum(OAM)holography.Multiple topological charges(TCs,l)of OAM,as multiple cryptographic sub-keys,are embedded into the host image along with...We propose an optical image watermarking scheme based on orbital angular momentum(OAM)holography.Multiple topological charges(TCs,l)of OAM,as multiple cryptographic sub-keys,are embedded into the host image along with the watermark information.Moreover,the Arnold transformation is employed to further enhance the security and the scrambling time(m)is also served as another cryptographic key.The watermark image is embedded into the host image by using the discrete wavelet transformation(DWT)and singular value decomposition(SVD)methods.Importantly,the interference image is utilized to further enhance security.The imperceptibility of our proposed method is analyzed by using the peak signal-to-noise ratio(PSNR)and the histogram of the watermarked host image.To demonstrate robustness,a series of attack tests,including Gaussian noise,Poisson noise,salt-and-pepper noise,JPEG compression,Gaussian lowpass filtering,cropping,and rotation,are conducted.The experimental results show that our proposed method has advanced security,imperceptibility,and robustness,making it a promising option for optical image watermarking applications.展开更多
The diversity of tree species and the complexity of land use in cities create challenging issues for tree species classification.The combination of deep learning methods and RGB optical images obtained by unmanned aer...The diversity of tree species and the complexity of land use in cities create challenging issues for tree species classification.The combination of deep learning methods and RGB optical images obtained by unmanned aerial vehicles(UAVs) provides a new research direction for urban tree species classification.We proposed an RGB optical image dataset with 10 urban tree species,termed TCC10,which is a benchmark for tree canopy classification(TCC).TCC10 dataset contains two types of data:tree canopy images with simple backgrounds and those with complex backgrounds.The objective was to examine the possibility of using deep learning methods(AlexNet,VGG-16,and ResNet-50) for individual tree species classification.The results of convolutional neural networks(CNNs) were compared with those of K-nearest neighbor(KNN) and BP neural network.Our results demonstrated:(1) ResNet-50 achieved an overall accuracy(OA) of 92.6% and a kappa coefficient of 0.91 for tree species classification on TCC10 and outperformed AlexNet and VGG-16.(2) The classification accuracy of KNN and BP neural network was less than70%,while the accuracy of CNNs was relatively higher.(3)The classification accuracy of tree canopy images with complex backgrounds was lower than that for images with simple backgrounds.For the deciduous tree species in TCC10,the classification accuracy of ResNet-50 was higher in summer than that in autumn.Therefore,the deep learning is effective for urban tree species classification using RGB optical images.展开更多
It is difficult to balance local details and global distribution using a single source image in marine target detection of a large scene.To solve this problem,a technique based on the fusion of optical image and synth...It is difficult to balance local details and global distribution using a single source image in marine target detection of a large scene.To solve this problem,a technique based on the fusion of optical image and synthetic aperture radar(SAR)image for the extraction of sea ice is proposed in this paper.The Band 2(B2 image of Sentinel-2(S2 in the research area is selected as optical image data.Preprocessing on the optical image,such as resampling,projection transformation and format conversion,are conducted to the S2 dataset before fusion.Imaging characteristics of the sea ice have been analyzed,and a new deep learning(DL)model,OceanTDL5,is built to detect sea ices.The fusion of the Sentinel-1(S1 and S2 images is realized by solving the optimal pixel values based on deriving Poisson Equation.The experimental results indicate that the use of a fused image improves the accuracy of sea ice detection compared with the use of a single data source.The fused image has richer spatial details and a clearer texture compared with the original optical image,and its material sense and color are more abundant.展开更多
Some existing image encryption schemes use simple low-dimensional chaotic systems, which makes the algorithms insecure and vulnerable to brute force attacks and cracking. Some algorithms have issues such as weak corre...Some existing image encryption schemes use simple low-dimensional chaotic systems, which makes the algorithms insecure and vulnerable to brute force attacks and cracking. Some algorithms have issues such as weak correlation with plaintext images, poor image reconstruction quality, and low efficiency in transmission and storage. To solve these issues,this paper proposes an optical image encryption algorithm based on a new four-dimensional memristive hyperchaotic system(4D MHS) and compressed sensing(CS). Firstly, this paper proposes a new 4D MHS, which has larger key space, richer dynamic behavior, and more complex hyperchaotic characteristics. The introduction of CS can reduce the image size and the transmission burden of hardware devices. The introduction of double random phase encoding(DRPE) enables this algorithm has the ability of parallel data processing and multi-dimensional coding space, and the hyperchaotic characteristics of 4D MHS make up for the nonlinear deficiency of DRPE. Secondly, a construction method of the deterministic chaotic measurement matrix(DCMM) is proposed. Using DCMM can not only save a lot of transmission bandwidth and storage space, but also ensure good quality of reconstructed images. Thirdly, the confusion method and diffusion method proposed are related to plaintext images, which require both four hyperchaotic sequences of 4D MHS and row and column keys based on plaintext images. The generation process of hyperchaotic sequences is closely related to the hash value of plaintext images. Therefore, this algorithm has high sensitivity to plaintext images. The experimental testing and comparative analysis results show that proposed algorithm has good security and effectiveness.展开更多
Mountain glaciers are sensitive to environment. It is important to acquire ice flow velocities over time for glacier research and hazard forecast. For this paper, cross-correlating of optical images is used to monitor...Mountain glaciers are sensitive to environment. It is important to acquire ice flow velocities over time for glacier research and hazard forecast. For this paper, cross-correlating of optical images is used to monitor ice flow velocities, and an improvement, which is called ＂moving grid,＂ is made to this method. For this research, two remote-sensing images in a certain glacier area, dur-ing different times are selected. The first image is divided into grids, and we calculated the correlation coefficient of each window in the grid with the window on the second image. The window with the highest correlation coefficient is considered the counter-part one on the first image. The displacement of the two corresponding windows is the movement of the glacier, and it is used to calculate glacier surface velocity. Compared to the traditional way of dividing an image with ascertain grid, this method uses small steps to move the grid from one location to another adjacent location until the whole glacier area is covered in the image, thus in-creasing corresponding point density. We selected a glacier in the Tianshan Mountains for this experiment and used two re-mote-sensing images with a 10-year interval to determine this method.展开更多
Vascular segmentation is a crucial task in biomedical image processing,which is significant for analyzing and modeling vascular networks under physiological and pathological states.With advances in fluorescent labelin...Vascular segmentation is a crucial task in biomedical image processing,which is significant for analyzing and modeling vascular networks under physiological and pathological states.With advances in fluorescent labeling and mesoscopic optical techniques,it has become possible to map the whole-mouse-brain vascular networks at capillary resolution.However,segmenting vessels from mesoscopic optical images is a challenging task.The problems,such as vascular signal discontinuities,vessel lumens,and background fluorescence signals in mesoscopic optical images,belong to global semantic information during vascular segmentation.Traditional vascular segmentation methods based on convolutional neural networks(CNNs)have been limited by their insufficient receptive fields,making it challenging to capture global semantic information of vessels and resulting in inaccurate segmentation results.Here,we propose SegVesseler,a vascular segmentation method based on Swin Transformer.SegVesseler adopts 3D Swin Transformer blocks to extract global contextual information in 3D images.This approach is able to maintain the connectivity and topology of blood vessels during segmentation.We evaluated the performance of our method on mouse cerebrovascular datasets generated from three different labeling and imaging modalities.The experimental results demonstrate that the segmentation effect of our method is significantly better than traditional CNNs and achieves state-of-the-art performance.展开更多
Mudflat vegetation plays a crucial role in the ecological function of wetland environment,and obtaining its fine spatial distri-bution is of great significance for wetland protection and management.Remote sensing tech...Mudflat vegetation plays a crucial role in the ecological function of wetland environment,and obtaining its fine spatial distri-bution is of great significance for wetland protection and management.Remote sensing techniques can realize the rapid extraction of wetland vegetation over a large area.However,the imaging of optical sensors is easily restricted by weather conditions,and the backs-cattered information reflected by Synthetic Aperture Radar(SAR)images is easily disturbed by many factors.Although both data sources have been applied in wetland vegetation classification,there is a lack of comparative study on how the selection of data sources affects the classification effect.This study takes the vegetation of the tidal flat wetland in Chongming Island,Shanghai,China,in 2019,as the research subject.A total of 22 optical feature parameters and 11 SAR feature parameters were extracted from the optical data source(Sentinel-2)and SAR data source(Sentinel-1),respectively.The performance of optical and SAR data and their feature paramet-ers in wetland vegetation classification was quantitatively compared and analyzed by different feature combinations.Furthermore,by simulating the scenario of missing optical images,the impact of optical image missing on vegetation classification accuracy and the compensatory effect of integrating SAR data were revealed.Results show that:1)under the same classification algorithm,the Overall Accuracy(OA)of the combined use of optical and SAR images was the highest,reaching 95.50%.The OA of using only optical images was slightly lower,while using only SAR images yields the lowest accuracy,but still achieved 86.48%.2)Compared to using the spec-tral reflectance of optical data and the backscattering coefficient of SAR data directly,the constructed optical and SAR feature paramet-ers contributed to improving classification accuracy.The inclusion of optical(vegetation index,spatial texture,and phenology features)and SAR feature parameters(SAR index and SAR texture features)in the classification algorithm resulted in an OA improvement of 4.56%and 9.47%,respectively.SAR backscatter,SAR index,optical phenological features,and vegetation index were identified as the top-ranking important features.3)When the optical data were missing continuously for six months,the OA dropped to a minimum of 41.56%.However,when combined with SAR data,the OA could be improved to 71.62%.This indicates that the incorporation of SAR features can effectively compensate for the loss of accuracy caused by optical image missing,especially in regions with long-term cloud cover.展开更多
In this work,using the thin disk model,we examine the optical observations of asymmetric thin-shell wormholes(ATWs)within the theoretical framework of higher-order non-commutative geometry.By utilizing ray tracing tec...In this work,using the thin disk model,we examine the optical observations of asymmetric thin-shell wormholes(ATWs)within the theoretical framework of higher-order non-commutative geometry.By utilizing ray tracing technology,the trajectories of photons under various relevant parameters,as well as the optical observational appearance of ATW,can be accurately simulated.Compared to the black hole(BH)spacetime,observational images of ATW will exhibit extra bright ring structures.The results show that an increase in the non-commutative parameter leads to the innermost extra photon ring moving away from the shadow region,while the second extra photon ring moves closer to the shadow region.However,only one extra bright ring structure is observed in the image when the non-commutative parameter increases toθ=0.03,implying that the observed features of ATWs seem to become increasingly visually similar to a BH with increasingθ.Furthermore,an increase in the mass ratio will result in a reduction of the radius of the innermost extra photon ring,whereas an increase in the throat radius will lead to an expansion of its radius.Notably,neither parameter has a significant impact on the size of the second extra photon ring.These findings significantly advance our theoretical understanding of the optical features of ATWs with higher-order non-commutative corrections.展开更多
BACKGROUND Optical coherence tomography(OCT)enables high-resolution,non-invasive visualization of retinal structures.Recent evidence suggests that retinal layer alterations may reflect central nervous system changes a...BACKGROUND Optical coherence tomography(OCT)enables high-resolution,non-invasive visualization of retinal structures.Recent evidence suggests that retinal layer alterations may reflect central nervous system changes associated with psychiatric disorders such as schizophrenia(SZ).AIM To develop an advanced deep learning model to classify OCT images and distinguish patients with SZ from healthy controls using retinal biomarkers.METHODS A novel convolutional neural network,Self-AttentionNeXt,was designed by integrating grouped self-attention mechanisms,residual and inverted bottleneck blocks,and a final 1×1 convolution for feature refinement.The model was trained and tested on both a custom OCT dataset collected from patients with SZ and a publicly available OCT dataset(OCT2017).RESULTS Self-AttentionNeXt achieved 97.0%accuracy on the collected SZ OCT dataset and over 95%accuracy on the public OCT2017 dataset.Gradient-weighted class activation mapping visualizations confirmed the model’s attention to clinically relevant retinal regions,suggesting effective feature localization.CONCLUSION Self-AttentionNeXt effectively combines transformer-inspired attention mechanisms with convolutional neural networks architecture to support the early and accurate detection of SZ using OCT images.This approach offers a promising direction for artificial intelligence-assisted psychiatric diagnostics and clinical decision support.展开更多
To verify the effectiveness of digital optical 3D image analyzer EvaSKIN in the objective and quantitative evaluation of wrinkles.A total of 115 subjects were recruited,the facial images of the subjects were collected...To verify the effectiveness of digital optical 3D image analyzer EvaSKIN in the objective and quantitative evaluation of wrinkles.A total of 115 subjects were recruited,the facial images of the subjects were collected by digital optical 3D image analyzer and manual camera,the changes of crow’s feet with age were analyzed.Pictures obtained by manual photography can be directly used for observation and preliminary grading of wrinkles.However,the requirements for evaluators are high,and the results are prone to errors,which will affect the accuracy of the evaluation.Therefore,skilled raters are needed.Compared with the manual photography method,the digital optical 3D image analyzer EvaSKIN can realize three-dimensional extraction of wrinkles,and obtain the change trend of crow’s feet with age.20~30 years old,wrinkles begin to appear slowly;wrinkles will increase rapidly at the age of 30~50;The length of 50~60 year old wrinkles is basically fixed,the wrinkles develop longitudewise,gradually widen and deepen,and the area,depth and volume increase is obvious,and the skin aging condition is intensified.the digital optical 3D image analyzer EvaSKIN realizes the 3D extraction of wrinkles,quantifies the circumference,area,average depth,maximum depth and volume of wrinkles,realizes the objective and quantitative evaluation of wrinkle state,is more accurate in the measurement of wrinkles,and provides a new instrument and method for the evaluation of wrinkles.it is a perfect and supplement to the traditional evaluation methods,and to a certain extent,it helps the research and development and evaluation institutions of cosmetics to obtain more abundant and three-dimensional data support.展开更多
Ultrafast phenomena induced by femtosecond laser irradiation encompass a range of highly dynamic physical processes,including but not limited to electron excitation,material ablation,plasma generation,and shock wave p...Ultrafast phenomena induced by femtosecond laser irradiation encompass a range of highly dynamic physical processes,including but not limited to electron excitation,material ablation,plasma generation,and shock wave propagation.Unveiling the dynamics of these ultrafast processes is crucial for effectively controlling laser processing.However,many of these phenomena occur on timescales ranging from femtoseconds(fs) to nanoseconds(ns),which presents significant challenges in monitoring and interpretation;thus,ultrafast optical imaging techniques are often required.This paper comprehensively reviews the ultrafast optical imaging methods employed in recent years to monitor various ultrafast processes such as electron excitation,ultrafast ablation,plasma ejection,and shock wave propagation during femtosecond laser processing of metallic,composite,and ceramic materials.These methods can be categorized into two primary types:pump-probe ultrafast optical imaging and single-shot ultrafast optical imaging techniques.The working principles and key findings associated with each type of ultrafast optical imaging technique are described in detail.Finally,the imaging principles,advantages and disadvantages,and application scenarios of various ultrafast imaging technologies are summarized,along with a discussion of future challenges and development directions in this field.展开更多
Fluorescent probes have revolutionized optical imaging and biosensing by enabling real-time visualization, quantification, and tracking of biological processes at molecular and cellular levels. These probes, ranging f...Fluorescent probes have revolutionized optical imaging and biosensing by enabling real-time visualization, quantification, and tracking of biological processes at molecular and cellular levels. These probes, ranging from organic dyes to genetically encoded proteins and nanomaterials, provide unparalleled specificity, sensitivity, and multiplexing capabilities. However, challenges such as brightness, photobleaching, biocompatibility, and emission range continue to drive innovation in probe design and application. This special issue, comprising four review papers and seven original research studies, highlights cutting-edge advancements in fluorescent probe technologies and their transformative roles in super-resolution imaging, in vivo diagnostics, and cancer therapeutics.展开更多
We report a new standalone Robotic All-Sky narrowband Imager(RASI)for auroral and airglow studies.RASI has new optics and an electromechanical system,low operation and installation costs,easy deployment and fully auto...We report a new standalone Robotic All-Sky narrowband Imager(RASI)for auroral and airglow studies.RASI has new optics and an electromechanical system,low operation and installation costs,easy deployment and fully automatic features.The new optics provide an all-sky field of view with excellent image quality and sensitivity.The new electromechanical system design offers a more compact size and the capability for outdoor independent deployment.We have also developed a fully automatic data acquisition software for RASI,which is based on the perception of solar altitude and the all-sky cloud cover.In conclusion,the RASI demonstrates significant advantages over the traditional all-sky narrowband imager,and it is highly suitable for the intensity measurements of large-scale auroras and airglow distributions.展开更多
AIM:To evaluate the choroidopathy in patients with systemic lupus erythematosus(SLE)using enhanced depth imaging spectral domain optical coherence tomography(EDI SD-OCT)and optical coherence tomography angiography(OCT...AIM:To evaluate the choroidopathy in patients with systemic lupus erythematosus(SLE)using enhanced depth imaging spectral domain optical coherence tomography(EDI SD-OCT)and optical coherence tomography angiography(OCTA).METHODS:A total of 74 patients with SLE and 40 healthy volunteers were included in this cross-sectional study.SLE patients were further divided into three subgroups based on clinical and blood biochemistry findings.Ocular parameters obtained on ophthalmologic examination and optical imaging(EDI SD-OCT and OCTA)included the best corrected distance visual acuity(logMAR CDVA),subfoveal choroidal thickness(SCT),choroidal vascularity index(CVI)and vessel density(VD)of superficial capillary plexus(SCP)and deep capillary plexus(DCP).RESULTS:SLE patients had significantly lower values for CVI and VD of DCP(DVD)than control subjects.Amongst SLE patients,gender and chloroquine dose were found to be independent determinants of CVI while age predicted SCT.Steroid dose was a significant predictor for foveal VD of SCP(SVD),chloroquine dose for parafoveal SVD,gender for total DVD,and gender and steroid dose for perifoveal DVD.No correlation of logMAR CDVA and SCT was noted between SLE patients and control subjects.No correlation of SCT was noted with disease duration,Systemic Lupus Erythematosus Disease Activity Index(SLEDAI)score,hydroxychloroquine(HCQ)dose or steroid dose.No correlation of CVI was noted with patient age,disease duration,SLEDAI score,HCQ dose or steroid dose.No significant difference was noted between SLE subgroups in terms of any of the ocular parameters studied.CONCLUSION:The findings reveal the presence of ocular findings suggestive of early onset choroidopathy on EDI SD-OCT and OCTA in SLE patients,in the absence of ocular manifestations or active disease.展开更多
Bragg processing using a volume hologram offers an alternative in optical image processing in contrast to Fourier-plane processing. By placing a volume hologram near the object in an optical imaging setup, we achieve ...Bragg processing using a volume hologram offers an alternative in optical image processing in contrast to Fourier-plane processing. By placing a volume hologram near the object in an optical imaging setup, we achieve Bragg processing. In this review, we discuss various image processing methods achievable with acousto-optic modulators as dynamic and programmable volume holograms. In particular, we concentrate on the discussion of various differentiation operations leading to edge extraction capabilities.展开更多
Although Convolutional Neural Networks(CNNs)have significantly improved the development of image Super-Resolution(SR)technology in recent years,the existing SR methods for SAR image with large scale factors have rarel...Although Convolutional Neural Networks(CNNs)have significantly improved the development of image Super-Resolution(SR)technology in recent years,the existing SR methods for SAR image with large scale factors have rarely been studied due to technical difficulty.A more efficient method is to obtain comprehensive information to guide the SAR image reconstruction.Indeed,the co-registered High-Resolution(HR)optical image has been successfully applied to enhance the quality of SAR image due to its discriminative characteristics.Inspired by this,we propose a novel Optical-Guided Super-Resolution Network(OGSRN)for SAR image with large scale factors.Specifically,our proposed OGSRN consists of two sub-nets:a SAR image SuperResolution U-Net(SRUN)and a SAR-to-Optical Residual Translation Network(SORTN).The whole process during training includes two stages.In stage-1,the SR SAR images are reconstructed by the SRUN.And an Enhanced Residual Attention Module(ERAM),which is comprised of the Channel Attention(CA)and Spatial Attention(SA)mechanisms,is constructed to boost the representation ability of the network.In stage-2,the output of the stage-1 and its corresponding HR SAR images are translated to optical images by the SORTN,respectively.And then the differences between SR images and HR images are computed in the optical space to obtain feedback information that can reduce the space of possible SR solution.After that,we can use the optimized SRUN to directly produce HR SAR image from Low-Resolution(LR)SAR image in the testing phase.The experimental results show that under the guidance of optical image,our OGSRN can achieve excellent performance in both quantitative assessment metrics and visual quality.展开更多
Sea ice as a disaster has recently attracted a great deal of attention in China. Its monitoring has become a routine task for the maritime sector. Remote sensing, which depends mainly on SAR and optical sensors, has b...Sea ice as a disaster has recently attracted a great deal of attention in China. Its monitoring has become a routine task for the maritime sector. Remote sensing, which depends mainly on SAR and optical sensors, has become the primary means for sea-ice research. Optical images contain abundant sea-ice multi-spectral in-formation, whereas SAR images contain rich sea-ice texture information. If the characteristic advantages of SAR and optical images could be combined for sea-ice study, the ability of sea-ice monitoring would be im-proved. In this study, in accordance with the characteristics of sea-ice SAR and optical images, the transfor-mation and fusion methods for these images were chosen. Also, a fusion method of optical and SAR images was proposed in order to improve sea-ice identification. Texture information can play an important role in sea-ice classification. Haar wavelet transformation was found to be suitable for the sea-ice SAR images, and the texture information of the sea-ice SAR image from Advanced Synthetic Aperture Radar （ASAR） loaded on ENVISAT was documented. The results of our studies showed that, the optical images in the hue-intensi-ty-saturation （HIS） space could reflect the spectral characteristics of the sea-ice types more efficiently than in the red-green-blue （RGB） space, and the optical image from the China-Brazil Earth Resources Satellite （CBERS-02B） was transferred from the RGB space to the HIS space. The principal component analysis （PCA） method could potentially contain the maximum information of the sea-ice images by fusing the HIS and texture images. The fusion image was obtained by a PCA method, which included the advantages of both the sea-ice SAR image and the optical image. To validate the fusion method, three methods were used to evaluate the fused image, i.e., objective, subjective, and comprehensive evaluations. It was concluded that the fusion method proposed could improve the ability of image interpretation and sea-ice identification.展开更多
This paper presents a bathymetry inversion method using single-frame fine-resolution optical remote sensing imagery based on ocean-wave refraction and shallow-water wave theory. First, the relationship among water dep...This paper presents a bathymetry inversion method using single-frame fine-resolution optical remote sensing imagery based on ocean-wave refraction and shallow-water wave theory. First, the relationship among water depth, wavelength and wave radian frequency in shallow water was deduced based on shallow-water wave theory. Considering the complex wave distribution in the optical remote sensing imagery, Fast Fourier Transform （FFT） and spatial profile measurements were applied for measuring the wavelengths. Then, the wave radian frequency was calculated by analyzing the long-distance fluctuation in the wavelength, which solved a key problem in obtaining the wave radian frequency in a single-frame image. A case study was conducted for Sanya Bay of Hainan Island, China. Single-flame fine-resolution optical remote sensing imagery from QuickBird satellite was used to invert the bathymetry without external input parameters. The result of the digital elevation model （DEM） was evaluated against a sea chart with a scale of 1：25 000. The root-mean-square error of the inverted bathymetry was 1.07 m, and the relative error was 16.2%. Therefore, the proposed method has the advantages including no requirement for true depths and environmental parameters, and is feasible for mapping the bathymetry of shallow coastal water.展开更多
Due to the bird’s eye view of remote sensing sensors,the orientational information of an object is a key factor that has to be considered in object detection.To obtain rotating bounding boxes,existing studies either ...Due to the bird’s eye view of remote sensing sensors,the orientational information of an object is a key factor that has to be considered in object detection.To obtain rotating bounding boxes,existing studies either rely on rotated anchoring schemes or adding complex rotating ROI transfer layers,leading to increased computational demand and reduced detection speeds.In this study,we propose a novel internal-external optimized convolutional neural network for arbitrary orientated object detection in optical remote sensing images.For the internal opti-mization,we designed an anchor-based single-shot head detector that adopts the concept of coarse-to-fine detection for two-stage object detection networks.The refined rotating anchors are generated from the coarse detection head module and fed into the refining detection head module with a link of an embedded deformable convolutional layer.For the external optimiza-tion,we propose an IOU balanced loss that addresses the regression challenges related to arbitrary orientated bounding boxes.Experimental results on the DOTA and HRSC2016 bench-mark datasets show that our proposed method outperforms selected methods.展开更多
基金The Key R&D Project of Hainan Province under contract No.ZDYF2023SHFZ097the National Natural Science Foundation of China under contract No.42376180。
文摘Mangroves are indispensable to coastlines,maintaining biodiversity,and mitigating climate change.Therefore,improving the accuracy of mangrove information identification is crucial for their ecological protection.Aiming at the limited morphological information of synthetic aperture radar(SAR)images,which is greatly interfered by noise,and the susceptibility of optical images to weather and lighting conditions,this paper proposes a pixel-level weighted fusion method for SAR and optical images.Image fusion enhanced the target features and made mangrove monitoring more comprehensive and accurate.To address the problem of high similarity between mangrove forests and other forests,this paper is based on the U-Net convolutional neural network,and an attention mechanism is added in the feature extraction stage to make the model pay more attention to the mangrove vegetation area in the image.In order to accelerate the convergence and normalize the input,batch normalization(BN)layer and Dropout layer are added after each convolutional layer.Since mangroves are a minority class in the image,an improved cross-entropy loss function is introduced in this paper to improve the model’s ability to recognize mangroves.The AttU-Net model for mangrove recognition in high similarity environments is thus constructed based on the fused images.Through comparison experiments,the overall accuracy of the improved U-Net model trained from the fused images to recognize the predicted regions is significantly improved.Based on the fused images,the recognition results of the AttU-Net model proposed in this paper are compared with its benchmark model,U-Net,and the Dense-Net,Res-Net,and Seg-Net methods.The AttU-Net model captured mangroves’complex structures and textural features in images more effectively.The average OA,F1-score,and Kappa coefficient in the four tested regions were 94.406%,90.006%,and 84.045%,which were significantly higher than several other methods.This method can provide some technical support for the monitoring and protection of mangrove ecosystems.
基金Project supported by the National Natural Science Foundation of China(Grant No.62375140)the Natural Science Foundation of Suqian,Jiangsu Province,China(Grant No.S202108)+1 种基金the Open Research Fund of the National Laboratory of Solid State Microstructures(Grant No.M36055)the Postgraduate Research&Practice Innovation Program of Jiangsu Province,China(Grant No.KYCX21-0745)。
文摘We propose an optical image watermarking scheme based on orbital angular momentum(OAM)holography.Multiple topological charges(TCs,l)of OAM,as multiple cryptographic sub-keys,are embedded into the host image along with the watermark information.Moreover,the Arnold transformation is employed to further enhance the security and the scrambling time(m)is also served as another cryptographic key.The watermark image is embedded into the host image by using the discrete wavelet transformation(DWT)and singular value decomposition(SVD)methods.Importantly,the interference image is utilized to further enhance security.The imperceptibility of our proposed method is analyzed by using the peak signal-to-noise ratio(PSNR)and the histogram of the watermarked host image.To demonstrate robustness,a series of attack tests,including Gaussian noise,Poisson noise,salt-and-pepper noise,JPEG compression,Gaussian lowpass filtering,cropping,and rotation,are conducted.The experimental results show that our proposed method has advanced security,imperceptibility,and robustness,making it a promising option for optical image watermarking applications.
基金supported by Joint Fund of Natural Science Foundation of Zhejiang-Qingshanhu Science and Technology City(Grant No.LQY18C160002)National Natural Science Foundation of China(Grant No.U1809208)+1 种基金Zhejiang Science and Technology Key R&D Program Funded Project(Grant No.2018C02013)Natural Science Foundation of Zhejiang Province(Grant No.LQ20F020005).
文摘The diversity of tree species and the complexity of land use in cities create challenging issues for tree species classification.The combination of deep learning methods and RGB optical images obtained by unmanned aerial vehicles(UAVs) provides a new research direction for urban tree species classification.We proposed an RGB optical image dataset with 10 urban tree species,termed TCC10,which is a benchmark for tree canopy classification(TCC).TCC10 dataset contains two types of data:tree canopy images with simple backgrounds and those with complex backgrounds.The objective was to examine the possibility of using deep learning methods(AlexNet,VGG-16,and ResNet-50) for individual tree species classification.The results of convolutional neural networks(CNNs) were compared with those of K-nearest neighbor(KNN) and BP neural network.Our results demonstrated:(1) ResNet-50 achieved an overall accuracy(OA) of 92.6% and a kappa coefficient of 0.91 for tree species classification on TCC10 and outperformed AlexNet and VGG-16.(2) The classification accuracy of KNN and BP neural network was less than70%,while the accuracy of CNNs was relatively higher.(3)The classification accuracy of tree canopy images with complex backgrounds was lower than that for images with simple backgrounds.For the deciduous tree species in TCC10,the classification accuracy of ResNet-50 was higher in summer than that in autumn.Therefore,the deep learning is effective for urban tree species classification using RGB optical images.
基金the Natural Science Foun-dation of Shandong Province(No.ZR2019MD034)。
文摘It is difficult to balance local details and global distribution using a single source image in marine target detection of a large scene.To solve this problem,a technique based on the fusion of optical image and synthetic aperture radar(SAR)image for the extraction of sea ice is proposed in this paper.The Band 2(B2 image of Sentinel-2(S2 in the research area is selected as optical image data.Preprocessing on the optical image,such as resampling,projection transformation and format conversion,are conducted to the S2 dataset before fusion.Imaging characteristics of the sea ice have been analyzed,and a new deep learning(DL)model,OceanTDL5,is built to detect sea ices.The fusion of the Sentinel-1(S1 and S2 images is realized by solving the optimal pixel values based on deriving Poisson Equation.The experimental results indicate that the use of a fused image improves the accuracy of sea ice detection compared with the use of a single data source.The fused image has richer spatial details and a clearer texture compared with the original optical image,and its material sense and color are more abundant.
文摘Some existing image encryption schemes use simple low-dimensional chaotic systems, which makes the algorithms insecure and vulnerable to brute force attacks and cracking. Some algorithms have issues such as weak correlation with plaintext images, poor image reconstruction quality, and low efficiency in transmission and storage. To solve these issues,this paper proposes an optical image encryption algorithm based on a new four-dimensional memristive hyperchaotic system(4D MHS) and compressed sensing(CS). Firstly, this paper proposes a new 4D MHS, which has larger key space, richer dynamic behavior, and more complex hyperchaotic characteristics. The introduction of CS can reduce the image size and the transmission burden of hardware devices. The introduction of double random phase encoding(DRPE) enables this algorithm has the ability of parallel data processing and multi-dimensional coding space, and the hyperchaotic characteristics of 4D MHS make up for the nonlinear deficiency of DRPE. Secondly, a construction method of the deterministic chaotic measurement matrix(DCMM) is proposed. Using DCMM can not only save a lot of transmission bandwidth and storage space, but also ensure good quality of reconstructed images. Thirdly, the confusion method and diffusion method proposed are related to plaintext images, which require both four hyperchaotic sequences of 4D MHS and row and column keys based on plaintext images. The generation process of hyperchaotic sequences is closely related to the hash value of plaintext images. Therefore, this algorithm has high sensitivity to plaintext images. The experimental testing and comparative analysis results show that proposed algorithm has good security and effectiveness.
基金supported by the National Basic Research Program of China (Grant No. 2009CB723901)863 program (2009AA12Z145)the Chinese Academy of Sciences (kzcx2-yw-301)
文摘Mountain glaciers are sensitive to environment. It is important to acquire ice flow velocities over time for glacier research and hazard forecast. For this paper, cross-correlating of optical images is used to monitor ice flow velocities, and an improvement, which is called ＂moving grid,＂ is made to this method. For this research, two remote-sensing images in a certain glacier area, dur-ing different times are selected. The first image is divided into grids, and we calculated the correlation coefficient of each window in the grid with the window on the second image. The window with the highest correlation coefficient is considered the counter-part one on the first image. The displacement of the two corresponding windows is the movement of the glacier, and it is used to calculate glacier surface velocity. Compared to the traditional way of dividing an image with ascertain grid, this method uses small steps to move the grid from one location to another adjacent location until the whole glacier area is covered in the image, thus in-creasing corresponding point density. We selected a glacier in the Tianshan Mountains for this experiment and used two re-mote-sensing images with a 10-year interval to determine this method.
基金supported by the STI2030-Major Projects (2021ZD0201002)the National Natural Science Foundation of China (82102137,T2122015)+2 种基金Natural Science Foundation of Shaanxi Provincial Department of Education (21JK0796)the Open Project Program of Wuhan National Laboratory for Optoelectronics (2021WNL OKF006)the Natural Science Foundation of Sichuan Province (2022NSFSC0964).
文摘Vascular segmentation is a crucial task in biomedical image processing,which is significant for analyzing and modeling vascular networks under physiological and pathological states.With advances in fluorescent labeling and mesoscopic optical techniques,it has become possible to map the whole-mouse-brain vascular networks at capillary resolution.However,segmenting vessels from mesoscopic optical images is a challenging task.The problems,such as vascular signal discontinuities,vessel lumens,and background fluorescence signals in mesoscopic optical images,belong to global semantic information during vascular segmentation.Traditional vascular segmentation methods based on convolutional neural networks(CNNs)have been limited by their insufficient receptive fields,making it challenging to capture global semantic information of vessels and resulting in inaccurate segmentation results.Here,we propose SegVesseler,a vascular segmentation method based on Swin Transformer.SegVesseler adopts 3D Swin Transformer blocks to extract global contextual information in 3D images.This approach is able to maintain the connectivity and topology of blood vessels during segmentation.We evaluated the performance of our method on mouse cerebrovascular datasets generated from three different labeling and imaging modalities.The experimental results demonstrate that the segmentation effect of our method is significantly better than traditional CNNs and achieves state-of-the-art performance.
基金Under the auspices of the National Key Research and Development Program of China(No.2023YFC3208500)Shanghai Municipal Natural Science Foundation(No.22ZR1421500)+3 种基金National Natural Science Foundation of China(No.U2243207)National Science and Technology Basic Resources Survey Project(No.2023FY01001)Open Research Fund of State Key Laboratory of Estuarine and Coastal Research(No.SKLEC-KF202406)Project from Science and Technology Commission of Shanghai Municipality(No.22DZ1202700)。
文摘Mudflat vegetation plays a crucial role in the ecological function of wetland environment,and obtaining its fine spatial distri-bution is of great significance for wetland protection and management.Remote sensing techniques can realize the rapid extraction of wetland vegetation over a large area.However,the imaging of optical sensors is easily restricted by weather conditions,and the backs-cattered information reflected by Synthetic Aperture Radar(SAR)images is easily disturbed by many factors.Although both data sources have been applied in wetland vegetation classification,there is a lack of comparative study on how the selection of data sources affects the classification effect.This study takes the vegetation of the tidal flat wetland in Chongming Island,Shanghai,China,in 2019,as the research subject.A total of 22 optical feature parameters and 11 SAR feature parameters were extracted from the optical data source(Sentinel-2)and SAR data source(Sentinel-1),respectively.The performance of optical and SAR data and their feature paramet-ers in wetland vegetation classification was quantitatively compared and analyzed by different feature combinations.Furthermore,by simulating the scenario of missing optical images,the impact of optical image missing on vegetation classification accuracy and the compensatory effect of integrating SAR data were revealed.Results show that:1)under the same classification algorithm,the Overall Accuracy(OA)of the combined use of optical and SAR images was the highest,reaching 95.50%.The OA of using only optical images was slightly lower,while using only SAR images yields the lowest accuracy,but still achieved 86.48%.2)Compared to using the spec-tral reflectance of optical data and the backscattering coefficient of SAR data directly,the constructed optical and SAR feature paramet-ers contributed to improving classification accuracy.The inclusion of optical(vegetation index,spatial texture,and phenology features)and SAR feature parameters(SAR index and SAR texture features)in the classification algorithm resulted in an OA improvement of 4.56%and 9.47%,respectively.SAR backscatter,SAR index,optical phenological features,and vegetation index were identified as the top-ranking important features.3)When the optical data were missing continuously for six months,the OA dropped to a minimum of 41.56%.However,when combined with SAR data,the OA could be improved to 71.62%.This indicates that the incorporation of SAR features can effectively compensate for the loss of accuracy caused by optical image missing,especially in regions with long-term cloud cover.
基金supported by the National Natural Science Foundation of China(11903025)by the Sichuan Science and Technology Program(2024NSFSC1999)。
文摘In this work,using the thin disk model,we examine the optical observations of asymmetric thin-shell wormholes(ATWs)within the theoretical framework of higher-order non-commutative geometry.By utilizing ray tracing technology,the trajectories of photons under various relevant parameters,as well as the optical observational appearance of ATW,can be accurately simulated.Compared to the black hole(BH)spacetime,observational images of ATW will exhibit extra bright ring structures.The results show that an increase in the non-commutative parameter leads to the innermost extra photon ring moving away from the shadow region,while the second extra photon ring moves closer to the shadow region.However,only one extra bright ring structure is observed in the image when the non-commutative parameter increases toθ=0.03,implying that the observed features of ATWs seem to become increasingly visually similar to a BH with increasingθ.Furthermore,an increase in the mass ratio will result in a reduction of the radius of the innermost extra photon ring,whereas an increase in the throat radius will lead to an expansion of its radius.Notably,neither parameter has a significant impact on the size of the second extra photon ring.These findings significantly advance our theoretical understanding of the optical features of ATWs with higher-order non-commutative corrections.
文摘BACKGROUND Optical coherence tomography(OCT)enables high-resolution,non-invasive visualization of retinal structures.Recent evidence suggests that retinal layer alterations may reflect central nervous system changes associated with psychiatric disorders such as schizophrenia(SZ).AIM To develop an advanced deep learning model to classify OCT images and distinguish patients with SZ from healthy controls using retinal biomarkers.METHODS A novel convolutional neural network,Self-AttentionNeXt,was designed by integrating grouped self-attention mechanisms,residual and inverted bottleneck blocks,and a final 1×1 convolution for feature refinement.The model was trained and tested on both a custom OCT dataset collected from patients with SZ and a publicly available OCT dataset(OCT2017).RESULTS Self-AttentionNeXt achieved 97.0%accuracy on the collected SZ OCT dataset and over 95%accuracy on the public OCT2017 dataset.Gradient-weighted class activation mapping visualizations confirmed the model’s attention to clinically relevant retinal regions,suggesting effective feature localization.CONCLUSION Self-AttentionNeXt effectively combines transformer-inspired attention mechanisms with convolutional neural networks architecture to support the early and accurate detection of SZ using OCT images.This approach offers a promising direction for artificial intelligence-assisted psychiatric diagnostics and clinical decision support.
文摘To verify the effectiveness of digital optical 3D image analyzer EvaSKIN in the objective and quantitative evaluation of wrinkles.A total of 115 subjects were recruited,the facial images of the subjects were collected by digital optical 3D image analyzer and manual camera,the changes of crow’s feet with age were analyzed.Pictures obtained by manual photography can be directly used for observation and preliminary grading of wrinkles.However,the requirements for evaluators are high,and the results are prone to errors,which will affect the accuracy of the evaluation.Therefore,skilled raters are needed.Compared with the manual photography method,the digital optical 3D image analyzer EvaSKIN can realize three-dimensional extraction of wrinkles,and obtain the change trend of crow’s feet with age.20~30 years old,wrinkles begin to appear slowly;wrinkles will increase rapidly at the age of 30~50;The length of 50~60 year old wrinkles is basically fixed,the wrinkles develop longitudewise,gradually widen and deepen,and the area,depth and volume increase is obvious,and the skin aging condition is intensified.the digital optical 3D image analyzer EvaSKIN realizes the 3D extraction of wrinkles,quantifies the circumference,area,average depth,maximum depth and volume of wrinkles,realizes the objective and quantitative evaluation of wrinkle state,is more accurate in the measurement of wrinkles,and provides a new instrument and method for the evaluation of wrinkles.it is a perfect and supplement to the traditional evaluation methods,and to a certain extent,it helps the research and development and evaluation institutions of cosmetics to obtain more abundant and three-dimensional data support.
基金supported by the National Key R&D Program of China(No.2022YFB4601601)the Key R&D Program of Guangxi Province,China(No.GKAB23026101)+1 种基金the Base,Talent Special Project of the Guangxi Science and Technology Plan Project(No.Gui Ke AD23026149)Guangxi Natural Science Foundation,China(No.2023GXNSFBA026287)
文摘Ultrafast phenomena induced by femtosecond laser irradiation encompass a range of highly dynamic physical processes,including but not limited to electron excitation,material ablation,plasma generation,and shock wave propagation.Unveiling the dynamics of these ultrafast processes is crucial for effectively controlling laser processing.However,many of these phenomena occur on timescales ranging from femtoseconds(fs) to nanoseconds(ns),which presents significant challenges in monitoring and interpretation;thus,ultrafast optical imaging techniques are often required.This paper comprehensively reviews the ultrafast optical imaging methods employed in recent years to monitor various ultrafast processes such as electron excitation,ultrafast ablation,plasma ejection,and shock wave propagation during femtosecond laser processing of metallic,composite,and ceramic materials.These methods can be categorized into two primary types:pump-probe ultrafast optical imaging and single-shot ultrafast optical imaging techniques.The working principles and key findings associated with each type of ultrafast optical imaging technique are described in detail.Finally,the imaging principles,advantages and disadvantages,and application scenarios of various ultrafast imaging technologies are summarized,along with a discussion of future challenges and development directions in this field.
文摘Fluorescent probes have revolutionized optical imaging and biosensing by enabling real-time visualization, quantification, and tracking of biological processes at molecular and cellular levels. These probes, ranging from organic dyes to genetically encoded proteins and nanomaterials, provide unparalleled specificity, sensitivity, and multiplexing capabilities. However, challenges such as brightness, photobleaching, biocompatibility, and emission range continue to drive innovation in probe design and application. This special issue, comprising four review papers and seven original research studies, highlights cutting-edge advancements in fluorescent probe technologies and their transformative roles in super-resolution imaging, in vivo diagnostics, and cancer therapeutics.
基金the projects of the CAS“Light of West China”Program,the National Natural Science Foundation of China(11573067)the Science and Technology Program of Shanghai(21DZ206100)+2 种基金the Ground-based Space Environment Monitoring Network(Chinese Meridian Project II)the Yunnan Revitalization Talent Support Program-Science&Technology Champion Project(202105AB160001)the Chinese National Antarctic&Arctic Research Expedition for the support of the all-sky auroral/airglow imager program at the Longyearbyen Station and Lijiang Station.
文摘We report a new standalone Robotic All-Sky narrowband Imager(RASI)for auroral and airglow studies.RASI has new optics and an electromechanical system,low operation and installation costs,easy deployment and fully automatic features.The new optics provide an all-sky field of view with excellent image quality and sensitivity.The new electromechanical system design offers a more compact size and the capability for outdoor independent deployment.We have also developed a fully automatic data acquisition software for RASI,which is based on the perception of solar altitude and the all-sky cloud cover.In conclusion,the RASI demonstrates significant advantages over the traditional all-sky narrowband imager,and it is highly suitable for the intensity measurements of large-scale auroras and airglow distributions.
文摘AIM:To evaluate the choroidopathy in patients with systemic lupus erythematosus(SLE)using enhanced depth imaging spectral domain optical coherence tomography(EDI SD-OCT)and optical coherence tomography angiography(OCTA).METHODS:A total of 74 patients with SLE and 40 healthy volunteers were included in this cross-sectional study.SLE patients were further divided into three subgroups based on clinical and blood biochemistry findings.Ocular parameters obtained on ophthalmologic examination and optical imaging(EDI SD-OCT and OCTA)included the best corrected distance visual acuity(logMAR CDVA),subfoveal choroidal thickness(SCT),choroidal vascularity index(CVI)and vessel density(VD)of superficial capillary plexus(SCP)and deep capillary plexus(DCP).RESULTS:SLE patients had significantly lower values for CVI and VD of DCP(DVD)than control subjects.Amongst SLE patients,gender and chloroquine dose were found to be independent determinants of CVI while age predicted SCT.Steroid dose was a significant predictor for foveal VD of SCP(SVD),chloroquine dose for parafoveal SVD,gender for total DVD,and gender and steroid dose for perifoveal DVD.No correlation of logMAR CDVA and SCT was noted between SLE patients and control subjects.No correlation of SCT was noted with disease duration,Systemic Lupus Erythematosus Disease Activity Index(SLEDAI)score,hydroxychloroquine(HCQ)dose or steroid dose.No correlation of CVI was noted with patient age,disease duration,SLEDAI score,HCQ dose or steroid dose.No significant difference was noted between SLE subgroups in terms of any of the ocular parameters studied.CONCLUSION:The findings reveal the presence of ocular findings suggestive of early onset choroidopathy on EDI SD-OCT and OCTA in SLE patients,in the absence of ocular manifestations or active disease.
基金The work was supported by the National Natural Science Foundation of China(Nos.11762009 and 61865007)the Natural Science Foundation of Yunnan Province,China(No.2018FB101)+1 种基金the Key Program of Science and Technology of Yunnan Province(No.2019FA025)the Yunnan Provincial Program for Foreign Talent(No.104126760027)。
文摘Bragg processing using a volume hologram offers an alternative in optical image processing in contrast to Fourier-plane processing. By placing a volume hologram near the object in an optical imaging setup, we achieve Bragg processing. In this review, we discuss various image processing methods achievable with acousto-optic modulators as dynamic and programmable volume holograms. In particular, we concentrate on the discussion of various differentiation operations leading to edge extraction capabilities.
基金supported by the National Natural Science Foundation of China(Nos.61771319,62076165 and 61871154)the Natural Science Foundation of Guangdong Province,China(No.2019A1515011307)+1 种基金Shenzhen Science and Technology Project,China(Nos.JCYJ20180507182259896 and 20200826154022001)the other project(Nos.2020KCXTD004 and WDZC20195500201)。
文摘Although Convolutional Neural Networks(CNNs)have significantly improved the development of image Super-Resolution(SR)technology in recent years,the existing SR methods for SAR image with large scale factors have rarely been studied due to technical difficulty.A more efficient method is to obtain comprehensive information to guide the SAR image reconstruction.Indeed,the co-registered High-Resolution(HR)optical image has been successfully applied to enhance the quality of SAR image due to its discriminative characteristics.Inspired by this,we propose a novel Optical-Guided Super-Resolution Network(OGSRN)for SAR image with large scale factors.Specifically,our proposed OGSRN consists of two sub-nets:a SAR image SuperResolution U-Net(SRUN)and a SAR-to-Optical Residual Translation Network(SORTN).The whole process during training includes two stages.In stage-1,the SR SAR images are reconstructed by the SRUN.And an Enhanced Residual Attention Module(ERAM),which is comprised of the Channel Attention(CA)and Spatial Attention(SA)mechanisms,is constructed to boost the representation ability of the network.In stage-2,the output of the stage-1 and its corresponding HR SAR images are translated to optical images by the SORTN,respectively.And then the differences between SR images and HR images are computed in the optical space to obtain feedback information that can reduce the space of possible SR solution.After that,we can use the optimized SRUN to directly produce HR SAR image from Low-Resolution(LR)SAR image in the testing phase.The experimental results show that under the guidance of optical image,our OGSRN can achieve excellent performance in both quantitative assessment metrics and visual quality.
基金The National Science Foundation for Young Scientists of China under contract No.41306193the National Special Research Fund for Non-Profit Marine Sector of China under contract No.201105016the ESA-MOST Dragon 3 Cooperation Programme under contract No.10501
文摘Sea ice as a disaster has recently attracted a great deal of attention in China. Its monitoring has become a routine task for the maritime sector. Remote sensing, which depends mainly on SAR and optical sensors, has become the primary means for sea-ice research. Optical images contain abundant sea-ice multi-spectral in-formation, whereas SAR images contain rich sea-ice texture information. If the characteristic advantages of SAR and optical images could be combined for sea-ice study, the ability of sea-ice monitoring would be im-proved. In this study, in accordance with the characteristics of sea-ice SAR and optical images, the transfor-mation and fusion methods for these images were chosen. Also, a fusion method of optical and SAR images was proposed in order to improve sea-ice identification. Texture information can play an important role in sea-ice classification. Haar wavelet transformation was found to be suitable for the sea-ice SAR images, and the texture information of the sea-ice SAR image from Advanced Synthetic Aperture Radar （ASAR） loaded on ENVISAT was documented. The results of our studies showed that, the optical images in the hue-intensi-ty-saturation （HIS） space could reflect the spectral characteristics of the sea-ice types more efficiently than in the red-green-blue （RGB） space, and the optical image from the China-Brazil Earth Resources Satellite （CBERS-02B） was transferred from the RGB space to the HIS space. The principal component analysis （PCA） method could potentially contain the maximum information of the sea-ice images by fusing the HIS and texture images. The fusion image was obtained by a PCA method, which included the advantages of both the sea-ice SAR image and the optical image. To validate the fusion method, three methods were used to evaluate the fused image, i.e., objective, subjective, and comprehensive evaluations. It was concluded that the fusion method proposed could improve the ability of image interpretation and sea-ice identification.
基金The Public Science and Technology Research Fund Project of Ocean under contract No.201105001the National Nature Science Foundation of China under contract No.41576174the Public Science and Technology Research Fund Project of Surveying,Mapping and Geoinformation under contract No.201512030
文摘This paper presents a bathymetry inversion method using single-frame fine-resolution optical remote sensing imagery based on ocean-wave refraction and shallow-water wave theory. First, the relationship among water depth, wavelength and wave radian frequency in shallow water was deduced based on shallow-water wave theory. Considering the complex wave distribution in the optical remote sensing imagery, Fast Fourier Transform （FFT） and spatial profile measurements were applied for measuring the wavelengths. Then, the wave radian frequency was calculated by analyzing the long-distance fluctuation in the wavelength, which solved a key problem in obtaining the wave radian frequency in a single-frame image. A case study was conducted for Sanya Bay of Hainan Island, China. Single-flame fine-resolution optical remote sensing imagery from QuickBird satellite was used to invert the bathymetry without external input parameters. The result of the digital elevation model （DEM） was evaluated against a sea chart with a scale of 1：25 000. The root-mean-square error of the inverted bathymetry was 1.07 m, and the relative error was 16.2%. Therefore, the proposed method has the advantages including no requirement for true depths and environmental parameters, and is feasible for mapping the bathymetry of shallow coastal water.
基金This work is supported by the National Natural Science Foundation of China[grant numbers 41890820,41771452,41771454,and 41901340]。
文摘Due to the bird’s eye view of remote sensing sensors,the orientational information of an object is a key factor that has to be considered in object detection.To obtain rotating bounding boxes,existing studies either rely on rotated anchoring schemes or adding complex rotating ROI transfer layers,leading to increased computational demand and reduced detection speeds.In this study,we propose a novel internal-external optimized convolutional neural network for arbitrary orientated object detection in optical remote sensing images.For the internal opti-mization,we designed an anchor-based single-shot head detector that adopts the concept of coarse-to-fine detection for two-stage object detection networks.The refined rotating anchors are generated from the coarse detection head module and fed into the refining detection head module with a link of an embedded deformable convolutional layer.For the external optimiza-tion,we propose an IOU balanced loss that addresses the regression challenges related to arbitrary orientated bounding boxes.Experimental results on the DOTA and HRSC2016 bench-mark datasets show that our proposed method outperforms selected methods.
