This study provides the first systematic evaluation of image resolution’s effect (50-300 PPI, pixels per inch) on UAV (unmanned aerial vehicle)-based digital close-range photogrammetry accuracy in civil engineering a...This study provides the first systematic evaluation of image resolution’s effect (50-300 PPI, pixels per inch) on UAV (unmanned aerial vehicle)-based digital close-range photogrammetry accuracy in civil engineering applications, such as infrastructure monitoring and heritage preservation. Using a high-resolution UAV with a 20 MP (MegaPixels) sensor, four images of a brick wall test field were captured and processed in Agisoft Metashape, with resolutions compared against Leica T2002 theodolite measurements (1.0 mm accuracy). Advanced statistical methods (ANOVA (analysis of variance), Tukey tests, Monte Carlo simulations) and ground control points validated the results. Accuracy improved from 25 mm at 50 PPI to 5 mm at 150 PPI (p < 0.01), plateauing at 4 mm beyond 200 PPI, while 150 PPI reduced processing time by 62% compared to 300 PPI. Unlike prior studies, this research uniquely isolates resolution effects in a controlled civil engineering context, offering a novel 150 PPI threshold that balances precision and efficiency. This threshold supports Saudi Vision 2030’s smart infrastructure goals for megaprojects like NEOM, providing a scalable framework for global applications. Future research should leverage deep learning to optimize resolutions in dynamic environments.展开更多
A new way is proposed to evaluate the influence of atmospheric turbulence on image resolution of airborne and space-borne optical remote sensing system, which is called as arrival angle-method. Applying this method, s...A new way is proposed to evaluate the influence of atmospheric turbulence on image resolution of airborne and space-borne optical remote sensing system, which is called as arrival angle-method. Applying this method, some engineering examples are selected to analyze the turbulence influences on image resolution based on three different atmospheric turbulence models quantificationally, for the airborne remote sensing system, the resolution errors caused by the atmospheric turbulence are less than 1 cm, and for the space-borne remote sensing system, the errors are around 1 cm. The results are similar to that obtained by the previous Friedmethod. Compared with the Fried-method, the arrival angle-method is rather simple and can be easily used in engineering fields.展开更多
Due to hardware limitations,existing hyperspectral(HS)camera often suffer from low spatial/temporal resolution.Recently,it has been prevalent to super-resolve a low reso-lution(LR)HS image into a high resolution(HR)HS...Due to hardware limitations,existing hyperspectral(HS)camera often suffer from low spatial/temporal resolution.Recently,it has been prevalent to super-resolve a low reso-lution(LR)HS image into a high resolution(HR)HS image with a HR RGB(or mul-tispectral)image guidance.Previous approaches for this guided super-resolution task often model the intrinsic characteristic of the desired HR HS image using hand-crafted priors.Recently,researchers pay more attention to deep learning methods with direct supervised or unsupervised learning,which exploit deep prior only from training dataset or testing data.In this article,an efficient convolutional neural network-based method is presented to progressively super-resolve HS image with RGB image guidance.Specif-ically,a progressive HS image super-resolution network is proposed,which progressively super-resolve the LR HS image with pixel shuffled HR RGB image guidance.Then,the super-resolution network is progressively trained with supervised pre-training and un-supervised adaption,where supervised pre-training learns the general prior on training data and unsupervised adaptation generalises the general prior to specific prior for variant testing scenes.The proposed method can effectively exploit prior from training dataset and testing HS and RGB images with spectral-spatial constraint.It has a good general-isation capability,especially for blind HS image super-resolution.Comprehensive experimental results show that the proposed deep progressive learning method out-performs the existing state-of-the-art methods for HS image super-resolution in non-blind and blind cases.展开更多
Convolutional neural networks depend on deep network architectures to extract accurate information for image super‐resolution.However,obtained information of these con-volutional neural networks cannot completely exp...Convolutional neural networks depend on deep network architectures to extract accurate information for image super‐resolution.However,obtained information of these con-volutional neural networks cannot completely express predicted high‐quality images for complex scenes.A dynamic network for image super‐resolution(DSRNet)is presented,which contains a residual enhancement block,wide enhancement block,feature refine-ment block and construction block.The residual enhancement block is composed of a residual enhanced architecture to facilitate hierarchical features for image super‐resolution.To enhance robustness of obtained super‐resolution model for complex scenes,a wide enhancement block achieves a dynamic architecture to learn more robust information to enhance applicability of an obtained super‐resolution model for varying scenes.To prevent interference of components in a wide enhancement block,a refine-ment block utilises a stacked architecture to accurately learn obtained features.Also,a residual learning operation is embedded in the refinement block to prevent long‐term dependency problem.Finally,a construction block is responsible for reconstructing high‐quality images.Designed heterogeneous architecture can not only facilitate richer structural information,but also be lightweight,which is suitable for mobile digital devices.Experimental results show that our method is more competitive in terms of performance,recovering time of image super‐resolution and complexity.The code of DSRNet can be obtained at https://github.com/hellloxiaotian/DSRNet.展开更多
In many cases,the Digital Surface Models(DSMs)and Digital Elevation Models(DEMs)are obtained with Light Detection and Ranging(LiDAR)or stereo matching.As an active method,LiDAR is very accurate but expensive,thus ofte...In many cases,the Digital Surface Models(DSMs)and Digital Elevation Models(DEMs)are obtained with Light Detection and Ranging(LiDAR)or stereo matching.As an active method,LiDAR is very accurate but expensive,thus often limiting its use in small-scale acquisition.Stereo matching is suitable for large-scale acquisition of terrain information as the increase of satellite stereo sensors.However,underperformance of stereo matching easily occurs in textureless areas.Accordingly,this study proposed a Shading Aware DSM GEneration Method(SADGE)with high resolution multi-view satellite images.Considering the complementarity of stereo matching and Shape from Shading(SfS),SADGE combines the advantage of stereo matching and SfS technique.First,an improved Semi-Global Matching(SGM)technique is used to generate an initial surface expressed by a DSM;then,it is refined by optimizing the objective function which modeled the imaging process with the illumination,surface albedo,and normal object surface.Different from the existing shading-based DEM refinement or generation method,no information about the illumination or the viewing angle is needed while concave/convex ambiguity can be avoided as multi-view images are utilized.Experiments with ZiYuan-3 and GaoFen-7 images show that the proposed method can generate higher accuracy DSM(12.5-56.3%improvement)with sound overall shape and temporarily detailed surface compared with a software solution(SURE)for multi-view stereo.展开更多
Photoacoustic microscopy （PAM） is recognized as a powerful tool for various microcirculation system studies. To improve the spatial resolution for the PAM images, the requirements of the system will always be increa...Photoacoustic microscopy （PAM） is recognized as a powerful tool for various microcirculation system studies. To improve the spatial resolution for the PAM images, the requirements of the system will always be increased correspondingly. Without additional cost of the system, we address the problem of improving the resolution of PAM images by integrating a deconvolution model with a directional total variation regularization. Additionally, we present a primal-dual-based algorithm to solve the associated optimization problem efficiently. Results from both test images and some PAM images studies validate the effectiveness of the proposed method in enhancing the spatial resolution. We expect the proposed technique to be an alternative resolution enhancement tool for some important biomedical applications.展开更多
Super-resolution optical imaging is crucial to the study of cellular processes.Current super-resolution fluorescence microscopy is restricted by the need of special fluorophores or sophisticated optical systems,or lon...Super-resolution optical imaging is crucial to the study of cellular processes.Current super-resolution fluorescence microscopy is restricted by the need of special fluorophores or sophisticated optical systems,or long acquisition and computational times.In this work,we present a deep-learning-based super-resolution technique of confocal microscopy.We devise a two-channel attention network(TCAN),which takes advantage of both spatial representations and frequency contents to learn a more precise mapping from low-resolution images to high-resolution ones.This scheme is robust against changes in the pixel size and the imaging setup,enabling the optimal model to generalize to different fluorescence microscopy modalities unseen in the training set.Our algorithm is validated on diverse biological structures and dual-color confocal images of actin-microtubules,improving the resolution from~230 nm to~110 nm.Last but not least,we demonstrate live-cell super-resolution imaging by revealing the detailed structures and dynamic instability of microtubules.展开更多
Individual tree detection and delineation(ITDD)is an important subject in forestry and urban forestry.This study represents the first research to propose the concept of crown resolution to comprehensively evaluate the...Individual tree detection and delineation(ITDD)is an important subject in forestry and urban forestry.This study represents the first research to propose the concept of crown resolution to comprehensively evaluate the co-effect of image resolution and crown size on deep learning.Six images with different resolutions were derived from a DJI Unmanned Aerial Vehicle(UAV),and 1344 manually delineated Chinese fir(Cunninghamia lanceolata(Lamb)Hook)tree crowns were used for six training and validation mask region-based convolutional neural network(Mask R-CNN)models,while additional 476 delineated tree crowns were reserved for testing.The overall detection accuracy,the influence of different crown sizes,and crown resolutions were calculated to evaluate model performance accuracy with different image resolutions for ITDD.Results show that the highest accuracy was achieved when the crown resolution was between 800 and 12800 pixels/tree.The accuracy of ITDD was impacted by crown resolution,and it was unable to effectively identify Chinese fir when the crown resolution was less than 25 pixels/tree or higher than 12800 pixels/tree.The study highlights crown resolution as a critical factor affecting ITDD and suggests selecting the appropriate resolution based on the target detected crown size.展开更多
This research paper recommends the point spread function(PSF)forecasting technique based on the projection onto convex set(POCS)and regularization to acquire low resolution images.As the environment for the production...This research paper recommends the point spread function(PSF)forecasting technique based on the projection onto convex set(POCS)and regularization to acquire low resolution images.As the environment for the production of user created contents(UCC)videos(one of the contents on the Internet)becomes widespread,resolution reduction and image distortion occurs,failing to satisfy users who desire high quality images.Accordingly,this research neutralizes the coding artifact through POCS and regularization processes by:1)factoring the local characteristics of the image when it comes to the noise that results during the discrete cosine transform(DCT)and quantization process;and 2)removing the blocking and ring phenomena which are problems with the existing video compression.Moreover,this research forecasts the point spread function to obtain low resolution images using the above-mentioned methods.Thus,a method is suggested for minimizing the errors found among the forecasting interpolation pixels.Low-resolution image quality obtained through the experiment demonstrates that significant enhancement was made on the visual level compared to the original image.展开更多
Road extraction plays an important role in many applications such as car navigation, but the manual extraction of roads is a laborious, tedious task. To speed the extraction of roads, an approach based on particle fil...Road extraction plays an important role in many applications such as car navigation, but the manual extraction of roads is a laborious, tedious task. To speed the extraction of roads, an approach based on particle filtering to extract automatically roads from high resolution imagery is proposed. Particle filtering provides a statistical framework for propagating sample-based approximations of posterior distributions and has almost no restriction on the ingredients of the model. We integrate the similarity of grey value and the edge point distribution of roads into particle filtering to deal with complex scenes. To handle road appearance changes the tracking algorithm is allowed to update the road model during temporally stable image observations. A fully automatic initialization strategy is used. Experimental results show that the proposed approach is a promising and fully automatic method for extracting roads from images, even in the presence of occlusions.展开更多
The exploration of building detection plays an important role in urban planning,smart city and military.Aiming at the problem of high overlapping ratio of detection frames for dense building detection in high resoluti...The exploration of building detection plays an important role in urban planning,smart city and military.Aiming at the problem of high overlapping ratio of detection frames for dense building detection in high resolution remote sensing images,we present an effective YOLOv3 framework,corner regression-based YOLOv3(Correg-YOLOv3),to localize dense building accurately.This improved YOLOv3 algorithm establishes a vertex regression mechanism and an additional loss item about building vertex offsets relative to the center point of bounding box.By extending output dimensions,the trained model is able to output the rectangular bounding boxes and the building vertices meanwhile.Finally,we evaluate the performance of the Correg-YOLOv3 on our self-produced data set and provide a comparative analysis qualitatively and quantitatively.The experimental results achieve high performance in precision(96.45%),recall rate(95.75%),F1 score(96.10%)and average precision(98.05%),which were 2.73%,5.4%,4.1%and 4.73%higher than that of YOLOv3.Therefore,our proposed algorithm effectively tackles the problem of dense building detection in high resolution images.展开更多
Small-object detection has long been a challenge.High-megapixel cameras are used to solve this problem in industries.However,current detectors are inefficient for high-resolution images.In this work,we propose a new m...Small-object detection has long been a challenge.High-megapixel cameras are used to solve this problem in industries.However,current detectors are inefficient for high-resolution images.In this work,we propose a new module called Pre-Locate Net,which is a plug-and-play structure that can be combined with most popular detectors.We inspire the use of classification ideas to obtain candidate regions in images,greatly reducing the amount of calculation,and thus achieving rapid detection in high-resolution images.Pre-Locate Net mainly includes two parts,candidate region classification and behavior classification.Candidate region classification is used to obtain a candidate region,and behavior classification is used to estimate the scale of an object.Different follow-up processing is adopted according to different scales to balance the variance of the network input.Different from the popular candidate region generation method,we abandon the idea of regression of a bounding box and adopt the concept of classification,so as to realize the prediction of a candidate region in the shallow network.We build a high-resolution dataset of aircraft and landing gears covering complex scenes to verify the effectiveness of our method.Compared to state-of-the-art detectors(e.g.,Guided Anchoring,Libra-RCNN,and FASF),our method achieves the best m AP of 94.5 on 1920×1080 images at 16.7 FPS.展开更多
Obtaining clear images of underwater scenes with descriptive details is an arduous task.Conventional imaging techniques fail to provide clear cut features and attributes that ultimately result in object recognition er...Obtaining clear images of underwater scenes with descriptive details is an arduous task.Conventional imaging techniques fail to provide clear cut features and attributes that ultimately result in object recognition errors.Consequently,a need for a system that produces clear images for underwater image study has been necessitated.To overcome problems in resolution and to make better use of the Super-Resolution(SR)method,this paper introduces a novel method that has been derived from the Alpha Generative Adversarial Network(AlphaGAN)model,named Alpha Super Resolution Generative Adversarial Network(AlphaSRGAN).The model put forth in this paper helps in enhancing the quality of underwater imagery and yields images with greater resolution and more concise details.Images undergo pre-processing before they are fed into a generator network that optimizes and reforms the structure of the network while enhancing the stability of the network that acts as the generator.After the images are processed by the generator network,they are passed through an adversarial method for training models.The dataset used in this paper to learn Single Image Super Resolution(SISR)is the USR 248 dataset.Training supervision is performed by an unprejudiced function that simultaneously scrutinizes and improves the image quality.Appraisal of images is done with reference to factors like local style information,global content and color.The dataset USR 248 which has a huge collection of images has been used for the study is composed of three collections of images—high(640×480)and low(80×60,160×120,and 320×240).Paired instances of different sizes—2×,4×and 8×—are also present in the dataset.Parameters like Mean Opinion Score(MOS),Peak Signal-to-Noise Ratio(PSNR),Structural Similarity(SSIM)and Underwater Image Quality Measure(UIQM)scores have been compared to validate the improved efficiency of our model when compared to existing works.展开更多
Accurate information on the location and magnitude of vegetation change in scenic areas can guide the configuration of tourism facilities and the formulation of vegetation protection measures.High spatial resolution r...Accurate information on the location and magnitude of vegetation change in scenic areas can guide the configuration of tourism facilities and the formulation of vegetation protection measures.High spatial resolution remote sensing images can be used to detect subtle vegetation changes.The major objective of this study was to map and quantify forest vegetation changes in a national scenic location,the Purple Mountains of Nanjing,China,using multi-temporal cross-sensor high spatial resolution satellite images to identify the main drivers of the vegetation changes and provide a reference for sustainable management.We used Quickbird images acquired in 2004,IKONOS images acquired in 2009,and WorldView2 images acquired in 2015.Four pixel-based direct change detection methods including the normalized difference vegetation index difference method,multi-index integrated change analysis(MIICA),principal component analysis,and spectral gradient difference analysis were compared in terms of their change detection performances.Subsequently,the best pixel-based detection method in conjunction with object-oriented image analysis was used to extract subtle forest vegetation changes.An accuracy assessment using the stratified random sampling points was conducted to evaluate the performance of the change detection results.The results showed that the MIICA method was the best pixel-based change detection method.And the object-oriented MIICA with an overall accuracy of 0.907 and a kappa coefficient of 0.846 was superior to the pixel-based MIICA.From 2004 to 2009,areas of vegetation gain mainly occurred around the periphery of the study area,while areas of vegetation loss were observed in the interior and along the boundary of the study area due to construction activities,which contributed to 79%of the total area of vegetation loss.During 2009–2015,the greening initiatives around the construction areas increased the forest vegetation coverage,accounting for 84%of the total area of vegetation gain.In spite of this,vegetation loss occurred in the interior of the Purple Mountains due to infrastructure development that caused conversion from vegetation to impervious areas.We recommend that:(1)a local multi-agency team inspect and assess law enforcement regarding natural resource utilization;and(2)strengthen environmental awareness education.展开更多
[ Objective] The study aimed to improve methods of monitoring Karst Rocky Desertification （KRD） control projects and increase the working efficiency. [Method] Based on remote sensing images with medium and high spat...[ Objective] The study aimed to improve methods of monitoring Karst Rocky Desertification （KRD） control projects and increase the working efficiency. [Method] Based on remote sensing images with medium and high spatial resolution, KRD control projects in Disi River basin in Puan County were monitored, that is, information of the project construction in the study area was extracted using supervised classification and hu- man-computer interactive interpretation, and the monitoring results were testified with the aid of GPS. [Result] It was feasible to monitor KRD con- trol projects in Disi River basin based on remote sensing images with medium and high resolution, and the monitoring accuracy was satisfactory, reaching above 80% or 90%, so the method is worthy of popularizing. [ Conclusion] Remote sensing images with medium and high resolution can be used to monitor other KRD control Droiects.展开更多
Non-superimposable mirror image crystals of both enantiomers（S/R） of cyclicγ-alkenyl alcohol（2） have been recognized and remarkably identified by the naked eye.More interestingly,both crystals are an outcome of m...Non-superimposable mirror image crystals of both enantiomers（S/R） of cyclicγ-alkenyl alcohol（2） have been recognized and remarkably identified by the naked eye.More interestingly,both crystals are an outcome of most astonishingly H-bond and intermolecularσ/π-πinteractions.They accounted for the relatively rare and less predictable spontaneous resolution with optical purity 〉99%ee from the racemic mixture.The chiral discrimination mechanism of this spontaneous resolution has also been proposed.展开更多
Calman filtering method based on wavelet transform has been successfully applied to signal denoising. According to the different application methods and the realization forms of Calman filter, combined with the struct...Calman filtering method based on wavelet transform has been successfully applied to signal denoising. According to the different application methods and the realization forms of Calman filter, combined with the structural analysis of wavelet decomposition, we present kinds of multi-scale filtering methods into the category of the three. The simulation results show that the multi-scale Calman filtering method based on system layer has better performance. Synthetic aperture radar （SAR） images have rich texture information, which can reflect the spatial structure of objects. The texture feature is widely used in SAR image classification and SAR image segmentation. Affected by imaging factors, the direct use of texture features extracted from SAR images is not good enough. In order to avoid the traditional method of filtering followed the texture feature extraction caused by the loss of texture and edge information, this paper presents a texture feature extraction of SAR image, then using Robust PCA method, finally using texture feature clustering method K-means test after treatment with RPCA expression.展开更多
Global motion estimation (GME) algorithms are widely applied to computer vision and video processing. In the previous works, the image resolutions are usually low for the real-time requirement (e.g. video stabilizatio...Global motion estimation (GME) algorithms are widely applied to computer vision and video processing. In the previous works, the image resolutions are usually low for the real-time requirement (e.g. video stabilization). However, in some mobile devices applications (e.g. image sequence panoramic stitching), the high resolution is necessary to obtain satisfactory quality of panoramic image. However, the computational cost will become too expensive to be suitable for the low power consumption requirement of mobile device. The full search algorithm can obtain the global minimum with extremely computational cost, while the typical fast algorithms may suffer from the local minimum problem. This paper proposed a fast algorithm to deal with 2560 × 1920 high-resolution (HR) image sequences. The proposed method estimates the motion vector by a two-level coarse-to-fine scheme which only exploits sparse reference blocks (25 blocks in this paper) in each level to determine the global motion vector, thus the computational costs are significantly decreased. In order to increase the effective search range and robustness, the predictive motion vector (PMV) technique is used in this work. By the comparisons of computational complexity, the proposed algorithm costs less addition operations than the typical Three-Step Search algorithm (TSS) for estimating the global motion of the HR images without the local minimum problem. The quantitative evaluations show that our method is comparable to the full search algorithm (FSA) which is considered to be the golden baseline.展开更多
Cotton is one of the most significant cash crops in the world,and it is also the main source of natural fiber for textiles.It is crucial for cotton management to identify the spatiotemporal distribution of cotton plan...Cotton is one of the most significant cash crops in the world,and it is also the main source of natural fiber for textiles.It is crucial for cotton management to identify the spatiotemporal distribution of cotton planting areas timely and accurately on a fine scale.However,previous research studies have predominantly concentrated on specific years using remote sensing data.Challenges still exist in the extraction of cotton areas for long time series with high accuracy.To address this issue,a novel cotton sample selection method was proposed and the machine learning method is employed to effectively identify the long time series cotton planting areas at a 30-m resolution scale.Bortala and Shuanghe in Xinjiang,China,were selected as the study cases to demonstrate the approach.Specifically,the cropland in this study was extracted by using an object-oriented classification method with Landsat images and the results were optimized as the vectorized boundary of croplands.Then,the cotton samples were selected using the Normalized Difference Vegetation Index(NDVI)series of Moderate Resolution Imaging Spectroradiometer(MODIS)based on its phenological characteristics.Next,cotton was identified based on the croplands from 2000 to 2020 by using the machine learning model.Finally,the performance was evaluated,and the spatiotemporal distribution characteristics of cotton planting areas were analyzed.The results showed that the proposed approach can achieve high accuracy at a fine spatial resolution.The performance evaluation indicated the applicability and suitability of the method,there is a good correlation between the extracted cotton areas and statistical data,and the cotton area of the study area showed an increasing trend.The cotton spatial distribution pattern developed from dispersion to agglomeration.The proposed approach and the derived 30-m cotton maps can provide a scientific reference for the optimization of agricultural management.展开更多
We report a comprehensive numerical study of super resolution (SR) structured illumination microscopy (SIM) utilizing the classic Heintzmann-Cremer SIM process and algorithm. In particular, we investigated the impact ...We report a comprehensive numerical study of super resolution (SR) structured illumination microscopy (SIM) utilizing the classic Heintzmann-Cremer SIM process and algorithm. In particular, we investigated the impact of the diffraction limit of the underlying imaging system on the optimal SIM grating frequency that can be used to obtain the highest SR enhancement with non-continuous spatial frequency support. Besides confirming the previous theoretical and experimental work that SR-SIM can achieve an enhancement close to 3 times the diffraction limit with grating pattern illuminations, we also observe and report a series of more subtle effects of SR-SIM with non-continuous spatial frequency support. Our simulations show that when the SIM grating frequency exceeds twice that of the diffraction limit, the higher SIM grating frequency can help achieve a higher SR enhancement for the underlying imaging systems whose diffraction limit is low, though this enhancement is obtained at the cost of losing resolution at some lower resolution targets. Our simulations also show that, for underlying imaging systems with high diffraction limits, however, SR-SIM grating frequencies above twice the diffraction limits tend to bring no significant extra enhancement. Furthermore, we observed that there exists a limit grating frequency above which the SR enhancement effect is lost, and the reconstructed images essentially have the same resolution as the one obtained directly from the underlying imaging system without using the SIM process.展开更多
文摘This study provides the first systematic evaluation of image resolution’s effect (50-300 PPI, pixels per inch) on UAV (unmanned aerial vehicle)-based digital close-range photogrammetry accuracy in civil engineering applications, such as infrastructure monitoring and heritage preservation. Using a high-resolution UAV with a 20 MP (MegaPixels) sensor, four images of a brick wall test field were captured and processed in Agisoft Metashape, with resolutions compared against Leica T2002 theodolite measurements (1.0 mm accuracy). Advanced statistical methods (ANOVA (analysis of variance), Tukey tests, Monte Carlo simulations) and ground control points validated the results. Accuracy improved from 25 mm at 50 PPI to 5 mm at 150 PPI (p < 0.01), plateauing at 4 mm beyond 200 PPI, while 150 PPI reduced processing time by 62% compared to 300 PPI. Unlike prior studies, this research uniquely isolates resolution effects in a controlled civil engineering context, offering a novel 150 PPI threshold that balances precision and efficiency. This threshold supports Saudi Vision 2030’s smart infrastructure goals for megaprojects like NEOM, providing a scalable framework for global applications. Future research should leverage deep learning to optimize resolutions in dynamic environments.
文摘A new way is proposed to evaluate the influence of atmospheric turbulence on image resolution of airborne and space-borne optical remote sensing system, which is called as arrival angle-method. Applying this method, some engineering examples are selected to analyze the turbulence influences on image resolution based on three different atmospheric turbulence models quantificationally, for the airborne remote sensing system, the resolution errors caused by the atmospheric turbulence are less than 1 cm, and for the space-borne remote sensing system, the errors are around 1 cm. The results are similar to that obtained by the previous Friedmethod. Compared with the Fried-method, the arrival angle-method is rather simple and can be easily used in engineering fields.
基金National Key R&D Program of China,Grant/Award Number:2022YFC3300704National Natural Science Foundation of China,Grant/Award Numbers:62171038,62088101,62006023。
文摘Due to hardware limitations,existing hyperspectral(HS)camera often suffer from low spatial/temporal resolution.Recently,it has been prevalent to super-resolve a low reso-lution(LR)HS image into a high resolution(HR)HS image with a HR RGB(or mul-tispectral)image guidance.Previous approaches for this guided super-resolution task often model the intrinsic characteristic of the desired HR HS image using hand-crafted priors.Recently,researchers pay more attention to deep learning methods with direct supervised or unsupervised learning,which exploit deep prior only from training dataset or testing data.In this article,an efficient convolutional neural network-based method is presented to progressively super-resolve HS image with RGB image guidance.Specif-ically,a progressive HS image super-resolution network is proposed,which progressively super-resolve the LR HS image with pixel shuffled HR RGB image guidance.Then,the super-resolution network is progressively trained with supervised pre-training and un-supervised adaption,where supervised pre-training learns the general prior on training data and unsupervised adaptation generalises the general prior to specific prior for variant testing scenes.The proposed method can effectively exploit prior from training dataset and testing HS and RGB images with spectral-spatial constraint.It has a good general-isation capability,especially for blind HS image super-resolution.Comprehensive experimental results show that the proposed deep progressive learning method out-performs the existing state-of-the-art methods for HS image super-resolution in non-blind and blind cases.
基金the TCL Science and Technology Innovation Fundthe Youth Science and Technology Talent Promotion Project of Jiangsu Association for Science and Technology,Grant/Award Number:JSTJ‐2023‐017+4 种基金Shenzhen Municipal Science and Technology Innovation Council,Grant/Award Number:JSGG20220831105002004National Natural Science Foundation of China,Grant/Award Number:62201468Postdoctoral Research Foundation of China,Grant/Award Number:2022M722599the Fundamental Research Funds for the Central Universities,Grant/Award Number:D5000210966the Guangdong Basic and Applied Basic Research Foundation,Grant/Award Number:2021A1515110079。
文摘Convolutional neural networks depend on deep network architectures to extract accurate information for image super‐resolution.However,obtained information of these con-volutional neural networks cannot completely express predicted high‐quality images for complex scenes.A dynamic network for image super‐resolution(DSRNet)is presented,which contains a residual enhancement block,wide enhancement block,feature refine-ment block and construction block.The residual enhancement block is composed of a residual enhanced architecture to facilitate hierarchical features for image super‐resolution.To enhance robustness of obtained super‐resolution model for complex scenes,a wide enhancement block achieves a dynamic architecture to learn more robust information to enhance applicability of an obtained super‐resolution model for varying scenes.To prevent interference of components in a wide enhancement block,a refine-ment block utilises a stacked architecture to accurately learn obtained features.Also,a residual learning operation is embedded in the refinement block to prevent long‐term dependency problem.Finally,a construction block is responsible for reconstructing high‐quality images.Designed heterogeneous architecture can not only facilitate richer structural information,but also be lightweight,which is suitable for mobile digital devices.Experimental results show that our method is more competitive in terms of performance,recovering time of image super‐resolution and complexity.The code of DSRNet can be obtained at https://github.com/hellloxiaotian/DSRNet.
基金supported by the National Natural Science Foundation of China[grant number 41801390]the National Key R&D Program of China[grant number 2018YFD1100405].
文摘In many cases,the Digital Surface Models(DSMs)and Digital Elevation Models(DEMs)are obtained with Light Detection and Ranging(LiDAR)or stereo matching.As an active method,LiDAR is very accurate but expensive,thus often limiting its use in small-scale acquisition.Stereo matching is suitable for large-scale acquisition of terrain information as the increase of satellite stereo sensors.However,underperformance of stereo matching easily occurs in textureless areas.Accordingly,this study proposed a Shading Aware DSM GEneration Method(SADGE)with high resolution multi-view satellite images.Considering the complementarity of stereo matching and Shape from Shading(SfS),SADGE combines the advantage of stereo matching and SfS technique.First,an improved Semi-Global Matching(SGM)technique is used to generate an initial surface expressed by a DSM;then,it is refined by optimizing the objective function which modeled the imaging process with the illumination,surface albedo,and normal object surface.Different from the existing shading-based DEM refinement or generation method,no information about the illumination or the viewing angle is needed while concave/convex ambiguity can be avoided as multi-view images are utilized.Experiments with ZiYuan-3 and GaoFen-7 images show that the proposed method can generate higher accuracy DSM(12.5-56.3%improvement)with sound overall shape and temporarily detailed surface compared with a software solution(SURE)for multi-view stereo.
基金supported by the National Natural Science Foundation of China(Nos.61174016,61201307,and 61371045)the Fundamental Research Funds for the Central Universities(No.2013132)
文摘Photoacoustic microscopy （PAM） is recognized as a powerful tool for various microcirculation system studies. To improve the spatial resolution for the PAM images, the requirements of the system will always be increased correspondingly. Without additional cost of the system, we address the problem of improving the resolution of PAM images by integrating a deconvolution model with a directional total variation regularization. Additionally, we present a primal-dual-based algorithm to solve the associated optimization problem efficiently. Results from both test images and some PAM images studies validate the effectiveness of the proposed method in enhancing the spatial resolution. We expect the proposed technique to be an alternative resolution enhancement tool for some important biomedical applications.
基金The National Key R&D Program of China(2021YFF0502900)National Natural Science Foundation of China(61835009,62127819,61620106016,62005171,61975127)+3 种基金Natural Science Foundation of Guangdong Province(2020A1515010679)Key Project of Guangdong Provincial Department of Education(2021ZDZX2013)Shenzhen Science and Technology R&D and Innovation Foundation(JCYJ20220531102807017)Shenzhen International Cooperation Research Project(GJHZ20190822095420249).
文摘Super-resolution optical imaging is crucial to the study of cellular processes.Current super-resolution fluorescence microscopy is restricted by the need of special fluorophores or sophisticated optical systems,or long acquisition and computational times.In this work,we present a deep-learning-based super-resolution technique of confocal microscopy.We devise a two-channel attention network(TCAN),which takes advantage of both spatial representations and frequency contents to learn a more precise mapping from low-resolution images to high-resolution ones.This scheme is robust against changes in the pixel size and the imaging setup,enabling the optimal model to generalize to different fluorescence microscopy modalities unseen in the training set.Our algorithm is validated on diverse biological structures and dual-color confocal images of actin-microtubules,improving the resolution from~230 nm to~110 nm.Last but not least,we demonstrate live-cell super-resolution imaging by revealing the detailed structures and dynamic instability of microtubules.
基金supported by the Natural Science Foundation of Fujian Province,China:[grant no grant number 2023J05183]the Education and Research Project for Youth Scholars of Education Department of Fujian Province,China:[grant no grant number JAT220206]the Scientific Research Foundation of Minnan Normal University:[grant no grant number KJ2022001].
文摘Individual tree detection and delineation(ITDD)is an important subject in forestry and urban forestry.This study represents the first research to propose the concept of crown resolution to comprehensively evaluate the co-effect of image resolution and crown size on deep learning.Six images with different resolutions were derived from a DJI Unmanned Aerial Vehicle(UAV),and 1344 manually delineated Chinese fir(Cunninghamia lanceolata(Lamb)Hook)tree crowns were used for six training and validation mask region-based convolutional neural network(Mask R-CNN)models,while additional 476 delineated tree crowns were reserved for testing.The overall detection accuracy,the influence of different crown sizes,and crown resolutions were calculated to evaluate model performance accuracy with different image resolutions for ITDD.Results show that the highest accuracy was achieved when the crown resolution was between 800 and 12800 pixels/tree.The accuracy of ITDD was impacted by crown resolution,and it was unable to effectively identify Chinese fir when the crown resolution was less than 25 pixels/tree or higher than 12800 pixels/tree.The study highlights crown resolution as a critical factor affecting ITDD and suggests selecting the appropriate resolution based on the target detected crown size.
基金The MKE(the Ministry of Knowledge Economy),Korea,under the ITRC(Information Technology Research Center)support program supervised by the NIPA(National IT Industry Promotion Agency) (NIPA-2012-H0301-12-2006)
文摘This research paper recommends the point spread function(PSF)forecasting technique based on the projection onto convex set(POCS)and regularization to acquire low resolution images.As the environment for the production of user created contents(UCC)videos(one of the contents on the Internet)becomes widespread,resolution reduction and image distortion occurs,failing to satisfy users who desire high quality images.Accordingly,this research neutralizes the coding artifact through POCS and regularization processes by:1)factoring the local characteristics of the image when it comes to the noise that results during the discrete cosine transform(DCT)and quantization process;and 2)removing the blocking and ring phenomena which are problems with the existing video compression.Moreover,this research forecasts the point spread function to obtain low resolution images using the above-mentioned methods.Thus,a method is suggested for minimizing the errors found among the forecasting interpolation pixels.Low-resolution image quality obtained through the experiment demonstrates that significant enhancement was made on the visual level compared to the original image.
文摘Road extraction plays an important role in many applications such as car navigation, but the manual extraction of roads is a laborious, tedious task. To speed the extraction of roads, an approach based on particle filtering to extract automatically roads from high resolution imagery is proposed. Particle filtering provides a statistical framework for propagating sample-based approximations of posterior distributions and has almost no restriction on the ingredients of the model. We integrate the similarity of grey value and the edge point distribution of roads into particle filtering to deal with complex scenes. To handle road appearance changes the tracking algorithm is allowed to update the road model during temporally stable image observations. A fully automatic initialization strategy is used. Experimental results show that the proposed approach is a promising and fully automatic method for extracting roads from images, even in the presence of occlusions.
基金National Natural Science Foundation of China(No.41871305)National Key Research and Development Program of China(No.2017YFC0602204)+2 种基金Fundamental Research Funds for the Central Universities,China University of Geosciences(Wuhan)(No.CUGQY1945)Open Fund of Key Laboratory of Geological Survey and Evaluation of Ministry of Education and the Fundamental Research Funds for the Central Universities(No.GLAB2019ZR02)Open Fund of Laboratory of Urban Land Resources Monitoring and Simulation,Ministry of Natural Resources,China(No.KF-2020-05-068)。
文摘The exploration of building detection plays an important role in urban planning,smart city and military.Aiming at the problem of high overlapping ratio of detection frames for dense building detection in high resolution remote sensing images,we present an effective YOLOv3 framework,corner regression-based YOLOv3(Correg-YOLOv3),to localize dense building accurately.This improved YOLOv3 algorithm establishes a vertex regression mechanism and an additional loss item about building vertex offsets relative to the center point of bounding box.By extending output dimensions,the trained model is able to output the rectangular bounding boxes and the building vertices meanwhile.Finally,we evaluate the performance of the Correg-YOLOv3 on our self-produced data set and provide a comparative analysis qualitatively and quantitatively.The experimental results achieve high performance in precision(96.45%),recall rate(95.75%),F1 score(96.10%)and average precision(98.05%),which were 2.73%,5.4%,4.1%and 4.73%higher than that of YOLOv3.Therefore,our proposed algorithm effectively tackles the problem of dense building detection in high resolution images.
基金the National Science Fund for Distinguished Young Scholars of China (No. 51625501)the Aeronautical Science Foundation of China (No. 201946051002)
文摘Small-object detection has long been a challenge.High-megapixel cameras are used to solve this problem in industries.However,current detectors are inefficient for high-resolution images.In this work,we propose a new module called Pre-Locate Net,which is a plug-and-play structure that can be combined with most popular detectors.We inspire the use of classification ideas to obtain candidate regions in images,greatly reducing the amount of calculation,and thus achieving rapid detection in high-resolution images.Pre-Locate Net mainly includes two parts,candidate region classification and behavior classification.Candidate region classification is used to obtain a candidate region,and behavior classification is used to estimate the scale of an object.Different follow-up processing is adopted according to different scales to balance the variance of the network input.Different from the popular candidate region generation method,we abandon the idea of regression of a bounding box and adopt the concept of classification,so as to realize the prediction of a candidate region in the shallow network.We build a high-resolution dataset of aircraft and landing gears covering complex scenes to verify the effectiveness of our method.Compared to state-of-the-art detectors(e.g.,Guided Anchoring,Libra-RCNN,and FASF),our method achieves the best m AP of 94.5 on 1920×1080 images at 16.7 FPS.
文摘Obtaining clear images of underwater scenes with descriptive details is an arduous task.Conventional imaging techniques fail to provide clear cut features and attributes that ultimately result in object recognition errors.Consequently,a need for a system that produces clear images for underwater image study has been necessitated.To overcome problems in resolution and to make better use of the Super-Resolution(SR)method,this paper introduces a novel method that has been derived from the Alpha Generative Adversarial Network(AlphaGAN)model,named Alpha Super Resolution Generative Adversarial Network(AlphaSRGAN).The model put forth in this paper helps in enhancing the quality of underwater imagery and yields images with greater resolution and more concise details.Images undergo pre-processing before they are fed into a generator network that optimizes and reforms the structure of the network while enhancing the stability of the network that acts as the generator.After the images are processed by the generator network,they are passed through an adversarial method for training models.The dataset used in this paper to learn Single Image Super Resolution(SISR)is the USR 248 dataset.Training supervision is performed by an unprejudiced function that simultaneously scrutinizes and improves the image quality.Appraisal of images is done with reference to factors like local style information,global content and color.The dataset USR 248 which has a huge collection of images has been used for the study is composed of three collections of images—high(640×480)and low(80×60,160×120,and 320×240).Paired instances of different sizes—2×,4×and 8×—are also present in the dataset.Parameters like Mean Opinion Score(MOS),Peak Signal-to-Noise Ratio(PSNR),Structural Similarity(SSIM)and Underwater Image Quality Measure(UIQM)scores have been compared to validate the improved efficiency of our model when compared to existing works.
基金supported by the National Natural Science Foundation of China(31670552)the PAPD(Priority Academic Program Development)of Jiangsu provincial universities and the China Postdoctoral Science Foundation funded projectthis work was performed while the corresponding author acted as an awardee of the 2017 Qinglan Project sponsored by Jiangsu Province。
文摘Accurate information on the location and magnitude of vegetation change in scenic areas can guide the configuration of tourism facilities and the formulation of vegetation protection measures.High spatial resolution remote sensing images can be used to detect subtle vegetation changes.The major objective of this study was to map and quantify forest vegetation changes in a national scenic location,the Purple Mountains of Nanjing,China,using multi-temporal cross-sensor high spatial resolution satellite images to identify the main drivers of the vegetation changes and provide a reference for sustainable management.We used Quickbird images acquired in 2004,IKONOS images acquired in 2009,and WorldView2 images acquired in 2015.Four pixel-based direct change detection methods including the normalized difference vegetation index difference method,multi-index integrated change analysis(MIICA),principal component analysis,and spectral gradient difference analysis were compared in terms of their change detection performances.Subsequently,the best pixel-based detection method in conjunction with object-oriented image analysis was used to extract subtle forest vegetation changes.An accuracy assessment using the stratified random sampling points was conducted to evaluate the performance of the change detection results.The results showed that the MIICA method was the best pixel-based change detection method.And the object-oriented MIICA with an overall accuracy of 0.907 and a kappa coefficient of 0.846 was superior to the pixel-based MIICA.From 2004 to 2009,areas of vegetation gain mainly occurred around the periphery of the study area,while areas of vegetation loss were observed in the interior and along the boundary of the study area due to construction activities,which contributed to 79%of the total area of vegetation loss.During 2009–2015,the greening initiatives around the construction areas increased the forest vegetation coverage,accounting for 84%of the total area of vegetation gain.In spite of this,vegetation loss occurred in the interior of the Purple Mountains due to infrastructure development that caused conversion from vegetation to impervious areas.We recommend that:(1)a local multi-agency team inspect and assess law enforcement regarding natural resource utilization;and(2)strengthen environmental awareness education.
基金Supported by the Key Science and Technology Projects of Guizhou Province,China[(2007)3017,(2008)3022]Major Special Project of Guizhou Province,China(2006-6006-2)
文摘[ Objective] The study aimed to improve methods of monitoring Karst Rocky Desertification （KRD） control projects and increase the working efficiency. [Method] Based on remote sensing images with medium and high spatial resolution, KRD control projects in Disi River basin in Puan County were monitored, that is, information of the project construction in the study area was extracted using supervised classification and hu- man-computer interactive interpretation, and the monitoring results were testified with the aid of GPS. [Result] It was feasible to monitor KRD con- trol projects in Disi River basin based on remote sensing images with medium and high resolution, and the monitoring accuracy was satisfactory, reaching above 80% or 90%, so the method is worthy of popularizing. [ Conclusion] Remote sensing images with medium and high resolution can be used to monitor other KRD control Droiects.
基金Financial support from Beijing Institute of Technology(No. 2011CX01008 and others)partially from NSFC(No.20972016)Chinese Scholarship Council(M.Sohail)
文摘Non-superimposable mirror image crystals of both enantiomers（S/R） of cyclicγ-alkenyl alcohol（2） have been recognized and remarkably identified by the naked eye.More interestingly,both crystals are an outcome of most astonishingly H-bond and intermolecularσ/π-πinteractions.They accounted for the relatively rare and less predictable spontaneous resolution with optical purity 〉99%ee from the racemic mixture.The chiral discrimination mechanism of this spontaneous resolution has also been proposed.
文摘Calman filtering method based on wavelet transform has been successfully applied to signal denoising. According to the different application methods and the realization forms of Calman filter, combined with the structural analysis of wavelet decomposition, we present kinds of multi-scale filtering methods into the category of the three. The simulation results show that the multi-scale Calman filtering method based on system layer has better performance. Synthetic aperture radar （SAR） images have rich texture information, which can reflect the spatial structure of objects. The texture feature is widely used in SAR image classification and SAR image segmentation. Affected by imaging factors, the direct use of texture features extracted from SAR images is not good enough. In order to avoid the traditional method of filtering followed the texture feature extraction caused by the loss of texture and edge information, this paper presents a texture feature extraction of SAR image, then using Robust PCA method, finally using texture feature clustering method K-means test after treatment with RPCA expression.
文摘Global motion estimation (GME) algorithms are widely applied to computer vision and video processing. In the previous works, the image resolutions are usually low for the real-time requirement (e.g. video stabilization). However, in some mobile devices applications (e.g. image sequence panoramic stitching), the high resolution is necessary to obtain satisfactory quality of panoramic image. However, the computational cost will become too expensive to be suitable for the low power consumption requirement of mobile device. The full search algorithm can obtain the global minimum with extremely computational cost, while the typical fast algorithms may suffer from the local minimum problem. This paper proposed a fast algorithm to deal with 2560 × 1920 high-resolution (HR) image sequences. The proposed method estimates the motion vector by a two-level coarse-to-fine scheme which only exploits sparse reference blocks (25 blocks in this paper) in each level to determine the global motion vector, thus the computational costs are significantly decreased. In order to increase the effective search range and robustness, the predictive motion vector (PMV) technique is used in this work. By the comparisons of computational complexity, the proposed algorithm costs less addition operations than the typical Three-Step Search algorithm (TSS) for estimating the global motion of the HR images without the local minimum problem. The quantitative evaluations show that our method is comparable to the full search algorithm (FSA) which is considered to be the golden baseline.
基金supported by the National Natural Science Foundation of China[grant number 42101342]Third Comprehensive Scientific Expedition to Xinjiang[grant number 2021XJKK1403].
文摘Cotton is one of the most significant cash crops in the world,and it is also the main source of natural fiber for textiles.It is crucial for cotton management to identify the spatiotemporal distribution of cotton planting areas timely and accurately on a fine scale.However,previous research studies have predominantly concentrated on specific years using remote sensing data.Challenges still exist in the extraction of cotton areas for long time series with high accuracy.To address this issue,a novel cotton sample selection method was proposed and the machine learning method is employed to effectively identify the long time series cotton planting areas at a 30-m resolution scale.Bortala and Shuanghe in Xinjiang,China,were selected as the study cases to demonstrate the approach.Specifically,the cropland in this study was extracted by using an object-oriented classification method with Landsat images and the results were optimized as the vectorized boundary of croplands.Then,the cotton samples were selected using the Normalized Difference Vegetation Index(NDVI)series of Moderate Resolution Imaging Spectroradiometer(MODIS)based on its phenological characteristics.Next,cotton was identified based on the croplands from 2000 to 2020 by using the machine learning model.Finally,the performance was evaluated,and the spatiotemporal distribution characteristics of cotton planting areas were analyzed.The results showed that the proposed approach can achieve high accuracy at a fine spatial resolution.The performance evaluation indicated the applicability and suitability of the method,there is a good correlation between the extracted cotton areas and statistical data,and the cotton area of the study area showed an increasing trend.The cotton spatial distribution pattern developed from dispersion to agglomeration.The proposed approach and the derived 30-m cotton maps can provide a scientific reference for the optimization of agricultural management.
文摘We report a comprehensive numerical study of super resolution (SR) structured illumination microscopy (SIM) utilizing the classic Heintzmann-Cremer SIM process and algorithm. In particular, we investigated the impact of the diffraction limit of the underlying imaging system on the optimal SIM grating frequency that can be used to obtain the highest SR enhancement with non-continuous spatial frequency support. Besides confirming the previous theoretical and experimental work that SR-SIM can achieve an enhancement close to 3 times the diffraction limit with grating pattern illuminations, we also observe and report a series of more subtle effects of SR-SIM with non-continuous spatial frequency support. Our simulations show that when the SIM grating frequency exceeds twice that of the diffraction limit, the higher SIM grating frequency can help achieve a higher SR enhancement for the underlying imaging systems whose diffraction limit is low, though this enhancement is obtained at the cost of losing resolution at some lower resolution targets. Our simulations also show that, for underlying imaging systems with high diffraction limits, however, SR-SIM grating frequencies above twice the diffraction limits tend to bring no significant extra enhancement. Furthermore, we observed that there exists a limit grating frequency above which the SR enhancement effect is lost, and the reconstructed images essentially have the same resolution as the one obtained directly from the underlying imaging system without using the SIM process.
