Osteoporosis is a major cause of bone fracture and can be characterised by both mass loss and microstructure deterioration of the bone.The modern way of osteoporosis assessment is through the measurement of bone miner...Osteoporosis is a major cause of bone fracture and can be characterised by both mass loss and microstructure deterioration of the bone.The modern way of osteoporosis assessment is through the measurement of bone mineral density,which is not able to unveil the pathological condition from the mesoscale aspect.To obtain mesoscale information from computed tomography(CT),the super-resolution(SR)approach for volumetric imaging data is required.A deep learning model AESR3D is proposed to recover high-resolution(HR)Micro-CT from low-resolution Micro-CT and implement an unsupervised segmentation for better trabecular observation and measurement.A new regularisation overcomplete autoencoder framework for the SR task is proposed and theoretically analysed.The best performance is achieved on structural similarity measure of trabecular CT SR task compared with the state-of-the-art models in both natural and medical image SR tasks.The HR and SR images show a high correlation(r=0.996,intraclass correlation coefficients=0.917)on trabecular bone morphological indicators.The results also prove the effectiveness of our regularisation framework when training a large capacity model.展开更多
Recently,satellite imagery has been widely applied in many areas.However,due to the limitations of hardware equipment and transmission bandwidth,the images received on the ground have low resolution and weak texture.I...Recently,satellite imagery has been widely applied in many areas.However,due to the limitations of hardware equipment and transmission bandwidth,the images received on the ground have low resolution and weak texture.In addition,since ground terminals have various resolutions and real-time playing requirements,it is essential to achieve arbitrary scale super-resolution(SR)of satellite images.In this paper,we propose an arbitrary scale SR network for satellite image reconstruction.First,we propose an arbitrary upscale module for satellite imagery that can map low-resolution satellite image features to arbitrary scale enlarged SR outputs.Second,we design an edge reinforcement module to enhance the highfrequency details in satellite images through a twobranch network.Finally,extensive upsample experiments on WHU-RS19 and NWPU-RESISC45 datasets and subsequent image segmentation experiments both show the superiority of our method over the counterparts.展开更多
The smart grid is an evolving critical infrastructure,which combines renewable energy and the most advanced information and communication technologies to provide more economic and secure power supply services.To cope ...The smart grid is an evolving critical infrastructure,which combines renewable energy and the most advanced information and communication technologies to provide more economic and secure power supply services.To cope with the intermittency of ever-increasing renewable energy and ensure the security of the smart grid,state estimation,which serves as a basic tool for understanding the true states of a smart grid,should be performed with high frequency.More complete system state data are needed to support high-frequency state estimation.The data completeness problem for smart grid state estimation is therefore studied in this paper.The problem of improving data completeness by recovering highfrequency data from low-frequency data is formulated as a super resolution perception(SRP)problem in this paper.A novel machine-learning-based SRP approach is thereafter proposed.The proposed method,namely the Super Resolution Perception Net for State Estimation(SRPNSE),consists of three steps:feature extraction,information completion,and data reconstruction.Case studies have demonstrated the effectiveness and value of the proposed SRPNSE approach in recovering high-frequency data from low-frequency data for the state estimation.展开更多
Low-resolution face images can be found in many practical applications. For example, faces captured from surveillance videos are typically in small sizes. Existing face recognition deep networks, trained on high-resol...Low-resolution face images can be found in many practical applications. For example, faces captured from surveillance videos are typically in small sizes. Existing face recognition deep networks, trained on high-resolution images, perform poorly in recognizing low-resolution faces. In this work, an improved multi-branch network is proposed by combining ResNet and feature super-resolution modules. ResNet is for recognizing high-resolution facial images and extracting features from both high-and low-resolution images.Feature super-resolution modules are inserted before the classifier of ResNet for low-resolution facial images. They are used to increase feature resolution. The proposed method is effective and simple. Experimental results show that the recognition accuracy for high-resolution face images is high, and the recognition accuracy for low-resolution face images is improved.展开更多
Obtaining clear images of underwater scenes with descriptive details is an arduous task.Conventional imaging techniques fail to provide clear cut features and attributes that ultimately result in object recognition er...Obtaining clear images of underwater scenes with descriptive details is an arduous task.Conventional imaging techniques fail to provide clear cut features and attributes that ultimately result in object recognition errors.Consequently,a need for a system that produces clear images for underwater image study has been necessitated.To overcome problems in resolution and to make better use of the Super-Resolution(SR)method,this paper introduces a novel method that has been derived from the Alpha Generative Adversarial Network(AlphaGAN)model,named Alpha Super Resolution Generative Adversarial Network(AlphaSRGAN).The model put forth in this paper helps in enhancing the quality of underwater imagery and yields images with greater resolution and more concise details.Images undergo pre-processing before they are fed into a generator network that optimizes and reforms the structure of the network while enhancing the stability of the network that acts as the generator.After the images are processed by the generator network,they are passed through an adversarial method for training models.The dataset used in this paper to learn Single Image Super Resolution(SISR)is the USR 248 dataset.Training supervision is performed by an unprejudiced function that simultaneously scrutinizes and improves the image quality.Appraisal of images is done with reference to factors like local style information,global content and color.The dataset USR 248 which has a huge collection of images has been used for the study is composed of three collections of images—high(640×480)and low(80×60,160×120,and 320×240).Paired instances of different sizes—2×,4×and 8×—are also present in the dataset.Parameters like Mean Opinion Score(MOS),Peak Signal-to-Noise Ratio(PSNR),Structural Similarity(SSIM)and Underwater Image Quality Measure(UIQM)scores have been compared to validate the improved efficiency of our model when compared to existing works.展开更多
Construction of high resolution images from low resolution sequences is often im- portant in surveillance applications. In this letter, an affine based multi-scale block-matching image registration algorithm is first ...Construction of high resolution images from low resolution sequences is often im- portant in surveillance applications. In this letter, an affine based multi-scale block-matching image registration algorithm is first proposed. The images to be registered are divided into overlapped blocks of different size according to its motions. The Least Square (LS) image reg- istration algorithm is extended to match the blocks. Then an object based Super Resolution (SR) scheme is designed, the Maximum A Priori (MAP) super resolution algorithm is extended to enhance the resolution of the interest objects. Experimental results show that the proposed multi-scale registration method provides more accurate registration between frames. Further more, the object based super resolution scheme shows an enhanced performance compared with the traditional MAP method.展开更多
In this paper,an iterative regularized super resolution (SR) algorithm considering non-Gaussian noise is proposed.Based on the assumption of a generalized Gaussian distribution for the contaminating noise,an lp norm i...In this paper,an iterative regularized super resolution (SR) algorithm considering non-Gaussian noise is proposed.Based on the assumption of a generalized Gaussian distribution for the contaminating noise,an lp norm is adopted to measure the data fidelity term in the cost function.In the meantime,a regularization functional defined in terms of the desired high resolution (HR) image is employed,which allows for the simultaneous determination of its value and the partly reconstructed image at each iteration step.The convergence is thoroughly studied.Simulation results show the effectiveness of the proposed algorithm as well as its superiority to conventional SR methods.展开更多
With the vigorous development of mobile networks,the number of devices at the network edge is growing rapidly and the massive amount of data generated by the devices brings a huge challenge of response latency and com...With the vigorous development of mobile networks,the number of devices at the network edge is growing rapidly and the massive amount of data generated by the devices brings a huge challenge of response latency and communication burden.Existing resource monitoring systems are widely deployed in cloud data centers,but it is difficult for traditional resource monitoring solutions to handle the massive data generated by thousands of edge devices.To address these challenges,we propose a super resolution sensing(SRS)method for distributed resource monitoring,which can be used to recover reliable and accurate high‑frequency data from low‑frequency sampled resource monitoring data.Experiments based on the proposed SRS model are also conducted and the experimental results show that it can effectively reduce the errors generated when recovering low‑frequency monitoring data to high‑frequency data,and verify the effectiveness and practical value of applying SRS method for resource monitoring on edge clouds.展开更多
This paper presents a threshold-free maximum a posteriori (MAP) super resolution (SR) algorithm to reconstruct high resolution (HR) images with sharp edges. The joint distribution of directional edge images is modeled...This paper presents a threshold-free maximum a posteriori (MAP) super resolution (SR) algorithm to reconstruct high resolution (HR) images with sharp edges. The joint distribution of directional edge images is modeled as a multidimensional Lorentzian (MDL) function and regarded as a new image prior. This model makes full use of gradient information to restrict the solution space and yields an edge-preserving SR algorithm. The Lorentzian parameters in the cost function are replaced with a tunable variable, and graduated nonconvexity (GNC) optimization is used to guarantee that the proposed multidimensional Lorentzian SR (MDLSR) algorithm converges to the global minimum. Simulation results show the effectiveness of the MDLSR algorithm as well as its superiority over conventional SR methods.展开更多
As an ill-posed problem, multiframe blind super resolution imaging recovers a high resolution image from a group of low resolution images with some degradations when the information of blur kernel is limited. Note tha...As an ill-posed problem, multiframe blind super resolution imaging recovers a high resolution image from a group of low resolution images with some degradations when the information of blur kernel is limited. Note that the quality of the recovered image is influenced more by the accuracy of blur estimation than an advanced regularization. We study the traditional model of the multiframe super resolution and modify it for blind deblurring. Based on the analysis, we proposed two algorithms. The first one is based on the total variation blind deconvolution algorithm and formulated as a functional for optimization with the regularization of blur. Based on the alternating minimization and the gradient descent algorithm, the high resolution image and the unknown blur kernel are estimated iteratively. By using the median shift and add operator, the second algorithm is more robust to the outlier influence. The MSAA initialization simplifies the interpolation process to reconstruct the blurred high resolution image for blind deblurring and improves the accuracy of blind super resolution imaging. The experimental results demonstrate the superiority and accuracy of our novel algorithms.展开更多
Single image super resolution(SISR)techniques produce images of high resolution(HR)as output from input images of low resolution(LR).Motivated by the effectiveness of deep learning methods,we provide a framework based...Single image super resolution(SISR)techniques produce images of high resolution(HR)as output from input images of low resolution(LR).Motivated by the effectiveness of deep learning methods,we provide a framework based on deep learning to achieve super resolution(SR)by utilizing deep singular-residual neural network(DSRNN)in training phase.Residuals are obtained from the difference between HR and LR images to generate LR-residual example pairs.Singular value decomposition(SVD)is applied to each LR-residual image pair to decompose into subbands of low and high frequency components.Later,DSRNN is trained on these subbands through input and output channels by optimizing the weights and biases of the network.With fewer layers in DSRNN,the influence of exploding gradients is reduced.This speeds up the learning process and also improves accuracy by using skip connections.The trained DSRNN parameters yield residuals to recover the HR subbands in the testing phase.Experimental analysis shows that the proposed method results in superior performance to existingmethods in terms of subjective quality.Extensive testing results on popular benchmark datasets such as set5,set14,and urban100 for a scaling factor of 4 show the effectiveness of the proposed method across different qualitative evaluation metrics.展开更多
Existing methods of measurement MTF for discrete imaging system are analysed. A slit target is frequently used to measure the MTF for an imaging system. Usually there are four methods to measure the MTF for a discrete...Existing methods of measurement MTF for discrete imaging system are analysed. A slit target is frequently used to measure the MTF for an imaging system. Usually there are four methods to measure the MTF for a discrete imaging system by using a slit. These methods have something imperfect respectively. But for the discrete imaging systems of under sampling it is difficult to reproduce this type of target properly since frequencies above Nyquist are folded into those below Nyquist, resulting in aliasing effect. To tackle the aliasing problem, a super resolution technique is introduced into our measurement, which gives MTF values both above and below Nyquist more accurately.展开更多
High-resolution video transmission requires a substantial amount of bandwidth.In this paper,we present a novel video processing methodology that innovatively integrates region of interest(ROI)identification and super-...High-resolution video transmission requires a substantial amount of bandwidth.In this paper,we present a novel video processing methodology that innovatively integrates region of interest(ROI)identification and super-resolution enhancement.Our method commences with the accurate detection of ROIs within video sequences,followed by the application of advanced super-resolution techniques to these areas,thereby preserving visual quality while economizing on data transmission.To validate and benchmark our approach,we have curated a new gaming dataset tailored to evaluate the effectiveness of ROI-based super-resolution in practical applications.The proposed model architecture leverages the transformer network framework,guided by a carefully designed multi-task loss function,which facilitates concurrent learning and execution of both ROI identification and resolution enhancement tasks.This unified deep learning model exhibits remarkable performance in achieving super-resolution on our custom dataset.The implications of this research extend to optimizing low-bitrate video streaming scenarios.By selectively enhancing the resolution of critical regions in videos,our solution enables high-quality video delivery under constrained bandwidth conditions.Empirical results demonstrate a 15%reduction in transmission bandwidth compared to traditional super-resolution based compression methods,without any perceivable decline in visual quality.This work thus contributes to the advancement of video compression and enhancement technologies,offering an effective strategy for improving digital media delivery efficiency and user experience,especially in bandwidth-limited environments.The innovative integration of ROI identification and super-resolution presents promising avenues for future research and development in adaptive and intelligent video communication systems.展开更多
Construction of high resolution images from low resolution sequences having rigid or semi-rigid ob-jects with unified motions is often important in surveillance and other applications.In this paper a novelobject-based...Construction of high resolution images from low resolution sequences having rigid or semi-rigid ob-jects with unified motions is often important in surveillance and other applications.In this paper a novelobject-based super resolution reconstruction scheme was proposed,in which a six-parameter affine model-based object tracking and registration method was first used to segment and match objects among a se-quence of low resolution frames.The motion model was then further extended to the traditional maximuma posterior(MAP)super resolution algorithm.The proposed object tracking and registration method wasevaluated by both simulated and real acquired sequences.The results have demonstrated the high accura-cy of the proposed object based method and the enhanced reconstruction performance of the extended ap-proach.展开更多
We developed an imaging technique combining two-photon computed super-resolution microscopy and suction-based stabilization to achieve the resolution of the single-cell level and organelles in vivo.To accomplish this,...We developed an imaging technique combining two-photon computed super-resolution microscopy and suction-based stabilization to achieve the resolution of the single-cell level and organelles in vivo.To accomplish this,a conventional two-photon microscope was equipped with a 3D-printed holders,which stabilize the tissue surface within the focal plane of immersion objectives.Further computational image stabilization and noise reduction were applied,followed by superresolution radial fluctuations(SRRF)analysis,doubling image resolution,and enhancing signal-to-noise ratios for in vivo subcellular process investigation.Stabilization of<1μm was obtained by suction,and<25 nm were achieved by subsequent algorithmic image stabilization.A Mito-Dendra2 mouse model,expressing green fluorescent protein(GFP)in mitochondria,demonstrated the potential of long-term intravital subcellular imaging.In vivo mitochondrial fission and fusion,mitochondrial status migration,and the effects of alcohol consumption(modeled as an alcoholic liver disease)and berberine treatment on hepatocyte mitochondrial dynamics are directly observed intravitally.Suction-based stabilization in two-photon intravital imaging,coupled with computational super-resolution holds promise for advancing in vivo subcellular imaging studies.展开更多
This paper proposes a two-stage point cloud super resolution framework that combines local interpolation and deep neural network based readjustment. For the first stage, the authors apply a local interpolation method ...This paper proposes a two-stage point cloud super resolution framework that combines local interpolation and deep neural network based readjustment. For the first stage, the authors apply a local interpolation method to increase the density and uniformity of the target point cloud. For the second stage, the authors employ an outer-product neural network to readjust the position of points that are inserted at the first stage. Comparison examples are given to demonstrate that the proposed framework achieves a better accuracy than existing state-of-art approaches, such as PU-Net, Point Net and DGCNN(Source code is available at https://github.com/qwerty1319/PC-SR).展开更多
Fluorescence polarization is related to the dipole orientation of chromophores,making fuores-cence polarization microscopy possible to_reveal structures and functions of tagged cellularorganelles and biological macrom...Fluorescence polarization is related to the dipole orientation of chromophores,making fuores-cence polarization microscopy possible to_reveal structures and functions of tagged cellularorganelles and biological macromolecules.Several recent super resolution techniques have beenapplied to fluorescence polarization microscopy,achieving dipole measurement at nanoscale.In this review,we summarize both difraction limited and super resolution fluorescence polari-zation microscopy techniques,as well as their applications in biological imaging.展开更多
Spontaneously blinking probe, which switches between dark and bright state without UV or external additives, is extremely attractive in super resolution imaging of live cells. Herein, a clickable rhodamine spirolactam...Spontaneously blinking probe, which switches between dark and bright state without UV or external additives, is extremely attractive in super resolution imaging of live cells. Herein, a clickable rhodamine spirolactam probe, Atto565-Tet, is rationally constructed for spontaneously blinking after biorthogonal labelling and successfully applied to super resolution imaging of mitochondria and lysosomes.展开更多
The images captured by different observation station have different resolutions.The Helioseismic and Magnetic Imager(HMI:a part of the NASA Solar Dynamics Observatory SDO)has low-precision but wide coverage.And the Go...The images captured by different observation station have different resolutions.The Helioseismic and Magnetic Imager(HMI:a part of the NASA Solar Dynamics Observatory SDO)has low-precision but wide coverage.And the Goode Solar Telescope(GST,formerly known as the New Solar Telescope)at Big Bear Solar Observatory(BBSO)solar images has high precision but small coverage.The super-resolution can make the captured images become clearer,so it is wildly used in solar image processing.The traditional super-resolution methods,such as interpolation,often use single image’s feature to improve the image’s quality.The methods based on deep learning-based super-resolution image reconstruction algorithms have better quality,but small-scale features often become ambiguous.To solve this problem,a transitional amplification network structure is proposed.The network can use the two types images relationship to make the images clear.By adding a transition image with almost no difference between the source image and the target image,the transitional amplification training procedure includes three parts:transition image acquisition,transition network training with source images and transition images,and amplification network training with transition images and target images.In addition,the traditional evaluation indicators based on structural similarity(SSIM)and peak signal-to-noise ratio(PSNR)calculate the difference in pixel values and perform poorly in cross-type image reconstruction.The method based on feature matching can effectively evaluate the similarity and clarity of features.The experimental results show that the quality index of the reconstructed image is consistent with the visual effect.展开更多
Compared with other methods, the chirp scaling (CS) algorithm is a novel one for compensating the range migration without any interpolation in SAR imaging. However, its resolution ability can't exceed that of Four...Compared with other methods, the chirp scaling (CS) algorithm is a novel one for compensating the range migration without any interpolation in SAR imaging. However, its resolution ability can't exceed that of Fourier transformation. To realize the super-resolution ability in the azimuth direction a chirp scaling Burg (CSB) algorithm is proposed in this paper, which can still reserve the advantage of avoiding any interpolation in the process of the two-dimensional space-variant correlation in the CS algorithm.展开更多
基金Beijing Natural Science Foundation-Haidian original Innovation Joint Foundation,Grant/Award Number:L192016Joint Funds of the National Natural Science Foundation of China,Grant/Award Number:U21A20489+3 种基金National Natural Science Foundation of China,Grant/Award Number:62003330Shenzhen Fundamental Research Funds,Grant/Award Numbers:JCYJ20220818101608019,JCYJ20190807170407391,JCYJ20180507182415428Natural Science Foundation of Guangdong Province,Grant/Award Number:2019A1515011699Guangdong-Hong Kong-Macao Joint Laboratory of Human-Machine Intelligence-Synergy Systems,Shenzhen Institute of Advanced Technology。
文摘Osteoporosis is a major cause of bone fracture and can be characterised by both mass loss and microstructure deterioration of the bone.The modern way of osteoporosis assessment is through the measurement of bone mineral density,which is not able to unveil the pathological condition from the mesoscale aspect.To obtain mesoscale information from computed tomography(CT),the super-resolution(SR)approach for volumetric imaging data is required.A deep learning model AESR3D is proposed to recover high-resolution(HR)Micro-CT from low-resolution Micro-CT and implement an unsupervised segmentation for better trabecular observation and measurement.A new regularisation overcomplete autoencoder framework for the SR task is proposed and theoretically analysed.The best performance is achieved on structural similarity measure of trabecular CT SR task compared with the state-of-the-art models in both natural and medical image SR tasks.The HR and SR images show a high correlation(r=0.996,intraclass correlation coefficients=0.917)on trabecular bone morphological indicators.The results also prove the effectiveness of our regularisation framework when training a large capacity model.
基金supported in part by the National Natural Science Foundation of China(NSFC)under Grant 91738302,Grant 62102423,Grant 61671332,and Grant U1736206in part by the Open Research Fund of State Key Laboratory of Information Engineering in Surveying,Mapping and Remote Sensing,Wuhan University under Grant 17E03.
文摘Recently,satellite imagery has been widely applied in many areas.However,due to the limitations of hardware equipment and transmission bandwidth,the images received on the ground have low resolution and weak texture.In addition,since ground terminals have various resolutions and real-time playing requirements,it is essential to achieve arbitrary scale super-resolution(SR)of satellite images.In this paper,we propose an arbitrary scale SR network for satellite image reconstruction.First,we propose an arbitrary upscale module for satellite imagery that can map low-resolution satellite image features to arbitrary scale enlarged SR outputs.Second,we design an edge reinforcement module to enhance the highfrequency details in satellite images through a twobranch network.Finally,extensive upsample experiments on WHU-RS19 and NWPU-RESISC45 datasets and subsequent image segmentation experiments both show the superiority of our method over the counterparts.
基金the Training Program of the Major Research Plan of the National Natural Science Foundation of China(91746118)the Shenzhen Municipal Science and Technology Innovation Committee Basic Research project(JCYJ20170410172224515)。
文摘The smart grid is an evolving critical infrastructure,which combines renewable energy and the most advanced information and communication technologies to provide more economic and secure power supply services.To cope with the intermittency of ever-increasing renewable energy and ensure the security of the smart grid,state estimation,which serves as a basic tool for understanding the true states of a smart grid,should be performed with high frequency.More complete system state data are needed to support high-frequency state estimation.The data completeness problem for smart grid state estimation is therefore studied in this paper.The problem of improving data completeness by recovering highfrequency data from low-frequency data is formulated as a super resolution perception(SRP)problem in this paper.A novel machine-learning-based SRP approach is thereafter proposed.The proposed method,namely the Super Resolution Perception Net for State Estimation(SRPNSE),consists of three steps:feature extraction,information completion,and data reconstruction.Case studies have demonstrated the effectiveness and value of the proposed SRPNSE approach in recovering high-frequency data from low-frequency data for the state estimation.
文摘Low-resolution face images can be found in many practical applications. For example, faces captured from surveillance videos are typically in small sizes. Existing face recognition deep networks, trained on high-resolution images, perform poorly in recognizing low-resolution faces. In this work, an improved multi-branch network is proposed by combining ResNet and feature super-resolution modules. ResNet is for recognizing high-resolution facial images and extracting features from both high-and low-resolution images.Feature super-resolution modules are inserted before the classifier of ResNet for low-resolution facial images. They are used to increase feature resolution. The proposed method is effective and simple. Experimental results show that the recognition accuracy for high-resolution face images is high, and the recognition accuracy for low-resolution face images is improved.
文摘Obtaining clear images of underwater scenes with descriptive details is an arduous task.Conventional imaging techniques fail to provide clear cut features and attributes that ultimately result in object recognition errors.Consequently,a need for a system that produces clear images for underwater image study has been necessitated.To overcome problems in resolution and to make better use of the Super-Resolution(SR)method,this paper introduces a novel method that has been derived from the Alpha Generative Adversarial Network(AlphaGAN)model,named Alpha Super Resolution Generative Adversarial Network(AlphaSRGAN).The model put forth in this paper helps in enhancing the quality of underwater imagery and yields images with greater resolution and more concise details.Images undergo pre-processing before they are fed into a generator network that optimizes and reforms the structure of the network while enhancing the stability of the network that acts as the generator.After the images are processed by the generator network,they are passed through an adversarial method for training models.The dataset used in this paper to learn Single Image Super Resolution(SISR)is the USR 248 dataset.Training supervision is performed by an unprejudiced function that simultaneously scrutinizes and improves the image quality.Appraisal of images is done with reference to factors like local style information,global content and color.The dataset USR 248 which has a huge collection of images has been used for the study is composed of three collections of images—high(640×480)and low(80×60,160×120,and 320×240).Paired instances of different sizes—2×,4×and 8×—are also present in the dataset.Parameters like Mean Opinion Score(MOS),Peak Signal-to-Noise Ratio(PSNR),Structural Similarity(SSIM)and Underwater Image Quality Measure(UIQM)scores have been compared to validate the improved efficiency of our model when compared to existing works.
基金Supported by the National Natural Science Founda-tion of China (No.60472036)the Beijing Natural Science Foundation (No.4052007)the Beijing Novel Program (No.2005B08).
文摘Construction of high resolution images from low resolution sequences is often im- portant in surveillance applications. In this letter, an affine based multi-scale block-matching image registration algorithm is first proposed. The images to be registered are divided into overlapped blocks of different size according to its motions. The Least Square (LS) image reg- istration algorithm is extended to match the blocks. Then an object based Super Resolution (SR) scheme is designed, the Maximum A Priori (MAP) super resolution algorithm is extended to enhance the resolution of the interest objects. Experimental results show that the proposed multi-scale registration method provides more accurate registration between frames. Further more, the object based super resolution scheme shows an enhanced performance compared with the traditional MAP method.
基金National Natural Science Foundations of China(No.60705012,No.60802025)
文摘In this paper,an iterative regularized super resolution (SR) algorithm considering non-Gaussian noise is proposed.Based on the assumption of a generalized Gaussian distribution for the contaminating noise,an lp norm is adopted to measure the data fidelity term in the cost function.In the meantime,a regularization functional defined in terms of the desired high resolution (HR) image is employed,which allows for the simultaneous determination of its value and the partly reconstructed image at each iteration step.The convergence is thoroughly studied.Simulation results show the effectiveness of the proposed algorithm as well as its superiority to conventional SR methods.
文摘With the vigorous development of mobile networks,the number of devices at the network edge is growing rapidly and the massive amount of data generated by the devices brings a huge challenge of response latency and communication burden.Existing resource monitoring systems are widely deployed in cloud data centers,but it is difficult for traditional resource monitoring solutions to handle the massive data generated by thousands of edge devices.To address these challenges,we propose a super resolution sensing(SRS)method for distributed resource monitoring,which can be used to recover reliable and accurate high‑frequency data from low‑frequency sampled resource monitoring data.Experiments based on the proposed SRS model are also conducted and the experimental results show that it can effectively reduce the errors generated when recovering low‑frequency monitoring data to high‑frequency data,and verify the effectiveness and practical value of applying SRS method for resource monitoring on edge clouds.
基金Project (Nos 60705012 and 60802025) supported by the National Natural Science Foundation of China
文摘This paper presents a threshold-free maximum a posteriori (MAP) super resolution (SR) algorithm to reconstruct high resolution (HR) images with sharp edges. The joint distribution of directional edge images is modeled as a multidimensional Lorentzian (MDL) function and regarded as a new image prior. This model makes full use of gradient information to restrict the solution space and yields an edge-preserving SR algorithm. The Lorentzian parameters in the cost function are replaced with a tunable variable, and graduated nonconvexity (GNC) optimization is used to guarantee that the proposed multidimensional Lorentzian SR (MDLSR) algorithm converges to the global minimum. Simulation results show the effectiveness of the MDLSR algorithm as well as its superiority over conventional SR methods.
基金Supported by the National Natural Science Foundation of China(No.61340034)the Research Program of Application Foundation and Advanced Technology of Tianjin(No.13JCYBJC15600)
文摘As an ill-posed problem, multiframe blind super resolution imaging recovers a high resolution image from a group of low resolution images with some degradations when the information of blur kernel is limited. Note that the quality of the recovered image is influenced more by the accuracy of blur estimation than an advanced regularization. We study the traditional model of the multiframe super resolution and modify it for blind deblurring. Based on the analysis, we proposed two algorithms. The first one is based on the total variation blind deconvolution algorithm and formulated as a functional for optimization with the regularization of blur. Based on the alternating minimization and the gradient descent algorithm, the high resolution image and the unknown blur kernel are estimated iteratively. By using the median shift and add operator, the second algorithm is more robust to the outlier influence. The MSAA initialization simplifies the interpolation process to reconstruct the blurred high resolution image for blind deblurring and improves the accuracy of blind super resolution imaging. The experimental results demonstrate the superiority and accuracy of our novel algorithms.
文摘Single image super resolution(SISR)techniques produce images of high resolution(HR)as output from input images of low resolution(LR).Motivated by the effectiveness of deep learning methods,we provide a framework based on deep learning to achieve super resolution(SR)by utilizing deep singular-residual neural network(DSRNN)in training phase.Residuals are obtained from the difference between HR and LR images to generate LR-residual example pairs.Singular value decomposition(SVD)is applied to each LR-residual image pair to decompose into subbands of low and high frequency components.Later,DSRNN is trained on these subbands through input and output channels by optimizing the weights and biases of the network.With fewer layers in DSRNN,the influence of exploding gradients is reduced.This speeds up the learning process and also improves accuracy by using skip connections.The trained DSRNN parameters yield residuals to recover the HR subbands in the testing phase.Experimental analysis shows that the proposed method results in superior performance to existingmethods in terms of subjective quality.Extensive testing results on popular benchmark datasets such as set5,set14,and urban100 for a scaling factor of 4 show the effectiveness of the proposed method across different qualitative evaluation metrics.
文摘Existing methods of measurement MTF for discrete imaging system are analysed. A slit target is frequently used to measure the MTF for an imaging system. Usually there are four methods to measure the MTF for a discrete imaging system by using a slit. These methods have something imperfect respectively. But for the discrete imaging systems of under sampling it is difficult to reproduce this type of target properly since frequencies above Nyquist are folded into those below Nyquist, resulting in aliasing effect. To tackle the aliasing problem, a super resolution technique is introduced into our measurement, which gives MTF values both above and below Nyquist more accurately.
基金funded by National Key Research and Development Program of China(No.2022YFC3302103).
文摘High-resolution video transmission requires a substantial amount of bandwidth.In this paper,we present a novel video processing methodology that innovatively integrates region of interest(ROI)identification and super-resolution enhancement.Our method commences with the accurate detection of ROIs within video sequences,followed by the application of advanced super-resolution techniques to these areas,thereby preserving visual quality while economizing on data transmission.To validate and benchmark our approach,we have curated a new gaming dataset tailored to evaluate the effectiveness of ROI-based super-resolution in practical applications.The proposed model architecture leverages the transformer network framework,guided by a carefully designed multi-task loss function,which facilitates concurrent learning and execution of both ROI identification and resolution enhancement tasks.This unified deep learning model exhibits remarkable performance in achieving super-resolution on our custom dataset.The implications of this research extend to optimizing low-bitrate video streaming scenarios.By selectively enhancing the resolution of critical regions in videos,our solution enables high-quality video delivery under constrained bandwidth conditions.Empirical results demonstrate a 15%reduction in transmission bandwidth compared to traditional super-resolution based compression methods,without any perceivable decline in visual quality.This work thus contributes to the advancement of video compression and enhancement technologies,offering an effective strategy for improving digital media delivery efficiency and user experience,especially in bandwidth-limited environments.The innovative integration of ROI identification and super-resolution presents promising avenues for future research and development in adaptive and intelligent video communication systems.
基金the National Natural Science Foundation of China(No90304001,60472036)the Beijing Natural Science Foundation(4052007)+1 种基金the National Key Lab of Communication Foundation,UEST,China(51434050105QT0101) the PolyU/UGC grants(B-Q698)
文摘Construction of high resolution images from low resolution sequences having rigid or semi-rigid ob-jects with unified motions is often important in surveillance and other applications.In this paper a novelobject-based super resolution reconstruction scheme was proposed,in which a six-parameter affine model-based object tracking and registration method was first used to segment and match objects among a se-quence of low resolution frames.The motion model was then further extended to the traditional maximuma posterior(MAP)super resolution algorithm.The proposed object tracking and registration method wasevaluated by both simulated and real acquired sequences.The results have demonstrated the high accura-cy of the proposed object based method and the enhanced reconstruction performance of the extended ap-proach.
基金supported by the Ministry of Science,ICT and Future Planning(MSIP)through the National Research Foundation of Korea(NRF)(RS-2024-00450201)supported by a grant from the Korea Health Technology R&D Project through the Korea Health Industry Development Institute(KHIDI),funded by the Ministry of Health and Welfare,Republic of Korea(HI22C1374).
文摘We developed an imaging technique combining two-photon computed super-resolution microscopy and suction-based stabilization to achieve the resolution of the single-cell level and organelles in vivo.To accomplish this,a conventional two-photon microscope was equipped with a 3D-printed holders,which stabilize the tissue surface within the focal plane of immersion objectives.Further computational image stabilization and noise reduction were applied,followed by superresolution radial fluctuations(SRRF)analysis,doubling image resolution,and enhancing signal-to-noise ratios for in vivo subcellular process investigation.Stabilization of<1μm was obtained by suction,and<25 nm were achieved by subsequent algorithmic image stabilization.A Mito-Dendra2 mouse model,expressing green fluorescent protein(GFP)in mitochondria,demonstrated the potential of long-term intravital subcellular imaging.In vivo mitochondrial fission and fusion,mitochondrial status migration,and the effects of alcohol consumption(modeled as an alcoholic liver disease)and berberine treatment on hepatocyte mitochondrial dynamics are directly observed intravitally.Suction-based stabilization in two-photon intravital imaging,coupled with computational super-resolution holds promise for advancing in vivo subcellular imaging studies.
基金supported by the NSFC-Zhejiang Joint Fund for the Integration of Industrialization and Informatization under Grant No.U1909210the National Nature Science Foundation of China under Grant Nos.61761136010,61772163。
文摘This paper proposes a two-stage point cloud super resolution framework that combines local interpolation and deep neural network based readjustment. For the first stage, the authors apply a local interpolation method to increase the density and uniformity of the target point cloud. For the second stage, the authors employ an outer-product neural network to readjust the position of points that are inserted at the first stage. Comparison examples are given to demonstrate that the proposed framework achieves a better accuracy than existing state-of-art approaches, such as PU-Net, Point Net and DGCNN(Source code is available at https://github.com/qwerty1319/PC-SR).
基金supported by the National Instrument Development Special Program(2013YQ03065102)the Natural Science Foundation of China(614-75010,61428501)Science and Technology Commission of Shanghai Municipality(16DZ-1100300).
文摘Fluorescence polarization is related to the dipole orientation of chromophores,making fuores-cence polarization microscopy possible to_reveal structures and functions of tagged cellularorganelles and biological macromolecules.Several recent super resolution techniques have beenapplied to fluorescence polarization microscopy,achieving dipole measurement at nanoscale.In this review,we summarize both difraction limited and super resolution fluorescence polari-zation microscopy techniques,as well as their applications in biological imaging.
基金supported by the National Natural Science Foundation of China (Nos. 21421005, 21576040, 21776037, 22004011)China Postdoctoral Science Foundation (Nos. BX20200073 and 2020M670754)Dalian Science and Technology Innovation Fund (No. 2020JJ25CY014)。
文摘Spontaneously blinking probe, which switches between dark and bright state without UV or external additives, is extremely attractive in super resolution imaging of live cells. Herein, a clickable rhodamine spirolactam probe, Atto565-Tet, is rationally constructed for spontaneously blinking after biorthogonal labelling and successfully applied to super resolution imaging of mitochondria and lysosomes.
基金This work was supported in part by CAS Key Laboratory of Solar Activity,National Astronomical Observatories Commission for Collaborating Research Program(CRP)(No:KLSA202114)National Science Foundation Project of P.R.China under Grant No.61701554+2 种基金the cross-discipline research project of Minzu University of China(2020MDJC08)State Language Commission Key Project(ZDl135-39)Promotion plan for young teachers scientific research ability of Minzu University of China,MUC 111 Project,First class courses(Digital Image Processing KC2066).
文摘The images captured by different observation station have different resolutions.The Helioseismic and Magnetic Imager(HMI:a part of the NASA Solar Dynamics Observatory SDO)has low-precision but wide coverage.And the Goode Solar Telescope(GST,formerly known as the New Solar Telescope)at Big Bear Solar Observatory(BBSO)solar images has high precision but small coverage.The super-resolution can make the captured images become clearer,so it is wildly used in solar image processing.The traditional super-resolution methods,such as interpolation,often use single image’s feature to improve the image’s quality.The methods based on deep learning-based super-resolution image reconstruction algorithms have better quality,but small-scale features often become ambiguous.To solve this problem,a transitional amplification network structure is proposed.The network can use the two types images relationship to make the images clear.By adding a transition image with almost no difference between the source image and the target image,the transitional amplification training procedure includes three parts:transition image acquisition,transition network training with source images and transition images,and amplification network training with transition images and target images.In addition,the traditional evaluation indicators based on structural similarity(SSIM)and peak signal-to-noise ratio(PSNR)calculate the difference in pixel values and perform poorly in cross-type image reconstruction.The method based on feature matching can effectively evaluate the similarity and clarity of features.The experimental results show that the quality index of the reconstructed image is consistent with the visual effect.
文摘Compared with other methods, the chirp scaling (CS) algorithm is a novel one for compensating the range migration without any interpolation in SAR imaging. However, its resolution ability can't exceed that of Fourier transformation. To realize the super-resolution ability in the azimuth direction a chirp scaling Burg (CSB) algorithm is proposed in this paper, which can still reserve the advantage of avoiding any interpolation in the process of the two-dimensional space-variant correlation in the CS algorithm.
