High Spatial and Spectral Resolution(HSSR)remote-sensing images can provide rich spectral bands and detailed ground information,but there is a relative lack of research on this new type of remote-sensing data.Although...High Spatial and Spectral Resolution(HSSR)remote-sensing images can provide rich spectral bands and detailed ground information,but there is a relative lack of research on this new type of remote-sensing data.Although there are already some HSSR datasets for deep learning model training and testing,the data volume of these datasets is small,resulting in low classification accuracy and weak generalization ability of the trained models.In this paper,an HSSR dataset Luojia-HSSR is constructed based on aerial hyperspectral imagery of southern Shenyang City of Liaoning Province in China.To our knowledge,it is the largest HSSR dataset to date,with 6438 pairs of 256×256 sized samples(including 3480 pairs in the training set,2209 pairs in the test set,and 749 pairs in the validation set),covering area of 161 km2 with spatial resolution 0.75 m,249 Visible and Near-Infrared(VNIR)spectral bands,and corresponding to 23 classes of field-validated ground coverage.It is an ideal experimental data for spatial-spectral feature extraction.Furthermore,a new deep learning model 3D-HRNet for interpreting HSSR images is proposed.The conv-neck in HRNet is modified to better mine the spatial information of the images.Then,a 3D convolution module with attention mechanism is designed to capture the global-local fine spectral information simultaneously.Subsequently,the 3D convolution is inserted into the HRNet to optimize the performance.The experiments show that the 3D-HRNet model has good interpreting ability for the Luojia-HSSR dataset with the Frequency Weighted Intersection over Union(FWIoU)reaching 80.54%,indicating that the Luojia-HSSR dataset constructed in this paper and the proposed 3D-HRnet model have good applicable prospects for processing HSSR remote sensing images.展开更多
Artifi cial neural network is a kind of artificial intelligence method to simulate the function of human brain, and deep learning technology can establish a depth network model with hierarchical structure on the basis...Artifi cial neural network is a kind of artificial intelligence method to simulate the function of human brain, and deep learning technology can establish a depth network model with hierarchical structure on the basis of artificial neural network. Deep learning brings new development direction to artificial neural network. Convolution neural network is a new artificial neural network method, which combines artificial neural network and deep learning technology, and this new neural network is widely used in many fields of computer vision. Modern image recognition algorithm requires classifi cation system to adapt to different types of tasks, and deep network and convolution neural network is a hot research topic in neural networks. According to the characteristics of satellite digital image, we use the convolution neural network to classify the image, which combines texture features with spectral features. The experimental results show that the convolution neural network algorithm can effectively classify the image.展开更多
As digital image techniques have been widely used, the requirements for high-resolution images become increasingly stringent. Traditional single-frame interpolation techniques cannot add new high frequency information...As digital image techniques have been widely used, the requirements for high-resolution images become increasingly stringent. Traditional single-frame interpolation techniques cannot add new high frequency information to the expanded images, and cannot improve resolution in deed. Multiframe-based techniques are effective ways for high-resolution image reconstruction, but their computation complexities and the difficulties in achieving image sequences limit their applications. An original method using an artificial neural network is proposed in this paper. Using the inherent merits in neural network, we can establish the mapping between high frequency components in low-resolution images and high-resolution images. Example applications and their results demonstrated the images reconstructed by our method are aesthetically and quantitatively (using the criteria of MSE and MAE) superior to the images acquired by common methods. Even for infrared images this method can give satisfactory results with high definition. In addition, a single-layer linear neural network is used in this paper, the computational complexity is very low, and this method can be realized in real time.展开更多
We develop a high resolution ground penetrating radar system （LANRCS-GPR） based on the E5071B Vector Network Analyzer （VNA）. This system takes advantage of a wideband and adjustable frequency domain ground penetra...We develop a high resolution ground penetrating radar system （LANRCS-GPR） based on the E5071B Vector Network Analyzer （VNA）. This system takes advantage of a wideband and adjustable frequency domain ground penetrating radar system and adds the characteristics of a network analyzer with ultra-wideband and high precision measurement. It adopts the LAN mode to concatenate system control that reduces construction cost and makes the system easy to expand. The high resolution ground penetrating radar system carries out real time imaging using F-K migration with high calculation efficiency. The experiment results of the system indicate that the LANRCS-GPR system provides high resolution and precision, high signal-to-noise ratio, and great dynamic range. Furthermore, the LANRCS-GPR system is flexible and reliable to operate with easy to expand system functions. The research and development of the LANRCS-GPR provide the theoretical and experimental foundation for future frequency domain ground penetrating radar production and also can serve as an experimental platform with high data gathering precision, enormous information capability, wide application, and convenient operation for electromagnetic wave research and electromagnetic exploration.展开更多
Small-object detection has long been a challenge.High-megapixel cameras are used to solve this problem in industries.However,current detectors are inefficient for high-resolution images.In this work,we propose a new m...Small-object detection has long been a challenge.High-megapixel cameras are used to solve this problem in industries.However,current detectors are inefficient for high-resolution images.In this work,we propose a new module called Pre-Locate Net,which is a plug-and-play structure that can be combined with most popular detectors.We inspire the use of classification ideas to obtain candidate regions in images,greatly reducing the amount of calculation,and thus achieving rapid detection in high-resolution images.Pre-Locate Net mainly includes two parts,candidate region classification and behavior classification.Candidate region classification is used to obtain a candidate region,and behavior classification is used to estimate the scale of an object.Different follow-up processing is adopted according to different scales to balance the variance of the network input.Different from the popular candidate region generation method,we abandon the idea of regression of a bounding box and adopt the concept of classification,so as to realize the prediction of a candidate region in the shallow network.We build a high-resolution dataset of aircraft and landing gears covering complex scenes to verify the effectiveness of our method.Compared to state-of-the-art detectors(e.g.,Guided Anchoring,Libra-RCNN,and FASF),our method achieves the best m AP of 94.5 on 1920×1080 images at 16.7 FPS.展开更多
Human pose estimation aims to localize the body joints from image or video data.With the development of deeplearning,pose estimation has become a hot research topic in the field of computer vision.In recent years,huma...Human pose estimation aims to localize the body joints from image or video data.With the development of deeplearning,pose estimation has become a hot research topic in the field of computer vision.In recent years,humanpose estimation has achieved great success in multiple fields such as animation and sports.However,to obtainaccurate positioning results,existing methods may suffer from large model sizes,a high number of parameters,and increased complexity,leading to high computing costs.In this paper,we propose a new lightweight featureencoder to construct a high-resolution network that reduces the number of parameters and lowers the computingcost.We also introduced a semantic enhancement module that improves global feature extraction and networkperformance by combining channel and spatial dimensions.Furthermore,we propose a dense connected spatialpyramid pooling module to compensate for the decrease in image resolution and information loss in the network.Finally,ourmethod effectively reduces the number of parameters and complexitywhile ensuring high performance.Extensive experiments show that our method achieves a competitive performance while dramatically reducing thenumber of parameters,and operational complexity.Specifically,our method can obtain 89.9%AP score on MPIIVAL,while the number of parameters and the complexity of operations were reduced by 41%and 36%,respectively.展开更多
The high resolution 3D nonlinear integrated inversion method is based on nonlinear theory. Under layer control, the log data from several wells （or all wells） in the study area and seismic trace data adjacent to the...The high resolution 3D nonlinear integrated inversion method is based on nonlinear theory. Under layer control, the log data from several wells （or all wells） in the study area and seismic trace data adjacent to the wells are input to a network with multiple inputs and outputs and are integratedly trained to obtain an adaptive weight function of the entire study area. Integrated nonlinear mapping relationships are built and updated by the lateral and vertical geologic variations of the reservoirs. Therefore, the inversion process and its inversion results can be constrained and controlled and a stable seismic inversion section with high resolution with velocity inversion, impedance inversion, and density inversion sections, can be gained. Good geologic effects have been obtained in model computation tests and real data processing, which verified that this method has high precision, good practicality, and can be used for quantitative reservoir analysis.展开更多
Increasing the resolution of seismic data has long been a major topic in seismic exploration.Due to the effect of high-frequency noises,traditional methods could only improve the resolution limitedly.To end this,this ...Increasing the resolution of seismic data has long been a major topic in seismic exploration.Due to the effect of high-frequency noises,traditional methods could only improve the resolution limitedly.To end this,this paper newly proposed a high-resolution seismic data processing method based on welleseismic combination after summarizing the research status on high resolution.Synthetic record and seismogram are similar in effective signals but dissimilar in noises.Their effective signals are regular and noises are irregular.And they are similar in adjacent frequency.Based on these“three-regularity”characteristics,the relationship between synthetic record and seismogram was established using the neural network algorithm.Then,the corresponding extrapolation algorithm was proposed based on the self-adaptive geological and geophysical variation of multi-layer network structure.And a model was established by virtue of this method and the theoretical simulation was carried out.In addition,it was tested from the aspects of frequency component and amplitude energy recovery,phase correction,regularity elimination and stochastic noise.And the following research results were obtained.First,this new method can extract high-frequency information as much as possible and remain middle and low-frequency effective information while eliminating the noises.Second,in this method,the idea of traditional methods to denoisefirst and then expand frequency is changed completely and the limitation of traditional methods is broken.It establishes the idea of expanding frequency and denoising simultaneously and increases the resolution to the uttermost.Third,this new method has been applied to a variety of reservoir descriptions and the high-resolution processing results have been improved significantly in precision and accuracy.展开更多
Axially-swept light-sheet microscopy(ASLM)has emerged as a distinguished tool for 3D imaging owing to its excellent spatial resolution.However,the acquisition time is significantly elongated due to the extra time cons...Axially-swept light-sheet microscopy(ASLM)has emerged as a distinguished tool for 3D imaging owing to its excellent spatial resolution.However,the acquisition time is significantly elongated due to the extra time consumed in axial scanning.Meanwhile,the spatial information provided in a single scan is fundamentally limited by the compromise between field-of-view and resolution.The overall inadequate optical throughput of current ASLM techniques impedes their widespread application in acquiring large samples.Here we demonstrate a spinning-disk-based ASLM(SDLM)approach that enables wide field-of-view(15×confocal range of the gaussian beam),isotropic 3D imaging of large organisms at 100 Hz full camera frame rate.In addition to the new optical design,we combine a recurrent neural network image restoration model to further improve the resolution of raw images.We demonstrate seconds scale stitching-free 3D imaging of the entire mouse brain(~9*8*5 mm size)at isotropic single-cell resolution(1.5μm voxel).With the high-quality data readily obtained by our approach,we also demonstrate the visualization of long projecting neurons and two genotypes of whole mouse brain cell profiling across the 3D space.Further transformation into in vivo research would broaden the application of SDLM.展开更多
基金supported by the Major Program of the National Natural Science Foundation of China[grant number 92038301]The research was also supported by the National Natural Science Foundation of China[grant number 41971295]+1 种基金the Foundation for Innovative Research Groups of the Natural Science Foundation of Hubei Province[grant number 2020CFA003]the Special Fund of Hubei Luojia Laboratory.
文摘High Spatial and Spectral Resolution(HSSR)remote-sensing images can provide rich spectral bands and detailed ground information,but there is a relative lack of research on this new type of remote-sensing data.Although there are already some HSSR datasets for deep learning model training and testing,the data volume of these datasets is small,resulting in low classification accuracy and weak generalization ability of the trained models.In this paper,an HSSR dataset Luojia-HSSR is constructed based on aerial hyperspectral imagery of southern Shenyang City of Liaoning Province in China.To our knowledge,it is the largest HSSR dataset to date,with 6438 pairs of 256×256 sized samples(including 3480 pairs in the training set,2209 pairs in the test set,and 749 pairs in the validation set),covering area of 161 km2 with spatial resolution 0.75 m,249 Visible and Near-Infrared(VNIR)spectral bands,and corresponding to 23 classes of field-validated ground coverage.It is an ideal experimental data for spatial-spectral feature extraction.Furthermore,a new deep learning model 3D-HRNet for interpreting HSSR images is proposed.The conv-neck in HRNet is modified to better mine the spatial information of the images.Then,a 3D convolution module with attention mechanism is designed to capture the global-local fine spectral information simultaneously.Subsequently,the 3D convolution is inserted into the HRNet to optimize the performance.The experiments show that the 3D-HRNet model has good interpreting ability for the Luojia-HSSR dataset with the Frequency Weighted Intersection over Union(FWIoU)reaching 80.54%,indicating that the Luojia-HSSR dataset constructed in this paper and the proposed 3D-HRnet model have good applicable prospects for processing HSSR remote sensing images.
文摘Artifi cial neural network is a kind of artificial intelligence method to simulate the function of human brain, and deep learning technology can establish a depth network model with hierarchical structure on the basis of artificial neural network. Deep learning brings new development direction to artificial neural network. Convolution neural network is a new artificial neural network method, which combines artificial neural network and deep learning technology, and this new neural network is widely used in many fields of computer vision. Modern image recognition algorithm requires classifi cation system to adapt to different types of tasks, and deep network and convolution neural network is a hot research topic in neural networks. According to the characteristics of satellite digital image, we use the convolution neural network to classify the image, which combines texture features with spectral features. The experimental results show that the convolution neural network algorithm can effectively classify the image.
文摘As digital image techniques have been widely used, the requirements for high-resolution images become increasingly stringent. Traditional single-frame interpolation techniques cannot add new high frequency information to the expanded images, and cannot improve resolution in deed. Multiframe-based techniques are effective ways for high-resolution image reconstruction, but their computation complexities and the difficulties in achieving image sequences limit their applications. An original method using an artificial neural network is proposed in this paper. Using the inherent merits in neural network, we can establish the mapping between high frequency components in low-resolution images and high-resolution images. Example applications and their results demonstrated the images reconstructed by our method are aesthetically and quantitatively (using the criteria of MSE and MAE) superior to the images acquired by common methods. Even for infrared images this method can give satisfactory results with high definition. In addition, a single-layer linear neural network is used in this paper, the computational complexity is very low, and this method can be realized in real time.
基金This project was supported by National Natural Science Foundation of china (No.40474042)
文摘We develop a high resolution ground penetrating radar system （LANRCS-GPR） based on the E5071B Vector Network Analyzer （VNA）. This system takes advantage of a wideband and adjustable frequency domain ground penetrating radar system and adds the characteristics of a network analyzer with ultra-wideband and high precision measurement. It adopts the LAN mode to concatenate system control that reduces construction cost and makes the system easy to expand. The high resolution ground penetrating radar system carries out real time imaging using F-K migration with high calculation efficiency. The experiment results of the system indicate that the LANRCS-GPR system provides high resolution and precision, high signal-to-noise ratio, and great dynamic range. Furthermore, the LANRCS-GPR system is flexible and reliable to operate with easy to expand system functions. The research and development of the LANRCS-GPR provide the theoretical and experimental foundation for future frequency domain ground penetrating radar production and also can serve as an experimental platform with high data gathering precision, enormous information capability, wide application, and convenient operation for electromagnetic wave research and electromagnetic exploration.
基金the National Science Fund for Distinguished Young Scholars of China (No. 51625501)the Aeronautical Science Foundation of China (No. 201946051002)
文摘Small-object detection has long been a challenge.High-megapixel cameras are used to solve this problem in industries.However,current detectors are inefficient for high-resolution images.In this work,we propose a new module called Pre-Locate Net,which is a plug-and-play structure that can be combined with most popular detectors.We inspire the use of classification ideas to obtain candidate regions in images,greatly reducing the amount of calculation,and thus achieving rapid detection in high-resolution images.Pre-Locate Net mainly includes two parts,candidate region classification and behavior classification.Candidate region classification is used to obtain a candidate region,and behavior classification is used to estimate the scale of an object.Different follow-up processing is adopted according to different scales to balance the variance of the network input.Different from the popular candidate region generation method,we abandon the idea of regression of a bounding box and adopt the concept of classification,so as to realize the prediction of a candidate region in the shallow network.We build a high-resolution dataset of aircraft and landing gears covering complex scenes to verify the effectiveness of our method.Compared to state-of-the-art detectors(e.g.,Guided Anchoring,Libra-RCNN,and FASF),our method achieves the best m AP of 94.5 on 1920×1080 images at 16.7 FPS.
基金the National Natural Science Foundation of China(Grant Number 62076246).
文摘Human pose estimation aims to localize the body joints from image or video data.With the development of deeplearning,pose estimation has become a hot research topic in the field of computer vision.In recent years,humanpose estimation has achieved great success in multiple fields such as animation and sports.However,to obtainaccurate positioning results,existing methods may suffer from large model sizes,a high number of parameters,and increased complexity,leading to high computing costs.In this paper,we propose a new lightweight featureencoder to construct a high-resolution network that reduces the number of parameters and lowers the computingcost.We also introduced a semantic enhancement module that improves global feature extraction and networkperformance by combining channel and spatial dimensions.Furthermore,we propose a dense connected spatialpyramid pooling module to compensate for the decrease in image resolution and information loss in the network.Finally,ourmethod effectively reduces the number of parameters and complexitywhile ensuring high performance.Extensive experiments show that our method achieves a competitive performance while dramatically reducing thenumber of parameters,and operational complexity.Specifically,our method can obtain 89.9%AP score on MPIIVAL,while the number of parameters and the complexity of operations were reduced by 41%and 36%,respectively.
基金supported by the Key Project of the National Natural Scientific Foundation(Grant No.40839909)
文摘The high resolution 3D nonlinear integrated inversion method is based on nonlinear theory. Under layer control, the log data from several wells （or all wells） in the study area and seismic trace data adjacent to the wells are input to a network with multiple inputs and outputs and are integratedly trained to obtain an adaptive weight function of the entire study area. Integrated nonlinear mapping relationships are built and updated by the lateral and vertical geologic variations of the reservoirs. Therefore, the inversion process and its inversion results can be constrained and controlled and a stable seismic inversion section with high resolution with velocity inversion, impedance inversion, and density inversion sections, can be gained. Good geologic effects have been obtained in model computation tests and real data processing, which verified that this method has high precision, good practicality, and can be used for quantitative reservoir analysis.
文摘Increasing the resolution of seismic data has long been a major topic in seismic exploration.Due to the effect of high-frequency noises,traditional methods could only improve the resolution limitedly.To end this,this paper newly proposed a high-resolution seismic data processing method based on welleseismic combination after summarizing the research status on high resolution.Synthetic record and seismogram are similar in effective signals but dissimilar in noises.Their effective signals are regular and noises are irregular.And they are similar in adjacent frequency.Based on these“three-regularity”characteristics,the relationship between synthetic record and seismogram was established using the neural network algorithm.Then,the corresponding extrapolation algorithm was proposed based on the self-adaptive geological and geophysical variation of multi-layer network structure.And a model was established by virtue of this method and the theoretical simulation was carried out.In addition,it was tested from the aspects of frequency component and amplitude energy recovery,phase correction,regularity elimination and stochastic noise.And the following research results were obtained.First,this new method can extract high-frequency information as much as possible and remain middle and low-frequency effective information while eliminating the noises.Second,in this method,the idea of traditional methods to denoisefirst and then expand frequency is changed completely and the limitation of traditional methods is broken.It establishes the idea of expanding frequency and denoising simultaneously and increases the resolution to the uttermost.Third,this new method has been applied to a variety of reservoir descriptions and the high-resolution processing results have been improved significantly in precision and accuracy.
基金supported by the funding from National Natural Science Foundation of China(T2225014,82270238,21927802,22404065,62405099)National Key Research and Development Program of China(2022YFC3401102,2023ZD0519900)+1 种基金China Postdoctoral Science Foundation(2024T170296,2023M741258,2024M750994)Postdoctor Project of Hubei Province under Grant Number(2024HBBHCXA015).
文摘Axially-swept light-sheet microscopy(ASLM)has emerged as a distinguished tool for 3D imaging owing to its excellent spatial resolution.However,the acquisition time is significantly elongated due to the extra time consumed in axial scanning.Meanwhile,the spatial information provided in a single scan is fundamentally limited by the compromise between field-of-view and resolution.The overall inadequate optical throughput of current ASLM techniques impedes their widespread application in acquiring large samples.Here we demonstrate a spinning-disk-based ASLM(SDLM)approach that enables wide field-of-view(15×confocal range of the gaussian beam),isotropic 3D imaging of large organisms at 100 Hz full camera frame rate.In addition to the new optical design,we combine a recurrent neural network image restoration model to further improve the resolution of raw images.We demonstrate seconds scale stitching-free 3D imaging of the entire mouse brain(~9*8*5 mm size)at isotropic single-cell resolution(1.5μm voxel).With the high-quality data readily obtained by our approach,we also demonstrate the visualization of long projecting neurons and two genotypes of whole mouse brain cell profiling across the 3D space.Further transformation into in vivo research would broaden the application of SDLM.
