Due to the limitations of spatial bandwidth product and data transmission bandwidth,the field of view,resolution,and imaging speed constrain each other in an optical imaging system.Here,a fast-zoom and high-resolution...Due to the limitations of spatial bandwidth product and data transmission bandwidth,the field of view,resolution,and imaging speed constrain each other in an optical imaging system.Here,a fast-zoom and high-resolution sparse compound-eye camera(CEC)based on dual-end collaborative optimization is proposed,which provides a cost-effective way to break through the trade-off among the field of view,resolution,and imaging speed.In the optical end,a sparse CEC based on liquid lenses is designed,which can realize large-field-of-view imaging in real time,and fast zooming within 5 ms.In the computational end,a disturbed degradation model driven super-resolution network(DDMDSR-Net)is proposed to deal with complex image degradation issues in actual imaging situations,achieving high-robustness and high-fidelity resolution enhancement.Based on the proposed dual-end collaborative optimization framework,the angular resolution of the CEC can be enhanced from 71.6"to 26.0",which provides a solution to realize high-resolution imaging for array camera dispensing with high optical hardware complexity and data transmission bandwidth.Experiments verify the advantages of the CEC based on dual-end collaborative optimization in high-fidelity reconstruction of real scene images,kilometer-level long-distance detection,and dynamic imaging and precise recognition of targets of interest.展开更多
This paper presents a high-speed and robust dual-band infrared thermal camera based on an ARM CPU.The system consists of a low-resolution long-wavelength infrared detector,a digital temperature and humid⁃ity sensor,an...This paper presents a high-speed and robust dual-band infrared thermal camera based on an ARM CPU.The system consists of a low-resolution long-wavelength infrared detector,a digital temperature and humid⁃ity sensor,and a CMOS sensor.In view of the significant contrast between face and background in thermal infra⁃red images,this paper explores a suitable accuracy-latency tradeoff for thermal face detection and proposes a tiny,lightweight detector named YOLO-Fastest-IR.Four YOLO-Fastest-IR models(IR0 to IR3)with different scales are designed based on YOLO-Fastest.To train and evaluate these lightweight models,a multi-user low-resolution thermal face database(RGBT-MLTF)was collected,and the four networks were trained.Experiments demon⁃strate that the lightweight convolutional neural network performs well in thermal infrared face detection tasks.The proposed algorithm outperforms existing face detection methods in both positioning accuracy and speed,making it more suitable for deployment on mobile platforms or embedded devices.After obtaining the region of interest(ROI)in the infrared(IR)image,the RGB camera is guided by the thermal infrared face detection results to achieve fine positioning of the RGB face.Experimental results show that YOLO-Fastest-IR achieves a frame rate of 92.9 FPS on a Raspberry Pi 4B and successfully detects 97.4%of faces in the RGBT-MLTF test set.Ultimate⁃ly,an infrared temperature measurement system with low cost,strong robustness,and high real-time perfor⁃mance was integrated,achieving a temperature measurement accuracy of 0.3℃.展开更多
Photomechanics is a crucial branch of solid mechanics.The localization of point targets constitutes a fundamental problem in optical experimental mechanics,with extensive applications in various missions of unmanned a...Photomechanics is a crucial branch of solid mechanics.The localization of point targets constitutes a fundamental problem in optical experimental mechanics,with extensive applications in various missions of unmanned aerial vehicles.Localizing moving targets is crucial for analyzing their motion characteristics and dynamic properties.Reconstructing the trajectories of points from asynchronous cameras is a significant challenge.It encompasses two coupled sub-problems:Trajectory reconstruction and camera synchronization.Present methods typically address only one of these sub-problems individually.This paper proposes a 3D trajectory reconstruction method for point targets based on asynchronous cameras,simultaneously solving both sub-problems.Firstly,we extend the trajectory intersection method to asynchronous cameras to resolve the limitation of traditional triangulation that requires camera synchronization.Secondly,we develop models for camera temporal information and target motion,based on imaging mechanisms and target dynamics characteristics.The parameters are optimized simultaneously to achieve trajectory reconstruction without accurate time parameters.Thirdly,we optimize the camera rotations alongside the camera time information and target motion parameters,using tighter and more continuous constraints on moving points.The reconstruction accuracy is significantly improved,especially when the camera rotations are inaccurate.Finally,the simulated and real-world experimental results demonstrate the feasibility and accuracy of the proposed method.The real-world results indicate that the proposed algorithm achieved a localization error of 112.95 m at an observation distance range of 15-20 km.展开更多
Observatories typically deploy all-sky cameras for monitoring cloud cover and weather conditions.However,many of these cameras lack scientific-grade sensors,r.esulting in limited photometric precision,which makes calc...Observatories typically deploy all-sky cameras for monitoring cloud cover and weather conditions.However,many of these cameras lack scientific-grade sensors,r.esulting in limited photometric precision,which makes calculating the sky area visibility distribution via extinction measurement challenging.To address this issue,we propose the Photometry-Free Sky Area Visibility Estimation(PFSAVE)method.This method uses the standard magnitude of the faintest star observed within a given sky area to estimate visibility.By employing a pertransformation refitting optimization strategy,we achieve a high-precision coordinate transformation model with an accuracy of 0.42 pixels.Using the results of HEALPix segmentation is also introduced to achieve high spatial resolution.Comprehensive analysis based on real allsky images demonstrates that our method exhibits higher accuracy than the extinction-based method.Our method supports both manual and robotic dynamic scheduling,especially under partially cloudy conditions.展开更多
It is important to understand the development of joints and fractures in rock masses to ensure drilling stability and blasting effectiveness.Traditional manual observation techniques for identifying and extracting fra...It is important to understand the development of joints and fractures in rock masses to ensure drilling stability and blasting effectiveness.Traditional manual observation techniques for identifying and extracting fracture characteristics have been proven to be inefficient and prone to subjective interpretation.Moreover,conventional image processing algorithms and classical deep learning models often encounter difficulties in accurately identifying fracture areas,resulting in unclear contours.This study proposes an intelligent method for detecting internal fractures in mine rock masses to address these challenges.The proposed approach captures a nodal fracture map within the targeted blast area and integrates channel and spatial attention mechanisms into the ResUnet(RU)model.The channel attention mechanism dynamically recalibrates the importance of each feature channel,and the spatial attention mechanism enhances feature representation in key areas while minimizing background noise,thus improving segmentation accuracy.A dynamic serpentine convolution module is also introduced that adaptively adjusts the shape and orientation of the convolution kernel based on the local structure of the input feature map.Furthermore,this method enables the automatic extraction and quantification of borehole nodal fracture information by fitting sinusoidal curves to the boundaries of the fracture contours using the least squares method.In comparison to other advanced deep learning models,our enhanced RU demonstrates superior performance across evaluation metrics,including accuracy,pixel accuracy(PA),and intersection over union(IoU).Unlike traditional manual extraction methods,our intelligent detection approach provides considerable time and cost savings,with an average error rate of approximately 4%.This approach has the potential to greatly improve the efficiency of geological surveys of borehole fractures.展开更多
This study presents a drone-based aerial imaging method for automated rice seedling detection and counting in paddy fields.Utilizing a drone equipped with a high-resolution camera,images are captured 14 days postsowin...This study presents a drone-based aerial imaging method for automated rice seedling detection and counting in paddy fields.Utilizing a drone equipped with a high-resolution camera,images are captured 14 days postsowing at a consistent altitude of six meters,employing autonomous flight for uniform data acquisition.The approach effectively addresses the distinct growth patterns of both single and clustered rice seedlings at this early stage.The methodology follows a two-step process:first,the GoogleNet deep learning network identifies the location and center points of rice plants.Then,the U-Net deep learning network performs classification and counting of individual plants and clusters.This combination of deep learning models achieved a 90%accuracy rate in classifying and counting both single and clustered seedlings.To validate the method’s effectiveness,results were compared against traditional manual counting conducted by agricultural experts.The comparison revealed minimal discrepancies,with a variance of only 2–4 clumps per square meter,confirming the reliability of the proposed method.This automated approach offers significant benefits by providing an efficient,accurate,and scalable solution for monitoring seedling growth.It enables farmers to optimize fertilizer and pesticide application,improve resource allocation,and enhance overall crop management,ultimately contributing to increased agricultural productivity.展开更多
Closed thoracic drainage can be performed using a steel-needle-guided chest tube to treat pleural effusion or pneumothorax in clinics.However,the puncture procedure during surgery is invisible,increasing the risk of s...Closed thoracic drainage can be performed using a steel-needle-guided chest tube to treat pleural effusion or pneumothorax in clinics.However,the puncture procedure during surgery is invisible,increasing the risk of surgical failure.Therefore,it is necessary to design a visualization system for closed thoracic drainage.Augmented reality(AR)technology can assist in visualizing the internal anatomical structure and determining the insertion point on the body surface.The structure of the currently used steel-needle-guided chest tube was modified by integrating it with an ultrafine diameter camera to provide real-time visualization of the puncture process.After simulation experiments,the overall registration error of the AR method was measured to be within(3.59±0.53)mm,indicating its potential for clinical application.The ultrafine diameter camera module and improved steel-needle-guided chest tube can timely reflect the position of the needle tip in the human body.A comparative experiment showed that video guidance could improve the safety of the puncture process compared to the traditional method.Finally,a qualitative evaluation of the usability of the system was conducted through a questionnaire.This system facilitates the visualization of closed thoracic drainage puncture procedure and pro-vides an implementation scheme to enhance the accuracy and safety of the operative step,which is conducive to reducing the learning curve and improving the proficiency of the doctors.展开更多
The estimation of orientation parameters and correction of lens distortion are crucial problems in the field of Unmanned Aerial Vehicles(UAVs)photogrammetry.In recent years,the utilization of UAVs for aerial photogram...The estimation of orientation parameters and correction of lens distortion are crucial problems in the field of Unmanned Aerial Vehicles(UAVs)photogrammetry.In recent years,the utilization of UAVs for aerial photogrammetry has witnessed a surge in popularity.Typically,UAVs are equipped with low-cost non-metric cameras and a Position and Orientation System(POS).Unfortunately,the Interior Orientation Parameters(IOPs)of the non-metric cameras are not fixed.Whether the lens distortions are large or small,they effect the image coordinates accordingly.Additionally,Inertial Measurement Units(IMUs)often have observation errors.To address these challenges and improve parameter estimation for UAVs Light Detection and Ranging(LiDAR)and photogrammetry,this paper analyzes the accuracy of POS observations obtained from Global Navigation Satellite System Real Time Kinematic(GNSS-RTK)and IMU data.A method that incorporates additional known conditions for parameter estimation,a series of algorithms to simultaneously solve for IOPs,Exterior Orientation Parameters(EOPs),and camera lens distortion correction parameters are proposed.Extensive experiments demonstrate that the coordinates measured by GNSS-RTK can be directly used as linear EOPs;however,angular EOP measurements from IMUs exhibit relatively large errors compared to adjustment results and require correction during the adjustment process.The IOPs of non-metric cameras vary slightly between images but need to be treated as unknown parameters in high precision applications.Furthermore,it is found that the Ebner systematic error model is sensitive to the choice of the magnification parameter of the photographic baseline length in images,it should be set as less than or equal to one third of the photographic baseline to ensure stable solutions.展开更多
Based on diverse landforms, the correlation between soil organic matter content and multi-spectral band of remote sensing image was analyzed in this pa- per. In addition, the inversion models were built for the soil o...Based on diverse landforms, the correlation between soil organic matter content and multi-spectral band of remote sensing image was analyzed in this pa- per. In addition, the inversion models were built for the soil organic matter content in different landforms. The results showed that the spectral reflectance was nega- tively related to soil organic matter content; linear regression analysis of remove was performed throughout the bands using SPSS. When the inversion models were built based on all the bands, better fitting effect was obtained. The precision of in- version models built based on different landforms was higher than those built re- gardless landforms. Compared with the actual value, the identification level of soil organic matter content was 91 65% under the allowable error was 7%. It indicated that the extraction of soil organic matter with inversion model that was built based on different landforrrs was feasible with higher precision.展开更多
In order to overcome the shortcomings that the reconstructed spectral reflectance may be negative when using the classic principal component analysis （PCA）to reduce the dimensions of the multi-spectral data, a nonne...In order to overcome the shortcomings that the reconstructed spectral reflectance may be negative when using the classic principal component analysis （PCA）to reduce the dimensions of the multi-spectral data, a nonnegative constrained principal component analysis method is proposed to construct a low-dimensional multi-spectral space and accomplish the conversion between the new constructed space and the multispectral space. First, the reason behind the negative data is analyzed and a nonnegative constraint is imposed on the classic PCA. Then a set of nonnegative linear independence weight vectors of principal components is obtained, by which a lowdimensional space is constructed. Finally, a nonlinear optimization technique is used to determine the projection vectors of the high-dimensional multi-spectral data in the constructed space. Experimental results show that the proposed method can keep the reconstructed spectral data in [ 0, 1 ]. The precision of the space created by the proposed method is equivalent to or even higher than that by the PCA.展开更多
[Objective] The aim of this study was to extract effective feature bands of damaged rice leaves by planthoppers to make identification and classification rapidly from great amounts of imaging spectral data. [Method] T...[Objective] The aim of this study was to extract effective feature bands of damaged rice leaves by planthoppers to make identification and classification rapidly from great amounts of imaging spectral data. [Method] The experiment, using multi-spectral imaging system, acquired the multi-spectral images of damaged rice leaves from band 400 to 720 nm by interval of 5 nm. [Result] According to the principle of band index, it was calculated that the bands at 515, 510, 710, 555, 630, 535, 505, 530 and 595 nm were having high band index value with rich information and little correlation. Furthermore, the experiment used two classification methods and calcu-lated the classification accuracy higher than 90.00% for feature bands and ful bands of damaged rice leaves by planthoppers respectively. [Conclusion] It can be con-cluded that these bands can be considered as effective feature bands to identify damaged rice leaves by planthoppers quickly from a large scale of crops.展开更多
Histogram of collinear gradient-enhanced coding （HCGEC）, a robust key point descriptor for multi-spectral image matching, is proposed. The HCGEC mainly encodes rough structures within an image and suppresses detaile...Histogram of collinear gradient-enhanced coding （HCGEC）, a robust key point descriptor for multi-spectral image matching, is proposed. The HCGEC mainly encodes rough structures within an image and suppresses detailed textural information, which is desirable in multi-spectral image matching. Experiments on two multi-spectral data sets demonstrate that the proposed descriptor can yield significantly better results than some state-of- the-art descriptors.展开更多
Image fusion is performed between one band of multi-spectral image and two bands of hyperspectral image to produce fused image with the same spatial resolution as source multi-spectral image and the same spectral reso...Image fusion is performed between one band of multi-spectral image and two bands of hyperspectral image to produce fused image with the same spatial resolution as source multi-spectral image and the same spectral resolution as source hyperspeetral image. According to the characteristics and 3-Dimensional （3-D） feature analysis of multi-spectral and hyperspectral image data volume, the new fusion approach using 3-D wavelet based method is proposed. This approach is composed of four major procedures： Spatial and spectral resampling, 3-D wavelet transform, wavelet coefficient integration and 3-D inverse wavelet transform. Especially, a novel method, Ratio Image Based Spectral Resampling （RIBSR）method, is proposed to accomplish data resampling in spectral domain by utilizing the property of ratio image. And a new fusion rule, Average and Substitution （A＆S） rule, is employed as the fusion rule to accomplish wavelet coefficient integration. Experimental results illustrate that the fusion approach using 3-D wavelet transform can utilize both spatial and spectral characteristics of source images more adequately and produce fused image with higher quality and fewer artifacts than fusion approach using 2-D wavelet transform. It is also revealed that RIBSR method is capable of interpolating the missing data more effectively and correctly, and A＆S rule can integrate coefficients of source images in 3-D wavelet domain to preserve both spatial and spectral features of source images more properly.展开更多
To monitor growth and predict the yield of rice over a large area, the chlorophyll contents in the rice canopy were estimated using the unmanned aerial vehicle(UAV) remote sensing technology. In this work, multi-spect...To monitor growth and predict the yield of rice over a large area, the chlorophyll contents in the rice canopy were estimated using the unmanned aerial vehicle(UAV) remote sensing technology. In this work, multi-spectral image information of the rice crop was obtained using a 6-channel multi-spectral camera mounted on a fixed wing UAV, which was flown 600 m above the ground, between 11: 00-14: 00 on a sunny day in summer. The measured chlorophyll values were collected as sample sets. The s-REP index was screened out to estimate chlorophyll contents through the analysis of six kinds of spectral indexes of chlorophyll estimated capacity. An inversion model of the chlorophyll contents was then built using the least square support vector regression(LS-SVR)algorithm, with calibration and prediction R-square values of 0.89 and 0.83, respectively. Finally, remote sensing mapping for a UAV image of the Fangzheng County Dexter Rice Planting Park was accomplished using the inversion model. The inversion and measured values were then compared using regression fitting. R-square and root-mean-square error of the fitting model were 0.79 and 2.39,respectively. The results demonstrated that accurate estimation of rice-canopy chlorophyll contents was feasible using the LS-SVR inversion model developed using the s-REP vegetation index.展开更多
Evaluation of the impact of herbicides on maize was done through multi- spectral and multi-modal imaging and multi-spectral fluorescence imaging combined with statistical methods. Spectra containing 13 wavelengths ran...Evaluation of the impact of herbicides on maize was done through multi- spectral and multi-modal imaging and multi-spectral fluorescence imaging combined with statistical methods. Spectra containing 13 wavelengths ranging from 375 nm to 940 nm were derived from multi-spectral images in transmission, reflection and scattering mode and fluorescence images obtained using high-pass filters (F450 nm, F500 nm, F550 nm, F600 nm, F650 nm) on control maize samples and maize samples treated with Herbextra herbicide were used. The appearance of the spectra allowed us to characterize the effect of the herbicide on the maize pigment concentration. The fluorescence images allowed us to track the fate of absorbed energy and through PLS-DA and SVM-DA to discriminate the two leaf categories with very low error rates for the test, i.e. 4.9% and 2% respectively. The results of this technique can be used in the context of precision agriculture.展开更多
With the diversified development of big data,detection and precision guidance technologies,electromagnetic(EM)functional materials and devices serving multiple spectrums have become a hot topic.Exploring the multispec...With the diversified development of big data,detection and precision guidance technologies,electromagnetic(EM)functional materials and devices serving multiple spectrums have become a hot topic.Exploring the multispectral response of materials is a challenging and meaningful scientific question.In this study,MXene/TiO_(2)hybrids with tunable conduction loss and polarization relaxation are fabricated by in situ atomic reconstruction engineering.More importantly,MXene/TiO_(2)hybrids exhibit adjustable spectral responses in the GHz,infrared and visible spectrums,and several EM devices are constructed based on this.An antenna array provides excellent EM energy harvesting in multiple microwave bands,with|S11|up to−63.2 dB,and can be tuned by the degree of bending.An ultra-wideband bandpass filter realizes a passband of about 5.4 GHz and effectively suppresses the transmission of EM signals in the stopband.An infrared stealth device has an emissivity of less than 0.2 in the infrared spectrum at wavelengths of 6-14μm.This work can provide new inspiration for the design and development of multifunctional,multi-spectrum EM devices.展开更多
An ultrafast framing camera with a pulse-dilation device,a microchannel plate(MCP)imager,and an electronic imaging system were reported.The camera achieved a temporal resolution of 10 ps by using a pulse-dilation devi...An ultrafast framing camera with a pulse-dilation device,a microchannel plate(MCP)imager,and an electronic imaging system were reported.The camera achieved a temporal resolution of 10 ps by using a pulse-dilation device and gated MCP imager,and a spatial resolution of 100μm by using an electronic imaging system comprising combined magnetic lenses.The spatial resolution characteristics of the camera were studied both theoretically and experimentally.The results showed that the camera with combined magnetic lenses reduced the field curvature and acquired a larger working area.A working area with a diameter of 53 mm was created by applying four magnetic lenses to the camera.Furthermore,the camera was used to detect the X-rays produced by the laser-targeting device.The diagnostic results indicated that the width of the X-ray pulse was approximately 18 ps.展开更多
Considering the problem of traditional cervical cancer detection method that brings high false negative rate （FNR） and high false positive rate （FPR）, a new abnormal cervical cells detection method of multi-spectr...Considering the problem of traditional cervical cancer detection method that brings high false negative rate （FNR） and high false positive rate （FPR）, a new abnormal cervical cells detection method of multi-spectral Pap smear is proposed in this thesis, on the basis of multi-spectral microscopic imaging technology and computer automotive recognition technology. At first, image in a specific wave band is segmented according to the relationship between intensity and spectrum of each pixel. Then, multi-spectral features of each pixel are extracted making use of improved cosine correlation analysis （CCA） algorithm. Combined with the characteristic of each cell＇s area, final definition is made. Experiments have proved the new approach could identify abnormal cells efficiently as well as lower FNR and FPR.展开更多
基金financial supports from National Natural Science Foundation of China(Grant Nos.U23A20368 and 62175006)Academic Excellence Foundation of BUAA for PhD Students.
文摘Due to the limitations of spatial bandwidth product and data transmission bandwidth,the field of view,resolution,and imaging speed constrain each other in an optical imaging system.Here,a fast-zoom and high-resolution sparse compound-eye camera(CEC)based on dual-end collaborative optimization is proposed,which provides a cost-effective way to break through the trade-off among the field of view,resolution,and imaging speed.In the optical end,a sparse CEC based on liquid lenses is designed,which can realize large-field-of-view imaging in real time,and fast zooming within 5 ms.In the computational end,a disturbed degradation model driven super-resolution network(DDMDSR-Net)is proposed to deal with complex image degradation issues in actual imaging situations,achieving high-robustness and high-fidelity resolution enhancement.Based on the proposed dual-end collaborative optimization framework,the angular resolution of the CEC can be enhanced from 71.6"to 26.0",which provides a solution to realize high-resolution imaging for array camera dispensing with high optical hardware complexity and data transmission bandwidth.Experiments verify the advantages of the CEC based on dual-end collaborative optimization in high-fidelity reconstruction of real scene images,kilometer-level long-distance detection,and dynamic imaging and precise recognition of targets of interest.
基金Supported by the Fundamental Research Funds for the Central Universities(2024300443)the Natural Science Foundation of Jiangsu Province(BK20241224).
文摘This paper presents a high-speed and robust dual-band infrared thermal camera based on an ARM CPU.The system consists of a low-resolution long-wavelength infrared detector,a digital temperature and humid⁃ity sensor,and a CMOS sensor.In view of the significant contrast between face and background in thermal infra⁃red images,this paper explores a suitable accuracy-latency tradeoff for thermal face detection and proposes a tiny,lightweight detector named YOLO-Fastest-IR.Four YOLO-Fastest-IR models(IR0 to IR3)with different scales are designed based on YOLO-Fastest.To train and evaluate these lightweight models,a multi-user low-resolution thermal face database(RGBT-MLTF)was collected,and the four networks were trained.Experiments demon⁃strate that the lightweight convolutional neural network performs well in thermal infrared face detection tasks.The proposed algorithm outperforms existing face detection methods in both positioning accuracy and speed,making it more suitable for deployment on mobile platforms or embedded devices.After obtaining the region of interest(ROI)in the infrared(IR)image,the RGB camera is guided by the thermal infrared face detection results to achieve fine positioning of the RGB face.Experimental results show that YOLO-Fastest-IR achieves a frame rate of 92.9 FPS on a Raspberry Pi 4B and successfully detects 97.4%of faces in the RGBT-MLTF test set.Ultimate⁃ly,an infrared temperature measurement system with low cost,strong robustness,and high real-time perfor⁃mance was integrated,achieving a temperature measurement accuracy of 0.3℃.
基金supported by the Hunan Provin〓〓cial Natural Science Foundation for Excellent Young Scholars(Grant No.2023JJ20045)the National Natural Science Foundation of China(Grant No.12372189)。
文摘Photomechanics is a crucial branch of solid mechanics.The localization of point targets constitutes a fundamental problem in optical experimental mechanics,with extensive applications in various missions of unmanned aerial vehicles.Localizing moving targets is crucial for analyzing their motion characteristics and dynamic properties.Reconstructing the trajectories of points from asynchronous cameras is a significant challenge.It encompasses two coupled sub-problems:Trajectory reconstruction and camera synchronization.Present methods typically address only one of these sub-problems individually.This paper proposes a 3D trajectory reconstruction method for point targets based on asynchronous cameras,simultaneously solving both sub-problems.Firstly,we extend the trajectory intersection method to asynchronous cameras to resolve the limitation of traditional triangulation that requires camera synchronization.Secondly,we develop models for camera temporal information and target motion,based on imaging mechanisms and target dynamics characteristics.The parameters are optimized simultaneously to achieve trajectory reconstruction without accurate time parameters.Thirdly,we optimize the camera rotations alongside the camera time information and target motion parameters,using tighter and more continuous constraints on moving points.The reconstruction accuracy is significantly improved,especially when the camera rotations are inaccurate.Finally,the simulated and real-world experimental results demonstrate the feasibility and accuracy of the proposed method.The real-world results indicate that the proposed algorithm achieved a localization error of 112.95 m at an observation distance range of 15-20 km.
基金supported by Natural Science Foundation of Jilin Province(20210101468JC)Chinese Academy of Sciences and Local Government Cooperation Project(2023SYHZ0027,23SH04)National Natural Science Foundation of China(12273063&12203078)。
文摘Observatories typically deploy all-sky cameras for monitoring cloud cover and weather conditions.However,many of these cameras lack scientific-grade sensors,r.esulting in limited photometric precision,which makes calculating the sky area visibility distribution via extinction measurement challenging.To address this issue,we propose the Photometry-Free Sky Area Visibility Estimation(PFSAVE)method.This method uses the standard magnitude of the faintest star observed within a given sky area to estimate visibility.By employing a pertransformation refitting optimization strategy,we achieve a high-precision coordinate transformation model with an accuracy of 0.42 pixels.Using the results of HEALPix segmentation is also introduced to achieve high spatial resolution.Comprehensive analysis based on real allsky images demonstrates that our method exhibits higher accuracy than the extinction-based method.Our method supports both manual and robotic dynamic scheduling,especially under partially cloudy conditions.
基金supported by the National Natural Science Foundation of China(No.52474172).
文摘It is important to understand the development of joints and fractures in rock masses to ensure drilling stability and blasting effectiveness.Traditional manual observation techniques for identifying and extracting fracture characteristics have been proven to be inefficient and prone to subjective interpretation.Moreover,conventional image processing algorithms and classical deep learning models often encounter difficulties in accurately identifying fracture areas,resulting in unclear contours.This study proposes an intelligent method for detecting internal fractures in mine rock masses to address these challenges.The proposed approach captures a nodal fracture map within the targeted blast area and integrates channel and spatial attention mechanisms into the ResUnet(RU)model.The channel attention mechanism dynamically recalibrates the importance of each feature channel,and the spatial attention mechanism enhances feature representation in key areas while minimizing background noise,thus improving segmentation accuracy.A dynamic serpentine convolution module is also introduced that adaptively adjusts the shape and orientation of the convolution kernel based on the local structure of the input feature map.Furthermore,this method enables the automatic extraction and quantification of borehole nodal fracture information by fitting sinusoidal curves to the boundaries of the fracture contours using the least squares method.In comparison to other advanced deep learning models,our enhanced RU demonstrates superior performance across evaluation metrics,including accuracy,pixel accuracy(PA),and intersection over union(IoU).Unlike traditional manual extraction methods,our intelligent detection approach provides considerable time and cost savings,with an average error rate of approximately 4%.This approach has the potential to greatly improve the efficiency of geological surveys of borehole fractures.
基金funded by the Ministry of Education and Training Project(code number:B2023-TCT-08).
文摘This study presents a drone-based aerial imaging method for automated rice seedling detection and counting in paddy fields.Utilizing a drone equipped with a high-resolution camera,images are captured 14 days postsowing at a consistent altitude of six meters,employing autonomous flight for uniform data acquisition.The approach effectively addresses the distinct growth patterns of both single and clustered rice seedlings at this early stage.The methodology follows a two-step process:first,the GoogleNet deep learning network identifies the location and center points of rice plants.Then,the U-Net deep learning network performs classification and counting of individual plants and clusters.This combination of deep learning models achieved a 90%accuracy rate in classifying and counting both single and clustered seedlings.To validate the method’s effectiveness,results were compared against traditional manual counting conducted by agricultural experts.The comparison revealed minimal discrepancies,with a variance of only 2–4 clumps per square meter,confirming the reliability of the proposed method.This automated approach offers significant benefits by providing an efficient,accurate,and scalable solution for monitoring seedling growth.It enables farmers to optimize fertilizer and pesticide application,improve resource allocation,and enhance overall crop management,ultimately contributing to increased agricultural productivity.
基金the Shanghai Municipal Education Commission-Gaofeng Clinical Medicine Grant(No.20172005)。
文摘Closed thoracic drainage can be performed using a steel-needle-guided chest tube to treat pleural effusion or pneumothorax in clinics.However,the puncture procedure during surgery is invisible,increasing the risk of surgical failure.Therefore,it is necessary to design a visualization system for closed thoracic drainage.Augmented reality(AR)technology can assist in visualizing the internal anatomical structure and determining the insertion point on the body surface.The structure of the currently used steel-needle-guided chest tube was modified by integrating it with an ultrafine diameter camera to provide real-time visualization of the puncture process.After simulation experiments,the overall registration error of the AR method was measured to be within(3.59±0.53)mm,indicating its potential for clinical application.The ultrafine diameter camera module and improved steel-needle-guided chest tube can timely reflect the position of the needle tip in the human body.A comparative experiment showed that video guidance could improve the safety of the puncture process compared to the traditional method.Finally,a qualitative evaluation of the usability of the system was conducted through a questionnaire.This system facilitates the visualization of closed thoracic drainage puncture procedure and pro-vides an implementation scheme to enhance the accuracy and safety of the operative step,which is conducive to reducing the learning curve and improving the proficiency of the doctors.
基金Natural Science Foundation of Hunan Province,China(No.2024JJ8335)Open Topic of Hunan Geospatial Information Engineering and Technology Research Center,China(No.HNGIET2023004).
文摘The estimation of orientation parameters and correction of lens distortion are crucial problems in the field of Unmanned Aerial Vehicles(UAVs)photogrammetry.In recent years,the utilization of UAVs for aerial photogrammetry has witnessed a surge in popularity.Typically,UAVs are equipped with low-cost non-metric cameras and a Position and Orientation System(POS).Unfortunately,the Interior Orientation Parameters(IOPs)of the non-metric cameras are not fixed.Whether the lens distortions are large or small,they effect the image coordinates accordingly.Additionally,Inertial Measurement Units(IMUs)often have observation errors.To address these challenges and improve parameter estimation for UAVs Light Detection and Ranging(LiDAR)and photogrammetry,this paper analyzes the accuracy of POS observations obtained from Global Navigation Satellite System Real Time Kinematic(GNSS-RTK)and IMU data.A method that incorporates additional known conditions for parameter estimation,a series of algorithms to simultaneously solve for IOPs,Exterior Orientation Parameters(EOPs),and camera lens distortion correction parameters are proposed.Extensive experiments demonstrate that the coordinates measured by GNSS-RTK can be directly used as linear EOPs;however,angular EOP measurements from IMUs exhibit relatively large errors compared to adjustment results and require correction during the adjustment process.The IOPs of non-metric cameras vary slightly between images but need to be treated as unknown parameters in high precision applications.Furthermore,it is found that the Ebner systematic error model is sensitive to the choice of the magnification parameter of the photographic baseline length in images,it should be set as less than or equal to one third of the photographic baseline to ensure stable solutions.
文摘Based on diverse landforms, the correlation between soil organic matter content and multi-spectral band of remote sensing image was analyzed in this pa- per. In addition, the inversion models were built for the soil organic matter content in different landforms. The results showed that the spectral reflectance was nega- tively related to soil organic matter content; linear regression analysis of remove was performed throughout the bands using SPSS. When the inversion models were built based on all the bands, better fitting effect was obtained. The precision of in- version models built based on different landforms was higher than those built re- gardless landforms. Compared with the actual value, the identification level of soil organic matter content was 91 65% under the allowable error was 7%. It indicated that the extraction of soil organic matter with inversion model that was built based on different landforrrs was feasible with higher precision.
基金The Pre-Research Foundation of National Ministries andCommissions (No9140A16050109DZ01)the Scientific Research Program of the Education Department of Shanxi Province (No09JK701)
文摘In order to overcome the shortcomings that the reconstructed spectral reflectance may be negative when using the classic principal component analysis （PCA）to reduce the dimensions of the multi-spectral data, a nonnegative constrained principal component analysis method is proposed to construct a low-dimensional multi-spectral space and accomplish the conversion between the new constructed space and the multispectral space. First, the reason behind the negative data is analyzed and a nonnegative constraint is imposed on the classic PCA. Then a set of nonnegative linear independence weight vectors of principal components is obtained, by which a lowdimensional space is constructed. Finally, a nonlinear optimization technique is used to determine the projection vectors of the high-dimensional multi-spectral data in the constructed space. Experimental results show that the proposed method can keep the reconstructed spectral data in [ 0, 1 ]. The precision of the space created by the proposed method is equivalent to or even higher than that by the PCA.
基金Supported by National Natural Science Foundation of China under Grant(No.60968001,61168003)Natural Science Foundation of Yunnan Province under Grant(No.2011FZ079,2009CD047)National Training Programs of Innovation and Entrepreneurship for Undergraduates under Grant(No.201210681005,201310681004)~~
文摘[Objective] The aim of this study was to extract effective feature bands of damaged rice leaves by planthoppers to make identification and classification rapidly from great amounts of imaging spectral data. [Method] The experiment, using multi-spectral imaging system, acquired the multi-spectral images of damaged rice leaves from band 400 to 720 nm by interval of 5 nm. [Result] According to the principle of band index, it was calculated that the bands at 515, 510, 710, 555, 630, 535, 505, 530 and 595 nm were having high band index value with rich information and little correlation. Furthermore, the experiment used two classification methods and calcu-lated the classification accuracy higher than 90.00% for feature bands and ful bands of damaged rice leaves by planthoppers respectively. [Conclusion] It can be con-cluded that these bands can be considered as effective feature bands to identify damaged rice leaves by planthoppers quickly from a large scale of crops.
文摘Histogram of collinear gradient-enhanced coding （HCGEC）, a robust key point descriptor for multi-spectral image matching, is proposed. The HCGEC mainly encodes rough structures within an image and suppresses detailed textural information, which is desirable in multi-spectral image matching. Experiments on two multi-spectral data sets demonstrate that the proposed descriptor can yield significantly better results than some state-of- the-art descriptors.
文摘Image fusion is performed between one band of multi-spectral image and two bands of hyperspectral image to produce fused image with the same spatial resolution as source multi-spectral image and the same spectral resolution as source hyperspeetral image. According to the characteristics and 3-Dimensional （3-D） feature analysis of multi-spectral and hyperspectral image data volume, the new fusion approach using 3-D wavelet based method is proposed. This approach is composed of four major procedures： Spatial and spectral resampling, 3-D wavelet transform, wavelet coefficient integration and 3-D inverse wavelet transform. Especially, a novel method, Ratio Image Based Spectral Resampling （RIBSR）method, is proposed to accomplish data resampling in spectral domain by utilizing the property of ratio image. And a new fusion rule, Average and Substitution （A＆S） rule, is employed as the fusion rule to accomplish wavelet coefficient integration. Experimental results illustrate that the fusion approach using 3-D wavelet transform can utilize both spatial and spectral characteristics of source images more adequately and produce fused image with higher quality and fewer artifacts than fusion approach using 2-D wavelet transform. It is also revealed that RIBSR method is capable of interpolating the missing data more effectively and correctly, and A＆S rule can integrate coefficients of source images in 3-D wavelet domain to preserve both spatial and spectral features of source images more properly.
基金Supported by the National Key R&D Program of China(2016YFD0300610)
文摘To monitor growth and predict the yield of rice over a large area, the chlorophyll contents in the rice canopy were estimated using the unmanned aerial vehicle(UAV) remote sensing technology. In this work, multi-spectral image information of the rice crop was obtained using a 6-channel multi-spectral camera mounted on a fixed wing UAV, which was flown 600 m above the ground, between 11: 00-14: 00 on a sunny day in summer. The measured chlorophyll values were collected as sample sets. The s-REP index was screened out to estimate chlorophyll contents through the analysis of six kinds of spectral indexes of chlorophyll estimated capacity. An inversion model of the chlorophyll contents was then built using the least square support vector regression(LS-SVR)algorithm, with calibration and prediction R-square values of 0.89 and 0.83, respectively. Finally, remote sensing mapping for a UAV image of the Fangzheng County Dexter Rice Planting Park was accomplished using the inversion model. The inversion and measured values were then compared using regression fitting. R-square and root-mean-square error of the fitting model were 0.79 and 2.39,respectively. The results demonstrated that accurate estimation of rice-canopy chlorophyll contents was feasible using the LS-SVR inversion model developed using the s-REP vegetation index.
文摘Evaluation of the impact of herbicides on maize was done through multi- spectral and multi-modal imaging and multi-spectral fluorescence imaging combined with statistical methods. Spectra containing 13 wavelengths ranging from 375 nm to 940 nm were derived from multi-spectral images in transmission, reflection and scattering mode and fluorescence images obtained using high-pass filters (F450 nm, F500 nm, F550 nm, F600 nm, F650 nm) on control maize samples and maize samples treated with Herbextra herbicide were used. The appearance of the spectra allowed us to characterize the effect of the herbicide on the maize pigment concentration. The fluorescence images allowed us to track the fate of absorbed energy and through PLS-DA and SVM-DA to discriminate the two leaf categories with very low error rates for the test, i.e. 4.9% and 2% respectively. The results of this technique can be used in the context of precision agriculture.
基金supported by the National Natural Science Foundation of China(Grant Nos.52373280,52177014,51977009,52273257).
文摘With the diversified development of big data,detection and precision guidance technologies,electromagnetic(EM)functional materials and devices serving multiple spectrums have become a hot topic.Exploring the multispectral response of materials is a challenging and meaningful scientific question.In this study,MXene/TiO_(2)hybrids with tunable conduction loss and polarization relaxation are fabricated by in situ atomic reconstruction engineering.More importantly,MXene/TiO_(2)hybrids exhibit adjustable spectral responses in the GHz,infrared and visible spectrums,and several EM devices are constructed based on this.An antenna array provides excellent EM energy harvesting in multiple microwave bands,with|S11|up to−63.2 dB,and can be tuned by the degree of bending.An ultra-wideband bandpass filter realizes a passband of about 5.4 GHz and effectively suppresses the transmission of EM signals in the stopband.An infrared stealth device has an emissivity of less than 0.2 in the infrared spectrum at wavelengths of 6-14μm.This work can provide new inspiration for the design and development of multifunctional,multi-spectrum EM devices.
基金National Natural Science Foundation of China(NSFC)(No.11775147)Guangdong Basic and Applied Basic Research Foundation(Nos.2019A1515110130 and 2024A1515011832)+1 种基金Shenzhen Key Laboratory of Photonics and Biophotonics(ZDSYS20210623092006020)Shenzhen Science and Technology Program(Nos.JCYJ20210324095007020,JCYJ20200109105201936 and JCYJ20230808105019039).
文摘An ultrafast framing camera with a pulse-dilation device,a microchannel plate(MCP)imager,and an electronic imaging system were reported.The camera achieved a temporal resolution of 10 ps by using a pulse-dilation device and gated MCP imager,and a spatial resolution of 100μm by using an electronic imaging system comprising combined magnetic lenses.The spatial resolution characteristics of the camera were studied both theoretically and experimentally.The results showed that the camera with combined magnetic lenses reduced the field curvature and acquired a larger working area.A working area with a diameter of 53 mm was created by applying four magnetic lenses to the camera.Furthermore,the camera was used to detect the X-rays produced by the laser-targeting device.The diagnostic results indicated that the width of the X-ray pulse was approximately 18 ps.
基金Supported by Key Project of the Tenth Five-Year Plan of the Ministry of Science and Technology of China (2001BA210A02)
文摘Considering the problem of traditional cervical cancer detection method that brings high false negative rate （FNR） and high false positive rate （FPR）, a new abnormal cervical cells detection method of multi-spectral Pap smear is proposed in this thesis, on the basis of multi-spectral microscopic imaging technology and computer automotive recognition technology. At first, image in a specific wave band is segmented according to the relationship between intensity and spectrum of each pixel. Then, multi-spectral features of each pixel are extracted making use of improved cosine correlation analysis （CCA） algorithm. Combined with the characteristic of each cell＇s area, final definition is made. Experiments have proved the new approach could identify abnormal cells efficiently as well as lower FNR and FPR.
