In recent years,three-dimensional reconstruction technologies that employ multiple cameras have continued to evolve significantly,enabling remote collaboration among users in extended Reality(XR)environments.In additi...In recent years,three-dimensional reconstruction technologies that employ multiple cameras have continued to evolve significantly,enabling remote collaboration among users in extended Reality(XR)environments.In addition,methods for deploying multiple cameras for motion capture of users(e.g.,performers)are widely used in computer graphics.As the need to minimize and optimize the number of cameras grows to reduce costs,various technologies and research approaches focused on Optimal Camera Placement(OCP)are continually being proposed.However,as most existing studies assume homogeneous camera setups,there is a growing demand for studies on heterogeneous camera setups.For instance,technical demands keep emerging in scenarios with minimal camera configurations,especially regarding cost factors,the physical placement of cameras given the spatial structure,and image capture strategies for heterogeneous cameras,such as high-resolution RGB cameras and depth cameras.In this study,we propose a pre-visualization and simulation method for the optimal placement of heterogeneous cameras in XR environments,accounting for both the specifications of heterogeneous cameras(e.g.,field of view)and the physical configuration(e.g.,wall configuration)in real-world spaces.The proposed method performs a visibility analysis of cameras by considering each camera’s field-of-view volume,resolution,and unique characteristics,along with physicalspace constraints.This approach enables the optimal position and rotation of each camera to be recommended,along with the minimum number of cameras required.In the results of our study conducted in heterogeneous camera combinations,the proposed method achieved 81.7%~82.7%coverage of the target visual information using only 2~3 cameras.In contrast,single(or homogeneous)-typed cameras were required to use 11 cameras for 81.6%coverage.Accordingly,we found that camera deployment resources can be reduced with the proposed approaches.展开更多
To address the challenges of high-precision optical surface defect detection,we propose a novel design for a wide-field and broadband light field camera in this work.The proposed system can achieve a 50°field of ...To address the challenges of high-precision optical surface defect detection,we propose a novel design for a wide-field and broadband light field camera in this work.The proposed system can achieve a 50°field of view and operates at both visible and near-infrared wavelengths.Using the principles of light field imaging,the proposed design enables 3D reconstruction of optical surfaces,thus enabling vertical surface height measurements with enhanced accuracy.Using Zemax-based simulations,we evaluate the system’s modulation transfer function,its optical aberrations,and its tolerance to shape variations through Zernike coefficient adjustments.The results demonstrate that this camera can achieve the required spatial resolution while also maintaining high imaging quality and thus offers a promising solution for advanced optical surface defect inspection.展开更多
LiDAR and camera are two of the most common sensors used in the fields of robot perception,autonomous driving,augmented reality,and virtual reality,where these sensors are widely used to perform various tasks such as ...LiDAR and camera are two of the most common sensors used in the fields of robot perception,autonomous driving,augmented reality,and virtual reality,where these sensors are widely used to perform various tasks such as odometry estimation and 3D reconstruction.Fusing the information from these two sensors can significantly increase the robustness and accuracy of these perception tasks.The extrinsic calibration between cameras and LiDAR is a fundamental prerequisite for multimodal systems.Recently,extensive studies have been conducted on the calibration of extrinsic parameters.Although several calibration methods facilitate sensor fusion,a comprehensive summary for researchers and,especially,non-expert users is lacking.Thus,we present an overview of extrinsic calibration and discuss diverse calibration methods from the perspective of calibration system design.Based on the calibration information sources,this study classifies these methods as target-based or targetless.For each type of calibration method,further classification was performed according to the diverse types of features or constraints used in the calibration process,and their detailed implementations and key characteristics were introduced.Thereafter,calibration-accuracy evaluation methods are presented.Finally,we comprehensively compare the advantages and disadvantages of each calibration method and suggest directions for practical applications and future research.展开更多
Vascular abnormalities are closely associated with the pathogenesis and progression of numerous diseases, such as thrombosis, tumors, and diabetes. Blood flow velocity serves as a critical biomarker for evaluating per...Vascular abnormalities are closely associated with the pathogenesis and progression of numerous diseases, such as thrombosis, tumors, and diabetes. Blood flow velocity serves as a critical biomarker for evaluating perfusion status. Quantitative detection of full-field blood flow variations in lesion areas holds significant scientific and clinical value for pathological studies,diagnosis, and intraoperative monitoring of related diseases. While laser speckle contrast imaging(LSCI) enables full-field blood flow visualization, its reliance on frame-based sensors necessitates handling massive data volumes, leading to inherent trade-offs among spatiotemporal resolution, real-time performance, and quantitative capabilities. Leveraging the asynchronous dynamic sensing, high temporal sampling rate, and low data redundancy of event cameras, this study proposes a quantitative blood flow imaging method termed laser speckle event imaging(LSEI). Experiments using off-the-shelf event cameras demonstrate that LSEI achieves real-time blood flow imaging with minimal computational overhead compared to frame-based LSCI. Furthermore,we investigate the relationship between event data streams and flow velocity through spatial-temporal autocorrelation analysis,enabling quantitative measurements without compromising temporal or spatial resolution. In in vivo imaging experiments of mouse ear blood flow, LSEI exhibits superior imaging details and real-time performance over conventional methods. The proposed approach holds promise as an efficient tool for diagnosis, therapeutic evaluation, and research on vascular-related diseases.展开更多
Based on diverse landforms, the correlation between soil organic matter content and multi-spectral band of remote sensing image was analyzed in this pa- per. In addition, the inversion models were built for the soil o...Based on diverse landforms, the correlation between soil organic matter content and multi-spectral band of remote sensing image was analyzed in this pa- per. In addition, the inversion models were built for the soil organic matter content in different landforms. The results showed that the spectral reflectance was nega- tively related to soil organic matter content; linear regression analysis of remove was performed throughout the bands using SPSS. When the inversion models were built based on all the bands, better fitting effect was obtained. The precision of in- version models built based on different landforms was higher than those built re- gardless landforms. Compared with the actual value, the identification level of soil organic matter content was 91 65% under the allowable error was 7%. It indicated that the extraction of soil organic matter with inversion model that was built based on different landforrrs was feasible with higher precision.展开更多
In order to overcome the shortcomings that the reconstructed spectral reflectance may be negative when using the classic principal component analysis （PCA）to reduce the dimensions of the multi-spectral data, a nonne...In order to overcome the shortcomings that the reconstructed spectral reflectance may be negative when using the classic principal component analysis （PCA）to reduce the dimensions of the multi-spectral data, a nonnegative constrained principal component analysis method is proposed to construct a low-dimensional multi-spectral space and accomplish the conversion between the new constructed space and the multispectral space. First, the reason behind the negative data is analyzed and a nonnegative constraint is imposed on the classic PCA. Then a set of nonnegative linear independence weight vectors of principal components is obtained, by which a lowdimensional space is constructed. Finally, a nonlinear optimization technique is used to determine the projection vectors of the high-dimensional multi-spectral data in the constructed space. Experimental results show that the proposed method can keep the reconstructed spectral data in [ 0, 1 ]. The precision of the space created by the proposed method is equivalent to or even higher than that by the PCA.展开更多
[Objective] The aim of this study was to extract effective feature bands of damaged rice leaves by planthoppers to make identification and classification rapidly from great amounts of imaging spectral data. [Method] T...[Objective] The aim of this study was to extract effective feature bands of damaged rice leaves by planthoppers to make identification and classification rapidly from great amounts of imaging spectral data. [Method] The experiment, using multi-spectral imaging system, acquired the multi-spectral images of damaged rice leaves from band 400 to 720 nm by interval of 5 nm. [Result] According to the principle of band index, it was calculated that the bands at 515, 510, 710, 555, 630, 535, 505, 530 and 595 nm were having high band index value with rich information and little correlation. Furthermore, the experiment used two classification methods and calcu-lated the classification accuracy higher than 90.00% for feature bands and ful bands of damaged rice leaves by planthoppers respectively. [Conclusion] It can be con-cluded that these bands can be considered as effective feature bands to identify damaged rice leaves by planthoppers quickly from a large scale of crops.展开更多
Histogram of collinear gradient-enhanced coding （HCGEC）, a robust key point descriptor for multi-spectral image matching, is proposed. The HCGEC mainly encodes rough structures within an image and suppresses detaile...Histogram of collinear gradient-enhanced coding （HCGEC）, a robust key point descriptor for multi-spectral image matching, is proposed. The HCGEC mainly encodes rough structures within an image and suppresses detailed textural information, which is desirable in multi-spectral image matching. Experiments on two multi-spectral data sets demonstrate that the proposed descriptor can yield significantly better results than some state-of- the-art descriptors.展开更多
Image fusion is performed between one band of multi-spectral image and two bands of hyperspectral image to produce fused image with the same spatial resolution as source multi-spectral image and the same spectral reso...Image fusion is performed between one band of multi-spectral image and two bands of hyperspectral image to produce fused image with the same spatial resolution as source multi-spectral image and the same spectral resolution as source hyperspeetral image. According to the characteristics and 3-Dimensional （3-D） feature analysis of multi-spectral and hyperspectral image data volume, the new fusion approach using 3-D wavelet based method is proposed. This approach is composed of four major procedures： Spatial and spectral resampling, 3-D wavelet transform, wavelet coefficient integration and 3-D inverse wavelet transform. Especially, a novel method, Ratio Image Based Spectral Resampling （RIBSR）method, is proposed to accomplish data resampling in spectral domain by utilizing the property of ratio image. And a new fusion rule, Average and Substitution （A＆S） rule, is employed as the fusion rule to accomplish wavelet coefficient integration. Experimental results illustrate that the fusion approach using 3-D wavelet transform can utilize both spatial and spectral characteristics of source images more adequately and produce fused image with higher quality and fewer artifacts than fusion approach using 2-D wavelet transform. It is also revealed that RIBSR method is capable of interpolating the missing data more effectively and correctly, and A＆S rule can integrate coefficients of source images in 3-D wavelet domain to preserve both spatial and spectral features of source images more properly.展开更多
To monitor growth and predict the yield of rice over a large area, the chlorophyll contents in the rice canopy were estimated using the unmanned aerial vehicle(UAV) remote sensing technology. In this work, multi-spect...To monitor growth and predict the yield of rice over a large area, the chlorophyll contents in the rice canopy were estimated using the unmanned aerial vehicle(UAV) remote sensing technology. In this work, multi-spectral image information of the rice crop was obtained using a 6-channel multi-spectral camera mounted on a fixed wing UAV, which was flown 600 m above the ground, between 11: 00-14: 00 on a sunny day in summer. The measured chlorophyll values were collected as sample sets. The s-REP index was screened out to estimate chlorophyll contents through the analysis of six kinds of spectral indexes of chlorophyll estimated capacity. An inversion model of the chlorophyll contents was then built using the least square support vector regression(LS-SVR)algorithm, with calibration and prediction R-square values of 0.89 and 0.83, respectively. Finally, remote sensing mapping for a UAV image of the Fangzheng County Dexter Rice Planting Park was accomplished using the inversion model. The inversion and measured values were then compared using regression fitting. R-square and root-mean-square error of the fitting model were 0.79 and 2.39,respectively. The results demonstrated that accurate estimation of rice-canopy chlorophyll contents was feasible using the LS-SVR inversion model developed using the s-REP vegetation index.展开更多
Evaluation of the impact of herbicides on maize was done through multi- spectral and multi-modal imaging and multi-spectral fluorescence imaging combined with statistical methods. Spectra containing 13 wavelengths ran...Evaluation of the impact of herbicides on maize was done through multi- spectral and multi-modal imaging and multi-spectral fluorescence imaging combined with statistical methods. Spectra containing 13 wavelengths ranging from 375 nm to 940 nm were derived from multi-spectral images in transmission, reflection and scattering mode and fluorescence images obtained using high-pass filters (F450 nm, F500 nm, F550 nm, F600 nm, F650 nm) on control maize samples and maize samples treated with Herbextra herbicide were used. The appearance of the spectra allowed us to characterize the effect of the herbicide on the maize pigment concentration. The fluorescence images allowed us to track the fate of absorbed energy and through PLS-DA and SVM-DA to discriminate the two leaf categories with very low error rates for the test, i.e. 4.9% and 2% respectively. The results of this technique can be used in the context of precision agriculture.展开更多
Considering the problem of traditional cervical cancer detection method that brings high false negative rate （FNR） and high false positive rate （FPR）, a new abnormal cervical cells detection method of multi-spectr...Considering the problem of traditional cervical cancer detection method that brings high false negative rate （FNR） and high false positive rate （FPR）, a new abnormal cervical cells detection method of multi-spectral Pap smear is proposed in this thesis, on the basis of multi-spectral microscopic imaging technology and computer automotive recognition technology. At first, image in a specific wave band is segmented according to the relationship between intensity and spectrum of each pixel. Then, multi-spectral features of each pixel are extracted making use of improved cosine correlation analysis （CCA） algorithm. Combined with the characteristic of each cell＇s area, final definition is made. Experiments have proved the new approach could identify abnormal cells efficiently as well as lower FNR and FPR.展开更多
Due to the limitations of spatial bandwidth product and data transmission bandwidth,the field of view,resolution,and imaging speed constrain each other in an optical imaging system.Here,a fast-zoom and high-resolution...Due to the limitations of spatial bandwidth product and data transmission bandwidth,the field of view,resolution,and imaging speed constrain each other in an optical imaging system.Here,a fast-zoom and high-resolution sparse compound-eye camera(CEC)based on dual-end collaborative optimization is proposed,which provides a cost-effective way to break through the trade-off among the field of view,resolution,and imaging speed.In the optical end,a sparse CEC based on liquid lenses is designed,which can realize large-field-of-view imaging in real time,and fast zooming within 5 ms.In the computational end,a disturbed degradation model driven super-resolution network(DDMDSR-Net)is proposed to deal with complex image degradation issues in actual imaging situations,achieving high-robustness and high-fidelity resolution enhancement.Based on the proposed dual-end collaborative optimization framework,the angular resolution of the CEC can be enhanced from 71.6"to 26.0",which provides a solution to realize high-resolution imaging for array camera dispensing with high optical hardware complexity and data transmission bandwidth.Experiments verify the advantages of the CEC based on dual-end collaborative optimization in high-fidelity reconstruction of real scene images,kilometer-level long-distance detection,and dynamic imaging and precise recognition of targets of interest.展开更多
Observatories typically deploy all-sky cameras for monitoring cloud cover and weather conditions.However,many of these cameras lack scientific-grade sensors,r.esulting in limited photometric precision,which makes calc...Observatories typically deploy all-sky cameras for monitoring cloud cover and weather conditions.However,many of these cameras lack scientific-grade sensors,r.esulting in limited photometric precision,which makes calculating the sky area visibility distribution via extinction measurement challenging.To address this issue,we propose the Photometry-Free Sky Area Visibility Estimation(PFSAVE)method.This method uses the standard magnitude of the faintest star observed within a given sky area to estimate visibility.By employing a pertransformation refitting optimization strategy,we achieve a high-precision coordinate transformation model with an accuracy of 0.42 pixels.Using the results of HEALPix segmentation is also introduced to achieve high spatial resolution.Comprehensive analysis based on real allsky images demonstrates that our method exhibits higher accuracy than the extinction-based method.Our method supports both manual and robotic dynamic scheduling,especially under partially cloudy conditions.展开更多
This paper presents a high-speed and robust dual-band infrared thermal camera based on an ARM CPU.The system consists of a low-resolution long-wavelength infrared detector,a digital temperature and humid⁃ity sensor,an...This paper presents a high-speed and robust dual-band infrared thermal camera based on an ARM CPU.The system consists of a low-resolution long-wavelength infrared detector,a digital temperature and humid⁃ity sensor,and a CMOS sensor.In view of the significant contrast between face and background in thermal infra⁃red images,this paper explores a suitable accuracy-latency tradeoff for thermal face detection and proposes a tiny,lightweight detector named YOLO-Fastest-IR.Four YOLO-Fastest-IR models(IR0 to IR3)with different scales are designed based on YOLO-Fastest.To train and evaluate these lightweight models,a multi-user low-resolution thermal face database(RGBT-MLTF)was collected,and the four networks were trained.Experiments demon⁃strate that the lightweight convolutional neural network performs well in thermal infrared face detection tasks.The proposed algorithm outperforms existing face detection methods in both positioning accuracy and speed,making it more suitable for deployment on mobile platforms or embedded devices.After obtaining the region of interest(ROI)in the infrared(IR)image,the RGB camera is guided by the thermal infrared face detection results to achieve fine positioning of the RGB face.Experimental results show that YOLO-Fastest-IR achieves a frame rate of 92.9 FPS on a Raspberry Pi 4B and successfully detects 97.4%of faces in the RGBT-MLTF test set.Ultimate⁃ly,an infrared temperature measurement system with low cost,strong robustness,and high real-time perfor⁃mance was integrated,achieving a temperature measurement accuracy of 0.3℃.展开更多
Blackmagic Camera for iOS 3.2版本可直接从i Phone推流到You Tube、Vimeo和Twitch,无需借助其他硬件或第三方软件,只要选择平台、输入推流密钥,就能以专业质量直播。本次更新还加入了对SRT推流的支持,可以把高质量、低延迟的视频发送...Blackmagic Camera for iOS 3.2版本可直接从i Phone推流到You Tube、Vimeo和Twitch,无需借助其他硬件或第三方软件,只要选择平台、输入推流密钥,就能以专业质量直播。本次更新还加入了对SRT推流的支持,可以把高质量、低延迟的视频发送到Blackmagic Streaming Decoder或其他支持SRT的广电制作系统,非常适合远程制作、新闻采集、活动实况报道。另外,现在用外部存储时会有更清晰的通知信息。当硬盘在录制、待机或上传素材过程中被断开时,警告会立即出现。展开更多
Camera technology advancement and deployment continue to play a vital role in modern life and production,amongst other capabilities,generating relevant visual information.The challenge of optimizing the use and deploy...Camera technology advancement and deployment continue to play a vital role in modern life and production,amongst other capabilities,generating relevant visual information.The challenge of optimizing the use and deployment of camera networks in various applications(e.g.,surveillance,traffic monitoring,and public safety to name but just a few)has attracted considerable attention from both academia and industries.Camera planning is the first step in addressing this challenge.The surveillance objectives and scenes of a camera network dictate the modelling and optimization algorithms for camera planning.However,existing reviews have primarily focused on models or optimization algorithms,with insufficient attention given to surveillance scenes.This review aims to bridge this gap by 1)Classifying surveillance scenes into the urban environment and rural outdoor environment and comparing the surveillance requirements and challenges;2)Summarizing the details of camera coverage optimization in the relevant literature from the perspective of deployment scenes;and 3)Proposing a new surveillance scene-Solar Insecticidal Lamps with the Internet of Things—as a case study to analyze the surveillance requirement and challenges in agricultural outdoor environment.Finally,we state the technical outlook on the physical safety of outdoor electronic devices in agriculture settings and provide insights to draw more attention and effort into this area.展开更多
基金supported by the 2024 Research Fund of University of Ulsan.
文摘In recent years,three-dimensional reconstruction technologies that employ multiple cameras have continued to evolve significantly,enabling remote collaboration among users in extended Reality(XR)environments.In addition,methods for deploying multiple cameras for motion capture of users(e.g.,performers)are widely used in computer graphics.As the need to minimize and optimize the number of cameras grows to reduce costs,various technologies and research approaches focused on Optimal Camera Placement(OCP)are continually being proposed.However,as most existing studies assume homogeneous camera setups,there is a growing demand for studies on heterogeneous camera setups.For instance,technical demands keep emerging in scenarios with minimal camera configurations,especially regarding cost factors,the physical placement of cameras given the spatial structure,and image capture strategies for heterogeneous cameras,such as high-resolution RGB cameras and depth cameras.In this study,we propose a pre-visualization and simulation method for the optimal placement of heterogeneous cameras in XR environments,accounting for both the specifications of heterogeneous cameras(e.g.,field of view)and the physical configuration(e.g.,wall configuration)in real-world spaces.The proposed method performs a visibility analysis of cameras by considering each camera’s field-of-view volume,resolution,and unique characteristics,along with physicalspace constraints.This approach enables the optimal position and rotation of each camera to be recommended,along with the minimum number of cameras required.In the results of our study conducted in heterogeneous camera combinations,the proposed method achieved 81.7%~82.7%coverage of the target visual information using only 2~3 cameras.In contrast,single(or homogeneous)-typed cameras were required to use 11 cameras for 81.6%coverage.Accordingly,we found that camera deployment resources can be reduced with the proposed approaches.
基金supported by the Jilin Science and Technology Development Plan (20240101029JJ) for the following study:synchronized high-speed detection of surface shape and defects in the grinding stage of complex surfaces (KLMSZZ202305)for the high-precision wide dynamic large aperture optical inspection system for fine astronomical observation by the National Major Research Instrument Development Project (62127901)+2 种基金for ultrasmooth manufacturing technology of large diameter complex curved surface by the National Key R&D Program(2022YFB3403405)for research on the key technology of rapid synchronous detection of surface shape and subsurface defects in the grinding stage of large diameter complex surfaces by the International Cooperation Project(2025010157)The Key Laboratory of Optical System Advanced Manufacturing Technology,Chinese Academy of Sciences (2022KLOMT02-04) also supported this study
文摘To address the challenges of high-precision optical surface defect detection,we propose a novel design for a wide-field and broadband light field camera in this work.The proposed system can achieve a 50°field of view and operates at both visible and near-infrared wavelengths.Using the principles of light field imaging,the proposed design enables 3D reconstruction of optical surfaces,thus enabling vertical surface height measurements with enhanced accuracy.Using Zemax-based simulations,we evaluate the system’s modulation transfer function,its optical aberrations,and its tolerance to shape variations through Zernike coefficient adjustments.The results demonstrate that this camera can achieve the required spatial resolution while also maintaining high imaging quality and thus offers a promising solution for advanced optical surface defect inspection.
基金Supported by Beijing Natural Science Foundation(Grant No.L241012)the National Natural Science Foundation of China(Grant No.62572468).
文摘LiDAR and camera are two of the most common sensors used in the fields of robot perception,autonomous driving,augmented reality,and virtual reality,where these sensors are widely used to perform various tasks such as odometry estimation and 3D reconstruction.Fusing the information from these two sensors can significantly increase the robustness and accuracy of these perception tasks.The extrinsic calibration between cameras and LiDAR is a fundamental prerequisite for multimodal systems.Recently,extensive studies have been conducted on the calibration of extrinsic parameters.Although several calibration methods facilitate sensor fusion,a comprehensive summary for researchers and,especially,non-expert users is lacking.Thus,we present an overview of extrinsic calibration and discuss diverse calibration methods from the perspective of calibration system design.Based on the calibration information sources,this study classifies these methods as target-based or targetless.For each type of calibration method,further classification was performed according to the diverse types of features or constraints used in the calibration process,and their detailed implementations and key characteristics were introduced.Thereafter,calibration-accuracy evaluation methods are presented.Finally,we comprehensively compare the advantages and disadvantages of each calibration method and suggest directions for practical applications and future research.
基金supported by the National Natural Science Foundation of China (Grant No.12572210)the Scientific Instrument Developing Project of Shenzhen University (Grant Nos.2023YQ011,2024YQ001)the Shenzhen Science and Technology Innovation Commission Project—Stable Support (General Project)(Grant No.20231120175055001)。
文摘Vascular abnormalities are closely associated with the pathogenesis and progression of numerous diseases, such as thrombosis, tumors, and diabetes. Blood flow velocity serves as a critical biomarker for evaluating perfusion status. Quantitative detection of full-field blood flow variations in lesion areas holds significant scientific and clinical value for pathological studies,diagnosis, and intraoperative monitoring of related diseases. While laser speckle contrast imaging(LSCI) enables full-field blood flow visualization, its reliance on frame-based sensors necessitates handling massive data volumes, leading to inherent trade-offs among spatiotemporal resolution, real-time performance, and quantitative capabilities. Leveraging the asynchronous dynamic sensing, high temporal sampling rate, and low data redundancy of event cameras, this study proposes a quantitative blood flow imaging method termed laser speckle event imaging(LSEI). Experiments using off-the-shelf event cameras demonstrate that LSEI achieves real-time blood flow imaging with minimal computational overhead compared to frame-based LSCI. Furthermore,we investigate the relationship between event data streams and flow velocity through spatial-temporal autocorrelation analysis,enabling quantitative measurements without compromising temporal or spatial resolution. In in vivo imaging experiments of mouse ear blood flow, LSEI exhibits superior imaging details and real-time performance over conventional methods. The proposed approach holds promise as an efficient tool for diagnosis, therapeutic evaluation, and research on vascular-related diseases.
文摘Based on diverse landforms, the correlation between soil organic matter content and multi-spectral band of remote sensing image was analyzed in this pa- per. In addition, the inversion models were built for the soil organic matter content in different landforms. The results showed that the spectral reflectance was nega- tively related to soil organic matter content; linear regression analysis of remove was performed throughout the bands using SPSS. When the inversion models were built based on all the bands, better fitting effect was obtained. The precision of in- version models built based on different landforms was higher than those built re- gardless landforms. Compared with the actual value, the identification level of soil organic matter content was 91 65% under the allowable error was 7%. It indicated that the extraction of soil organic matter with inversion model that was built based on different landforrrs was feasible with higher precision.
基金The Pre-Research Foundation of National Ministries andCommissions (No9140A16050109DZ01)the Scientific Research Program of the Education Department of Shanxi Province (No09JK701)
文摘In order to overcome the shortcomings that the reconstructed spectral reflectance may be negative when using the classic principal component analysis （PCA）to reduce the dimensions of the multi-spectral data, a nonnegative constrained principal component analysis method is proposed to construct a low-dimensional multi-spectral space and accomplish the conversion between the new constructed space and the multispectral space. First, the reason behind the negative data is analyzed and a nonnegative constraint is imposed on the classic PCA. Then a set of nonnegative linear independence weight vectors of principal components is obtained, by which a lowdimensional space is constructed. Finally, a nonlinear optimization technique is used to determine the projection vectors of the high-dimensional multi-spectral data in the constructed space. Experimental results show that the proposed method can keep the reconstructed spectral data in [ 0, 1 ]. The precision of the space created by the proposed method is equivalent to or even higher than that by the PCA.
基金Supported by National Natural Science Foundation of China under Grant(No.60968001,61168003)Natural Science Foundation of Yunnan Province under Grant(No.2011FZ079,2009CD047)National Training Programs of Innovation and Entrepreneurship for Undergraduates under Grant(No.201210681005,201310681004)~~
文摘[Objective] The aim of this study was to extract effective feature bands of damaged rice leaves by planthoppers to make identification and classification rapidly from great amounts of imaging spectral data. [Method] The experiment, using multi-spectral imaging system, acquired the multi-spectral images of damaged rice leaves from band 400 to 720 nm by interval of 5 nm. [Result] According to the principle of band index, it was calculated that the bands at 515, 510, 710, 555, 630, 535, 505, 530 and 595 nm were having high band index value with rich information and little correlation. Furthermore, the experiment used two classification methods and calcu-lated the classification accuracy higher than 90.00% for feature bands and ful bands of damaged rice leaves by planthoppers respectively. [Conclusion] It can be con-cluded that these bands can be considered as effective feature bands to identify damaged rice leaves by planthoppers quickly from a large scale of crops.
文摘Histogram of collinear gradient-enhanced coding （HCGEC）, a robust key point descriptor for multi-spectral image matching, is proposed. The HCGEC mainly encodes rough structures within an image and suppresses detailed textural information, which is desirable in multi-spectral image matching. Experiments on two multi-spectral data sets demonstrate that the proposed descriptor can yield significantly better results than some state-of- the-art descriptors.
文摘Image fusion is performed between one band of multi-spectral image and two bands of hyperspectral image to produce fused image with the same spatial resolution as source multi-spectral image and the same spectral resolution as source hyperspeetral image. According to the characteristics and 3-Dimensional （3-D） feature analysis of multi-spectral and hyperspectral image data volume, the new fusion approach using 3-D wavelet based method is proposed. This approach is composed of four major procedures： Spatial and spectral resampling, 3-D wavelet transform, wavelet coefficient integration and 3-D inverse wavelet transform. Especially, a novel method, Ratio Image Based Spectral Resampling （RIBSR）method, is proposed to accomplish data resampling in spectral domain by utilizing the property of ratio image. And a new fusion rule, Average and Substitution （A＆S） rule, is employed as the fusion rule to accomplish wavelet coefficient integration. Experimental results illustrate that the fusion approach using 3-D wavelet transform can utilize both spatial and spectral characteristics of source images more adequately and produce fused image with higher quality and fewer artifacts than fusion approach using 2-D wavelet transform. It is also revealed that RIBSR method is capable of interpolating the missing data more effectively and correctly, and A＆S rule can integrate coefficients of source images in 3-D wavelet domain to preserve both spatial and spectral features of source images more properly.
基金Supported by the National Key R&D Program of China(2016YFD0300610)
文摘To monitor growth and predict the yield of rice over a large area, the chlorophyll contents in the rice canopy were estimated using the unmanned aerial vehicle(UAV) remote sensing technology. In this work, multi-spectral image information of the rice crop was obtained using a 6-channel multi-spectral camera mounted on a fixed wing UAV, which was flown 600 m above the ground, between 11: 00-14: 00 on a sunny day in summer. The measured chlorophyll values were collected as sample sets. The s-REP index was screened out to estimate chlorophyll contents through the analysis of six kinds of spectral indexes of chlorophyll estimated capacity. An inversion model of the chlorophyll contents was then built using the least square support vector regression(LS-SVR)algorithm, with calibration and prediction R-square values of 0.89 and 0.83, respectively. Finally, remote sensing mapping for a UAV image of the Fangzheng County Dexter Rice Planting Park was accomplished using the inversion model. The inversion and measured values were then compared using regression fitting. R-square and root-mean-square error of the fitting model were 0.79 and 2.39,respectively. The results demonstrated that accurate estimation of rice-canopy chlorophyll contents was feasible using the LS-SVR inversion model developed using the s-REP vegetation index.
文摘Evaluation of the impact of herbicides on maize was done through multi- spectral and multi-modal imaging and multi-spectral fluorescence imaging combined with statistical methods. Spectra containing 13 wavelengths ranging from 375 nm to 940 nm were derived from multi-spectral images in transmission, reflection and scattering mode and fluorescence images obtained using high-pass filters (F450 nm, F500 nm, F550 nm, F600 nm, F650 nm) on control maize samples and maize samples treated with Herbextra herbicide were used. The appearance of the spectra allowed us to characterize the effect of the herbicide on the maize pigment concentration. The fluorescence images allowed us to track the fate of absorbed energy and through PLS-DA and SVM-DA to discriminate the two leaf categories with very low error rates for the test, i.e. 4.9% and 2% respectively. The results of this technique can be used in the context of precision agriculture.
基金Supported by Key Project of the Tenth Five-Year Plan of the Ministry of Science and Technology of China (2001BA210A02)
文摘Considering the problem of traditional cervical cancer detection method that brings high false negative rate （FNR） and high false positive rate （FPR）, a new abnormal cervical cells detection method of multi-spectral Pap smear is proposed in this thesis, on the basis of multi-spectral microscopic imaging technology and computer automotive recognition technology. At first, image in a specific wave band is segmented according to the relationship between intensity and spectrum of each pixel. Then, multi-spectral features of each pixel are extracted making use of improved cosine correlation analysis （CCA） algorithm. Combined with the characteristic of each cell＇s area, final definition is made. Experiments have proved the new approach could identify abnormal cells efficiently as well as lower FNR and FPR.
基金financial supports from National Natural Science Foundation of China(Grant Nos.U23A20368 and 62175006)Academic Excellence Foundation of BUAA for PhD Students.
文摘Due to the limitations of spatial bandwidth product and data transmission bandwidth,the field of view,resolution,and imaging speed constrain each other in an optical imaging system.Here,a fast-zoom and high-resolution sparse compound-eye camera(CEC)based on dual-end collaborative optimization is proposed,which provides a cost-effective way to break through the trade-off among the field of view,resolution,and imaging speed.In the optical end,a sparse CEC based on liquid lenses is designed,which can realize large-field-of-view imaging in real time,and fast zooming within 5 ms.In the computational end,a disturbed degradation model driven super-resolution network(DDMDSR-Net)is proposed to deal with complex image degradation issues in actual imaging situations,achieving high-robustness and high-fidelity resolution enhancement.Based on the proposed dual-end collaborative optimization framework,the angular resolution of the CEC can be enhanced from 71.6"to 26.0",which provides a solution to realize high-resolution imaging for array camera dispensing with high optical hardware complexity and data transmission bandwidth.Experiments verify the advantages of the CEC based on dual-end collaborative optimization in high-fidelity reconstruction of real scene images,kilometer-level long-distance detection,and dynamic imaging and precise recognition of targets of interest.
基金supported by Natural Science Foundation of Jilin Province(20210101468JC)Chinese Academy of Sciences and Local Government Cooperation Project(2023SYHZ0027,23SH04)National Natural Science Foundation of China(12273063&12203078)。
文摘Observatories typically deploy all-sky cameras for monitoring cloud cover and weather conditions.However,many of these cameras lack scientific-grade sensors,r.esulting in limited photometric precision,which makes calculating the sky area visibility distribution via extinction measurement challenging.To address this issue,we propose the Photometry-Free Sky Area Visibility Estimation(PFSAVE)method.This method uses the standard magnitude of the faintest star observed within a given sky area to estimate visibility.By employing a pertransformation refitting optimization strategy,we achieve a high-precision coordinate transformation model with an accuracy of 0.42 pixels.Using the results of HEALPix segmentation is also introduced to achieve high spatial resolution.Comprehensive analysis based on real allsky images demonstrates that our method exhibits higher accuracy than the extinction-based method.Our method supports both manual and robotic dynamic scheduling,especially under partially cloudy conditions.
基金Supported by the Fundamental Research Funds for the Central Universities(2024300443)the Natural Science Foundation of Jiangsu Province(BK20241224).
文摘This paper presents a high-speed and robust dual-band infrared thermal camera based on an ARM CPU.The system consists of a low-resolution long-wavelength infrared detector,a digital temperature and humid⁃ity sensor,and a CMOS sensor.In view of the significant contrast between face and background in thermal infra⁃red images,this paper explores a suitable accuracy-latency tradeoff for thermal face detection and proposes a tiny,lightweight detector named YOLO-Fastest-IR.Four YOLO-Fastest-IR models(IR0 to IR3)with different scales are designed based on YOLO-Fastest.To train and evaluate these lightweight models,a multi-user low-resolution thermal face database(RGBT-MLTF)was collected,and the four networks were trained.Experiments demon⁃strate that the lightweight convolutional neural network performs well in thermal infrared face detection tasks.The proposed algorithm outperforms existing face detection methods in both positioning accuracy and speed,making it more suitable for deployment on mobile platforms or embedded devices.After obtaining the region of interest(ROI)in the infrared(IR)image,the RGB camera is guided by the thermal infrared face detection results to achieve fine positioning of the RGB face.Experimental results show that YOLO-Fastest-IR achieves a frame rate of 92.9 FPS on a Raspberry Pi 4B and successfully detects 97.4%of faces in the RGBT-MLTF test set.Ultimate⁃ly,an infrared temperature measurement system with low cost,strong robustness,and high real-time perfor⁃mance was integrated,achieving a temperature measurement accuracy of 0.3℃.
文摘Blackmagic Camera for iOS 3.2版本可直接从i Phone推流到You Tube、Vimeo和Twitch,无需借助其他硬件或第三方软件,只要选择平台、输入推流密钥,就能以专业质量直播。本次更新还加入了对SRT推流的支持,可以把高质量、低延迟的视频发送到Blackmagic Streaming Decoder或其他支持SRT的广电制作系统,非常适合远程制作、新闻采集、活动实况报道。另外,现在用外部存储时会有更清晰的通知信息。当硬盘在录制、待机或上传素材过程中被断开时,警告会立即出现。
基金supported by the National Natural Science Foundation of China(62072248).
文摘Camera technology advancement and deployment continue to play a vital role in modern life and production,amongst other capabilities,generating relevant visual information.The challenge of optimizing the use and deployment of camera networks in various applications(e.g.,surveillance,traffic monitoring,and public safety to name but just a few)has attracted considerable attention from both academia and industries.Camera planning is the first step in addressing this challenge.The surveillance objectives and scenes of a camera network dictate the modelling and optimization algorithms for camera planning.However,existing reviews have primarily focused on models or optimization algorithms,with insufficient attention given to surveillance scenes.This review aims to bridge this gap by 1)Classifying surveillance scenes into the urban environment and rural outdoor environment and comparing the surveillance requirements and challenges;2)Summarizing the details of camera coverage optimization in the relevant literature from the perspective of deployment scenes;and 3)Proposing a new surveillance scene-Solar Insecticidal Lamps with the Internet of Things—as a case study to analyze the surveillance requirement and challenges in agricultural outdoor environment.Finally,we state the technical outlook on the physical safety of outdoor electronic devices in agriculture settings and provide insights to draw more attention and effort into this area.
