Accurate mapping of wetlands is crucial for wetlands conservation, as well as for monitoring and assessing coastal resources and the environment. Multispectral(MSI) satellite image time series have rich temporal evolu...Accurate mapping of wetlands is crucial for wetlands conservation, as well as for monitoring and assessing coastal resources and the environment. Multispectral(MSI) satellite image time series have rich temporal evolution characteristics, which can reveal dynamic changes in surface cover and environmental conditions. However, due to the limited number of bands, the ability to express the difference of ground features is limited, resulting in an inability to capture surface objects' changes in the finer spectral range. Therefore,this paper proposed a dual-branch spatial-temporal spectral feature fusion network(Fusion-Former), which combined MSI time series data with hyperspectral(HSI) data to achieve accurate mapping of wetlands in Liaohe River Delta, China in 2022. Fusion-Former achieved an overall accuracy(OA) of 96.36% in the Liaohe River Delta wetland, significantly outperforming all benchmark methods.Experimental results demonstrate that utilizing the temporal phenological information from multi-temporal MSI and the fine-grained spatial-spectral features from HSI can effectively resolve the misclassification between spectrally similar vegetation and water bodies.Furthermore, a continuous improvement in accuracy was observed as the length of the input time series increased, underscoring the critical role of temporal information. Therefore, by integrating these complementary information sources, the proposed method enables the generation of accurate wetland maps to support decision-makers in formulating more precise conservation and management strategies.展开更多
In recent years,the rapid advancement of artificial intelligence(AI)technology has enabled AI-assisted negative screening to significantly enhance physicians'efficiency through image feature analysis and multimoda...In recent years,the rapid advancement of artificial intelligence(AI)technology has enabled AI-assisted negative screening to significantly enhance physicians'efficiency through image feature analysis and multimodal data modeling,allowing them to focus more on diagnosing positive cases.Meanwhile,multispectral imaging(MSI)integrates spectral and spatial resolution to capture subtle tissue features invisible to the human eye,providing high-resolution data support for pathological analysis.Combining AI technology with MSI and employing quantitative methods to analyze multiband biomarkers(such as absorbance differences in keratin pearls)can effectively improve diagnostic specificity and reduce subjective errors in manual slide interpretation.To address the challenge of identifying negative tissue sections,we developed a discrimination algorithm powered by MSI.We demonstrated its efficacy using cutaneous squamous cell carcinoma(cSCC)as a representative case study.The algorithm achieved 100%accuracy in excluding negative cases and effectively mitigated the false-positive problem caused by cSCC heterogeneity.We constructed a multispectral image(MSI)dataset acquired at 520 nm,600 nm,and 630 nm wavelengths.Subsequently,we employed an optimized MobileViT model for tissue classification and performed comparative analyses against other models.The experimental results showed that our optimized MobileViT model achieved superior performance in identifying negative tissue sections,with a perfect accuracy rate of 100%.Thus,our results confirm the feasibility of integrating MSI with AI to exclude negative cases with perfect accuracy,offering a novel solution to alleviate the workload of pathologists.展开更多
Cemented paste backfill(CPB)is a technology that achieves safe mining by filling the goaf with waste rocks,tailings,and other materials.It is an inevitable choice to deal with the development of deep and highly diffic...Cemented paste backfill(CPB)is a technology that achieves safe mining by filling the goaf with waste rocks,tailings,and other materials.It is an inevitable choice to deal with the development of deep and highly difficult mines and meet the requirements of environmental protection and safety regulations.It promotes the development of a circular economy in mines through the development of lowgrade resources and the resource utilization of waste,and extends the service life of mines.The mass concentration of solid content(abbreviated as“concentration”)is a critical parameter for CPB.However,discrepancies often arise between the on-site measurements and the pre-designed values due to factors such as groundwater inflow and segregation within the goaf,which cannot be evaluated after the solidification of CPB.This paper innovatively provides an in-situ non-destructive approach to identify the real concentration of CPB after curing for certain days using hyperspectral imaging(HSI)technology.Initially,the spectral variation patterns under different concentration conditions were investigated through hyperspectral scanning experiments on CPB samples.The results demonstrate that as the CPB concentration increases from 61wt%to 73wt%,the overall spectral reflectance gradually increases,with two distinct absorption peaks observed at 1407 and 1917 nm.Notably,the reflectance at 1407 nm exhibited a strong linear relationship with the concentration.Subsequently,the K-nearest neighbors(KNN)and support vector machine(SVM)algorithms were employed to classify and identify different concentrations.The study revealed that,with the KNN algorithm,the highest accuracy was achieved when K(number of nearest neighbors)was 1,although this resulted in overfitting.When K=3,the model displayed the optimal balance between accuracy and stability,with an accuracy of 95.03%.In the SVM algorithm,the highest accuracy of 98.24%was attained with parameters C(regularization parameter)=200 and Gamma(kernel coefficient)=10.A comparative analysis of precision,accuracy,and recall further highlighted that the SVM provided superior stability and precision for identifying CPB concentration.Thus,HSI technology offers an effective solution for the in-situ,non-destructive monitoring of CPB concentration,presenting a promising approach for optimizing and controlling CPB characteristic parameters.展开更多
This review summarizes studies of hydrothermal alteration minerals at the Qiucun gold deposit in southeastern China and focuses on characterization and mapping of the deposit using hyperspectral remote sensing.The dep...This review summarizes studies of hydrothermal alteration minerals at the Qiucun gold deposit in southeastern China and focuses on characterization and mapping of the deposit using hyperspectral remote sensing.The deposit exhibits multistage fluid-rock interaction,as evidenced by systematic alteration assemblages,including silicification,sericitization by white micas,the development of argillaceous clays,variable chloritization,and locally significant carbonate alteration.We describe the genetic importance of such mineral groups and emphasize their diagnostic Visible and Near-Infrared to Short-Wave Infrared(VNIR-SWIR)spectral signatures,especially Al-OH,Mg-OH/Fe-OH,and CO3 absorption bands,which make it possible to distinguish between minerals,not to mention the fact that,in some instances,compositional trends may be predicted.This review’s methodological advances are discussed beginning with data collection at satellite,airborne,and ground levels,proceeding to processing procedures,such as atmospheric and topographic correction,and culminating in spectral analysis,including continuum removal,spectral matching,and unmixing/classification techniques.An integrated study of hyperspectral findings reveals that alteration minerals develop spatially coherent zones that are strongly controlled by fault/fracture structures and host-rock reactivity,producing proximal silicification/sericitization cores and larger silicified/larcenies of argillaceous rocks owing to diverse apex coverings of carbonate.This should be combined with petrography and geochemistry to address overprinting,mixed pixels,and surface weathering,and to couple mineral maps with ore-forming processes.The review finds that hyperspectral remote sensing offers a solid modeling platform for the deposit-scale alteration at Qiucun and other hydrothermal gold systems,and outlines the directions for future research to integrate quantitatively and more threedimensional alteration characterization.展开更多
Also known as imaging spectroscopy,hyperspectral remote sensing is becoming a key technology for ecosystem and natural resource management sustainability.Hyperspectral observations can be used to measure tens to hundr...Also known as imaging spectroscopy,hyperspectral remote sensing is becoming a key technology for ecosystem and natural resource management sustainability.Hyperspectral observations can be used to measure tens to hundreds of narrow bands of reflected radiation to resolve diagnostic absorption bands and spectral shape variations associated with vegetation pigments,water status of the canopy,biochemical composition,mineralogies,and organic matter of the soil,and water quality constituents of aquatic water.These abilities allow one to make a transition between the descriptive mapping and the functional monitoring,the anticipation of stress and disturbance early,and the more accurate attribution of environmental change.This summary encompasses improvements on the entire sensor-to-product pipeline,including field and UAV(Unmanned Aerial Vehicle)system platform developments,airborne campaign and spaceborne mission developments,calibration and analysis-ready preprocessing improvements,empirical learning methodology improvements,radiative transfer-based inversion method,spectral unmixing,deep learning,and hybrid physics-machine learning.We underline the increased importance of the combination of data with LiDAR(Light Detection and Ranging),SAR(Synthetic Aperture Radar),and thermal features aimed at decreasing the level of ambiguity and enhancing operational resilience.Applications based on decision are evaluated in terms of biodiversity and habitat evaluation,vegetation functionality and restoration,stress and disturbance,sustainable agricultural production,inland water quality and coastal water quality,land degradation and soil status,and environmental impact assessment.Inhibiting factors to operational adoption have always been perceived to be domain shift by region,season,and sensor,ground truth and validation,mixed pixels and scale mismatch,preprocessing sensitivities,and desirable uncertainty quantification and product output that is interpretable.We conclude with the scalability,sustainability,service priorities,such as harmonization standards,representative benchmarking,uncertainty-aware delivery,and co-design of stakeholders.展开更多
Hyperspectral remote sensing has emerged as a transformative technology for sustainable natural resource management by providing unprecedented insight into the biochemical,biophysical,and compositional properties of E...Hyperspectral remote sensing has emerged as a transformative technology for sustainable natural resource management by providing unprecedented insight into the biochemical,biophysical,and compositional properties of Earth’s surface.The high spectral resolution of hyperspectral sensors allows a very specific discrimination of materials,monitoring of environmental stress at a very early stage,and provides quantitative retrieval of ecological and geochemical parameters in a wide range of landscapes.The booming technology in sensor design,machine learning,spectral unmixing,and multi-sensor data fusion has further improved the analysis potential and application of imaging spectroscopy to a large extent.This paper involves a discussion of the oversight of such technological advances and the manner in which they are utilized in the principal fields that include forestry,agriculture,water,mineral exploration,and coastal ecosystems.Case studies allow us to identify the potential practical consequences of both spaceborne and unmanned aerial vehicles(UAV)-based hyperspectral systems and AI-based workflows that can be used to aid in more efficient and accurate environmental review.Even though the issues associated with data volume,atmospheric impacts,lack of uniformity in the calibration process,and socioeconomic limits continue to exist,the new technology in sensor miniaturization,cloud computing,and artificial intelligence indicates a fast-changing environment.All these developments make hyperspectral remote sensing a key instrument in solving global sustainability problems and evidence-based management of natural resources in an evolving world.展开更多
Hyperspectral images(HSIs)are susceptible to various noise interferences during the imaging process,leading to degraded image quality and affecting the accuracy of information extraction.Efficient denoising methods ar...Hyperspectral images(HSIs)are susceptible to various noise interferences during the imaging process,leading to degraded image quality and affecting the accuracy of information extraction.Efficient denoising methods are crucial for ensuring the accuracy of subsequent remote sensing analysis and applications.In view of the characteristics of hyperspectral image data,such as high dimensionality,strong spectral correlation,and high computational complexity,a threedimensional visual state space U-Net(VSSU3D)was proposed in this paper.By introducing a visual state space module into the traditional U-Net,and combining the spatial-spectral characteristics of hyperspectral images with the core idea of the Mamba model,targeted optimizations wereachieved to effectively model global information dependencies while reducing computational complexity.Additionally,a simplified channel attention module was embedded between the encoder and decoder to enhance cross-scale feature fusion capabilities.Experimental results on multiple publicly available hyperspectral image datasets demonstrated that VSSU3D achieved denoising performance comparable to or superior to existing advanced methods,which verified its effectiveness.展开更多
Mapping forests is an important process in managing natural resources.At present,due to spectral resolution limitations,multispectral images do not give a complete separation between different forest species.In contra...Mapping forests is an important process in managing natural resources.At present,due to spectral resolution limitations,multispectral images do not give a complete separation between different forest species.In contrast,advances in remote sensing technologies have provided hyperspectral tools and images as a solution for the determination of species.In this study,spectral signatures for stone pine（Pinus pinea L.） forests were collected using an advanced spectroradiometer ＂ASD FieldSpec 4 Hi-Res＂ with an accuracy of 1 nm.These spectral signatures are used to compare between different multispectral and hyperspectral satellite images.The comparison is based on processing satellite images： hyperspectral Hyperion,hyperspectral CHRIS-Proba,Advanced Land Imager（ALI）,and Landsat 8.Enhancement and classification methods for hyperspectral and multispectral images are investigated and analyzed.In addition,a well-known hyperspectral image classification algorithm,spectral angle mapper（SAM）,has been improved to perform the classification process efficiently based on collected spectral signatures.The results show that the modified SAM is 9% more accurate than the conventional SAM.In addition,experiments indicate that the CHRIS-Proba image is more accurate than Landsat 8（overall accuracy 82%,precision 93%,and Kappa coefficient 0.43 compared to 60,67%,and 0.035,respectively）.Similarly,Hyperion is better than ALI in mapping stone pine（overall accuracy 92%,precision 97%,and Kappa coefficient 0.74 compared to 52,56%,and -0.032,respectively）.展开更多
Graph learning,when used as a semi-supervised learning(SSL)method,performs well for classification tasks with a low label rate.We provide a graph-based batch active learning pipeline for pixel/patch neighborhood multi...Graph learning,when used as a semi-supervised learning(SSL)method,performs well for classification tasks with a low label rate.We provide a graph-based batch active learning pipeline for pixel/patch neighborhood multi-or hyperspectral image segmentation.Our batch active learning approach selects a collection of unlabeled pixels that satisfy a graph local maximum constraint for the active learning acquisition function that determines the relative importance of each pixel to the classification.This work builds on recent advances in the design of novel active learning acquisition functions(e.g.,the Model Change approach in arXiv:2110.07739)while adding important further developments including patch-neighborhood image analysis and batch active learning methods to further increase the accuracy and greatly increase the computational efficiency of these methods.In addition to improvements in the accuracy,our approach can greatly reduce the number of labeled pixels needed to achieve the same level of the accuracy based on randomly selected labeled pixels.展开更多
Urban tree species provide various essential ecosystem services in cities,such as regulating urban temperatures,reducing noise,capturing carbon,and mitigating the urban heat island effect.The quality of these services...Urban tree species provide various essential ecosystem services in cities,such as regulating urban temperatures,reducing noise,capturing carbon,and mitigating the urban heat island effect.The quality of these services is influenced by species diversity,tree health,and the distribution and the composition of trees.Traditionally,data on urban trees has been collected through field surveys and manual interpretation of remote sensing images.In this study,we evaluated the effectiveness of multispectral airborne laser scanning(ALS)data in classifying 24 common urban roadside tree species in Espoo,Finland.Tree crown structure information,intensity features,and spectral data were used for classification.Eight different machine learning algorithms were tested,with the extra trees(ET)algorithm performing the best,achieving an overall accuracy of 71.7%using multispectral LiDAR data.This result highlights that integrating structural and spectral information within a single framework can improve the classification accuracy.Future research will focus on identifying the most important features for species classification and developing algorithms with greater efficiency and accuracy.展开更多
The cleanliness of seed cotton plays a critical role in the pre-treatment of cotton textiles,and the removal of impurity during the harvesting process directly determines the quality and market value of cotton textile...The cleanliness of seed cotton plays a critical role in the pre-treatment of cotton textiles,and the removal of impurity during the harvesting process directly determines the quality and market value of cotton textiles.By fusing band combination optimization with deep learning,this study aims to achieve more efficient and accurate detection of film impurities in seed cotton on the production line.By applying hyperspectral imaging and a one-dimensional deep learning algorithm,we detect and classify impurities in seed cotton after harvest.The main categories detected include pure cotton,conveyor belt,film covering seed cotton,and film adhered to the conveyor belt.The proposed method achieves an impurity detection rate of 99.698%.To further ensure the feasibility and practical application potential of this strategy,we compare our results against existing mainstream methods.In addition,the model shows excellent recognition performance on pseudo-color images of real samples.With a processing time of 11.764μs per pixel from experimental data,it shows a much improved speed requirement while maintaining the accuracy of real production lines.This strategy provides an accurate and efficient method for removing impurities during cotton processing.展开更多
Hyper Spectral Image Super-Resolution(HSI-SR) has gained significant attention in recent years due to its potential applications.However,the challenge of obtaining high-resolution hyperspectral images is compounded by...Hyper Spectral Image Super-Resolution(HSI-SR) has gained significant attention in recent years due to its potential applications.However,the challenge of obtaining high-resolution hyperspectral images is compounded by limitations in sensor resolution and the high dimensionality of spectral data.Traditional approaches,including interpolation-based methods and sparse representation techniques,often struggle to capture the intricate spectral-spatial dependencies in hyperspectral images.To address these limitations,this study proposes a Hadamard Self-Attention Network(HSAN) for fusing a High-resolution Multispectral Image(Hr-MSI) and a Low-resolution Hyper Spectral Image(Lr-HSI),achieving HSI-SR for obtaining a High-resolution Hyper Spectral Image(Hr-HSI).The core of HSAN is a new Hadamard self-attention mechanism that can be more efficient than traditional dot-product attention because it avoids matrix multiplications and softmax operations.Considering that deep learning-based data fusion typically entails a significant computational and storage burden,this new approach can be integrated with convolutional layers to form an unsupervised lightweight network,which significantly reduces dependence on computational resources.Experimental results across four datasets validate the effectiveness and advantages of HSAN,compared with state-of-the-art approaches.The source code will be available at https://github.com/zxnhkdm/HSAN.展开更多
In this study,eight different varieties of maize seeds were used as the research objects.Conduct 81 types of combined preprocessing on the original spectra.Through comparison,Savitzky-Golay(SG)-multivariate scattering...In this study,eight different varieties of maize seeds were used as the research objects.Conduct 81 types of combined preprocessing on the original spectra.Through comparison,Savitzky-Golay(SG)-multivariate scattering correction(MSC)-maximum-minimum normalization(MN)was identified as the optimal preprocessing technique.The competitive adaptive reweighted sampling(CARS),successive projections algorithm(SPA),and their combined methods were employed to extract feature wavelengths.Classification models based on back propagation(BP),support vector machine(SVM),random forest(RF),and partial least squares(PLS)were established using full-band data and feature wavelengths.Among all models,the(CARS-SPA)-BP model achieved the highest accuracy rate of 98.44%.This study offers novel insights and methodologies for the rapid and accurate identification of corn seeds as well as other crop seeds.展开更多
Multispectral imaging plays a crucial role in simultaneously capturing detailed spatial and spectral information,which is fundamental for understanding complex phenomena across various domains.Traditional systems face...Multispectral imaging plays a crucial role in simultaneously capturing detailed spatial and spectral information,which is fundamental for understanding complex phenomena across various domains.Traditional systems face significant challenges,such as large volume,static function,and limited wavelength selectivity.Here,we propose an innovative dynamic reflective multispectral imaging system via a thermally responsive cholesteric liquid crystal based planar lens.By employing advanced photoalignment technology,the phase distribution of a lens is imprinted to the liquid crystal director.The reflection band is reversibly tuned from 450 nm to 750 nm by thermally controlling the helical pitch of the cholesteric liquid crystal,allowing selectively capturing images in different colors.This capability increases imaging versatility,showing great potential in precision agriculture for assessing crop health,noninvasive diagnostics in healthcare,and advanced remote sensing for environmental monitoring.展开更多
Imaging hyperspectral technology has distinctive advantages of non-destructive and non-contact measurement,and the integration of spectral and spatial data.These characteristics present new methodologies for intellige...Imaging hyperspectral technology has distinctive advantages of non-destructive and non-contact measurement,and the integration of spectral and spatial data.These characteristics present new methodologies for intelligent geological sensing in tunnels and other underground engineering projects.However,the in situ acquisition and rapid classification of hyperspectral images in underground still faces great challenges,including the difficulty in obtaining uniform hyperspectral images and the complexity of deploying sophisticated models on mobile platforms.This study proposes an intelligent lithology identification method based on partition feature extraction of hyperspectral images.Firstly,pixel-level hyperspectral information from representative lithological regions is extracted and fused to obtain rock hyperspectral image partition features.Subsequently,an SG-SNV-PCA-DNN(SSPD)model specifically designed for optimizing rock hyperspectral data,performing spectral dimensionality reduction,and identifying lithology is integrated.In an experimental study involving 3420 hyperspectral images,the SSPD identification model achieved the highest accuracy in the testing set,reaching 98.77%.Moreover,the speed of the SSPD model was found to be 18.5%faster than that of the unprocessed model,with an accuracy improvement of 5.22%.In contrast,the ResNet-101 model,used for point-by-point identification based on non-partitioned features,achieved a maximum accuracy of 97.86%in the testing set.In addition,the partition feature extraction methods significantly reduce computational complexity.An objective evaluation of various models demonstrated that the SSPD model exhibited superior performance,achieving a precision(P)of 99.46%,a recall(R)of 99.44%,and F1 score(F1)of 99.45%.Additionally,a pioneering in situ detection work was carried out in a tunnel using underground hyperspectral imaging technology.展开更多
In recent years,camouflage technology has evolved from single-spectral-band applications to multifunctional and multispectral implementations.Hyperspectral imaging has emerged as a powerful technique for target identi...In recent years,camouflage technology has evolved from single-spectral-band applications to multifunctional and multispectral implementations.Hyperspectral imaging has emerged as a powerful technique for target identification due to its capacity to capture both spectral and spatial information.The advancement of imaging spectroscopy technology has significantly enhanced reconnaissance capabilities,offering substantial advantages in camouflaged target classification and detection.However,the increasing spectral similarity between camouflaged targets and their backgrounds has significantly compromised detection performance in specific scenarios.Conventional feature extraction methods are often limited to single,shallow spectral or spatial features,failing to extract deep features and consequently yielding suboptimal classification accuracy.To address these limitations,this study proposes an innovative 3D-2D convolutional neural networks architecture incorporating depthwise separable convolution(DSC)and attention mechanisms(AM).The framework first applies dimensionality reduction to hyperspectral images and extracts preliminary spectral-spatial features.It then employs an alternating combination of 3D and 2D convolutions for deep feature extraction.For target classification,the LogSoftmax function is implemented.The integration of depthwise separable convolution not only enhances classification accuracy but also substantially reduces model parameters.Furthermore,the attention mechanisms significantly improve the network's ability to represent multidimensional features.Extensive experiments were conducted on a custom land-based hyperspectral image dataset.The results demonstrate remarkable classification accuracy:98.74%for grassland camouflage,99.13%for dead leaf camouflage and 98.94%for wild grass camouflage.Comparative analysis shows that the proposed framework is outstanding in terms of classification accuracy and robustness for camouflage target classification.展开更多
Crop leaf area index(LAI)and biomass are two major biophysical parameters to measure crop growth and health condition.Measuring LAI and biomass in field experiments is a destructive method.Therefore,we focused on the ...Crop leaf area index(LAI)and biomass are two major biophysical parameters to measure crop growth and health condition.Measuring LAI and biomass in field experiments is a destructive method.Therefore,we focused on the application of unmanned aerial vehicles(UAVs)in agriculture,which is a cost and labor-efficientmethod.Hence,UAV-captured multispectral images were applied to monitor crop growth,identify plant bio-physical conditions,and so on.In this study,we monitored soybean crops using UAV and field experiments.This experiment was conducted at theMAFES(Mississippi Agricultural and Forestry Experiment Station)Pontotoc Ridge-Flatwoods Branch Experiment Station.It followed a randomized block design with five cover crops:Cereal Rye,Vetch,Wheat,MC:mixed Mustard and Cereal Rye,and native vegetation.Planting was made in the fall,and three fertilizer treatments were applied:Synthetic Fertilizer,Poultry Litter,and none,applied before planting the soybean,in a full factorial combination.We monitored soybean reproductive phases at R3(initial pod development),R5(initial seed development),R6(full seed development),and R7(initial maturity)and used UAV multispectral remote sensing for soybean LAI and biomass estimations.The major goal of this study was to assess LAI and biomass estimations from UAV multispectral images in the reproductive stages when the development of leaves and biomass was stabilized.Wemade about fourteen vegetation indices(VIs)fromUAVmultispectral images at these stages to estimate LAI and biomass.Wemodeled LAI and biomass based on these remotely sensed VIs and ground-truth measurements usingmachine learning methods,including linear regression,Random Forest(RF),and support vector regression(SVR).Thereafter,the models were applied to estimate LAI and biomass.According to the model results,LAI was better estimated at the R6 stage and biomass at the R3 stage.Compared to the other models,the RF models showed better estimation,i.e.,an R^(2) of about 0.58–0.68 with an RMSE(rootmean square error)of 0.52–0.60(m^(2)/m^(2))for the LAI and about 0.44–0.64 for R^(2) and 21–26(g dry weight/5 plants)for RMSE of biomass estimation.We performed a leave-one-out cross-validation.Based on cross-validatedmodels with field experiments,we also found that the R6 stage was the best for estimating LAI,and the R3 stage for estimating crop biomass.The cross-validated RF model showed the estimation ability with an R^(2) about 0.25–0.44 and RMSE of 0.65–0.85(m^(2)/m^(2))for LAI estimation;and R^(2) about 0.1–0.31 and an RMSE of about 28–35(g dry weight/5 plants)for crop biomass estimation.This result will be helpful to promote the use of non-destructive remote sensing methods to determine the crop LAI and biomass status,which may bring more efficient crop production and management.展开更多
In hyperspectral image classification(HSIC),accurately extracting spatial and spectral information from hyperspectral images(HSI)is crucial for achieving precise classification.However,due to low spatial resolution an...In hyperspectral image classification(HSIC),accurately extracting spatial and spectral information from hyperspectral images(HSI)is crucial for achieving precise classification.However,due to low spatial resolution and complex category boundary,mixed pixels containing features from multiple classes are inevitable in HSIs.Additionally,the spectral similarity among different classes challenge for extracting distinctive spectral features essential for HSIC.To address the impact of mixed pixels and spectral similarity for HSIC,we propose a central-pixel guiding sub-pixel and sub-channel convolution network(CP-SPSC)to extract more precise spatial and spectral features.Firstly,we designed spatial attention(CP-SPA)and spectral attention(CP-SPE)informed by the central pixel to effectively reduce spectral interference of irrelevant categories in the same patch.Furthermore,we use CP-SPA to guide 2D sub-pixel convolution(SPConv2d)to capture spatial features finer than the pixel level.Meanwhile,CP-SPE is also utilized to guide 1D sub-channel con-volution(SCConv1d)in selecting more precise spectral channels.For fusing spatial and spectral information at the feature-level,the spectral feature extension transformation module(SFET)adopts mirror-padding and snake permutation to transform 1D spectral information of the center pixel into 2D spectral features.Experiments on three popular datasets demonstrate that ours out-performs several state-of-the-art methods in accuracy.展开更多
Multispectral imaging,which simultaneously captures the spatial and spectral information of a scene,is widely used across diverse fields,including remote sensing,biomedical imaging,and agricultural monitoring.We intro...Multispectral imaging,which simultaneously captures the spatial and spectral information of a scene,is widely used across diverse fields,including remote sensing,biomedical imaging,and agricultural monitoring.We introduce a snapshot multispectral imaging approach employing a standard monochrome image sensor with no additional spectral filters or customized components.Our system leverages the inherent chromatic aberration of wavelength-dependent defocusing as a natural source of physical encoding of multispectral information;this encoded image information is rapidly decoded via a deep learning-based multispectral Fourier imager network(mFIN).We experimentally tested our method with six illumination bands and demonstrated an overall accuracy of 98.25%for predicting the illumination channels at the input and achieved a robust multispectral image reconstruction on various test objects.This deep learning-powered framework achieves high-quality multispectral image reconstruction using snapshot image acquisition with a monochrome image sensor and could be useful for applications in biomedicine,industrial quality control,and agriculture,among others.展开更多
Spartina alterniflora's robust reproductive capacity has enabled it to spread rapidly, posing a serious threat to native ecosystems in China. Therefore, accurate quantification of Spartina alterniflora aboveground...Spartina alterniflora's robust reproductive capacity has enabled it to spread rapidly, posing a serious threat to native ecosystems in China. Therefore, accurate quantification of Spartina alterniflora aboveground biomass at a fine scale is crucial for understanding its growth dynamics and managing its invasion. This study focuses on the coastal wetlands of central Jiangsu Province, China, utilizing multispectral unmanned aerial vehicle(UAV) data to map the distribution of Spartina alterniflora. Object-based image analysis(OBIA) combined with support vector machines(SVM) was employed for classification. Additionally, multiple regression models, including univariate, band-based, vegetation index(VI)-based, and multivariate linear regression models integrating both band and VI data, were developed to estimate biomass:(1) the Bands + VIs multiple linear regression model based on fresh weight exhibited the highest estimation accuracy;(2) the optimal model achieved R^(2) values of 0.81 and 0.82 at Dafeng and Tiaozini Nature Reserve,with RMSE values of 591.78 g/m^(2) and 337.62 g/m^(2), and MAE values of 576.82 g/m^(2) and 287.71 g/m^(2), respectively;and(3) the aboveground biomass of Spartina alterniflora primarily ranged from 994.60 g/m^(2) to 5 351.48 g/m^(2) at Dafeng and from 796.05 g/m^(2) to 1 994.02 g/m^(2) in Tiaozini Nature Reserve. These findings highlight the effectiveness of multispectral UAV technology for accurately estimating Spartina alterniflora biomass, providing a robust methodology for wetland vegetation monitoring and invasive species management.展开更多
基金Under the auspices of the National Natural Science Foundation of China(No.42471380,42325104,42101350)。
文摘Accurate mapping of wetlands is crucial for wetlands conservation, as well as for monitoring and assessing coastal resources and the environment. Multispectral(MSI) satellite image time series have rich temporal evolution characteristics, which can reveal dynamic changes in surface cover and environmental conditions. However, due to the limited number of bands, the ability to express the difference of ground features is limited, resulting in an inability to capture surface objects' changes in the finer spectral range. Therefore,this paper proposed a dual-branch spatial-temporal spectral feature fusion network(Fusion-Former), which combined MSI time series data with hyperspectral(HSI) data to achieve accurate mapping of wetlands in Liaohe River Delta, China in 2022. Fusion-Former achieved an overall accuracy(OA) of 96.36% in the Liaohe River Delta wetland, significantly outperforming all benchmark methods.Experimental results demonstrate that utilizing the temporal phenological information from multi-temporal MSI and the fine-grained spatial-spectral features from HSI can effectively resolve the misclassification between spectrally similar vegetation and water bodies.Furthermore, a continuous improvement in accuracy was observed as the length of the input time series increased, underscoring the critical role of temporal information. Therefore, by integrating these complementary information sources, the proposed method enables the generation of accurate wetland maps to support decision-makers in formulating more precise conservation and management strategies.
基金funded by the Natural Science Foundation of Shanghai Municipality(No.21ZR1440500)the Shanghai Science and Technology Commission(Grant No.21S31902700).
文摘In recent years,the rapid advancement of artificial intelligence(AI)technology has enabled AI-assisted negative screening to significantly enhance physicians'efficiency through image feature analysis and multimodal data modeling,allowing them to focus more on diagnosing positive cases.Meanwhile,multispectral imaging(MSI)integrates spectral and spatial resolution to capture subtle tissue features invisible to the human eye,providing high-resolution data support for pathological analysis.Combining AI technology with MSI and employing quantitative methods to analyze multiband biomarkers(such as absorbance differences in keratin pearls)can effectively improve diagnostic specificity and reduce subjective errors in manual slide interpretation.To address the challenge of identifying negative tissue sections,we developed a discrimination algorithm powered by MSI.We demonstrated its efficacy using cutaneous squamous cell carcinoma(cSCC)as a representative case study.The algorithm achieved 100%accuracy in excluding negative cases and effectively mitigated the false-positive problem caused by cSCC heterogeneity.We constructed a multispectral image(MSI)dataset acquired at 520 nm,600 nm,and 630 nm wavelengths.Subsequently,we employed an optimized MobileViT model for tissue classification and performed comparative analyses against other models.The experimental results showed that our optimized MobileViT model achieved superior performance in identifying negative tissue sections,with a perfect accuracy rate of 100%.Thus,our results confirm the feasibility of integrating MSI with AI to exclude negative cases with perfect accuracy,offering a novel solution to alleviate the workload of pathologists.
基金funded by the National Natural Science Foundation of China(Nos.52474165 and 52522404)。
文摘Cemented paste backfill(CPB)is a technology that achieves safe mining by filling the goaf with waste rocks,tailings,and other materials.It is an inevitable choice to deal with the development of deep and highly difficult mines and meet the requirements of environmental protection and safety regulations.It promotes the development of a circular economy in mines through the development of lowgrade resources and the resource utilization of waste,and extends the service life of mines.The mass concentration of solid content(abbreviated as“concentration”)is a critical parameter for CPB.However,discrepancies often arise between the on-site measurements and the pre-designed values due to factors such as groundwater inflow and segregation within the goaf,which cannot be evaluated after the solidification of CPB.This paper innovatively provides an in-situ non-destructive approach to identify the real concentration of CPB after curing for certain days using hyperspectral imaging(HSI)technology.Initially,the spectral variation patterns under different concentration conditions were investigated through hyperspectral scanning experiments on CPB samples.The results demonstrate that as the CPB concentration increases from 61wt%to 73wt%,the overall spectral reflectance gradually increases,with two distinct absorption peaks observed at 1407 and 1917 nm.Notably,the reflectance at 1407 nm exhibited a strong linear relationship with the concentration.Subsequently,the K-nearest neighbors(KNN)and support vector machine(SVM)algorithms were employed to classify and identify different concentrations.The study revealed that,with the KNN algorithm,the highest accuracy was achieved when K(number of nearest neighbors)was 1,although this resulted in overfitting.When K=3,the model displayed the optimal balance between accuracy and stability,with an accuracy of 95.03%.In the SVM algorithm,the highest accuracy of 98.24%was attained with parameters C(regularization parameter)=200 and Gamma(kernel coefficient)=10.A comparative analysis of precision,accuracy,and recall further highlighted that the SVM provided superior stability and precision for identifying CPB concentration.Thus,HSI technology offers an effective solution for the in-situ,non-destructive monitoring of CPB concentration,presenting a promising approach for optimizing and controlling CPB characteristic parameters.
基金supported by the Jiangsu Province Frontier Leading Technology Basic Research Special Project-Research on the New Optoelectronic Imaging and Information Processing Basic Theory and Method(No:BK20192003).
文摘This review summarizes studies of hydrothermal alteration minerals at the Qiucun gold deposit in southeastern China and focuses on characterization and mapping of the deposit using hyperspectral remote sensing.The deposit exhibits multistage fluid-rock interaction,as evidenced by systematic alteration assemblages,including silicification,sericitization by white micas,the development of argillaceous clays,variable chloritization,and locally significant carbonate alteration.We describe the genetic importance of such mineral groups and emphasize their diagnostic Visible and Near-Infrared to Short-Wave Infrared(VNIR-SWIR)spectral signatures,especially Al-OH,Mg-OH/Fe-OH,and CO3 absorption bands,which make it possible to distinguish between minerals,not to mention the fact that,in some instances,compositional trends may be predicted.This review’s methodological advances are discussed beginning with data collection at satellite,airborne,and ground levels,proceeding to processing procedures,such as atmospheric and topographic correction,and culminating in spectral analysis,including continuum removal,spectral matching,and unmixing/classification techniques.An integrated study of hyperspectral findings reveals that alteration minerals develop spatially coherent zones that are strongly controlled by fault/fracture structures and host-rock reactivity,producing proximal silicification/sericitization cores and larger silicified/larcenies of argillaceous rocks owing to diverse apex coverings of carbonate.This should be combined with petrography and geochemistry to address overprinting,mixed pixels,and surface weathering,and to couple mineral maps with ore-forming processes.The review finds that hyperspectral remote sensing offers a solid modeling platform for the deposit-scale alteration at Qiucun and other hydrothermal gold systems,and outlines the directions for future research to integrate quantitatively and more threedimensional alteration characterization.
文摘Also known as imaging spectroscopy,hyperspectral remote sensing is becoming a key technology for ecosystem and natural resource management sustainability.Hyperspectral observations can be used to measure tens to hundreds of narrow bands of reflected radiation to resolve diagnostic absorption bands and spectral shape variations associated with vegetation pigments,water status of the canopy,biochemical composition,mineralogies,and organic matter of the soil,and water quality constituents of aquatic water.These abilities allow one to make a transition between the descriptive mapping and the functional monitoring,the anticipation of stress and disturbance early,and the more accurate attribution of environmental change.This summary encompasses improvements on the entire sensor-to-product pipeline,including field and UAV(Unmanned Aerial Vehicle)system platform developments,airborne campaign and spaceborne mission developments,calibration and analysis-ready preprocessing improvements,empirical learning methodology improvements,radiative transfer-based inversion method,spectral unmixing,deep learning,and hybrid physics-machine learning.We underline the increased importance of the combination of data with LiDAR(Light Detection and Ranging),SAR(Synthetic Aperture Radar),and thermal features aimed at decreasing the level of ambiguity and enhancing operational resilience.Applications based on decision are evaluated in terms of biodiversity and habitat evaluation,vegetation functionality and restoration,stress and disturbance,sustainable agricultural production,inland water quality and coastal water quality,land degradation and soil status,and environmental impact assessment.Inhibiting factors to operational adoption have always been perceived to be domain shift by region,season,and sensor,ground truth and validation,mixed pixels and scale mismatch,preprocessing sensitivities,and desirable uncertainty quantification and product output that is interpretable.We conclude with the scalability,sustainability,service priorities,such as harmonization standards,representative benchmarking,uncertainty-aware delivery,and co-design of stakeholders.
基金supported by the Shandong Province Higher Education Institutions New Technology R&D Platform—Spatiotemporal IoT Cloud Application New Technology R&D Center,Shandong Vocational Education Skill Master Studio—Zhao Yaqian Skill Master Studio,and Shandong University of Engineering and Vocational Technology.
文摘Hyperspectral remote sensing has emerged as a transformative technology for sustainable natural resource management by providing unprecedented insight into the biochemical,biophysical,and compositional properties of Earth’s surface.The high spectral resolution of hyperspectral sensors allows a very specific discrimination of materials,monitoring of environmental stress at a very early stage,and provides quantitative retrieval of ecological and geochemical parameters in a wide range of landscapes.The booming technology in sensor design,machine learning,spectral unmixing,and multi-sensor data fusion has further improved the analysis potential and application of imaging spectroscopy to a large extent.This paper involves a discussion of the oversight of such technological advances and the manner in which they are utilized in the principal fields that include forestry,agriculture,water,mineral exploration,and coastal ecosystems.Case studies allow us to identify the potential practical consequences of both spaceborne and unmanned aerial vehicles(UAV)-based hyperspectral systems and AI-based workflows that can be used to aid in more efficient and accurate environmental review.Even though the issues associated with data volume,atmospheric impacts,lack of uniformity in the calibration process,and socioeconomic limits continue to exist,the new technology in sensor miniaturization,cloud computing,and artificial intelligence indicates a fast-changing environment.All these developments make hyperspectral remote sensing a key instrument in solving global sustainability problems and evidence-based management of natural resources in an evolving world.
文摘Hyperspectral images(HSIs)are susceptible to various noise interferences during the imaging process,leading to degraded image quality and affecting the accuracy of information extraction.Efficient denoising methods are crucial for ensuring the accuracy of subsequent remote sensing analysis and applications.In view of the characteristics of hyperspectral image data,such as high dimensionality,strong spectral correlation,and high computational complexity,a threedimensional visual state space U-Net(VSSU3D)was proposed in this paper.By introducing a visual state space module into the traditional U-Net,and combining the spatial-spectral characteristics of hyperspectral images with the core idea of the Mamba model,targeted optimizations wereachieved to effectively model global information dependencies while reducing computational complexity.Additionally,a simplified channel attention module was embedded between the encoder and decoder to enhance cross-scale feature fusion capabilities.Experimental results on multiple publicly available hyperspectral image datasets demonstrated that VSSU3D achieved denoising performance comparable to or superior to existing advanced methods,which verified its effectiveness.
基金funded by the Lebanese National Council for Scientific Research(Mapping Stone Pine Forests in Lebanon)
文摘Mapping forests is an important process in managing natural resources.At present,due to spectral resolution limitations,multispectral images do not give a complete separation between different forest species.In contrast,advances in remote sensing technologies have provided hyperspectral tools and images as a solution for the determination of species.In this study,spectral signatures for stone pine（Pinus pinea L.） forests were collected using an advanced spectroradiometer ＂ASD FieldSpec 4 Hi-Res＂ with an accuracy of 1 nm.These spectral signatures are used to compare between different multispectral and hyperspectral satellite images.The comparison is based on processing satellite images： hyperspectral Hyperion,hyperspectral CHRIS-Proba,Advanced Land Imager（ALI）,and Landsat 8.Enhancement and classification methods for hyperspectral and multispectral images are investigated and analyzed.In addition,a well-known hyperspectral image classification algorithm,spectral angle mapper（SAM）,has been improved to perform the classification process efficiently based on collected spectral signatures.The results show that the modified SAM is 9% more accurate than the conventional SAM.In addition,experiments indicate that the CHRIS-Proba image is more accurate than Landsat 8（overall accuracy 82%,precision 93%,and Kappa coefficient 0.43 compared to 60,67%,and 0.035,respectively）.Similarly,Hyperion is better than ALI in mapping stone pine（overall accuracy 92%,precision 97%,and Kappa coefficient 0.74 compared to 52,56%,and -0.032,respectively）.
基金supported by the UC-National Lab In-Residence Graduate Fellowship Grant L21GF3606supported by a DOD National Defense Science and Engineering Graduate(NDSEG)Research Fellowship+1 种基金supported by the Laboratory Directed Research and Development program of Los Alamos National Laboratory under project numbers 20170668PRD1 and 20210213ERsupported by the NGA under Contract No.HM04762110003.
文摘Graph learning,when used as a semi-supervised learning(SSL)method,performs well for classification tasks with a low label rate.We provide a graph-based batch active learning pipeline for pixel/patch neighborhood multi-or hyperspectral image segmentation.Our batch active learning approach selects a collection of unlabeled pixels that satisfy a graph local maximum constraint for the active learning acquisition function that determines the relative importance of each pixel to the classification.This work builds on recent advances in the design of novel active learning acquisition functions(e.g.,the Model Change approach in arXiv:2110.07739)while adding important further developments including patch-neighborhood image analysis and batch active learning methods to further increase the accuracy and greatly increase the computational efficiency of these methods.In addition to improvements in the accuracy,our approach can greatly reduce the number of labeled pixels needed to achieve the same level of the accuracy based on randomly selected labeled pixels.
文摘Urban tree species provide various essential ecosystem services in cities,such as regulating urban temperatures,reducing noise,capturing carbon,and mitigating the urban heat island effect.The quality of these services is influenced by species diversity,tree health,and the distribution and the composition of trees.Traditionally,data on urban trees has been collected through field surveys and manual interpretation of remote sensing images.In this study,we evaluated the effectiveness of multispectral airborne laser scanning(ALS)data in classifying 24 common urban roadside tree species in Espoo,Finland.Tree crown structure information,intensity features,and spectral data were used for classification.Eight different machine learning algorithms were tested,with the extra trees(ET)algorithm performing the best,achieving an overall accuracy of 71.7%using multispectral LiDAR data.This result highlights that integrating structural and spectral information within a single framework can improve the classification accuracy.Future research will focus on identifying the most important features for species classification and developing algorithms with greater efficiency and accuracy.
基金supported in part by the Six Talent Peaks Project in Jiangsu Province under Grant 013040315in part by the China Textile Industry Federation Science and Technology Guidance Project under Grant 2017107+1 种基金in part by the National Natural Science Foundation of China under Grant 31570714in part by the China Scholarship Council under Grant 202108320290。
文摘The cleanliness of seed cotton plays a critical role in the pre-treatment of cotton textiles,and the removal of impurity during the harvesting process directly determines the quality and market value of cotton textiles.By fusing band combination optimization with deep learning,this study aims to achieve more efficient and accurate detection of film impurities in seed cotton on the production line.By applying hyperspectral imaging and a one-dimensional deep learning algorithm,we detect and classify impurities in seed cotton after harvest.The main categories detected include pure cotton,conveyor belt,film covering seed cotton,and film adhered to the conveyor belt.The proposed method achieves an impurity detection rate of 99.698%.To further ensure the feasibility and practical application potential of this strategy,we compare our results against existing mainstream methods.In addition,the model shows excellent recognition performance on pseudo-color images of real samples.With a processing time of 11.764μs per pixel from experimental data,it shows a much improved speed requirement while maintaining the accuracy of real production lines.This strategy provides an accurate and efficient method for removing impurities during cotton processing.
基金National Natural Science Foundation of China(No. 42571463)Macao Young Scholars Program(No. AM2023033)+1 种基金Shaanxi Province Youth Science and Technology Star Program(No. 2024ZCKJXX-115)Natural Science Foundation of Shaanxi Province(No.2025JC-YBMS-257)。
文摘Hyper Spectral Image Super-Resolution(HSI-SR) has gained significant attention in recent years due to its potential applications.However,the challenge of obtaining high-resolution hyperspectral images is compounded by limitations in sensor resolution and the high dimensionality of spectral data.Traditional approaches,including interpolation-based methods and sparse representation techniques,often struggle to capture the intricate spectral-spatial dependencies in hyperspectral images.To address these limitations,this study proposes a Hadamard Self-Attention Network(HSAN) for fusing a High-resolution Multispectral Image(Hr-MSI) and a Low-resolution Hyper Spectral Image(Lr-HSI),achieving HSI-SR for obtaining a High-resolution Hyper Spectral Image(Hr-HSI).The core of HSAN is a new Hadamard self-attention mechanism that can be more efficient than traditional dot-product attention because it avoids matrix multiplications and softmax operations.Considering that deep learning-based data fusion typically entails a significant computational and storage burden,this new approach can be integrated with convolutional layers to form an unsupervised lightweight network,which significantly reduces dependence on computational resources.Experimental results across four datasets validate the effectiveness and advantages of HSAN,compared with state-of-the-art approaches.The source code will be available at https://github.com/zxnhkdm/HSAN.
基金supported by the Science and Technology Development Plan Project of Jilin Provincial Department of Science and Technology (No.20220203112S)the Jilin Provincial Department of Education Science and Technology Research Project (No.JJKH20210039KJ)。
文摘In this study,eight different varieties of maize seeds were used as the research objects.Conduct 81 types of combined preprocessing on the original spectra.Through comparison,Savitzky-Golay(SG)-multivariate scattering correction(MSC)-maximum-minimum normalization(MN)was identified as the optimal preprocessing technique.The competitive adaptive reweighted sampling(CARS),successive projections algorithm(SPA),and their combined methods were employed to extract feature wavelengths.Classification models based on back propagation(BP),support vector machine(SVM),random forest(RF),and partial least squares(PLS)were established using full-band data and feature wavelengths.Among all models,the(CARS-SPA)-BP model achieved the highest accuracy rate of 98.44%.This study offers novel insights and methodologies for the rapid and accurate identification of corn seeds as well as other crop seeds.
基金supported by the National Key Research and Development Program of China(No.2022YFA1203700)the National Natural Science Foundation of China(NSFC)(Nos.62405129 and 62035008)+1 种基金the University Research Project of Guangzhou Education Bureau(No.202235053)the Natural Science Foundation of Jiangsu Province(No.BK20241197).
文摘Multispectral imaging plays a crucial role in simultaneously capturing detailed spatial and spectral information,which is fundamental for understanding complex phenomena across various domains.Traditional systems face significant challenges,such as large volume,static function,and limited wavelength selectivity.Here,we propose an innovative dynamic reflective multispectral imaging system via a thermally responsive cholesteric liquid crystal based planar lens.By employing advanced photoalignment technology,the phase distribution of a lens is imprinted to the liquid crystal director.The reflection band is reversibly tuned from 450 nm to 750 nm by thermally controlling the helical pitch of the cholesteric liquid crystal,allowing selectively capturing images in different colors.This capability increases imaging versatility,showing great potential in precision agriculture for assessing crop health,noninvasive diagnostics in healthcare,and advanced remote sensing for environmental monitoring.
基金support from the National Natural Science Foundation of China(Grant Nos.52379103,52279103)the Natural Science Foundation of Shandong Province(Grant No.ZR2023YQ049).
文摘Imaging hyperspectral technology has distinctive advantages of non-destructive and non-contact measurement,and the integration of spectral and spatial data.These characteristics present new methodologies for intelligent geological sensing in tunnels and other underground engineering projects.However,the in situ acquisition and rapid classification of hyperspectral images in underground still faces great challenges,including the difficulty in obtaining uniform hyperspectral images and the complexity of deploying sophisticated models on mobile platforms.This study proposes an intelligent lithology identification method based on partition feature extraction of hyperspectral images.Firstly,pixel-level hyperspectral information from representative lithological regions is extracted and fused to obtain rock hyperspectral image partition features.Subsequently,an SG-SNV-PCA-DNN(SSPD)model specifically designed for optimizing rock hyperspectral data,performing spectral dimensionality reduction,and identifying lithology is integrated.In an experimental study involving 3420 hyperspectral images,the SSPD identification model achieved the highest accuracy in the testing set,reaching 98.77%.Moreover,the speed of the SSPD model was found to be 18.5%faster than that of the unprocessed model,with an accuracy improvement of 5.22%.In contrast,the ResNet-101 model,used for point-by-point identification based on non-partitioned features,achieved a maximum accuracy of 97.86%in the testing set.In addition,the partition feature extraction methods significantly reduce computational complexity.An objective evaluation of various models demonstrated that the SSPD model exhibited superior performance,achieving a precision(P)of 99.46%,a recall(R)of 99.44%,and F1 score(F1)of 99.45%.Additionally,a pioneering in situ detection work was carried out in a tunnel using underground hyperspectral imaging technology.
文摘In recent years,camouflage technology has evolved from single-spectral-band applications to multifunctional and multispectral implementations.Hyperspectral imaging has emerged as a powerful technique for target identification due to its capacity to capture both spectral and spatial information.The advancement of imaging spectroscopy technology has significantly enhanced reconnaissance capabilities,offering substantial advantages in camouflaged target classification and detection.However,the increasing spectral similarity between camouflaged targets and their backgrounds has significantly compromised detection performance in specific scenarios.Conventional feature extraction methods are often limited to single,shallow spectral or spatial features,failing to extract deep features and consequently yielding suboptimal classification accuracy.To address these limitations,this study proposes an innovative 3D-2D convolutional neural networks architecture incorporating depthwise separable convolution(DSC)and attention mechanisms(AM).The framework first applies dimensionality reduction to hyperspectral images and extracts preliminary spectral-spatial features.It then employs an alternating combination of 3D and 2D convolutions for deep feature extraction.For target classification,the LogSoftmax function is implemented.The integration of depthwise separable convolution not only enhances classification accuracy but also substantially reduces model parameters.Furthermore,the attention mechanisms significantly improve the network's ability to represent multidimensional features.Extensive experiments were conducted on a custom land-based hyperspectral image dataset.The results demonstrate remarkable classification accuracy:98.74%for grassland camouflage,99.13%for dead leaf camouflage and 98.94%for wild grass camouflage.Comparative analysis shows that the proposed framework is outstanding in terms of classification accuracy and robustness for camouflage target classification.
基金This research was supported in part by a postdoctoral research fellow appointment to the Agricultural Research Service(ARS)Research Participation Program administered by the Oak Ridge Institute for Science and Education(ORISE)through an interagency agreement between the U.S.Department of Energy(DOE)and the U.S.Department of Agriculture(USDA).
文摘Crop leaf area index(LAI)and biomass are two major biophysical parameters to measure crop growth and health condition.Measuring LAI and biomass in field experiments is a destructive method.Therefore,we focused on the application of unmanned aerial vehicles(UAVs)in agriculture,which is a cost and labor-efficientmethod.Hence,UAV-captured multispectral images were applied to monitor crop growth,identify plant bio-physical conditions,and so on.In this study,we monitored soybean crops using UAV and field experiments.This experiment was conducted at theMAFES(Mississippi Agricultural and Forestry Experiment Station)Pontotoc Ridge-Flatwoods Branch Experiment Station.It followed a randomized block design with five cover crops:Cereal Rye,Vetch,Wheat,MC:mixed Mustard and Cereal Rye,and native vegetation.Planting was made in the fall,and three fertilizer treatments were applied:Synthetic Fertilizer,Poultry Litter,and none,applied before planting the soybean,in a full factorial combination.We monitored soybean reproductive phases at R3(initial pod development),R5(initial seed development),R6(full seed development),and R7(initial maturity)and used UAV multispectral remote sensing for soybean LAI and biomass estimations.The major goal of this study was to assess LAI and biomass estimations from UAV multispectral images in the reproductive stages when the development of leaves and biomass was stabilized.Wemade about fourteen vegetation indices(VIs)fromUAVmultispectral images at these stages to estimate LAI and biomass.Wemodeled LAI and biomass based on these remotely sensed VIs and ground-truth measurements usingmachine learning methods,including linear regression,Random Forest(RF),and support vector regression(SVR).Thereafter,the models were applied to estimate LAI and biomass.According to the model results,LAI was better estimated at the R6 stage and biomass at the R3 stage.Compared to the other models,the RF models showed better estimation,i.e.,an R^(2) of about 0.58–0.68 with an RMSE(rootmean square error)of 0.52–0.60(m^(2)/m^(2))for the LAI and about 0.44–0.64 for R^(2) and 21–26(g dry weight/5 plants)for RMSE of biomass estimation.We performed a leave-one-out cross-validation.Based on cross-validatedmodels with field experiments,we also found that the R6 stage was the best for estimating LAI,and the R3 stage for estimating crop biomass.The cross-validated RF model showed the estimation ability with an R^(2) about 0.25–0.44 and RMSE of 0.65–0.85(m^(2)/m^(2))for LAI estimation;and R^(2) about 0.1–0.31 and an RMSE of about 28–35(g dry weight/5 plants)for crop biomass estimation.This result will be helpful to promote the use of non-destructive remote sensing methods to determine the crop LAI and biomass status,which may bring more efficient crop production and management.
基金supported by the National Natural Science Foundation of China(No.62071323).
文摘In hyperspectral image classification(HSIC),accurately extracting spatial and spectral information from hyperspectral images(HSI)is crucial for achieving precise classification.However,due to low spatial resolution and complex category boundary,mixed pixels containing features from multiple classes are inevitable in HSIs.Additionally,the spectral similarity among different classes challenge for extracting distinctive spectral features essential for HSIC.To address the impact of mixed pixels and spectral similarity for HSIC,we propose a central-pixel guiding sub-pixel and sub-channel convolution network(CP-SPSC)to extract more precise spatial and spectral features.Firstly,we designed spatial attention(CP-SPA)and spectral attention(CP-SPE)informed by the central pixel to effectively reduce spectral interference of irrelevant categories in the same patch.Furthermore,we use CP-SPA to guide 2D sub-pixel convolution(SPConv2d)to capture spatial features finer than the pixel level.Meanwhile,CP-SPE is also utilized to guide 1D sub-channel con-volution(SCConv1d)in selecting more precise spectral channels.For fusing spatial and spectral information at the feature-level,the spectral feature extension transformation module(SFET)adopts mirror-padding and snake permutation to transform 1D spectral information of the center pixel into 2D spectral features.Experiments on three popular datasets demonstrate that ours out-performs several state-of-the-art methods in accuracy.
文摘Multispectral imaging,which simultaneously captures the spatial and spectral information of a scene,is widely used across diverse fields,including remote sensing,biomedical imaging,and agricultural monitoring.We introduce a snapshot multispectral imaging approach employing a standard monochrome image sensor with no additional spectral filters or customized components.Our system leverages the inherent chromatic aberration of wavelength-dependent defocusing as a natural source of physical encoding of multispectral information;this encoded image information is rapidly decoded via a deep learning-based multispectral Fourier imager network(mFIN).We experimentally tested our method with six illumination bands and demonstrated an overall accuracy of 98.25%for predicting the illumination channels at the input and achieved a robust multispectral image reconstruction on various test objects.This deep learning-powered framework achieves high-quality multispectral image reconstruction using snapshot image acquisition with a monochrome image sensor and could be useful for applications in biomedicine,industrial quality control,and agriculture,among others.
基金Postgraduate Research&Practice Innovation Program of Jiangsu Province under contract Nos KYCX23_1067 and KYCX25_1231the National Natural Science Foundation of China under contract No.42476157。
文摘Spartina alterniflora's robust reproductive capacity has enabled it to spread rapidly, posing a serious threat to native ecosystems in China. Therefore, accurate quantification of Spartina alterniflora aboveground biomass at a fine scale is crucial for understanding its growth dynamics and managing its invasion. This study focuses on the coastal wetlands of central Jiangsu Province, China, utilizing multispectral unmanned aerial vehicle(UAV) data to map the distribution of Spartina alterniflora. Object-based image analysis(OBIA) combined with support vector machines(SVM) was employed for classification. Additionally, multiple regression models, including univariate, band-based, vegetation index(VI)-based, and multivariate linear regression models integrating both band and VI data, were developed to estimate biomass:(1) the Bands + VIs multiple linear regression model based on fresh weight exhibited the highest estimation accuracy;(2) the optimal model achieved R^(2) values of 0.81 and 0.82 at Dafeng and Tiaozini Nature Reserve,with RMSE values of 591.78 g/m^(2) and 337.62 g/m^(2), and MAE values of 576.82 g/m^(2) and 287.71 g/m^(2), respectively;and(3) the aboveground biomass of Spartina alterniflora primarily ranged from 994.60 g/m^(2) to 5 351.48 g/m^(2) at Dafeng and from 796.05 g/m^(2) to 1 994.02 g/m^(2) in Tiaozini Nature Reserve. These findings highlight the effectiveness of multispectral UAV technology for accurately estimating Spartina alterniflora biomass, providing a robust methodology for wetland vegetation monitoring and invasive species management.
