Multispectral imaging plays a crucial role in simultaneously capturing detailed spatial and spectral information,which is fundamental for understanding complex phenomena across various domains.Traditional systems face...Multispectral imaging plays a crucial role in simultaneously capturing detailed spatial and spectral information,which is fundamental for understanding complex phenomena across various domains.Traditional systems face significant challenges,such as large volume,static function,and limited wavelength selectivity.Here,we propose an innovative dynamic reflective multispectral imaging system via a thermally responsive cholesteric liquid crystal based planar lens.By employing advanced photoalignment technology,the phase distribution of a lens is imprinted to the liquid crystal director.The reflection band is reversibly tuned from 450 nm to 750 nm by thermally controlling the helical pitch of the cholesteric liquid crystal,allowing selectively capturing images in different colors.This capability increases imaging versatility,showing great potential in precision agriculture for assessing crop health,noninvasive diagnostics in healthcare,and advanced remote sensing for environmental monitoring.展开更多
Physical dormancy(PY) commonly present in the seeds of higher plants is believed to be responsible for the germination failure by impermeable seed coat in hard seeds of legume species, instead of physiological dormanc...Physical dormancy(PY) commonly present in the seeds of higher plants is believed to be responsible for the germination failure by impermeable seed coat in hard seeds of legume species, instead of physiological dormancy(PD). In this study, a non-destructive approach involving multispectral imaging was used to successfully identify hard seeds from non-hard seeds in Medicago sativa, with accuracy as high as96.8%–99.0%. We further adopted multiple-omics strategies to investigate the differences of physiology,metabolomics, methylomics, and transcriptomics in alfalfa hard seeds, with non-hard seeds as control.The hard seeds showed dramatically increased antioxidants and 125 metabolites of significant differences in non-targeted metabolomics analysis, which are enriched in the biosynthesis pathways of flavonoids, lipids and hormones, especially with significantly higher ABA, a hormone known to induce dormancy. In our transcriptomics results, the enrichment pathway of “response to abscisic acid” of differential expressed genes(DEG) supported the key role of ABA in metabolomics results. The methylome analysis identified 54,899, 46,216 and 54,452 differential methylation regions for contexts of CpG, CHG and CHH, and 344 DEGs might be regulated by hypermethylation and hypomethylation of promoter and exon regions, including four ABA-and JA-responsive genes. Among 8% hard seeds in seed lots,24.5% still did not germinate after scarifying seed coat, and were named as non-PY hard seeds.Compared to hard seeds, significantly higher contents of ABA/IAA and ABA/JA were identified in nonPY hard seeds, which indicated the potential presence of PD. In summary, the significantly changed metabolites, gene expressions, and methylations all suggested involvement of ABA responses in hard seeds, and germination failure of alfalfa hard seeds was caused by combinational dormancy(PY + PD),rather than PY alone.展开更多
Multiplexed immunohistochemistry/fluorescence(mIHC/IF)in combination with multispectral unmixing is a novel multitarget histopathological staining and imaging technique.By simultaneously revealing expression level and...Multiplexed immunohistochemistry/fluorescence(mIHC/IF)in combination with multispectral unmixing is a novel multitarget histopathological staining and imaging technique.By simultaneously revealing expression level and spatial information for up to eight biomarkers in situ,in addition to a nuclear stain within a single formalin-fixed paraffin-embedded(FFPE)tissue section,this technology can analyze the phenotype,abundance,morphology and intercellular relationship of cells while providing statistically significant results.In recent years,technical improvements have brought new insight into mIHC/IF and multispectral imaging approaches,which have been successfully applied in the field of cancer immunotherapy,specifically in regard to tumor microenvironment research,immunotherapy drug discovery,and prognostic and metastatic risk evaluation.This review highlights the principle,workflow,advantages and disadvantages of the technology,and discusses the latest applications of mIHC/IF-based imaging technology in the field of TME-related research and immunotherapy drug discovery.展开更多
Computer forensics and identification for traditional Chinese painting arts have caught the attention of various fields. Rice paper＇s feature extraction and analysis methods are of high significance for the rice pape...Computer forensics and identification for traditional Chinese painting arts have caught the attention of various fields. Rice paper＇s feature extraction and analysis methods are of high significance for the rice paper is an important carrier of traditional Chinese painting arts. In this paper, rice paper＇s morphological feature analysis is done using multi spectral imaging technology. The multispectral imaging system is utilized to acquire rice paper＇s spectral images in different wave- length channels, and then those spectral images are measured using texture parameter statistics to acquire sensitive bands for rice paper＇s feature. The mathematical morphology and grayscale statistical principle are utilized to establish a rice paper＇s morphological feature analytical model which is used to acquire rice paper＇ s one-dimensional vector. For the purpose of eval- uating these feature vectors＇ accuracy, they are entered into the support vector machine（SVM） classifier for detection and classification. The results show that the rice paper＇s feature is out loud in the spectral band 550 nm, and the average classifi- cation accuracy of feature vectors output from the analytical model is 96 %. The results indicate that the rice paper＇s feature analytical model can extract most of rice paper＇s features with accuracy and efficiency.展开更多
This paper investigates the appropriate range of values for the transcutaneous blood oxygen saturation(StO2)of granulating tissues and the surrounding tissue that can ensure timely wound recovery.This work has used a ...This paper investigates the appropriate range of values for the transcutaneous blood oxygen saturation(StO2)of granulating tissues and the surrounding tissue that can ensure timely wound recovery.This work has used a multispectral imaging system to collect wound images at wave-lengths ranging between 520 nm and 600 nm with a resolution of 10 nm.As part of this research,a pilot study was conducted on three injured individuals with superfcial wounds of different wound ages at different skin locations.The S_(t)O_(2)value predicted for the examined wounds using the Extended Modified Lambert-Beer model revealed a mean S_(t)O_(2)of 61±10.3%compared to 41.6±6.2%at the surrounding tissues,and 50.1±1.53%for control sites.These preliminary results contribute to the existing knowledge on the possible range and variation of wound bed S_(t)O_(2)that are to be used as indicators of the functioning of the vasomotion system and wound health.This study has concluded that a high S_(t)O_(2)of approximately 60%and a large fuctuation in this value should precede a good progression in wound healing.展开更多
A multispectral imaging system consisting of liquid crystal tunable filter(LCTF)and charge coupled device(CCD)camera was used to collect the images of fingernail samples at intervals of 10 nm during the spectral range...A multispectral imaging system consisting of liquid crystal tunable filter(LCTF)and charge coupled device(CCD)camera was used to collect the images of fingernail samples at intervals of 10 nm during the spectral range of 450-1 000 nm,and a multispectral image of human fingernails containing 56 bands was obtained.The accurate reflectivity information of fingernails was obtained through referring whiteboard comparative measurement method.Principal component analysis(PCA)and band index method were used to reduce the dimension of the sample images respectively and two feature spaces were obtained.Spectral angle mapping(SAM)was used to classify human fingernails in these two feature spaces.The classification accuracy were above 92.5%and 82.9%respectively.Therefore,the feature space obtained by the PCA can be used as the characteristic spectrum of human fingernails,which provides a reliable basis for the analysis of multispectral spectrum of fingernails and human health assessment in the future.展开更多
Non-invasive potato defects detection has been demanded for sorting and grading purpose.Researches on the classification of the defects has been available,however,investigation on the severity level calculation is lim...Non-invasive potato defects detection has been demanded for sorting and grading purpose.Researches on the classification of the defects has been available,however,investigation on the severity level calculation is limited.For the detection of the common scab,it has been found that imaging in the infrared region provide an interesting characteristic that could distinguish defected area to normal area.Thus,investigations on this wavelength range is interesting to add more knowledge and for applications.In this research,the multispectral image has been obtained and investigated especially at three wavelengths(950,1150,1600 nm).Image pre-processing and pseudo-color conversion techniques were explored to enhance the contrast between defects,normal background skin area and soil deposits.Results show that external defects,such as common scab and some mechanical damage types,appear brighter in the near infrared region,especially at 1600 nm against the normal skin background.It has been found that pseudo-color images conversion provides more information regarding type if surface characteristics compared to grayscale single imaging.Image segmentation using pseudo-color images after multiplication operation pre-processing could be used for common scab and mechanical damage detection excluding soil deposits with a Dice Sorensen coefficient of 0.64.In addition,image segmentation using single image at 1600 nm shown relatively better results with Dice Sorensen coefficient of 0.72 with note that thick soil deposits will also be segmented.Defect severity level evaluation had an R2 correlation of 0.84 against standard measurements of severity.展开更多
Crop leaf area index(LAI)and biomass are two major biophysical parameters to measure crop growth and health condition.Measuring LAI and biomass in field experiments is a destructive method.Therefore,we focused on the ...Crop leaf area index(LAI)and biomass are two major biophysical parameters to measure crop growth and health condition.Measuring LAI and biomass in field experiments is a destructive method.Therefore,we focused on the application of unmanned aerial vehicles(UAVs)in agriculture,which is a cost and labor-efficientmethod.Hence,UAV-captured multispectral images were applied to monitor crop growth,identify plant bio-physical conditions,and so on.In this study,we monitored soybean crops using UAV and field experiments.This experiment was conducted at theMAFES(Mississippi Agricultural and Forestry Experiment Station)Pontotoc Ridge-Flatwoods Branch Experiment Station.It followed a randomized block design with five cover crops:Cereal Rye,Vetch,Wheat,MC:mixed Mustard and Cereal Rye,and native vegetation.Planting was made in the fall,and three fertilizer treatments were applied:Synthetic Fertilizer,Poultry Litter,and none,applied before planting the soybean,in a full factorial combination.We monitored soybean reproductive phases at R3(initial pod development),R5(initial seed development),R6(full seed development),and R7(initial maturity)and used UAV multispectral remote sensing for soybean LAI and biomass estimations.The major goal of this study was to assess LAI and biomass estimations from UAV multispectral images in the reproductive stages when the development of leaves and biomass was stabilized.Wemade about fourteen vegetation indices(VIs)fromUAVmultispectral images at these stages to estimate LAI and biomass.Wemodeled LAI and biomass based on these remotely sensed VIs and ground-truth measurements usingmachine learning methods,including linear regression,Random Forest(RF),and support vector regression(SVR).Thereafter,the models were applied to estimate LAI and biomass.According to the model results,LAI was better estimated at the R6 stage and biomass at the R3 stage.Compared to the other models,the RF models showed better estimation,i.e.,an R^(2) of about 0.58–0.68 with an RMSE(rootmean square error)of 0.52–0.60(m^(2)/m^(2))for the LAI and about 0.44–0.64 for R^(2) and 21–26(g dry weight/5 plants)for RMSE of biomass estimation.We performed a leave-one-out cross-validation.Based on cross-validatedmodels with field experiments,we also found that the R6 stage was the best for estimating LAI,and the R3 stage for estimating crop biomass.The cross-validated RF model showed the estimation ability with an R^(2) about 0.25–0.44 and RMSE of 0.65–0.85(m^(2)/m^(2))for LAI estimation;and R^(2) about 0.1–0.31 and an RMSE of about 28–35(g dry weight/5 plants)for crop biomass estimation.This result will be helpful to promote the use of non-destructive remote sensing methods to determine the crop LAI and biomass status,which may bring more efficient crop production and management.展开更多
Accurate segmentation of camouflage objects in aerial imagery is vital for improving the efficiency of UAV-based reconnaissance and rescue missions.However,camouflage object segmentation is increasingly challenging du...Accurate segmentation of camouflage objects in aerial imagery is vital for improving the efficiency of UAV-based reconnaissance and rescue missions.However,camouflage object segmentation is increasingly challenging due to advances in both camouflage materials and biological mimicry.Although multispectral-RGB based technology shows promise,conventional dual-aperture multispectral-RGB imaging systems are constrained by imprecise and time-consuming registration and fusion across different modalities,limiting their performance.Here,we propose the Reconstructed Multispectral-RGB Fusion Network(RMRF-Net),which reconstructs RGB images into multispectral ones,enabling efficient multimodal segmentation using only an RGB camera.Specifically,RMRF-Net employs a divergentsimilarity feature correction strategy to minimize reconstruction errors and includes an efficient boundary-aware decoder to enhance object contours.Notably,we establish the first real-world aerial multispectral-RGB semantic segmentation of camouflage objects dataset,including 11 object categories.Experimental results demonstrate that RMRF-Net outperforms existing methods,achieving 17.38 FPS on the NVIDIA Jetson AGX Orin,with only a 0.96%drop in mIoU compared to the RTX 3090,showing its practical applicability in multimodal remote sensing.展开更多
This study investigated three different types of multispectral imaging systems for airborne remote sensing to support management in agricultural application and production.The three systems have been used in agricultu...This study investigated three different types of multispectral imaging systems for airborne remote sensing to support management in agricultural application and production.The three systems have been used in agricultural studies.They range from low-cost to relatively high-cost,manually operated to automated,multispectral composite imaging with a single camera and integrated imaging with custom-mounting of separate cameras.Practical issues regarding use of the imaging systems were described and discussed.The low-cost system,due to band saturation,slow imaging speed and poor image quality,is more preferable to slower moving platforms that can fly close to the ground,such as unmanned autonomous helicopters,but not recommended for low or high altitude aerial remote sensing on fixed-wing aircraft.With the restriction on payload unmanned autonomous helicopters are not recommended for high-cost systems because they are typically heavy and difficult to mount.The system with intermediate cost works well for low altitude aerial remote sensing on fixed-wing aircraft with field shapefile-based global positioning triggering.This system also works well for high altitude aerial remote sensing on fixed-wing aircraft with global positioning triggering or manually operated.The custom-built system is recommended for high altitude aerial remote sensing on fixed-wing aircraft with waypoint global positioning triggering or manually operated.展开更多
Bismuth-based perovskites are considered to be promising candidates to substitute the toxic lead-based perovskite in optoelectronics due to their excellent optoelectronic properties,high environmental friendliness,and...Bismuth-based perovskites are considered to be promising candidates to substitute the toxic lead-based perovskite in optoelectronics due to their excellent optoelectronic properties,high environmental friendliness,and(moisture,light,and heat)stability.However,there are still few reports about high performance bismuth-based perovskite ultraviolet photodetectors,and is more lacking in ultraviolet imaging demonstration.Herein,we reported a self-powered NiO_(x)/Cs_(3)Bi_(2)Br_(9) heterojunction photodetector with excellent photodetection performance by electrochemical depositing NiOx as the hole transport layer.The optimized NiO_(x)/CsaBi_(2)Brg heterojunction photodetector exhibits excellent ultraviolet detection performance with a fast response speed of 3.04/4.65 ms,wide linear dynamic range of 116.6 dB,decent responsivity of 4.33 mA·W^(-1) at 0 V bias,and high detectivity of 1.3×10^(11) jones.The outstanding performance of the optimized NiO_(x)/Cs_(3)Bi_(2)Br_(9) heterojunction photodetector is enough to meet the high-quality ultraviolet imaging.Therefore,we further integrated the optimized NiO_(x)/Cs_(3)Bi_(2)Br_(9) heterojunction photodetector to the transmission mode ultraviolet multispectral imaging system,achieving admirable imaging results at weak light condition.This work will play a positive role in promoting the development of bismuth-based ultraviolet photodetection and ultraviolet multispectral imaging.展开更多
Camouflaged people are extremely expert in actively concealing themselves by effectively utilizing cover and the surrounding environment. Despite advancements in optical detection capabilities through imaging systems,...Camouflaged people are extremely expert in actively concealing themselves by effectively utilizing cover and the surrounding environment. Despite advancements in optical detection capabilities through imaging systems, including spectral, polarization, and infrared technologies, there is still a lack of effective real-time method for accurately detecting small-size and high-efficient camouflaged people in complex real-world scenes. Here, this study proposes a snapshot multispectral image-based camouflaged detection model, multispectral YOLO(MS-YOLO), which utilizes the SPD-Conv and Sim AM modules to effectively represent targets and suppress background interference by exploiting the spatial-spectral target information. Besides, the study constructs the first real-shot multispectral camouflaged people dataset(MSCPD), which encompasses diverse scenes, target scales, and attitudes. To minimize information redundancy, MS-YOLO selects an optimal subset of 12 bands with strong feature representation and minimal inter-band correlation as input. Through experiments on the MSCPD, MS-YOLO achieves a mean Average Precision of 94.31% and real-time detection at 65 frames per second, which confirms the effectiveness and efficiency of our method in detecting camouflaged people in various typical desert and forest scenes. Our approach offers valuable support to improve the perception capabilities of unmanned aerial vehicles in detecting enemy forces and rescuing personnel in battlefield.展开更多
An extreme ultraviolet solar corona multispectral imager can allow direct observation of high temperature coronal plasma,which is related to solar flares,coronal mass ejections and other significant coronal activities...An extreme ultraviolet solar corona multispectral imager can allow direct observation of high temperature coronal plasma,which is related to solar flares,coronal mass ejections and other significant coronal activities.This manuscript proposes a novel end-to-end computational design method for an extreme ultraviolet(EUV)solar corona multispectral imager operating at wavelengths near 100 nm,including a stray light suppression design and computational image recovery.To suppress the strong stray light from the solar disk,an outer opto-mechanical structure is designed to protect the imaging component of the system.Considering the low reflectivity(less than 70%)and strong-scattering(roughness)of existing extreme ultraviolet optical elements,the imaging component comprises only a primary mirror and a curved grating.A Lyot aperture is used to further suppress any residual stray light.Finally,a deep learning computational imaging method is used to correct the individual multi-wavelength images from the original recorded multi-slit data.In results and data,this can achieve a far-field angular resolution below 7",and spectral resolution below 0.05 nm.The field of view is±3 R_(☉)along the multi-slit moving direction,where R☉represents the radius of the solar disk.The ratio of the corona's stray light intensity to the solar center's irradiation intensity is less than 10-6 at the circle of 1.3 R_(☉).展开更多
Information on Land Use and Land Cover Map(LULCM)is essential for environment and socioeconomic applications.Such maps are generally derived from Multispectral Remote Sensing Images(MRSI)via classification.The classif...Information on Land Use and Land Cover Map(LULCM)is essential for environment and socioeconomic applications.Such maps are generally derived from Multispectral Remote Sensing Images(MRSI)via classification.The classification process can be described as information flow from images to maps through a trained classifier.Characterizing the information flow is essential for understanding the classification mechanism,providing solutions that address such theoretical issues as“what is the maximum number of classes that can be classified from a given MRSI?”and“how much information gain can be obtained?”Consequently,two interesting questions naturally arise,i.e.(i)How can we characterize the information flow?and(ii)What is the mathematical form of the information flow?To answer these two questions,this study first hypothesizes that thermodynamic entropy is the appropriate measure of information for both MRSI and LULCM.This hypothesis is then supported by kinetic-theory-based experiments.Thereafter,upon such an entropy,a generalized Jarzynski equation is formulated to mathematically model the information flow,which contains such parameters as thermodynamic entropy of MRSI,thermodynamic entropy of LULCM,weighted F1-score(classification accuracy),and total number of classes.This generalized Jarzynski equation has been successfully validated by hypothesis-driven experiments where 694 Sentinel-2 images are classified into 10 classes by four classical classifiers.This study provides a way for linking thermodynamic laws and concepts to the characterization and understanding of information flow in land cover classification,opening a new door for constructing domain knowledge.展开更多
Authentication of pasta is currently determined using molecular biology-based techniques focusing on DNA as the target analyte. Whilst proven to be effective, these approaches can be criticised as being destructive, t...Authentication of pasta is currently determined using molecular biology-based techniques focusing on DNA as the target analyte. Whilst proven to be effective, these approaches can be criticised as being destructive, time consuming, and requiring specialist instrument training. Advances in the field of multispectral imaging (MSI) and hyperspectral imaging (HSI) have facilitated the development of compact imaging platforms with the capability to rapidly differentiate a range of materials (inclusive of grains and seeds) based on surface colour, texture and chemical composition. This preliminary investigation evaluated the applicability of spectral imaging for identification and quantitation of durum wheat grain samples in relation to pasta authenticity. MSI and HSI were capable of rapidly distinguishing between durum wheat and adulterant common wheat cultivars and assigning percentage adulteration levels characterised by low biases and good repeatability estimates. The results demonstrated the potential for spectral imaging based seed/grain adulteration testing to augment existing standard molecular approaches for food authenticity testing.展开更多
This study aimed to set a computer-integrated multichannel spectral imaging system as a high-throughput phenotyping tool for the analysis of individual cowpea seeds harvested at different developmental stages. The cha...This study aimed to set a computer-integrated multichannel spectral imaging system as a high-throughput phenotyping tool for the analysis of individual cowpea seeds harvested at different developmental stages. The changes in germination capacity and variations in moisture, protein and different sugars during twelve stages of seed development from 10 to 32 days after anthesis were nondestructively monitored. Multispectral data at 20 discrete wavelengths in the ultraviolet, visible and near infrared regions were extracted from individual seeds and then modelled using partial least squares regression and linear discriminant analysis(LDA) models. The developed multivariate models were accurate enough for monitoring all possible changes occurred in moisture, protein and sugar contents with coefficients of determination in prediction R^(2) of 0.93, 0.80 and 0.78 and root mean square errors in prediction(RMSEP) of 6.045%, 2.236% and 0.890%, respectively. The accuracy of PLS models in predicting individual sugars such as verbascose and stachyose was reasonable with R~2 of 0.87 and 0.87 and RMSEP of 0.071%and 0.485%, respectively;but for the prediction of sucrose and raffinose the accuracy was relatively limited with R^(2) of 0.24 and 0.66 and RMSEP of 0.567% and 0.045%, respectively. The developed LDA model was robust in classifying the seeds based on their germination capacity with overall correct classification of96.33% and 95.67% in the training and validation datasets, respectively. With these levels of accuracy,the proposed multichannel spectral imaging system designed for single seeds could be an effective choice as a rapid screening and non-destructive technique for identifying the ideal harvesting time of cowpea seeds based on their chemical composition and germination capacity. Moreover, the development of chemical images of the major constituents along with classification images confirmed the usefulness of the proposed technique as a non-destructive tool for estimating the concentrations and spatial distributions of moisture, protein and sugars during different developmental stages of cowpea seeds.展开更多
Multispectral imaging (MSI) technique is often used to capture imagesof the fundus by illuminating it with different wavelengths of light. However,these images are taken at different points in time such that eyeball m...Multispectral imaging (MSI) technique is often used to capture imagesof the fundus by illuminating it with different wavelengths of light. However,these images are taken at different points in time such that eyeball movementscan cause misalignment between consecutive images. The multispectral imagesequence reveals important information in the form of retinal and choroidal bloodvessel maps, which can help ophthalmologists to analyze the morphology of theseblood vessels in detail. This in turn can lead to a high diagnostic accuracy of several diseases. In this paper, we propose a novel semi-supervised end-to-end deeplearning framework called “Adversarial Segmentation and Registration Nets”(ASRNet) for the simultaneous estimation of the blood vessel segmentation andthe registration of multispectral images via an adversarial learning process. ASRNet consists of two subnetworks: (i) A segmentation module S that fulfills theblood vessel segmentation task, and (ii) A registration module R that estimatesthe spatial correspondence of an image pair. Based on the segmention-drivenregistration network, we train the segmentation network using a semi-supervisedadversarial learning strategy. Our experimental results show that the proposedASRNet can achieve state-of-the-art accuracy in segmentation and registrationtasks performed with real MSI datasets.展开更多
Multispectral microscopy enables information enhancement in the study of specimens because of the large spectral band used in this technique. A low cost multimode multispectral microscope using a camera and a set of q...Multispectral microscopy enables information enhancement in the study of specimens because of the large spectral band used in this technique. A low cost multimode multispectral microscope using a camera and a set of quasi-monochromatic Light Emitting Diodes (LEDs) ranging from ultraviolet to near-infrared wavelengths as illumination sources was constructed. But the use of a large spectral band provided by non-monochromatic sources induces variation of focal plan of the imager due to chromatic aberration which rises up the diffraction effects and blurs the images causing shadow around them. It results in discrepancies between standard spectra and extracted spectra with microscope. So we need to calibrate that instrument to be a standard one. We proceed with two types of images comparison to choose the reference wavelength for image acquisition where diffraction effect is more reduced. At each wavelength chosen as a reference, one image is well contrasted. First, we compare the thirteen well contrasted images to identify that presenting more reduced shadow. In second time, we determine the mean of the shadow size over the images from each set. The correction of the discrepancies required measurements on filters using a standard spectrometer and the microscope in transmission mode and reflection mode. To evaluate the capacity of our device to transmit information in frequency domain, its modulation transfer function is evaluated. Multivariate analysis is used to test its capacity to recognize properties of well-known sample. The wavelength 700 nm was chosen to be the reference for the image acquisition, because at this wavelength the images are well contrasted. The measurement made on the filters suggested correction coefficients in transmission mode and reflection mode. The experimental instrument recognized the microsphere’s properties and led to the extraction of the standard transmittance and reflectance spectra. Therefore, this microscope is used as a conventional instrument.展开更多
Even though multispectral imaging is considered very significant in biological imaging,it is only commonly used in microscopy in a 2D approach.Here,we present a Fluorescence Molecular Tomography system capable of reco...Even though multispectral imaging is considered very significant in biological imaging,it is only commonly used in microscopy in a 2D approach.Here,we present a Fluorescence Molecular Tomography system capable of recording simultaneously tomographic data at several spectral windows,enabling multispectral tomography.3D reconstructed data from several spectral windows is used to construct a linear unmixing algorithm for multispectral deconvolution of overlapping fluorescence signals.The method is applied on tomographic 3D fluorescence concentration maps in tissue-mimicking phantoms,yielding absolute quantification of the concentration of each individual fluorophore.Results are compared to the case when unmixing is performed in the raw 2D data instead of the reconstructed 3D concentration map,showing greater accuracy when unmixing algorithms are applied in the reconstructed data.Both the reflection and transmission geometries are considered.展开更多
A novel fusion method of multispectral image and panchromatic image based on nonsubsampled contourlet transform（NSCT） and non-negative matrix factorization（NMF） is presented,the aim of which is to preserve both sp...A novel fusion method of multispectral image and panchromatic image based on nonsubsampled contourlet transform（NSCT） and non-negative matrix factorization（NMF） is presented,the aim of which is to preserve both spectral and spatial information simultaneously in fused image.NMF is a matrix factorization method,which can extract the local feature by choosing suitable dimension of the feature subspace.Firstly the multispectral image was represented in intensity hue saturation（IHS） system.Then the I component and panchromatic image were decomposed by NSCT.Next we used NMF to learn the feature of both multispectral and panchromatic images＇ low-frequency subbands,and the selection principle of the other coefficients was absolute maximum criterion.Finally the new coefficients were reconstructed to get the fused image.Experiments are carried out and the results are compared with some other methods,which show that the new method performs better in improving the spatial resolution and preserving the feature information than the other existing relative methods.展开更多
基金supported by the National Key Research and Development Program of China(No.2022YFA1203700)the National Natural Science Foundation of China(NSFC)(Nos.62405129 and 62035008)+1 种基金the University Research Project of Guangzhou Education Bureau(No.202235053)the Natural Science Foundation of Jiangsu Province(No.BK20241197).
文摘Multispectral imaging plays a crucial role in simultaneously capturing detailed spatial and spectral information,which is fundamental for understanding complex phenomena across various domains.Traditional systems face significant challenges,such as large volume,static function,and limited wavelength selectivity.Here,we propose an innovative dynamic reflective multispectral imaging system via a thermally responsive cholesteric liquid crystal based planar lens.By employing advanced photoalignment technology,the phase distribution of a lens is imprinted to the liquid crystal director.The reflection band is reversibly tuned from 450 nm to 750 nm by thermally controlling the helical pitch of the cholesteric liquid crystal,allowing selectively capturing images in different colors.This capability increases imaging versatility,showing great potential in precision agriculture for assessing crop health,noninvasive diagnostics in healthcare,and advanced remote sensing for environmental monitoring.
基金supported by the earmarked fund for CARS (CARS-34)National Key Research and Development Program of China (2022YFD1300804)the Key R&D Project of Sichuan Science and Technology Program(2023YFSY0012)。
文摘Physical dormancy(PY) commonly present in the seeds of higher plants is believed to be responsible for the germination failure by impermeable seed coat in hard seeds of legume species, instead of physiological dormancy(PD). In this study, a non-destructive approach involving multispectral imaging was used to successfully identify hard seeds from non-hard seeds in Medicago sativa, with accuracy as high as96.8%–99.0%. We further adopted multiple-omics strategies to investigate the differences of physiology,metabolomics, methylomics, and transcriptomics in alfalfa hard seeds, with non-hard seeds as control.The hard seeds showed dramatically increased antioxidants and 125 metabolites of significant differences in non-targeted metabolomics analysis, which are enriched in the biosynthesis pathways of flavonoids, lipids and hormones, especially with significantly higher ABA, a hormone known to induce dormancy. In our transcriptomics results, the enrichment pathway of “response to abscisic acid” of differential expressed genes(DEG) supported the key role of ABA in metabolomics results. The methylome analysis identified 54,899, 46,216 and 54,452 differential methylation regions for contexts of CpG, CHG and CHH, and 344 DEGs might be regulated by hypermethylation and hypomethylation of promoter and exon regions, including four ABA-and JA-responsive genes. Among 8% hard seeds in seed lots,24.5% still did not germinate after scarifying seed coat, and were named as non-PY hard seeds.Compared to hard seeds, significantly higher contents of ABA/IAA and ABA/JA were identified in nonPY hard seeds, which indicated the potential presence of PD. In summary, the significantly changed metabolites, gene expressions, and methylations all suggested involvement of ABA responses in hard seeds, and germination failure of alfalfa hard seeds was caused by combinational dormancy(PY + PD),rather than PY alone.
基金supported by State Key Laboratory of Natural and Biomimetic Drugs,Peking University。
文摘Multiplexed immunohistochemistry/fluorescence(mIHC/IF)in combination with multispectral unmixing is a novel multitarget histopathological staining and imaging technique.By simultaneously revealing expression level and spatial information for up to eight biomarkers in situ,in addition to a nuclear stain within a single formalin-fixed paraffin-embedded(FFPE)tissue section,this technology can analyze the phenotype,abundance,morphology and intercellular relationship of cells while providing statistically significant results.In recent years,technical improvements have brought new insight into mIHC/IF and multispectral imaging approaches,which have been successfully applied in the field of cancer immunotherapy,specifically in regard to tumor microenvironment research,immunotherapy drug discovery,and prognostic and metastatic risk evaluation.This review highlights the principle,workflow,advantages and disadvantages of the technology,and discusses the latest applications of mIHC/IF-based imaging technology in the field of TME-related research and immunotherapy drug discovery.
基金University-Industry-Science Partnership Project of Guangdong Province and Ministry of Education,China(No.2012B091000155)Strategic Emerging Industries Project of Guangdong Province(No.2011912027)
文摘Computer forensics and identification for traditional Chinese painting arts have caught the attention of various fields. Rice paper＇s feature extraction and analysis methods are of high significance for the rice paper is an important carrier of traditional Chinese painting arts. In this paper, rice paper＇s morphological feature analysis is done using multi spectral imaging technology. The multispectral imaging system is utilized to acquire rice paper＇s spectral images in different wave- length channels, and then those spectral images are measured using texture parameter statistics to acquire sensitive bands for rice paper＇s feature. The mathematical morphology and grayscale statistical principle are utilized to establish a rice paper＇s morphological feature analytical model which is used to acquire rice paper＇ s one-dimensional vector. For the purpose of eval- uating these feature vectors＇ accuracy, they are entered into the support vector machine（SVM） classifier for detection and classification. The results show that the rice paper＇s feature is out loud in the spectral band 550 nm, and the average classifi- cation accuracy of feature vectors output from the analytical model is 96 %. The results indicate that the rice paper＇s feature analytical model can extract most of rice paper＇s features with accuracy and efficiency.
基金Ministry of Education Malaysia under grant no.FRGS 1581 and University Tun Hussein Onn Malaysia under grant no.U165.
文摘This paper investigates the appropriate range of values for the transcutaneous blood oxygen saturation(StO2)of granulating tissues and the surrounding tissue that can ensure timely wound recovery.This work has used a multispectral imaging system to collect wound images at wave-lengths ranging between 520 nm and 600 nm with a resolution of 10 nm.As part of this research,a pilot study was conducted on three injured individuals with superfcial wounds of different wound ages at different skin locations.The S_(t)O_(2)value predicted for the examined wounds using the Extended Modified Lambert-Beer model revealed a mean S_(t)O_(2)of 61±10.3%compared to 41.6±6.2%at the surrounding tissues,and 50.1±1.53%for control sites.These preliminary results contribute to the existing knowledge on the possible range and variation of wound bed S_(t)O_(2)that are to be used as indicators of the functioning of the vasomotion system and wound health.This study has concluded that a high S_(t)O_(2)of approximately 60%and a large fuctuation in this value should precede a good progression in wound healing.
基金Nationnal Natural Science Foundation of China(No.61605176)
文摘A multispectral imaging system consisting of liquid crystal tunable filter(LCTF)and charge coupled device(CCD)camera was used to collect the images of fingernail samples at intervals of 10 nm during the spectral range of 450-1 000 nm,and a multispectral image of human fingernails containing 56 bands was obtained.The accurate reflectivity information of fingernails was obtained through referring whiteboard comparative measurement method.Principal component analysis(PCA)and band index method were used to reduce the dimension of the sample images respectively and two feature spaces were obtained.Spectral angle mapping(SAM)was used to classify human fingernails in these two feature spaces.The classification accuracy were above 92.5%and 82.9%respectively.Therefore,the feature space obtained by the PCA can be used as the characteristic spectrum of human fingernails,which provides a reliable basis for the analysis of multispectral spectrum of fingernails and human health assessment in the future.
基金Japan Government Cross-Ministerial Strategic Innovation Promotion Program-Smart Bio Industry and Agricultural Fundamental Technology(SIP-2:Consortium,Smart Food Chain).
文摘Non-invasive potato defects detection has been demanded for sorting and grading purpose.Researches on the classification of the defects has been available,however,investigation on the severity level calculation is limited.For the detection of the common scab,it has been found that imaging in the infrared region provide an interesting characteristic that could distinguish defected area to normal area.Thus,investigations on this wavelength range is interesting to add more knowledge and for applications.In this research,the multispectral image has been obtained and investigated especially at three wavelengths(950,1150,1600 nm).Image pre-processing and pseudo-color conversion techniques were explored to enhance the contrast between defects,normal background skin area and soil deposits.Results show that external defects,such as common scab and some mechanical damage types,appear brighter in the near infrared region,especially at 1600 nm against the normal skin background.It has been found that pseudo-color images conversion provides more information regarding type if surface characteristics compared to grayscale single imaging.Image segmentation using pseudo-color images after multiplication operation pre-processing could be used for common scab and mechanical damage detection excluding soil deposits with a Dice Sorensen coefficient of 0.64.In addition,image segmentation using single image at 1600 nm shown relatively better results with Dice Sorensen coefficient of 0.72 with note that thick soil deposits will also be segmented.Defect severity level evaluation had an R2 correlation of 0.84 against standard measurements of severity.
基金This research was supported in part by a postdoctoral research fellow appointment to the Agricultural Research Service(ARS)Research Participation Program administered by the Oak Ridge Institute for Science and Education(ORISE)through an interagency agreement between the U.S.Department of Energy(DOE)and the U.S.Department of Agriculture(USDA).
文摘Crop leaf area index(LAI)and biomass are two major biophysical parameters to measure crop growth and health condition.Measuring LAI and biomass in field experiments is a destructive method.Therefore,we focused on the application of unmanned aerial vehicles(UAVs)in agriculture,which is a cost and labor-efficientmethod.Hence,UAV-captured multispectral images were applied to monitor crop growth,identify plant bio-physical conditions,and so on.In this study,we monitored soybean crops using UAV and field experiments.This experiment was conducted at theMAFES(Mississippi Agricultural and Forestry Experiment Station)Pontotoc Ridge-Flatwoods Branch Experiment Station.It followed a randomized block design with five cover crops:Cereal Rye,Vetch,Wheat,MC:mixed Mustard and Cereal Rye,and native vegetation.Planting was made in the fall,and three fertilizer treatments were applied:Synthetic Fertilizer,Poultry Litter,and none,applied before planting the soybean,in a full factorial combination.We monitored soybean reproductive phases at R3(initial pod development),R5(initial seed development),R6(full seed development),and R7(initial maturity)and used UAV multispectral remote sensing for soybean LAI and biomass estimations.The major goal of this study was to assess LAI and biomass estimations from UAV multispectral images in the reproductive stages when the development of leaves and biomass was stabilized.Wemade about fourteen vegetation indices(VIs)fromUAVmultispectral images at these stages to estimate LAI and biomass.Wemodeled LAI and biomass based on these remotely sensed VIs and ground-truth measurements usingmachine learning methods,including linear regression,Random Forest(RF),and support vector regression(SVR).Thereafter,the models were applied to estimate LAI and biomass.According to the model results,LAI was better estimated at the R6 stage and biomass at the R3 stage.Compared to the other models,the RF models showed better estimation,i.e.,an R^(2) of about 0.58–0.68 with an RMSE(rootmean square error)of 0.52–0.60(m^(2)/m^(2))for the LAI and about 0.44–0.64 for R^(2) and 21–26(g dry weight/5 plants)for RMSE of biomass estimation.We performed a leave-one-out cross-validation.Based on cross-validatedmodels with field experiments,we also found that the R6 stage was the best for estimating LAI,and the R3 stage for estimating crop biomass.The cross-validated RF model showed the estimation ability with an R^(2) about 0.25–0.44 and RMSE of 0.65–0.85(m^(2)/m^(2))for LAI estimation;and R^(2) about 0.1–0.31 and an RMSE of about 28–35(g dry weight/5 plants)for crop biomass estimation.This result will be helpful to promote the use of non-destructive remote sensing methods to determine the crop LAI and biomass status,which may bring more efficient crop production and management.
基金National Natural Science Foundation of China(Grant Nos.62005049 and 62072110)Natural Science Foundation of Fujian Province(Grant No.2020J01451).
文摘Accurate segmentation of camouflage objects in aerial imagery is vital for improving the efficiency of UAV-based reconnaissance and rescue missions.However,camouflage object segmentation is increasingly challenging due to advances in both camouflage materials and biological mimicry.Although multispectral-RGB based technology shows promise,conventional dual-aperture multispectral-RGB imaging systems are constrained by imprecise and time-consuming registration and fusion across different modalities,limiting their performance.Here,we propose the Reconstructed Multispectral-RGB Fusion Network(RMRF-Net),which reconstructs RGB images into multispectral ones,enabling efficient multimodal segmentation using only an RGB camera.Specifically,RMRF-Net employs a divergentsimilarity feature correction strategy to minimize reconstruction errors and includes an efficient boundary-aware decoder to enhance object contours.Notably,we establish the first real-world aerial multispectral-RGB semantic segmentation of camouflage objects dataset,including 11 object categories.Experimental results demonstrate that RMRF-Net outperforms existing methods,achieving 17.38 FPS on the NVIDIA Jetson AGX Orin,with only a 0.96%drop in mIoU compared to the RTX 3090,showing its practical applicability in multimodal remote sensing.
文摘This study investigated three different types of multispectral imaging systems for airborne remote sensing to support management in agricultural application and production.The three systems have been used in agricultural studies.They range from low-cost to relatively high-cost,manually operated to automated,multispectral composite imaging with a single camera and integrated imaging with custom-mounting of separate cameras.Practical issues regarding use of the imaging systems were described and discussed.The low-cost system,due to band saturation,slow imaging speed and poor image quality,is more preferable to slower moving platforms that can fly close to the ground,such as unmanned autonomous helicopters,but not recommended for low or high altitude aerial remote sensing on fixed-wing aircraft.With the restriction on payload unmanned autonomous helicopters are not recommended for high-cost systems because they are typically heavy and difficult to mount.The system with intermediate cost works well for low altitude aerial remote sensing on fixed-wing aircraft with field shapefile-based global positioning triggering.This system also works well for high altitude aerial remote sensing on fixed-wing aircraft with global positioning triggering or manually operated.The custom-built system is recommended for high altitude aerial remote sensing on fixed-wing aircraft with waypoint global positioning triggering or manually operated.
基金supports from the National Natural Science Foundation of China(Nos.51772135 and 52002148).
文摘Bismuth-based perovskites are considered to be promising candidates to substitute the toxic lead-based perovskite in optoelectronics due to their excellent optoelectronic properties,high environmental friendliness,and(moisture,light,and heat)stability.However,there are still few reports about high performance bismuth-based perovskite ultraviolet photodetectors,and is more lacking in ultraviolet imaging demonstration.Herein,we reported a self-powered NiO_(x)/Cs_(3)Bi_(2)Br_(9) heterojunction photodetector with excellent photodetection performance by electrochemical depositing NiOx as the hole transport layer.The optimized NiO_(x)/CsaBi_(2)Brg heterojunction photodetector exhibits excellent ultraviolet detection performance with a fast response speed of 3.04/4.65 ms,wide linear dynamic range of 116.6 dB,decent responsivity of 4.33 mA·W^(-1) at 0 V bias,and high detectivity of 1.3×10^(11) jones.The outstanding performance of the optimized NiO_(x)/Cs_(3)Bi_(2)Br_(9) heterojunction photodetector is enough to meet the high-quality ultraviolet imaging.Therefore,we further integrated the optimized NiO_(x)/Cs_(3)Bi_(2)Br_(9) heterojunction photodetector to the transmission mode ultraviolet multispectral imaging system,achieving admirable imaging results at weak light condition.This work will play a positive role in promoting the development of bismuth-based ultraviolet photodetection and ultraviolet multispectral imaging.
基金support by the National Natural Science Foundation of China (Grant No. 62005049)Natural Science Foundation of Fujian Province (Grant Nos. 2020J01451, 2022J05113)Education and Scientific Research Program for Young and Middleaged Teachers in Fujian Province (Grant No. JAT210035)。
文摘Camouflaged people are extremely expert in actively concealing themselves by effectively utilizing cover and the surrounding environment. Despite advancements in optical detection capabilities through imaging systems, including spectral, polarization, and infrared technologies, there is still a lack of effective real-time method for accurately detecting small-size and high-efficient camouflaged people in complex real-world scenes. Here, this study proposes a snapshot multispectral image-based camouflaged detection model, multispectral YOLO(MS-YOLO), which utilizes the SPD-Conv and Sim AM modules to effectively represent targets and suppress background interference by exploiting the spatial-spectral target information. Besides, the study constructs the first real-shot multispectral camouflaged people dataset(MSCPD), which encompasses diverse scenes, target scales, and attitudes. To minimize information redundancy, MS-YOLO selects an optimal subset of 12 bands with strong feature representation and minimal inter-band correlation as input. Through experiments on the MSCPD, MS-YOLO achieves a mean Average Precision of 94.31% and real-time detection at 65 frames per second, which confirms the effectiveness and efficiency of our method in detecting camouflaged people in various typical desert and forest scenes. Our approach offers valuable support to improve the perception capabilities of unmanned aerial vehicles in detecting enemy forces and rescuing personnel in battlefield.
基金This study is partially supported by the National Natural Science Foundation of China(NSFC)(62005120,62125504).
文摘An extreme ultraviolet solar corona multispectral imager can allow direct observation of high temperature coronal plasma,which is related to solar flares,coronal mass ejections and other significant coronal activities.This manuscript proposes a novel end-to-end computational design method for an extreme ultraviolet(EUV)solar corona multispectral imager operating at wavelengths near 100 nm,including a stray light suppression design and computational image recovery.To suppress the strong stray light from the solar disk,an outer opto-mechanical structure is designed to protect the imaging component of the system.Considering the low reflectivity(less than 70%)and strong-scattering(roughness)of existing extreme ultraviolet optical elements,the imaging component comprises only a primary mirror and a curved grating.A Lyot aperture is used to further suppress any residual stray light.Finally,a deep learning computational imaging method is used to correct the individual multi-wavelength images from the original recorded multi-slit data.In results and data,this can achieve a far-field angular resolution below 7",and spectral resolution below 0.05 nm.The field of view is±3 R_(☉)along the multi-slit moving direction,where R☉represents the radius of the solar disk.The ratio of the corona's stray light intensity to the solar center's irradiation intensity is less than 10-6 at the circle of 1.3 R_(☉).
基金supported by the National Natural Science Foundation of China[grant number 41930104]by the Research Grants Council of Hong Kong[grant number PolyU 152219/18E].
文摘Information on Land Use and Land Cover Map(LULCM)is essential for environment and socioeconomic applications.Such maps are generally derived from Multispectral Remote Sensing Images(MRSI)via classification.The classification process can be described as information flow from images to maps through a trained classifier.Characterizing the information flow is essential for understanding the classification mechanism,providing solutions that address such theoretical issues as“what is the maximum number of classes that can be classified from a given MRSI?”and“how much information gain can be obtained?”Consequently,two interesting questions naturally arise,i.e.(i)How can we characterize the information flow?and(ii)What is the mathematical form of the information flow?To answer these two questions,this study first hypothesizes that thermodynamic entropy is the appropriate measure of information for both MRSI and LULCM.This hypothesis is then supported by kinetic-theory-based experiments.Thereafter,upon such an entropy,a generalized Jarzynski equation is formulated to mathematically model the information flow,which contains such parameters as thermodynamic entropy of MRSI,thermodynamic entropy of LULCM,weighted F1-score(classification accuracy),and total number of classes.This generalized Jarzynski equation has been successfully validated by hypothesis-driven experiments where 694 Sentinel-2 images are classified into 10 classes by four classical classifiers.This study provides a way for linking thermodynamic laws and concepts to the characterization and understanding of information flow in land cover classification,opening a new door for constructing domain knowledge.
文摘Authentication of pasta is currently determined using molecular biology-based techniques focusing on DNA as the target analyte. Whilst proven to be effective, these approaches can be criticised as being destructive, time consuming, and requiring specialist instrument training. Advances in the field of multispectral imaging (MSI) and hyperspectral imaging (HSI) have facilitated the development of compact imaging platforms with the capability to rapidly differentiate a range of materials (inclusive of grains and seeds) based on surface colour, texture and chemical composition. This preliminary investigation evaluated the applicability of spectral imaging for identification and quantitation of durum wheat grain samples in relation to pasta authenticity. MSI and HSI were capable of rapidly distinguishing between durum wheat and adulterant common wheat cultivars and assigning percentage adulteration levels characterised by low biases and good repeatability estimates. The results demonstrated the potential for spectral imaging based seed/grain adulteration testing to augment existing standard molecular approaches for food authenticity testing.
基金supported by the STDF-IRD-AUF Joint Research Project No. 27755 provided by Egyptian Science and Technology Development Fund (STDF)the Distinguished Scientist Fellowship Program (DSFP) of King Saud University。
文摘This study aimed to set a computer-integrated multichannel spectral imaging system as a high-throughput phenotyping tool for the analysis of individual cowpea seeds harvested at different developmental stages. The changes in germination capacity and variations in moisture, protein and different sugars during twelve stages of seed development from 10 to 32 days after anthesis were nondestructively monitored. Multispectral data at 20 discrete wavelengths in the ultraviolet, visible and near infrared regions were extracted from individual seeds and then modelled using partial least squares regression and linear discriminant analysis(LDA) models. The developed multivariate models were accurate enough for monitoring all possible changes occurred in moisture, protein and sugar contents with coefficients of determination in prediction R^(2) of 0.93, 0.80 and 0.78 and root mean square errors in prediction(RMSEP) of 6.045%, 2.236% and 0.890%, respectively. The accuracy of PLS models in predicting individual sugars such as verbascose and stachyose was reasonable with R~2 of 0.87 and 0.87 and RMSEP of 0.071%and 0.485%, respectively;but for the prediction of sucrose and raffinose the accuracy was relatively limited with R^(2) of 0.24 and 0.66 and RMSEP of 0.567% and 0.045%, respectively. The developed LDA model was robust in classifying the seeds based on their germination capacity with overall correct classification of96.33% and 95.67% in the training and validation datasets, respectively. With these levels of accuracy,the proposed multichannel spectral imaging system designed for single seeds could be an effective choice as a rapid screening and non-destructive technique for identifying the ideal harvesting time of cowpea seeds based on their chemical composition and germination capacity. Moreover, the development of chemical images of the major constituents along with classification images confirmed the usefulness of the proposed technique as a non-destructive tool for estimating the concentrations and spatial distributions of moisture, protein and sugars during different developmental stages of cowpea seeds.
基金supported by the National Natural Science Foundation of China(Grant Nos.81871508 and 61773246)the Major Program of Shandong Province Natural Science Foundation(Grant No.ZR2019ZD04 and ZR2018ZB0419)the Taishan Scholar Program of Shandong Province of China(Grant No.TSHW201502038).
文摘Multispectral imaging (MSI) technique is often used to capture imagesof the fundus by illuminating it with different wavelengths of light. However,these images are taken at different points in time such that eyeball movementscan cause misalignment between consecutive images. The multispectral imagesequence reveals important information in the form of retinal and choroidal bloodvessel maps, which can help ophthalmologists to analyze the morphology of theseblood vessels in detail. This in turn can lead to a high diagnostic accuracy of several diseases. In this paper, we propose a novel semi-supervised end-to-end deeplearning framework called “Adversarial Segmentation and Registration Nets”(ASRNet) for the simultaneous estimation of the blood vessel segmentation andthe registration of multispectral images via an adversarial learning process. ASRNet consists of two subnetworks: (i) A segmentation module S that fulfills theblood vessel segmentation task, and (ii) A registration module R that estimatesthe spatial correspondence of an image pair. Based on the segmention-drivenregistration network, we train the segmentation network using a semi-supervisedadversarial learning strategy. Our experimental results show that the proposedASRNet can achieve state-of-the-art accuracy in segmentation and registrationtasks performed with real MSI datasets.
文摘Multispectral microscopy enables information enhancement in the study of specimens because of the large spectral band used in this technique. A low cost multimode multispectral microscope using a camera and a set of quasi-monochromatic Light Emitting Diodes (LEDs) ranging from ultraviolet to near-infrared wavelengths as illumination sources was constructed. But the use of a large spectral band provided by non-monochromatic sources induces variation of focal plan of the imager due to chromatic aberration which rises up the diffraction effects and blurs the images causing shadow around them. It results in discrepancies between standard spectra and extracted spectra with microscope. So we need to calibrate that instrument to be a standard one. We proceed with two types of images comparison to choose the reference wavelength for image acquisition where diffraction effect is more reduced. At each wavelength chosen as a reference, one image is well contrasted. First, we compare the thirteen well contrasted images to identify that presenting more reduced shadow. In second time, we determine the mean of the shadow size over the images from each set. The correction of the discrepancies required measurements on filters using a standard spectrometer and the microscope in transmission mode and reflection mode. To evaluate the capacity of our device to transmit information in frequency domain, its modulation transfer function is evaluated. Multivariate analysis is used to test its capacity to recognize properties of well-known sample. The wavelength 700 nm was chosen to be the reference for the image acquisition, because at this wavelength the images are well contrasted. The measurement made on the filters suggested correction coefficients in transmission mode and reflection mode. The experimental instrument recognized the microsphere’s properties and led to the extraction of the standard transmittance and reflectance spectra. Therefore, this microscope is used as a conventional instrument.
基金E.U.FP6 Integrated Project“Molecular Imaging”LSHG-CT-2003-503259E.U.FP7 Collaborative Project“FMT-XCT”.R.F.acknowledges support from the Marie Curie Program EST-MolecImag Early Stage Training MEST-CT-2004-007643.
文摘Even though multispectral imaging is considered very significant in biological imaging,it is only commonly used in microscopy in a 2D approach.Here,we present a Fluorescence Molecular Tomography system capable of recording simultaneously tomographic data at several spectral windows,enabling multispectral tomography.3D reconstructed data from several spectral windows is used to construct a linear unmixing algorithm for multispectral deconvolution of overlapping fluorescence signals.The method is applied on tomographic 3D fluorescence concentration maps in tissue-mimicking phantoms,yielding absolute quantification of the concentration of each individual fluorophore.Results are compared to the case when unmixing is performed in the raw 2D data instead of the reconstructed 3D concentration map,showing greater accuracy when unmixing algorithms are applied in the reconstructed data.Both the reflection and transmission geometries are considered.
基金Supported by the National Natural Science Foundation of China(60872065)
文摘A novel fusion method of multispectral image and panchromatic image based on nonsubsampled contourlet transform（NSCT） and non-negative matrix factorization（NMF） is presented,the aim of which is to preserve both spectral and spatial information simultaneously in fused image.NMF is a matrix factorization method,which can extract the local feature by choosing suitable dimension of the feature subspace.Firstly the multispectral image was represented in intensity hue saturation（IHS） system.Then the I component and panchromatic image were decomposed by NSCT.Next we used NMF to learn the feature of both multispectral and panchromatic images＇ low-frequency subbands,and the selection principle of the other coefficients was absolute maximum criterion.Finally the new coefficients were reconstructed to get the fused image.Experiments are carried out and the results are compared with some other methods,which show that the new method performs better in improving the spatial resolution and preserving the feature information than the other existing relative methods.
