Ionogels have demonstrated substantial applications in smart wearable systems,soft robotics,and biomedical engineering due to the exceptional ionic conductivity and optical transparency.However,achieving ionogels with...Ionogels have demonstrated substantial applications in smart wearable systems,soft robotics,and biomedical engineering due to the exceptional ionic conductivity and optical transparency.However,achieving ionogels with desirable mechanical properties,environmental stability,and multi-mode sensing remains challenging.Here,we propose a simple strategy for the fabrication of multifunctional silk fabric-based ionogels(BSFIGs).The resulting fabric ionogels exhibits superior mechanical properties,with high tensile strength(11.3 MPa)and work of fracture(2.53 MJ/m^(3)).And its work of fracture still has 1.42 MJ/m^(3)as the notch increased to 50%,indicating its crack growth insensitivity.These ionogels can be used as sensors for strain,temperature,and tactile multimode sensing,demonstrating a gauge factor of 1.19 and a temperature coefficient of resistance of3.17/℃^(-1).Furthermore,these ionogels can be used for the detection of different roughness and as touch screens.The ionogels also exhibit exceptional optical transmittance and environmental stability even at80℃.Our scalable fabrication process broadens the application potential of these multifunctional ionogels in diverse fields,from smart systems to extreme environments.展开更多
The sixth generation(6G)of mobile communication system is witnessing a new paradigm shift,i.e.,integrated sensing-communication system.A comprehensive dataset is a prerequisite for 6G integrated sensing-communication ...The sixth generation(6G)of mobile communication system is witnessing a new paradigm shift,i.e.,integrated sensing-communication system.A comprehensive dataset is a prerequisite for 6G integrated sensing-communication research.This paper develops a novel simulation dataset,named M3SC,for mixed multi-modal(MMM)sensing-communication integration,and the generation framework of the M3SC dataset is further given.To obtain multimodal sensory data in physical space and communication data in electromagnetic space,we utilize Air-Sim and WaveFarer to collect multi-modal sensory data and exploit Wireless InSite to collect communication data.Furthermore,the in-depth integration and precise alignment of AirSim,WaveFarer,andWireless InSite are achieved.The M3SC dataset covers various weather conditions,multiplex frequency bands,and different times of the day.Currently,the M3SC dataset contains 1500 snapshots,including 80 RGB images,160 depth maps,80 LiDAR point clouds,256 sets of mmWave waveforms with 8 radar point clouds,and 72 channel impulse response(CIR)matrices per snapshot,thus totaling 120,000 RGB images,240,000 depth maps,120,000 LiDAR point clouds,384,000 sets of mmWave waveforms with 12,000 radar point clouds,and 108,000 CIR matrices.The data processing result presents the multi-modal sensory information and communication channel statistical properties.Finally,the MMM sensing-communication application,which can be supported by the M3SC dataset,is discussed.展开更多
Wearable thermoelectric devices hold significant promise in the realm of self-powered wearable electron-ics,offering applications in energy harvesting,movement tracking,and health monitoring.Nevertheless,developing th...Wearable thermoelectric devices hold significant promise in the realm of self-powered wearable electron-ics,offering applications in energy harvesting,movement tracking,and health monitoring.Nevertheless,developing thermoelectric devices with exceptional flexibility,enduring thermoelectric stability,multi-functional sensing,and comfortable wear remains a challenge.In this work,a stretchable MXene-based thermoelectric fabric is designed to accurately discern temperature and strain stimuli.This is achieved by constructing an adhesive polydopamine(PDA)layer on the nylon fabric surface,which facilitates the subsequent MXene attachment through hydrogen bonding.This fusion results in MXene-based thermo-electric fabric that excels in both temperature sensing and strain sensing.The resultant MXene-based thermoelectric fabric exhibits outstanding temperature detection capability and cyclic stability,while also delivering excellent sensitivity,rapid responsiveness(60 ms),and remarkable durability in strain sens-ing(3200 cycles).Moreover,when affixed to a mask,this MXene-based thermoelectric fabric utilizes the temperature difference between the body and the environment to harness body heat,converting it into electrical energy and accurately discerning the body’s respiratory rate.In addition,the MXene-based ther-moelectric fabric can monitor the state of the body’s joint through its own deformation.Furthermore,it possesses the capability to convert solar energy into heat.These findings indicate that MXene-based ther-moelectric fabric holds great promise for applications in power generation,motion tracking,and health monitoring.展开更多
Iced transmission line galloping poses a significant threat to the safety and reliability of power systems,leading directly to line tripping,disconnections,and power outages.Existing early warning methods of iced tran...Iced transmission line galloping poses a significant threat to the safety and reliability of power systems,leading directly to line tripping,disconnections,and power outages.Existing early warning methods of iced transmission line galloping suffer from issues such as reliance on a single data source,neglect of irregular time series,and lack of attention-based closed-loop feedback,resulting in high rates of missed and false alarms.To address these challenges,we propose an Internet of Things(IoT)empowered early warning method of transmission line galloping that integrates time series data from optical fiber sensing and weather forecast.Initially,the method applies a primary adaptive weighted fusion to the IoT empowered optical fiber real-time sensing data and weather forecast data,followed by a secondary fusion based on a Back Propagation(BP)neural network,and uses the K-medoids algorithm for clustering the fused data.Furthermore,an adaptive irregular time series perception adjustment module is introduced into the traditional Gated Recurrent Unit(GRU)network,and closed-loop feedback based on attentionmechanism is employed to update network parameters through gradient feedback of the loss function,enabling closed-loop training and time series data prediction of the GRU network model.Subsequently,considering various types of prediction data and the duration of icing,an iced transmission line galloping risk coefficient is established,and warnings are categorized based on this coefficient.Finally,using an IoT-driven realistic dataset of iced transmission line galloping,the effectiveness of the proposed method is validated through multi-dimensional simulation scenarios.展开更多
Objective To develop a non-invasive predictive model for coronary artery stenosis severity based on adaptive multi-modal integration of traditional Chinese and western medicine data.Methods Clinical indicators,echocar...Objective To develop a non-invasive predictive model for coronary artery stenosis severity based on adaptive multi-modal integration of traditional Chinese and western medicine data.Methods Clinical indicators,echocardiographic data,traditional Chinese medicine(TCM)tongue manifestations,and facial features were collected from patients who underwent coro-nary computed tomography angiography(CTA)in the Cardiac Care Unit(CCU)of Shanghai Tenth People's Hospital between May 1,2023 and May 1,2024.An adaptive weighted multi-modal data fusion(AWMDF)model based on deep learning was constructed to predict the severity of coronary artery stenosis.The model was evaluated using metrics including accura-cy,precision,recall,F1 score,and the area under the receiver operating characteristic(ROC)curve(AUC).Further performance assessment was conducted through comparisons with six ensemble machine learning methods,data ablation,model component ablation,and various decision-level fusion strategies.Results A total of 158 patients were included in the study.The AWMDF model achieved ex-cellent predictive performance(AUC=0.973,accuracy=0.937,precision=0.937,recall=0.929,and F1 score=0.933).Compared with model ablation,data ablation experiments,and various traditional machine learning models,the AWMDF model demonstrated superior per-formance.Moreover,the adaptive weighting strategy outperformed alternative approaches,including simple weighting,averaging,voting,and fixed-weight schemes.Conclusion The AWMDF model demonstrates potential clinical value in the non-invasive prediction of coronary artery disease and could serve as a tool for clinical decision support.展开更多
Sleep monitoring is an important part of health management because sleep quality is crucial for restoration of human health.However,current commercial products of polysomnography are cumbersome with connecting wires a...Sleep monitoring is an important part of health management because sleep quality is crucial for restoration of human health.However,current commercial products of polysomnography are cumbersome with connecting wires and state-of-the-art flexible sensors are still interferential for being attached to the body.Herein,we develop a flexible-integrated multimodal sensing patch based on hydrogel and its application in unconstraint sleep monitoring.The patch comprises a bottom hydrogel-based dualmode pressure–temperature sensing layer and a top electrospun nanofiber-based non-contact detection layer as one integrated device.The hydrogel as core substrate exhibits strong toughness and water retention,and the multimodal sensing of temperature,pressure,and non-contact proximity is realized based on different sensing mechanisms with no crosstalk interference.The multimodal sensing function is verified in a simulated real-world scenario by a robotic hand grasping objects to validate its practicability.Multiple multimodal sensing patches integrated on different locations of a pillow are assembled for intelligent sleep monitoring.Versatile human–pillow interaction information as well as their evolution over time are acquired and analyzed by a one-dimensional convolutional neural network.Track of head movement and recognition of bad patterns that may lead to poor sleep are achieved,which provides a promising approach for sleep monitoring.展开更多
An improved model based on you only look once version 8(YOLOv8)is proposed to solve the problem of low detection accuracy due to the diversity of object sizes in optical remote sensing images.Firstly,the feature pyram...An improved model based on you only look once version 8(YOLOv8)is proposed to solve the problem of low detection accuracy due to the diversity of object sizes in optical remote sensing images.Firstly,the feature pyramid network(FPN)structure of the original YOLOv8 mode is replaced by the generalized-FPN(GFPN)structure in GiraffeDet to realize the"cross-layer"and"cross-scale"adaptive feature fusion,to enrich the semantic information and spatial information on the feature map to improve the target detection ability of the model.Secondly,a pyramid-pool module of multi atrous spatial pyramid pooling(MASPP)is designed by using the idea of atrous convolution and feature pyramid structure to extract multi-scale features,so as to improve the processing ability of the model for multi-scale objects.The experimental results show that the detection accuracy of the improved YOLOv8 model on DIOR dataset is 92%and mean average precision(mAP)is 87.9%,respectively 3.5%and 1.7%higher than those of the original model.It is proved the detection and classification ability of the proposed model on multi-dimensional optical remote sensing target has been improved.展开更多
To prepare a conductive polymer actuator with decent performance,a self-built experimental platform for the preparation of polypyrrole film is employed.One of the essential goals is to examine the mechanical character...To prepare a conductive polymer actuator with decent performance,a self-built experimental platform for the preparation of polypyrrole film is employed.One of the essential goals is to examine the mechanical characteristics of the actuator in the presence of various combinations of process parameters,combined with the orthogonal test method of"four factors and three levels".The bending and sensing characteristics of actuators of various sizes are methodically examined using a self-made bending polypyrrole actuator.The functional relationship between the bending displacement and the output voltage signal is established by studying the characteristics of the actuator sensor subjected to various degrees of bending.The experimental results reveal that the bending displacement of the actuator tip almost exhibits a linear variation as a function of length and width.When the voltage reaches 0.8 V,the bending speed of the actuator tends to be stable.Finally,the mechanical properties of the self-assembled polypyrrole actuator are verified by the design and fabrication of the microgripper.展开更多
A phenylphenothiazine anchored Tb(Ⅲ)-cyclen complex PTP-Cy-Tb for hypochlorite ion(ClO^(-))detection has been designed and prepared.PTP-Cy-Tb shows a weak Tb-based emission with AIE-characteristics in aqueous solutio...A phenylphenothiazine anchored Tb(Ⅲ)-cyclen complex PTP-Cy-Tb for hypochlorite ion(ClO^(-))detection has been designed and prepared.PTP-Cy-Tb shows a weak Tb-based emission with AIE-characteristics in aqueous solutions.After addition of ClO^(-),the fluorescence of PTP-Cy-Tb gives a large enhancement for oxidization the thioether to sulfoxide group.The detection limit of PTP-Cy-Tb toward ClO^(-)is as low as 8.85 nmol/L.The sensing mechanism was detailedly investigated by time of flight mass spectrometer(TOF-MS),Fourier transform infrared spectroscopy(FT-IR)and density functional theory(DFT)calculation.In addition,PTP-Cy-Tb has been successfully used for on-site and real-time detection of ClO^(-)in real water samples by using the smartphone-based visualization method and test strips.展开更多
The use of AI technologies in remote sensing(RS)tasks has been the focus of many individuals in both the professional and academic domains.Having more accessible interfaces and tools that allow people of little or no ...The use of AI technologies in remote sensing(RS)tasks has been the focus of many individuals in both the professional and academic domains.Having more accessible interfaces and tools that allow people of little or no experience to intuitively interact with RS data of multiple formats is a potential provided by this integration.However,the use of AI and AI agents to help automate RS-related tasks is still in its infancy stage,with some frameworks and interfaces built on top of well-known vision language models(VLM)such as GPT-4,segment anything model(SAM),and grounding DINO.These tools do promise and draw guidelines on the potentials and limitations of existing solutions concerning the use of said models.In this work,the state of the art AI foundation models(FM)are reviewed and used in a multi-modal manner to ingest RS imagery input and perform zero-shot object detection using natural language.The natural language input is then used to define the classes or labels the model should look for,then,both inputs are fed to the pipeline.The pipeline presented in this work makes up for the shortcomings of the general knowledge FMs by stacking pre-processing and post-processing applications on top of the FMs;these applications include tiling to produce uniform patches of the original image for faster detection,outlier rejection of redundant bounding boxes using statistical and machine learning methods.The pipeline was tested with UAV,aerial and satellite images taken over multiple areas.The accuracy for the semantic segmentation showed improvement from the original 64%to approximately 80%-99%by utilizing the pipeline and techniques proposed in this work.GitHub Repository:MohanadDiab/LangRS.展开更多
Yellow rust(Puccinia striiformis f.sp.Tritici,YR)and fusarium head blight(Fusarium graminearum,FHB)are the two main diseases affecting wheat in the main grain-producing areas of East China,which is common for the two ...Yellow rust(Puccinia striiformis f.sp.Tritici,YR)and fusarium head blight(Fusarium graminearum,FHB)are the two main diseases affecting wheat in the main grain-producing areas of East China,which is common for the two diseases to appear simultaneously in some main production areas.It is necessary to discriminate wheat YR and FHB at the regional scale to accurately locate the disease in space,conduct detailed disease severity monitoring,and scientific control.Four images on different dates were acquired from Sentinel-2,Landsat-8,and Gaofen-1 during the critical period of winter wheat,and 22 remote sensing features that characterize the wheat growth status were then calculated.Meanwhile,6 meteorological parameters that reflect the wheat phenological information were also obtained by combining the site meteorological data and spatial interpolation technology.Then,the principal components(PCs)of comprehensive remote sensing and meteorological features were extracted with principal component analysis(PCA).The PCs-based discrimination models were established to map YR and FHB damage using the random forest(RF)and backpropagation neural network(BPNN).The models’performance was verified based on the disease field truth data(57 plots during the filling period)and 5-fold cross-validation.The results revealed that the PCs obtained after PCA dimensionality reduction outperformed the initial features(IFs)from remote sensing and meteorology in discriminating between the two diseases.Compared to the IFs,the average area under the curve for both micro-average and macro-average ROC curves increased by 0.07 in the PCs-based RF models and increased by 0.16 and 0.13,respectively,in the PCs-based BPNN models.Notably,the PCs-based BPNN discrimination model emerged as the most effective,achieving an overall accuracy of 83.9%.Our proposed discrimination model for wheat YR and FHB,coupled with multi-source remote sensing images and meteorological data,overcomes the limitations of a single-sensor and single-phase remote sensing information in multiple stress discrimination in cloudy and rainy areas.It performs well in revealing the damage spatial distribution of the two diseases at a regional scale,providing a basis for detailed disease severity monitoring,and scientific prevention and control.展开更多
A novel 3D metal-organic framework(MOF)[Pr_(2)(L)_(3)(H_(2)O)5·H_(2)O]n(Pr-1),(H_(2)L=4,4'-oxybis(benzoic acid))with a rare structure of broken layer net,was constructed under the condition of solvothermal sy...A novel 3D metal-organic framework(MOF)[Pr_(2)(L)_(3)(H_(2)O)5·H_(2)O]n(Pr-1),(H_(2)L=4,4'-oxybis(benzoic acid))with a rare structure of broken layer net,was constructed under the condition of solvothermal synthesis.The struc-ture and crystal net were analyzed and characterized.This rod net of Pr-1 is new to both RCSR and ToposPro data-bases,and is named as rn-12 as suggested.Due to the luminescent properties of H_(2)L and Pr(Ⅲ),the solid-state fluo-rescence property and sensing performance(solvents and metal ions)of Pr-1 were investigated.The sensing experi-ments indicated that Pr-1 could act as a fluorescence sensor to detect Cd^(2+)ions with good sensitivity.In addition,antibacterial activities show that Pr-1 exhibited stronger antibacterial activity against Escherichia coli(E.coli),Staphylococcus aureus(S.aureus),and Bacillus subtilis(B.subtilis)compared to synthetic materials.展开更多
Cloud detection is a critical preprocessing step in remote sensing image processing, as the presence of clouds significantly affects the accuracy of remote sensing data and limits its applicability across various doma...Cloud detection is a critical preprocessing step in remote sensing image processing, as the presence of clouds significantly affects the accuracy of remote sensing data and limits its applicability across various domains. This study presents an enhanced cloud detection method based on the U-Net architecture, designed to address the challenges of multi-scale cloud features and long-range dependencies inherent in remote sensing imagery. A Multi-Scale Dilated Attention (MSDA) module is introduced to effectively integrate multi-scale information and model long-range dependencies across different scales, enhancing the model’s ability to detect clouds of varying sizes. Additionally, a Multi-Head Self-Attention (MHSA) mechanism is incorporated to improve the model’s capacity for capturing finer details, particularly in distinguishing thin clouds from surface features. A multi-path supervision mechanism is also devised to ensure the model learns cloud features at multiple scales, further boosting the accuracy and robustness of cloud mask generation. Experimental results demonstrate that the enhanced model achieves superior performance compared to other benchmarked methods in complex scenarios. It significantly improves cloud detection accuracy, highlighting its strong potential for practical applications in cloud detection tasks.展开更多
Remote sensing and web-based platforms have emerged as vital tools in the effective monitoring of mangrove ecosystems, which are crucial for coastal protection, biodiversity, and carbon sequestration. Utilizing satell...Remote sensing and web-based platforms have emerged as vital tools in the effective monitoring of mangrove ecosystems, which are crucial for coastal protection, biodiversity, and carbon sequestration. Utilizing satellite imagery and aerial data, remote sensing allows researchers to assess the health and extent of mangrove forests over large areas and time periods, providing insights into changes due to environmental stressors like climate change, urbanization, and deforestation. Coupled with web-based platforms, this technology facilitates real-time data sharing and collaborative research efforts among scientists, policymakers, and conservationists. Thus, there is a need to grow this research interest among experts working in this kind of ecosystem. The aim of this paper is to provide a comprehensive literature review on the effective role of remote sensing and web-based platform in monitoring mangrove ecosystem. The research paper utilized the thematic approach to extract specific information to use in the discussion which helped realize the efficiency of digital monitoring for the environment. Web-based platforms and remote sensing represent a powerful tool for environmental monitoring, particularly in the context of forest ecosystems. They facilitate the accessibility of vital data, promote collaboration among stakeholders, support evidence-based policymaking, and engage communities in conservation efforts. As experts confront the urgent challenges posed by climate change and environmental degradation, leveraging technology through web-based platforms is essential for fostering a sustainable future for the forests of the world.展开更多
Multi-modal Named Entity Recognition(MNER)aims to better identify meaningful textual entities by integrating information from images.Previous work has focused on extracting visual semantics at a fine-grained level,or ...Multi-modal Named Entity Recognition(MNER)aims to better identify meaningful textual entities by integrating information from images.Previous work has focused on extracting visual semantics at a fine-grained level,or obtaining entity related external knowledge from knowledge bases or Large Language Models(LLMs).However,these approaches ignore the poor semantic correlation between visual and textual modalities in MNER datasets and do not explore different multi-modal fusion approaches.In this paper,we present MMAVK,a multi-modal named entity recognition model with auxiliary visual knowledge and word-level fusion,which aims to leverage the Multi-modal Large Language Model(MLLM)as an implicit knowledge base.It also extracts vision-based auxiliary knowledge from the image formore accurate and effective recognition.Specifically,we propose vision-based auxiliary knowledge generation,which guides the MLLM to extract external knowledge exclusively derived from images to aid entity recognition by designing target-specific prompts,thus avoiding redundant recognition and cognitive confusion caused by the simultaneous processing of image-text pairs.Furthermore,we employ a word-level multi-modal fusion mechanism to fuse the extracted external knowledge with each word-embedding embedded from the transformerbased encoder.Extensive experimental results demonstrate that MMAVK outperforms or equals the state-of-the-art methods on the two classical MNER datasets,even when the largemodels employed have significantly fewer parameters than other baselines.展开更多
Multi-modal knowledge graph completion(MMKGC)aims to complete missing entities or relations in multi-modal knowledge graphs,thereby discovering more previously unknown triples.Due to the continuous growth of data and ...Multi-modal knowledge graph completion(MMKGC)aims to complete missing entities or relations in multi-modal knowledge graphs,thereby discovering more previously unknown triples.Due to the continuous growth of data and knowledge and the limitations of data sources,the visual knowledge within the knowledge graphs is generally of low quality,and some entities suffer from the issue of missing visual modality.Nevertheless,previous studies of MMKGC have primarily focused on how to facilitate modality interaction and fusion while neglecting the problems of low modality quality and modality missing.In this case,mainstream MMKGC models only use pre-trained visual encoders to extract features and transfer the semantic information to the joint embeddings through modal fusion,which inevitably suffers from problems such as error propagation and increased uncertainty.To address these problems,we propose a Multi-modal knowledge graph Completion model based on Super-resolution and Detailed Description Generation(MMCSD).Specifically,we leverage a pre-trained residual network to enhance the resolution and improve the quality of the visual modality.Moreover,we design multi-level visual semantic extraction and entity description generation,thereby further extracting entity semantics from structural triples and visual images.Meanwhile,we train a variational multi-modal auto-encoder and utilize a pre-trained multi-modal language model to complement the missing visual features.We conducted experiments on FB15K-237 and DB13K,and the results showed that MMCSD can effectively perform MMKGC and achieve state-of-the-art performance.展开更多
This paper explores the recovery of block sparse signals in frame-based settings using the l_(2)/l_(q)-synthesis technique(0<q≤1).We propose a new null space property,referred to as block D-NSP_(q),which is based ...This paper explores the recovery of block sparse signals in frame-based settings using the l_(2)/l_(q)-synthesis technique(0<q≤1).We propose a new null space property,referred to as block D-NSP_(q),which is based on the dictionary D.We establish that matrices adhering to the block D-NSP_(q)condition are both necessary and sufficient for the exact recovery of block sparse signals via l_(2)/l_(q)-synthesis.Additionally,this condition is essential for the stable recovery of signals that are block-compressible with respect to D.This D-NSP_(q)property is identified as the first complete condition for successful signal recovery using l_(2)/l_(q)-synthesis.Furthermore,we assess the theoretical efficacy of the l2/lq-synthesis method under conditions of measurement noise.展开更多
Stimuli-responsive two-dimensional (2D) covalent organic frameworks (COFs) with precise structures and permanent porosity have been employed as platforms for sensors. The slight change of backbones inside frameworks l...Stimuli-responsive two-dimensional (2D) covalent organic frameworks (COFs) with precise structures and permanent porosity have been employed as platforms for sensors. The slight change of backbones inside frameworks leads to different electronic states by external stimuli, such as solvent, pH, and water. Herein, we introduced an alkynyl-based building block (ETBA) with high planarity to synthesize two imine-based alkynyl-COFs (ETBA-TAPE-COF and ETBA-PYTA-COF) with high yield, good crystallinity, and chemical stability. Due to the presence of acetylene bonds, ETBA-TAPE-COF does not adopt the completely overlapping AA stacking mode. Slight interlayer displacement occurs along the parallel direction relative to the acetylene linkages, which facilitates lower configurational energy. Additionally, the introduction of pyrene group contributes to high π-electron mobility of ETBA-PYTA-COF. The interactions between electron-withdrawing group (ETBA) and electron-donating group (PYTA) during the processes of protonation and intramolecular charge transfer (ICT) endow ETBA-PYTA-COF with excellent acidochromic and solvatochromic properties, respectively. Based on this, a fluorescence sensor is successfully established, which can be used for rapid response to trace amounts of water in organic solvents. In contrast, ETBA-TAPE-COF does not exhibit these photophysical properties due to its higher HOMO–LUMO gap compared to ETBA-PYTA-COF. This work proposes a new strategy for designing and preparing COFs with unique photophysical properties without introducing additional functional groups.展开更多
Integrating multiple medical imaging techniques,including Magnetic Resonance Imaging(MRI),Computed Tomography,Positron Emission Tomography(PET),and ultrasound,provides a comprehensive view of the patient health status...Integrating multiple medical imaging techniques,including Magnetic Resonance Imaging(MRI),Computed Tomography,Positron Emission Tomography(PET),and ultrasound,provides a comprehensive view of the patient health status.Each of these methods contributes unique diagnostic insights,enhancing the overall assessment of patient condition.Nevertheless,the amalgamation of data from multiple modalities presents difficulties due to disparities in resolution,data collection methods,and noise levels.While traditional models like Convolutional Neural Networks(CNNs)excel in single-modality tasks,they struggle to handle multi-modal complexities,lacking the capacity to model global relationships.This research presents a novel approach for examining multi-modal medical imagery using a transformer-based system.The framework employs self-attention and cross-attention mechanisms to synchronize and integrate features across various modalities.Additionally,it shows resilience to variations in noise and image quality,making it adaptable for real-time clinical use.To address the computational hurdles linked to transformer models,particularly in real-time clinical applications in resource-constrained environments,several optimization techniques have been integrated to boost scalability and efficiency.Initially,a streamlined transformer architecture was adopted to minimize the computational load while maintaining model effectiveness.Methods such as model pruning,quantization,and knowledge distillation have been applied to reduce the parameter count and enhance the inference speed.Furthermore,efficient attention mechanisms such as linear or sparse attention were employed to alleviate the substantial memory and processing requirements of traditional self-attention operations.For further deployment optimization,researchers have implemented hardware-aware acceleration strategies,including the use of TensorRT and ONNX-based model compression,to ensure efficient execution on edge devices.These optimizations allow the approach to function effectively in real-time clinical settings,ensuring viability even in environments with limited resources.Future research directions include integrating non-imaging data to facilitate personalized treatment and enhancing computational efficiency for implementation in resource-limited environments.This study highlights the transformative potential of transformer models in multi-modal medical imaging,offering improvements in diagnostic accuracy and patient care outcomes.展开更多
Chloroform and other volatile organic pollutants have garnered widespread attention from the public and researchers,because of their potential harm to the respiratory system,nervous system,skin,and eyes.However,resear...Chloroform and other volatile organic pollutants have garnered widespread attention from the public and researchers,because of their potential harm to the respiratory system,nervous system,skin,and eyes.However,research on chloroform vapor sensing is still in its early stages,primarily due to the lack of specific recognition motif.Here we report a mesoporous photonic crystal sensor incorporating carbon dots-based nanoreceptor(HMSS@CDs-PCs)for enhanced chloroform sensing.The colloidal PC packed with hollow mesoporous silica spheres provides an interconnected ordered macro-meso-hierarchical porous structure,ideal for rapid gas sensing utilizing the photonic bandgap shift as the readout signal.The as-synthesized CDs with pyridinic-N-oxide functional groups adsorbed in the hollow mesoporous silica spheres are found to not only serve as the chloroform adsorption sites,but also a molecular glue that prevents crack formation in the colloidal PC.The sensitivity of HMSS@CDs-PCs sensor is 0.79 nm ppm^(-1)and an impressively low limit of detection is 3.22 ppm,which are the best reported values in fast-response chloroform vapor sensor without multi-signal assistance.The positive response time is 7.5 s and the negative response time 9 s.Furthermore,relatively stable sensing can be maintained within a relative humidity of 20%-85%RH and temperature of 25-55℃.This study demonstrates that HMSS@CDs-PCs sensors have practical application potential in indoor and outdoor chloroform vapor detection.展开更多
基金supported by the National Natural Science Foundation of China(No.12302192)the Fundamental Research Funds for the Central Universities(No.SWU-KQ22025)+4 种基金the Science and Technology Research Program of Chongqing Municipal Education Commission(No.KJQN202300222)Natural Science Foundation of Chongqing(No.cstc2021jcyj-msxmX0241)the Fund for Innovative Research Groups of Natural Science Foundation of Hebei Province(No.A2024202045)Key Technologies and Demonstration Application Research Project for Large-scale Lithium-ion Hybrid Energy Storage Equipment(No.HC23118)Major Basic Research Project of Hebei Province Natural Science Foundation(No.A2023202049).
文摘Ionogels have demonstrated substantial applications in smart wearable systems,soft robotics,and biomedical engineering due to the exceptional ionic conductivity and optical transparency.However,achieving ionogels with desirable mechanical properties,environmental stability,and multi-mode sensing remains challenging.Here,we propose a simple strategy for the fabrication of multifunctional silk fabric-based ionogels(BSFIGs).The resulting fabric ionogels exhibits superior mechanical properties,with high tensile strength(11.3 MPa)and work of fracture(2.53 MJ/m^(3)).And its work of fracture still has 1.42 MJ/m^(3)as the notch increased to 50%,indicating its crack growth insensitivity.These ionogels can be used as sensors for strain,temperature,and tactile multimode sensing,demonstrating a gauge factor of 1.19 and a temperature coefficient of resistance of3.17/℃^(-1).Furthermore,these ionogels can be used for the detection of different roughness and as touch screens.The ionogels also exhibit exceptional optical transmittance and environmental stability even at80℃.Our scalable fabrication process broadens the application potential of these multifunctional ionogels in diverse fields,from smart systems to extreme environments.
基金This work was supported in part by the Ministry National Key Research and Development Project(Grant No.2020AAA0108101)the National Natural Science Foundation of China(Grants No.62125101,62341101,62001018,and 62301011)+1 种基金Shandong Natural Science Foundation(Grant No.ZR2023YQ058)the New Cornerstone Science Foundation through the XPLORER PRIZE.The authors would like to thank Mengyuan Lu and Zengrui Han for their help in the construction of electromagnetic space in Wireless InSite simulation platform and Weibo Wen,Qi Duan,and Yong Yu for their help in the construction of phys ical space in AirSim simulation platform.
文摘The sixth generation(6G)of mobile communication system is witnessing a new paradigm shift,i.e.,integrated sensing-communication system.A comprehensive dataset is a prerequisite for 6G integrated sensing-communication research.This paper develops a novel simulation dataset,named M3SC,for mixed multi-modal(MMM)sensing-communication integration,and the generation framework of the M3SC dataset is further given.To obtain multimodal sensory data in physical space and communication data in electromagnetic space,we utilize Air-Sim and WaveFarer to collect multi-modal sensory data and exploit Wireless InSite to collect communication data.Furthermore,the in-depth integration and precise alignment of AirSim,WaveFarer,andWireless InSite are achieved.The M3SC dataset covers various weather conditions,multiplex frequency bands,and different times of the day.Currently,the M3SC dataset contains 1500 snapshots,including 80 RGB images,160 depth maps,80 LiDAR point clouds,256 sets of mmWave waveforms with 8 radar point clouds,and 72 channel impulse response(CIR)matrices per snapshot,thus totaling 120,000 RGB images,240,000 depth maps,120,000 LiDAR point clouds,384,000 sets of mmWave waveforms with 12,000 radar point clouds,and 108,000 CIR matrices.The data processing result presents the multi-modal sensory information and communication channel statistical properties.Finally,the MMM sensing-communication application,which can be supported by the M3SC dataset,is discussed.
基金supported by the National Natural Science Foundation of China(No.21975107)the China Scholarship Council(No.202206790046).
文摘Wearable thermoelectric devices hold significant promise in the realm of self-powered wearable electron-ics,offering applications in energy harvesting,movement tracking,and health monitoring.Nevertheless,developing thermoelectric devices with exceptional flexibility,enduring thermoelectric stability,multi-functional sensing,and comfortable wear remains a challenge.In this work,a stretchable MXene-based thermoelectric fabric is designed to accurately discern temperature and strain stimuli.This is achieved by constructing an adhesive polydopamine(PDA)layer on the nylon fabric surface,which facilitates the subsequent MXene attachment through hydrogen bonding.This fusion results in MXene-based thermo-electric fabric that excels in both temperature sensing and strain sensing.The resultant MXene-based thermoelectric fabric exhibits outstanding temperature detection capability and cyclic stability,while also delivering excellent sensitivity,rapid responsiveness(60 ms),and remarkable durability in strain sens-ing(3200 cycles).Moreover,when affixed to a mask,this MXene-based thermoelectric fabric utilizes the temperature difference between the body and the environment to harness body heat,converting it into electrical energy and accurately discerning the body’s respiratory rate.In addition,the MXene-based ther-moelectric fabric can monitor the state of the body’s joint through its own deformation.Furthermore,it possesses the capability to convert solar energy into heat.These findings indicate that MXene-based ther-moelectric fabric holds great promise for applications in power generation,motion tracking,and health monitoring.
基金research was funded by Science and Technology Project of State Grid Corporation of China under grant number 5200-202319382A-2-3-XG.
文摘Iced transmission line galloping poses a significant threat to the safety and reliability of power systems,leading directly to line tripping,disconnections,and power outages.Existing early warning methods of iced transmission line galloping suffer from issues such as reliance on a single data source,neglect of irregular time series,and lack of attention-based closed-loop feedback,resulting in high rates of missed and false alarms.To address these challenges,we propose an Internet of Things(IoT)empowered early warning method of transmission line galloping that integrates time series data from optical fiber sensing and weather forecast.Initially,the method applies a primary adaptive weighted fusion to the IoT empowered optical fiber real-time sensing data and weather forecast data,followed by a secondary fusion based on a Back Propagation(BP)neural network,and uses the K-medoids algorithm for clustering the fused data.Furthermore,an adaptive irregular time series perception adjustment module is introduced into the traditional Gated Recurrent Unit(GRU)network,and closed-loop feedback based on attentionmechanism is employed to update network parameters through gradient feedback of the loss function,enabling closed-loop training and time series data prediction of the GRU network model.Subsequently,considering various types of prediction data and the duration of icing,an iced transmission line galloping risk coefficient is established,and warnings are categorized based on this coefficient.Finally,using an IoT-driven realistic dataset of iced transmission line galloping,the effectiveness of the proposed method is validated through multi-dimensional simulation scenarios.
基金Construction Program of the Key Discipline of State Administration of Traditional Chinese Medicine of China(ZYYZDXK-2023069)Research Project of Shanghai Municipal Health Commission (2024QN018)Shanghai University of Traditional Chinese Medicine Science and Technology Development Program (23KFL005)。
文摘Objective To develop a non-invasive predictive model for coronary artery stenosis severity based on adaptive multi-modal integration of traditional Chinese and western medicine data.Methods Clinical indicators,echocardiographic data,traditional Chinese medicine(TCM)tongue manifestations,and facial features were collected from patients who underwent coro-nary computed tomography angiography(CTA)in the Cardiac Care Unit(CCU)of Shanghai Tenth People's Hospital between May 1,2023 and May 1,2024.An adaptive weighted multi-modal data fusion(AWMDF)model based on deep learning was constructed to predict the severity of coronary artery stenosis.The model was evaluated using metrics including accura-cy,precision,recall,F1 score,and the area under the receiver operating characteristic(ROC)curve(AUC).Further performance assessment was conducted through comparisons with six ensemble machine learning methods,data ablation,model component ablation,and various decision-level fusion strategies.Results A total of 158 patients were included in the study.The AWMDF model achieved ex-cellent predictive performance(AUC=0.973,accuracy=0.937,precision=0.937,recall=0.929,and F1 score=0.933).Compared with model ablation,data ablation experiments,and various traditional machine learning models,the AWMDF model demonstrated superior per-formance.Moreover,the adaptive weighting strategy outperformed alternative approaches,including simple weighting,averaging,voting,and fixed-weight schemes.Conclusion The AWMDF model demonstrates potential clinical value in the non-invasive prediction of coronary artery disease and could serve as a tool for clinical decision support.
基金supported by the National Key Research and Development Program of China under Grant(2024YFE0100400)Taishan Scholars Project Special Funds(tsqn202312035)+2 种基金the open research foundation of State Key Laboratory of Integrated Chips and Systems,the Tianjin Science and Technology Plan Project(No.22JCZDJC00630)the Higher Education Institution Science and Technology Research Project of Hebei Province(No.JZX2024024)Jinan City-University Integrated Development Strategy Project under Grant(JNSX2023017).
文摘Sleep monitoring is an important part of health management because sleep quality is crucial for restoration of human health.However,current commercial products of polysomnography are cumbersome with connecting wires and state-of-the-art flexible sensors are still interferential for being attached to the body.Herein,we develop a flexible-integrated multimodal sensing patch based on hydrogel and its application in unconstraint sleep monitoring.The patch comprises a bottom hydrogel-based dualmode pressure–temperature sensing layer and a top electrospun nanofiber-based non-contact detection layer as one integrated device.The hydrogel as core substrate exhibits strong toughness and water retention,and the multimodal sensing of temperature,pressure,and non-contact proximity is realized based on different sensing mechanisms with no crosstalk interference.The multimodal sensing function is verified in a simulated real-world scenario by a robotic hand grasping objects to validate its practicability.Multiple multimodal sensing patches integrated on different locations of a pillow are assembled for intelligent sleep monitoring.Versatile human–pillow interaction information as well as their evolution over time are acquired and analyzed by a one-dimensional convolutional neural network.Track of head movement and recognition of bad patterns that may lead to poor sleep are achieved,which provides a promising approach for sleep monitoring.
基金supported by the National Natural Science Foundation of China(No.62241109)the Tianjin Science and Technology Commissioner Project(No.20YDTPJC01110)。
文摘An improved model based on you only look once version 8(YOLOv8)is proposed to solve the problem of low detection accuracy due to the diversity of object sizes in optical remote sensing images.Firstly,the feature pyramid network(FPN)structure of the original YOLOv8 mode is replaced by the generalized-FPN(GFPN)structure in GiraffeDet to realize the"cross-layer"and"cross-scale"adaptive feature fusion,to enrich the semantic information and spatial information on the feature map to improve the target detection ability of the model.Secondly,a pyramid-pool module of multi atrous spatial pyramid pooling(MASPP)is designed by using the idea of atrous convolution and feature pyramid structure to extract multi-scale features,so as to improve the processing ability of the model for multi-scale objects.The experimental results show that the detection accuracy of the improved YOLOv8 model on DIOR dataset is 92%and mean average precision(mAP)is 87.9%,respectively 3.5%and 1.7%higher than those of the original model.It is proved the detection and classification ability of the proposed model on multi-dimensional optical remote sensing target has been improved.
基金Funded by the National Natural Science Foundation of Hunan Province,Chinal(No.2021JJ60012)。
文摘To prepare a conductive polymer actuator with decent performance,a self-built experimental platform for the preparation of polypyrrole film is employed.One of the essential goals is to examine the mechanical characteristics of the actuator in the presence of various combinations of process parameters,combined with the orthogonal test method of"four factors and three levels".The bending and sensing characteristics of actuators of various sizes are methodically examined using a self-made bending polypyrrole actuator.The functional relationship between the bending displacement and the output voltage signal is established by studying the characteristics of the actuator sensor subjected to various degrees of bending.The experimental results reveal that the bending displacement of the actuator tip almost exhibits a linear variation as a function of length and width.When the voltage reaches 0.8 V,the bending speed of the actuator tends to be stable.Finally,the mechanical properties of the self-assembled polypyrrole actuator are verified by the design and fabrication of the microgripper.
基金supported by the National Nature Science Foundation of China(Nos.22061028 and 22361028)Jiangxi Provincial Natural Science Foundation(No.20224ACB203012)。
文摘A phenylphenothiazine anchored Tb(Ⅲ)-cyclen complex PTP-Cy-Tb for hypochlorite ion(ClO^(-))detection has been designed and prepared.PTP-Cy-Tb shows a weak Tb-based emission with AIE-characteristics in aqueous solutions.After addition of ClO^(-),the fluorescence of PTP-Cy-Tb gives a large enhancement for oxidization the thioether to sulfoxide group.The detection limit of PTP-Cy-Tb toward ClO^(-)is as low as 8.85 nmol/L.The sensing mechanism was detailedly investigated by time of flight mass spectrometer(TOF-MS),Fourier transform infrared spectroscopy(FT-IR)and density functional theory(DFT)calculation.In addition,PTP-Cy-Tb has been successfully used for on-site and real-time detection of ClO^(-)in real water samples by using the smartphone-based visualization method and test strips.
文摘The use of AI technologies in remote sensing(RS)tasks has been the focus of many individuals in both the professional and academic domains.Having more accessible interfaces and tools that allow people of little or no experience to intuitively interact with RS data of multiple formats is a potential provided by this integration.However,the use of AI and AI agents to help automate RS-related tasks is still in its infancy stage,with some frameworks and interfaces built on top of well-known vision language models(VLM)such as GPT-4,segment anything model(SAM),and grounding DINO.These tools do promise and draw guidelines on the potentials and limitations of existing solutions concerning the use of said models.In this work,the state of the art AI foundation models(FM)are reviewed and used in a multi-modal manner to ingest RS imagery input and perform zero-shot object detection using natural language.The natural language input is then used to define the classes or labels the model should look for,then,both inputs are fed to the pipeline.The pipeline presented in this work makes up for the shortcomings of the general knowledge FMs by stacking pre-processing and post-processing applications on top of the FMs;these applications include tiling to produce uniform patches of the original image for faster detection,outlier rejection of redundant bounding boxes using statistical and machine learning methods.The pipeline was tested with UAV,aerial and satellite images taken over multiple areas.The accuracy for the semantic segmentation showed improvement from the original 64%to approximately 80%-99%by utilizing the pipeline and techniques proposed in this work.GitHub Repository:MohanadDiab/LangRS.
基金supported by National Key R&D Program of China(2022YFD2000100)National Natural Science Foundation of China(42401400)Zhejiang Provincial Key Research and Development Program(2023C02018).
文摘Yellow rust(Puccinia striiformis f.sp.Tritici,YR)and fusarium head blight(Fusarium graminearum,FHB)are the two main diseases affecting wheat in the main grain-producing areas of East China,which is common for the two diseases to appear simultaneously in some main production areas.It is necessary to discriminate wheat YR and FHB at the regional scale to accurately locate the disease in space,conduct detailed disease severity monitoring,and scientific control.Four images on different dates were acquired from Sentinel-2,Landsat-8,and Gaofen-1 during the critical period of winter wheat,and 22 remote sensing features that characterize the wheat growth status were then calculated.Meanwhile,6 meteorological parameters that reflect the wheat phenological information were also obtained by combining the site meteorological data and spatial interpolation technology.Then,the principal components(PCs)of comprehensive remote sensing and meteorological features were extracted with principal component analysis(PCA).The PCs-based discrimination models were established to map YR and FHB damage using the random forest(RF)and backpropagation neural network(BPNN).The models’performance was verified based on the disease field truth data(57 plots during the filling period)and 5-fold cross-validation.The results revealed that the PCs obtained after PCA dimensionality reduction outperformed the initial features(IFs)from remote sensing and meteorology in discriminating between the two diseases.Compared to the IFs,the average area under the curve for both micro-average and macro-average ROC curves increased by 0.07 in the PCs-based RF models and increased by 0.16 and 0.13,respectively,in the PCs-based BPNN models.Notably,the PCs-based BPNN discrimination model emerged as the most effective,achieving an overall accuracy of 83.9%.Our proposed discrimination model for wheat YR and FHB,coupled with multi-source remote sensing images and meteorological data,overcomes the limitations of a single-sensor and single-phase remote sensing information in multiple stress discrimination in cloudy and rainy areas.It performs well in revealing the damage spatial distribution of the two diseases at a regional scale,providing a basis for detailed disease severity monitoring,and scientific prevention and control.
文摘A novel 3D metal-organic framework(MOF)[Pr_(2)(L)_(3)(H_(2)O)5·H_(2)O]n(Pr-1),(H_(2)L=4,4'-oxybis(benzoic acid))with a rare structure of broken layer net,was constructed under the condition of solvothermal synthesis.The struc-ture and crystal net were analyzed and characterized.This rod net of Pr-1 is new to both RCSR and ToposPro data-bases,and is named as rn-12 as suggested.Due to the luminescent properties of H_(2)L and Pr(Ⅲ),the solid-state fluo-rescence property and sensing performance(solvents and metal ions)of Pr-1 were investigated.The sensing experi-ments indicated that Pr-1 could act as a fluorescence sensor to detect Cd^(2+)ions with good sensitivity.In addition,antibacterial activities show that Pr-1 exhibited stronger antibacterial activity against Escherichia coli(E.coli),Staphylococcus aureus(S.aureus),and Bacillus subtilis(B.subtilis)compared to synthetic materials.
文摘Cloud detection is a critical preprocessing step in remote sensing image processing, as the presence of clouds significantly affects the accuracy of remote sensing data and limits its applicability across various domains. This study presents an enhanced cloud detection method based on the U-Net architecture, designed to address the challenges of multi-scale cloud features and long-range dependencies inherent in remote sensing imagery. A Multi-Scale Dilated Attention (MSDA) module is introduced to effectively integrate multi-scale information and model long-range dependencies across different scales, enhancing the model’s ability to detect clouds of varying sizes. Additionally, a Multi-Head Self-Attention (MHSA) mechanism is incorporated to improve the model’s capacity for capturing finer details, particularly in distinguishing thin clouds from surface features. A multi-path supervision mechanism is also devised to ensure the model learns cloud features at multiple scales, further boosting the accuracy and robustness of cloud mask generation. Experimental results demonstrate that the enhanced model achieves superior performance compared to other benchmarked methods in complex scenarios. It significantly improves cloud detection accuracy, highlighting its strong potential for practical applications in cloud detection tasks.
文摘Remote sensing and web-based platforms have emerged as vital tools in the effective monitoring of mangrove ecosystems, which are crucial for coastal protection, biodiversity, and carbon sequestration. Utilizing satellite imagery and aerial data, remote sensing allows researchers to assess the health and extent of mangrove forests over large areas and time periods, providing insights into changes due to environmental stressors like climate change, urbanization, and deforestation. Coupled with web-based platforms, this technology facilitates real-time data sharing and collaborative research efforts among scientists, policymakers, and conservationists. Thus, there is a need to grow this research interest among experts working in this kind of ecosystem. The aim of this paper is to provide a comprehensive literature review on the effective role of remote sensing and web-based platform in monitoring mangrove ecosystem. The research paper utilized the thematic approach to extract specific information to use in the discussion which helped realize the efficiency of digital monitoring for the environment. Web-based platforms and remote sensing represent a powerful tool for environmental monitoring, particularly in the context of forest ecosystems. They facilitate the accessibility of vital data, promote collaboration among stakeholders, support evidence-based policymaking, and engage communities in conservation efforts. As experts confront the urgent challenges posed by climate change and environmental degradation, leveraging technology through web-based platforms is essential for fostering a sustainable future for the forests of the world.
基金funded by Research Project,grant number BHQ090003000X03.
文摘Multi-modal Named Entity Recognition(MNER)aims to better identify meaningful textual entities by integrating information from images.Previous work has focused on extracting visual semantics at a fine-grained level,or obtaining entity related external knowledge from knowledge bases or Large Language Models(LLMs).However,these approaches ignore the poor semantic correlation between visual and textual modalities in MNER datasets and do not explore different multi-modal fusion approaches.In this paper,we present MMAVK,a multi-modal named entity recognition model with auxiliary visual knowledge and word-level fusion,which aims to leverage the Multi-modal Large Language Model(MLLM)as an implicit knowledge base.It also extracts vision-based auxiliary knowledge from the image formore accurate and effective recognition.Specifically,we propose vision-based auxiliary knowledge generation,which guides the MLLM to extract external knowledge exclusively derived from images to aid entity recognition by designing target-specific prompts,thus avoiding redundant recognition and cognitive confusion caused by the simultaneous processing of image-text pairs.Furthermore,we employ a word-level multi-modal fusion mechanism to fuse the extracted external knowledge with each word-embedding embedded from the transformerbased encoder.Extensive experimental results demonstrate that MMAVK outperforms or equals the state-of-the-art methods on the two classical MNER datasets,even when the largemodels employed have significantly fewer parameters than other baselines.
基金funded by Research Project,grant number BHQ090003000X03。
文摘Multi-modal knowledge graph completion(MMKGC)aims to complete missing entities or relations in multi-modal knowledge graphs,thereby discovering more previously unknown triples.Due to the continuous growth of data and knowledge and the limitations of data sources,the visual knowledge within the knowledge graphs is generally of low quality,and some entities suffer from the issue of missing visual modality.Nevertheless,previous studies of MMKGC have primarily focused on how to facilitate modality interaction and fusion while neglecting the problems of low modality quality and modality missing.In this case,mainstream MMKGC models only use pre-trained visual encoders to extract features and transfer the semantic information to the joint embeddings through modal fusion,which inevitably suffers from problems such as error propagation and increased uncertainty.To address these problems,we propose a Multi-modal knowledge graph Completion model based on Super-resolution and Detailed Description Generation(MMCSD).Specifically,we leverage a pre-trained residual network to enhance the resolution and improve the quality of the visual modality.Moreover,we design multi-level visual semantic extraction and entity description generation,thereby further extracting entity semantics from structural triples and visual images.Meanwhile,we train a variational multi-modal auto-encoder and utilize a pre-trained multi-modal language model to complement the missing visual features.We conducted experiments on FB15K-237 and DB13K,and the results showed that MMCSD can effectively perform MMKGC and achieve state-of-the-art performance.
基金Supported by The Featured Innovation Projects of the General University of Guangdong Province(2023KTSCX096)The Special Projects in Key Areas of Guangdong Province(ZDZX1088)Research Team Project of Guangdong University of Education(2024KYCXTD018)。
文摘This paper explores the recovery of block sparse signals in frame-based settings using the l_(2)/l_(q)-synthesis technique(0<q≤1).We propose a new null space property,referred to as block D-NSP_(q),which is based on the dictionary D.We establish that matrices adhering to the block D-NSP_(q)condition are both necessary and sufficient for the exact recovery of block sparse signals via l_(2)/l_(q)-synthesis.Additionally,this condition is essential for the stable recovery of signals that are block-compressible with respect to D.This D-NSP_(q)property is identified as the first complete condition for successful signal recovery using l_(2)/l_(q)-synthesis.Furthermore,we assess the theoretical efficacy of the l2/lq-synthesis method under conditions of measurement noise.
基金supported by the National Natural Science Foundation of China(22172055)the Science Fund for Distinguished Young Scholars of Guangdong Province(2023B1515040026)+1 种基金the Key Area Research and Development Program of Guangdong Province(2023B0101200008)the Natural Science Foundation of Guangdong Province(2022A1515011892).
文摘Stimuli-responsive two-dimensional (2D) covalent organic frameworks (COFs) with precise structures and permanent porosity have been employed as platforms for sensors. The slight change of backbones inside frameworks leads to different electronic states by external stimuli, such as solvent, pH, and water. Herein, we introduced an alkynyl-based building block (ETBA) with high planarity to synthesize two imine-based alkynyl-COFs (ETBA-TAPE-COF and ETBA-PYTA-COF) with high yield, good crystallinity, and chemical stability. Due to the presence of acetylene bonds, ETBA-TAPE-COF does not adopt the completely overlapping AA stacking mode. Slight interlayer displacement occurs along the parallel direction relative to the acetylene linkages, which facilitates lower configurational energy. Additionally, the introduction of pyrene group contributes to high π-electron mobility of ETBA-PYTA-COF. The interactions between electron-withdrawing group (ETBA) and electron-donating group (PYTA) during the processes of protonation and intramolecular charge transfer (ICT) endow ETBA-PYTA-COF with excellent acidochromic and solvatochromic properties, respectively. Based on this, a fluorescence sensor is successfully established, which can be used for rapid response to trace amounts of water in organic solvents. In contrast, ETBA-TAPE-COF does not exhibit these photophysical properties due to its higher HOMO–LUMO gap compared to ETBA-PYTA-COF. This work proposes a new strategy for designing and preparing COFs with unique photophysical properties without introducing additional functional groups.
基金supported by the Deanship of Research and Graduate Studies at King Khalid University under Small Research Project grant number RGP1/139/45.
文摘Integrating multiple medical imaging techniques,including Magnetic Resonance Imaging(MRI),Computed Tomography,Positron Emission Tomography(PET),and ultrasound,provides a comprehensive view of the patient health status.Each of these methods contributes unique diagnostic insights,enhancing the overall assessment of patient condition.Nevertheless,the amalgamation of data from multiple modalities presents difficulties due to disparities in resolution,data collection methods,and noise levels.While traditional models like Convolutional Neural Networks(CNNs)excel in single-modality tasks,they struggle to handle multi-modal complexities,lacking the capacity to model global relationships.This research presents a novel approach for examining multi-modal medical imagery using a transformer-based system.The framework employs self-attention and cross-attention mechanisms to synchronize and integrate features across various modalities.Additionally,it shows resilience to variations in noise and image quality,making it adaptable for real-time clinical use.To address the computational hurdles linked to transformer models,particularly in real-time clinical applications in resource-constrained environments,several optimization techniques have been integrated to boost scalability and efficiency.Initially,a streamlined transformer architecture was adopted to minimize the computational load while maintaining model effectiveness.Methods such as model pruning,quantization,and knowledge distillation have been applied to reduce the parameter count and enhance the inference speed.Furthermore,efficient attention mechanisms such as linear or sparse attention were employed to alleviate the substantial memory and processing requirements of traditional self-attention operations.For further deployment optimization,researchers have implemented hardware-aware acceleration strategies,including the use of TensorRT and ONNX-based model compression,to ensure efficient execution on edge devices.These optimizations allow the approach to function effectively in real-time clinical settings,ensuring viability even in environments with limited resources.Future research directions include integrating non-imaging data to facilitate personalized treatment and enhancing computational efficiency for implementation in resource-limited environments.This study highlights the transformative potential of transformer models in multi-modal medical imaging,offering improvements in diagnostic accuracy and patient care outcomes.
基金supported by the National Key Research and Development Program of China(No.2022YFB3205500)National Natural Science Foundation of China(Nos.U23A20360 and 62303192)QL wishes to thank Water Research Australia(WRA 1144/21)for funding support.
文摘Chloroform and other volatile organic pollutants have garnered widespread attention from the public and researchers,because of their potential harm to the respiratory system,nervous system,skin,and eyes.However,research on chloroform vapor sensing is still in its early stages,primarily due to the lack of specific recognition motif.Here we report a mesoporous photonic crystal sensor incorporating carbon dots-based nanoreceptor(HMSS@CDs-PCs)for enhanced chloroform sensing.The colloidal PC packed with hollow mesoporous silica spheres provides an interconnected ordered macro-meso-hierarchical porous structure,ideal for rapid gas sensing utilizing the photonic bandgap shift as the readout signal.The as-synthesized CDs with pyridinic-N-oxide functional groups adsorbed in the hollow mesoporous silica spheres are found to not only serve as the chloroform adsorption sites,but also a molecular glue that prevents crack formation in the colloidal PC.The sensitivity of HMSS@CDs-PCs sensor is 0.79 nm ppm^(-1)and an impressively low limit of detection is 3.22 ppm,which are the best reported values in fast-response chloroform vapor sensor without multi-signal assistance.The positive response time is 7.5 s and the negative response time 9 s.Furthermore,relatively stable sensing can be maintained within a relative humidity of 20%-85%RH and temperature of 25-55℃.This study demonstrates that HMSS@CDs-PCs sensors have practical application potential in indoor and outdoor chloroform vapor detection.
