With rapid urbanization,fires pose significant challenges in urban governance.Traditional fire detection methods often struggle to detect smoke in complex urban scenes due to environmental interferences and variations...With rapid urbanization,fires pose significant challenges in urban governance.Traditional fire detection methods often struggle to detect smoke in complex urban scenes due to environmental interferences and variations in viewing angles.This study proposes a novel multimodal smoke detection method that fuses infrared and visible imagery using a transformer-based deep learning model.By capturing both thermal and visual cues,our approach significantly enhances the accuracy and robustness of smoke detection in business parks scenes.We first established a dual-view dataset comprising infrared and visible light videos,implemented an innovative image feature fusion strategy,and designed a deep learning model based on the transformer architecture and attention mechanism for smoke classification.Experimental results demonstrate that our method outperforms existing methods,under the condition of multi-view input,it achieves an accuracy rate of 90.88%,precision rate of 98.38%,recall rate of 92.41%and false positive and false negative rates both below 5%,underlining the effectiveness of the proposed multimodal and multi-view fusion approach.The attention mechanism plays a crucial role in improving detection performance,particularly in identifying subtle smoke features.展开更多
Medical image fusion technology is crucial for improving the detection accuracy and treatment efficiency of diseases,but existing fusion methods have problems such as blurred texture details,low contrast,and inability...Medical image fusion technology is crucial for improving the detection accuracy and treatment efficiency of diseases,but existing fusion methods have problems such as blurred texture details,low contrast,and inability to fully extract fused image information.Therefore,a multimodal medical image fusion method based on mask optimization and parallel attention mechanism was proposed to address the aforementioned issues.Firstly,it converted the entire image into a binary mask,and constructed a contour feature map to maximize the contour feature information of the image and a triple path network for image texture detail feature extraction and optimization.Secondly,a contrast enhancement module and a detail preservation module were proposed to enhance the overall brightness and texture details of the image.Afterwards,a parallel attention mechanism was constructed using channel features and spatial feature changes to fuse images and enhance the salient information of the fused images.Finally,a decoupling network composed of residual networks was set up to optimize the information between the fused image and the source image so as to reduce information loss in the fused image.Compared with nine high-level methods proposed in recent years,the seven objective evaluation indicators of our method have improved by 6%−31%,indicating that this method can obtain fusion results with clearer texture details,higher contrast,and smaller pixel differences between the fused image and the source image.It is superior to other comparison algorithms in both subjective and objective indicators.展开更多
Surgical navigation has evolved significantly through advances in augmented reality,virtual reality,and mixed reality,improving precision and safety across many clinical applications,including neurosurgery,maxillofaci...Surgical navigation has evolved significantly through advances in augmented reality,virtual reality,and mixed reality,improving precision and safety across many clinical applications,including neurosurgery,maxillofacial,spinal,and arthroplasty procedures.By integrating preoperative imaging with real-time intraoperative data,these systems provide dynamic guidance,reduce radiation exposure,and minimize tissue damage.Key challenges persist,including intraoperative registration accuracy,flexible tissue deformation,respiratory compensation,and real-time imaging quality.Emerging solutions include artificial intelligence-driven segmentation,deformation-field modeling,and hybrid registration techniques.Future developments will include lightweight,portable systems,improved non-rigid registration algorithms,and greater clinical adoption.Despite advances in rigid-tissue applications,soft-tissue navigation requires additional innovation to address motion variability and registration reliability,ultimately advancing minimally invasive surgery and precision medicine.展开更多
AIM:To analyze the clinical and multimodal imaging characteristics of acute central serous chorioretinopathy(CSC)with or without fibrinous exudation.METHODS:Retrospective case-control study.Patients diagnosed with acu...AIM:To analyze the clinical and multimodal imaging characteristics of acute central serous chorioretinopathy(CSC)with or without fibrinous exudation.METHODS:Retrospective case-control study.Patients diagnosed with acute CSC with fibrinous exudation(FE group)and without fibrinous exudation(non-FE group)were consecutively included.The clinical data and multimodal images including color fundus photography,fundus autofluorescence,spectral-domain optical coherence tomography(OCT),fundus fluorescein angiography,and indocyanine green angiography at presentation were recorded.Treatment method,follow-up outcomes including best-corrected visual acuity(BCVA)and OCT characteristics were also documented.RESULTS:The FE group(n=8,8 eyes,6 males)had a mean age of 47.50±7.27y,and the median symptom duration was 26.50d.The non-FE group(n=20,20 eyes,16 males)had a mean age of 40.40±4.36y,and the median symptom duration was 7.00d.Compared to the non-FE group,the FE group exhibited significantly older age(P=0.004),longer self-reported symptom duration(P=0.02),and poorer baseline and follow-up BCVA(P=0.011,P=0.003).After more than one month followup,visual improvement was statistically significant in the non-FE group(P=0.017),but not in the FE group(P=0.157).Multimodal imaging results found higher prevalence of pigment epithelial detachment(PED;P=0.029)and larger subfoveal choroidal thickness(P<0.001)in the FE group,while there was no significant difference in central macular thickness between the groups.The leakage start time was earlier in the FE group(14.50±2.33s)than in the non-FE group(22.67±1.24s,P<0.001).The expanding dot sign was the most common leakage pattern of fibrinous CSC.Late leakage area usually expanded to more than 1/2 disc diameter(DD)in the FE group,while it was less than 1/2 DD in the non-FE group.CONCLUSION:Fibrinous exudation in acute CSC is a multimodal imaging biomarker indicative of severe choroidal vasculopathy and retinal pigment epithelium barrier failure.Recognizing this entity and understanding its potential mechanisms are crucial for managing patient prognosis and may guide future targeted interventions.展开更多
Accurate diagnosis of tumors needs much detailed information. However, available single imaging modality cannot provide complete or comprehensive data. Nanomedicine is the application of nanotechnology to medicine, an...Accurate diagnosis of tumors needs much detailed information. However, available single imaging modality cannot provide complete or comprehensive data. Nanomedicine is the application of nanotechnology to medicine, and multimodality imaging based on nanoparticles has been receiving extensive attention. This new hybrid imaging technology could provide complementary information from different imaging modalities using only a single injection of contrast agent. In this review, we introduce recent developments in multifunctional nanoparticles and their biomedical applications to multimodal imaging and theragnosis as nanomedicine. Most of the reviewed studies are based on the intrinsic properties of nanoparticles and their application in clinical imaging technology. The imaging techniques include positron emission tomography, single-photon emission computed tomography, computerized tomography, magnetic resonance imaging, optical imaging, and ultrasound imaging.展开更多
The diagnosis and effective management of inflammatory bowel disease(IBD) requires a combination clinical, endoscopic, histological, biological, and imaging data. While endoscopy and biopsy remains the gold standard f...The diagnosis and effective management of inflammatory bowel disease(IBD) requires a combination clinical, endoscopic, histological, biological, and imaging data. While endoscopy and biopsy remains the gold standard for diagnosis of IBD, imaging plays a central role in the assessment of extra mural disease, in disease surveillance and in the assessment of response to medical treatments, which are often expensive. Imaging is also vital in the detection and diagnosis of disease related complications, both acute and chronic. In this review, we will describe, with illustrative images, the imaging features of IBD in adults, with emphasis on upto-date imaging techniques focusing predominantly on cross sectional imaging and new magnetic resonance imaging techniques.展开更多
Infective endocarditis is one of the leading life-threatening infections around the world.With the exponential growth in the field of transcatheter interventions and advances in specialized surgical techniques,the num...Infective endocarditis is one of the leading life-threatening infections around the world.With the exponential growth in the field of transcatheter interventions and advances in specialized surgical techniques,the number of prosthetic valves and cardiac implantable devices has significantly increased.This has led to a steep rise in the number of cases of prosthetic valve endocarditis(PVE)comprising up to 30%of all cases.Clinical guidelines rely on the use of the modified Duke criteria;however,the diagnostic sensitivity of the modified Duke criteria is reduced in the context of PVE.This is in part attributed to prosthesis related artifact which greatly affects the ability of echocardiography to detect early infective changes related to PVE in certain cases.There has been increasing recognition of the roles of complementary imaging modalities and updates in international society recommendations.Prompt diagnosis and treatment can prevent the devastating consequences of this condition.Imaging modalities such as cardiac computed tomography and 18-fluorodeoxyglucose positron emission tomography/computed tomography are diagnostic tools that provide a complementary role to echocardiography in aiding diagnosis,pre-operative planning,and treatment decisionmaking process in these challenging cases.Understanding the strengths and limitations of these adjuvant imaging modalities is crucial for the implementation of appropriate imaging modalities in clinical practice.展开更多
Aneurysmal change of saphenous vein grafts （SVG） is a rare condition that predominantly develops 10-20 years after coronary artery bypass graft （CABG）. Natural course includes mechanical complications due to mass ...Aneurysmal change of saphenous vein grafts （SVG） is a rare condition that predominantly develops 10-20 years after coronary artery bypass graft （CABG）. Natural course includes mechanical complications due to mass effect, myocardial infarction and aneurysmal rupture. Aneurysmectomy can be considered when it induces such complications. We demonstrate complete set of diagnosis, treatment and post-operative imaging of a huge SVG aneurysm that was successfully treated with surgical resection.展开更多
In this paper,we propose a new image fusion algorithm based on two-dimensional Scale-Mixing Complex Wavelet Transform(2D-SMCWT).The fusion of the detail 2D-SMCWT cofficients is performed via a Bayesian Maximum a Poste...In this paper,we propose a new image fusion algorithm based on two-dimensional Scale-Mixing Complex Wavelet Transform(2D-SMCWT).The fusion of the detail 2D-SMCWT cofficients is performed via a Bayesian Maximum a Posteriori(MAP)approach by considering a trivariate statistical model for the local neighboring of 2D-SMCWT coefficients.For the approx imation coefficients,a new fusion rule based on the Principal Component Analysis(PCA)is applied.We conduct several experiments using three different groups of multimodal medical images to evaluate the performance of the proposed method.The obt ained results prove the superiority of the proposed method over the state of the art fusion methods in terms of visual quality and several commonly used metrics.Robustness of the proposed method is further tested against different types of noise.The plots of fusion met rics establish the accuracy of the proposed fusion method.展开更多
A clinical approach to new cardiomyopathy entails defining patient phenotype and disease pathophysiology.After echocardiography,invasive assessments to define hemodynamics and coronary anatomy are usually pursued.In s...A clinical approach to new cardiomyopathy entails defining patient phenotype and disease pathophysiology.After echocardiography,invasive assessments to define hemodynamics and coronary anatomy are usually pursued.In selected non-ischemic cases,endomyocardial biopsies are performed in search for an etiology.Fortunately,advances in cardiac imaging allow for a multifaceted cardiac evaluation in a single study,reducing cost,lead time to diagnosis,and procedural adverse events while still providing supreme accuracy.展开更多
Fourier Ptychographic Microscopy(FPM)is a high-throughput computational optical imaging technology reported in 2013.It effectively breaks through the trade-off between high-resolution imaging and wide-field imaging.In...Fourier Ptychographic Microscopy(FPM)is a high-throughput computational optical imaging technology reported in 2013.It effectively breaks through the trade-off between high-resolution imaging and wide-field imaging.In recent years,it has been found that FPM is not only a tool to break through the trade-off between field of view and spatial resolution,but also a paradigm to break through those trade-off problems,thus attracting extensive attention.Compared with previous reviews,this review does not introduce its concept,basic principles,optical system and series of applications once again,but focuses on elaborating the three major difficulties faced by FPM technology in the process from“looking good”in the laboratory to“working well”in practical applications:mismatch between numerical model and physical reality,long reconstruction time and high computing power demand,and lack of multi-modal expansion.It introduces how to achieve key technological innovations in FPM through the dual drive of Artificial Intelligence(AI)and physics,including intelligent reconstruction algorithms introducing machine learning concepts,optical-algorithm co-design,fusion of frequency domain extrapolation methods and generative adversarial networks,multi-modal imaging schemes and data fusion enhancement,etc.,gradually solving the difficulties of FPM technology.Conversely,this review deeply considers the unique value of FPM technology in potentially feeding back to the development of“AI+optics”,such as providing AI benchmark tests under physical constraints,inspirations for the balance of computing power and bandwidth in miniaturized intelligent microscopes,and photoelectric hybrid architectures.Finally,it introduces the industrialization path and frontier directions of FPM technology,pointing out that with the promotion of the dual drive of AI and physics,it will generate a large number of industrial application case,and looks forward to the possibilities of future application scenarios and expansions,for instance,body fluid biopsy and point-of-care testing at the grassroots level represent the expansion of the growth market.展开更多
Pamiparib is a potent and selective oral poly(adenosine diphosphate(ADP)-ribose)-polymerase(PARP)1/2inhibitor(PARPi).Pamiparib has good bioavailability and shows greater cytotoxic potency and similar DNA-trapping capa...Pamiparib is a potent and selective oral poly(adenosine diphosphate(ADP)-ribose)-polymerase(PARP)1/2inhibitor(PARPi).Pamiparib has good bioavailability and shows greater cytotoxic potency and similar DNA-trapping capacity compared to olaparib.It is not affected by adenosine triphosphate(ATP)-binding cassette transporters.展开更多
The phenotypes of the adenine-to-guanine transition at position 3243 of mitochondrial DNA(m.3243A>G)are highly variable,with different symptoms observed in different patients.These include mitochondrial encephalomy...The phenotypes of the adenine-to-guanine transition at position 3243 of mitochondrial DNA(m.3243A>G)are highly variable,with different symptoms observed in different patients.These include mitochondrial encephalomyopathy,lactic acidosis,and stroke-like episodes(MELAS);maternally inherited diabetes and deafness syndrome(MIDD);other syndromic conditions;or non-syndromic mitochondrial disorders.Renal involvement associated with this mutation generally manifests as subnephrotic proteinuria,progressive deterioration of kidney function,and increased morbidity.The retinopathies linked to the m.3243A>G mutation have heterogeneous presentations,characterized by variable degrees of retinal pigment epithelium(RPE)atrophy and hyperpigmentation at the posterior pole.As a severe phenotype of the m.3243A>G mutation,MELAS combined with focal and segmental glomerulosclerosis(FSGS)is rare.We herein firstly reported in detail the ophthalmic manifestations of a patient with this condition.Additionally,we reviewed the literature on fundus,ophthalmic electrophysiology,and optical coherence tomography(OCT)findings related to the m.3243A>G mutation.展开更多
As a cutting-edge technology in the field of medical robotics,vascular interventional surgical robots have made remarkable progress in recent years.This paper focuses on the technological innovations of vascular inter...As a cutting-edge technology in the field of medical robotics,vascular interventional surgical robots have made remarkable progress in recent years.This paper focuses on the technological innovations of vascular interventional surgical robots,with particular attention to the system developed by Xu’s team that rapidly secured national patents through China’s Green Innovation Fast-Track.The article elaborates on its key breakthroughs in haptic force feedback,master-slave control accuracy,and multimodal image fusion,and discusses the potential clinical advantages these innovations confer.By benchmarking the system against comparable technologies at home and abroad,the paper forecasts its future applications in healthcare and provides a reference for subsequent R&D and clinical adoption.展开更多
Osteosarcoma is the most common primary bone tumor with high malignancy.It is particularly necessary to achieve rapid and accurate diagnosis in its intraoperative examination and early diagnosis.Accordingly,the multim...Osteosarcoma is the most common primary bone tumor with high malignancy.It is particularly necessary to achieve rapid and accurate diagnosis in its intraoperative examination and early diagnosis.Accordingly,the multimodal microscopic imaging diagnosis system constructed by bright field,spontaneous fluorescence and polarized light microscopic imaging was used to study the pathological mechanism of osteosarcoma from the tissue microenvironment level and achieve rapid and accurate diagnosis.First,the multimodal microscopic images of normal and osteosarcoma tissue slices were collected to characterize the overall morphology of the tissue microenvironment of the samples,the arrangement structure of collagen fibers and the content and distribution of endogenous fluorescent substances.Second,based on the correlation and complementarity of the feature information contained in the three single-mode images,combined with convolutional neural network(CNN)and image fusion methods,a multimodal intelligent diagnosis model was constructed to effectively improve the information utilization and diagnosis accuracy.The accuracy and true positivity of the multimodal diagnostic model were significantly improved to 0.8495 and 0.9412,respectively,compared to those of the single-modal models.Besides,the difference of tissue microenvironments before and after cancerization can be used as a basis for cancer diagnosis,and the information extraction and intelligent diagnosis of osteosarcoma tissue can be achieved by using multimodal microscopic imaging technology combined with deep learning,which significantly promoted the application of tissue microenvironment in pathological examination.This diagnostic system relies on its advantages of simple operation,high efficiency and accuracy and high cost-effectiveness,and has enormous clinical application potential and research significance.展开更多
BACKGROUND Congenital renal arteriovenous fistula(RAVF)is a clinically rare condition and frequently missed and misdiagnosed.Multimodal imaging techniques can pro-vide more detailed diagnostic information to help phys...BACKGROUND Congenital renal arteriovenous fistula(RAVF)is a clinically rare condition and frequently missed and misdiagnosed.Multimodal imaging techniques can pro-vide more detailed diagnostic information to help physicians more accurately diagnose and treat diseases.Combining imaging methods to diagnose RAVF has rarely been reported.CASE SUMMARY A 69-year-old female patient presented with gross hematuria that had persisted for 10 days.The patient underwent ultrasound examinations of the kidneys and renal blood vessels,enhanced computed tomography,three-dimensional com-puted tomography angiography,and digital subtraction angiography of the renal arteries.These revealed dilatation of the left renal vein and abnormal shunting between the left renal artery and vein.The patient was diagnosed with a left RAVF using combined multimodal imaging techniques.The patient was treated with left renal artery embolization immediately after renal arteriography.Hema-turia resolved following the left renal artery embolization without serious bleeding or other complications.The patient made a full recovery after one year of postoperative follow-up.CONCLUSION Multimodal imaging techniques complement each other when diagnosing RAVF,providing detailed diagnostic information that can aid in accurate diagnosis and treatment.In addition,this case reminds the sonographer to pay more attention to the color doppler flow imaging and blood flow spectrum when examining the kidney,so as to avoid misdiagnosis of renal cystic lesions as renal cysts and missed diagnosis of RAVF.展开更多
Objective:This study aimed to evaluate the clinical utility of[^(68)Ga]Ga-RM2 positron emission tomography/computed tomography(PET/CT),in comparison with^(18)F-fluorodeoxyglucose([^(18)F]FDG)PET/CT,for staging and pro...Objective:This study aimed to evaluate the clinical utility of[^(68)Ga]Ga-RM2 positron emission tomography/computed tomography(PET/CT),in comparison with^(18)F-fluorodeoxyglucose([^(18)F]FDG)PET/CT,for staging and prognosis in patients with estrogen receptor-positive(ER+)breast cancer.Methods:This prospective study enrolled nine female patients with breast cancer(mean age 45.5±11.5 years).Eight patients were confirmed to have ER+disease.All participant underwent both[^(68)Ga]Ga-RM2 PET/CT and[^(18)F]FDG PET/CT scans within a one-week interval.The maximum standardized uptake values(SUV_(max))was measured for primary tumors,lymph nodes,and metastatic lesions.The physiological distribution of[^(68)Ga]GaRM2 was also evaluated.Results:No adverse events were observed.Metastatic were identified in lymph nodes(n=29 lesions),bone(n=19),liver(n=7),brain(n=3),and multiple other sites.[^(68)Ga]Ga-RM2 demonstrated a significantly higher median SUV_(max)than[^(18)F]FDG across all lesions[7.5(interquartile range,IQR,3.4-14.0)vs.4.0(IQR,2.3-6.1);P<0.001].Similarly,the tumor-to-background ratio(TBR)was significantly superior with[^(68)Ga]Ga-RM2 for all type of lesions:primary tumors[12.3(IQR,10.4-18.3)vs.7.0(IQR,6.0-10.0);P<0.001],lymph node metastases[17.8(IQR,4.4-39.0)vs.4.7(IQR,2.7-10.2);P<0.001],hepatic metastases[5.4(IQR,3.7-8.3)vs.1.0(IQR,0.9-1.5);P<0.001],and osseous metastases[13.9(IQR,7.3-18.0)vs.4.3(IQR,1.6-5.9);P<0.001].Physiological uptake of[^(68)Ga]Ga-RM2 was the highest in the pancreas(SUV_(max),77.82±22.64),with moderate uptake in the kidneys(2.82±0.62),heart(1.83±0.29),and liver(1.33±0.41).Conclusions:[^(68)Ga]Ga-RM2 PET/CT demonstrates superior uptake metrics for the detection of metastatic lesions,particularly in the brain and breast,suggesting its potential as a valuable complementary imaging modality to[^(18)F]FDG PET/CT.These promising foundings warrant further validation in larger cohorts to confirm their clinical impact and to standardize imaging protocols.展开更多
Objective To develop a multimodal imaging atlas of a rat brain-computer interface(BCI)that incorporates brain,arterial,bone tissue and a BCI device using mixed reality(MR)for three-dimensional(3D)visualization.Methods...Objective To develop a multimodal imaging atlas of a rat brain-computer interface(BCI)that incorporates brain,arterial,bone tissue and a BCI device using mixed reality(MR)for three-dimensional(3D)visualization.Methods An invasive BCI was implanted in the left visual cortex of 4-week-old Sprague–Dawley rats.Multimodal imaging techniques,including micro-CT and 9.0 T MRI,were used to acquire images of the rat cranial bone structure,vascular distribution,brain tissue functional zones,and BCI device before and after implantation.Using 3D-slicer software,the images were fused through spatial transformations,followed by image segmentation and 3D model reconstruction.The HoloLens platform was employed for MR visualization.Results This study constructed a multimodal imaging atlas for rats that included the skull,brain tissue,arterial tissue,and BCI device coupled with MR technology to create an interactive 3D anatomical model.Conclusions This multimodal 3D atlas provides an objective and stable reference for exploring complex relationships between brain tissue structure and function,enhancing the understanding of the operational principles of BCIs.This is the first multimodal 3D imaging atlas related to a BCI created using Sprague–Dawley rats.展开更多
Introduction Choroidal neovascularization(CNV)associated with ocular inflammatory disease,also known as inflammatory CNV(iCNV),is a rare complication that can lead to severe vision loss in patients with infectious and...Introduction Choroidal neovascularization(CNV)associated with ocular inflammatory disease,also known as inflammatory CNV(iCNV),is a rare complication that can lead to severe vision loss in patients with infectious and noninfectious uveitis(1-3).After pathologic myopia,ocular inflammatory disease is a frequently implicated cause of CNV in patients younger than 50 years old(4).展开更多
Objective:The study aimed to report the distinctive fundus appearance of bilateral asymmetric choroidal melanocytosis and reviewed the clinical and multimodal imaging characteristics to differentiate choroidal melanoc...Objective:The study aimed to report the distinctive fundus appearance of bilateral asymmetric choroidal melanocytosis and reviewed the clinical and multimodal imaging characteristics to differentiate choroidal melanocytosis from malignant pigmented retinal lesions.Methods:An observational case report and literature review.Results:A 60-year-old patient underwent comprehensive ophthalmologic examinations.Underfunduscopic examination,bilateral choroidal melanocytosis with asymmetry choroidal pigmentation change was observed.In the right eye,there was diffuse darker coloration extending from posterior pole to the mid-peripheral retina.In the left eye,flat patches of choroidal hyperpigmentation were present,involving superior and inferior hemisphere region,while other regions were depigmented.Spectral-domain optical coherence tomography revealed that the layers of retina and choroid were basically normal,with no elevation of the retinal pigment epithelium.Near infrared reflectance images provided a clearer view of mottled focal hyperpigmentation area,which corresponded to the choroidal hyperpigmentation.Conclusions:This case highlights the effectiveness of multimodal imaging in distinguishing choroidal melanocytosis from malignant entities.It emphasizes the crucial role of multimodal imaging in guiding clinical management to prevent vision-threatening complications and monitor potential malignant transformation.展开更多
基金supported by the National Natural Science Foundation of China(32171797)Chunhui Project Foundation of the Education Department of China(HZKY20220026).
文摘With rapid urbanization,fires pose significant challenges in urban governance.Traditional fire detection methods often struggle to detect smoke in complex urban scenes due to environmental interferences and variations in viewing angles.This study proposes a novel multimodal smoke detection method that fuses infrared and visible imagery using a transformer-based deep learning model.By capturing both thermal and visual cues,our approach significantly enhances the accuracy and robustness of smoke detection in business parks scenes.We first established a dual-view dataset comprising infrared and visible light videos,implemented an innovative image feature fusion strategy,and designed a deep learning model based on the transformer architecture and attention mechanism for smoke classification.Experimental results demonstrate that our method outperforms existing methods,under the condition of multi-view input,it achieves an accuracy rate of 90.88%,precision rate of 98.38%,recall rate of 92.41%and false positive and false negative rates both below 5%,underlining the effectiveness of the proposed multimodal and multi-view fusion approach.The attention mechanism plays a crucial role in improving detection performance,particularly in identifying subtle smoke features.
基金supported by Gansu Natural Science Foundation Programme(No.24JRRA231)National Natural Science Foundation of China(No.62061023)Gansu Provincial Education,Science and Technology Innovation and Industry(No.2021CYZC-04)。
文摘Medical image fusion technology is crucial for improving the detection accuracy and treatment efficiency of diseases,but existing fusion methods have problems such as blurred texture details,low contrast,and inability to fully extract fused image information.Therefore,a multimodal medical image fusion method based on mask optimization and parallel attention mechanism was proposed to address the aforementioned issues.Firstly,it converted the entire image into a binary mask,and constructed a contour feature map to maximize the contour feature information of the image and a triple path network for image texture detail feature extraction and optimization.Secondly,a contrast enhancement module and a detail preservation module were proposed to enhance the overall brightness and texture details of the image.Afterwards,a parallel attention mechanism was constructed using channel features and spatial feature changes to fuse images and enhance the salient information of the fused images.Finally,a decoupling network composed of residual networks was set up to optimize the information between the fused image and the source image so as to reduce information loss in the fused image.Compared with nine high-level methods proposed in recent years,the seven objective evaluation indicators of our method have improved by 6%−31%,indicating that this method can obtain fusion results with clearer texture details,higher contrast,and smaller pixel differences between the fused image and the source image.It is superior to other comparison algorithms in both subjective and objective indicators.
基金Supported by the National Natural Science Foundation of China(NSFC)under Grants 62025104,62422102,62331005,62301034,and U22A2052the Beijing Natural Science Foundation-Daxing Innovation Joint Fund(L256040).
文摘Surgical navigation has evolved significantly through advances in augmented reality,virtual reality,and mixed reality,improving precision and safety across many clinical applications,including neurosurgery,maxillofacial,spinal,and arthroplasty procedures.By integrating preoperative imaging with real-time intraoperative data,these systems provide dynamic guidance,reduce radiation exposure,and minimize tissue damage.Key challenges persist,including intraoperative registration accuracy,flexible tissue deformation,respiratory compensation,and real-time imaging quality.Emerging solutions include artificial intelligence-driven segmentation,deformation-field modeling,and hybrid registration techniques.Future developments will include lightweight,portable systems,improved non-rigid registration algorithms,and greater clinical adoption.Despite advances in rigid-tissue applications,soft-tissue navigation requires additional innovation to address motion variability and registration reliability,ultimately advancing minimally invasive surgery and precision medicine.
基金Supported by Tianjin Key Medical Discipline Construction Project(No.TJYXZDXK-3-004A-2).
文摘AIM:To analyze the clinical and multimodal imaging characteristics of acute central serous chorioretinopathy(CSC)with or without fibrinous exudation.METHODS:Retrospective case-control study.Patients diagnosed with acute CSC with fibrinous exudation(FE group)and without fibrinous exudation(non-FE group)were consecutively included.The clinical data and multimodal images including color fundus photography,fundus autofluorescence,spectral-domain optical coherence tomography(OCT),fundus fluorescein angiography,and indocyanine green angiography at presentation were recorded.Treatment method,follow-up outcomes including best-corrected visual acuity(BCVA)and OCT characteristics were also documented.RESULTS:The FE group(n=8,8 eyes,6 males)had a mean age of 47.50±7.27y,and the median symptom duration was 26.50d.The non-FE group(n=20,20 eyes,16 males)had a mean age of 40.40±4.36y,and the median symptom duration was 7.00d.Compared to the non-FE group,the FE group exhibited significantly older age(P=0.004),longer self-reported symptom duration(P=0.02),and poorer baseline and follow-up BCVA(P=0.011,P=0.003).After more than one month followup,visual improvement was statistically significant in the non-FE group(P=0.017),but not in the FE group(P=0.157).Multimodal imaging results found higher prevalence of pigment epithelial detachment(PED;P=0.029)and larger subfoveal choroidal thickness(P<0.001)in the FE group,while there was no significant difference in central macular thickness between the groups.The leakage start time was earlier in the FE group(14.50±2.33s)than in the non-FE group(22.67±1.24s,P<0.001).The expanding dot sign was the most common leakage pattern of fibrinous CSC.Late leakage area usually expanded to more than 1/2 disc diameter(DD)in the FE group,while it was less than 1/2 DD in the non-FE group.CONCLUSION:Fibrinous exudation in acute CSC is a multimodal imaging biomarker indicative of severe choroidal vasculopathy and retinal pigment epithelium barrier failure.Recognizing this entity and understanding its potential mechanisms are crucial for managing patient prognosis and may guide future targeted interventions.
文摘Accurate diagnosis of tumors needs much detailed information. However, available single imaging modality cannot provide complete or comprehensive data. Nanomedicine is the application of nanotechnology to medicine, and multimodality imaging based on nanoparticles has been receiving extensive attention. This new hybrid imaging technology could provide complementary information from different imaging modalities using only a single injection of contrast agent. In this review, we introduce recent developments in multifunctional nanoparticles and their biomedical applications to multimodal imaging and theragnosis as nanomedicine. Most of the reviewed studies are based on the intrinsic properties of nanoparticles and their application in clinical imaging technology. The imaging techniques include positron emission tomography, single-photon emission computed tomography, computerized tomography, magnetic resonance imaging, optical imaging, and ultrasound imaging.
文摘The diagnosis and effective management of inflammatory bowel disease(IBD) requires a combination clinical, endoscopic, histological, biological, and imaging data. While endoscopy and biopsy remains the gold standard for diagnosis of IBD, imaging plays a central role in the assessment of extra mural disease, in disease surveillance and in the assessment of response to medical treatments, which are often expensive. Imaging is also vital in the detection and diagnosis of disease related complications, both acute and chronic. In this review, we will describe, with illustrative images, the imaging features of IBD in adults, with emphasis on upto-date imaging techniques focusing predominantly on cross sectional imaging and new magnetic resonance imaging techniques.
文摘Infective endocarditis is one of the leading life-threatening infections around the world.With the exponential growth in the field of transcatheter interventions and advances in specialized surgical techniques,the number of prosthetic valves and cardiac implantable devices has significantly increased.This has led to a steep rise in the number of cases of prosthetic valve endocarditis(PVE)comprising up to 30%of all cases.Clinical guidelines rely on the use of the modified Duke criteria;however,the diagnostic sensitivity of the modified Duke criteria is reduced in the context of PVE.This is in part attributed to prosthesis related artifact which greatly affects the ability of echocardiography to detect early infective changes related to PVE in certain cases.There has been increasing recognition of the roles of complementary imaging modalities and updates in international society recommendations.Prompt diagnosis and treatment can prevent the devastating consequences of this condition.Imaging modalities such as cardiac computed tomography and 18-fluorodeoxyglucose positron emission tomography/computed tomography are diagnostic tools that provide a complementary role to echocardiography in aiding diagnosis,pre-operative planning,and treatment decisionmaking process in these challenging cases.Understanding the strengths and limitations of these adjuvant imaging modalities is crucial for the implementation of appropriate imaging modalities in clinical practice.
文摘Aneurysmal change of saphenous vein grafts （SVG） is a rare condition that predominantly develops 10-20 years after coronary artery bypass graft （CABG）. Natural course includes mechanical complications due to mass effect, myocardial infarction and aneurysmal rupture. Aneurysmectomy can be considered when it induces such complications. We demonstrate complete set of diagnosis, treatment and post-operative imaging of a huge SVG aneurysm that was successfully treated with surgical resection.
文摘In this paper,we propose a new image fusion algorithm based on two-dimensional Scale-Mixing Complex Wavelet Transform(2D-SMCWT).The fusion of the detail 2D-SMCWT cofficients is performed via a Bayesian Maximum a Posteriori(MAP)approach by considering a trivariate statistical model for the local neighboring of 2D-SMCWT coefficients.For the approx imation coefficients,a new fusion rule based on the Principal Component Analysis(PCA)is applied.We conduct several experiments using three different groups of multimodal medical images to evaluate the performance of the proposed method.The obt ained results prove the superiority of the proposed method over the state of the art fusion methods in terms of visual quality and several commonly used metrics.Robustness of the proposed method is further tested against different types of noise.The plots of fusion met rics establish the accuracy of the proposed fusion method.
文摘A clinical approach to new cardiomyopathy entails defining patient phenotype and disease pathophysiology.After echocardiography,invasive assessments to define hemodynamics and coronary anatomy are usually pursued.In selected non-ischemic cases,endomyocardial biopsies are performed in search for an etiology.Fortunately,advances in cardiac imaging allow for a multifaceted cardiac evaluation in a single study,reducing cost,lead time to diagnosis,and procedural adverse events while still providing supreme accuracy.
基金National Natural Science Foundation of China(No.12574332)the Space Optoelectronic Measurement and Perception Lab.,Beijing Institute of Control Engineering(No.LabSOMP-2023-10)Major Science and Technology Innovation Program of Xianyang City(No.L2024-ZDKJ-ZDCGZH-0021)。
文摘Fourier Ptychographic Microscopy(FPM)is a high-throughput computational optical imaging technology reported in 2013.It effectively breaks through the trade-off between high-resolution imaging and wide-field imaging.In recent years,it has been found that FPM is not only a tool to break through the trade-off between field of view and spatial resolution,but also a paradigm to break through those trade-off problems,thus attracting extensive attention.Compared with previous reviews,this review does not introduce its concept,basic principles,optical system and series of applications once again,but focuses on elaborating the three major difficulties faced by FPM technology in the process from“looking good”in the laboratory to“working well”in practical applications:mismatch between numerical model and physical reality,long reconstruction time and high computing power demand,and lack of multi-modal expansion.It introduces how to achieve key technological innovations in FPM through the dual drive of Artificial Intelligence(AI)and physics,including intelligent reconstruction algorithms introducing machine learning concepts,optical-algorithm co-design,fusion of frequency domain extrapolation methods and generative adversarial networks,multi-modal imaging schemes and data fusion enhancement,etc.,gradually solving the difficulties of FPM technology.Conversely,this review deeply considers the unique value of FPM technology in potentially feeding back to the development of“AI+optics”,such as providing AI benchmark tests under physical constraints,inspirations for the balance of computing power and bandwidth in miniaturized intelligent microscopes,and photoelectric hybrid architectures.Finally,it introduces the industrialization path and frontier directions of FPM technology,pointing out that with the promotion of the dual drive of AI and physics,it will generate a large number of industrial application case,and looks forward to the possibilities of future application scenarios and expansions,for instance,body fluid biopsy and point-of-care testing at the grassroots level represent the expansion of the growth market.
基金supported in part by funding from BeiGene,Ltd.,USA(Grant No.:KPR081)with additional support from the Alessandra Bono Foundation,Italy.
文摘Pamiparib is a potent and selective oral poly(adenosine diphosphate(ADP)-ribose)-polymerase(PARP)1/2inhibitor(PARPi).Pamiparib has good bioavailability and shows greater cytotoxic potency and similar DNA-trapping capacity compared to olaparib.It is not affected by adenosine triphosphate(ATP)-binding cassette transporters.
基金Supported by the Clinical Research Plan of SHDC(No.SHDC2020CR6029).
文摘The phenotypes of the adenine-to-guanine transition at position 3243 of mitochondrial DNA(m.3243A>G)are highly variable,with different symptoms observed in different patients.These include mitochondrial encephalomyopathy,lactic acidosis,and stroke-like episodes(MELAS);maternally inherited diabetes and deafness syndrome(MIDD);other syndromic conditions;or non-syndromic mitochondrial disorders.Renal involvement associated with this mutation generally manifests as subnephrotic proteinuria,progressive deterioration of kidney function,and increased morbidity.The retinopathies linked to the m.3243A>G mutation have heterogeneous presentations,characterized by variable degrees of retinal pigment epithelium(RPE)atrophy and hyperpigmentation at the posterior pole.As a severe phenotype of the m.3243A>G mutation,MELAS combined with focal and segmental glomerulosclerosis(FSGS)is rare.We herein firstly reported in detail the ophthalmic manifestations of a patient with this condition.Additionally,we reviewed the literature on fundus,ophthalmic electrophysiology,and optical coherence tomography(OCT)findings related to the m.3243A>G mutation.
文摘As a cutting-edge technology in the field of medical robotics,vascular interventional surgical robots have made remarkable progress in recent years.This paper focuses on the technological innovations of vascular interventional surgical robots,with particular attention to the system developed by Xu’s team that rapidly secured national patents through China’s Green Innovation Fast-Track.The article elaborates on its key breakthroughs in haptic force feedback,master-slave control accuracy,and multimodal image fusion,and discusses the potential clinical advantages these innovations confer.By benchmarking the system against comparable technologies at home and abroad,the paper forecasts its future applications in healthcare and provides a reference for subsequent R&D and clinical adoption.
基金the National Natural Science Foundation of China(62375127,82272664)Hunan Provincial Natural Science Foundation of China(2022JJ30843)+5 种基金the Science and Technology Development Fund Guided by Central Govern-ment(2021Szvup169)the Scientic Research Program of Hunan Provincial Health Commission(B202304077077)the Fundamental Research Funds for the Central Universities(NS2022035)Prospective Layout Special Fund of Nanjing University of Aero-nautics and Astronautics(ILA-22022)Graduate Research and Innovation Program of Nanjing University of Aeronautics and Astronautics(xcxjh20220328)Experimental Technology Research and Development Project of NUAA(No.SYJS202303Z)for the grant。
文摘Osteosarcoma is the most common primary bone tumor with high malignancy.It is particularly necessary to achieve rapid and accurate diagnosis in its intraoperative examination and early diagnosis.Accordingly,the multimodal microscopic imaging diagnosis system constructed by bright field,spontaneous fluorescence and polarized light microscopic imaging was used to study the pathological mechanism of osteosarcoma from the tissue microenvironment level and achieve rapid and accurate diagnosis.First,the multimodal microscopic images of normal and osteosarcoma tissue slices were collected to characterize the overall morphology of the tissue microenvironment of the samples,the arrangement structure of collagen fibers and the content and distribution of endogenous fluorescent substances.Second,based on the correlation and complementarity of the feature information contained in the three single-mode images,combined with convolutional neural network(CNN)and image fusion methods,a multimodal intelligent diagnosis model was constructed to effectively improve the information utilization and diagnosis accuracy.The accuracy and true positivity of the multimodal diagnostic model were significantly improved to 0.8495 and 0.9412,respectively,compared to those of the single-modal models.Besides,the difference of tissue microenvironments before and after cancerization can be used as a basis for cancer diagnosis,and the information extraction and intelligent diagnosis of osteosarcoma tissue can be achieved by using multimodal microscopic imaging technology combined with deep learning,which significantly promoted the application of tissue microenvironment in pathological examination.This diagnostic system relies on its advantages of simple operation,high efficiency and accuracy and high cost-effectiveness,and has enormous clinical application potential and research significance.
文摘BACKGROUND Congenital renal arteriovenous fistula(RAVF)is a clinically rare condition and frequently missed and misdiagnosed.Multimodal imaging techniques can pro-vide more detailed diagnostic information to help physicians more accurately diagnose and treat diseases.Combining imaging methods to diagnose RAVF has rarely been reported.CASE SUMMARY A 69-year-old female patient presented with gross hematuria that had persisted for 10 days.The patient underwent ultrasound examinations of the kidneys and renal blood vessels,enhanced computed tomography,three-dimensional com-puted tomography angiography,and digital subtraction angiography of the renal arteries.These revealed dilatation of the left renal vein and abnormal shunting between the left renal artery and vein.The patient was diagnosed with a left RAVF using combined multimodal imaging techniques.The patient was treated with left renal artery embolization immediately after renal arteriography.Hema-turia resolved following the left renal artery embolization without serious bleeding or other complications.The patient made a full recovery after one year of postoperative follow-up.CONCLUSION Multimodal imaging techniques complement each other when diagnosing RAVF,providing detailed diagnostic information that can aid in accurate diagnosis and treatment.In addition,this case reminds the sonographer to pay more attention to the color doppler flow imaging and blood flow spectrum when examining the kidney,so as to avoid misdiagnosis of renal cystic lesions as renal cysts and missed diagnosis of RAVF.
基金supported by the National Natural Science Foundation of China(No.82372001,82171973,82171980)the Youth Talent Support Program(No.A002863)Scientific Research Foundation of Peking University Cancer Hospital(No.BJCH2024CZ02)。
文摘Objective:This study aimed to evaluate the clinical utility of[^(68)Ga]Ga-RM2 positron emission tomography/computed tomography(PET/CT),in comparison with^(18)F-fluorodeoxyglucose([^(18)F]FDG)PET/CT,for staging and prognosis in patients with estrogen receptor-positive(ER+)breast cancer.Methods:This prospective study enrolled nine female patients with breast cancer(mean age 45.5±11.5 years).Eight patients were confirmed to have ER+disease.All participant underwent both[^(68)Ga]Ga-RM2 PET/CT and[^(18)F]FDG PET/CT scans within a one-week interval.The maximum standardized uptake values(SUV_(max))was measured for primary tumors,lymph nodes,and metastatic lesions.The physiological distribution of[^(68)Ga]GaRM2 was also evaluated.Results:No adverse events were observed.Metastatic were identified in lymph nodes(n=29 lesions),bone(n=19),liver(n=7),brain(n=3),and multiple other sites.[^(68)Ga]Ga-RM2 demonstrated a significantly higher median SUV_(max)than[^(18)F]FDG across all lesions[7.5(interquartile range,IQR,3.4-14.0)vs.4.0(IQR,2.3-6.1);P<0.001].Similarly,the tumor-to-background ratio(TBR)was significantly superior with[^(68)Ga]Ga-RM2 for all type of lesions:primary tumors[12.3(IQR,10.4-18.3)vs.7.0(IQR,6.0-10.0);P<0.001],lymph node metastases[17.8(IQR,4.4-39.0)vs.4.7(IQR,2.7-10.2);P<0.001],hepatic metastases[5.4(IQR,3.7-8.3)vs.1.0(IQR,0.9-1.5);P<0.001],and osseous metastases[13.9(IQR,7.3-18.0)vs.4.3(IQR,1.6-5.9);P<0.001].Physiological uptake of[^(68)Ga]Ga-RM2 was the highest in the pancreas(SUV_(max),77.82±22.64),with moderate uptake in the kidneys(2.82±0.62),heart(1.83±0.29),and liver(1.33±0.41).Conclusions:[^(68)Ga]Ga-RM2 PET/CT demonstrates superior uptake metrics for the detection of metastatic lesions,particularly in the brain and breast,suggesting its potential as a valuable complementary imaging modality to[^(18)F]FDG PET/CT.These promising foundings warrant further validation in larger cohorts to confirm their clinical impact and to standardize imaging protocols.
基金supported by the National Natural Science Foundation of China(No.82172524 and No.81974355)National Innovation Platform Development Program(No.2020021105012440),China+3 种基金Major Program of Hubei Province(No.2021BEA161),ChinaMajor Key Project of Hubei Province(No.JD2023BAA005),ChinaWuhan Union Hospital Free Innovation Preliminary Research Fund(No.2024XHYN047),ChinaJoint Funds for the Innovation of Science and Technology(No.2024Y9062),Fujian Province,China.
文摘Objective To develop a multimodal imaging atlas of a rat brain-computer interface(BCI)that incorporates brain,arterial,bone tissue and a BCI device using mixed reality(MR)for three-dimensional(3D)visualization.Methods An invasive BCI was implanted in the left visual cortex of 4-week-old Sprague–Dawley rats.Multimodal imaging techniques,including micro-CT and 9.0 T MRI,were used to acquire images of the rat cranial bone structure,vascular distribution,brain tissue functional zones,and BCI device before and after implantation.Using 3D-slicer software,the images were fused through spatial transformations,followed by image segmentation and 3D model reconstruction.The HoloLens platform was employed for MR visualization.Results This study constructed a multimodal imaging atlas for rats that included the skull,brain tissue,arterial tissue,and BCI device coupled with MR technology to create an interactive 3D anatomical model.Conclusions This multimodal 3D atlas provides an objective and stable reference for exploring complex relationships between brain tissue structure and function,enhancing the understanding of the operational principles of BCIs.This is the first multimodal 3D imaging atlas related to a BCI created using Sprague–Dawley rats.
文摘Introduction Choroidal neovascularization(CNV)associated with ocular inflammatory disease,also known as inflammatory CNV(iCNV),is a rare complication that can lead to severe vision loss in patients with infectious and noninfectious uveitis(1-3).After pathologic myopia,ocular inflammatory disease is a frequently implicated cause of CNV in patients younger than 50 years old(4).
基金found by the Key Research and Development Program of the Ministry of Science and Technology(2022YFF1202901)the National Natural Science Foundation of China(82171404)+3 种基金the Natural Science Foundation of Guangdong Province of China(2023A1515011529)the Science and Technology Planning Project of Guangzhou City(2023A03J0181,2024A04J6481)the Fundamental Research Funds for the Central Universities(22yklj04)the Research Start-up Founds of Sun Yat-sen University(Funded Talent[2020]18).
文摘Objective:The study aimed to report the distinctive fundus appearance of bilateral asymmetric choroidal melanocytosis and reviewed the clinical and multimodal imaging characteristics to differentiate choroidal melanocytosis from malignant pigmented retinal lesions.Methods:An observational case report and literature review.Results:A 60-year-old patient underwent comprehensive ophthalmologic examinations.Underfunduscopic examination,bilateral choroidal melanocytosis with asymmetry choroidal pigmentation change was observed.In the right eye,there was diffuse darker coloration extending from posterior pole to the mid-peripheral retina.In the left eye,flat patches of choroidal hyperpigmentation were present,involving superior and inferior hemisphere region,while other regions were depigmented.Spectral-domain optical coherence tomography revealed that the layers of retina and choroid were basically normal,with no elevation of the retinal pigment epithelium.Near infrared reflectance images provided a clearer view of mottled focal hyperpigmentation area,which corresponded to the choroidal hyperpigmentation.Conclusions:This case highlights the effectiveness of multimodal imaging in distinguishing choroidal melanocytosis from malignant entities.It emphasizes the crucial role of multimodal imaging in guiding clinical management to prevent vision-threatening complications and monitor potential malignant transformation.
