Phantom limb pain(PLP)is not only a physical pain experience but also poses a significant challenge to mental health and quality of life.Currently,the mechanism of PLP treatment is still unclear,and there are many met...Phantom limb pain(PLP)is not only a physical pain experience but also poses a significant challenge to mental health and quality of life.Currently,the mechanism of PLP treatment is still unclear,and there are many methods with varying effects.This article starts with the application research of extended reality technology in PLP treatment,through describing the application of its branch technologies(virtual reality,augmented reality,and mixed reality technology),to lay the foundation for subsequent research,in the hope of finding advanced and effective treatment methods,and providing a basis for future product transformation.展开更多
The rapid evolution of virtual reality(VR)and augmented reality(AR)technologies has significantly transformed human-computer interaction,with applications spanning entertainment,education,healthcare,industry,and remot...The rapid evolution of virtual reality(VR)and augmented reality(AR)technologies has significantly transformed human-computer interaction,with applications spanning entertainment,education,healthcare,industry,and remote collaboration.A central challenge in these immersive systems lies in enabling intuitive,efficient,and natural interactions.Hand gesture recognition offers a compelling solution by leveraging the expressiveness of human hands to facilitate seamless control without relying on traditional input devices such as controllers or keyboards,which can limit immersion.However,achieving robust gesture recognition requires overcoming challenges related to accurate hand tracking,complex environmental conditions,and minimizing system latency.This study proposes an artificial intelligence(AI)-driven framework for recognizing both static and dynamic hand gestures in VR and AR environments using skeleton-based tracking compliant with the OpenXR standard.Our approach employs a lightweight neural network architecture capable of real-time classification within approximately 1.3mswhilemaintaining average accuracy of 95%.We also introduce a novel dataset generation method to support training robust models and demonstrate consistent classification of diverse gestures across widespread commercial VR devices.This work represents one of the first studies to implement and validate dynamic hand gesture recognition in real time using standardized VR hardware,laying the groundwork for more immersive,accessible,and user-friendly interaction systems.By advancing AI-driven gesture interfaces,this research has the potential to broaden the adoption of VR and AR across diverse domains and enhance the overall user experience.展开更多
Medical procedures are inherently invasive and carry the risk of inducing pain to the mind and body.Recently,efforts have been made to alleviate the discomfort associated with invasive medical procedures through the u...Medical procedures are inherently invasive and carry the risk of inducing pain to the mind and body.Recently,efforts have been made to alleviate the discomfort associated with invasive medical procedures through the use of virtual reality(VR)technology.VR has been demonstrated to be an effective treatment for pain associated with medical procedures,as well as for chronic pain conditions for which no effective treatment has been established.The precise mechanism by which the diversion from reality facilitated by VR contributes to the diminution of pain and anxiety has yet to be elucidated.However,the provision of positive images through VR-based visual stimulation may enhance the functionality of brain networks.The salience network is diminished,while the default mode network is enhanced.Additionally,the medial prefrontal cortex may establish a stronger connection with the default mode network,which could result in a reduction of pain and anxiety.Further research into the potential of VR technology to alleviate pain could lead to a reduction in the number of individuals who overdose on painkillers and contribute to positive change in the medical field.展开更多
Objectives:To explore the efficacy and safety of virtual reality(VR)in relieving negative emotions in patients with breast cancer with different personalities.Methods:A randomized controlled trial was conducted.Betwee...Objectives:To explore the efficacy and safety of virtual reality(VR)in relieving negative emotions in patients with breast cancer with different personalities.Methods:A randomized controlled trial was conducted.Between April 2023 and October 2023,we enrolled patients with breast cancer treated in the Department of Breast Cancer and Oncology at Sun Yat-Sen Memorial Hospital,Sun Yat-Sen University,Guangdong Province.The patients were randomly divided into an intervention group(n=118)and a control group(n=119)using block randomization.The intervention group received the VR intervention 3-5 times over 5±2 weeks using natural landscapes with music or relaxation guidance,and the duration of each VR intervention was 15±3 min.The control group received routine nursing care,including disease education and psychological counseling.Patients were assessed using the Type D Scale,Positive and Negative Affect Scale,and Distress Thermometer,and adverse events during the intervention were recorded.Results:Overall,85 patients completed the study(44 in the intervention group and 41 in the control group).Patients with Type D personalities showed more negative emotions[25.0(21.5,27.5)vs.19.0(16.0,24.0),P=0.001]and distressed attitudes[4.0(2.0,5.0)vs.3.0(1.0,4.0),P=0.020]with fewer positive emotions(27.2±5.6 vs.31.0±5.9,P=0.014)than those with non-Type D personalities.Total population analysis revealed no significant differences between the groups.However,in the subgroup analysis,patients with Type D personalities in the intervention group showed greater relief from negative emotions than those in the control group[median difference,-5.0(-9.0,-2.5)vs.-2.0(-4.0,2.0),P=0.046].No significant differences were found between groups of patients with non-Type D personality traits.The proportion of adverse events was not significantly different between groups(P=0.110).Conclusions:Breast cancer patients with Type D personalities suffer more severe negative emotions and distress,and more attention should be paid to them.VR intervention significantly and safely reduced negative emotions in patients with Type D personalities.展开更多
Augmented reality(AR)is an emerging dynamic technology that effectively supports education across different levels.The increased use of mobile devices has an even greater impact.As the demand for AR applications in ed...Augmented reality(AR)is an emerging dynamic technology that effectively supports education across different levels.The increased use of mobile devices has an even greater impact.As the demand for AR applications in education continues to increase,educators actively seek innovative and immersive methods to engage students in learning.However,exploring these possibilities also entails identifying and overcoming existing barriers to optimal educational integration.Concurrently,this surge in demand has prompted the identification of specific barriers,one of which is three-dimensional(3D)modeling.Creating 3D objects for augmented reality education applications can be challenging and time-consuming for the educators.To address this,we have developed a pipeline that creates realistic 3D objects from the two-dimensional(2D)photograph.Applications for augmented and virtual reality can then utilize these created 3D objects.We evaluated the proposed pipeline based on the usability of the 3D object and performance metrics.Quantitatively,with 117 respondents,the co-creation team was surveyed with openended questions to evaluate the precision of the 3D object created by the proposed photogrammetry pipeline.We analyzed the survey data using descriptive-analytical methods and found that the proposed pipeline produces 3D models that are positively accurate when compared to real-world objects,with an average mean score above 8.This study adds new knowledge in creating 3D objects for augmented reality applications by using the photogrammetry technique;finally,it discusses potential problems and future research directions for 3D objects in the education sector.展开更多
The use of virtual reality to educate preoperative patients has a positive impact on nurses as well as patients undergoing treatment.It can help improve patient satisfaction and improve favorable outcomes by reducing ...The use of virtual reality to educate preoperative patients has a positive impact on nurses as well as patients undergoing treatment.It can help improve patient satisfaction and improve favorable outcomes by reducing patient anxiety and proving adequate knowledge about the procedure and possible outcomes to the patient.It also reduces burden on nursing staff and counsellors.Larger and more diverse cohort studies will help us understand the wider application of this tool on the patient population.It may be difficult to apply this tool on elderly patients with failing eyesight,multiple physical comorbidities.Also,there may be reduced acceptance of this modality by older nursing staff and practitioners who may prefer the traditional verbal version for counselling.We will benefit from a combined approach of using virtual reality apps with tradition one-on-one counselling to help alleviate patient concerns and improve patient and healthcare professional satisfaction.展开更多
Objectives:Emotional stress is a significant public health challenge.Virtual reality(VR)offers the potential for aiding emotional recovery.This study explores the impact of VR environment design factors on emotional r...Objectives:Emotional stress is a significant public health challenge.Virtual reality(VR)offers the potential for aiding emotional recovery.This study explores the impact of VR environment design factors on emotional recovery,examining underlying mechanisms through physiological indicators and behavioral responses.Methods:Two experimentswere conducted.Experiment 1 employed a 4[Scene Type:real environment(RE),virtual scenes that restore the RE(VR),virtual scenes that incorporate natural window view design(VR-W),and a no-scene control condition(CTL)]×3(Experimental Phase:baseline,emotion arousal,recovery)mixed design(N=33).Participants viewed a 4-min anxiety-inducing video followed by a 3-min scene exposure.State-Trait Anxiety Inventory-State Form(STAIS),galvanic skin response(GSR),and blood-volume pulse(BVP)frequency were analyzed with linear mixed-effects models.Experiment 2 used a 3(Motion-control mode:Unnatural,Semi-natural,Natural)×2(Sound form:Spatial positioning,Surround)×3(Experimental Phase:baseline,emotion arousal,recovery)mixed design(N=42).Presence was analyzed with the Scheirer–Ray–Hare test;phase efficacy was verified with Friedman tests.Results:Experiment 1 showed significant Scene Type×Experimental Phase interactions for GSR(F=8.006,p<0.001,η^(2)_(p)=0.624)and BVP frequency(F=11.491,p<0.001,η^(2)_(p)=0.704).VR-Wproduced the largest recovery(ΔGSR=–1.26;ΔBVP=–5.80;Hedges g≥0.83)vs.RE and VR.STAI-S returned to baseline across all Scene Types.Experiment 2 revealedmain effects of Motion-control mode(F=8.55,p=0.001,η^(2)_(p)=0.32)and Sound form(F=4.35,p=0.044,η^(2)_(p)=0.11)on Presence(Semi-natural+Spatial positioning highest).The greatest physiological recovery occurred with the UnnaturalMotioncontrolmode(GSRH=20.17,p<0.001,ε^(2)=0.49;BVPH=7.92,p=0.019),amplified by Spatial positioning Sound form only in this mode.Design factors did not influence STAI-S change.Conclusions:VR scenes are as restorative as RE;embedding VR-W accelerates recovery.Maximal Presence is not essential:Unnatural Motion-control mode induced the largest physiological recovery,especially combined with Spatial positioning Sound form.展开更多
Objective:Partial or segmental inferior vena cava(IVC)resection is indicated for tumor control in patients with renal tumors invading the IVC.This study aimed to introduce a virtual vascular endoscope to assist surgeo...Objective:Partial or segmental inferior vena cava(IVC)resection is indicated for tumor control in patients with renal tumors invading the IVC.This study aimed to introduce a virtual vascular endoscope to assist surgeons in locating IVC invasion,formulate a surgical plan for robot-assisted IVC thrombectomy(RA-IVCT),and evaluate its potential value.Methods:The reconstruction involves building the construction of deep learning models to predict IVC invasion,which were evaluated via intraoperative findings and pathological analysis.Thirty-six patients with renal tumors and IVC thrombi who underwent RA-IVCT between June 2016 and March 2022 were included in the study.A virtual vascular endoscopy was performed based on preoperative CT findings to identify IVC invasion.Based on the extent of IVC wall invasion and the collateral situation,surgeons could decide whether to perform partial or segmental IVC resection during RA-IVCT.Results:Twenty patients were retrospectively analysed for training in virtual vascular endoscopy(the training cohort),and 16 patients were prospectively analysed to evaluate the accuracy of this technique(the validation cohort).Sixteen patients with IVC invasion underwent cavectomy,whereas six patients underwent partial IVC resection.In the validation cohort,pathological analysis confirmed the exact location of IVC invasion in eight of the nine patients,as indicated by virtual vascular endoscopy.Patients who underwent partial IVC wall resection had less lower extremity edema than those who underwent cavectomy.Conclusion:Our initial experience showed that the virtual vascular endoscopy could assist surgeons in identifying IVC invasion and creating a surgical plan for RA-IVCT.展开更多
In the realm of virtual reality(VR),haptic feedback is integral to enhance the immersive experience;yet,existing wearable devices predominantly rely on skin contact feedback,lacking options for compact and non-contact...In the realm of virtual reality(VR),haptic feedback is integral to enhance the immersive experience;yet,existing wearable devices predominantly rely on skin contact feedback,lacking options for compact and non-contact breeze-sense feedback.Herein,we propose a compact and non-contact working model piezoelectret actuator for providing a gentle and safe breeze sensation.This easy-fabricated and flexible breeze-sense generator with thickness around 1 mm generates air flow pressure up to~163 Pa,which is significantly sensed by human skin.In a typical demonstration,the breeze-sense generators array showcases its versatility by employing multiple coded modes for non-contact information transmitting.The thin thinness and good flexibility facilitate seamless integration with wearable VR setups,and the wearable arrays empower volunteers to precisely perceive the continuous and sudden breeze senses in the virtual environments.This work is expected to inspire developing new haptic feedback devices that play pivotal roles in human-machine interfaces for VR applications.展开更多
The integration of Human-Robot Collaboration(HRC)into Virtual Reality(VR)technology is transforming industries by enhancing workforce skills,improving safety,and optimizing operational processes and efficiency through...The integration of Human-Robot Collaboration(HRC)into Virtual Reality(VR)technology is transforming industries by enhancing workforce skills,improving safety,and optimizing operational processes and efficiency through realistic simulations of industry-specific scenarios.Despite the growing adoption of VR integrated with HRC,comprehensive reviews of current research in HRC-VR within the construction and manufacturing fields are lacking.This review examines the latest advances in designing and implementing HRC using VR technology in these industries.The aim is to address the application domains of HRC-VR,types of robots used,VR setups,and software solutions used.To achieve this,a systematic literature review using the Preferred Reporting Items for Systematic Reviews and Meta-Analyses methodology was conducted on the Web of Science and Google Scholar databases,analyzing 383 articles and selecting 53 papers that met the established selection criteria.The findings emphasize a significant focus on enhancing human-robot interaction with a trend toward using immersive VR experiences and interactive 3D content creation tools.However,the integration of HRC with VR,especially in the dynamic construction environment,presents unique challenges and opportunities for future research,including developing more realistic simulations and adaptable robot systems.This paper offers insights for researchers,practitioners,educators,industry professionals,and policymakers interested in leveraging the integration of HRC with VR in construction and manufacturing industries.展开更多
Background:While traditional meditation practices are known for their mental health benefits,they often face limitations such as restricted access and environmental distractions.To address these challenges and enhance...Background:While traditional meditation practices are known for their mental health benefits,they often face limitations such as restricted access and environmental distractions.To address these challenges and enhance meditation effectiveness,this study implemented an immersive virtual reality meditation(IVRM)program and examined its potentialmental health benefits among university students-a population that frequently experiences significant psychological distress.Methods:Nineteen university students participated in eight 15-min sessions of an IVRM program designed to promote mindfulness and relaxation over the course of one month.Perceived stress and anxiety levels were assessed using validated self-report measures at baseline(T1)and post-intervention(T2).Twotailed paired t-tests were conducted to evaluate the preliminary efficacy of the program,and effect sizes were reported using Cohen’s d.Results:Significant reductions were observed from pre-to post-intervention in perceived stress(t(18)=3.694,p<0.001,SE=0.17,d=−0.85)and perceived anxiety(t(18)=5.113,p<0.01,SE=0.10,d=−1.20),both indicating large effect sizes.Conclusion:Our findings provide preliminary evidence that the IVRMprogramcan reduce stress and anxiety levels in university students.The positive results suggest that IVRM has the potential to serve as a novel,technology-based meditation intervention for individuals at elevated risk for developingmental health disorders.Furthermore,our study suggests important implications for future research.展开更多
The purpose of this study is to establish a multivariate nonlinear regression mathematical model to predict the displacement of tumor during brain tumor resection surgery.And the study will be integrated with augmente...The purpose of this study is to establish a multivariate nonlinear regression mathematical model to predict the displacement of tumor during brain tumor resection surgery.And the study will be integrated with augmented reality technology to achieve three-dimensional visualization,thereby enhancing the complete resection rate of tumor and the success rate of surgery.Based on the preoperative MRI data of the patients,a 3D virtual model is reconstructed and 3D printed.A brain biomimetic model is created using gel injection molding.By considering cerebrospinal fluid loss and tumor cyst fluid loss as independent variables,the highest point displacement in the vertical bone window direction is determined as the dependent variable after positioning the patient for surgery.An orthogonal experiment is conducted on the biomimetic model to establish a predictive model,and this model is incorporated into the augmented reality navigation system.To validate the predictive model,five participants wore HoloLens2 devices,overlaying the patient’s 3D virtual model onto the physical head model.Subsequently,the spatial coordinates of the tumor’s highest point after displacement were measured on both the physical and virtual models(actual coordinates and predicted coordinates,respectively).The difference between these coordinates represents the model’s prediction error.The results indicate that the measured and predicted errors for the displacement of the tumor’s highest point on the X and Y axes range from−0.6787 mm to 0.2957 mm and−0.4314 mm to 0.2253 mm,respectively.The relative errors for each experimental group are within 10%,demonstrating a good fit of the model.This method of establishing a regression model represents a preliminary attempt to predict brain tumor displacement in specific situations.It also provides a new approach for surgeons.By combining augmented reality visualization,it addresses the need for predicting tumor displacement and precisely locating brain anatomical structures in a simple and cost-effective manner.展开更多
Augmented reality(AR)is a technology that superimposes digital information onto real-world objects via head-mounted display devices to improve surgical finesse through visually enhanced medical information.With the ra...Augmented reality(AR)is a technology that superimposes digital information onto real-world objects via head-mounted display devices to improve surgical finesse through visually enhanced medical information.With the rapid development of digital technology,AR has been increasingly adopted in orthopedic surgeries across the globe,especially in total knee arthroplasty procedures which demand high precision.By overlaying digital information onto the surgeon's field of view,AR systems enhance precision,improve alignment accuracy,and reduce the risk of complications associated with malalignment.Some concerns have been raised despite accuracy,including the learning curve,long-term outcomes,and technical limitations.Furthermore,it is essential for health practitioners to gain trust in the utilisation of AR.展开更多
This paper mainly discusses the perioperative nursing course teaching model suitable for higher vocational education.The core content of“perioperative nursing”course is set according to surgical nursing posts,and ga...This paper mainly discusses the perioperative nursing course teaching model suitable for higher vocational education.The core content of“perioperative nursing”course is set according to surgical nursing posts,and gamified course objectives are designed according to learners’cognitive rules.Typical nursing tasks are used as the carrier,teaching case base is formed based on the concept of medical and educational collaboration,and gamified teaching situations are created based on VR technology to optimize the teaching process and enable students to experience the learning process immersive.Enhance students’job competency and professional competence.In the course design,modular teaching,project teaching,team cooperation teaching,gamification teaching,VR immersive teaching,medical teaching collaborative evaluation and other modes are aggregated,and the course design of perioperative nursing is re-carried out.展开更多
In the Acknowledgements section of this article,the grant number"2020YFE0205900"relating to"National Key R&D Program of China"was missing,it has been included and the corrected Acknowledgements...In the Acknowledgements section of this article,the grant number"2020YFE0205900"relating to"National Key R&D Program of China"was missing,it has been included and the corrected Acknowledgements section is given below.展开更多
This manuscript critically evaluates the randomized controlled trial(RCT)conducted by Phiri et al,which assessed the effectiveness of virtual reality(VR)training for psychiatric staff in reducing restrictive practices...This manuscript critically evaluates the randomized controlled trial(RCT)conducted by Phiri et al,which assessed the effectiveness of virtual reality(VR)training for psychiatric staff in reducing restrictive practices(RPs).Specifically,this RCT investigated the impact of VR on the handling of aggressive patients by psychiatric staff compared to traditional training methods.Despite significant reductions in perceived discrimination in the VR group,there were no major improvements in self-efficacy or anxiety levels.The system usability scale rated the VR platform highly,but it did not consistently outperform traditional training methods.Indeed,the study shows the potential for VR to reduce RPs,although fluctuations in RP rates suggest that external factors,such as staff turnover,influenced the outcomes.This manuscript evaluates the study’s methodology,results,and broader implications for mental health training.Additionally,it highlights the need for more comprehensive research to establish VR as a standard tool for psychiatric staff education,focusing on patient care outcomes and real-world applicability.Finally,this study explores future research di-rections,technological improvements,and the potential impact of policies that could enhance the integration of VR in clinical training.展开更多
Virtual reality(VR)technology revitalises rehabilitation training by creating rich,interactive virtual rehabilitation scenes and tasks that deeply engage patients.Robotics with immersive VR environments have the poten...Virtual reality(VR)technology revitalises rehabilitation training by creating rich,interactive virtual rehabilitation scenes and tasks that deeply engage patients.Robotics with immersive VR environments have the potential to significantly enhance the sense of immersion for patients during training.This paper proposes a rehabilitation robot system.The system integrates a VR environment,the exoskeleton entity,and research on rehabilitation assessment metrics derived from surface electromyographic signal(sEMG).Employing more realistic and engaging virtual stimuli,this method guides patients to actively participate,thereby enhancing the effectiveness of neural connection reconstruction—an essential aspect of rehabilitation.Furthermore,this study introduces a muscle activation model that merges linear and non-linear states of muscle,avoiding the impact of non-linear shape factors on model accuracy present in traditional models.A muscle strength assessment model based on optimised generalised regression(WOAGRNN)is also proposed,with a root mean square error of 0.017,347 and a mean absolute percentage error of 1.2461%,serving as critical assessment indicators for the effectiveness of rehabilitation.Finally,the system is preliminarily applied in human movement experiments,validating the practicality and potential effectiveness of VRcentred rehabilitation strategies in medical recovery.展开更多
The convergence of large language models(LLMs)and virtual reality(VR)technologies has led to significant breakthroughs across multiple domains,particularly in healthcare and medicine.Owing to its immersive and interac...The convergence of large language models(LLMs)and virtual reality(VR)technologies has led to significant breakthroughs across multiple domains,particularly in healthcare and medicine.Owing to its immersive and interactive capabilities,VR technology has demonstrated exceptional utility in surgical simulation,rehabilitation,physical therapy,mental health,and psychological treatment.By creating highly realistic and precisely controlled environments,VR not only enhances the efficiency of medical training but also enables personalized therapeutic approaches for patients.The convergence of LLMs and VR extends the potential of both technologies.LLM-empowered VR can transform medical education through interactive learning platforms and address complex healthcare challenges using comprehensive solutions.This convergence enhances the quality of training,decision-making,and patient engagement,paving the way for innovative healthcare delivery.This study aims to comprehensively review the current applications,research advancements,and challenges associated with these two technologies in healthcare and medicine.The rapid evolution of these technologies is driving the healthcare industry toward greater intelligence and precision,establishing them as critical forces in the transformation of modern medicine.展开更多
Objective To develop a multimodal imaging atlas of a rat brain-computer interface(BCI)that incorporates brain,arterial,bone tissue and a BCI device using mixed reality(MR)for three-dimensional(3D)visualization.Methods...Objective To develop a multimodal imaging atlas of a rat brain-computer interface(BCI)that incorporates brain,arterial,bone tissue and a BCI device using mixed reality(MR)for three-dimensional(3D)visualization.Methods An invasive BCI was implanted in the left visual cortex of 4-week-old Sprague–Dawley rats.Multimodal imaging techniques,including micro-CT and 9.0 T MRI,were used to acquire images of the rat cranial bone structure,vascular distribution,brain tissue functional zones,and BCI device before and after implantation.Using 3D-slicer software,the images were fused through spatial transformations,followed by image segmentation and 3D model reconstruction.The HoloLens platform was employed for MR visualization.Results This study constructed a multimodal imaging atlas for rats that included the skull,brain tissue,arterial tissue,and BCI device coupled with MR technology to create an interactive 3D anatomical model.Conclusions This multimodal 3D atlas provides an objective and stable reference for exploring complex relationships between brain tissue structure and function,enhancing the understanding of the operational principles of BCIs.This is the first multimodal 3D imaging atlas related to a BCI created using Sprague–Dawley rats.展开更多
Endoscopic transnasal optic nerve decompression surgery plays a crucial role in minimal invasive treatment of complex traumatic optic neuropathy.However,a major challenge faced during the procedure is the inability to...Endoscopic transnasal optic nerve decompression surgery plays a crucial role in minimal invasive treatment of complex traumatic optic neuropathy.However,a major challenge faced during the procedure is the inability to visualize the optic nerve intraoperatively.To address this issue,an endoscopic image-based augmented reality surgical navigation system is developed in this study.The system aims to virtually fuse the optic nerve onto the endoscopic images,assisting surgeons in determining the optic nerve’s position and reducing surgical risks.First,a calibration algorithm based on a checkerboard grid of immobile points is proposed,building upon existing calibration methods.Additionally,to tackle accuracy issues associated with augmented reality technology,an optical navigation and visual fusion compensation algorithm is proposed to improve the intraoperative tracking accuracy.To evaluate the system’s performance,model experiments were meticulously designed and conducted.The results confirm the accuracy and stability of the proposed system,with an average tracking error of(0.99±0.46)mm.This outcome demonstrates the effectiveness of the proposed algorithm in improving the augmented reality surgical navigation system’s accuracy.Furthermore,the system successfully displays hidden optic nerves and other deep tissues,thus showcasing the promising potential for future applications in orbital and maxillofacial surgery.展开更多
文摘Phantom limb pain(PLP)is not only a physical pain experience but also poses a significant challenge to mental health and quality of life.Currently,the mechanism of PLP treatment is still unclear,and there are many methods with varying effects.This article starts with the application research of extended reality technology in PLP treatment,through describing the application of its branch technologies(virtual reality,augmented reality,and mixed reality technology),to lay the foundation for subsequent research,in the hope of finding advanced and effective treatment methods,and providing a basis for future product transformation.
基金supported by research fund from Chosun University,2024.
文摘The rapid evolution of virtual reality(VR)and augmented reality(AR)technologies has significantly transformed human-computer interaction,with applications spanning entertainment,education,healthcare,industry,and remote collaboration.A central challenge in these immersive systems lies in enabling intuitive,efficient,and natural interactions.Hand gesture recognition offers a compelling solution by leveraging the expressiveness of human hands to facilitate seamless control without relying on traditional input devices such as controllers or keyboards,which can limit immersion.However,achieving robust gesture recognition requires overcoming challenges related to accurate hand tracking,complex environmental conditions,and minimizing system latency.This study proposes an artificial intelligence(AI)-driven framework for recognizing both static and dynamic hand gestures in VR and AR environments using skeleton-based tracking compliant with the OpenXR standard.Our approach employs a lightweight neural network architecture capable of real-time classification within approximately 1.3mswhilemaintaining average accuracy of 95%.We also introduce a novel dataset generation method to support training robust models and demonstrate consistent classification of diverse gestures across widespread commercial VR devices.This work represents one of the first studies to implement and validate dynamic hand gesture recognition in real time using standardized VR hardware,laying the groundwork for more immersive,accessible,and user-friendly interaction systems.By advancing AI-driven gesture interfaces,this research has the potential to broaden the adoption of VR and AR across diverse domains and enhance the overall user experience.
文摘Medical procedures are inherently invasive and carry the risk of inducing pain to the mind and body.Recently,efforts have been made to alleviate the discomfort associated with invasive medical procedures through the use of virtual reality(VR)technology.VR has been demonstrated to be an effective treatment for pain associated with medical procedures,as well as for chronic pain conditions for which no effective treatment has been established.The precise mechanism by which the diversion from reality facilitated by VR contributes to the diminution of pain and anxiety has yet to be elucidated.However,the provision of positive images through VR-based visual stimulation may enhance the functionality of brain networks.The salience network is diminished,while the default mode network is enhanced.Additionally,the medial prefrontal cortex may establish a stronger connection with the default mode network,which could result in a reduction of pain and anxiety.Further research into the potential of VR technology to alleviate pain could lead to a reduction in the number of individuals who overdose on painkillers and contribute to positive change in the medical field.
基金supported by a project of the National Natural Science Foundation of China:Research on the integration of artificial intelligence and virtual reality technology to promote psychological rehabilitation of breast cancer patients with different personalities(project approval no.82073408).
文摘Objectives:To explore the efficacy and safety of virtual reality(VR)in relieving negative emotions in patients with breast cancer with different personalities.Methods:A randomized controlled trial was conducted.Between April 2023 and October 2023,we enrolled patients with breast cancer treated in the Department of Breast Cancer and Oncology at Sun Yat-Sen Memorial Hospital,Sun Yat-Sen University,Guangdong Province.The patients were randomly divided into an intervention group(n=118)and a control group(n=119)using block randomization.The intervention group received the VR intervention 3-5 times over 5±2 weeks using natural landscapes with music or relaxation guidance,and the duration of each VR intervention was 15±3 min.The control group received routine nursing care,including disease education and psychological counseling.Patients were assessed using the Type D Scale,Positive and Negative Affect Scale,and Distress Thermometer,and adverse events during the intervention were recorded.Results:Overall,85 patients completed the study(44 in the intervention group and 41 in the control group).Patients with Type D personalities showed more negative emotions[25.0(21.5,27.5)vs.19.0(16.0,24.0),P=0.001]and distressed attitudes[4.0(2.0,5.0)vs.3.0(1.0,4.0),P=0.020]with fewer positive emotions(27.2±5.6 vs.31.0±5.9,P=0.014)than those with non-Type D personalities.Total population analysis revealed no significant differences between the groups.However,in the subgroup analysis,patients with Type D personalities in the intervention group showed greater relief from negative emotions than those in the control group[median difference,-5.0(-9.0,-2.5)vs.-2.0(-4.0,2.0),P=0.046].No significant differences were found between groups of patients with non-Type D personality traits.The proportion of adverse events was not significantly different between groups(P=0.110).Conclusions:Breast cancer patients with Type D personalities suffer more severe negative emotions and distress,and more attention should be paid to them.VR intervention significantly and safely reduced negative emotions in patients with Type D personalities.
文摘Augmented reality(AR)is an emerging dynamic technology that effectively supports education across different levels.The increased use of mobile devices has an even greater impact.As the demand for AR applications in education continues to increase,educators actively seek innovative and immersive methods to engage students in learning.However,exploring these possibilities also entails identifying and overcoming existing barriers to optimal educational integration.Concurrently,this surge in demand has prompted the identification of specific barriers,one of which is three-dimensional(3D)modeling.Creating 3D objects for augmented reality education applications can be challenging and time-consuming for the educators.To address this,we have developed a pipeline that creates realistic 3D objects from the two-dimensional(2D)photograph.Applications for augmented and virtual reality can then utilize these created 3D objects.We evaluated the proposed pipeline based on the usability of the 3D object and performance metrics.Quantitatively,with 117 respondents,the co-creation team was surveyed with openended questions to evaluate the precision of the 3D object created by the proposed photogrammetry pipeline.We analyzed the survey data using descriptive-analytical methods and found that the proposed pipeline produces 3D models that are positively accurate when compared to real-world objects,with an average mean score above 8.This study adds new knowledge in creating 3D objects for augmented reality applications by using the photogrammetry technique;finally,it discusses potential problems and future research directions for 3D objects in the education sector.
文摘The use of virtual reality to educate preoperative patients has a positive impact on nurses as well as patients undergoing treatment.It can help improve patient satisfaction and improve favorable outcomes by reducing patient anxiety and proving adequate knowledge about the procedure and possible outcomes to the patient.It also reduces burden on nursing staff and counsellors.Larger and more diverse cohort studies will help us understand the wider application of this tool on the patient population.It may be difficult to apply this tool on elderly patients with failing eyesight,multiple physical comorbidities.Also,there may be reduced acceptance of this modality by older nursing staff and practitioners who may prefer the traditional verbal version for counselling.We will benefit from a combined approach of using virtual reality apps with tradition one-on-one counselling to help alleviate patient concerns and improve patient and healthcare professional satisfaction.
基金funded by the General Project of the National Social Science Fund(NSSF)of China in Art(Project No.23BG133)the Scientific Research Foundation ofWuhan Institute of Technology(Project No.K2023064)+2 种基金the Open Fund of Key Research Base of Humanities and Social Sciences in Hubei Province—Research Center for College Students’Development and Innovation Education:“VR Healing Intervention for College Students’Academic Anxiety—VR Healing Based on Intention Dialogue”(Project No.DXS2023017)the Research Project of China Youth and Children Research Society(Project No.2025B11)the Major Strategic Consulting Projects of the Chinese Academy of Engineering between Academy and Local Regions(Project No.2024-DFZD-41).
文摘Objectives:Emotional stress is a significant public health challenge.Virtual reality(VR)offers the potential for aiding emotional recovery.This study explores the impact of VR environment design factors on emotional recovery,examining underlying mechanisms through physiological indicators and behavioral responses.Methods:Two experimentswere conducted.Experiment 1 employed a 4[Scene Type:real environment(RE),virtual scenes that restore the RE(VR),virtual scenes that incorporate natural window view design(VR-W),and a no-scene control condition(CTL)]×3(Experimental Phase:baseline,emotion arousal,recovery)mixed design(N=33).Participants viewed a 4-min anxiety-inducing video followed by a 3-min scene exposure.State-Trait Anxiety Inventory-State Form(STAIS),galvanic skin response(GSR),and blood-volume pulse(BVP)frequency were analyzed with linear mixed-effects models.Experiment 2 used a 3(Motion-control mode:Unnatural,Semi-natural,Natural)×2(Sound form:Spatial positioning,Surround)×3(Experimental Phase:baseline,emotion arousal,recovery)mixed design(N=42).Presence was analyzed with the Scheirer–Ray–Hare test;phase efficacy was verified with Friedman tests.Results:Experiment 1 showed significant Scene Type×Experimental Phase interactions for GSR(F=8.006,p<0.001,η^(2)_(p)=0.624)and BVP frequency(F=11.491,p<0.001,η^(2)_(p)=0.704).VR-Wproduced the largest recovery(ΔGSR=–1.26;ΔBVP=–5.80;Hedges g≥0.83)vs.RE and VR.STAI-S returned to baseline across all Scene Types.Experiment 2 revealedmain effects of Motion-control mode(F=8.55,p=0.001,η^(2)_(p)=0.32)and Sound form(F=4.35,p=0.044,η^(2)_(p)=0.11)on Presence(Semi-natural+Spatial positioning highest).The greatest physiological recovery occurred with the UnnaturalMotioncontrolmode(GSRH=20.17,p<0.001,ε^(2)=0.49;BVPH=7.92,p=0.019),amplified by Spatial positioning Sound form only in this mode.Design factors did not influence STAI-S change.Conclusions:VR scenes are as restorative as RE;embedding VR-W accelerates recovery.Maximal Presence is not essential:Unnatural Motion-control mode induced the largest physiological recovery,especially combined with Spatial positioning Sound form.
基金supported by the National Natural Science Foundation of China(No.82273412 to Huang Q).
文摘Objective:Partial or segmental inferior vena cava(IVC)resection is indicated for tumor control in patients with renal tumors invading the IVC.This study aimed to introduce a virtual vascular endoscope to assist surgeons in locating IVC invasion,formulate a surgical plan for robot-assisted IVC thrombectomy(RA-IVCT),and evaluate its potential value.Methods:The reconstruction involves building the construction of deep learning models to predict IVC invasion,which were evaluated via intraoperative findings and pathological analysis.Thirty-six patients with renal tumors and IVC thrombi who underwent RA-IVCT between June 2016 and March 2022 were included in the study.A virtual vascular endoscopy was performed based on preoperative CT findings to identify IVC invasion.Based on the extent of IVC wall invasion and the collateral situation,surgeons could decide whether to perform partial or segmental IVC resection during RA-IVCT.Results:Twenty patients were retrospectively analysed for training in virtual vascular endoscopy(the training cohort),and 16 patients were prospectively analysed to evaluate the accuracy of this technique(the validation cohort).Sixteen patients with IVC invasion underwent cavectomy,whereas six patients underwent partial IVC resection.In the validation cohort,pathological analysis confirmed the exact location of IVC invasion in eight of the nine patients,as indicated by virtual vascular endoscopy.Patients who underwent partial IVC wall resection had less lower extremity edema than those who underwent cavectomy.Conclusion:Our initial experience showed that the virtual vascular endoscopy could assist surgeons in identifying IVC invasion and creating a surgical plan for RA-IVCT.
基金supported by the Science and Technology Development Fund of Macao SAR(File No.0117/2024/AMJ)University of Macao(MYRG-GRG2023-00041-FST-UMDF,MYRG-GRG2024-00121-FST,MYRG-CRG2024-00014-FST-ICI)Zhuhai UM Science&Technology Research Institute(CP-009-2024).
文摘In the realm of virtual reality(VR),haptic feedback is integral to enhance the immersive experience;yet,existing wearable devices predominantly rely on skin contact feedback,lacking options for compact and non-contact breeze-sense feedback.Herein,we propose a compact and non-contact working model piezoelectret actuator for providing a gentle and safe breeze sensation.This easy-fabricated and flexible breeze-sense generator with thickness around 1 mm generates air flow pressure up to~163 Pa,which is significantly sensed by human skin.In a typical demonstration,the breeze-sense generators array showcases its versatility by employing multiple coded modes for non-contact information transmitting.The thin thinness and good flexibility facilitate seamless integration with wearable VR setups,and the wearable arrays empower volunteers to precisely perceive the continuous and sudden breeze senses in the virtual environments.This work is expected to inspire developing new haptic feedback devices that play pivotal roles in human-machine interfaces for VR applications.
基金Supported by National Science Foundation under Grant No.2222881.
文摘The integration of Human-Robot Collaboration(HRC)into Virtual Reality(VR)technology is transforming industries by enhancing workforce skills,improving safety,and optimizing operational processes and efficiency through realistic simulations of industry-specific scenarios.Despite the growing adoption of VR integrated with HRC,comprehensive reviews of current research in HRC-VR within the construction and manufacturing fields are lacking.This review examines the latest advances in designing and implementing HRC using VR technology in these industries.The aim is to address the application domains of HRC-VR,types of robots used,VR setups,and software solutions used.To achieve this,a systematic literature review using the Preferred Reporting Items for Systematic Reviews and Meta-Analyses methodology was conducted on the Web of Science and Google Scholar databases,analyzing 383 articles and selecting 53 papers that met the established selection criteria.The findings emphasize a significant focus on enhancing human-robot interaction with a trend toward using immersive VR experiences and interactive 3D content creation tools.However,the integration of HRC with VR,especially in the dynamic construction environment,presents unique challenges and opportunities for future research,including developing more realistic simulations and adaptable robot systems.This paper offers insights for researchers,practitioners,educators,industry professionals,and policymakers interested in leveraging the integration of HRC with VR in construction and manufacturing industries.
文摘Background:While traditional meditation practices are known for their mental health benefits,they often face limitations such as restricted access and environmental distractions.To address these challenges and enhance meditation effectiveness,this study implemented an immersive virtual reality meditation(IVRM)program and examined its potentialmental health benefits among university students-a population that frequently experiences significant psychological distress.Methods:Nineteen university students participated in eight 15-min sessions of an IVRM program designed to promote mindfulness and relaxation over the course of one month.Perceived stress and anxiety levels were assessed using validated self-report measures at baseline(T1)and post-intervention(T2).Twotailed paired t-tests were conducted to evaluate the preliminary efficacy of the program,and effect sizes were reported using Cohen’s d.Results:Significant reductions were observed from pre-to post-intervention in perceived stress(t(18)=3.694,p<0.001,SE=0.17,d=−0.85)and perceived anxiety(t(18)=5.113,p<0.01,SE=0.10,d=−1.20),both indicating large effect sizes.Conclusion:Our findings provide preliminary evidence that the IVRMprogramcan reduce stress and anxiety levels in university students.The positive results suggest that IVRM has the potential to serve as a novel,technology-based meditation intervention for individuals at elevated risk for developingmental health disorders.Furthermore,our study suggests important implications for future research.
基金the University of Shanghai for Science and Technology’s Medical Engineering Interdisciplinary Project(No.10-22-308-520)the Ministry of Education’s First Batch of Industry-Education Cooperation Collaborative Education Projects(No.202101042008)+1 种基金the Fundamental Research Funds for the Central Universities(No.YG2019QNA34)the Shanghai Municipal Health Commission for Youth Clinical Research Project(No.20194Y0134)。
文摘The purpose of this study is to establish a multivariate nonlinear regression mathematical model to predict the displacement of tumor during brain tumor resection surgery.And the study will be integrated with augmented reality technology to achieve three-dimensional visualization,thereby enhancing the complete resection rate of tumor and the success rate of surgery.Based on the preoperative MRI data of the patients,a 3D virtual model is reconstructed and 3D printed.A brain biomimetic model is created using gel injection molding.By considering cerebrospinal fluid loss and tumor cyst fluid loss as independent variables,the highest point displacement in the vertical bone window direction is determined as the dependent variable after positioning the patient for surgery.An orthogonal experiment is conducted on the biomimetic model to establish a predictive model,and this model is incorporated into the augmented reality navigation system.To validate the predictive model,five participants wore HoloLens2 devices,overlaying the patient’s 3D virtual model onto the physical head model.Subsequently,the spatial coordinates of the tumor’s highest point after displacement were measured on both the physical and virtual models(actual coordinates and predicted coordinates,respectively).The difference between these coordinates represents the model’s prediction error.The results indicate that the measured and predicted errors for the displacement of the tumor’s highest point on the X and Y axes range from−0.6787 mm to 0.2957 mm and−0.4314 mm to 0.2253 mm,respectively.The relative errors for each experimental group are within 10%,demonstrating a good fit of the model.This method of establishing a regression model represents a preliminary attempt to predict brain tumor displacement in specific situations.It also provides a new approach for surgeons.By combining augmented reality visualization,it addresses the need for predicting tumor displacement and precisely locating brain anatomical structures in a simple and cost-effective manner.
基金Supported by The Hunan Provincial Natural Science Foundation of China,No.2023JJ30773,No.2025JJ60480,and No.2025JJ60552The Scientific Research Program of The Hunan Provincial Health Commission,No.202204072544+4 种基金The Science and Technology Innovation Program of Hunan Province,No.2024RC3053The CBT ECR/MCR Scheme,No.324910-0028/07National Natural Science Foundation of China,No.32300652The Scientific Research Program of Hunan Provincial Health Commission,No.W20243023The Scientific Research Launch Project for New Employees of The Second Xiangya Hospital of Central South University.
文摘Augmented reality(AR)is a technology that superimposes digital information onto real-world objects via head-mounted display devices to improve surgical finesse through visually enhanced medical information.With the rapid development of digital technology,AR has been increasingly adopted in orthopedic surgeries across the globe,especially in total knee arthroplasty procedures which demand high precision.By overlaying digital information onto the surgeon's field of view,AR systems enhance precision,improve alignment accuracy,and reduce the risk of complications associated with malalignment.Some concerns have been raised despite accuracy,including the learning curve,long-term outcomes,and technical limitations.Furthermore,it is essential for health practitioners to gain trust in the utilisation of AR.
基金Scientific Research Project of Hunan Provincial Department of Education“Design and Implementation of Vocational Nursing Talent Training Based on Virtual Reality Immersive Game Teaching”(Project No.:23C0938)Loudi Vocational and Technical College 2024 Education and Teaching Reform Research Project“Design and Implementation of Surgical Nursing Gamification Course Based on Immersive Virtual Reality Technology”(Project No.:LZJY24ZZC01)。
文摘This paper mainly discusses the perioperative nursing course teaching model suitable for higher vocational education.The core content of“perioperative nursing”course is set according to surgical nursing posts,and gamified course objectives are designed according to learners’cognitive rules.Typical nursing tasks are used as the carrier,teaching case base is formed based on the concept of medical and educational collaboration,and gamified teaching situations are created based on VR technology to optimize the teaching process and enable students to experience the learning process immersive.Enhance students’job competency and professional competence.In the course design,modular teaching,project teaching,team cooperation teaching,gamification teaching,VR immersive teaching,medical teaching collaborative evaluation and other modes are aggregated,and the course design of perioperative nursing is re-carried out.
文摘In the Acknowledgements section of this article,the grant number"2020YFE0205900"relating to"National Key R&D Program of China"was missing,it has been included and the corrected Acknowledgements section is given below.
基金Supported by Basic Science Research Program Through the National Research Foundation of Korea(NRF)Funded by the Ministry of Education,No.NRF-RS-2023-00237287 and No.NRF-2021S1A5A8062526Local Government-University Cooperation-Based Regional Innovation Projects,No.2021RIS-003.
文摘This manuscript critically evaluates the randomized controlled trial(RCT)conducted by Phiri et al,which assessed the effectiveness of virtual reality(VR)training for psychiatric staff in reducing restrictive practices(RPs).Specifically,this RCT investigated the impact of VR on the handling of aggressive patients by psychiatric staff compared to traditional training methods.Despite significant reductions in perceived discrimination in the VR group,there were no major improvements in self-efficacy or anxiety levels.The system usability scale rated the VR platform highly,but it did not consistently outperform traditional training methods.Indeed,the study shows the potential for VR to reduce RPs,although fluctuations in RP rates suggest that external factors,such as staff turnover,influenced the outcomes.This manuscript evaluates the study’s methodology,results,and broader implications for mental health training.Additionally,it highlights the need for more comprehensive research to establish VR as a standard tool for psychiatric staff education,focusing on patient care outcomes and real-world applicability.Finally,this study explores future research di-rections,technological improvements,and the potential impact of policies that could enhance the integration of VR in clinical training.
基金National Key Research and Development Program of China,Grant/Award Number:2022YFB4700701National Outstanding Youth Science Fund Project of National Natural Science Foundation of China,Grant/Award Number:52025054。
文摘Virtual reality(VR)technology revitalises rehabilitation training by creating rich,interactive virtual rehabilitation scenes and tasks that deeply engage patients.Robotics with immersive VR environments have the potential to significantly enhance the sense of immersion for patients during training.This paper proposes a rehabilitation robot system.The system integrates a VR environment,the exoskeleton entity,and research on rehabilitation assessment metrics derived from surface electromyographic signal(sEMG).Employing more realistic and engaging virtual stimuli,this method guides patients to actively participate,thereby enhancing the effectiveness of neural connection reconstruction—an essential aspect of rehabilitation.Furthermore,this study introduces a muscle activation model that merges linear and non-linear states of muscle,avoiding the impact of non-linear shape factors on model accuracy present in traditional models.A muscle strength assessment model based on optimised generalised regression(WOAGRNN)is also proposed,with a root mean square error of 0.017,347 and a mean absolute percentage error of 1.2461%,serving as critical assessment indicators for the effectiveness of rehabilitation.Finally,the system is preliminarily applied in human movement experiments,validating the practicality and potential effectiveness of VRcentred rehabilitation strategies in medical recovery.
基金Supported by Noncommunicable Chronic Diseases-National Science and Technology Major Project(2024ZD0523200)National Natural Science Foundation of China(62301330,62101346).
文摘The convergence of large language models(LLMs)and virtual reality(VR)technologies has led to significant breakthroughs across multiple domains,particularly in healthcare and medicine.Owing to its immersive and interactive capabilities,VR technology has demonstrated exceptional utility in surgical simulation,rehabilitation,physical therapy,mental health,and psychological treatment.By creating highly realistic and precisely controlled environments,VR not only enhances the efficiency of medical training but also enables personalized therapeutic approaches for patients.The convergence of LLMs and VR extends the potential of both technologies.LLM-empowered VR can transform medical education through interactive learning platforms and address complex healthcare challenges using comprehensive solutions.This convergence enhances the quality of training,decision-making,and patient engagement,paving the way for innovative healthcare delivery.This study aims to comprehensively review the current applications,research advancements,and challenges associated with these two technologies in healthcare and medicine.The rapid evolution of these technologies is driving the healthcare industry toward greater intelligence and precision,establishing them as critical forces in the transformation of modern medicine.
基金supported by the National Natural Science Foundation of China(No.82172524 and No.81974355)National Innovation Platform Development Program(No.2020021105012440),China+3 种基金Major Program of Hubei Province(No.2021BEA161),ChinaMajor Key Project of Hubei Province(No.JD2023BAA005),ChinaWuhan Union Hospital Free Innovation Preliminary Research Fund(No.2024XHYN047),ChinaJoint Funds for the Innovation of Science and Technology(No.2024Y9062),Fujian Province,China.
文摘Objective To develop a multimodal imaging atlas of a rat brain-computer interface(BCI)that incorporates brain,arterial,bone tissue and a BCI device using mixed reality(MR)for three-dimensional(3D)visualization.Methods An invasive BCI was implanted in the left visual cortex of 4-week-old Sprague–Dawley rats.Multimodal imaging techniques,including micro-CT and 9.0 T MRI,were used to acquire images of the rat cranial bone structure,vascular distribution,brain tissue functional zones,and BCI device before and after implantation.Using 3D-slicer software,the images were fused through spatial transformations,followed by image segmentation and 3D model reconstruction.The HoloLens platform was employed for MR visualization.Results This study constructed a multimodal imaging atlas for rats that included the skull,brain tissue,arterial tissue,and BCI device coupled with MR technology to create an interactive 3D anatomical model.Conclusions This multimodal 3D atlas provides an objective and stable reference for exploring complex relationships between brain tissue structure and function,enhancing the understanding of the operational principles of BCIs.This is the first multimodal 3D imaging atlas related to a BCI created using Sprague–Dawley rats.
基金the National Natural Science Foundation of China(Nos.82330063 and M-0019)the Interdisciplinary Program of Shanghai Jiao Tong University(Nos.YG2022QN056,YG2023ZD19,and YG2023ZD15)+2 种基金the Cross Disciplinary Research Fund of Shanghai Ninth People’s Hospital,Shanghai Jiao Tong University School of Medicine(No.JYJC202115)the Translation Clinical R&D Project of Medical Robot of Shanghai Ninth People’s Hospital,Shanghai Jiao Tong University School of Medicine(No.IMR-NPH202002)the Shanghai Key Clinical Specialty,Shanghai Eye Disease Research Center(No.2022ZZ01003)。
文摘Endoscopic transnasal optic nerve decompression surgery plays a crucial role in minimal invasive treatment of complex traumatic optic neuropathy.However,a major challenge faced during the procedure is the inability to visualize the optic nerve intraoperatively.To address this issue,an endoscopic image-based augmented reality surgical navigation system is developed in this study.The system aims to virtually fuse the optic nerve onto the endoscopic images,assisting surgeons in determining the optic nerve’s position and reducing surgical risks.First,a calibration algorithm based on a checkerboard grid of immobile points is proposed,building upon existing calibration methods.Additionally,to tackle accuracy issues associated with augmented reality technology,an optical navigation and visual fusion compensation algorithm is proposed to improve the intraoperative tracking accuracy.To evaluate the system’s performance,model experiments were meticulously designed and conducted.The results confirm the accuracy and stability of the proposed system,with an average tracking error of(0.99±0.46)mm.This outcome demonstrates the effectiveness of the proposed algorithm in improving the augmented reality surgical navigation system’s accuracy.Furthermore,the system successfully displays hidden optic nerves and other deep tissues,thus showcasing the promising potential for future applications in orbital and maxillofacial surgery.
