Closed thoracic drainage can be performed using a steel-needle-guided chest tube to treat pleural effusion or pneumothorax in clinics.However,the puncture procedure during surgery is invisible,increasing the risk of s...Closed thoracic drainage can be performed using a steel-needle-guided chest tube to treat pleural effusion or pneumothorax in clinics.However,the puncture procedure during surgery is invisible,increasing the risk of surgical failure.Therefore,it is necessary to design a visualization system for closed thoracic drainage.Augmented reality(AR)technology can assist in visualizing the internal anatomical structure and determining the insertion point on the body surface.The structure of the currently used steel-needle-guided chest tube was modified by integrating it with an ultrafine diameter camera to provide real-time visualization of the puncture process.After simulation experiments,the overall registration error of the AR method was measured to be within(3.59±0.53)mm,indicating its potential for clinical application.The ultrafine diameter camera module and improved steel-needle-guided chest tube can timely reflect the position of the needle tip in the human body.A comparative experiment showed that video guidance could improve the safety of the puncture process compared to the traditional method.Finally,a qualitative evaluation of the usability of the system was conducted through a questionnaire.This system facilitates the visualization of closed thoracic drainage puncture procedure and pro-vides an implementation scheme to enhance the accuracy and safety of the operative step,which is conducive to reducing the learning curve and improving the proficiency of the doctors.展开更多
With the continuous progress of virtual simulation technology,medical surgery visualization system has been developed from two-dimensional to three-dimensional,from digital to network and intelligentization.The visual...With the continuous progress of virtual simulation technology,medical surgery visualization system has been developed from two-dimensional to three-dimensional,from digital to network and intelligentization.The visualization system with mixed reality technology will also be used in all stage of medical surgery,such as case discussion,surgical planning,intraoperative guidance,post-operative evaluation,rehabilitation,so as to further promote high intelligence,high precision of medical surgery,and consequently improve effectiveness of treatment and quality of medical service.This paper discusses the composition and technical characteristics of medical operation visualization system based on mixed reality technology,and introduces some typical applications of mixed reality technology in medical operation visualization,which provides a new perspective for the application of mixed technology in medical surgery.展开更多
Long-time driving and monotonous visual environment increase the safety risk of driving in an extra-long tunnel.Driving fatigue can be effectively relieved by setting the visual fatigue relief zone in the tunnel.Howev...Long-time driving and monotonous visual environment increase the safety risk of driving in an extra-long tunnel.Driving fatigue can be effectively relieved by setting the visual fatigue relief zone in the tunnel.However,the setting form of visual fatigue relief zone,such as its length and location,is difficult to be designed and quantified.By integrating virtual reality(VR)apparatus with wearable electroencephalogram(EEG)-based devices,a hybrid method was proposed in this study to assist analyzers to formulate the layout of visual fatigue relief zone in the extra-long tunnel.The virtual environment of this study was based on an 11.5 km extra-long tunnel located in Yunnan Province in China.The results indicated that the use of natural landscape decoration inside the tunnel could improve driving fatigue with the growth rate of attention of the driver increased by more than 20%.The accumulation of driving fatigue had a negative effect on the fatigue relief.The results demonstrated that the optimal location of the fatigue relief zone was at the place where driving fatigue had just occurred rather than at the place where a certain amount of driving fatigue had accumulated.展开更多
In this study,a 3D virtual reality and visualization engine for rendering the ocean,named VV-Ocean,is designed for marine applications.The design goals of VV-Ocean aim at high fidelity simulation of ocean environment,...In this study,a 3D virtual reality and visualization engine for rendering the ocean,named VV-Ocean,is designed for marine applications.The design goals of VV-Ocean aim at high fidelity simulation of ocean environment,visualization of massive and multidimensional marine data,and imitation of marine lives.VV-Ocean is composed of five modules,i.e.memory management module,resources management module,scene management module,rendering process management module and interaction management module.There are three core functions in VV-Ocean:reconstructing vivid virtual ocean scenes,visualizing real data dynamically in real time,imitating and simulating marine lives intuitively.Based on VV-Ocean,we establish a sea-land integration platform which can reproduce drifting and diffusion processes of oil spilling from sea bottom to surface.Environment factors such as ocean current and wind field have been considered in this simulation.On this platform oil spilling process can be abstracted as movements of abundant oil particles.The result shows that oil particles blend with water well and the platform meets the requirement for real-time and interactive rendering.VV-Ocean can be widely used in ocean applications such as demonstrating marine operations,facilitating maritime communications,developing ocean games,reducing marine hazards,forecasting the weather over oceans,serving marine tourism,and so on.Finally,further technological improvements of VV-Ocean are discussed.展开更多
In the modern era,preoperative planning is substantially facilitated by artificial reality technologies,which permit a better understanding of patient anatomy,thus increasing the safety and accuracy of surgical interv...In the modern era,preoperative planning is substantially facilitated by artificial reality technologies,which permit a better understanding of patient anatomy,thus increasing the safety and accuracy of surgical interventions.In the field of orthopedic surgery,the increase in safety and accuracy improves treatment quality and orthopedic patient outcomes.Artificial reality technologies,which include virtual reality(VR),augmented reality(AR),and mixed reality(MR),use digital images obtained from computed tomography or magnetic resonance imaging.VR replaces the user’s physical environment with one that is computer generated.AR and MR have been defined as technologies that permit the fusing of the physical with the virtual environment,enabling the user to interact with both physical and virtual objects.MR has been defined as a technology that,in contrast to AR,enables users to visualize the depth and perspective of the virtual models.We aimed to shed light on the role that MR can play in the visualization of orthopedic surgical anatomy.The literature suggests that MR could be a valuable tool in orthopedic surgeon’s hands for visualization of the anatomy.However,we remark that confusion exists in the literature concerning the characteristics of MR.Thus,a more clear description of MR is needed in orthopedic research,so that the potential of this technology can be more deeply understood.展开更多
The availability and quantity of remotely sensed and terrestrial geospatial data sets are on the rise.Historically,these data sets have been analyzed and quarried on 2D desktop computers;however,immersive technologies...The availability and quantity of remotely sensed and terrestrial geospatial data sets are on the rise.Historically,these data sets have been analyzed and quarried on 2D desktop computers;however,immersive technologies and specifically immersive virtual reality(iVR)allow for the integration,visualization,analysis,and exploration of these 3D geospatial data sets.iVR can deliver remote and large-scale geospatial data sets to the laboratory,providing embodied experiences of field sites across the earth and beyond.We describe a workflow for the ingestion of geospatial data sets and the development of an iVR workbench,and present the application of these for an experience of Iceland’s Thrihnukar volcano where we:(1)combined satellite imagery with terrain elevation data to create a basic reconstruction of the physical site;(2)used terrestrial LiDAR data to provide a geo-referenced point cloud model of the magmatic-volcanic system,as well as the LiDAR intensity values for the identification of rock types;and(3)used Structure-from-Motion(SfM)to construct a photorealistic point cloud of the inside volcano.The workbench provides tools for the direct manipulation of the georeferenced data sets,including scaling,rotation,and translation,and a suite of geometric measurement tools,including length,area,and volume.Future developments will be inspired by an ongoing user study that formally evaluates the workbench’s mature components in the context of fieldwork and analyses activities.展开更多
We aim to develop a novel visualization tool for percutaneous renal puncture training based on augmented reality(AR)and compare the needle placement performance of this AR system with ultrasound-guidedfreehand naviga...We aim to develop a novel visualization tool for percutaneous renal puncture training based on augmented reality(AR)and compare the needle placement performance of this AR system with ultrasound-guidedfreehand navigation in phantoms.A head-mounted display-based AR navigation system was developed usingthe Unity3D software and Visual Studio to enable the overlay of the preoperative needle path and the complexanatomical structures onto a phantom in real time.The spatial location of the stationary phantom and the percutaneous instrument motion were traced by a Qualisys motion capture system.To evaluate the tracking accuracy,15 participants(7 males and 8 females)performed a single needle insertion using AR navigation(the number ofpunctures n=75)and ultrasound-guided freehand navigation(n=75).The needle placement error was measuredas the Euclidean distance between the actual needle tip and the virtual target by MicronTracker.All participantsdemonstrated a superior needle insertion efficiency when using the AR-assisted puncture method compared withthe ultrasound-guided freehand method.The needle insertion error of the ultrasound-guided method showed anincreased error compared with the AR method(5.54 mm±2.59 mm,4.34 mm±2.10 mm,respectively,p<0.05).The ultrasound-guided needle placements showed an increased time compared with the AR method(19.08 s±3.59 s,15.14 s±2.72 s,respectively,p<0.0001).Our AR training system facilitates the needle placement performance and solves hand-eye coordination problems.The system has the potential to increase efficiency andeffectiveness of percutaneous renal puncture training.展开更多
Visual reality(VR)health-monitoring by flexible electronics provides a new avenue to remote and wearable medicine.The combination of flexible electronics and VR could facilitate smart remote disease diagnosis by real-...Visual reality(VR)health-monitoring by flexible electronics provides a new avenue to remote and wearable medicine.The combination of flexible electronics and VR could facilitate smart remote disease diagnosis by real-time monitoring of the physiological signals and remote interaction between patient and physician.The flexible healthcare sensor is the most crucial unit in the flexible and wearable health-monitoring system,which has attracted much attention in recent years.This paper briefly reviews the progress in flexible healthcare sensors and VR healthcare devices.The flexible healthcare sensor is introduced with basic flexible materials,manufacturing techniques,and their applications in health-monitoring(such as blood/sweat detection and heart-rate tracking).VR healthcare devices for telemedicine diagnosis are discussed,and the smart remote diagnosis system using flexible and wearable healthcare sensors,and a VR device,is addressed.展开更多
Background To solve the problem of visualization in augmented reality(AR),for assembly process information,we report here on our study into the composition of AR assembly process information.Methods Our work led us to...Background To solve the problem of visualization in augmented reality(AR),for assembly process information,we report here on our study into the composition of AR assembly process information.Methods Our work led us to classify the visual elements of assembly processes into six categories,and after looking further into visual element expression characteristics used in assembly process information in the AR environment,standard assembly process elements have been identified and visual element layout principles studied.Conclusion Typical visualization elements have been presented,using an AR-based assembly instruction system.展开更多
Background Eye tracking te chnology is receiving increased attention in the field of virtual reality.Specifically,future gaze prediction is crucial in pre-computation for many applications such as gaze-contingent rend...Background Eye tracking te chnology is receiving increased attention in the field of virtual reality.Specifically,future gaze prediction is crucial in pre-computation for many applications such as gaze-contingent rendering,advertisement placement,and content-based design.To explore future gaze prediction,it is necessary to analyze the temporal continuity of visual attention in immersive virtual reality.Methods In this paper,the concept of temporal continuity of visual attention is presented.Subsequently,an autocorrelation function method is proposed to evaluate the temporal continuity.Thereafter,the temporal continuity is analyzed in both free-viewing and task-oriented conditions.Results Specifically,in free-viewing conditions,the analysis of a free-viewing gaze dataset indicates that the temporal continuity performs well only within a short time interval.A task-oriented game scene condition was created and conducted to collect users'gaze data.An analysis of the collected gaze data finds the temporal continuity has a similar performance with that of the free-viewing conditions.Temporal continuity can be applied to future gaze prediction and if it is good,users'current gaze positions can be directly utilized to predict their gaze positions in the future.Conclusions The current gaze's future prediction performances are further evaluated in both free-viewing and task-oriented conditions and discover that the current gaze can be efficiently applied to the task of short-term future gaze prediction.The task of long-term gaze prediction still remains to be explored.展开更多
Subjective visual vertical(SVV)and subjective visual horizontal(SVH)tests can be used to evaluate the perception of verticality and horizontality,respectively,and can aid the diagnosis of otolith dysfunction in clinic...Subjective visual vertical(SVV)and subjective visual horizontal(SVH)tests can be used to evaluate the perception of verticality and horizontality,respectively,and can aid the diagnosis of otolith dysfunction in clinical practice.In this study,SVV and SVH screen version tests are implemented using virtual reality(VR)equipment;the proposed test method promotes a more immersive feeling for the subject while using a simple equipment configuration and possessing excellent mobility.To verify the performance of the proposed VR-based SVV and SVH tests,a reliable comparison was made between the traditional screen-based SVV and SVH tests and the proposed method,based on 30 healthy subjects.The average results of our experimental tests on the VR-based binocular SVV and SVH equipment were−0.15◦±1.74 and 0.60◦±1.18,respectively.The proposed VR-based method satisfies the normal tolerance for horizontal or vertical lines,i.e.,a±3◦error,as defined in previous studies,and it can be used to replace existing test methods.展开更多
In this article, we present a three-dimensional visualization technique that has been developed in order to establish an interactive immersive environment to visualize the particles in granular materials and dislocati...In this article, we present a three-dimensional visualization technique that has been developed in order to establish an interactive immersive environment to visualize the particles in granular materials and dislocations in crystals. Simple elementary objects often exhibit complex collective behavior. Understanding of such behaviors and developments of coarse-scale theories, often requires insight into collective behavior that can only be obtained through immersive visualization. By displaying the computational results in a virtual environment with three-dimensional perception, one can immerse inside the model and analyze the intricate and very complex behavior of individual particles and dislocations. We built the stereographic images of the models using OpenGL rendering technique and then combine with the Virtual Reality technology in order to immerse in the three-dimensional model. A head mounted display has been used to allow the user to immerse inside the models and a flock of birds tracking device that allows the movements around and within the immersive environment.展开更多
Recently a ubiquitous sensor network which collects our environmental information gets increasingly popular, a visualization application is necessary for users to manage complicated wireless networks, however, these a...Recently a ubiquitous sensor network which collects our environmental information gets increasingly popular, a visualization application is necessary for users to manage complicated wireless networks, however, these applications are developed individually for wireless communication standard or a type of wireless device. Therefore, users are forced to adopt and use the application individually according to the target of the wireless network. In this paper, we propose a visualization platform for wireless network environments using augmented reality technology, and evaluate the effectiveness of the platform. From the result of the evaluation, we have confirmed the proposed platform has availability for visualization and management of wireless networks.展开更多
Background A task assigned to space exploration satellites involves detecting the physical environment within a certain space.However,space detection data are complex and abstract.These data are not conducive for rese...Background A task assigned to space exploration satellites involves detecting the physical environment within a certain space.However,space detection data are complex and abstract.These data are not conducive for researchers'visual perceptions of the evolution and interaction of events in the space environment.Methods A time-series dynamic data sampling method for large-scale space was proposed for sample detection data in space and time,and the corresponding relationships between data location features and other attribute features were established.A tone-mapping method based on statistical histogram equalization was proposed and applied to the final attribute feature data.The visualization process is optimized for rendering by merging materials,reducing the number of patches,and performing other operations.Results The results of sampling,feature extraction,and uniform visualization of the detection data of complex types,long duration spans,and uneven spatial distributions were obtained.The real-time visualization of large-scale spatial structures using augmented reality devices,particularly low-performance devices,was also investigated.Conclusions The proposed visualization system can reconstruct the three-dimensional structure of a large-scale space,express the structure and changes in the spatial environment using augmented reality,and assist in intuitively discovering spatial environmental events and evolutionary rules.展开更多
Objective The study of medicine formulas is a core component of traditional Chinese medicine(TCM),yet traditional learning methods often lack interactivity and contextual understanding,making it challenging for beginn...Objective The study of medicine formulas is a core component of traditional Chinese medicine(TCM),yet traditional learning methods often lack interactivity and contextual understanding,making it challenging for beginners to grasp the intricate composition rules of formulas.To address this gap,we introduce Formula-S,a situated visualization method for TCM formula learning in augmented reality(AR)and evaluate its performance.This study aims to evaluate the effectiveness of Formula-S in enhancing TCM formula learning for beginners by comparing it with traditional text-based formula learning and web-based visualization.Methods Formula-S is an interactive AR tool designed for TCM formula learning,featuring three modes(3D,Web,and Table).The dataset included TCM formulas and herb properties extracted from authoritative references,including textbook and the SymMap database.In Formula-S,the hierarchical visualization of the formulas as herbal medicine compositions,is linked to the multidimensional herb attribute visualization and embedded in the real world,where real herb samples are presented.To evaluate its effectiveness,a controlled study(n=30)was conducted.Participants who had no formal TCM knowledge were tasked with herbal medicine identification,formula composition,and recognition.In the study,participants interacted with the AR tool through HoloLens 2.Data were collected on both task performance(accuracy and response time)and user experience,with a focus on task efficiency,accuracy,and user preference across the different learning modes.Results The situated visualization method of Formula-S had comparable accuracy to other methods but shorter response time for herbal formula learning tasks.Regarding user experience,our new approach demonstrated the highest system usability and lowest task load,effectively reducing cognitive load and allowing users to complete tasks with greater ease and efficiency.Participants reported that Formula-S enhanced their learning experience through its intuitive interface and immersive AR environment,suggesting this approach offers usability advantages for TCM education.Conclusions The situated visualization method in Formula-S offers more efficient and accurate searching capabilities compared to traditional and web-based methods.Additionally,it provides superior contextual understanding of TCM formulas,making it a promising new solution for TCM learning.展开更多
The design process of the built environment relies on the collaborative effort of all parties involved in the project.During the design phase,owners,end users,and their representatives are expected to make the most cr...The design process of the built environment relies on the collaborative effort of all parties involved in the project.During the design phase,owners,end users,and their representatives are expected to make the most critical design and budgetary decisions-shaping the essential traits of the project,hence emerge the need and necessity to create and integrate mechanisms to support the decision-making process.Design decisions should not be based on assumptions,past experiences,or imagination.An example of the numerous problems that are a result of uninformed design decisions is“change orders”,known as the deviation from the original scope of work,which leads to an increase of the overall cost,and changes to the construction schedule of the project.The long-term aim of this inquiry is to understand the user’s behavior,and establish evidence-based control measures,which are actions and processes that can be implemented in practice to decrease the volume and frequency of the occurrence of change orders.The current study developed a foundation for further examination by proposing potential control measures,and testing their efficiency,such as integrating Virtual Reality(VR).The specific aim was to examine the effect of different visualization methods(i.e.,VR vs.construction drawings)on,(1)how well the subjects understand the information presented about the future/planned environment;(2)the subjects’perceived confidence in what the future environment will look like;(3)the likelihood of changing the built environment;(4)design review time;and(5)accuracy in reviewing and understanding the design.展开更多
This study aims to explore the application of digital technology in landscape design,focusing on the research of virtual reality visualization and interactive design in the process of plant configuration.Through an in...This study aims to explore the application of digital technology in landscape design,focusing on the research of virtual reality visualization and interactive design in the process of plant configuration.Through an in-depth analysis of digital technology,the study outlines its important role in landscape design,especially in the application of plant configuration.The current application status of virtual reality technology in landscape design is discussed,as well as how interactive design can enhance user experience and participation.Furthermore,the achievements and challenges of digital technology in landscape design are summarized.Finally,it proposes future research directions and suggestions,aiming to provide new ideas and methods for practice and research in the field of landscape design and promote the further application and development of digital technology in landscape design.展开更多
This article investigates virtual reality (VR)-based teleoperation with robustness against modeling errors. VR technology is an effective way to overcome the large time delay during space robot teleoperation. However,...This article investigates virtual reality (VR)-based teleoperation with robustness against modeling errors. VR technology is an effective way to overcome the large time delay during space robot teleoperation. However, it depends highly on the accuracy of model. Model errors between the virtual and real environment exist inevitably. The existing way to deal with the problem is by means of either model matching or robot compliance control. As distinct from the existing methods, this article tries to combine m...展开更多
目的采用文献计量学分析虚拟现实(virtual reality,VR)技术在医学教育领域的应用研究,探讨该领域的研究现况、热点和发展趋势等。方法检索2003年1月—2023年9月Web of Science核心合集数据库中VR技术应用于医学教育或教学中的相关文献,...目的采用文献计量学分析虚拟现实(virtual reality,VR)技术在医学教育领域的应用研究,探讨该领域的研究现况、热点和发展趋势等。方法检索2003年1月—2023年9月Web of Science核心合集数据库中VR技术应用于医学教育或教学中的相关文献,并运用CiteSpace 6.1.R6和VOSviewer 1.6.18等软件对发文国家/地区、机构、期刊、共同引用参考文献及关键词进行分析,并可视化科学知识图谱。结果共纳入文献1621篇,该领域自2018年后发文量迅速增长;美国在该领域的发展中起主导作用;中国的发文量居第五位,但影响力有待提高;研究热点主要包括手术模拟、技能训练、远程教学等。结论VR技术在医学教育领域的应用越来越受到重视,建议进一步加强对这一领域的探索,以期为未来的医学教育提供新的发展方向。展开更多
基金the Shanghai Municipal Education Commission-Gaofeng Clinical Medicine Grant(No.20172005)。
文摘Closed thoracic drainage can be performed using a steel-needle-guided chest tube to treat pleural effusion or pneumothorax in clinics.However,the puncture procedure during surgery is invisible,increasing the risk of surgical failure.Therefore,it is necessary to design a visualization system for closed thoracic drainage.Augmented reality(AR)technology can assist in visualizing the internal anatomical structure and determining the insertion point on the body surface.The structure of the currently used steel-needle-guided chest tube was modified by integrating it with an ultrafine diameter camera to provide real-time visualization of the puncture process.After simulation experiments,the overall registration error of the AR method was measured to be within(3.59±0.53)mm,indicating its potential for clinical application.The ultrafine diameter camera module and improved steel-needle-guided chest tube can timely reflect the position of the needle tip in the human body.A comparative experiment showed that video guidance could improve the safety of the puncture process compared to the traditional method.Finally,a qualitative evaluation of the usability of the system was conducted through a questionnaire.This system facilitates the visualization of closed thoracic drainage puncture procedure and pro-vides an implementation scheme to enhance the accuracy and safety of the operative step,which is conducive to reducing the learning curve and improving the proficiency of the doctors.
基金Supported by the Chinese Ministry of Education Online Education Research Foundation Key Project(No.2017ZD116)the College Teaching Guarantee Project(No.2018-4142Z6L)~~
文摘With the continuous progress of virtual simulation technology,medical surgery visualization system has been developed from two-dimensional to three-dimensional,from digital to network and intelligentization.The visualization system with mixed reality technology will also be used in all stage of medical surgery,such as case discussion,surgical planning,intraoperative guidance,post-operative evaluation,rehabilitation,so as to further promote high intelligence,high precision of medical surgery,and consequently improve effectiveness of treatment and quality of medical service.This paper discusses the composition and technical characteristics of medical operation visualization system based on mixed reality technology,and introduces some typical applications of mixed reality technology in medical operation visualization,which provides a new perspective for the application of mixed technology in medical surgery.
基金Project(2018YFB2101000) supported by the National Key R&D Program of ChinaProject(20YF1451400) supported by Shanghai Sailing Program,ChinaProject(SLDRCE19-A-14) supported by the Research Fund of State Key Laboratory for Disaster Reduction in Civil Engineering,China。
文摘Long-time driving and monotonous visual environment increase the safety risk of driving in an extra-long tunnel.Driving fatigue can be effectively relieved by setting the visual fatigue relief zone in the tunnel.However,the setting form of visual fatigue relief zone,such as its length and location,is difficult to be designed and quantified.By integrating virtual reality(VR)apparatus with wearable electroencephalogram(EEG)-based devices,a hybrid method was proposed in this study to assist analyzers to formulate the layout of visual fatigue relief zone in the extra-long tunnel.The virtual environment of this study was based on an 11.5 km extra-long tunnel located in Yunnan Province in China.The results indicated that the use of natural landscape decoration inside the tunnel could improve driving fatigue with the growth rate of attention of the driver increased by more than 20%.The accumulation of driving fatigue had a negative effect on the fatigue relief.The results demonstrated that the optimal location of the fatigue relief zone was at the place where driving fatigue had just occurred rather than at the place where a certain amount of driving fatigue had accumulated.
基金supported by the Global Change Research Program of China under Project 2012CB955603the Natural Science Foundation of China under Project 41076115+2 种基金the National Basic Research Program of China under Project 2009CB723903the Public Science and Technology Research Funds of the Ocean under Project 201005019the National High-Tech Research and Development Program of China under Project 2008AA121701
文摘In this study,a 3D virtual reality and visualization engine for rendering the ocean,named VV-Ocean,is designed for marine applications.The design goals of VV-Ocean aim at high fidelity simulation of ocean environment,visualization of massive and multidimensional marine data,and imitation of marine lives.VV-Ocean is composed of five modules,i.e.memory management module,resources management module,scene management module,rendering process management module and interaction management module.There are three core functions in VV-Ocean:reconstructing vivid virtual ocean scenes,visualizing real data dynamically in real time,imitating and simulating marine lives intuitively.Based on VV-Ocean,we establish a sea-land integration platform which can reproduce drifting and diffusion processes of oil spilling from sea bottom to surface.Environment factors such as ocean current and wind field have been considered in this simulation.On this platform oil spilling process can be abstracted as movements of abundant oil particles.The result shows that oil particles blend with water well and the platform meets the requirement for real-time and interactive rendering.VV-Ocean can be widely used in ocean applications such as demonstrating marine operations,facilitating maritime communications,developing ocean games,reducing marine hazards,forecasting the weather over oceans,serving marine tourism,and so on.Finally,further technological improvements of VV-Ocean are discussed.
文摘In the modern era,preoperative planning is substantially facilitated by artificial reality technologies,which permit a better understanding of patient anatomy,thus increasing the safety and accuracy of surgical interventions.In the field of orthopedic surgery,the increase in safety and accuracy improves treatment quality and orthopedic patient outcomes.Artificial reality technologies,which include virtual reality(VR),augmented reality(AR),and mixed reality(MR),use digital images obtained from computed tomography or magnetic resonance imaging.VR replaces the user’s physical environment with one that is computer generated.AR and MR have been defined as technologies that permit the fusing of the physical with the virtual environment,enabling the user to interact with both physical and virtual objects.MR has been defined as a technology that,in contrast to AR,enables users to visualize the depth and perspective of the virtual models.We aimed to shed light on the role that MR can play in the visualization of orthopedic surgical anatomy.The literature suggests that MR could be a valuable tool in orthopedic surgeon’s hands for visualization of the anatomy.However,we remark that confusion exists in the literature concerning the characteristics of MR.Thus,a more clear description of MR is needed in orthopedic research,so that the potential of this technology can be more deeply understood.
基金This work was supported by the National Science Foundation[grant numbers 1526520 to AK and 0711456 to PL].
文摘The availability and quantity of remotely sensed and terrestrial geospatial data sets are on the rise.Historically,these data sets have been analyzed and quarried on 2D desktop computers;however,immersive technologies and specifically immersive virtual reality(iVR)allow for the integration,visualization,analysis,and exploration of these 3D geospatial data sets.iVR can deliver remote and large-scale geospatial data sets to the laboratory,providing embodied experiences of field sites across the earth and beyond.We describe a workflow for the ingestion of geospatial data sets and the development of an iVR workbench,and present the application of these for an experience of Iceland’s Thrihnukar volcano where we:(1)combined satellite imagery with terrain elevation data to create a basic reconstruction of the physical site;(2)used terrestrial LiDAR data to provide a geo-referenced point cloud model of the magmatic-volcanic system,as well as the LiDAR intensity values for the identification of rock types;and(3)used Structure-from-Motion(SfM)to construct a photorealistic point cloud of the inside volcano.The workbench provides tools for the direct manipulation of the georeferenced data sets,including scaling,rotation,and translation,and a suite of geometric measurement tools,including length,area,and volume.Future developments will be inspired by an ongoing user study that formally evaluates the workbench’s mature components in the context of fieldwork and analyses activities.
基金the National Natural Science Foundation of China(No.11502146)。
文摘We aim to develop a novel visualization tool for percutaneous renal puncture training based on augmented reality(AR)and compare the needle placement performance of this AR system with ultrasound-guidedfreehand navigation in phantoms.A head-mounted display-based AR navigation system was developed usingthe Unity3D software and Visual Studio to enable the overlay of the preoperative needle path and the complexanatomical structures onto a phantom in real time.The spatial location of the stationary phantom and the percutaneous instrument motion were traced by a Qualisys motion capture system.To evaluate the tracking accuracy,15 participants(7 males and 8 females)performed a single needle insertion using AR navigation(the number ofpunctures n=75)and ultrasound-guided freehand navigation(n=75).The needle placement error was measuredas the Euclidean distance between the actual needle tip and the virtual target by MicronTracker.All participantsdemonstrated a superior needle insertion efficiency when using the AR-assisted puncture method compared withthe ultrasound-guided freehand method.The needle insertion error of the ultrasound-guided method showed anincreased error compared with the AR method(5.54 mm±2.59 mm,4.34 mm±2.10 mm,respectively,p<0.05).The ultrasound-guided needle placements showed an increased time compared with the AR method(19.08 s±3.59 s,15.14 s±2.72 s,respectively,p<0.0001).Our AR training system facilitates the needle placement performance and solves hand-eye coordination problems.The system has the potential to increase efficiency andeffectiveness of percutaneous renal puncture training.
基金the Fundamental Research Funds for the Central Universities(3102019PY004),a start-up funding from Northwestern Polytechnical University.
文摘Visual reality(VR)health-monitoring by flexible electronics provides a new avenue to remote and wearable medicine.The combination of flexible electronics and VR could facilitate smart remote disease diagnosis by real-time monitoring of the physiological signals and remote interaction between patient and physician.The flexible healthcare sensor is the most crucial unit in the flexible and wearable health-monitoring system,which has attracted much attention in recent years.This paper briefly reviews the progress in flexible healthcare sensors and VR healthcare devices.The flexible healthcare sensor is introduced with basic flexible materials,manufacturing techniques,and their applications in health-monitoring(such as blood/sweat detection and heart-rate tracking).VR healthcare devices for telemedicine diagnosis are discussed,and the smart remote diagnosis system using flexible and wearable healthcare sensors,and a VR device,is addressed.
基金Industrial Technology Development Program(JCKY2016204A502).
文摘Background To solve the problem of visualization in augmented reality(AR),for assembly process information,we report here on our study into the composition of AR assembly process information.Methods Our work led us to classify the visual elements of assembly processes into six categories,and after looking further into visual element expression characteristics used in assembly process information in the AR environment,standard assembly process elements have been identified and visual element layout principles studied.Conclusion Typical visualization elements have been presented,using an AR-based assembly instruction system.
基金the National Key R&D Program of China(2017 YFB 0203000)National Natural Science Foundation of China(61632003,61661146002,61631001).
文摘Background Eye tracking te chnology is receiving increased attention in the field of virtual reality.Specifically,future gaze prediction is crucial in pre-computation for many applications such as gaze-contingent rendering,advertisement placement,and content-based design.To explore future gaze prediction,it is necessary to analyze the temporal continuity of visual attention in immersive virtual reality.Methods In this paper,the concept of temporal continuity of visual attention is presented.Subsequently,an autocorrelation function method is proposed to evaluate the temporal continuity.Thereafter,the temporal continuity is analyzed in both free-viewing and task-oriented conditions.Results Specifically,in free-viewing conditions,the analysis of a free-viewing gaze dataset indicates that the temporal continuity performs well only within a short time interval.A task-oriented game scene condition was created and conducted to collect users'gaze data.An analysis of the collected gaze data finds the temporal continuity has a similar performance with that of the free-viewing conditions.Temporal continuity can be applied to future gaze prediction and if it is good,users'current gaze positions can be directly utilized to predict their gaze positions in the future.Conclusions The current gaze's future prediction performances are further evaluated in both free-viewing and task-oriented conditions and discover that the current gaze can be efficiently applied to the task of short-term future gaze prediction.The task of long-term gaze prediction still remains to be explored.
基金supported by the Soonchunhyang University Research Fund and 2018 Ulsan University Hospital Research Grant(UUH-2018-12)(Grantee:JYP,http://www.uuh.ulsan.kr).The authors are grateful for their supports.
文摘Subjective visual vertical(SVV)and subjective visual horizontal(SVH)tests can be used to evaluate the perception of verticality and horizontality,respectively,and can aid the diagnosis of otolith dysfunction in clinical practice.In this study,SVV and SVH screen version tests are implemented using virtual reality(VR)equipment;the proposed test method promotes a more immersive feeling for the subject while using a simple equipment configuration and possessing excellent mobility.To verify the performance of the proposed VR-based SVV and SVH tests,a reliable comparison was made between the traditional screen-based SVV and SVH tests and the proposed method,based on 30 healthy subjects.The average results of our experimental tests on the VR-based binocular SVV and SVH equipment were−0.15◦±1.74 and 0.60◦±1.18,respectively.The proposed VR-based method satisfies the normal tolerance for horizontal or vertical lines,i.e.,a±3◦error,as defined in previous studies,and it can be used to replace existing test methods.
文摘In this article, we present a three-dimensional visualization technique that has been developed in order to establish an interactive immersive environment to visualize the particles in granular materials and dislocations in crystals. Simple elementary objects often exhibit complex collective behavior. Understanding of such behaviors and developments of coarse-scale theories, often requires insight into collective behavior that can only be obtained through immersive visualization. By displaying the computational results in a virtual environment with three-dimensional perception, one can immerse inside the model and analyze the intricate and very complex behavior of individual particles and dislocations. We built the stereographic images of the models using OpenGL rendering technique and then combine with the Virtual Reality technology in order to immerse in the three-dimensional model. A head mounted display has been used to allow the user to immerse inside the models and a flock of birds tracking device that allows the movements around and within the immersive environment.
文摘Recently a ubiquitous sensor network which collects our environmental information gets increasingly popular, a visualization application is necessary for users to manage complicated wireless networks, however, these applications are developed individually for wireless communication standard or a type of wireless device. Therefore, users are forced to adopt and use the application individually according to the target of the wireless network. In this paper, we propose a visualization platform for wireless network environments using augmented reality technology, and evaluate the effectiveness of the platform. From the result of the evaluation, we have confirmed the proposed platform has availability for visualization and management of wireless networks.
文摘Background A task assigned to space exploration satellites involves detecting the physical environment within a certain space.However,space detection data are complex and abstract.These data are not conducive for researchers'visual perceptions of the evolution and interaction of events in the space environment.Methods A time-series dynamic data sampling method for large-scale space was proposed for sample detection data in space and time,and the corresponding relationships between data location features and other attribute features were established.A tone-mapping method based on statistical histogram equalization was proposed and applied to the final attribute feature data.The visualization process is optimized for rendering by merging materials,reducing the number of patches,and performing other operations.Results The results of sampling,feature extraction,and uniform visualization of the detection data of complex types,long duration spans,and uneven spatial distributions were obtained.The real-time visualization of large-scale spatial structures using augmented reality devices,particularly low-performance devices,was also investigated.Conclusions The proposed visualization system can reconstruct the three-dimensional structure of a large-scale space,express the structure and changes in the spatial environment using augmented reality,and assist in intuitively discovering spatial environmental events and evolutionary rules.
文摘Objective The study of medicine formulas is a core component of traditional Chinese medicine(TCM),yet traditional learning methods often lack interactivity and contextual understanding,making it challenging for beginners to grasp the intricate composition rules of formulas.To address this gap,we introduce Formula-S,a situated visualization method for TCM formula learning in augmented reality(AR)and evaluate its performance.This study aims to evaluate the effectiveness of Formula-S in enhancing TCM formula learning for beginners by comparing it with traditional text-based formula learning and web-based visualization.Methods Formula-S is an interactive AR tool designed for TCM formula learning,featuring three modes(3D,Web,and Table).The dataset included TCM formulas and herb properties extracted from authoritative references,including textbook and the SymMap database.In Formula-S,the hierarchical visualization of the formulas as herbal medicine compositions,is linked to the multidimensional herb attribute visualization and embedded in the real world,where real herb samples are presented.To evaluate its effectiveness,a controlled study(n=30)was conducted.Participants who had no formal TCM knowledge were tasked with herbal medicine identification,formula composition,and recognition.In the study,participants interacted with the AR tool through HoloLens 2.Data were collected on both task performance(accuracy and response time)and user experience,with a focus on task efficiency,accuracy,and user preference across the different learning modes.Results The situated visualization method of Formula-S had comparable accuracy to other methods but shorter response time for herbal formula learning tasks.Regarding user experience,our new approach demonstrated the highest system usability and lowest task load,effectively reducing cognitive load and allowing users to complete tasks with greater ease and efficiency.Participants reported that Formula-S enhanced their learning experience through its intuitive interface and immersive AR environment,suggesting this approach offers usability advantages for TCM education.Conclusions The situated visualization method in Formula-S offers more efficient and accurate searching capabilities compared to traditional and web-based methods.Additionally,it provides superior contextual understanding of TCM formulas,making it a promising new solution for TCM learning.
文摘The design process of the built environment relies on the collaborative effort of all parties involved in the project.During the design phase,owners,end users,and their representatives are expected to make the most critical design and budgetary decisions-shaping the essential traits of the project,hence emerge the need and necessity to create and integrate mechanisms to support the decision-making process.Design decisions should not be based on assumptions,past experiences,or imagination.An example of the numerous problems that are a result of uninformed design decisions is“change orders”,known as the deviation from the original scope of work,which leads to an increase of the overall cost,and changes to the construction schedule of the project.The long-term aim of this inquiry is to understand the user’s behavior,and establish evidence-based control measures,which are actions and processes that can be implemented in practice to decrease the volume and frequency of the occurrence of change orders.The current study developed a foundation for further examination by proposing potential control measures,and testing their efficiency,such as integrating Virtual Reality(VR).The specific aim was to examine the effect of different visualization methods(i.e.,VR vs.construction drawings)on,(1)how well the subjects understand the information presented about the future/planned environment;(2)the subjects’perceived confidence in what the future environment will look like;(3)the likelihood of changing the built environment;(4)design review time;and(5)accuracy in reviewing and understanding the design.
基金2023 Campus Scientific Research Fund of Chongqing Institute of Engineering(Project number:2023xsky03)2023 Education and Teaching Reform Research Project of Chongqing Institute of Engineering(Project number:JY2023214)2023 First-class Curriculum Construction Project of Chongqing Institute of Engineering(Project number:KC20230103)。
文摘This study aims to explore the application of digital technology in landscape design,focusing on the research of virtual reality visualization and interactive design in the process of plant configuration.Through an in-depth analysis of digital technology,the study outlines its important role in landscape design,especially in the application of plant configuration.The current application status of virtual reality technology in landscape design is discussed,as well as how interactive design can enhance user experience and participation.Furthermore,the achievements and challenges of digital technology in landscape design are summarized.Finally,it proposes future research directions and suggestions,aiming to provide new ideas and methods for practice and research in the field of landscape design and promote the further application and development of digital technology in landscape design.
基金National Natural Science Foundation of China (60675054)National High-Tech Research and Development Program (2006AA04Z228)"111" Project (B07018)
文摘This article investigates virtual reality (VR)-based teleoperation with robustness against modeling errors. VR technology is an effective way to overcome the large time delay during space robot teleoperation. However, it depends highly on the accuracy of model. Model errors between the virtual and real environment exist inevitably. The existing way to deal with the problem is by means of either model matching or robot compliance control. As distinct from the existing methods, this article tries to combine m...
