The widespread adoption of tunnel boring machines(TBMs)has led to an increased focus on disc cutter wear,including both normal and abnormal types,for efficient and safe TBM excavation.However,abnormal wear has yet to ...The widespread adoption of tunnel boring machines(TBMs)has led to an increased focus on disc cutter wear,including both normal and abnormal types,for efficient and safe TBM excavation.However,abnormal wear has yet to be thoroughly investigated,primarily due to the complexity of considering mixed ground conditions and the imbalance in the number of instances between the two types of wear.This study developed a prediction model for abnormal TBM disc cutter wear,considering mixed ground conditions,by employing interpretable machine learning with data augmentation.An equivalent elastic modulus was used to consider the characteristics of mixed ground conditions,and wear data was obtained from 65 cutterhead intervention(CHI)reports covering both mixed ground and hard rock sections.With a balanced training dataset obtained by data augmentation,an extreme gradient boosting(XGB)model delivered acceptable results with an accuracy of 0.94,an F1-score of 0.808,and a recall of 0.8.In addition,the accuracy for each individual disc cutter exhibited low variability.When employing data augmentation,a significant improvement in recall was observed compared to when it was not used,although the difference in accuracy and F1-score was marginal.The subsequent model interpretation revealed the chamber pressure,cutter installation radius,and torque as significant contributors.Specifically,a threshold in chamber pressure was observed,which could induce abnormal wear.The study also explored how elevated values of these influential contributors correlate with abnormal wear.The proposed model offers a valuable tool for planning the replacement of abnormally worn disc cutters,enhancing the safety and efficiency of TBM operations.展开更多
The development of digital intelligent diagnostic and treatment technology has opened countless new opportunities for liver surgery from the era of digital anatomy to a new era of digital diagnostics,virtual surgery s...The development of digital intelligent diagnostic and treatment technology has opened countless new opportunities for liver surgery from the era of digital anatomy to a new era of digital diagnostics,virtual surgery simulation and using the created scenarios in real-time surgery using mixed reality.In this article,we described our experience on developing a dedicated 3 dimensional visualization and reconstruction software for surgeons to be used in advanced liver surgery and living donor liver transplantation.Furthermore,we shared the recent developments in the field by explaining the outreach of the software from virtual reality to augmented reality and mixed reality.展开更多
On the basis of composition duality principles, augmented three-field macrohybrid mixed variational problems and finite element schemes are analyzed. The compatibility condition adopted here, for compositional dualiza...On the basis of composition duality principles, augmented three-field macrohybrid mixed variational problems and finite element schemes are analyzed. The compatibility condition adopted here, for compositional dualization, is the coupling operator surjectivity, property that expresses in a general operator sense the Ladysenskaja-Babulka-Brezzi inf-sup condition. Variational macro-hybridization is performed under the assumption of decomposable primal and dual spaces relative to nonoverlapping domain decompositions. Then, through compositional dualization macro-hybrid mixed problems are obtained, with internal boundary dual traces as Lagrange multipliers. Also, ＂mass＂ preconditioned aug- mentation of three-field formulations are derived, stabilizing macro-hybrid mixed finite element schemes and rendering possible speed up of rates of convergence. Dual mixed incompressible Darcy flow problems illustrate the theory throughout the paper.展开更多
Augmented-and mixed-reality technologies have pioneered the realization of real-time fusion and interactive projection for laparoscopic surgeries.Indocyanine green fluorescence imaging technology has enabled anatomica...Augmented-and mixed-reality technologies have pioneered the realization of real-time fusion and interactive projection for laparoscopic surgeries.Indocyanine green fluorescence imaging technology has enabled anatomical,functional,and radical hepatectomy through tumor identification and localization of target hepatic segments,driving a transformative shift in themanagement of hepatic surgical diseases,moving away from traditional,empirical diagnostic and treatment approaches toward digital,intelligent ones.The Hepatic Surgery Group of the Surgery Branch of the Chinese Medical Association,Digital Medicine Branch of the Chinese Medical Association,Digital Intelligent Surgery Committee of the Chinese Society of ResearchHospitals,and Liver Cancer Committee of the Chinese Medical Doctor Association organized the relevant experts in China to formulate this consensus.This consensus provides a comprehensive outline of the principles,advantages,processes,and key considerations associated with the application of augmented reality and mixed-reality technology combined with indocyanine green fluorescence imaging technology for hepatic segmental and subsegmental resection.The purpose is to streamline and standardize the application of these technologies.展开更多
A precise knowledge of intra-parenchymal vascular and biliary architecture and the location of lesions in relation to the complex anatomy is indispensable to perform liver surgery.Therefore,virtual three-dimensional(3...A precise knowledge of intra-parenchymal vascular and biliary architecture and the location of lesions in relation to the complex anatomy is indispensable to perform liver surgery.Therefore,virtual three-dimensional(3D)-reconstruction models from computed tomography/magnetic resonance imaging scans of the liver might be helpful for visualization.Augmented reality,mixed reality and 3Dnavigation could transfer such 3D-image data directly into the operation theater to support the surgeon.This review examines the literature about the clinical and intraoperative use of these image guidance techniques in liver surgery and provides the reader with the opportunity to learn about these techniques.Augmented reality and mixed reality have been shown to be feasible for the use in open and minimally invasive liver surgery.3D-navigation facilitated targeting of intraparenchymal lesions.The existing data is limited to small cohorts and description about technical details e.g.,accordance between the virtual 3D-model and the real liver anatomy.Randomized controlled trials regarding clinical data or oncological outcome are not available.Up to now there is no intraoperative application of artificial intelligence in liver surgery.The usability of all these sophisticated image guidance tools has still not reached the grade of immersion which would be necessary for a widespread use in the daily surgical routine.Although there are many challenges,augmented reality,mixed reality,3Dnavigation and artificial intelligence are emerging fields in hepato-biliary surgery.展开更多
Augmented reality(AR)and virtual reality(VR)are two novel display technologies that are under updates.The essential feature of AR/VR is the full-color display that requires high pixel densities.To generate three-color...Augmented reality(AR)and virtual reality(VR)are two novel display technologies that are under updates.The essential feature of AR/VR is the full-color display that requires high pixel densities.To generate three-color pixels,the fluorescent color conversion layer inevitably includes green and red pixels.To fabricate such sort of display kits,inkjet printing is a promising way to position the color conversion layers.In this review article,the progress of AR/VR technologies is first reviewed,and in succession,the state of the art of inkjet printing,as well as two key issues-the optimization of ink and the reduction of coffee-ring effects,are introduced.Finally,some potential problems associated with the color converting layer are highlighted.展开更多
Background Mixed-reality technologies,including virtual reality(VR)and augmented reality(AR),are considered to be promising potential tools for science teaching and learning processes that could foster positive emotio...Background Mixed-reality technologies,including virtual reality(VR)and augmented reality(AR),are considered to be promising potential tools for science teaching and learning processes that could foster positive emotions,motivate autonomous learning,and improve learning outcomes.Methods In this study,a technology-aided biological microscope learning system based on VR/AR is presented.The structure of the microscope is described in a detailed three-dimensional(3D)model,each component being represented with their topological interrelationships and associations among them being established.The interactive behavior of the model was specified,and a standard operating guide was compiled.The motion control of components was simulated based on collision detection.Combined with immersive VR equipment and AR technology,we developed a virtual microscope subsystem and a mobile virtual microscope guidance system.Results The system consisted of a VR subsystem and an AR subsystem.The focus of the VR subsystem was to simulate operating the microscope and associated interactive behaviors that allowed users to observe and operate the components of the 3D microscope model by means of natural interactions in an immersive scenario.The AR subsystem allowed participants to use a mobile terminal that took a picture of a microscope from a textbook and then displayed the structure and functions of the instrument,as well as the relevant operating guidance.This flexibly allowed students to use the system before or after class without time and space constraints.The system allowed users to switch between the VR and AR subsystems.Conclusions The system is useful for helping learners(especially K-12 students)to recognize a microscope's structure and grasp the required operational skills by simulating operations using an interactive process.In the future,such technology-assisted education would be a successful learning platform in an open learning space.展开更多
Background Gesture is a basic interaction channel that is frequently used by humans to communicate in daily life. In this paper, we explore to use gesture-based approaches for target acquisition in virtual and augment...Background Gesture is a basic interaction channel that is frequently used by humans to communicate in daily life. In this paper, we explore to use gesture-based approaches for target acquisition in virtual and augmented reality. A typical process of gesture-based target acquisition is: when a user intends to acquire a target, she performs a gesture with her hands, head or other parts of the body, the computer senses and recognizes the gesture and infers the most possible target. Methods We build mental model and behavior model of the user to study two key parts of the interaction process. Mental model describes how user thinks up a gesture for acquiring a target, and can be the intuitive mapping between gestures and targets. Behavior model describes how user moves the body parts to perform the gestures, and the relationship between the gesture that user intends to perform and signals that computer senses. Results In this paper, we present and discuss three pieces of research that focus on the mental model and behavior model of gesture-based target acquisition in VR and AR. Conclusions We show that leveraging these two models, interaction experience and performance can be improved in VR and AR environments.展开更多
The rapid evolution of virtual reality(VR)and augmented reality(AR)technologies has significantly transformed human-computer interaction,with applications spanning entertainment,education,healthcare,industry,and remot...The rapid evolution of virtual reality(VR)and augmented reality(AR)technologies has significantly transformed human-computer interaction,with applications spanning entertainment,education,healthcare,industry,and remote collaboration.A central challenge in these immersive systems lies in enabling intuitive,efficient,and natural interactions.Hand gesture recognition offers a compelling solution by leveraging the expressiveness of human hands to facilitate seamless control without relying on traditional input devices such as controllers or keyboards,which can limit immersion.However,achieving robust gesture recognition requires overcoming challenges related to accurate hand tracking,complex environmental conditions,and minimizing system latency.This study proposes an artificial intelligence(AI)-driven framework for recognizing both static and dynamic hand gestures in VR and AR environments using skeleton-based tracking compliant with the OpenXR standard.Our approach employs a lightweight neural network architecture capable of real-time classification within approximately 1.3mswhilemaintaining average accuracy of 95%.We also introduce a novel dataset generation method to support training robust models and demonstrate consistent classification of diverse gestures across widespread commercial VR devices.This work represents one of the first studies to implement and validate dynamic hand gesture recognition in real time using standardized VR hardware,laying the groundwork for more immersive,accessible,and user-friendly interaction systems.By advancing AI-driven gesture interfaces,this research has the potential to broaden the adoption of VR and AR across diverse domains and enhance the overall user experience.展开更多
This paper proposes virtual impedance adaptation of the lower-limb exoskeleton for human performance augmentation(LEHPA) based on deep reinforcement learning(VIADRL) to mitigate reliance on model accuracy and address ...This paper proposes virtual impedance adaptation of the lower-limb exoskeleton for human performance augmentation(LEHPA) based on deep reinforcement learning(VIADRL) to mitigate reliance on model accuracy and address the ever-changing human-exoskeleton interaction(HEI) dynamics. The classical sensitivity amplification control strategy is expanded to the virtual impedance control strategy with more learnable virtual impedance parameters. The adjustment of these virtual impedance parameters is formalized as finding the optimal policy for a Markov Decision Process and can then be effectively resolved using deep reinforcement learning algorithms. To ensure safe and efficient policy training, a multibody simulation environment is established to facilitate the training process, supplemented by the innovative hybrid inverse-forward dynamics simulation approach for executing the simulation. For comparison purposes, the SADRL strategy is introduced as a benchmark. A novel control performance evaluation method based on the HEI forces at the back, thighs, and shanks is proposed to quantitatively evaluate the performance of our proposed VIADRL strategy. The VIADRL controller is systematically compared with the SADRL controller at five selected walking speeds. The lumped ratio of HEI forces under the SADRL strategy relative to those under the SADRL strategy is as low as 0.81 in simulation and approximately 0.89 on the LEHPA prototype. The overall reduction of HEI forces demonstrates the superiority of the VIADRL strategy in comparison to the SADRL strategy.展开更多
Objective:This study aimed to explore the applications of three-dimensional (3D) technology, including virtual reality, augmented reality (AR), and 3D printing system, in the field of medicine, particularly in renal i...Objective:This study aimed to explore the applications of three-dimensional (3D) technology, including virtual reality, augmented reality (AR), and 3D printing system, in the field of medicine, particularly in renal interventions for cancer treatment.Methods:A specialized software transforms 2D medical images into precise 3D digital models, facilitating improved anatomical understanding and surgical planning. Patient-specific 3D printed anatomical models are utilized for preoperative planning, intraoperative guidance, and surgical education. AR technology enables the overlay of digital perceptions onto real-world surgical environments.Results:Patient-specific 3D printed anatomical models have multiple applications, such as preoperative planning, intraoperative guidance, trainee education, and patient counseling. Virtual reality involves substituting the real world with a computer-generated 3D environment, while AR overlays digitally created perceptions onto the existing reality. The advances in 3D modeling technology have sparked considerable interest in their application to partial nephrectomy in the realm of renal cancer. 3D printing, also known as additive manufacturing, constructs 3D objects based on computer-aided design or digital 3D models. Utilizing 3D-printed preoperative renal models provides benefits for surgical planning, offering a more reliable assessment of the tumor's relationship with vital anatomical structures and enabling better preparation for procedures. AR technology allows surgeons to visualize patient-specific renal anatomical structures and their spatial relationships with surrounding organs by projecting CT/MRI images onto a live laparoscopic video. Incorporating patient-specific 3D digital models into healthcare enhances best practice, resulting in improved patient care, increased patient satisfaction, and cost saving for the healthcare system.展开更多
To effectively simulate the fracture propagation in shale,the bedding plane(BP)effect is incorporated into the augmented virtual internal bond(AVIB)constitutive relation through BP tensor.Comparing the BP-embedded AVI...To effectively simulate the fracture propagation in shale,the bedding plane(BP)effect is incorporated into the augmented virtual internal bond(AVIB)constitutive relation through BP tensor.Comparing the BP-embedded AVIB with the theory of transverse isotropy,it is found the approach can represent the anisotropic properties induced by parallel BPs.Through the simulation example,it is found that this method can simulate the stiffness anisotropy of shale and can represent the effect of BPs on hydraulic fracture propagation direction.Compared with the BP-embedded virtual internal bond(VIB),this method can account for the various Poisson’s ratio.It provides a feasible approach to simulate the fracture propagation in shale.展开更多
Dear Editor,This letter investigates the problem of multi-dimension formation tracking(MDFT)for the cross-domain unmanned systems,including several interconnected agents,namely,unmanned aerial vehicles(UAVs)and unmann...Dear Editor,This letter investigates the problem of multi-dimension formation tracking(MDFT)for the cross-domain unmanned systems,including several interconnected agents,namely,unmanned aerial vehicles(UAVs)and unmanned surface vehicles(USVs).We assume that each agent suffers from by the mixed constraints on its velocity,control input and Euler angle.Solving the MDFT problem implies that 1)The virtual state of each USV is determined in the earth coordinate by expanding its 2D work space to the 3D space.展开更多
Virtual Reality (VR) and Mixed Reality (MR) offer unique opportunities for the architecture and construction industry through different approaches with building information modeling (BIM). While VR offers architecture...Virtual Reality (VR) and Mixed Reality (MR) offer unique opportunities for the architecture and construction industry through different approaches with building information modeling (BIM). While VR offers architecture and construction practitioners the ability to personally experience the built environment in an immersive, MR with its unique ability of overlaying digital information in the real world allows practitioners to perform on-site visualization for construction planning and as-built verification. With their similar but distinct characteristics, VR and MR offer a variety of functionality to the architecture and construction industry that often confuses practitioners on what to choose to best fit their needs. To clarify this confusion, this paper investigates the available technologies of VR and MR in terms of both hardware and software and compares the functionality between the two for architecture and construction uses. While VR hardware has been developed into three categories based on their connection types and tracking methods, MR hardware has mainly focused on standalone devices. Eight VR software and nine MR software have been identified, investigated, and compared. This paper provides the latest information for architecture and construction practitioners on how VR and MR hardware and software work similarly and differently.展开更多
Virtual reality(VR)and augmented reality(AR)technologies have become increasingly important instruments in the field of art education as information technology develops quickly,transforming the conventional art educat...Virtual reality(VR)and augmented reality(AR)technologies have become increasingly important instruments in the field of art education as information technology develops quickly,transforming the conventional art education approach.The present situation,benefits,difficulties,and potential development tendencies of VR and AR technologies in art education will be investigated in this study.By means of literature analysis and case studies,this paper presents the fundamental ideas of VR and AR technologies together with their several uses in art education,namely virtual museums,interactive art production,art history instruction,and distant art cooperation.The research examines how these technologies might improve students’immersion,raise their learning motivation,and encourage innovative ideas and multidisciplinary cooperation.Practical application concerns including technology costs,content production obstacles,user acceptance,privacy,and ethical questions also come under discussion.At last,the article offers ideas and suggestions to help VR and AR technologies be effectively integrated into art education through teacher training,curriculum design,technology infrastructure development,and multidisciplinary cooperation.This study offers useful advice for teachers of art as well as important references for legislators and technology developers working together to further the creative growth of art education.展开更多
This study comprehensively reviews the literature to deeply explore the role of computer science and internet technologies in addressing educational inequality and socio-psychological issues,with a particular focus on...This study comprehensively reviews the literature to deeply explore the role of computer science and internet technologies in addressing educational inequality and socio-psychological issues,with a particular focus on applications of 5G,artificial intelligence(AI),and augmented/virtual reality(AR/VR).By analyzing how these technologies are reshaping learning and their potential to ameliorate educational disparities,the study reveals challenges present in ensuring educational equity.The research methodology includes exhaustive reviews of applications of AI and machine learning,the Internet of Things and wearable technologies integration,big data analytics and data mining,and the effects of online platforms and social media on socio-psychological issues.Besides,the study discusses applications of these technologies in educational inequality and socio-psychological problem-solving through the lens of 5G,AI,and AR/VR,while also delineating challenges faced by these emerging technologies and future outlooks.The study finds that while computer science and internet technologies hold promise to bridge academic divides and address socio-psychological problems,the complexity of technology access and infrastructure,lack of digital literacy and skills,and critical ethical and privacy issues can impact widespread adoption and efficacy.Overall,the study provides a novel perspective to understand the potential of computer science and internet technologies in ameliorating educational inequality and socio-psychological issues,while pointing to new directions for future research.It also emphasizes the importance of cooperation among educational institutions,technology vendors,policymakers and researchers,and establishing comprehensive ethical guidelines and regulations to ensure the responsible use of these technologies.展开更多
Mixed reality(MR)technology is a new digital holographic image technology,which appears in the field of graphics after virtual reality(VR)and augmented reality(AR)technology,a new interdisciplinary frontier.As a new g...Mixed reality(MR)technology is a new digital holographic image technology,which appears in the field of graphics after virtual reality(VR)and augmented reality(AR)technology,a new interdisciplinary frontier.As a new generation of technology,MR has attracted great attention of clinicians in recent years.The emergence of MR will bring about revolutionary changes in medical education training,medical research,medical communication,and clinical treatment.At present,MR technology has become the popular frontline information technology for medical applications.With the popularization of digital technology in the medical field,the development prospects of MR are inestimable.The purpose of this review article is to introduce the application of MR technology in the medical field and prospect its trend in the future.展开更多
Due to the narrowness of space and the complexity of structure,the assembly of aircraft cabin has become one of the major bottlenecks in the whole manufacturing process.To solve the problem,at the beginning of aircraf...Due to the narrowness of space and the complexity of structure,the assembly of aircraft cabin has become one of the major bottlenecks in the whole manufacturing process.To solve the problem,at the beginning of aircraft design,the different stages of the lifecycle of aircraft must be thought about,which include the trial manufacture,assembly,maintenance,recycling and destruction of the product.Recently,thanks to the development of the virtual reality and augmented reality,some low-cost and fast solutions are found for the product assembly.This paper presents a mixed reality-based interactive technology for the aircraft cabin assembly,which can enhance the efficiency of the assemblage in a virtual environment in terms of vision,information and operation.In the mixed reality-based assembly environment,the physical scene can be obtained by a camera and then generated by a computer.The virtual parts,the features of visual assembly,the navigation information,the physical parts and the physical assembly environment will be mixed and presented in the same assembly scene.The mixed or the augmented information will provide some assembling information as a detailed assembly instruction in the mixed reality-based assembly environment.Constraint proxy and its match rules help to reconstruct and visualize the restriction relationship among different parts,and to avoid the complex calculation of constraint's match.Finally,a desktop prototype system of virtual assembly has been built to assist the assembly verification and training with the virtual hand.展开更多
The massive technological advancements around the world have created significant challenging competition among companies where each of the companies tries to attract the customers using different techniques. One of th...The massive technological advancements around the world have created significant challenging competition among companies where each of the companies tries to attract the customers using different techniques. One of the recent tech- niques is Augmented Reality (AR). The AR is a new technology which is capable of presenting possibilities that are difficult for other technologies to offer and meet. Nowadays, numerous augmented reality applications have been used in the industry of different kinds and disseminated all over the world. AR will really alter the way individuals view the world. The AR is yet in its initial phases of research and development at different colleges and high-tech institutes. Throughout the last years, AR apps became transportable and generally available on various devices. Besides, AR be- gins to occupy its place in our audio-visual media and to be used in various fields in our life in tangible and exciting ways such as news, sports and is used in many domains in our life such as electronic commerce, promotion, design, and business. In addition, AR is used to facilitate the learning whereas it enables students to access location-specific infor- mation provided through various sources. Such growth and spread of AR applications pushes organizations to compete one another, every one of them exerts its best to gain the customers. This paper provides a comprehensive study of AR including its history, architecture, applications, current challenges and future trends.展开更多
In the modern era,preoperative planning is substantially facilitated by artificial reality technologies,which permit a better understanding of patient anatomy,thus increasing the safety and accuracy of surgical interv...In the modern era,preoperative planning is substantially facilitated by artificial reality technologies,which permit a better understanding of patient anatomy,thus increasing the safety and accuracy of surgical interventions.In the field of orthopedic surgery,the increase in safety and accuracy improves treatment quality and orthopedic patient outcomes.Artificial reality technologies,which include virtual reality(VR),augmented reality(AR),and mixed reality(MR),use digital images obtained from computed tomography or magnetic resonance imaging.VR replaces the user’s physical environment with one that is computer generated.AR and MR have been defined as technologies that permit the fusing of the physical with the virtual environment,enabling the user to interact with both physical and virtual objects.MR has been defined as a technology that,in contrast to AR,enables users to visualize the depth and perspective of the virtual models.We aimed to shed light on the role that MR can play in the visualization of orthopedic surgical anatomy.The literature suggests that MR could be a valuable tool in orthopedic surgeon’s hands for visualization of the anatomy.However,we remark that confusion exists in the literature concerning the characteristics of MR.Thus,a more clear description of MR is needed in orthopedic research,so that the potential of this technology can be more deeply understood.展开更多
基金support of the“National R&D Project for Smart Construction Technology (Grant No.RS-2020-KA157074)”funded by the Korea Agency for Infrastructure Technology Advancement under the Ministry of Land,Infrastructure and Transport,and managed by the Korea Expressway Corporation.
文摘The widespread adoption of tunnel boring machines(TBMs)has led to an increased focus on disc cutter wear,including both normal and abnormal types,for efficient and safe TBM excavation.However,abnormal wear has yet to be thoroughly investigated,primarily due to the complexity of considering mixed ground conditions and the imbalance in the number of instances between the two types of wear.This study developed a prediction model for abnormal TBM disc cutter wear,considering mixed ground conditions,by employing interpretable machine learning with data augmentation.An equivalent elastic modulus was used to consider the characteristics of mixed ground conditions,and wear data was obtained from 65 cutterhead intervention(CHI)reports covering both mixed ground and hard rock sections.With a balanced training dataset obtained by data augmentation,an extreme gradient boosting(XGB)model delivered acceptable results with an accuracy of 0.94,an F1-score of 0.808,and a recall of 0.8.In addition,the accuracy for each individual disc cutter exhibited low variability.When employing data augmentation,a significant improvement in recall was observed compared to when it was not used,although the difference in accuracy and F1-score was marginal.The subsequent model interpretation revealed the chamber pressure,cutter installation radius,and torque as significant contributors.Specifically,a threshold in chamber pressure was observed,which could induce abnormal wear.The study also explored how elevated values of these influential contributors correlate with abnormal wear.The proposed model offers a valuable tool for planning the replacement of abnormally worn disc cutters,enhancing the safety and efficiency of TBM operations.
文摘The development of digital intelligent diagnostic and treatment technology has opened countless new opportunities for liver surgery from the era of digital anatomy to a new era of digital diagnostics,virtual surgery simulation and using the created scenarios in real-time surgery using mixed reality.In this article,we described our experience on developing a dedicated 3 dimensional visualization and reconstruction software for surgeons to be used in advanced liver surgery and living donor liver transplantation.Furthermore,we shared the recent developments in the field by explaining the outreach of the software from virtual reality to augmented reality and mixed reality.
文摘On the basis of composition duality principles, augmented three-field macrohybrid mixed variational problems and finite element schemes are analyzed. The compatibility condition adopted here, for compositional dualization, is the coupling operator surjectivity, property that expresses in a general operator sense the Ladysenskaja-Babulka-Brezzi inf-sup condition. Variational macro-hybridization is performed under the assumption of decomposable primal and dual spaces relative to nonoverlapping domain decompositions. Then, through compositional dualization macro-hybrid mixed problems are obtained, with internal boundary dual traces as Lagrange multipliers. Also, ＂mass＂ preconditioned aug- mentation of three-field formulations are derived, stabilizing macro-hybrid mixed finite element schemes and rendering possible speed up of rates of convergence. Dual mixed incompressible Darcy flow problems illustrate the theory throughout the paper.
基金National Key Research and Development Program(2016YFC0106500800)NationalMajor Scientific Instruments and Equipments Development Project of National Natural Science Foundation of China(81627805)+3 种基金National Natural Science Foundation of China-Guangdong Joint Fund Key Program(U1401254)National Natural Science Foundation of China Mathematics Tianyuan Foundation(12026602)Guangdong Provincial Natural Science Foundation Team Project(6200171)Guangdong Provincial Health Appropriate Technology Promotion Project(20230319214525105,20230322152307666).
文摘Augmented-and mixed-reality technologies have pioneered the realization of real-time fusion and interactive projection for laparoscopic surgeries.Indocyanine green fluorescence imaging technology has enabled anatomical,functional,and radical hepatectomy through tumor identification and localization of target hepatic segments,driving a transformative shift in themanagement of hepatic surgical diseases,moving away from traditional,empirical diagnostic and treatment approaches toward digital,intelligent ones.The Hepatic Surgery Group of the Surgery Branch of the Chinese Medical Association,Digital Medicine Branch of the Chinese Medical Association,Digital Intelligent Surgery Committee of the Chinese Society of ResearchHospitals,and Liver Cancer Committee of the Chinese Medical Doctor Association organized the relevant experts in China to formulate this consensus.This consensus provides a comprehensive outline of the principles,advantages,processes,and key considerations associated with the application of augmented reality and mixed-reality technology combined with indocyanine green fluorescence imaging technology for hepatic segmental and subsegmental resection.The purpose is to streamline and standardize the application of these technologies.
文摘A precise knowledge of intra-parenchymal vascular and biliary architecture and the location of lesions in relation to the complex anatomy is indispensable to perform liver surgery.Therefore,virtual three-dimensional(3D)-reconstruction models from computed tomography/magnetic resonance imaging scans of the liver might be helpful for visualization.Augmented reality,mixed reality and 3Dnavigation could transfer such 3D-image data directly into the operation theater to support the surgeon.This review examines the literature about the clinical and intraoperative use of these image guidance techniques in liver surgery and provides the reader with the opportunity to learn about these techniques.Augmented reality and mixed reality have been shown to be feasible for the use in open and minimally invasive liver surgery.3D-navigation facilitated targeting of intraparenchymal lesions.The existing data is limited to small cohorts and description about technical details e.g.,accordance between the virtual 3D-model and the real liver anatomy.Randomized controlled trials regarding clinical data or oncological outcome are not available.Up to now there is no intraoperative application of artificial intelligence in liver surgery.The usability of all these sophisticated image guidance tools has still not reached the grade of immersion which would be necessary for a widespread use in the daily surgical routine.Although there are many challenges,augmented reality,mixed reality,3Dnavigation and artificial intelligence are emerging fields in hepato-biliary surgery.
基金supported by the National Natural Science Foundation of China (11904302)the Fundamental Research Funds for the Central Universities (Grant No.20720190005)+1 种基金the Major Science and Technology Project of Xiamen in China (3502Z20191015)Hong Kong University of Science and Technology-Foshan Joint Research Program (FSUST19-FYTRI11)
文摘Augmented reality(AR)and virtual reality(VR)are two novel display technologies that are under updates.The essential feature of AR/VR is the full-color display that requires high pixel densities.To generate three-color pixels,the fluorescent color conversion layer inevitably includes green and red pixels.To fabricate such sort of display kits,inkjet printing is a promising way to position the color conversion layers.In this review article,the progress of AR/VR technologies is first reviewed,and in succession,the state of the art of inkjet printing,as well as two key issues-the optimization of ink and the reduction of coffee-ring effects,are introduced.Finally,some potential problems associated with the color converting layer are highlighted.
基金the National Key Research and Development Program of China(2018YFB1004905).
文摘Background Mixed-reality technologies,including virtual reality(VR)and augmented reality(AR),are considered to be promising potential tools for science teaching and learning processes that could foster positive emotions,motivate autonomous learning,and improve learning outcomes.Methods In this study,a technology-aided biological microscope learning system based on VR/AR is presented.The structure of the microscope is described in a detailed three-dimensional(3D)model,each component being represented with their topological interrelationships and associations among them being established.The interactive behavior of the model was specified,and a standard operating guide was compiled.The motion control of components was simulated based on collision detection.Combined with immersive VR equipment and AR technology,we developed a virtual microscope subsystem and a mobile virtual microscope guidance system.Results The system consisted of a VR subsystem and an AR subsystem.The focus of the VR subsystem was to simulate operating the microscope and associated interactive behaviors that allowed users to observe and operate the components of the 3D microscope model by means of natural interactions in an immersive scenario.The AR subsystem allowed participants to use a mobile terminal that took a picture of a microscope from a textbook and then displayed the structure and functions of the instrument,as well as the relevant operating guidance.This flexibly allowed students to use the system before or after class without time and space constraints.The system allowed users to switch between the VR and AR subsystems.Conclusions The system is useful for helping learners(especially K-12 students)to recognize a microscope's structure and grasp the required operational skills by simulating operations using an interactive process.In the future,such technology-assisted education would be a successful learning platform in an open learning space.
文摘Background Gesture is a basic interaction channel that is frequently used by humans to communicate in daily life. In this paper, we explore to use gesture-based approaches for target acquisition in virtual and augmented reality. A typical process of gesture-based target acquisition is: when a user intends to acquire a target, she performs a gesture with her hands, head or other parts of the body, the computer senses and recognizes the gesture and infers the most possible target. Methods We build mental model and behavior model of the user to study two key parts of the interaction process. Mental model describes how user thinks up a gesture for acquiring a target, and can be the intuitive mapping between gestures and targets. Behavior model describes how user moves the body parts to perform the gestures, and the relationship between the gesture that user intends to perform and signals that computer senses. Results In this paper, we present and discuss three pieces of research that focus on the mental model and behavior model of gesture-based target acquisition in VR and AR. Conclusions We show that leveraging these two models, interaction experience and performance can be improved in VR and AR environments.
基金supported by research fund from Chosun University,2024.
文摘The rapid evolution of virtual reality(VR)and augmented reality(AR)technologies has significantly transformed human-computer interaction,with applications spanning entertainment,education,healthcare,industry,and remote collaboration.A central challenge in these immersive systems lies in enabling intuitive,efficient,and natural interactions.Hand gesture recognition offers a compelling solution by leveraging the expressiveness of human hands to facilitate seamless control without relying on traditional input devices such as controllers or keyboards,which can limit immersion.However,achieving robust gesture recognition requires overcoming challenges related to accurate hand tracking,complex environmental conditions,and minimizing system latency.This study proposes an artificial intelligence(AI)-driven framework for recognizing both static and dynamic hand gestures in VR and AR environments using skeleton-based tracking compliant with the OpenXR standard.Our approach employs a lightweight neural network architecture capable of real-time classification within approximately 1.3mswhilemaintaining average accuracy of 95%.We also introduce a novel dataset generation method to support training robust models and demonstrate consistent classification of diverse gestures across widespread commercial VR devices.This work represents one of the first studies to implement and validate dynamic hand gesture recognition in real time using standardized VR hardware,laying the groundwork for more immersive,accessible,and user-friendly interaction systems.By advancing AI-driven gesture interfaces,this research has the potential to broaden the adoption of VR and AR across diverse domains and enhance the overall user experience.
文摘This paper proposes virtual impedance adaptation of the lower-limb exoskeleton for human performance augmentation(LEHPA) based on deep reinforcement learning(VIADRL) to mitigate reliance on model accuracy and address the ever-changing human-exoskeleton interaction(HEI) dynamics. The classical sensitivity amplification control strategy is expanded to the virtual impedance control strategy with more learnable virtual impedance parameters. The adjustment of these virtual impedance parameters is formalized as finding the optimal policy for a Markov Decision Process and can then be effectively resolved using deep reinforcement learning algorithms. To ensure safe and efficient policy training, a multibody simulation environment is established to facilitate the training process, supplemented by the innovative hybrid inverse-forward dynamics simulation approach for executing the simulation. For comparison purposes, the SADRL strategy is introduced as a benchmark. A novel control performance evaluation method based on the HEI forces at the back, thighs, and shanks is proposed to quantitatively evaluate the performance of our proposed VIADRL strategy. The VIADRL controller is systematically compared with the SADRL controller at five selected walking speeds. The lumped ratio of HEI forces under the SADRL strategy relative to those under the SADRL strategy is as low as 0.81 in simulation and approximately 0.89 on the LEHPA prototype. The overall reduction of HEI forces demonstrates the superiority of the VIADRL strategy in comparison to the SADRL strategy.
文摘Objective:This study aimed to explore the applications of three-dimensional (3D) technology, including virtual reality, augmented reality (AR), and 3D printing system, in the field of medicine, particularly in renal interventions for cancer treatment.Methods:A specialized software transforms 2D medical images into precise 3D digital models, facilitating improved anatomical understanding and surgical planning. Patient-specific 3D printed anatomical models are utilized for preoperative planning, intraoperative guidance, and surgical education. AR technology enables the overlay of digital perceptions onto real-world surgical environments.Results:Patient-specific 3D printed anatomical models have multiple applications, such as preoperative planning, intraoperative guidance, trainee education, and patient counseling. Virtual reality involves substituting the real world with a computer-generated 3D environment, while AR overlays digitally created perceptions onto the existing reality. The advances in 3D modeling technology have sparked considerable interest in their application to partial nephrectomy in the realm of renal cancer. 3D printing, also known as additive manufacturing, constructs 3D objects based on computer-aided design or digital 3D models. Utilizing 3D-printed preoperative renal models provides benefits for surgical planning, offering a more reliable assessment of the tumor's relationship with vital anatomical structures and enabling better preparation for procedures. AR technology allows surgeons to visualize patient-specific renal anatomical structures and their spatial relationships with surrounding organs by projecting CT/MRI images onto a live laparoscopic video. Incorporating patient-specific 3D digital models into healthcare enhances best practice, resulting in improved patient care, increased patient satisfaction, and cost saving for the healthcare system.
基金This work is supported by the National Natural Science Foundation of China(Grant 11772190),which is gratefully acknowledged.
文摘To effectively simulate the fracture propagation in shale,the bedding plane(BP)effect is incorporated into the augmented virtual internal bond(AVIB)constitutive relation through BP tensor.Comparing the BP-embedded AVIB with the theory of transverse isotropy,it is found the approach can represent the anisotropic properties induced by parallel BPs.Through the simulation example,it is found that this method can simulate the stiffness anisotropy of shale and can represent the effect of BPs on hydraulic fracture propagation direction.Compared with the BP-embedded virtual internal bond(VIB),this method can account for the various Poisson’s ratio.It provides a feasible approach to simulate the fracture propagation in shale.
基金supported in part by the National Natural Science Foundation of China(62073301,62373162,62473349,U24A20268,62233007)the Shenzhen Science and Technology Program(JCYJ20240813114007010).
文摘Dear Editor,This letter investigates the problem of multi-dimension formation tracking(MDFT)for the cross-domain unmanned systems,including several interconnected agents,namely,unmanned aerial vehicles(UAVs)and unmanned surface vehicles(USVs).We assume that each agent suffers from by the mixed constraints on its velocity,control input and Euler angle.Solving the MDFT problem implies that 1)The virtual state of each USV is determined in the earth coordinate by expanding its 2D work space to the 3D space.
文摘Virtual Reality (VR) and Mixed Reality (MR) offer unique opportunities for the architecture and construction industry through different approaches with building information modeling (BIM). While VR offers architecture and construction practitioners the ability to personally experience the built environment in an immersive, MR with its unique ability of overlaying digital information in the real world allows practitioners to perform on-site visualization for construction planning and as-built verification. With their similar but distinct characteristics, VR and MR offer a variety of functionality to the architecture and construction industry that often confuses practitioners on what to choose to best fit their needs. To clarify this confusion, this paper investigates the available technologies of VR and MR in terms of both hardware and software and compares the functionality between the two for architecture and construction uses. While VR hardware has been developed into three categories based on their connection types and tracking methods, MR hardware has mainly focused on standalone devices. Eight VR software and nine MR software have been identified, investigated, and compared. This paper provides the latest information for architecture and construction practitioners on how VR and MR hardware and software work similarly and differently.
文摘Virtual reality(VR)and augmented reality(AR)technologies have become increasingly important instruments in the field of art education as information technology develops quickly,transforming the conventional art education approach.The present situation,benefits,difficulties,and potential development tendencies of VR and AR technologies in art education will be investigated in this study.By means of literature analysis and case studies,this paper presents the fundamental ideas of VR and AR technologies together with their several uses in art education,namely virtual museums,interactive art production,art history instruction,and distant art cooperation.The research examines how these technologies might improve students’immersion,raise their learning motivation,and encourage innovative ideas and multidisciplinary cooperation.Practical application concerns including technology costs,content production obstacles,user acceptance,privacy,and ethical questions also come under discussion.At last,the article offers ideas and suggestions to help VR and AR technologies be effectively integrated into art education through teacher training,curriculum design,technology infrastructure development,and multidisciplinary cooperation.This study offers useful advice for teachers of art as well as important references for legislators and technology developers working together to further the creative growth of art education.
文摘This study comprehensively reviews the literature to deeply explore the role of computer science and internet technologies in addressing educational inequality and socio-psychological issues,with a particular focus on applications of 5G,artificial intelligence(AI),and augmented/virtual reality(AR/VR).By analyzing how these technologies are reshaping learning and their potential to ameliorate educational disparities,the study reveals challenges present in ensuring educational equity.The research methodology includes exhaustive reviews of applications of AI and machine learning,the Internet of Things and wearable technologies integration,big data analytics and data mining,and the effects of online platforms and social media on socio-psychological issues.Besides,the study discusses applications of these technologies in educational inequality and socio-psychological problem-solving through the lens of 5G,AI,and AR/VR,while also delineating challenges faced by these emerging technologies and future outlooks.The study finds that while computer science and internet technologies hold promise to bridge academic divides and address socio-psychological problems,the complexity of technology access and infrastructure,lack of digital literacy and skills,and critical ethical and privacy issues can impact widespread adoption and efficacy.Overall,the study provides a novel perspective to understand the potential of computer science and internet technologies in ameliorating educational inequality and socio-psychological issues,while pointing to new directions for future research.It also emphasizes the importance of cooperation among educational institutions,technology vendors,policymakers and researchers,and establishing comprehensive ethical guidelines and regulations to ensure the responsible use of these technologies.
文摘Mixed reality(MR)technology is a new digital holographic image technology,which appears in the field of graphics after virtual reality(VR)and augmented reality(AR)technology,a new interdisciplinary frontier.As a new generation of technology,MR has attracted great attention of clinicians in recent years.The emergence of MR will bring about revolutionary changes in medical education training,medical research,medical communication,and clinical treatment.At present,MR technology has become the popular frontline information technology for medical applications.With the popularization of digital technology in the medical field,the development prospects of MR are inestimable.The purpose of this review article is to introduce the application of MR technology in the medical field and prospect its trend in the future.
基金supported by National Defence Basic Research Foundation of China(Grant No.B1420060173)National Hi-tech Research and Development Program of China(863 Program,Grant No.2006AA04Z138)
文摘Due to the narrowness of space and the complexity of structure,the assembly of aircraft cabin has become one of the major bottlenecks in the whole manufacturing process.To solve the problem,at the beginning of aircraft design,the different stages of the lifecycle of aircraft must be thought about,which include the trial manufacture,assembly,maintenance,recycling and destruction of the product.Recently,thanks to the development of the virtual reality and augmented reality,some low-cost and fast solutions are found for the product assembly.This paper presents a mixed reality-based interactive technology for the aircraft cabin assembly,which can enhance the efficiency of the assemblage in a virtual environment in terms of vision,information and operation.In the mixed reality-based assembly environment,the physical scene can be obtained by a camera and then generated by a computer.The virtual parts,the features of visual assembly,the navigation information,the physical parts and the physical assembly environment will be mixed and presented in the same assembly scene.The mixed or the augmented information will provide some assembling information as a detailed assembly instruction in the mixed reality-based assembly environment.Constraint proxy and its match rules help to reconstruct and visualize the restriction relationship among different parts,and to avoid the complex calculation of constraint's match.Finally,a desktop prototype system of virtual assembly has been built to assist the assembly verification and training with the virtual hand.
文摘The massive technological advancements around the world have created significant challenging competition among companies where each of the companies tries to attract the customers using different techniques. One of the recent tech- niques is Augmented Reality (AR). The AR is a new technology which is capable of presenting possibilities that are difficult for other technologies to offer and meet. Nowadays, numerous augmented reality applications have been used in the industry of different kinds and disseminated all over the world. AR will really alter the way individuals view the world. The AR is yet in its initial phases of research and development at different colleges and high-tech institutes. Throughout the last years, AR apps became transportable and generally available on various devices. Besides, AR be- gins to occupy its place in our audio-visual media and to be used in various fields in our life in tangible and exciting ways such as news, sports and is used in many domains in our life such as electronic commerce, promotion, design, and business. In addition, AR is used to facilitate the learning whereas it enables students to access location-specific infor- mation provided through various sources. Such growth and spread of AR applications pushes organizations to compete one another, every one of them exerts its best to gain the customers. This paper provides a comprehensive study of AR including its history, architecture, applications, current challenges and future trends.
文摘In the modern era,preoperative planning is substantially facilitated by artificial reality technologies,which permit a better understanding of patient anatomy,thus increasing the safety and accuracy of surgical interventions.In the field of orthopedic surgery,the increase in safety and accuracy improves treatment quality and orthopedic patient outcomes.Artificial reality technologies,which include virtual reality(VR),augmented reality(AR),and mixed reality(MR),use digital images obtained from computed tomography or magnetic resonance imaging.VR replaces the user’s physical environment with one that is computer generated.AR and MR have been defined as technologies that permit the fusing of the physical with the virtual environment,enabling the user to interact with both physical and virtual objects.MR has been defined as a technology that,in contrast to AR,enables users to visualize the depth and perspective of the virtual models.We aimed to shed light on the role that MR can play in the visualization of orthopedic surgical anatomy.The literature suggests that MR could be a valuable tool in orthopedic surgeon’s hands for visualization of the anatomy.However,we remark that confusion exists in the literature concerning the characteristics of MR.Thus,a more clear description of MR is needed in orthopedic research,so that the potential of this technology can be more deeply understood.
