Background Haptic feedback plays a crucial role in virtual reality(VR)interaction,helping to improve the precision of user operation and enhancing the immersion of the user experience.Instrumental haptic feedback in v...Background Haptic feedback plays a crucial role in virtual reality(VR)interaction,helping to improve the precision of user operation and enhancing the immersion of the user experience.Instrumental haptic feedback in virtual environments is primarily realized using grounded force or vibration feedback devices.However,improvements are required in terms of the active space and feedback realism.Methods We propose a lightweight and flexible haptic feedback glove that can haptically render objects in VR environments via kinesthetic and vibration feedback,thereby enabling users to enjoy a rich virtual piano-playing experience.The kinesthetic feedback of the glove relies on a cable-pulling mechanism that rotates the mechanism and pulls the two cables connected to it,thereby changing the amount of force generated to simulate the hardness or softness of the object.Vibration feedback is provided by small vibration motors embedded in the bottom of the fingertips of the glove.We designed a piano-playing scenario in the virtual environment and conducted user tests.The evaluation metrics were clarity,realism,enjoyment,and satisfaction.Results A total of 14 subjects participated in the test,and the results showed that our proposed glove scored significantly higher on the four evaluation metrics than the nofeedback and vibration feedback methods.Conclusions Our proposed glove significantly enhances the user experience when interacting with virtual objects.展开更多
Background Most existing chemical experiment teaching systems lack solid immersive experiences,making it difficult to engage students.To address these challenges,we propose a chemical simulation teaching system based ...Background Most existing chemical experiment teaching systems lack solid immersive experiences,making it difficult to engage students.To address these challenges,we propose a chemical simulation teaching system based on virtual reality and gesture interaction.Methods The parameters of the models were obtained through actual investigation,whereby Blender and 3DS MAX were used to model and import these parameters into a physics engine.By establishing an interface for the physics engine,gesture interaction hardware,and virtual reality(VR)helmet,a highly realistic chemical experiment environment was created.Using code script logic,particle systems,as well as other systems,chemical phenomena were simulated.Furthermore,we created an online teaching platform using streaming media and databases to address the problems of distance teaching.Results The proposed system was evaluated against two mainstream products in the market.In the experiments,the proposed system outperformed the other products in terms of fidelity and practicality.Conclusions The proposed system which offers realistic simulations and practicability,can help improve the high school chemistry experimental education.展开更多
Background Physical entity interactions in mixed reality(MR)environments aim to harness human capabilities in manipulating physical objects,thereby enhancing virtual environment(VEs)functionality.In MR,a common strate...Background Physical entity interactions in mixed reality(MR)environments aim to harness human capabilities in manipulating physical objects,thereby enhancing virtual environment(VEs)functionality.In MR,a common strategy is to use virtual agents as substitutes for physical entities,balancing interaction efficiency with environmental immersion.However,the impact of virtual agent size and form on interaction performance remains unclear.Methods Two experiments were conducted to explore how virtual agent size and form affect interaction performance,immersion,and preference in MR environments.The first experiment assessed five virtual agent sizes(25%,50%,75%,100%,and 125%of physical size).The second experiment tested four types of frames(no frame,consistent frame,half frame,and surrounding frame)across all agent sizes.Participants,utilizing a head mounted display,performed tasks involving moving cups,typing words,and using a mouse.They completed questionnaires assessing aspects such as the virtual environment effects,interaction effects,collision concerns,and preferences.Results Results from the first experiment revealed that agents matching physical object size produced the best overall performance.The second experiment demonstrated that consistent framing notably enhances interaction accuracy and speed but reduces immersion.To balance efficiency and immersion,frameless agents matching physical object sizes were deemed optimal.Conclusions Virtual agents matching physical entity sizes enhance user experience and interaction performance.Conversely,familiar frames from 2D interfaces detrimentally affect interaction and immersion in virtual spaces.This study provides valuable insights for the future development of MR systems.展开更多
Background Fibromyalgia(FM)is a chronic rheumatic disorder characterised by musculoskeletal pain,fatigue,and psychoemotional symptoms.Virtual reality(VR)has proven to be an innovative and motivating tool for managing ...Background Fibromyalgia(FM)is a chronic rheumatic disorder characterised by musculoskeletal pain,fatigue,and psychoemotional symptoms.Virtual reality(VR)has proven to be an innovative and motivating tool for managing FM,with several studies indicating that it can improve quality of life indices and reduce psychoemotional symptoms.However,studies on immersive VR-based exercise(iVRE)are limited.Methods The aim of this study was to evaluate the effects of iVRE on quality of life,stress,anxiety,depression,and handgrip strength in patients with FM.A single-arm pre-post-test pilot study was conducted.Individuals diagnosed with FM were recruited using convenience sampling.The iVRE protocol consisted of 12 sessions of 10 min warm-up and 15 min exercises applied with the Oculus Quest 2TM device.The impact on quality of life was assessed using the Revised Fibromyalgia Impact Questionnaire,and the effects on stress,anxiety,and depression were determined using the Depression Anxiety Stress Scale-21 questionnaire.Handgrip strength was evaluated using the Baseline®dynamometer.The normality assumption was evaluated,and the pre-post means were compared using Student's ttest(p<0.05).Results Eleven individuals(40.6±11.2 years)completed the protocol(10 women).There were significant differences in favour of iVRE in quality of life impact(p<0.001,Cohen's d:1.48),handgrip strength(p<0.05,Cohen's d:0.26),depression(p<0.05,Cohen's d:0.73),and anxiety(p<0.05,Cohen's d:0.73).Conclusions A six-week iVRE program significantly reduces the impact on quality of life,anxiety,and depression and improves handgrip strength in people with FM.Future studies should investigate the physiological effects using systemic biomarkers to explain the scope of this therapeutic modality.展开更多
Virtual reality(VR)technology revitalises rehabilitation training by creating rich,interactive virtual rehabilitation scenes and tasks that deeply engage patients.Robotics with immersive VR environments have the poten...Virtual reality(VR)technology revitalises rehabilitation training by creating rich,interactive virtual rehabilitation scenes and tasks that deeply engage patients.Robotics with immersive VR environments have the potential to significantly enhance the sense of immersion for patients during training.This paper proposes a rehabilitation robot system.The system integrates a VR environment,the exoskeleton entity,and research on rehabilitation assessment metrics derived from surface electromyographic signal(sEMG).Employing more realistic and engaging virtual stimuli,this method guides patients to actively participate,thereby enhancing the effectiveness of neural connection reconstruction—an essential aspect of rehabilitation.Furthermore,this study introduces a muscle activation model that merges linear and non-linear states of muscle,avoiding the impact of non-linear shape factors on model accuracy present in traditional models.A muscle strength assessment model based on optimised generalised regression(WOAGRNN)is also proposed,with a root mean square error of 0.017,347 and a mean absolute percentage error of 1.2461%,serving as critical assessment indicators for the effectiveness of rehabilitation.Finally,the system is preliminarily applied in human movement experiments,validating the practicality and potential effectiveness of VRcentred rehabilitation strategies in medical recovery.展开更多
This paper investigates the application of Natural Language Processing (NLP) in AI interaction design for virtual experiences. It analyzes the impact of various interaction methods on user experience, integrating Virt...This paper investigates the application of Natural Language Processing (NLP) in AI interaction design for virtual experiences. It analyzes the impact of various interaction methods on user experience, integrating Virtual Reality (VR) and Augmented Reality (AR) technologies to achieve more natural and intuitive interaction models through NLP techniques. Through experiments and data analysis across multiple technical models, this study proposes an innovative design solution based on natural language interaction and summarizes its advantages and limitations in immersive experiences.展开更多
This study aims to explore the application of digital technology in landscape design,focusing on the research of virtual reality visualization and interactive design in the process of plant configuration.Through an in...This study aims to explore the application of digital technology in landscape design,focusing on the research of virtual reality visualization and interactive design in the process of plant configuration.Through an in-depth analysis of digital technology,the study outlines its important role in landscape design,especially in the application of plant configuration.The current application status of virtual reality technology in landscape design is discussed,as well as how interactive design can enhance user experience and participation.Furthermore,the achievements and challenges of digital technology in landscape design are summarized.Finally,it proposes future research directions and suggestions,aiming to provide new ideas and methods for practice and research in the field of landscape design and promote the further application and development of digital technology in landscape design.展开更多
Objective: To explore the effects of the somatosensory interaction technology combined with virtual reality technology on upper limbs function and activities of daily living (ADL) in cerebrovascular disease patients. ...Objective: To explore the effects of the somatosensory interaction technology combined with virtual reality technology on upper limbs function and activities of daily living (ADL) in cerebrovascular disease patients. Methods: Form January, 2019 to December, 2019, 80 cerebrovascular disease patients were recruited, and had been divided into control group (n = 40) and observation group (n = 40), randomly. The control groups received conventional rehabilitation treatment, for 40 minutes per day, while observation group received conventional rehabilitation treatment, for 20 minutes per day, and virtual reality technology treatment, 20 minutes per day, 5 days a week for 4 weeks. Wolf Motor Function Test (WMFT), Fugl-Meyer Assessment-Upper Extremities (FMA-UE) and modified Barthel index (MBI) were used to assess the motor function of the upper limbs and ADL before and after treatment. Results: Before treatment, the scores of WMFT, FMA-UE and MBI were no significant difference between two groups (P > 0.05). The scores improved in both groups after treatment (P < 0.01), and were higher in the observation group than in the control group (P < 0.05). Conclusion: The somatosensory interaction technology combined with virtual reality technology could facilitate to improve the upper limbs function and ADL in cerebrovascular disease patients.展开更多
With the development of virtual reality(VR)and human-computer interaction technology,how to use natural and efficient interaction methods in the virtual environment has become a hot topic of research.Gesture is one of...With the development of virtual reality(VR)and human-computer interaction technology,how to use natural and efficient interaction methods in the virtual environment has become a hot topic of research.Gesture is one of the most important communication methods of human beings,which can effectively express users'demands.In the past few decades,gesture-based interaction has made significant progress.This article focuses on the gesture interaction technology and discusses the definition and classification of gestures,input devices for gesture interaction,and gesture interaction recognition technology.The application of gesture interaction technology in virtual reality is studied,the existing problems in the current gesture interaction are summarized,and the future development is prospected.展开更多
Background Virtual reality technology has been widely used in surgical simulators,providing new opportunities for assessing and training surgical skills.Machine learning algorithms are commonly used to analyze and eva...Background Virtual reality technology has been widely used in surgical simulators,providing new opportunities for assessing and training surgical skills.Machine learning algorithms are commonly used to analyze and evaluate the performance of participants.However,their interpretability limits the personalization of the training for individual participants.Methods Seventy-nine participants were recruited and divided into three groups based on their skill level in intracranial tumor resection.Data on the use of surgical tools were collected using a surgical simulator.Feature selection was performed using the Minimum Redundancy Maximum Relevance and SVM-RFE algorithms to obtain the final metrics for training the machine learning model.Five machine learning algorithms were trained to predict the skill level,and the support vector machine performed the best,with an accuracy of 92.41%and Area Under Curve value of 0.98253.The machine learning model was interpreted using Shapley values to identify the important factors contributing to the skill level of each participant.Results This study demonstrates the effectiveness of machine learning in differentiating the evaluation and training of virtual reality neurosurgical performances.The use of Shapley values enables targeted training by identifying deficiencies in individual skills.Conclusions This study provides insights into the use of machine learning for personalized training in virtual reality neurosurgery.The interpretability of the machine learning models enables the development of individualized training programs.In addition,this study highlighted the potential of explanatory models in training external skills.展开更多
The cooperative work between human being and computer based on virtual reality (VR) is investigated to plan the disassembly sequences more efficiently. A three-layer model of human-computer cooperative virtual disasse...The cooperative work between human being and computer based on virtual reality (VR) is investigated to plan the disassembly sequences more efficiently. A three-layer model of human-computer cooperative virtual disassembly is built, and the corresponding human-computer system for stable virtual disassembly is developed. In this system, an immersive and interactive virtual disassembly environment has been created to provide planners with a more visual working scene. For cooperative disassembly, an intelligent module of stability analysis of disassembly operations is embedded into the human-computer system to assist planners to implement disassembly tasks better. The supporting matrix for stability analysis of disassembly operations is defined and the method of stability analysis is detailed. Based on the approach, the stability of any disassembly operation can be analyzed to instruct the manual virtual disassembly. At last, a disassembly case in the virtual environment is given to prove the validity of above ideas.展开更多
Due to the narrowness of space and the complexity of structure, the assembly of aircraft cabin has become one of the major bottlenecks in the whole manufacturing process. To solve the problem, at the beginning of airc...Due to the narrowness of space and the complexity of structure, the assembly of aircraft cabin has become one of the major bottlenecks in the whole manufacturing process. To solve the problem, at the beginning of aircraft design, the different stages of the lifecycle of aircraft must be thought about, which include the trial manufacture, assembly, maintenance, recycling and destruction of the product. Recently, thanks to the development of the virtual reality and augmented reality, some low-cost and fast solutions are found for the product assembly. This paper presents a mixed reality-based interactive technology for the aircraft cabin assembly, which can enhance the efficiency of the assemblage in a virtual environment in terms of vision, information and operation. In the mixed reality-based assembly environment, the physical scene can be obtained by a camera and then generated by a computer. The virtual parts, the features of visual assembly, the navigation information, the physical parts and the physical assembly environment will be mixed and presented in the same assembly scene. The mixed or the augmented information will provide some assembling information as a detailed assembly instruction in the mixed reality-based assembly environment. Constraint proxy and its match rules help to reconstruct and visualize the restriction relationship among different parts, and to avoid the complex calculation of constraint＇s match. Finally, a desktop prototype system of virtual assembly has been built to assist the assembly verification and training with the virtual hand.展开更多
Nanomaterial-based flexible sensors(NMFSs)can be tightly attached to the human skin or integrated with clothing to monitor human physiological information,provide medical data,or explore metaverse spaces.Nanomaterials...Nanomaterial-based flexible sensors(NMFSs)can be tightly attached to the human skin or integrated with clothing to monitor human physiological information,provide medical data,or explore metaverse spaces.Nanomaterials have been widely incorporated into flexible sensors due to their facile processing,material compatibility,and unique properties.This review highlights the recent advancements in NMFSs involving various nanomaterial frameworks such as nanoparticles,nanowires,and nanofilms.Different triggering interaction interfaces between NMFSs and metaverse/virtual reality(VR)applications,e.g.skin-mechanics-triggered,temperature-triggered,magnetically triggered,and neural-triggered interfaces,are discussed.In the context of interfacing physical and virtual worlds,machine learning(ML)has emerged as a promising tool for processing sensor data for controlling avatars in metaverse/VR worlds,and many ML algorithms have been proposed for virtual interaction technologies.This paper discusses the advantages,disadvantages,and prospects of NMFSs in metaverse/VR applications.展开更多
We present an approach to control a semi-autonomous robot team remotely under low bandwidth conditions with a single operator. Our approach utilises virtual reality and autonomous robots to create an immersive user in...We present an approach to control a semi-autonomous robot team remotely under low bandwidth conditions with a single operator. Our approach utilises virtual reality and autonomous robots to create an immersive user interface for multi-robot control. This saves a big amount of bandwidth, just because there is no need to transfer a constant steam of camera images. The virtual environment for control only has to be transferred once to the control station and only has to be updated when the map is out of date. Also, the camera position can easily be changed in virtual reality for more overview on the robots situation. The parts of this approach can easily be transferred to applications on earth e.g. for semi-autonomous robots in hazardous areas or under water applications.展开更多
Background Navigation assistance is essential for users when roaming virtual reality scenes;however,the traditional navigation method requires users to manually request a map for viewing,which leads to low immersion a...Background Navigation assistance is essential for users when roaming virtual reality scenes;however,the traditional navigation method requires users to manually request a map for viewing,which leads to low immersion and poor user experience.Methods To address this issue,we first collected data on who required navigation assistance in a virtual reality environment,including various eye movement features,such as gaze fixation,pupil size,and gaze angle.Subsequently,we used the boosting-based XGBoost algorithm to train a prediction model and finally used it to predict whether users require navigation assistance in a roaming task.Results After evaluating the performance of the model,the accuracy,precision,recall,and F1-score of our model reached approximately 95%.In addition,by applying the model to a virtual reality scene,an adaptive navigation assistance system based on the real-time eye movement data of the user was implemented.Conclusions Compared with traditional navigation assistance methods,our new adaptive navigation assistance method could enable the user to be more immersive and effective while roaming in a virtual reality(VR)environment.展开更多
In a building, the paint coating applied to interior walls conveys their aesthetic character and also performs an important function of protection. It is a construction component which is exposed to agents of deterior...In a building, the paint coating applied to interior walls conveys their aesthetic character and also performs an important function of protection. It is a construction component which is exposed to agents of deterioration related to its use, needing the regular evaluation of its state of repair. The completed model supports the performance of such periodic inspections and the monitoring of interior wall maintenance, using Virtual Reality (VR) technology. Used during an inspection visit, the application allows users to consult a database of irregularities, normally associated with paint coating, classified by the most probable causes and by recommended repair methodologies. In addition, with this model, a chromatic scale related to the degree of deterioration of the coating, defined as a function of the time between the dates of the application of the paint and the scheduled repainting, can be attributed to each element of coating monitored. This use of VR technology allows inspections and the evaluation of the degree of wear and tear of materials to be carried out in a highly direct and intuitive manner. The computer application has a positive contribution to make in the field of construction, using as it does Information Technology (IT) tools which give access to innovative technology with it capacity for interaction and visualization.展开更多
In the last few decades, technology found its way from being a wild sci-fi dream, only seen in movies, to being an important element of all aspects of life. The technological industry bloomed quite rapidly where the t...In the last few decades, technology found its way from being a wild sci-fi dream, only seen in movies, to being an important element of all aspects of life. The technological industry bloomed quite rapidly where the technological solutions have made any process you can think of easier, faster and more efficient. Educational methodologies started off simple, having a teacher using simply his/her words and some writing along with it. With technology entering the field of education, teaching methods were enhanced and the quality of its outcomes was improved. However, sadly in Arab countries that was not the story. In other words, the use of new education technologies is still limited to basic and simple tasks. In fact, to add to the agony, most of the programs used are poorly implemented and rarely applied. Interestingly, as many studies confirm and from the simple observation of kids playing, it is found that most children are very attracted to new technologies and their applications. Those interests not only changed what a normal childhood would look like, but also introduced a multi-billion industry of electronic games. Virtual Reality (VR) games were introduced a few years back starting a gaming revolution, allowing gamers to enter the world of their dreams. Similar to most technologies, VR started to become more affordable with time. Multiple companies have competed to give us amazing VR products such as Samsung Gear. In this manuscript, we present a Virtual Reality Educational Game (VREG), which is an interactive 3D game with Arabic content that targets the students between age 4 and 8 and can be played on a smart phone. VREG includes multiple games that cover the different concepts of Arabic and English languages alongside math, aiming to help the student to learn through playing. In order to make sure that our game reaches wanted education standards, we put it to the test in two private schools;the feedback was very positive from both teachers and students where the majority of users enjoyed their experiments in VR games.展开更多
Haptic interaction plays an important role in the virtual reality technology,which let a person not only view the 3D virtual environment but also realistically touch the virtual environment.As a key part of haptic int...Haptic interaction plays an important role in the virtual reality technology,which let a person not only view the 3D virtual environment but also realistically touch the virtual environment.As a key part of haptic interaction,force feedback has become an essential function for the haptic interaction.Therefore,multi-dimensional force sensors are widely used in the fields of virtual reality and augmented reality.In this paper,some conventional multi-dimensional force sensors based on different measurement principles,such as resistive,capacitive,piezoelectric,are briefly introduced.Then the mechanical structures of the elastic body of multi-dimensional force sensors are reviewed.It is obvious that the performance of the multi-dimensional force sensor is mainly dependent upon the mechanical structure of elastic body.Furthermore,the calibration process of the force sensor is analyzed,and problems in calibration are discussed.Interdimensional coupling error is one of the main factors affecting the measurement precision of the multi-dimensional force sensors.Therefore,reducing or even eliminating dimensional coupling error becomes a fundamental requirement in the design of multi-dimensional force sensors,and the decoupling state-of-art of the multi-dimensional force sensors are introduced in this paper.At last,the trends and current challenges of multi-dimensional force sensing technology are proposed.展开更多
Background Gesture is a basic interaction channel that is frequently used by humans to communicate in daily life. In this paper, we explore to use gesture-based approaches for target acquisition in virtual and augment...Background Gesture is a basic interaction channel that is frequently used by humans to communicate in daily life. In this paper, we explore to use gesture-based approaches for target acquisition in virtual and augmented reality. A typical process of gesture-based target acquisition is: when a user intends to acquire a target, she performs a gesture with her hands, head or other parts of the body, the computer senses and recognizes the gesture and infers the most possible target. Methods We build mental model and behavior model of the user to study two key parts of the interaction process. Mental model describes how user thinks up a gesture for acquiring a target, and can be the intuitive mapping between gestures and targets. Behavior model describes how user moves the body parts to perform the gestures, and the relationship between the gesture that user intends to perform and signals that computer senses. Results In this paper, we present and discuss three pieces of research that focus on the mental model and behavior model of gesture-based target acquisition in VR and AR. Conclusions We show that leveraging these two models, interaction experience and performance can be improved in VR and AR environments.展开更多
Background Virtual reality(VR)in healthcare training has increased adoption and support,but efforts are still required to mitigate usability concerns.Methods This study conducted a usability study of an in-use emergen...Background Virtual reality(VR)in healthcare training has increased adoption and support,but efforts are still required to mitigate usability concerns.Methods This study conducted a usability study of an in-use emergency medicine VR training application,available on commercially available VR hardware and with a standard interaction design.Nine users without prior VR experience but with relevant medical expertise completed two simulation scenarios for a total of 18 recorded sessions.They completed NASA Task Load Index and System Usability Scale questionnaires after each session,and their performance was recorded for the tracking of user errors.Results and Conclusions Our results showed a medium(and potentially optimal)Workload and an above average System Usability Score.There was significant improvement in several factors between users'first and second sessions,notably increased Performance evaluation.User errors with the strongest correlation to usability were not directly tied to interaction design,however,but to a limited'possibility space'.Suggestions for closing this'gulf of execution'were presented,including'voice control'and'hand-tracking',which are only feasible for this commercial product now with the availability of the Oculus Quest headset.Moreover,wider implications for VR medical training were outlined,and potential next steps towards a standardized design identified.展开更多
基金Supported by the Natienal Natural Science Foundation of China(U23A20287).
文摘Background Haptic feedback plays a crucial role in virtual reality(VR)interaction,helping to improve the precision of user operation and enhancing the immersion of the user experience.Instrumental haptic feedback in virtual environments is primarily realized using grounded force or vibration feedback devices.However,improvements are required in terms of the active space and feedback realism.Methods We propose a lightweight and flexible haptic feedback glove that can haptically render objects in VR environments via kinesthetic and vibration feedback,thereby enabling users to enjoy a rich virtual piano-playing experience.The kinesthetic feedback of the glove relies on a cable-pulling mechanism that rotates the mechanism and pulls the two cables connected to it,thereby changing the amount of force generated to simulate the hardness or softness of the object.Vibration feedback is provided by small vibration motors embedded in the bottom of the fingertips of the glove.We designed a piano-playing scenario in the virtual environment and conducted user tests.The evaluation metrics were clarity,realism,enjoyment,and satisfaction.Results A total of 14 subjects participated in the test,and the results showed that our proposed glove scored significantly higher on the four evaluation metrics than the nofeedback and vibration feedback methods.Conclusions Our proposed glove significantly enhances the user experience when interacting with virtual objects.
基金National Innovation and Entrepreneurship Program for College Students(202218213001)Science and Technology Innovation Strategy of Guangdong Province(Science and Technology Innovation Cultivation of University Students 2020329182130C000002).
文摘Background Most existing chemical experiment teaching systems lack solid immersive experiences,making it difficult to engage students.To address these challenges,we propose a chemical simulation teaching system based on virtual reality and gesture interaction.Methods The parameters of the models were obtained through actual investigation,whereby Blender and 3DS MAX were used to model and import these parameters into a physics engine.By establishing an interface for the physics engine,gesture interaction hardware,and virtual reality(VR)helmet,a highly realistic chemical experiment environment was created.Using code script logic,particle systems,as well as other systems,chemical phenomena were simulated.Furthermore,we created an online teaching platform using streaming media and databases to address the problems of distance teaching.Results The proposed system was evaluated against two mainstream products in the market.In the experiments,the proposed system outperformed the other products in terms of fidelity and practicality.Conclusions The proposed system which offers realistic simulations and practicability,can help improve the high school chemistry experimental education.
基金the Strategic research and consulting project of Chinese Academy of Engineering(2023-HY-14).
文摘Background Physical entity interactions in mixed reality(MR)environments aim to harness human capabilities in manipulating physical objects,thereby enhancing virtual environment(VEs)functionality.In MR,a common strategy is to use virtual agents as substitutes for physical entities,balancing interaction efficiency with environmental immersion.However,the impact of virtual agent size and form on interaction performance remains unclear.Methods Two experiments were conducted to explore how virtual agent size and form affect interaction performance,immersion,and preference in MR environments.The first experiment assessed five virtual agent sizes(25%,50%,75%,100%,and 125%of physical size).The second experiment tested four types of frames(no frame,consistent frame,half frame,and surrounding frame)across all agent sizes.Participants,utilizing a head mounted display,performed tasks involving moving cups,typing words,and using a mouse.They completed questionnaires assessing aspects such as the virtual environment effects,interaction effects,collision concerns,and preferences.Results Results from the first experiment revealed that agents matching physical object size produced the best overall performance.The second experiment demonstrated that consistent framing notably enhances interaction accuracy and speed but reduces immersion.To balance efficiency and immersion,frameless agents matching physical object sizes were deemed optimal.Conclusions Virtual agents matching physical entity sizes enhance user experience and interaction performance.Conversely,familiar frames from 2D interfaces detrimentally affect interaction and immersion in virtual spaces.This study provides valuable insights for the future development of MR systems.
基金Supported by collaborative project(ID3003)of the Vice-Rectors Office for University Outreach(VCM,Spanish acronym)of the Universidad San Sebastián Concepción,Republic of Chile.
文摘Background Fibromyalgia(FM)is a chronic rheumatic disorder characterised by musculoskeletal pain,fatigue,and psychoemotional symptoms.Virtual reality(VR)has proven to be an innovative and motivating tool for managing FM,with several studies indicating that it can improve quality of life indices and reduce psychoemotional symptoms.However,studies on immersive VR-based exercise(iVRE)are limited.Methods The aim of this study was to evaluate the effects of iVRE on quality of life,stress,anxiety,depression,and handgrip strength in patients with FM.A single-arm pre-post-test pilot study was conducted.Individuals diagnosed with FM were recruited using convenience sampling.The iVRE protocol consisted of 12 sessions of 10 min warm-up and 15 min exercises applied with the Oculus Quest 2TM device.The impact on quality of life was assessed using the Revised Fibromyalgia Impact Questionnaire,and the effects on stress,anxiety,and depression were determined using the Depression Anxiety Stress Scale-21 questionnaire.Handgrip strength was evaluated using the Baseline®dynamometer.The normality assumption was evaluated,and the pre-post means were compared using Student's ttest(p<0.05).Results Eleven individuals(40.6±11.2 years)completed the protocol(10 women).There were significant differences in favour of iVRE in quality of life impact(p<0.001,Cohen's d:1.48),handgrip strength(p<0.05,Cohen's d:0.26),depression(p<0.05,Cohen's d:0.73),and anxiety(p<0.05,Cohen's d:0.73).Conclusions A six-week iVRE program significantly reduces the impact on quality of life,anxiety,and depression and improves handgrip strength in people with FM.Future studies should investigate the physiological effects using systemic biomarkers to explain the scope of this therapeutic modality.
基金National Key Research and Development Program of China,Grant/Award Number:2022YFB4700701National Outstanding Youth Science Fund Project of National Natural Science Foundation of China,Grant/Award Number:52025054。
文摘Virtual reality(VR)technology revitalises rehabilitation training by creating rich,interactive virtual rehabilitation scenes and tasks that deeply engage patients.Robotics with immersive VR environments have the potential to significantly enhance the sense of immersion for patients during training.This paper proposes a rehabilitation robot system.The system integrates a VR environment,the exoskeleton entity,and research on rehabilitation assessment metrics derived from surface electromyographic signal(sEMG).Employing more realistic and engaging virtual stimuli,this method guides patients to actively participate,thereby enhancing the effectiveness of neural connection reconstruction—an essential aspect of rehabilitation.Furthermore,this study introduces a muscle activation model that merges linear and non-linear states of muscle,avoiding the impact of non-linear shape factors on model accuracy present in traditional models.A muscle strength assessment model based on optimised generalised regression(WOAGRNN)is also proposed,with a root mean square error of 0.017,347 and a mean absolute percentage error of 1.2461%,serving as critical assessment indicators for the effectiveness of rehabilitation.Finally,the system is preliminarily applied in human movement experiments,validating the practicality and potential effectiveness of VRcentred rehabilitation strategies in medical recovery.
文摘This paper investigates the application of Natural Language Processing (NLP) in AI interaction design for virtual experiences. It analyzes the impact of various interaction methods on user experience, integrating Virtual Reality (VR) and Augmented Reality (AR) technologies to achieve more natural and intuitive interaction models through NLP techniques. Through experiments and data analysis across multiple technical models, this study proposes an innovative design solution based on natural language interaction and summarizes its advantages and limitations in immersive experiences.
基金2023 Campus Scientific Research Fund of Chongqing Institute of Engineering(Project number:2023xsky03)2023 Education and Teaching Reform Research Project of Chongqing Institute of Engineering(Project number:JY2023214)2023 First-class Curriculum Construction Project of Chongqing Institute of Engineering(Project number:KC20230103)。
文摘This study aims to explore the application of digital technology in landscape design,focusing on the research of virtual reality visualization and interactive design in the process of plant configuration.Through an in-depth analysis of digital technology,the study outlines its important role in landscape design,especially in the application of plant configuration.The current application status of virtual reality technology in landscape design is discussed,as well as how interactive design can enhance user experience and participation.Furthermore,the achievements and challenges of digital technology in landscape design are summarized.Finally,it proposes future research directions and suggestions,aiming to provide new ideas and methods for practice and research in the field of landscape design and promote the further application and development of digital technology in landscape design.
文摘Objective: To explore the effects of the somatosensory interaction technology combined with virtual reality technology on upper limbs function and activities of daily living (ADL) in cerebrovascular disease patients. Methods: Form January, 2019 to December, 2019, 80 cerebrovascular disease patients were recruited, and had been divided into control group (n = 40) and observation group (n = 40), randomly. The control groups received conventional rehabilitation treatment, for 40 minutes per day, while observation group received conventional rehabilitation treatment, for 20 minutes per day, and virtual reality technology treatment, 20 minutes per day, 5 days a week for 4 weeks. Wolf Motor Function Test (WMFT), Fugl-Meyer Assessment-Upper Extremities (FMA-UE) and modified Barthel index (MBI) were used to assess the motor function of the upper limbs and ADL before and after treatment. Results: Before treatment, the scores of WMFT, FMA-UE and MBI were no significant difference between two groups (P > 0.05). The scores improved in both groups after treatment (P < 0.01), and were higher in the observation group than in the control group (P < 0.05). Conclusion: The somatosensory interaction technology combined with virtual reality technology could facilitate to improve the upper limbs function and ADL in cerebrovascular disease patients.
基金National Key Research and Development(2016YFB1001405)Frontier Subject Key Research(QYZDY-SSW-JSC041)Chinese Academy of Sciences hundred people,National Natural Science Foundation of China(61572479)project support.
文摘With the development of virtual reality(VR)and human-computer interaction technology,how to use natural and efficient interaction methods in the virtual environment has become a hot topic of research.Gesture is one of the most important communication methods of human beings,which can effectively express users'demands.In the past few decades,gesture-based interaction has made significant progress.This article focuses on the gesture interaction technology and discusses the definition and classification of gestures,input devices for gesture interaction,and gesture interaction recognition technology.The application of gesture interaction technology in virtual reality is studied,the existing problems in the current gesture interaction are summarized,and the future development is prospected.
基金Supported by the Yunnan Key Laboratory of Opto-Electronic Information Technology,Postgraduate Research Innovation Fund of Yunnan Normal University (YJSJJ22-B79)the National Natural Science Foundation of China (62062069,62062070,62005235)。
文摘Background Virtual reality technology has been widely used in surgical simulators,providing new opportunities for assessing and training surgical skills.Machine learning algorithms are commonly used to analyze and evaluate the performance of participants.However,their interpretability limits the personalization of the training for individual participants.Methods Seventy-nine participants were recruited and divided into three groups based on their skill level in intracranial tumor resection.Data on the use of surgical tools were collected using a surgical simulator.Feature selection was performed using the Minimum Redundancy Maximum Relevance and SVM-RFE algorithms to obtain the final metrics for training the machine learning model.Five machine learning algorithms were trained to predict the skill level,and the support vector machine performed the best,with an accuracy of 92.41%and Area Under Curve value of 0.98253.The machine learning model was interpreted using Shapley values to identify the important factors contributing to the skill level of each participant.Results This study demonstrates the effectiveness of machine learning in differentiating the evaluation and training of virtual reality neurosurgical performances.The use of Shapley values enables targeted training by identifying deficiencies in individual skills.Conclusions This study provides insights into the use of machine learning for personalized training in virtual reality neurosurgery.The interpretability of the machine learning models enables the development of individualized training programs.In addition,this study highlighted the potential of explanatory models in training external skills.
基金This project is supported by National Natural Science Foundation of China (No.59990470-2).
文摘The cooperative work between human being and computer based on virtual reality (VR) is investigated to plan the disassembly sequences more efficiently. A three-layer model of human-computer cooperative virtual disassembly is built, and the corresponding human-computer system for stable virtual disassembly is developed. In this system, an immersive and interactive virtual disassembly environment has been created to provide planners with a more visual working scene. For cooperative disassembly, an intelligent module of stability analysis of disassembly operations is embedded into the human-computer system to assist planners to implement disassembly tasks better. The supporting matrix for stability analysis of disassembly operations is defined and the method of stability analysis is detailed. Based on the approach, the stability of any disassembly operation can be analyzed to instruct the manual virtual disassembly. At last, a disassembly case in the virtual environment is given to prove the validity of above ideas.
基金supported by National Defence Basic Research Foundation of China (Grant No. B1420060173)National Hi-tech Research and Development Program of China (863 Program, Grant No. 2006AA04Z138)
文摘Due to the narrowness of space and the complexity of structure, the assembly of aircraft cabin has become one of the major bottlenecks in the whole manufacturing process. To solve the problem, at the beginning of aircraft design, the different stages of the lifecycle of aircraft must be thought about, which include the trial manufacture, assembly, maintenance, recycling and destruction of the product. Recently, thanks to the development of the virtual reality and augmented reality, some low-cost and fast solutions are found for the product assembly. This paper presents a mixed reality-based interactive technology for the aircraft cabin assembly, which can enhance the efficiency of the assemblage in a virtual environment in terms of vision, information and operation. In the mixed reality-based assembly environment, the physical scene can be obtained by a camera and then generated by a computer. The virtual parts, the features of visual assembly, the navigation information, the physical parts and the physical assembly environment will be mixed and presented in the same assembly scene. The mixed or the augmented information will provide some assembling information as a detailed assembly instruction in the mixed reality-based assembly environment. Constraint proxy and its match rules help to reconstruct and visualize the restriction relationship among different parts, and to avoid the complex calculation of constraint＇s match. Finally, a desktop prototype system of virtual assembly has been built to assist the assembly verification and training with the virtual hand.
基金financially supported by China Scholarship Council(CSC)under the Grant CSC(No.202107585001)Jilin Provincial Science and Technology Program(Nos.20210101069JC and 20190702002GH)+2 种基金Science and Technology Program of Changchun(No.21ZGM18)‘111’Project of China(No.D17017)the Hong Kong Research Grants Council(Project Nos.11207222 and 11210819)for partially supporting this work。
文摘Nanomaterial-based flexible sensors(NMFSs)can be tightly attached to the human skin or integrated with clothing to monitor human physiological information,provide medical data,or explore metaverse spaces.Nanomaterials have been widely incorporated into flexible sensors due to their facile processing,material compatibility,and unique properties.This review highlights the recent advancements in NMFSs involving various nanomaterial frameworks such as nanoparticles,nanowires,and nanofilms.Different triggering interaction interfaces between NMFSs and metaverse/virtual reality(VR)applications,e.g.skin-mechanics-triggered,temperature-triggered,magnetically triggered,and neural-triggered interfaces,are discussed.In the context of interfacing physical and virtual worlds,machine learning(ML)has emerged as a promising tool for processing sensor data for controlling avatars in metaverse/VR worlds,and many ML algorithms have been proposed for virtual interaction technologies.This paper discusses the advantages,disadvantages,and prospects of NMFSs in metaverse/VR applications.
文摘We present an approach to control a semi-autonomous robot team remotely under low bandwidth conditions with a single operator. Our approach utilises virtual reality and autonomous robots to create an immersive user interface for multi-robot control. This saves a big amount of bandwidth, just because there is no need to transfer a constant steam of camera images. The virtual environment for control only has to be transferred once to the control station and only has to be updated when the map is out of date. Also, the camera position can easily be changed in virtual reality for more overview on the robots situation. The parts of this approach can easily be transferred to applications on earth e.g. for semi-autonomous robots in hazardous areas or under water applications.
基金Supported by the National Natural Science Foundation of China (62172368)the Natural Science Foundation of Zhejiang Province (LR22F020003)。
文摘Background Navigation assistance is essential for users when roaming virtual reality scenes;however,the traditional navigation method requires users to manually request a map for viewing,which leads to low immersion and poor user experience.Methods To address this issue,we first collected data on who required navigation assistance in a virtual reality environment,including various eye movement features,such as gaze fixation,pupil size,and gaze angle.Subsequently,we used the boosting-based XGBoost algorithm to train a prediction model and finally used it to predict whether users require navigation assistance in a roaming task.Results After evaluating the performance of the model,the accuracy,precision,recall,and F1-score of our model reached approximately 95%.In addition,by applying the model to a virtual reality scene,an adaptive navigation assistance system based on the real-time eye movement data of the user was implemented.Conclusions Compared with traditional navigation assistance methods,our new adaptive navigation assistance method could enable the user to be more immersive and effective while roaming in a virtual reality(VR)environment.
文摘In a building, the paint coating applied to interior walls conveys their aesthetic character and also performs an important function of protection. It is a construction component which is exposed to agents of deterioration related to its use, needing the regular evaluation of its state of repair. The completed model supports the performance of such periodic inspections and the monitoring of interior wall maintenance, using Virtual Reality (VR) technology. Used during an inspection visit, the application allows users to consult a database of irregularities, normally associated with paint coating, classified by the most probable causes and by recommended repair methodologies. In addition, with this model, a chromatic scale related to the degree of deterioration of the coating, defined as a function of the time between the dates of the application of the paint and the scheduled repainting, can be attributed to each element of coating monitored. This use of VR technology allows inspections and the evaluation of the degree of wear and tear of materials to be carried out in a highly direct and intuitive manner. The computer application has a positive contribution to make in the field of construction, using as it does Information Technology (IT) tools which give access to innovative technology with it capacity for interaction and visualization.
文摘In the last few decades, technology found its way from being a wild sci-fi dream, only seen in movies, to being an important element of all aspects of life. The technological industry bloomed quite rapidly where the technological solutions have made any process you can think of easier, faster and more efficient. Educational methodologies started off simple, having a teacher using simply his/her words and some writing along with it. With technology entering the field of education, teaching methods were enhanced and the quality of its outcomes was improved. However, sadly in Arab countries that was not the story. In other words, the use of new education technologies is still limited to basic and simple tasks. In fact, to add to the agony, most of the programs used are poorly implemented and rarely applied. Interestingly, as many studies confirm and from the simple observation of kids playing, it is found that most children are very attracted to new technologies and their applications. Those interests not only changed what a normal childhood would look like, but also introduced a multi-billion industry of electronic games. Virtual Reality (VR) games were introduced a few years back starting a gaming revolution, allowing gamers to enter the world of their dreams. Similar to most technologies, VR started to become more affordable with time. Multiple companies have competed to give us amazing VR products such as Samsung Gear. In this manuscript, we present a Virtual Reality Educational Game (VREG), which is an interactive 3D game with Arabic content that targets the students between age 4 and 8 and can be played on a smart phone. VREG includes multiple games that cover the different concepts of Arabic and English languages alongside math, aiming to help the student to learn through playing. In order to make sure that our game reaches wanted education standards, we put it to the test in two private schools;the feedback was very positive from both teachers and students where the majority of users enjoyed their experiments in VR games.
基金Supported by Natural Science Foundation of China(U1713210).
文摘Haptic interaction plays an important role in the virtual reality technology,which let a person not only view the 3D virtual environment but also realistically touch the virtual environment.As a key part of haptic interaction,force feedback has become an essential function for the haptic interaction.Therefore,multi-dimensional force sensors are widely used in the fields of virtual reality and augmented reality.In this paper,some conventional multi-dimensional force sensors based on different measurement principles,such as resistive,capacitive,piezoelectric,are briefly introduced.Then the mechanical structures of the elastic body of multi-dimensional force sensors are reviewed.It is obvious that the performance of the multi-dimensional force sensor is mainly dependent upon the mechanical structure of elastic body.Furthermore,the calibration process of the force sensor is analyzed,and problems in calibration are discussed.Interdimensional coupling error is one of the main factors affecting the measurement precision of the multi-dimensional force sensors.Therefore,reducing or even eliminating dimensional coupling error becomes a fundamental requirement in the design of multi-dimensional force sensors,and the decoupling state-of-art of the multi-dimensional force sensors are introduced in this paper.At last,the trends and current challenges of multi-dimensional force sensing technology are proposed.
文摘Background Gesture is a basic interaction channel that is frequently used by humans to communicate in daily life. In this paper, we explore to use gesture-based approaches for target acquisition in virtual and augmented reality. A typical process of gesture-based target acquisition is: when a user intends to acquire a target, she performs a gesture with her hands, head or other parts of the body, the computer senses and recognizes the gesture and infers the most possible target. Methods We build mental model and behavior model of the user to study two key parts of the interaction process. Mental model describes how user thinks up a gesture for acquiring a target, and can be the intuitive mapping between gestures and targets. Behavior model describes how user moves the body parts to perform the gestures, and the relationship between the gesture that user intends to perform and signals that computer senses. Results In this paper, we present and discuss three pieces of research that focus on the mental model and behavior model of gesture-based target acquisition in VR and AR. Conclusions We show that leveraging these two models, interaction experience and performance can be improved in VR and AR environments.
基金Centre for Digital Entertainment(EP/L016540/1,EPSRC,UK)。
文摘Background Virtual reality(VR)in healthcare training has increased adoption and support,but efforts are still required to mitigate usability concerns.Methods This study conducted a usability study of an in-use emergency medicine VR training application,available on commercially available VR hardware and with a standard interaction design.Nine users without prior VR experience but with relevant medical expertise completed two simulation scenarios for a total of 18 recorded sessions.They completed NASA Task Load Index and System Usability Scale questionnaires after each session,and their performance was recorded for the tracking of user errors.Results and Conclusions Our results showed a medium(and potentially optimal)Workload and an above average System Usability Score.There was significant improvement in several factors between users'first and second sessions,notably increased Performance evaluation.User errors with the strongest correlation to usability were not directly tied to interaction design,however,but to a limited'possibility space'.Suggestions for closing this'gulf of execution'were presented,including'voice control'and'hand-tracking',which are only feasible for this commercial product now with the availability of the Oculus Quest headset.Moreover,wider implications for VR medical training were outlined,and potential next steps towards a standardized design identified.
