This research paper introduces a soft VR glove that enhances how users interact with virtual objects. It seamlessly integrates discrete modules for sensing and providing haptic feedback, encompassing tactile and kinae...This research paper introduces a soft VR glove that enhances how users interact with virtual objects. It seamlessly integrates discrete modules for sensing and providing haptic feedback, encompassing tactile and kinaesthetic aspects while prioritizing wearability and natural finger movements. The glove employs custom-designed flexible bend sensors with carbon-impregnated film for in-situ joint angle tracking, simplifying the sensing system and enhancing portability. A multi-modal haptic feedback approach includes an innovative pneumatically actuated tactile feedback technique and a motor-tendon-driven kinaesthetic feedback system, providing exceptional realism in virtual object manipulation. The glove’s kinaesthetic feedback lets users perceive virtual objects’ size, shape, and stiffness characteristics. Psychophysical investigations demonstrate how readily the users acclimate to this hardware and prove each module’s effectiveness and synergistic operation. This soft VR glove represents a minimalist, lightweight, and comprehensive solution for authentic haptic interaction in virtual environments, opening new possibilities for applications in various fields.展开更多
Microrobots powered by an external magnetic field could be used for sophisticated medical applications such as cell treatment,micromanipulation,and noninvasive surgery inside the body.Untethered microrobot application...Microrobots powered by an external magnetic field could be used for sophisticated medical applications such as cell treatment,micromanipulation,and noninvasive surgery inside the body.Untethered microrobot applications can benefit from haptic technology and telecommunication,enabling telemedical micro-manipulation.Users can manipulate the microrobots with haptic feedback by interacting with the robot operating system remotely in such applications.Artificially created haptic forces based on wirelessly transmitted data and model-based guidance can aid human operators with haptic sensations while manipulating microrobots.The system presented here includes a haptic device and a magnetic tweezer system linked together using a network-based teleoperation method with motion models in fluids.The magnetic microrobots can be controlled remotely,and the haptic interactions with the remote environment can be felt in real time.A time-domain passivity controller is applied to overcome network delay and ensure stability of communication.This study develops and tests a motion model for microrobots and evaluates two image-based 3D tracking algorithms to improve tracking accuracy in various Newtonian fluids.Additionally,it demonstrates that microrobots can group together to transport multiple larger objects,move through microfluidic channels for detailed tasks,and use a novel method for disassembly,greatly expanding their range of use in microscale operations.Remote medical treatment in multiple locations,remote delivery of medication without the need for physical penetration of the skin,and remotely controlled cell manipulations are some of the possible uses of the proposed technology.展开更多
In the realm of virtual reality(VR),haptic feedback is integral to enhance the immersive experience;yet,existing wearable devices predominantly rely on skin contact feedback,lacking options for compact and non-contact...In the realm of virtual reality(VR),haptic feedback is integral to enhance the immersive experience;yet,existing wearable devices predominantly rely on skin contact feedback,lacking options for compact and non-contact breeze-sense feedback.Herein,we propose a compact and non-contact working model piezoelectret actuator for providing a gentle and safe breeze sensation.This easy-fabricated and flexible breeze-sense generator with thickness around 1 mm generates air flow pressure up to~163 Pa,which is significantly sensed by human skin.In a typical demonstration,the breeze-sense generators array showcases its versatility by employing multiple coded modes for non-contact information transmitting.The thin thinness and good flexibility facilitate seamless integration with wearable VR setups,and the wearable arrays empower volunteers to precisely perceive the continuous and sudden breeze senses in the virtual environments.This work is expected to inspire developing new haptic feedback devices that play pivotal roles in human-machine interfaces for VR applications.展开更多
Background Haptic feedback plays a crucial role in virtual reality(VR)interaction,helping to improve the precision of user operation and enhancing the immersion of the user experience.Instrumental haptic feedback in v...Background Haptic feedback plays a crucial role in virtual reality(VR)interaction,helping to improve the precision of user operation and enhancing the immersion of the user experience.Instrumental haptic feedback in virtual environments is primarily realized using grounded force or vibration feedback devices.However,improvements are required in terms of the active space and feedback realism.Methods We propose a lightweight and flexible haptic feedback glove that can haptically render objects in VR environments via kinesthetic and vibration feedback,thereby enabling users to enjoy a rich virtual piano-playing experience.The kinesthetic feedback of the glove relies on a cable-pulling mechanism that rotates the mechanism and pulls the two cables connected to it,thereby changing the amount of force generated to simulate the hardness or softness of the object.Vibration feedback is provided by small vibration motors embedded in the bottom of the fingertips of the glove.We designed a piano-playing scenario in the virtual environment and conducted user tests.The evaluation metrics were clarity,realism,enjoyment,and satisfaction.Results A total of 14 subjects participated in the test,and the results showed that our proposed glove scored significantly higher on the four evaluation metrics than the nofeedback and vibration feedback methods.Conclusions Our proposed glove significantly enhances the user experience when interacting with virtual objects.展开更多
Background The sense of touch plays a crucial role in interactive behavior within virtual spaces,particularly when visual attention is absent.Although haptic feedback has been widely used to compensate for the lack of...Background The sense of touch plays a crucial role in interactive behavior within virtual spaces,particularly when visual attention is absent.Although haptic feedback has been widely used to compensate for the lack of visual cues,the use of tactile information as a predictive feedforward cue to guide hand movements remains unexplored and lacks theoretical understanding.Methods This study introduces a fingertip aero-haptic rendering method to investigate its effectiveness in directing hand movements during eyes-free spatial interactions.The wearable device incorporates a multichannel micro-airflow chamber to deliver adjustable tactile effects on the fingertips.Results The first study verified that tactile directional feedforward cues significantly improve user capabilities in eyes-free target acquisition and that users rely heavily on haptic indications rather than spatial memory to control their hands.A subsequent study examined the impact of enriched tactile feedforward cues on assisting users in determining precise target positions during eyes-free interactions,and assessed the required learning efforts.Conclusions The haptic feedforward effect holds great practical promise in eyeless design for virtual reality.We aim to integrate cognitive models and tactile feedforward cues in the future,and apply richer tactile feedforward information to alleviate users'perceptual deficiencies.展开更多
Immersion, interaction, and imagination are three features of virtual reality (VR). Existing VR systems possess fairly realistic visual and auditory feedbacks, and however, are poor with haptic feedback, by means of w...Immersion, interaction, and imagination are three features of virtual reality (VR). Existing VR systems possess fairly realistic visual and auditory feedbacks, and however, are poor with haptic feedback, by means of which human can perceive the physical world via abundant haptic properties. Haptic display is an interface aiming to enable bilateral signal communications between human and computer, and thus to greatly enhance the immersion and interaction of VR systems. This paper surveys the paradigm shift of haptic display occurred in the past 30 years, which is classified into three stages, including desktop haptics, surface haptics, and wearable haptics. The driving forces, key technologies and typical applications in each stage are critically reviewed. Toward the future high-fidelity VR interaction, research challenges are highlighted concerning handheld haptic device, multimodal haptic device, and high fidelity haptic rendering. In the end, the importance of understanding human haptic perception for designing effective haptic devices is addressed.展开更多
BACKGROUND Perception is frequently impaired in patients with Alzheimer’s disease(AD).Several patients exhibit visual or haptic hallucinations.CASE SUMMARY A 71-year-old Chinese man presented with visual and haptic h...BACKGROUND Perception is frequently impaired in patients with Alzheimer’s disease(AD).Several patients exhibit visual or haptic hallucinations.CASE SUMMARY A 71-year-old Chinese man presented with visual and haptic hallucinations he had been experiencing for 2 weeks.The clinical manifestations were the feeling of insects crawling and biting the limbs and geison.He looked for the insects while itching and scratching,which led to skin breakage on the limbs.He was treated with topical and anti-allergic drugs in several dermatology departments without any significant improvement.After admission,the patient was administered risperidone(0.5 mg)and duloxetine(2 mg/day).One week later,the dose of risperidone was increased to 2 mg/day,and that of duloxetine was increased to 60 mg/day.After 2 weeks of treatment,the patient’s sensation of insects crawling and biting disappeared,and his mood stabilized.CONCLUSION This patient manifested psychiatric behavioral symptoms caused by AD brain atrophy.It was important to re-evaluate the patient’s cognitive-psychological status when the patient repeatedly went to the hospital for treatment.Follow-up attention to cognitive function and the consideration of perceptual deficits as early manifestations of AD should be considered.展开更多
The utilization of high-resolution haptic feedback devices in a virtual reality(VR)environment can increase the precision of controlling remotely operated vehicles and reduce training costs for subsea construction ope...The utilization of high-resolution haptic feedback devices in a virtual reality(VR)environment can increase the precision of controlling remotely operated vehicles and reduce training costs for subsea construction operations.This paper introduces a novel flexible-driven wearable pin-array device.The spatial separation of the control box and actuator allows the device to attain natural and seamless interactive movements while delivering high-density haptic feedback in VR.The pin array consists of 25 haptic pin modules that run on a linear servo motor via a flexible shaft for force transmission.The analysis and calculation of the flexible transmission resistance effect using the haptic pin module's shaft length and bending radius were conducted.A series of experiments was performed to gather comprehensive data on the pin module's output,transmission resistance and error,and response delay to optimize its structural design and transmission strategy.The device's effectiveness in rendering shape and coarse texture was evaluated via two user studies.The results affirm that the introduced device enables users to precisely discern seven shapes and four distinct coarse surfaces.展开更多
Haptic communications is recognized as a promising enabler of extensive services by enabling real-time haptic control and feedback in remote environments,e.g.,teleoperation and autonomous driving.Considering the stric...Haptic communications is recognized as a promising enabler of extensive services by enabling real-time haptic control and feedback in remote environments,e.g.,teleoperation and autonomous driving.Considering the strict transmission requirements on reliability and latency,Device-to-Device(D2D)communications is introduced to assist haptic communications.In particular,the teleoperators with poor channel quality are assisted by auxiliaries,and each auxiliary and its corresponding teleoperator constitute a D2D pair.However,the haptic interaction and the scarcity of radio resources pose severe challenges to the resource allocation,especially facing the sporadic packet arrivals.First,the contentionbased access scheme is applied to achieve low-latency transmission,where the resource scheduling latency is omitted and users can directly access available resources.In this context,we derive the reliability index of D2D pairs under the contention-based access scheme,i.e.,closed-loop packet error probability.Then,the reliability performance is guaranteed by bidirectional power control,which aims to minimize the sum packet error probability of all D2D pairs.Potential game theory is introduced to solve the problem with low complexity.Accordingly,a distributed power control algorithm based on synchronous log-linear learning is proposed to converge to the optimal Nash Equilibrium.Experimental results demonstrate the superiority of the proposed learning algorithm.展开更多
Background Laparoscopic surgery is a surgical technique in which special instruments are inserted through small incision holes inside the body.For some time,efforts have been made to improve surgical pre training thro...Background Laparoscopic surgery is a surgical technique in which special instruments are inserted through small incision holes inside the body.For some time,efforts have been made to improve surgical pre training through practical exercises on abstracted and reduced models.Methods The authors strive for a portable,easy to use and cost-effective Virtual Reality-based(VR)laparoscopic pre-training platform and therefore address the question of how such a system has to be designed to achieve the quality of today's gold standard using real tissue specimens.Current VR controllers are limited regarding haptic feedback.Since haptic feedback is necessary or at least beneficial for laparoscopic surgery training,the platform to be developed consists of a newly designed prototype laparoscopic VR controller with haptic feedback,a commercially available head-mounted display,a VR environment for simulating a laparoscopic surgery,and a training concept.Results To take full advantage of benefits such as repeatability and cost-effectiveness of VR-based training,the system shall not require a tissue sample for haptic feedback.It is currently calculated and visually displayed to the user in the VR environment.On the prototype controller,a first axis was provided with perceptible feedback for test purposes.Two of the prototype VR controllers can be combined to simulate a typical both-handed use case,e.g.,laparoscopic suturing.A Unity based VR prototype allows the execution of simple standard pre-trainings.Conclusions The first prototype enables full operation of a virtual laparoscopic instrument in VR.In addition,the simulation can compute simple interaction forces.Major challenges lie in a realistic real-time tissue simulation and calculation of forces for the haptic feedback.Mechanical weaknesses were identified in the first hardware prototype,which will be improved in subsequent versions.All degrees of freedom of the controller are to be provided with haptic feedback.To make forces tangible in the simulation,characteristic values need to be determined using real tissue samples.The system has yet to be validated by cross-comparing real and VR haptics with surgeons.展开更多
Introduction: This paper presents the design, development, and usability evaluation of a custom haptic syringe aimed to improve the realism of a virtual reality local anesthesia simulation (VRLA), specifically for the...Introduction: This paper presents the design, development, and usability evaluation of a custom haptic syringe aimed to improve the realism of a virtual reality local anesthesia simulation (VRLA), specifically for the inferior alveolar nerve block (IANB), that formally used a head mounted device (HMD) and vibration feedback via hand controllers. The custom haptic syringe interface provides a more realistic tactile sensation of plunging a real syringe in a human patient. This pilot study investigated the usability of the custom haptic syringe to replace one of the hand controllers to provide a more realistic and better training experience. Method: A one group pre-post survey investigated student perceptions regarding the effectiveness and usability of a haptic syringe to provide a more realistic experience to train dental students to learn the procedural steps to inject local anesthesia into a virtual patient. Twenty-two third year dental students participated. The pre-post survey examined changes in students’ perceived emotions, preparedness, and effectiveness of the VRLA as a foundational learning strategy prior to entering clinical group practice. Results: While quantitative results on comparable survey questions did not yield statistically significant differences, qualitative open-ended responses revealed a much greater satisfaction using the custom haptic syringe compared to the out of the box controllers. Conclusions: Feedback regarding the haptic syringe showed a substantial step closer to providing a more real experience for students in an effort to create a better bridge between classroom learning and clinical practice in order to prepare students to more confidently and competently work with real clients. Further refinement of the syringe is forthcoming along with a more formal comparative experimental study.展开更多
A haptic device is proposed which gives the user feedback information on their location and orientation of the obstacle through the mobile robot that detects the obstacle in an environment where the user cannot see.Mo...A haptic device is proposed which gives the user feedback information on their location and orientation of the obstacle through the mobile robot that detects the obstacle in an environment where the user cannot see.Mobile robot recognizes the exact position of the obstacle through configuring the nested ultrasonic sensor and giving feedback information to the haptic device.The haptic device consisting of five vibration motors can realize the haptic through the vibration of user's finger using the position information of the obstacle received feedback.In addition,it has high accuracy to recognize the surrounding environment and realizes the various situations with the fuzzy controller and the nested ultrasonic sensors.展开更多
In this paper, we make a comparison of haptic control schemes （position-position and position-force control schemes） for two haptic teleoperation systems by QoE （quality of experience） assessment. One is a remote ...In this paper, we make a comparison of haptic control schemes （position-position and position-force control schemes） for two haptic teleoperation systems by QoE （quality of experience） assessment. One is a remote control system with haptic media and video. In the system, we can write characters by controlling a haptic interface device at a remote place with another haptic interface device while watching video. The other is a remote instruction system with haptic media, video and voice. By using the system, a teacher can actively write characters and teach a student how to write the characters. The student can also write characters actively, and the teacher can confirm how the student writes the characters. We investigate the influences of network delay on QoE for the two systems with the two haptic control schemes.展开更多
This paper presents a new solution to haptic based teleoperation to control a large-sized slave robot for space exploration, which includes two specially designed haptic joysticks, a hybrid master-slave motion mapping...This paper presents a new solution to haptic based teleoperation to control a large-sized slave robot for space exploration, which includes two specially designed haptic joysticks, a hybrid master-slave motion mapping method, and a haptic feedback model rendering the operating resistance and the interactive feedback on the slave side. Two devices using the 3 R and DELTA mechanisms respectively are developed to be manipulated to control the position and orientation of a large-sized slave robot by using both of a user's two hands respectively. The hybrid motion mapping method combines rate control and variable scaled position mapping to realize accurate and efficient master-slave control. Haptic feedback for these two mapping modes is designed with emphasis on ergonomics to improve the immersion of haptic based teleoperation. A stiffness estimation method is used to calculate the contact stiffness on the slave side and play the contact force rendered by using a traditional spring-damping model to a user on the master side stably. Experiments by using virtual environments to simulate the slave side are conducted to validate the effectiveness and efficiency of the proposed solution.展开更多
With the development of human robot interaction technologies, haptic interfaces are widely used for 3 D applications to provide the sense of touch. These interfaces have been utilized in medical simulation, virtual as...With the development of human robot interaction technologies, haptic interfaces are widely used for 3 D applications to provide the sense of touch. These interfaces have been utilized in medical simulation, virtual assembly and remote manipulation tasks. However, haptic interface design and control are still critical problems to reproduce the highly sensitive touch sense of humans. This paper presents the development and evaluation of a7-DOF(degree of freedom) haptic interface based on the modified delta mechanism. Firstly, both kinematics and dynamics of the modified mechanism are analyzed and presented. A novel gravity compensation algorithm based on the physical model is proposed and validated in simulation. A haptic controller is proposed based on the forward kinematics and the gravity compensation algorithm. To evaluate the control performance of the haptic interface, a prototype has been implemented. Three kinds of experiments: gravity compensation, static response and force tracking are performed respectively. The experimental results show that the mean error of the gravity compensation is less than 0.7 N and the maximum continuous force along the axis can be up to 6 N. This demonstrates the good performance of the proposed haptic interface.展开更多
To improve the accuracy and interactivity of soft tissue delormatlon simulation, a new plate spring model based on physics is proposed. The model is parameterized and thus can be adapted to simulate different organs. ...To improve the accuracy and interactivity of soft tissue delormatlon simulation, a new plate spring model based on physics is proposed. The model is parameterized and thus can be adapted to simulate different organs. Different soft tissues are modeled by changing the width, number of pieces, thickness, and length of a single plate spring. In this paper, the structural design, calcula- tion of soft tissue deformation and real-time feedback operations of our system are also introduced. To evaluate the feasibility of the system and validate the model, an experimental system of haptic in- teraction, in which users can use virtual hands to pull virtual brain tissues, is built using PHANTOM OMNI devices. Experimental results show that the proposed system is stable, accurate and promising for modeling instantaneous soft tissue deformation.展开更多
AIM:To evaluate the safety and efficacy of scleral-fixated 3-looped haptics intraocular lens(IOL)implantation for surgical management of microspherophakia.METHODS:A retrospective case series include 10 microspherophak...AIM:To evaluate the safety and efficacy of scleral-fixated 3-looped haptics intraocular lens(IOL)implantation for surgical management of microspherophakia.METHODS:A retrospective case series include 10 microspherophakic patients(15 eyes)who underwent lens removal plus a modified surgical treatment of scleral-fixated 3-looped haptics IOL implantation.The primary outcomes involved visual acuity,intraocular pressure(IOP).Secondary outcomes were spherical equivalent(SE),anterior chamber depth(ACD),corneal endothelial cell density and postoperative complications.RESULTS:After a postoperative follow-up of 17.60±15.44mo,improved visual outcomes can be observed.The uncorrected distance visual acuity(UCVA)log MAR improved from 1.54±0.59 preoperatively to 0.51±0.35 postoperatively(P=0.001),and best corrected visual acuity(BCVA)log MAR improved from 0.97±0.91 preoperatively to 0.24±0.23 postoperatively(P=0.003).Moreover,the SE decreased from-9.58±7.47D preoperatively to-0.65±2.21 D postoperatively(P<0.001).In terms of safety profile,the average IOP decreased from 21.10±12.94 mm Hg preoperatively to 14.03±3.57 mm Hg postoperatively(P=0.044),and the previously elevated IOP of three eyes decreased to the normal range.The ACD increased from 2.25±1.45 mm preoperatively to 3.35±0.39 mm postoperatively(P=0.017).The density of corneal endothelial cells did not change significantly after surgery(P=0.140).The posterior chamber IOLs were well centered and no severe complications were found.CONCLUSION:Lens removal plus the modified surgical treatment of scleral-fixated 3-looped haptics IOL implantation can help in improvement of visual acuity,which can be regarded as a relative safe method for the surgical management of microspherophakia.展开更多
Reducing energy consumption has become a matter of increasing concern for electric vehicle owners. EcoDriver is a project funded by the European Commission, searching for new eco-driving solutions for reducing energy ...Reducing energy consumption has become a matter of increasing concern for electric vehicle owners. EcoDriver is a project funded by the European Commission, searching for new eco-driving solutions for reducing energy consumption in private and public transport. EcoDriver’s main purpose is to teach efficient driving strategies and facilitate drivers’ decision-making processes through several feedback modalities, in order to help increase driving efficiency and therefore reduce energy consumption. In the present study, the Full ecoDriver System combined with a haptic feedback gas pedal was tested in real driving conditions to give answers to some questions about its effectiveness, efficiency, workload and acceptability in an electric vehicle. The sample profile was composed by thirty young but experienced drivers. They had to drive around an open road track which allowed several possible scenarios such as curves, intersection or roundabout, speed limit changes and preceding vehicles. Average speed was registered on each lap, likewise other subjective measurements. The main results suggest that the efficiency benefits achieved while driving depend on the event type and the feedback modality provided. For instance haptic feedback seems to be especially indicated for roundabouts. In addition, the visual feedback provided by the FeDS nomadic device helps to save energy and learn eco-driving strategies. These outcomes indicate how several feedback modalities could facilitate the decision making process, changing driving behaviour, reducing energy consumption and increasing safety. These questions would help advance further research on eco-driving Intelligent Transport Systems and driving behaviour issues.展开更多
This paper proposes a group synchronization control scheme with prediction in work using haptic media. The scheme adjusts the output timing among multiple terminals and keeps the interactivity high. It outputs positio...This paper proposes a group synchronization control scheme with prediction in work using haptic media. The scheme adjusts the output timing among multiple terminals and keeps the interactivity high. It outputs position information by predicting the future position later than the position included in the last-received information by a fixed amount of time. It also advances the output time of position information at each local terminal by the same amount of time. We deal with two different types of work using haptic media so as to demonstrate the effectiveness of the scheme. We assess the output quality of haptic media for the two types of work subjectively and objectively by Quality of Experience (QoE) assessment. We further clarify the relationship between subjective and objective assessment results.展开更多
基金CSIR research grant HCP-26 supported the work reported in this article.
文摘This research paper introduces a soft VR glove that enhances how users interact with virtual objects. It seamlessly integrates discrete modules for sensing and providing haptic feedback, encompassing tactile and kinaesthetic aspects while prioritizing wearability and natural finger movements. The glove employs custom-designed flexible bend sensors with carbon-impregnated film for in-situ joint angle tracking, simplifying the sensing system and enhancing portability. A multi-modal haptic feedback approach includes an innovative pneumatically actuated tactile feedback technique and a motor-tendon-driven kinaesthetic feedback system, providing exceptional realism in virtual object manipulation. The glove’s kinaesthetic feedback lets users perceive virtual objects’ size, shape, and stiffness characteristics. Psychophysical investigations demonstrate how readily the users acclimate to this hardware and prove each module’s effectiveness and synergistic operation. This soft VR glove represents a minimalist, lightweight, and comprehensive solution for authentic haptic interaction in virtual environments, opening new possibilities for applications in various fields.
基金supported by National Science Foundation Grant No.2123824.
文摘Microrobots powered by an external magnetic field could be used for sophisticated medical applications such as cell treatment,micromanipulation,and noninvasive surgery inside the body.Untethered microrobot applications can benefit from haptic technology and telecommunication,enabling telemedical micro-manipulation.Users can manipulate the microrobots with haptic feedback by interacting with the robot operating system remotely in such applications.Artificially created haptic forces based on wirelessly transmitted data and model-based guidance can aid human operators with haptic sensations while manipulating microrobots.The system presented here includes a haptic device and a magnetic tweezer system linked together using a network-based teleoperation method with motion models in fluids.The magnetic microrobots can be controlled remotely,and the haptic interactions with the remote environment can be felt in real time.A time-domain passivity controller is applied to overcome network delay and ensure stability of communication.This study develops and tests a motion model for microrobots and evaluates two image-based 3D tracking algorithms to improve tracking accuracy in various Newtonian fluids.Additionally,it demonstrates that microrobots can group together to transport multiple larger objects,move through microfluidic channels for detailed tasks,and use a novel method for disassembly,greatly expanding their range of use in microscale operations.Remote medical treatment in multiple locations,remote delivery of medication without the need for physical penetration of the skin,and remotely controlled cell manipulations are some of the possible uses of the proposed technology.
基金supported by the Science and Technology Development Fund of Macao SAR(File No.0117/2024/AMJ)University of Macao(MYRG-GRG2023-00041-FST-UMDF,MYRG-GRG2024-00121-FST,MYRG-CRG2024-00014-FST-ICI)Zhuhai UM Science&Technology Research Institute(CP-009-2024).
文摘In the realm of virtual reality(VR),haptic feedback is integral to enhance the immersive experience;yet,existing wearable devices predominantly rely on skin contact feedback,lacking options for compact and non-contact breeze-sense feedback.Herein,we propose a compact and non-contact working model piezoelectret actuator for providing a gentle and safe breeze sensation.This easy-fabricated and flexible breeze-sense generator with thickness around 1 mm generates air flow pressure up to~163 Pa,which is significantly sensed by human skin.In a typical demonstration,the breeze-sense generators array showcases its versatility by employing multiple coded modes for non-contact information transmitting.The thin thinness and good flexibility facilitate seamless integration with wearable VR setups,and the wearable arrays empower volunteers to precisely perceive the continuous and sudden breeze senses in the virtual environments.This work is expected to inspire developing new haptic feedback devices that play pivotal roles in human-machine interfaces for VR applications.
基金Supported by the Natienal Natural Science Foundation of China(U23A20287).
文摘Background Haptic feedback plays a crucial role in virtual reality(VR)interaction,helping to improve the precision of user operation and enhancing the immersion of the user experience.Instrumental haptic feedback in virtual environments is primarily realized using grounded force or vibration feedback devices.However,improvements are required in terms of the active space and feedback realism.Methods We propose a lightweight and flexible haptic feedback glove that can haptically render objects in VR environments via kinesthetic and vibration feedback,thereby enabling users to enjoy a rich virtual piano-playing experience.The kinesthetic feedback of the glove relies on a cable-pulling mechanism that rotates the mechanism and pulls the two cables connected to it,thereby changing the amount of force generated to simulate the hardness or softness of the object.Vibration feedback is provided by small vibration motors embedded in the bottom of the fingertips of the glove.We designed a piano-playing scenario in the virtual environment and conducted user tests.The evaluation metrics were clarity,realism,enjoyment,and satisfaction.Results A total of 14 subjects participated in the test,and the results showed that our proposed glove scored significantly higher on the four evaluation metrics than the nofeedback and vibration feedback methods.Conclusions Our proposed glove significantly enhances the user experience when interacting with virtual objects.
文摘Background The sense of touch plays a crucial role in interactive behavior within virtual spaces,particularly when visual attention is absent.Although haptic feedback has been widely used to compensate for the lack of visual cues,the use of tactile information as a predictive feedforward cue to guide hand movements remains unexplored and lacks theoretical understanding.Methods This study introduces a fingertip aero-haptic rendering method to investigate its effectiveness in directing hand movements during eyes-free spatial interactions.The wearable device incorporates a multichannel micro-airflow chamber to deliver adjustable tactile effects on the fingertips.Results The first study verified that tactile directional feedforward cues significantly improve user capabilities in eyes-free target acquisition and that users rely heavily on haptic indications rather than spatial memory to control their hands.A subsequent study examined the impact of enriched tactile feedforward cues on assisting users in determining precise target positions during eyes-free interactions,and assessed the required learning efforts.Conclusions The haptic feedforward effect holds great practical promise in eyeless design for virtual reality.We aim to integrate cognitive models and tactile feedforward cues in the future,and apply richer tactile feedforward information to alleviate users'perceptual deficiencies.
基金Supported by the National Key Research and Development Program(2017YFB1002803)the National Natural Science Foundation of China under the grants(61572055,61633004).
文摘Immersion, interaction, and imagination are three features of virtual reality (VR). Existing VR systems possess fairly realistic visual and auditory feedbacks, and however, are poor with haptic feedback, by means of which human can perceive the physical world via abundant haptic properties. Haptic display is an interface aiming to enable bilateral signal communications between human and computer, and thus to greatly enhance the immersion and interaction of VR systems. This paper surveys the paradigm shift of haptic display occurred in the past 30 years, which is classified into three stages, including desktop haptics, surface haptics, and wearable haptics. The driving forces, key technologies and typical applications in each stage are critically reviewed. Toward the future high-fidelity VR interaction, research challenges are highlighted concerning handheld haptic device, multimodal haptic device, and high fidelity haptic rendering. In the end, the importance of understanding human haptic perception for designing effective haptic devices is addressed.
文摘BACKGROUND Perception is frequently impaired in patients with Alzheimer’s disease(AD).Several patients exhibit visual or haptic hallucinations.CASE SUMMARY A 71-year-old Chinese man presented with visual and haptic hallucinations he had been experiencing for 2 weeks.The clinical manifestations were the feeling of insects crawling and biting the limbs and geison.He looked for the insects while itching and scratching,which led to skin breakage on the limbs.He was treated with topical and anti-allergic drugs in several dermatology departments without any significant improvement.After admission,the patient was administered risperidone(0.5 mg)and duloxetine(2 mg/day).One week later,the dose of risperidone was increased to 2 mg/day,and that of duloxetine was increased to 60 mg/day.After 2 weeks of treatment,the patient’s sensation of insects crawling and biting disappeared,and his mood stabilized.CONCLUSION This patient manifested psychiatric behavioral symptoms caused by AD brain atrophy.It was important to re-evaluate the patient’s cognitive-psychological status when the patient repeatedly went to the hospital for treatment.Follow-up attention to cognitive function and the consideration of perceptual deficits as early manifestations of AD should be considered.
文摘The utilization of high-resolution haptic feedback devices in a virtual reality(VR)environment can increase the precision of controlling remotely operated vehicles and reduce training costs for subsea construction operations.This paper introduces a novel flexible-driven wearable pin-array device.The spatial separation of the control box and actuator allows the device to attain natural and seamless interactive movements while delivering high-density haptic feedback in VR.The pin array consists of 25 haptic pin modules that run on a linear servo motor via a flexible shaft for force transmission.The analysis and calculation of the flexible transmission resistance effect using the haptic pin module's shaft length and bending radius were conducted.A series of experiments was performed to gather comprehensive data on the pin module's output,transmission resistance and error,and response delay to optimize its structural design and transmission strategy.The device's effectiveness in rendering shape and coarse texture was evaluated via two user studies.The results affirm that the introduced device enables users to precisely discern seven shapes and four distinct coarse surfaces.
基金supported in part by the Jiangsu Provincial Natural Science Foundation for Excellent Young Scholars(Grant No.BK20170089)in part by the National Natural Science Foundation of China(Grant No.61671474)in part by the Jiangsu Provincial Natural Science Fund for Outstanding Young Scholars(Grant No.BK20180028).
文摘Haptic communications is recognized as a promising enabler of extensive services by enabling real-time haptic control and feedback in remote environments,e.g.,teleoperation and autonomous driving.Considering the strict transmission requirements on reliability and latency,Device-to-Device(D2D)communications is introduced to assist haptic communications.In particular,the teleoperators with poor channel quality are assisted by auxiliaries,and each auxiliary and its corresponding teleoperator constitute a D2D pair.However,the haptic interaction and the scarcity of radio resources pose severe challenges to the resource allocation,especially facing the sporadic packet arrivals.First,the contentionbased access scheme is applied to achieve low-latency transmission,where the resource scheduling latency is omitted and users can directly access available resources.In this context,we derive the reliability index of D2D pairs under the contention-based access scheme,i.e.,closed-loop packet error probability.Then,the reliability performance is guaranteed by bidirectional power control,which aims to minimize the sum packet error probability of all D2D pairs.Potential game theory is introduced to solve the problem with low complexity.Accordingly,a distributed power control algorithm based on synchronous log-linear learning is proposed to converge to the optimal Nash Equilibrium.Experimental results demonstrate the superiority of the proposed learning algorithm.
文摘Background Laparoscopic surgery is a surgical technique in which special instruments are inserted through small incision holes inside the body.For some time,efforts have been made to improve surgical pre training through practical exercises on abstracted and reduced models.Methods The authors strive for a portable,easy to use and cost-effective Virtual Reality-based(VR)laparoscopic pre-training platform and therefore address the question of how such a system has to be designed to achieve the quality of today's gold standard using real tissue specimens.Current VR controllers are limited regarding haptic feedback.Since haptic feedback is necessary or at least beneficial for laparoscopic surgery training,the platform to be developed consists of a newly designed prototype laparoscopic VR controller with haptic feedback,a commercially available head-mounted display,a VR environment for simulating a laparoscopic surgery,and a training concept.Results To take full advantage of benefits such as repeatability and cost-effectiveness of VR-based training,the system shall not require a tissue sample for haptic feedback.It is currently calculated and visually displayed to the user in the VR environment.On the prototype controller,a first axis was provided with perceptible feedback for test purposes.Two of the prototype VR controllers can be combined to simulate a typical both-handed use case,e.g.,laparoscopic suturing.A Unity based VR prototype allows the execution of simple standard pre-trainings.Conclusions The first prototype enables full operation of a virtual laparoscopic instrument in VR.In addition,the simulation can compute simple interaction forces.Major challenges lie in a realistic real-time tissue simulation and calculation of forces for the haptic feedback.Mechanical weaknesses were identified in the first hardware prototype,which will be improved in subsequent versions.All degrees of freedom of the controller are to be provided with haptic feedback.To make forces tangible in the simulation,characteristic values need to be determined using real tissue samples.The system has yet to be validated by cross-comparing real and VR haptics with surgeons.
文摘Introduction: This paper presents the design, development, and usability evaluation of a custom haptic syringe aimed to improve the realism of a virtual reality local anesthesia simulation (VRLA), specifically for the inferior alveolar nerve block (IANB), that formally used a head mounted device (HMD) and vibration feedback via hand controllers. The custom haptic syringe interface provides a more realistic tactile sensation of plunging a real syringe in a human patient. This pilot study investigated the usability of the custom haptic syringe to replace one of the hand controllers to provide a more realistic and better training experience. Method: A one group pre-post survey investigated student perceptions regarding the effectiveness and usability of a haptic syringe to provide a more realistic experience to train dental students to learn the procedural steps to inject local anesthesia into a virtual patient. Twenty-two third year dental students participated. The pre-post survey examined changes in students’ perceived emotions, preparedness, and effectiveness of the VRLA as a foundational learning strategy prior to entering clinical group practice. Results: While quantitative results on comparable survey questions did not yield statistically significant differences, qualitative open-ended responses revealed a much greater satisfaction using the custom haptic syringe compared to the out of the box controllers. Conclusions: Feedback regarding the haptic syringe showed a substantial step closer to providing a more real experience for students in an effort to create a better bridge between classroom learning and clinical practice in order to prepare students to more confidently and competently work with real clients. Further refinement of the syringe is forthcoming along with a more formal comparative experimental study.
基金The MOTIE(Ministry of Trade,Industry and Energy),Korea,under the Human Resources Development Program for Special Environment Navigation Localization National Robotics Research Center support program supervised by the NIPA(National IT Industry Promotion Agency)(H1502-13-1001)The MSIP(Ministry of Science,ICT&Future Planning),Korea,under the ITRC(Information Technology Research Center)support program(NIPA-2013-H0301-13-2006)supervised by the NIPA
文摘A haptic device is proposed which gives the user feedback information on their location and orientation of the obstacle through the mobile robot that detects the obstacle in an environment where the user cannot see.Mobile robot recognizes the exact position of the obstacle through configuring the nested ultrasonic sensor and giving feedback information to the haptic device.The haptic device consisting of five vibration motors can realize the haptic through the vibration of user's finger using the position information of the obstacle received feedback.In addition,it has high accuracy to recognize the surrounding environment and realizes the various situations with the fuzzy controller and the nested ultrasonic sensors.
文摘In this paper, we make a comparison of haptic control schemes （position-position and position-force control schemes） for two haptic teleoperation systems by QoE （quality of experience） assessment. One is a remote control system with haptic media and video. In the system, we can write characters by controlling a haptic interface device at a remote place with another haptic interface device while watching video. The other is a remote instruction system with haptic media, video and voice. By using the system, a teacher can actively write characters and teach a student how to write the characters. The student can also write characters actively, and the teacher can confirm how the student writes the characters. We investigate the influences of network delay on QoE for the two systems with the two haptic control schemes.
基金supported by the Open Research Fund of Key Laboratory of Space Utilization,Chinese Academy of Sciences(No.LSU-YKZX-2017-02)
文摘This paper presents a new solution to haptic based teleoperation to control a large-sized slave robot for space exploration, which includes two specially designed haptic joysticks, a hybrid master-slave motion mapping method, and a haptic feedback model rendering the operating resistance and the interactive feedback on the slave side. Two devices using the 3 R and DELTA mechanisms respectively are developed to be manipulated to control the position and orientation of a large-sized slave robot by using both of a user's two hands respectively. The hybrid motion mapping method combines rate control and variable scaled position mapping to realize accurate and efficient master-slave control. Haptic feedback for these two mapping modes is designed with emphasis on ergonomics to improve the immersion of haptic based teleoperation. A stiffness estimation method is used to calculate the contact stiffness on the slave side and play the contact force rendered by using a traditional spring-damping model to a user on the master side stably. Experiments by using virtual environments to simulate the slave side are conducted to validate the effectiveness and efficiency of the proposed solution.
基金supported by the National Natural Science Foundation(NNSF)of China(61533016,U1613210)the National High-tech Research and Development Program(863 Program)of China(2015AA042306)the Beijing Natural Science Foundation(4161001)
文摘With the development of human robot interaction technologies, haptic interfaces are widely used for 3 D applications to provide the sense of touch. These interfaces have been utilized in medical simulation, virtual assembly and remote manipulation tasks. However, haptic interface design and control are still critical problems to reproduce the highly sensitive touch sense of humans. This paper presents the development and evaluation of a7-DOF(degree of freedom) haptic interface based on the modified delta mechanism. Firstly, both kinematics and dynamics of the modified mechanism are analyzed and presented. A novel gravity compensation algorithm based on the physical model is proposed and validated in simulation. A haptic controller is proposed based on the forward kinematics and the gravity compensation algorithm. To evaluate the control performance of the haptic interface, a prototype has been implemented. Three kinds of experiments: gravity compensation, static response and force tracking are performed respectively. The experimental results show that the mean error of the gravity compensation is less than 0.7 N and the maximum continuous force along the axis can be up to 6 N. This demonstrates the good performance of the proposed haptic interface.
基金Supported by the National High Technology Research and Development Programme of China(No.2013AA010803,2009AA01Z311,2009AA01Z314)the National Natural Science Foundation of China(No.61304205,61203316,61272379,61103086,41301037)+3 种基金the Natural Science Foundation of Jiangsu Province(BK20141002)the Open Funding Project of State Key Laboratory of Virtual Reality Technology and Systems,Beihang University,Jiangsu Ordinary University Science Research Project(No.13KJB120007)Innovation and Entrepreneurship Training Project of College Students(No.201410300153,201410300165)the Excellent Undergraduate Paper(design)Supporting Project of NUIST
文摘To improve the accuracy and interactivity of soft tissue delormatlon simulation, a new plate spring model based on physics is proposed. The model is parameterized and thus can be adapted to simulate different organs. Different soft tissues are modeled by changing the width, number of pieces, thickness, and length of a single plate spring. In this paper, the structural design, calcula- tion of soft tissue deformation and real-time feedback operations of our system are also introduced. To evaluate the feasibility of the system and validate the model, an experimental system of haptic in- teraction, in which users can use virtual hands to pull virtual brain tissues, is built using PHANTOM OMNI devices. Experimental results show that the proposed system is stable, accurate and promising for modeling instantaneous soft tissue deformation.
文摘AIM:To evaluate the safety and efficacy of scleral-fixated 3-looped haptics intraocular lens(IOL)implantation for surgical management of microspherophakia.METHODS:A retrospective case series include 10 microspherophakic patients(15 eyes)who underwent lens removal plus a modified surgical treatment of scleral-fixated 3-looped haptics IOL implantation.The primary outcomes involved visual acuity,intraocular pressure(IOP).Secondary outcomes were spherical equivalent(SE),anterior chamber depth(ACD),corneal endothelial cell density and postoperative complications.RESULTS:After a postoperative follow-up of 17.60±15.44mo,improved visual outcomes can be observed.The uncorrected distance visual acuity(UCVA)log MAR improved from 1.54±0.59 preoperatively to 0.51±0.35 postoperatively(P=0.001),and best corrected visual acuity(BCVA)log MAR improved from 0.97±0.91 preoperatively to 0.24±0.23 postoperatively(P=0.003).Moreover,the SE decreased from-9.58±7.47D preoperatively to-0.65±2.21 D postoperatively(P<0.001).In terms of safety profile,the average IOP decreased from 21.10±12.94 mm Hg preoperatively to 14.03±3.57 mm Hg postoperatively(P=0.044),and the previously elevated IOP of three eyes decreased to the normal range.The ACD increased from 2.25±1.45 mm preoperatively to 3.35±0.39 mm postoperatively(P=0.017).The density of corneal endothelial cells did not change significantly after surgery(P=0.140).The posterior chamber IOLs were well centered and no severe complications were found.CONCLUSION:Lens removal plus the modified surgical treatment of scleral-fixated 3-looped haptics IOL implantation can help in improvement of visual acuity,which can be regarded as a relative safe method for the surgical management of microspherophakia.
文摘Reducing energy consumption has become a matter of increasing concern for electric vehicle owners. EcoDriver is a project funded by the European Commission, searching for new eco-driving solutions for reducing energy consumption in private and public transport. EcoDriver’s main purpose is to teach efficient driving strategies and facilitate drivers’ decision-making processes through several feedback modalities, in order to help increase driving efficiency and therefore reduce energy consumption. In the present study, the Full ecoDriver System combined with a haptic feedback gas pedal was tested in real driving conditions to give answers to some questions about its effectiveness, efficiency, workload and acceptability in an electric vehicle. The sample profile was composed by thirty young but experienced drivers. They had to drive around an open road track which allowed several possible scenarios such as curves, intersection or roundabout, speed limit changes and preceding vehicles. Average speed was registered on each lap, likewise other subjective measurements. The main results suggest that the efficiency benefits achieved while driving depend on the event type and the feedback modality provided. For instance haptic feedback seems to be especially indicated for roundabouts. In addition, the visual feedback provided by the FeDS nomadic device helps to save energy and learn eco-driving strategies. These outcomes indicate how several feedback modalities could facilitate the decision making process, changing driving behaviour, reducing energy consumption and increasing safety. These questions would help advance further research on eco-driving Intelligent Transport Systems and driving behaviour issues.
文摘This paper proposes a group synchronization control scheme with prediction in work using haptic media. The scheme adjusts the output timing among multiple terminals and keeps the interactivity high. It outputs position information by predicting the future position later than the position included in the last-received information by a fixed amount of time. It also advances the output time of position information at each local terminal by the same amount of time. We deal with two different types of work using haptic media so as to demonstrate the effectiveness of the scheme. We assess the output quality of haptic media for the two types of work subjectively and objectively by Quality of Experience (QoE) assessment. We further clarify the relationship between subjective and objective assessment results.
