Virtual reality(VR)is an emerging communication means and creates extensive opportunities in interacting scenarios such as remote collaboration and metaverse.Human-machine interfaces(HMIs)play important roles in VR as...Virtual reality(VR)is an emerging communication means and creates extensive opportunities in interacting scenarios such as remote collaboration and metaverse.Human-machine interfaces(HMIs)play important roles in VR as they provide interaction platforms between users and virtual environments.However,traditional VR HMIs based on handheld devices or keyboards cannot recognize diverse three-dimensional(3D)gestures,which results in limited freedom of VR interactions.Here,we report a noncontact VR HMI enabled by an electret-nanofiber-based triboelectric sensor(ETS),which is fabricated by the electrospun polylactic acid/thermoplastic polyurethane(PLA/TPU)electret nanofiber film.The nanofiber structure of PLA/TPU electret enhanced the charge retention ability of triboelectric sensor and thus significantly improved its signal strength and stability.Integrated with a deep learning-based multilayer perceptron neural network,the ETS realizes the recognition of 18 different types of 3D gestures with a high average accuracy of 97.3%.An intelligent noncontact VR interactive system based on the ETS is further developed,which is used to manipulate game characters for performing different actions by 3D gestures.Compared with traditional VR HMIs,the proposed VR HMI based on PLA/TPU electret nanofiber film can detect various 3D gestures and offers a superior interaction freedom.This work for the first time introduces the triboelectric 3D gesture recognition method to the VR HMIs,and could make the interaction between human and virtual environments become more efficient and fascinating.展开更多
We outline problems and potential solutions for feasible human-machine interfaces using cable-based parallel manipulators for physiotherapy applications.From an engineering perspective,we discuss the design constraint...We outline problems and potential solutions for feasible human-machine interfaces using cable-based parallel manipulators for physiotherapy applications.From an engineering perspective,we discuss the design constraints related to acceptance by patients and physiotherapist users.To date,most designs have focused on mobile platforms that are designed to be operated as an end-effector connected to human limbs for direct patient interaction.Some specific examples are illustrated from the authors' experience with prototypes available at Laboratory of Robotics and Mechatronics (LARM),Italy.展开更多
The fusion of VlSI （visual identity system Internet）, digital maps and Web GIS is presented. Web GIS interface interactive design with VISI needs to consider more new factors. VISI can provide the design principle, ...The fusion of VlSI （visual identity system Internet）, digital maps and Web GIS is presented. Web GIS interface interactive design with VISI needs to consider more new factors. VISI can provide the design principle, elements and contents for the Web GIS. The design of the Wuhan Bus Search System is fulfilled to confirm the validity and practicability of the fusion.展开更多
Background With an increasing number of vehicles becoming autonomous,intelligent,and connected,paying attention to the future usage of car human-machine interface with these vehicles should become more relevant.Severa...Background With an increasing number of vehicles becoming autonomous,intelligent,and connected,paying attention to the future usage of car human-machine interface with these vehicles should become more relevant.Several studies have addressed car HMI but were less attentive to designing and implementing interactive glazing for every day(autonomous)driving contexts.Methods Reflecting on the literature,we describe an engineering psychology practice and the design of six novel future user scenarios,which envision the application of a specific set of augmented reality(AR)support user interactions.Additionally,we conduct evaluations on specific scenarios and experiential prototypes,which reveal that these AR scenarios aid the target user groups in experiencing a new type of interaction.The overall evaluation is positive with valuable assessment results and suggestions.Conclusions This study can interest applied psychology educators who aspire to teach how AR can be operationalized in a human-centered design process to students with minimal pre-existing expertise or minimal scientific knowledge in engineering psychology.展开更多
Combination flexible and stretchable textiles with self-powered sensors bring a novel insight into wearable functional electronics and cyber security in the era of Internet of Things.This work presents a highly flexib...Combination flexible and stretchable textiles with self-powered sensors bring a novel insight into wearable functional electronics and cyber security in the era of Internet of Things.This work presents a highly flexible and self-powered fully fabric-based triboelectric nanogenerator(F-TENG)with sandwiched structure for biomechanical energy harvesting and real-time biometric authentication.The prepared F-TENG can power a digital watch by low-frequency motion and respond to the pressure change by the fall of leaves.A self-powered wearable keyboard(SPWK)is also fabricated by integrating large-area F-TENG sensor arrays,which not only can trace and record electrophysiological signals,but also can identify individuals’typing characteristics by means of the Haar wavelet.Based on these merits,the SPWK has promising applications in the realm of wearable electronics,self-powered sensors,cyber security,and artificial intelligences.展开更多
Letter handwriting,especially stroke correction,is of great importance for recording languages and expressing and exchanging ideas for individual behavior and the public.In this study,a biodegradable and conductive ca...Letter handwriting,especially stroke correction,is of great importance for recording languages and expressing and exchanging ideas for individual behavior and the public.In this study,a biodegradable and conductive carboxymethyl chitosan-silk fibroin(CSF)film is prepared to design wearable triboelectric nanogenerator(denoted as CSF-TENG),which outputs of V_(oc)≈165 V,I_(sc)≈1.4μA,and Q_(sc)≈72 mW cm^(−2).Further,in vitro biodegradation of CSF film is performed through trypsin and lysozyme.The results show that trypsin and lysozyme have stable and favorable biodegradation properties,removing 63.1%of CSF film after degrading for 11 days.Further,the CSF-TENG-based human-machine interface(HMI)is designed to promptly track writing steps and access the accuracy of letters,resulting in a straightforward communication media of human and machine.The CSF-TENG-based HMI can automatically recognize and correct three representative letters(F,H,and K),which is benefited by HMI system for data processing and analysis.The CSF-TENG-based HMI can make decisions for the next stroke,highlighting the stroke in advance by replacing it with red,which can be a candidate for calligraphy practice and correction.Finally,various demonstrations are done in real-time to achieve virtual and real-world controls including writing,vehicle movements,and healthcare.展开更多
Quadriplegia is a neuromuscular disease that may cause varying degrees of functional loss in trunk and limbs.In such cases,head movements can be used as an alternative communication channel.In this study,a human–mach...Quadriplegia is a neuromuscular disease that may cause varying degrees of functional loss in trunk and limbs.In such cases,head movements can be used as an alternative communication channel.In this study,a human–machine interface which is controlled by human head movements is designed and implemented.The proposed system enables users to steer the desired movement direction and to control the speed of an output device by using head movements.Head movements of the users are detected using a 6 DOF IMUs measuring three-axis accelerometer and three-axis gyroscope.The head movement axes and the Euler angles have been associated with movement direction and speed,respectively.To ensure driving safety,the speed of the system is determined by considering the speed requested by the user and the obstacle distance on the route.In this context,fuzzy logic algorithm is employed for closed-loop speed control according to distance sensors and reference speed data.A car model was used as the output device on the machine interface.However,the wireless communication between human and machine interfaces provides to adapt this system to any remote device or systems.The implemented system was tested by five subjects.Performance of the system was evaluated in terms of task completion times and feedback from the subjects about their experience with the system.Results indicate that the proposed system is easy to use;and the control capability and usage speed increase with user experience.The control speed is improved with the increase in user experience.展开更多
Sense of touch is one of the important information from environment for human to live in daily life. Haptic interface is a hot topic in virtual reality but almost all of the devices focus on fingers and hands as targe...Sense of touch is one of the important information from environment for human to live in daily life. Haptic interface is a hot topic in virtual reality but almost all of the devices focus on fingers and hands as targets. In this paper, we focus on the foot haptic device with magnetic flied sensitive elastomer （MSE）. We developed a haptic unit used as a magnetic field generator for MSE and contact point of foot haptic device. MSE samples mixed with 80 wt% carbonyl iron particles were prepared and evaluated with the developed magnet. Experimental results show that the mechanical property of the haptic unit can be modeled with the adjustable friction element. This property has a good advantage for the haptic unit.展开更多
This paper describes the design and evaluation of a user interface for a remotely supervised autonomous agricultural sprayer. The interface was designed to help the remote supervisor to instruct the autonomous sprayer...This paper describes the design and evaluation of a user interface for a remotely supervised autonomous agricultural sprayer. The interface was designed to help the remote supervisor to instruct the autonomous sprayer to commence operation, monitor the status of the sprayer and its operation in the field, and intervene when needed (i.e., to stop or shut down). Design principles and guidelines were carefully selected to help develop a human-centered automation interface. Evaluation of the interface using a combination of heuristic, cognitive walkthrough, and user testing techniques revealed several strengths of the design as well as areas that needed further improvement. Overall, this paper provides guidelines that will assist other researchers to develop an ergonomic user interface for a fully autonomous agricultural machine.展开更多
With the rapid development of wearable electronic skin technology, flexible strain sensors have shown great application prospects in the fields of human motion and physiological signal detection, medical diagnostics, ...With the rapid development of wearable electronic skin technology, flexible strain sensors have shown great application prospects in the fields of human motion and physiological signal detection, medical diagnostics, and human-computer interaction owing to their outstanding sensing performance. This paper reports a strain sensor with synergistic conductive network, consisting of stable carbon nanotube dispersion (CNT) layer and brittle MXene layer by dip-coating and electrostatic self-assembly method, and breathable three-dimensional (3D) flexible substrate of thermoplastic polyurethane (TPU) fibrous membrane prepared through electrospinning technology. The MXene/CNT@PDA-TPU (MC@p-TPU) flexible strain sensor had excellent air permeability, wide operating range (0–450 %), high sensitivity (Gauge Factor, GFmax = 8089.7), ultra-low detection limit (0.05 %), rapid response and recovery times (40 ms/60 ms), and excellent cycle stability and durability (10,000 cycles). Given its superior strain sensing capabilities, this sensor can be applied in physiological signals detection, human motion pattern recognition, and driving exoskeleton robots. In addition, MC@p-TPU fibrous membrane also exhibited excellent photothermal conversion performance and can be used as a wearable photo-heater, which has far-reaching application potential in the photothermal therapy of human joint diseases.展开更多
Ionic hydrogel-based sensors have shined a spotlight on wearable electronics.However,the sensitivity and reliability of hydrogel devices are significantly hampered by the weak adhesion of skin-sensor interface as well...Ionic hydrogel-based sensors have shined a spotlight on wearable electronics.However,the sensitivity and reliability of hydrogel devices are significantly hampered by the weak adhesion of skin-sensor interface as well as inferior temperature tolerance.Here,inspired by the structure and composition of dermis,a novel skin-attachable and environment-stable hydrogel was designed by integrating collagen into the LiCl-containing chemically cross-linked polyacrylamide hydrogel.The hydrogel exhibited skin-like mechanical properties of low modulus,superior stretchability as well as excellent elasticity.Furthermore,the introduction of collagen endowed the hydrogel with robust and seamless interfaces with diverse materials,including the curved skin.As a result,the hydrogel is capable of serving as a human-machine interface for collecting reliable electrocardiography(ECG)signals and discerning various human motions,with high sensitivity(gauge factor=10.7),fast response,negligible hysteresis as well as extensive monitoring range.Notably,the hydrogel that can mimick the temperature-tolerant mechanism of most organisms possesses persistent stabilization of adhesive,conductive,sensory and mechanical performances at subzero or ambient conditions.The skin-inspired strategy paves an effective way for the design of multifunctional materials with potential applications in next-generation electronics.展开更多
Wearable human-machine interface(HMI)is an advanced technology that has a wide range of applications from robotics to augmented/virtual reality(AR/VR).In this study,an optically driven wearable human-interactive smart...Wearable human-machine interface(HMI)is an advanced technology that has a wide range of applications from robotics to augmented/virtual reality(AR/VR).In this study,an optically driven wearable human-interactive smart textile is proposed by integrating a polydimethylsiloxane(PDMS)patch embedded with optical micro/nanofibers(MNF)array with a piece of textiles.Enabled by the highly sensitive pressure dependent bending loss of MNF,the smart textile shows high sensitivity(65.5 kPa^(−1))and fast response(25 ms)for touch sensing.Benefiting from the warp and weft structure of the textile,the optical smart textile can feel slight finger slip along the MNF.Furthermore,machine learning is utilized to classify the touch manners,achieving a recognition accuracy as high as 98.1%.As a proof-of-concept,a remote-control robotic hand and a smart interactive doll are demonstrated based on the optical smart textile.This optical smart textile represents an ideal HMI for AR/VR and robotics applications.展开更多
基金supported by the National Natural Science Foundation of China(No.52303112)the Henan Province Science and Technology Research and Development Program Joint Fund Advantageous Discipline Cultivation Project(No.232301420033)+1 种基金the China Postdoctoral Science Foundation(Nos.2022TQ0281 and 2023M733213)the Key R&D and Promotion Special(Scientific Problem Tackling)Project of Henan Province(No.242102231014).
文摘Virtual reality(VR)is an emerging communication means and creates extensive opportunities in interacting scenarios such as remote collaboration and metaverse.Human-machine interfaces(HMIs)play important roles in VR as they provide interaction platforms between users and virtual environments.However,traditional VR HMIs based on handheld devices or keyboards cannot recognize diverse three-dimensional(3D)gestures,which results in limited freedom of VR interactions.Here,we report a noncontact VR HMI enabled by an electret-nanofiber-based triboelectric sensor(ETS),which is fabricated by the electrospun polylactic acid/thermoplastic polyurethane(PLA/TPU)electret nanofiber film.The nanofiber structure of PLA/TPU electret enhanced the charge retention ability of triboelectric sensor and thus significantly improved its signal strength and stability.Integrated with a deep learning-based multilayer perceptron neural network,the ETS realizes the recognition of 18 different types of 3D gestures with a high average accuracy of 97.3%.An intelligent noncontact VR interactive system based on the ETS is further developed,which is used to manipulate game characters for performing different actions by 3D gestures.Compared with traditional VR HMIs,the proposed VR HMI based on PLA/TPU electret nanofiber film can detect various 3D gestures and offers a superior interaction freedom.This work for the first time introduces the triboelectric 3D gesture recognition method to the VR HMIs,and could make the interaction between human and virtual environments become more efficient and fascinating.
基金supported by the research project RORAS 2 of the Mediterranean Program funded by INRIA,France
文摘We outline problems and potential solutions for feasible human-machine interfaces using cable-based parallel manipulators for physiotherapy applications.From an engineering perspective,we discuss the design constraints related to acceptance by patients and physiotherapist users.To date,most designs have focused on mobile platforms that are designed to be operated as an end-effector connected to human limbs for direct patient interaction.Some specific examples are illustrated from the authors' experience with prototypes available at Laboratory of Robotics and Mechatronics (LARM),Italy.
基金Supported by the National Natural Science Foundation of China （No. 40071071）.
文摘The fusion of VlSI （visual identity system Internet）, digital maps and Web GIS is presented. Web GIS interface interactive design with VISI needs to consider more new factors. VISI can provide the design principle, elements and contents for the Web GIS. The design of the Wuhan Bus Search System is fulfilled to confirm the validity and practicability of the fusion.
基金Supported by the‘Automotive Glazing Application in Intelligent Cockpit Human-Machine Interface’project(SKHX2021049)a collaboration between the Saint-Go Bain Research and the Beijing Normal University。
文摘Background With an increasing number of vehicles becoming autonomous,intelligent,and connected,paying attention to the future usage of car human-machine interface with these vehicles should become more relevant.Several studies have addressed car HMI but were less attentive to designing and implementing interactive glazing for every day(autonomous)driving contexts.Methods Reflecting on the literature,we describe an engineering psychology practice and the design of six novel future user scenarios,which envision the application of a specific set of augmented reality(AR)support user interactions.Additionally,we conduct evaluations on specific scenarios and experiential prototypes,which reveal that these AR scenarios aid the target user groups in experiencing a new type of interaction.The overall evaluation is positive with valuable assessment results and suggestions.Conclusions This study can interest applied psychology educators who aspire to teach how AR can be operationalized in a human-centered design process to students with minimal pre-existing expertise or minimal scientific knowledge in engineering psychology.
基金the National Key R&D Project from Minister of Science and Technology(Grant No.2016YFA0202704)the Beijing Municipal Natural Science Foundation(Grant No.2212052)+1 种基金the Shanghai Sailing Program(Grant No.19S28101)the Fundamental Research Funds for the Central Universities(Grant No.19D128102).
文摘Combination flexible and stretchable textiles with self-powered sensors bring a novel insight into wearable functional electronics and cyber security in the era of Internet of Things.This work presents a highly flexible and self-powered fully fabric-based triboelectric nanogenerator(F-TENG)with sandwiched structure for biomechanical energy harvesting and real-time biometric authentication.The prepared F-TENG can power a digital watch by low-frequency motion and respond to the pressure change by the fall of leaves.A self-powered wearable keyboard(SPWK)is also fabricated by integrating large-area F-TENG sensor arrays,which not only can trace and record electrophysiological signals,but also can identify individuals’typing characteristics by means of the Haar wavelet.Based on these merits,the SPWK has promising applications in the realm of wearable electronics,self-powered sensors,cyber security,and artificial intelligences.
基金This study was financially supported by National Natural Science Foundation of China(NO.31470509)China Postdoctoral Science Foundation(No.2019T120390)+1 种基金China Scholarship Council(NO.202006790091)the Opening Project of China National Textile and Apparel Council Key Laboratory of Natural Dyes,Soochow University(No.SDHY2122)。
文摘Letter handwriting,especially stroke correction,is of great importance for recording languages and expressing and exchanging ideas for individual behavior and the public.In this study,a biodegradable and conductive carboxymethyl chitosan-silk fibroin(CSF)film is prepared to design wearable triboelectric nanogenerator(denoted as CSF-TENG),which outputs of V_(oc)≈165 V,I_(sc)≈1.4μA,and Q_(sc)≈72 mW cm^(−2).Further,in vitro biodegradation of CSF film is performed through trypsin and lysozyme.The results show that trypsin and lysozyme have stable and favorable biodegradation properties,removing 63.1%of CSF film after degrading for 11 days.Further,the CSF-TENG-based human-machine interface(HMI)is designed to promptly track writing steps and access the accuracy of letters,resulting in a straightforward communication media of human and machine.The CSF-TENG-based HMI can automatically recognize and correct three representative letters(F,H,and K),which is benefited by HMI system for data processing and analysis.The CSF-TENG-based HMI can make decisions for the next stroke,highlighting the stroke in advance by replacing it with red,which can be a candidate for calligraphy practice and correction.Finally,various demonstrations are done in real-time to achieve virtual and real-world controls including writing,vehicle movements,and healthcare.
基金the Scientific and Technological Research Council of Turkey(TUBITAK).
文摘Quadriplegia is a neuromuscular disease that may cause varying degrees of functional loss in trunk and limbs.In such cases,head movements can be used as an alternative communication channel.In this study,a human–machine interface which is controlled by human head movements is designed and implemented.The proposed system enables users to steer the desired movement direction and to control the speed of an output device by using head movements.Head movements of the users are detected using a 6 DOF IMUs measuring three-axis accelerometer and three-axis gyroscope.The head movement axes and the Euler angles have been associated with movement direction and speed,respectively.To ensure driving safety,the speed of the system is determined by considering the speed requested by the user and the obstacle distance on the route.In this context,fuzzy logic algorithm is employed for closed-loop speed control according to distance sensors and reference speed data.A car model was used as the output device on the machine interface.However,the wireless communication between human and machine interfaces provides to adapt this system to any remote device or systems.The implemented system was tested by five subjects.Performance of the system was evaluated in terms of task completion times and feedback from the subjects about their experience with the system.Results indicate that the proposed system is easy to use;and the control capability and usage speed increase with user experience.The control speed is improved with the increase in user experience.
文摘Sense of touch is one of the important information from environment for human to live in daily life. Haptic interface is a hot topic in virtual reality but almost all of the devices focus on fingers and hands as targets. In this paper, we focus on the foot haptic device with magnetic flied sensitive elastomer （MSE）. We developed a haptic unit used as a magnetic field generator for MSE and contact point of foot haptic device. MSE samples mixed with 80 wt% carbonyl iron particles were prepared and evaluated with the developed magnet. Experimental results show that the mechanical property of the haptic unit can be modeled with the adjustable friction element. This property has a good advantage for the haptic unit.
文摘This paper describes the design and evaluation of a user interface for a remotely supervised autonomous agricultural sprayer. The interface was designed to help the remote supervisor to instruct the autonomous sprayer to commence operation, monitor the status of the sprayer and its operation in the field, and intervene when needed (i.e., to stop or shut down). Design principles and guidelines were carefully selected to help develop a human-centered automation interface. Evaluation of the interface using a combination of heuristic, cognitive walkthrough, and user testing techniques revealed several strengths of the design as well as areas that needed further improvement. Overall, this paper provides guidelines that will assist other researchers to develop an ergonomic user interface for a fully autonomous agricultural machine.
基金supported by the National Natural Science Foundation of China(Nos.52373093 and 12072325)the Outstanding Youth Fund of Henan Province(No.242300421062)+1 种基金National Key R&D Program of China(No.2019YFA0706802)the 111 project(No.D18023).
文摘With the rapid development of wearable electronic skin technology, flexible strain sensors have shown great application prospects in the fields of human motion and physiological signal detection, medical diagnostics, and human-computer interaction owing to their outstanding sensing performance. This paper reports a strain sensor with synergistic conductive network, consisting of stable carbon nanotube dispersion (CNT) layer and brittle MXene layer by dip-coating and electrostatic self-assembly method, and breathable three-dimensional (3D) flexible substrate of thermoplastic polyurethane (TPU) fibrous membrane prepared through electrospinning technology. The MXene/CNT@PDA-TPU (MC@p-TPU) flexible strain sensor had excellent air permeability, wide operating range (0–450 %), high sensitivity (Gauge Factor, GFmax = 8089.7), ultra-low detection limit (0.05 %), rapid response and recovery times (40 ms/60 ms), and excellent cycle stability and durability (10,000 cycles). Given its superior strain sensing capabilities, this sensor can be applied in physiological signals detection, human motion pattern recognition, and driving exoskeleton robots. In addition, MC@p-TPU fibrous membrane also exhibited excellent photothermal conversion performance and can be used as a wearable photo-heater, which has far-reaching application potential in the photothermal therapy of human joint diseases.
基金supported by the National Natural Science Foundation of China (51873024)the Science and Technology Department of Jilin Province (20200708102YY and 20190201234JC)
文摘Ionic hydrogel-based sensors have shined a spotlight on wearable electronics.However,the sensitivity and reliability of hydrogel devices are significantly hampered by the weak adhesion of skin-sensor interface as well as inferior temperature tolerance.Here,inspired by the structure and composition of dermis,a novel skin-attachable and environment-stable hydrogel was designed by integrating collagen into the LiCl-containing chemically cross-linked polyacrylamide hydrogel.The hydrogel exhibited skin-like mechanical properties of low modulus,superior stretchability as well as excellent elasticity.Furthermore,the introduction of collagen endowed the hydrogel with robust and seamless interfaces with diverse materials,including the curved skin.As a result,the hydrogel is capable of serving as a human-machine interface for collecting reliable electrocardiography(ECG)signals and discerning various human motions,with high sensitivity(gauge factor=10.7),fast response,negligible hysteresis as well as extensive monitoring range.Notably,the hydrogel that can mimick the temperature-tolerant mechanism of most organisms possesses persistent stabilization of adhesive,conductive,sensory and mechanical performances at subzero or ambient conditions.The skin-inspired strategy paves an effective way for the design of multifunctional materials with potential applications in next-generation electronics.
基金We acknowledge funding from the National Natural Science Foundation of China(No.61975173)Major Scientific Research Project of Zhejiang Lab(No.2019MC0AD01)+1 种基金Key Research and Development Project of Zhejiang Province(No.2021C05003)the CIE-Tencent Robotics X Rhino-Bird Focused Research Program(No.2020-01-006).
文摘Wearable human-machine interface(HMI)is an advanced technology that has a wide range of applications from robotics to augmented/virtual reality(AR/VR).In this study,an optically driven wearable human-interactive smart textile is proposed by integrating a polydimethylsiloxane(PDMS)patch embedded with optical micro/nanofibers(MNF)array with a piece of textiles.Enabled by the highly sensitive pressure dependent bending loss of MNF,the smart textile shows high sensitivity(65.5 kPa^(−1))and fast response(25 ms)for touch sensing.Benefiting from the warp and weft structure of the textile,the optical smart textile can feel slight finger slip along the MNF.Furthermore,machine learning is utilized to classify the touch manners,achieving a recognition accuracy as high as 98.1%.As a proof-of-concept,a remote-control robotic hand and a smart interactive doll are demonstrated based on the optical smart textile.This optical smart textile represents an ideal HMI for AR/VR and robotics applications.
