Virtual reality(VR)is an emerging communication means and creates extensive opportunities in interacting scenarios such as remote collaboration and metaverse.Human-machine interfaces(HMIs)play important roles in VR as...Virtual reality(VR)is an emerging communication means and creates extensive opportunities in interacting scenarios such as remote collaboration and metaverse.Human-machine interfaces(HMIs)play important roles in VR as they provide interaction platforms between users and virtual environments.However,traditional VR HMIs based on handheld devices or keyboards cannot recognize diverse three-dimensional(3D)gestures,which results in limited freedom of VR interactions.Here,we report a noncontact VR HMI enabled by an electret-nanofiber-based triboelectric sensor(ETS),which is fabricated by the electrospun polylactic acid/thermoplastic polyurethane(PLA/TPU)electret nanofiber film.The nanofiber structure of PLA/TPU electret enhanced the charge retention ability of triboelectric sensor and thus significantly improved its signal strength and stability.Integrated with a deep learning-based multilayer perceptron neural network,the ETS realizes the recognition of 18 different types of 3D gestures with a high average accuracy of 97.3%.An intelligent noncontact VR interactive system based on the ETS is further developed,which is used to manipulate game characters for performing different actions by 3D gestures.Compared with traditional VR HMIs,the proposed VR HMI based on PLA/TPU electret nanofiber film can detect various 3D gestures and offers a superior interaction freedom.This work for the first time introduces the triboelectric 3D gesture recognition method to the VR HMIs,and could make the interaction between human and virtual environments become more efficient and fascinating.展开更多
We outline problems and potential solutions for feasible human-machine interfaces using cable-based parallel manipulators for physiotherapy applications.From an engineering perspective,we discuss the design constraint...We outline problems and potential solutions for feasible human-machine interfaces using cable-based parallel manipulators for physiotherapy applications.From an engineering perspective,we discuss the design constraints related to acceptance by patients and physiotherapist users.To date,most designs have focused on mobile platforms that are designed to be operated as an end-effector connected to human limbs for direct patient interaction.Some specific examples are illustrated from the authors' experience with prototypes available at Laboratory of Robotics and Mechatronics (LARM),Italy.展开更多
Today’s product creative design has rendered many fe atures and has brought a great change in our everyday life, there are many new c hallenges in its traditional theory and principle. According to the traditional de...Today’s product creative design has rendered many fe atures and has brought a great change in our everyday life, there are many new c hallenges in its traditional theory and principle. According to the traditional design theory, the FBS design model pays more attention to the function and stru cture of the product. But this model still couldn’t strengthen the relation bet ween product appearance design and human-machine design effectively. This paper adopt converse design thinking and presents an improved design thinking methodo logy based on C: FBS for product appearance design and give a general summarizat ion for the features, methods and technology based on human-machine interaction and interface. Meanwhile it also combines with the behavior design of product r elated IT fields and constructs a new outline to improve the design of product a ppearance supported by the technology of computer aided design. So the new metho d about design thinking for computer aided design, the new abstract product design model and the key problem of design thinking based on human-machine inte raction and interface are addressed in this paper. This kind of creative design theory that is driven by human-machine interaction and interface will help the development of CAD software system and the research of product design and manufa cture. Additionally, this paper gives some beneficial characters to address the theory based on human-machine interaction and interface. Meanwhile, combining with the developing of computer technology, the trends of design thinking based on t he technology of human-machine interaction and interface are also analyzed and discussed at the end of this paper.展开更多
The fusion of VlSI （visual identity system Internet）, digital maps and Web GIS is presented. Web GIS interface interactive design with VISI needs to consider more new factors. VISI can provide the design principle, ...The fusion of VlSI （visual identity system Internet）, digital maps and Web GIS is presented. Web GIS interface interactive design with VISI needs to consider more new factors. VISI can provide the design principle, elements and contents for the Web GIS. The design of the Wuhan Bus Search System is fulfilled to confirm the validity and practicability of the fusion.展开更多
Background With an increasing number of vehicles becoming autonomous,intelligent,and connected,paying attention to the future usage of car human-machine interface with these vehicles should become more relevant.Severa...Background With an increasing number of vehicles becoming autonomous,intelligent,and connected,paying attention to the future usage of car human-machine interface with these vehicles should become more relevant.Several studies have addressed car HMI but were less attentive to designing and implementing interactive glazing for every day(autonomous)driving contexts.Methods Reflecting on the literature,we describe an engineering psychology practice and the design of six novel future user scenarios,which envision the application of a specific set of augmented reality(AR)support user interactions.Additionally,we conduct evaluations on specific scenarios and experiential prototypes,which reveal that these AR scenarios aid the target user groups in experiencing a new type of interaction.The overall evaluation is positive with valuable assessment results and suggestions.Conclusions This study can interest applied psychology educators who aspire to teach how AR can be operationalized in a human-centered design process to students with minimal pre-existing expertise or minimal scientific knowledge in engineering psychology.展开更多
Electromyography(EMG)has already been broadly used in human-machine interaction(HMI)applications.Determining how to decode the information inside EMG signals robustly and accurately is a key problem for which we urgen...Electromyography(EMG)has already been broadly used in human-machine interaction(HMI)applications.Determining how to decode the information inside EMG signals robustly and accurately is a key problem for which we urgently need a solution.Recently,many EMG pattern recognition tasks have been addressed using deep learning methods.In this paper,we analyze recent papers and present a literature review describing the role that deep learning plays in EMG-based HMI.An overview of typical network structures and processing schemes will be provided.Recent progress in typical tasks such as movement classification,joint angle prediction,and force/torque estimation will be introduced.New issues,including multimodal sensing,inter-subject/inter-session,and robustness toward disturbances will be discussed.We attempt to provide a comprehensive analysis of current research by discussing the advantages,challenges,and opportunities brought by deep learning.We hope that deep learning can aid in eliminating factors that hinder the development of EMG-based HMI systems.Furthermore,possible future directions will be presented to pave the way for future research.展开更多
Quadriplegia is a neuromuscular disease that may cause varying degrees of functional loss in trunk and limbs.In such cases,head movements can be used as an alternative communication channel.In this study,a human–mach...Quadriplegia is a neuromuscular disease that may cause varying degrees of functional loss in trunk and limbs.In such cases,head movements can be used as an alternative communication channel.In this study,a human–machine interface which is controlled by human head movements is designed and implemented.The proposed system enables users to steer the desired movement direction and to control the speed of an output device by using head movements.Head movements of the users are detected using a 6 DOF IMUs measuring three-axis accelerometer and three-axis gyroscope.The head movement axes and the Euler angles have been associated with movement direction and speed,respectively.To ensure driving safety,the speed of the system is determined by considering the speed requested by the user and the obstacle distance on the route.In this context,fuzzy logic algorithm is employed for closed-loop speed control according to distance sensors and reference speed data.A car model was used as the output device on the machine interface.However,the wireless communication between human and machine interfaces provides to adapt this system to any remote device or systems.The implemented system was tested by five subjects.Performance of the system was evaluated in terms of task completion times and feedback from the subjects about their experience with the system.Results indicate that the proposed system is easy to use;and the control capability and usage speed increase with user experience.The control speed is improved with the increase in user experience.展开更多
Combination flexible and stretchable textiles with self-powered sensors bring a novel insight into wearable functional electronics and cyber security in the era of Internet of Things.This work presents a highly flexib...Combination flexible and stretchable textiles with self-powered sensors bring a novel insight into wearable functional electronics and cyber security in the era of Internet of Things.This work presents a highly flexible and self-powered fully fabric-based triboelectric nanogenerator(F-TENG)with sandwiched structure for biomechanical energy harvesting and real-time biometric authentication.The prepared F-TENG can power a digital watch by low-frequency motion and respond to the pressure change by the fall of leaves.A self-powered wearable keyboard(SPWK)is also fabricated by integrating large-area F-TENG sensor arrays,which not only can trace and record electrophysiological signals,but also can identify individuals’typing characteristics by means of the Haar wavelet.Based on these merits,the SPWK has promising applications in the realm of wearable electronics,self-powered sensors,cyber security,and artificial intelligences.展开更多
Letter handwriting,especially stroke correction,is of great importance for recording languages and expressing and exchanging ideas for individual behavior and the public.In this study,a biodegradable and conductive ca...Letter handwriting,especially stroke correction,is of great importance for recording languages and expressing and exchanging ideas for individual behavior and the public.In this study,a biodegradable and conductive carboxymethyl chitosan-silk fibroin(CSF)film is prepared to design wearable triboelectric nanogenerator(denoted as CSF-TENG),which outputs of V_(oc)≈165 V,I_(sc)≈1.4μA,and Q_(sc)≈72 mW cm^(−2).Further,in vitro biodegradation of CSF film is performed through trypsin and lysozyme.The results show that trypsin and lysozyme have stable and favorable biodegradation properties,removing 63.1%of CSF film after degrading for 11 days.Further,the CSF-TENG-based human-machine interface(HMI)is designed to promptly track writing steps and access the accuracy of letters,resulting in a straightforward communication media of human and machine.The CSF-TENG-based HMI can automatically recognize and correct three representative letters(F,H,and K),which is benefited by HMI system for data processing and analysis.The CSF-TENG-based HMI can make decisions for the next stroke,highlighting the stroke in advance by replacing it with red,which can be a candidate for calligraphy practice and correction.Finally,various demonstrations are done in real-time to achieve virtual and real-world controls including writing,vehicle movements,and healthcare.展开更多
Sense of touch is one of the important information from environment for human to live in daily life. Haptic interface is a hot topic in virtual reality but almost all of the devices focus on fingers and hands as targe...Sense of touch is one of the important information from environment for human to live in daily life. Haptic interface is a hot topic in virtual reality but almost all of the devices focus on fingers and hands as targets. In this paper, we focus on the foot haptic device with magnetic flied sensitive elastomer （MSE）. We developed a haptic unit used as a magnetic field generator for MSE and contact point of foot haptic device. MSE samples mixed with 80 wt% carbonyl iron particles were prepared and evaluated with the developed magnet. Experimental results show that the mechanical property of the haptic unit can be modeled with the adjustable friction element. This property has a good advantage for the haptic unit.展开更多
This paper describes the design and evaluation of a user interface for a remotely supervised autonomous agricultural sprayer. The interface was designed to help the remote supervisor to instruct the autonomous sprayer...This paper describes the design and evaluation of a user interface for a remotely supervised autonomous agricultural sprayer. The interface was designed to help the remote supervisor to instruct the autonomous sprayer to commence operation, monitor the status of the sprayer and its operation in the field, and intervene when needed (i.e., to stop or shut down). Design principles and guidelines were carefully selected to help develop a human-centered automation interface. Evaluation of the interface using a combination of heuristic, cognitive walkthrough, and user testing techniques revealed several strengths of the design as well as areas that needed further improvement. Overall, this paper provides guidelines that will assist other researchers to develop an ergonomic user interface for a fully autonomous agricultural machine.展开更多
A method-mix for intercultural user interface design (IUID) is explained and exemplified by application examples based on a hybrid approach covering cultural contexts in human-computer interaction (HCI) design using a...A method-mix for intercultural user interface design (IUID) is explained and exemplified by application examples based on a hybrid approach covering cultural contexts in human-computer interaction (HCI) design using a model of culturally influenced HCI. Cultural influence on HCI is described using cultural variables for user interface design. Assumptions and empirical results regarding the influence of culture on HCI, considering the path of the information processing and the interaction style between Chinese and German users are explained based on cultural models. Subsequent indicators represent the relationship between culture and HCI (culturally imprinted by the user). Correlations adopted theoretically between cultural dimensions and variables for HCI design were investigated. These correlations represent relevant constituents of a model for culturally influenced HCI. Considerations applying this model and evidence for the proper application of the IUID method-mix are presented elucidating why and how cultural aspects play a role in HCI design and usability/UX engineering. The IUID method-mix serves to inspire HCI engineers in the requirement analysis phase as well as HCI designers in the design phase. The readers are thereby sensitized to the challenges of intercultural usability/UX engineering and intercultural HCI design and will be equipped with methodological knowledge relevant to the derivation of design recommendations for user interface design for and in their desired cultural contexts. Finally, implications for practitioners are shown, including HCI style scores and practical design recommendations, to prognosticate the effort and the expenditures for considering the cultural context in IUID.展开更多
基金supported by the National Natural Science Foundation of China(No.52303112)the Henan Province Science and Technology Research and Development Program Joint Fund Advantageous Discipline Cultivation Project(No.232301420033)+1 种基金the China Postdoctoral Science Foundation(Nos.2022TQ0281 and 2023M733213)the Key R&D and Promotion Special(Scientific Problem Tackling)Project of Henan Province(No.242102231014).
文摘Virtual reality(VR)is an emerging communication means and creates extensive opportunities in interacting scenarios such as remote collaboration and metaverse.Human-machine interfaces(HMIs)play important roles in VR as they provide interaction platforms between users and virtual environments.However,traditional VR HMIs based on handheld devices or keyboards cannot recognize diverse three-dimensional(3D)gestures,which results in limited freedom of VR interactions.Here,we report a noncontact VR HMI enabled by an electret-nanofiber-based triboelectric sensor(ETS),which is fabricated by the electrospun polylactic acid/thermoplastic polyurethane(PLA/TPU)electret nanofiber film.The nanofiber structure of PLA/TPU electret enhanced the charge retention ability of triboelectric sensor and thus significantly improved its signal strength and stability.Integrated with a deep learning-based multilayer perceptron neural network,the ETS realizes the recognition of 18 different types of 3D gestures with a high average accuracy of 97.3%.An intelligent noncontact VR interactive system based on the ETS is further developed,which is used to manipulate game characters for performing different actions by 3D gestures.Compared with traditional VR HMIs,the proposed VR HMI based on PLA/TPU electret nanofiber film can detect various 3D gestures and offers a superior interaction freedom.This work for the first time introduces the triboelectric 3D gesture recognition method to the VR HMIs,and could make the interaction between human and virtual environments become more efficient and fascinating.
基金supported by the research project RORAS 2 of the Mediterranean Program funded by INRIA,France
文摘We outline problems and potential solutions for feasible human-machine interfaces using cable-based parallel manipulators for physiotherapy applications.From an engineering perspective,we discuss the design constraints related to acceptance by patients and physiotherapist users.To date,most designs have focused on mobile platforms that are designed to be operated as an end-effector connected to human limbs for direct patient interaction.Some specific examples are illustrated from the authors' experience with prototypes available at Laboratory of Robotics and Mechatronics (LARM),Italy.
文摘Today’s product creative design has rendered many fe atures and has brought a great change in our everyday life, there are many new c hallenges in its traditional theory and principle. According to the traditional design theory, the FBS design model pays more attention to the function and stru cture of the product. But this model still couldn’t strengthen the relation bet ween product appearance design and human-machine design effectively. This paper adopt converse design thinking and presents an improved design thinking methodo logy based on C: FBS for product appearance design and give a general summarizat ion for the features, methods and technology based on human-machine interaction and interface. Meanwhile it also combines with the behavior design of product r elated IT fields and constructs a new outline to improve the design of product a ppearance supported by the technology of computer aided design. So the new metho d about design thinking for computer aided design, the new abstract product design model and the key problem of design thinking based on human-machine inte raction and interface are addressed in this paper. This kind of creative design theory that is driven by human-machine interaction and interface will help the development of CAD software system and the research of product design and manufa cture. Additionally, this paper gives some beneficial characters to address the theory based on human-machine interaction and interface. Meanwhile, combining with the developing of computer technology, the trends of design thinking based on t he technology of human-machine interaction and interface are also analyzed and discussed at the end of this paper.
基金Supported by the National Natural Science Foundation of China （No. 40071071）.
文摘The fusion of VlSI （visual identity system Internet）, digital maps and Web GIS is presented. Web GIS interface interactive design with VISI needs to consider more new factors. VISI can provide the design principle, elements and contents for the Web GIS. The design of the Wuhan Bus Search System is fulfilled to confirm the validity and practicability of the fusion.
基金Supported by the‘Automotive Glazing Application in Intelligent Cockpit Human-Machine Interface’project(SKHX2021049)a collaboration between the Saint-Go Bain Research and the Beijing Normal University。
文摘Background With an increasing number of vehicles becoming autonomous,intelligent,and connected,paying attention to the future usage of car human-machine interface with these vehicles should become more relevant.Several studies have addressed car HMI but were less attentive to designing and implementing interactive glazing for every day(autonomous)driving contexts.Methods Reflecting on the literature,we describe an engineering psychology practice and the design of six novel future user scenarios,which envision the application of a specific set of augmented reality(AR)support user interactions.Additionally,we conduct evaluations on specific scenarios and experiential prototypes,which reveal that these AR scenarios aid the target user groups in experiencing a new type of interaction.The overall evaluation is positive with valuable assessment results and suggestions.Conclusions This study can interest applied psychology educators who aspire to teach how AR can be operationalized in a human-centered design process to students with minimal pre-existing expertise or minimal scientific knowledge in engineering psychology.
基金supported in part by the National Natural Science Foundation of China(U181321461773369+2 种基金61903360)the Selfplanned Project of the State Key Laboratory of Robotics(2020-Z12)China Postdoctoral Science Foundation funded project(2019M661155)。
文摘Electromyography(EMG)has already been broadly used in human-machine interaction(HMI)applications.Determining how to decode the information inside EMG signals robustly and accurately is a key problem for which we urgently need a solution.Recently,many EMG pattern recognition tasks have been addressed using deep learning methods.In this paper,we analyze recent papers and present a literature review describing the role that deep learning plays in EMG-based HMI.An overview of typical network structures and processing schemes will be provided.Recent progress in typical tasks such as movement classification,joint angle prediction,and force/torque estimation will be introduced.New issues,including multimodal sensing,inter-subject/inter-session,and robustness toward disturbances will be discussed.We attempt to provide a comprehensive analysis of current research by discussing the advantages,challenges,and opportunities brought by deep learning.We hope that deep learning can aid in eliminating factors that hinder the development of EMG-based HMI systems.Furthermore,possible future directions will be presented to pave the way for future research.
基金the Scientific and Technological Research Council of Turkey(TUBITAK).
文摘Quadriplegia is a neuromuscular disease that may cause varying degrees of functional loss in trunk and limbs.In such cases,head movements can be used as an alternative communication channel.In this study,a human–machine interface which is controlled by human head movements is designed and implemented.The proposed system enables users to steer the desired movement direction and to control the speed of an output device by using head movements.Head movements of the users are detected using a 6 DOF IMUs measuring three-axis accelerometer and three-axis gyroscope.The head movement axes and the Euler angles have been associated with movement direction and speed,respectively.To ensure driving safety,the speed of the system is determined by considering the speed requested by the user and the obstacle distance on the route.In this context,fuzzy logic algorithm is employed for closed-loop speed control according to distance sensors and reference speed data.A car model was used as the output device on the machine interface.However,the wireless communication between human and machine interfaces provides to adapt this system to any remote device or systems.The implemented system was tested by five subjects.Performance of the system was evaluated in terms of task completion times and feedback from the subjects about their experience with the system.Results indicate that the proposed system is easy to use;and the control capability and usage speed increase with user experience.The control speed is improved with the increase in user experience.
基金the National Key R&D Project from Minister of Science and Technology(Grant No.2016YFA0202704)the Beijing Municipal Natural Science Foundation(Grant No.2212052)+1 种基金the Shanghai Sailing Program(Grant No.19S28101)the Fundamental Research Funds for the Central Universities(Grant No.19D128102).
文摘Combination flexible and stretchable textiles with self-powered sensors bring a novel insight into wearable functional electronics and cyber security in the era of Internet of Things.This work presents a highly flexible and self-powered fully fabric-based triboelectric nanogenerator(F-TENG)with sandwiched structure for biomechanical energy harvesting and real-time biometric authentication.The prepared F-TENG can power a digital watch by low-frequency motion and respond to the pressure change by the fall of leaves.A self-powered wearable keyboard(SPWK)is also fabricated by integrating large-area F-TENG sensor arrays,which not only can trace and record electrophysiological signals,but also can identify individuals’typing characteristics by means of the Haar wavelet.Based on these merits,the SPWK has promising applications in the realm of wearable electronics,self-powered sensors,cyber security,and artificial intelligences.
基金This study was financially supported by National Natural Science Foundation of China(NO.31470509)China Postdoctoral Science Foundation(No.2019T120390)+1 种基金China Scholarship Council(NO.202006790091)the Opening Project of China National Textile and Apparel Council Key Laboratory of Natural Dyes,Soochow University(No.SDHY2122)。
文摘Letter handwriting,especially stroke correction,is of great importance for recording languages and expressing and exchanging ideas for individual behavior and the public.In this study,a biodegradable and conductive carboxymethyl chitosan-silk fibroin(CSF)film is prepared to design wearable triboelectric nanogenerator(denoted as CSF-TENG),which outputs of V_(oc)≈165 V,I_(sc)≈1.4μA,and Q_(sc)≈72 mW cm^(−2).Further,in vitro biodegradation of CSF film is performed through trypsin and lysozyme.The results show that trypsin and lysozyme have stable and favorable biodegradation properties,removing 63.1%of CSF film after degrading for 11 days.Further,the CSF-TENG-based human-machine interface(HMI)is designed to promptly track writing steps and access the accuracy of letters,resulting in a straightforward communication media of human and machine.The CSF-TENG-based HMI can automatically recognize and correct three representative letters(F,H,and K),which is benefited by HMI system for data processing and analysis.The CSF-TENG-based HMI can make decisions for the next stroke,highlighting the stroke in advance by replacing it with red,which can be a candidate for calligraphy practice and correction.Finally,various demonstrations are done in real-time to achieve virtual and real-world controls including writing,vehicle movements,and healthcare.
文摘Sense of touch is one of the important information from environment for human to live in daily life. Haptic interface is a hot topic in virtual reality but almost all of the devices focus on fingers and hands as targets. In this paper, we focus on the foot haptic device with magnetic flied sensitive elastomer （MSE）. We developed a haptic unit used as a magnetic field generator for MSE and contact point of foot haptic device. MSE samples mixed with 80 wt% carbonyl iron particles were prepared and evaluated with the developed magnet. Experimental results show that the mechanical property of the haptic unit can be modeled with the adjustable friction element. This property has a good advantage for the haptic unit.
文摘This paper describes the design and evaluation of a user interface for a remotely supervised autonomous agricultural sprayer. The interface was designed to help the remote supervisor to instruct the autonomous sprayer to commence operation, monitor the status of the sprayer and its operation in the field, and intervene when needed (i.e., to stop or shut down). Design principles and guidelines were carefully selected to help develop a human-centered automation interface. Evaluation of the interface using a combination of heuristic, cognitive walkthrough, and user testing techniques revealed several strengths of the design as well as areas that needed further improvement. Overall, this paper provides guidelines that will assist other researchers to develop an ergonomic user interface for a fully autonomous agricultural machine.
文摘A method-mix for intercultural user interface design (IUID) is explained and exemplified by application examples based on a hybrid approach covering cultural contexts in human-computer interaction (HCI) design using a model of culturally influenced HCI. Cultural influence on HCI is described using cultural variables for user interface design. Assumptions and empirical results regarding the influence of culture on HCI, considering the path of the information processing and the interaction style between Chinese and German users are explained based on cultural models. Subsequent indicators represent the relationship between culture and HCI (culturally imprinted by the user). Correlations adopted theoretically between cultural dimensions and variables for HCI design were investigated. These correlations represent relevant constituents of a model for culturally influenced HCI. Considerations applying this model and evidence for the proper application of the IUID method-mix are presented elucidating why and how cultural aspects play a role in HCI design and usability/UX engineering. The IUID method-mix serves to inspire HCI engineers in the requirement analysis phase as well as HCI designers in the design phase. The readers are thereby sensitized to the challenges of intercultural usability/UX engineering and intercultural HCI design and will be equipped with methodological knowledge relevant to the derivation of design recommendations for user interface design for and in their desired cultural contexts. Finally, implications for practitioners are shown, including HCI style scores and practical design recommendations, to prognosticate the effort and the expenditures for considering the cultural context in IUID.
