Rock discontinuities control rock mechanical behaviors and significantly influence the stability of rock masses.However,existing discontinuity mapping algorithms are susceptible to noise,and the calculation results ca...Rock discontinuities control rock mechanical behaviors and significantly influence the stability of rock masses.However,existing discontinuity mapping algorithms are susceptible to noise,and the calculation results cannot be fed back to users timely.To address this issue,we proposed a human-machine interaction(HMI)method for discontinuity mapping.Users can help the algorithm identify the noise and make real-time result judgments and parameter adjustments.For this,a regular cube was selected to illustrate the workflows:(1)point cloud was acquired using remote sensing;(2)the HMI method was employed to select reference points and angle thresholds to detect group discontinuity;(3)individual discontinuities were extracted from the group discontinuity using a density-based cluster algorithm;and(4)the orientation of each discontinuity was measured based on a plane fitting algorithm.The method was applied to a well-studied highway road cut and a complex natural slope.The consistency of the computational results with field measurements demonstrates its good accuracy,and the average error in the dip direction and dip angle for both cases was less than 3.Finally,the computational time of the proposed method was compared with two other popular algorithms,and the reduction in computational time by tens of times proves its high computational efficiency.This method provides geologists and geological engineers with a new idea to map rapidly and accurately rock structures under large amounts of noises or unclear features.展开更多
Electromyography(EMG)has already been broadly used in human-machine interaction(HMI)applications.Determining how to decode the information inside EMG signals robustly and accurately is a key problem for which we urgen...Electromyography(EMG)has already been broadly used in human-machine interaction(HMI)applications.Determining how to decode the information inside EMG signals robustly and accurately is a key problem for which we urgently need a solution.Recently,many EMG pattern recognition tasks have been addressed using deep learning methods.In this paper,we analyze recent papers and present a literature review describing the role that deep learning plays in EMG-based HMI.An overview of typical network structures and processing schemes will be provided.Recent progress in typical tasks such as movement classification,joint angle prediction,and force/torque estimation will be introduced.New issues,including multimodal sensing,inter-subject/inter-session,and robustness toward disturbances will be discussed.We attempt to provide a comprehensive analysis of current research by discussing the advantages,challenges,and opportunities brought by deep learning.We hope that deep learning can aid in eliminating factors that hinder the development of EMG-based HMI systems.Furthermore,possible future directions will be presented to pave the way for future research.展开更多
Hydrogel-based triboelectric nanoge nerator(TENG)has a promising applied prospect in wearable electronic devices.However,its low performance,poor stability,insufficient recyclability and inferior self-healing seriousl...Hydrogel-based triboelectric nanoge nerator(TENG)has a promising applied prospect in wearable electronic devices.However,its low performance,poor stability,insufficient recyclability and inferior self-healing seriously hinder its development.Herein,we report a robust route to a liquid metal(LM)/polyvinyl alcohol(PVA)hydrogel-based TENG(LP-TENG).Owing to the intrinsically liquid feature of conductive LM within the flexible PVA hydrogel,the as-prepared LP-TENG exhibited comprehensiye advantages of adaptability,biocompatibility,outstanding electrical performance,superior stability,recyclability and diverse applications,which were unattainable by traditional systems.Concretely,the LP-TENG delivered appealing open circuit voltage of 250 V,short circuit current of 4μA and transferred charge of 120 nC with high stability,outperforming most advanced TENG systems.The LP-TENG was successfully employed for versatile applications with multifunctionality,including human motion detection,handwriting recognition,energy collection,message transmission and human-machine interaction.This work presents significant prospects for crafting advanced materials and devices in the fields of wearable electronics,flexible skin and smart robots.展开更多
The fusion of VlSI （visual identity system Internet）, digital maps and Web GIS is presented. Web GIS interface interactive design with VISI needs to consider more new factors. VISI can provide the design principle, ...The fusion of VlSI （visual identity system Internet）, digital maps and Web GIS is presented. Web GIS interface interactive design with VISI needs to consider more new factors. VISI can provide the design principle, elements and contents for the Web GIS. The design of the Wuhan Bus Search System is fulfilled to confirm the validity and practicability of the fusion.展开更多
Speech recognition rate will deteriorate greatly in human-machine interaction when the speaker's speech mixes with a bystander's voice. This paper proposes a time-frequency approach for Blind Source Seperation...Speech recognition rate will deteriorate greatly in human-machine interaction when the speaker's speech mixes with a bystander's voice. This paper proposes a time-frequency approach for Blind Source Seperation (BSS) for intelligent Human-Machine Interaction(HMI). Main idea of the algorithm is to simultaneously diagonalize the correlation matrix of the pre-whitened signals at different time delays for every frequency bins in time-frequency domain. The prososed method has two merits: (1) fast convergence speed; (2) high signal to interference ratio of the separated signals. Numerical evaluations are used to compare the performance of the proposed algorithm with two other deconvolution algorithms. An efficient algorithm to resolve permutation ambiguity is also proposed in this paper. The algorithm proposed saves more than 10% of computational time with properly selected parameters and achieves good performances for both simulated convolutive mixtures and real room recorded speeches.展开更多
Teleoperation is of great importance in the area of robotics,especially when people are unavailable in the robot workshop.It provides a way for people to control robots remotely using human intelligence.In this paper,...Teleoperation is of great importance in the area of robotics,especially when people are unavailable in the robot workshop.It provides a way for people to control robots remotely using human intelligence.In this paper,a robotic teleoperation system for precise robotic manipulation is established.The data glove and the 7-degrees of freedom(DOFs)force feedback controller are used for the remote control interaction.The control system and the monitor system are designed for the remote precise manipulation.The monitor system contains an image acquisition system and a human-machine interaction module,and aims to simulate and detect the robot running state.Besides,a visual object tracking algorithm is developed to estimate the states of the dynamic system from noisy observations.The established robotic teleoperation systemis applied to a series of experiments,and high-precision results are obtained,showing the effectiveness of the physical system.展开更多
As the Internet of Things advances,gesture recognition emerges as a prominent domain in human-machine interaction(HMI).However,interactive wearables based on conductive hydrogels for individuals with single-arm functi...As the Internet of Things advances,gesture recognition emerges as a prominent domain in human-machine interaction(HMI).However,interactive wearables based on conductive hydrogels for individuals with single-arm functionality or disabilities remain underexplored.Here,we devised a wearable one-handed keyboard with gesture recognition,employing machine learning algorithms and hydrogel-based mechanical sensors to boost productivity.PCG(PAM/CMC/rGO)hydrogels are composed of polyacrylamide(PAM),sodium carboxymethyl cellulose(CMC),and reduced graphene oxide(rGO),which function as a strain,pressure sensor,and electrode material.The PAM chains offer the gel’s elasticity by covalent cross-linking,while the biocompatible CMC improves the dispersion of rGO and promotes electromechanical properties.Integrating rGO sheets into the polymer matrix facilitates cross-linking and generates supple-mentary conductive pathways,thereby augmenting the gel system’s elasticity,sensitivity,and durability.Our hydrogel sensors include high sensitivity(gage factor(GF)=8.18,395.6%-551.96%)and superior pressure sensing capabilities(Sensitivity(S)=0.3116 kPa^(-1),0-9.82 kPa).Furthermore,we developed a wearable keyboard with up to 98.13%accuracy using convolutional neural networks and a custom data acquisition system.This study establishes the groundwork for creating multifunctional gel sensors for intelligent machines,wearable devices,and brain-computer interfaces.展开更多
Combination flexible and stretchable textiles with self-powered sensors bring a novel insight into wearable functional electronics and cyber security in the era of Internet of Things.This work presents a highly flexib...Combination flexible and stretchable textiles with self-powered sensors bring a novel insight into wearable functional electronics and cyber security in the era of Internet of Things.This work presents a highly flexible and self-powered fully fabric-based triboelectric nanogenerator(F-TENG)with sandwiched structure for biomechanical energy harvesting and real-time biometric authentication.The prepared F-TENG can power a digital watch by low-frequency motion and respond to the pressure change by the fall of leaves.A self-powered wearable keyboard(SPWK)is also fabricated by integrating large-area F-TENG sensor arrays,which not only can trace and record electrophysiological signals,but also can identify individuals’typing characteristics by means of the Haar wavelet.Based on these merits,the SPWK has promising applications in the realm of wearable electronics,self-powered sensors,cyber security,and artificial intelligences.展开更多
Today’s product creative design has rendered many fe atures and has brought a great change in our everyday life, there are many new c hallenges in its traditional theory and principle. According to the traditional de...Today’s product creative design has rendered many fe atures and has brought a great change in our everyday life, there are many new c hallenges in its traditional theory and principle. According to the traditional design theory, the FBS design model pays more attention to the function and stru cture of the product. But this model still couldn’t strengthen the relation bet ween product appearance design and human-machine design effectively. This paper adopt converse design thinking and presents an improved design thinking methodo logy based on C: FBS for product appearance design and give a general summarizat ion for the features, methods and technology based on human-machine interaction and interface. Meanwhile it also combines with the behavior design of product r elated IT fields and constructs a new outline to improve the design of product a ppearance supported by the technology of computer aided design. So the new metho d about design thinking for computer aided design, the new abstract product design model and the key problem of design thinking based on human-machine inte raction and interface are addressed in this paper. This kind of creative design theory that is driven by human-machine interaction and interface will help the development of CAD software system and the research of product design and manufa cture. Additionally, this paper gives some beneficial characters to address the theory based on human-machine interaction and interface. Meanwhile, combining with the developing of computer technology, the trends of design thinking based on t he technology of human-machine interaction and interface are also analyzed and discussed at the end of this paper.展开更多
Porous hydrogel sensors have attracted significant attention in fields such as smart wearables and medical monitoring due to their high sensitivity.However,existing fabrication methods typically degrade the surface sm...Porous hydrogel sensors have attracted significant attention in fields such as smart wearables and medical monitoring due to their high sensitivity.However,existing fabrication methods typically degrade the surface smoothness of hydrogels when introducing porous structures and face significant challenges in removing fillers completely.To address these challenges,we herein introduce a novel one-step,thermosensitive spray-coating technique for the preparation of aircell hydrogel(ACH).This method leverages the rapid cooling of a thermoresponsive gelatin methacryloyl solution through atomization,enabling rapid cross-linking within seconds and air bubbles encapsulated in situ.Additionally,the transient flow of the pre-gel facilitates the repair of voids formed by ruptured surface bubbles,leading to the creation of the ACH with uniformly distributed inner air bubbles and a smooth outer surface.The mold-free fabrication method is independent of substrate surface properties,enabling the creation of a porous hydrogel film with a thickness as thin as 163 µm.Furthermore,the dual-crosslinked network endows the ACH with excellent anti-swelling properties,and the physical crosslinking between gelatin molecules allows the ACH to self-heal.The ACH exhibits excellent sensitivity in deformation sensing and can even successfully track minor external forces,which enables it to effectively complete various tasks such as facial expression recognition,pitch differentiation,and motion detection.By integrating the ACH into a sensing glove,we also demonstrate the significant potential of the ACH for applications in human-machine interaction and tactile sensing.Ultimately,the ACH sensors are also applied to motion mapping and machine tactile feedback,indicating their promising potential in human-machine interaction.展开更多
Surgical robots are designed to provide enhanced precision and dexterity compared to manual surgical procedures,which mainly rely on multimodal sensing technologies for the surgeon to seamlessly operate the robotic ar...Surgical robots are designed to provide enhanced precision and dexterity compared to manual surgical procedures,which mainly rely on multimodal sensing technologies for the surgeon to seamlessly operate the robotic arms and instruments.Compared with single-mode sensors,optical and mechanical bi-modal sensors provide improved precision,enhanced safety,and robustness of human-machine interaction systems.Here,the template-guided and pneumatic printing technologies are combined to construct perovskite and graphene parallel structures with both optical and mechanical sensing capabilities.The printed uniformly crystallized perovskite microstructure exhibits fast and sensitive photoelectric response characteristics,enabling shadow recognition functionality.The combination of graphene and elastic rubber endows the great printability to prepare parallel structures near the perovskite arrays for force sensing capabilities.Thus,the printed perovskite and graphene structures possess non-contact optical sensing capabilities to detect hand position by recognizing shadows between the hand and the sensor,as well as contact mechanical sensing capabilities to detect touch force applied by the hand.It provides a synergistic platform for real-time and multidimensional feedback to improve human-machine interaction.展开更多
Three-dimensional(3D) display technology—a cutting-edge medium for human-machine interaction—enhances visual information density via image dimensional expansion and reduces the cognitive load to improve the efficien...Three-dimensional(3D) display technology—a cutting-edge medium for human-machine interaction—enhances visual information density via image dimensional expansion and reduces the cognitive load to improve the efficiency of information exchange [1–3].展开更多
Exoskeleton robots and their control methods have been extensively developed to aid post-stroke rehabilitation. Most of the existing methods using linear controllers are designed for position control and are not suita...Exoskeleton robots and their control methods have been extensively developed to aid post-stroke rehabilitation. Most of the existing methods using linear controllers are designed for position control and are not suitable for human-machine interaction(HMI) force control, as the interaction system between the human body and exoskeleton is uncertain and nonlinear. We present an approach for HMI force control via model reference adaptive impedance control(MRAIC) to solve this problem in case of index finger exoskeleton control. First, a dynamic HMI model, which is based on a position control inner loop, is formulated. Second, the theoretical MRAC framework is implemented in the control system. Then, the adaptive controllers are designed according to the Lyapunov stability theory. To verify the performance of the proposed method, we compare it with a proportional-integral-derivative(PID) method in the time domain with real experiments and in the frequency domain with simulations. The results illustrate the effectiveness and robustness of the proposed method in solving the nonlinear HMI force control problem in hand exoskeleton.展开更多
At nomaly detectors are used to distinguish differences between normal and abnormal data,which are usually implemented by evaluating and ranking the anomaly scores of each instance.A static unsupervised streaming anom...At nomaly detectors are used to distinguish differences between normal and abnormal data,which are usually implemented by evaluating and ranking the anomaly scores of each instance.A static unsupervised streaming anomaly detector is difficult to dynamically adjust anomaly score calculation.In real scenarios,anomaly detection often needs to be regulated by human feedback,which benefits adjusting anomaly detectors.In this paper,we propose a human-machine interactive streaming anomaly detection method,named ISPForest,which can be adaptively updated online under the guidance of human feedback.In particular,the feedback will be used to adjust the anomaly score calculation and structure of the detector,ideally attaining more accurate anomaly scores in the future.Our main contribution is to improve the tree-based streaming anomaly detection model that can be updated online from perspectives of anomaly score calculation and model structure.Our approach is instantiated for the powerful class of tree-based streaming anomaly detectors,and we conduct experiments on a range of benchmark datasets.The results demonstrate that the utility of incorporating feedback can improve the performance of anomaly detectors with a few human efforts.展开更多
Noncontact interaction systems have attracted considerable research attention in recent years because of convenient operation,sterility,and injury prevention.However,the insufficient sensing distance and weak robustne...Noncontact interaction systems have attracted considerable research attention in recent years because of convenient operation,sterility,and injury prevention.However,the insufficient sensing distance and weak robustness of noncontact interaction systems for complex environments limit their practical applications.Here,we designed an integrated optical noncontact controlling system(ONCS)based on PtTe_(x)/Si optoelectronic heterojunction array.Broadband sensitive photoresponse is realized at zero bias voltage,with excellent detectivity and responsivity,boosting the noncontact sensing distance to at least 150 mm.Consequently,the system can perform noncontact detection,encoding,and control by recognizing shadow-induced spatiotemporal sequence changes in heterojunction array photocurrents.As a proof of concept,different interactive functions have been demonstrated with good accuracy and robustness by encoding finger movement above the ONCS.This study provides a new perspective for constructing high-performance noncontact interaction systems.展开更多
Human-machine interaction can incorporate several components which when suitably designed,synthesized,and integrated can benefit the human decision maker in performing various tasks and activities.These interactions c...Human-machine interaction can incorporate several components which when suitably designed,synthesized,and integrated can benefit the human decision maker in performing various tasks and activities.These interactions can be designed through multiple modalities such as textural,graphic,audio,or any tangible interfaces depending on the specific nature of the decision-making task which needs to be performed by human.The control and decision-making architecture of such humanmachine interaction can be defined in variety of ways.In this paper,we present an overview of an architecture which has been recently proposed in the literature based on the notion of open quantum systems.We present a brief interpretation of some of the main modelling and solution components of this framework.The main implication of this framework is that it presents the state of the decision maker and the interacting environment in a probabilistic framework,where the time evolution of this ensemble is estimated within the interpretation and solutions of the open quantum system.展开更多
In the parallel steering coordination control strategy for path tracking,it is difficult to match the current driver steering model using the fixed parameters with the actual driver,and the designed steering coordinat...In the parallel steering coordination control strategy for path tracking,it is difficult to match the current driver steering model using the fixed parameters with the actual driver,and the designed steering coordination control strategy under a single objective and simple conditions is difficult to adapt to the multi-dimensional state variables’input.In this paper,we propose a deep reinforcement learning algorithm-based multi-objective parallel human-machine steering coordination strategy for path tracking considering driver misoperation and external disturbance.Firstly,the driver steering mathematical model is constructed based on the driver preview characteristics and steering delay response,and the driver characteristic parameters are fitted after collecting the actual driver driving data.Secondly,considering that the vehicle is susceptible to the influence of external disturbances during the driving process,the Tube MPC(Tube Model Predictive Control)based path tracking steering controller is designed based on the vehicle system dynamics error model.After verifying that the driver steering model meets the driver steering operation characteristics,DQN(Deep Q-network),DDPG(Deep Deterministic Policy Gradient)and TD3(Twin Delayed Deep Deterministic Policy Gradient)deep reinforcement learning algorithms are utilized to design a multi-objective parallel steering coordination strategy which satisfies the multi-dimensional state variables’input of the vehicle.Finally,the tracking accuracy,lateral safety,human-machine conflict and driver steering load evaluation index are designed in different driver operation states and different road environments,and the performance of the parallel steering coordination control strategies with different deep reinforcement learning algorithms and fuzzy algorithms are compared by simulations and hardware in the loop experiments.The results show that the parallel steering collaborative strategy based on a deep reinforcement learning algorithm can more effectively assist the driver in tracking the target path under lateral wind interference and driver misoperation,and the TD3-based coordination control strategy has better overall performance.展开更多
Human-machine interaction(HMI)has always been at the frontier of technological innovation,making our interactions with technology more intuitive and effi-cient,as well as driving much of the research interest in this ...Human-machine interaction(HMI)has always been at the frontier of technological innovation,making our interactions with technology more intuitive and effi-cient,as well as driving much of the research interest in this field.Wearable electronic systems can seamlessly and accurately receive,store,process,and output information.This endows them with tremendous potential applications ranging from daily life interactions to monitoring physiological signals and clinical medical treatments.Building upon this foundation,researchers have embarked on a series of innovations concerning textile fibers’materials,manufacturing techniques,and further functional payloads.展开更多
Photothermoelectric(PTE)photodetectors with selfpowered and uncooled advantages have attracted much interest due to the wide application prospects in the military and civilian fields.However,traditional PTE photodetec...Photothermoelectric(PTE)photodetectors with selfpowered and uncooled advantages have attracted much interest due to the wide application prospects in the military and civilian fields.However,traditional PTE photodetectors lack of mechanical flexibility and cannot operate independently without the test instrument.Herein,we present a flexible PTE photodetector capable of dual-mode output,combining electrical and optical signal generation for enhanced functionality.Using solution processing,high-quality MXene thin films are assembled on asymmetric electrodes as the photosensitive layer.The geometrically asymmetric electrode design significantly enhances the responsivity,achieving 0.33 m A W^(-1)under infrared illumination,twice that of the symmetrical configuration.This improvement stems from optimized photothermal conversion and an expanded temperature gradient.The PTE device maintains stable performance after 300 bending cycles,demonstrating excellent flexibility.A new energy conversion pathway has been established by coupling the photothermal conversion of MXene with thermochromic composite materials,leading to a real-time visualization of invisible infrared radiation.Leveraging this functionality,we demonstrate the first human-machine collaborative infrared imaging system,wherein the dual-mode photodetector arrays synchronously generate human-readable pattern and machine-readable pattern.Our study not only provides a new solution for functional integration of flexible photodetectors,but also sets a new benchmark for human-machine collaborative optoelectronics.展开更多
Background With an increasing number of vehicles becoming autonomous,intelligent,and connected,paying attention to the future usage of car human-machine interface with these vehicles should become more relevant.Severa...Background With an increasing number of vehicles becoming autonomous,intelligent,and connected,paying attention to the future usage of car human-machine interface with these vehicles should become more relevant.Several studies have addressed car HMI but were less attentive to designing and implementing interactive glazing for every day(autonomous)driving contexts.Methods Reflecting on the literature,we describe an engineering psychology practice and the design of six novel future user scenarios,which envision the application of a specific set of augmented reality(AR)support user interactions.Additionally,we conduct evaluations on specific scenarios and experiential prototypes,which reveal that these AR scenarios aid the target user groups in experiencing a new type of interaction.The overall evaluation is positive with valuable assessment results and suggestions.Conclusions This study can interest applied psychology educators who aspire to teach how AR can be operationalized in a human-centered design process to students with minimal pre-existing expertise or minimal scientific knowledge in engineering psychology.展开更多
基金supported by the National Key R&D Program of China(No.2023YFC3081200)the National Natural Science Foundation of China(No.42077264)the Scientific Research Project of PowerChina Huadong Engineering Corporation Limited(HDEC-2022-0301).
文摘Rock discontinuities control rock mechanical behaviors and significantly influence the stability of rock masses.However,existing discontinuity mapping algorithms are susceptible to noise,and the calculation results cannot be fed back to users timely.To address this issue,we proposed a human-machine interaction(HMI)method for discontinuity mapping.Users can help the algorithm identify the noise and make real-time result judgments and parameter adjustments.For this,a regular cube was selected to illustrate the workflows:(1)point cloud was acquired using remote sensing;(2)the HMI method was employed to select reference points and angle thresholds to detect group discontinuity;(3)individual discontinuities were extracted from the group discontinuity using a density-based cluster algorithm;and(4)the orientation of each discontinuity was measured based on a plane fitting algorithm.The method was applied to a well-studied highway road cut and a complex natural slope.The consistency of the computational results with field measurements demonstrates its good accuracy,and the average error in the dip direction and dip angle for both cases was less than 3.Finally,the computational time of the proposed method was compared with two other popular algorithms,and the reduction in computational time by tens of times proves its high computational efficiency.This method provides geologists and geological engineers with a new idea to map rapidly and accurately rock structures under large amounts of noises or unclear features.
基金supported in part by the National Natural Science Foundation of China(U181321461773369+2 种基金61903360)the Selfplanned Project of the State Key Laboratory of Robotics(2020-Z12)China Postdoctoral Science Foundation funded project(2019M661155)。
文摘Electromyography(EMG)has already been broadly used in human-machine interaction(HMI)applications.Determining how to decode the information inside EMG signals robustly and accurately is a key problem for which we urgently need a solution.Recently,many EMG pattern recognition tasks have been addressed using deep learning methods.In this paper,we analyze recent papers and present a literature review describing the role that deep learning plays in EMG-based HMI.An overview of typical network structures and processing schemes will be provided.Recent progress in typical tasks such as movement classification,joint angle prediction,and force/torque estimation will be introduced.New issues,including multimodal sensing,inter-subject/inter-session,and robustness toward disturbances will be discussed.We attempt to provide a comprehensive analysis of current research by discussing the advantages,challenges,and opportunities brought by deep learning.We hope that deep learning can aid in eliminating factors that hinder the development of EMG-based HMI systems.Furthermore,possible future directions will be presented to pave the way for future research.
基金financially supported by the Natural Science Foundation of China(Nos.22109120,62104170 and 82202757)Zhejiang Provincial Natural Science Foundation of China(Nos.LQ21B030002 and LY23F040001)。
文摘Hydrogel-based triboelectric nanoge nerator(TENG)has a promising applied prospect in wearable electronic devices.However,its low performance,poor stability,insufficient recyclability and inferior self-healing seriously hinder its development.Herein,we report a robust route to a liquid metal(LM)/polyvinyl alcohol(PVA)hydrogel-based TENG(LP-TENG).Owing to the intrinsically liquid feature of conductive LM within the flexible PVA hydrogel,the as-prepared LP-TENG exhibited comprehensiye advantages of adaptability,biocompatibility,outstanding electrical performance,superior stability,recyclability and diverse applications,which were unattainable by traditional systems.Concretely,the LP-TENG delivered appealing open circuit voltage of 250 V,short circuit current of 4μA and transferred charge of 120 nC with high stability,outperforming most advanced TENG systems.The LP-TENG was successfully employed for versatile applications with multifunctionality,including human motion detection,handwriting recognition,energy collection,message transmission and human-machine interaction.This work presents significant prospects for crafting advanced materials and devices in the fields of wearable electronics,flexible skin and smart robots.
基金Supported by the National Natural Science Foundation of China （No. 40071071）.
文摘The fusion of VlSI （visual identity system Internet）, digital maps and Web GIS is presented. Web GIS interface interactive design with VISI needs to consider more new factors. VISI can provide the design principle, elements and contents for the Web GIS. The design of the Wuhan Bus Search System is fulfilled to confirm the validity and practicability of the fusion.
文摘Speech recognition rate will deteriorate greatly in human-machine interaction when the speaker's speech mixes with a bystander's voice. This paper proposes a time-frequency approach for Blind Source Seperation (BSS) for intelligent Human-Machine Interaction(HMI). Main idea of the algorithm is to simultaneously diagonalize the correlation matrix of the pre-whitened signals at different time delays for every frequency bins in time-frequency domain. The prososed method has two merits: (1) fast convergence speed; (2) high signal to interference ratio of the separated signals. Numerical evaluations are used to compare the performance of the proposed algorithm with two other deconvolution algorithms. An efficient algorithm to resolve permutation ambiguity is also proposed in this paper. The algorithm proposed saves more than 10% of computational time with properly selected parameters and achieves good performances for both simulated convolutive mixtures and real room recorded speeches.
基金NSFC-Shenzhen Robotics Research Center Project(No.U2013207)the Beijing Science and Technology Plan Project(No.Z191100008019008)。
文摘Teleoperation is of great importance in the area of robotics,especially when people are unavailable in the robot workshop.It provides a way for people to control robots remotely using human intelligence.In this paper,a robotic teleoperation system for precise robotic manipulation is established.The data glove and the 7-degrees of freedom(DOFs)force feedback controller are used for the remote control interaction.The control system and the monitor system are designed for the remote precise manipulation.The monitor system contains an image acquisition system and a human-machine interaction module,and aims to simulate and detect the robot running state.Besides,a visual object tracking algorithm is developed to estimate the states of the dynamic system from noisy observations.The established robotic teleoperation systemis applied to a series of experiments,and high-precision results are obtained,showing the effectiveness of the physical system.
基金supported by the China Postdoctoral Science Foundation(No.2022BG011)the Fundamental Research Funds for Central Universities(No.2020CDJ-LHZZ-077)+1 种基金the Natural Science Foundation of Chongqing,China(No.c stc2020jcyj-msxmX0397)the Fundamental Research Funds for Central Universities(No.00007717).
文摘As the Internet of Things advances,gesture recognition emerges as a prominent domain in human-machine interaction(HMI).However,interactive wearables based on conductive hydrogels for individuals with single-arm functionality or disabilities remain underexplored.Here,we devised a wearable one-handed keyboard with gesture recognition,employing machine learning algorithms and hydrogel-based mechanical sensors to boost productivity.PCG(PAM/CMC/rGO)hydrogels are composed of polyacrylamide(PAM),sodium carboxymethyl cellulose(CMC),and reduced graphene oxide(rGO),which function as a strain,pressure sensor,and electrode material.The PAM chains offer the gel’s elasticity by covalent cross-linking,while the biocompatible CMC improves the dispersion of rGO and promotes electromechanical properties.Integrating rGO sheets into the polymer matrix facilitates cross-linking and generates supple-mentary conductive pathways,thereby augmenting the gel system’s elasticity,sensitivity,and durability.Our hydrogel sensors include high sensitivity(gage factor(GF)=8.18,395.6%-551.96%)and superior pressure sensing capabilities(Sensitivity(S)=0.3116 kPa^(-1),0-9.82 kPa).Furthermore,we developed a wearable keyboard with up to 98.13%accuracy using convolutional neural networks and a custom data acquisition system.This study establishes the groundwork for creating multifunctional gel sensors for intelligent machines,wearable devices,and brain-computer interfaces.
基金the National Key R&D Project from Minister of Science and Technology(Grant No.2016YFA0202704)the Beijing Municipal Natural Science Foundation(Grant No.2212052)+1 种基金the Shanghai Sailing Program(Grant No.19S28101)the Fundamental Research Funds for the Central Universities(Grant No.19D128102).
文摘Combination flexible and stretchable textiles with self-powered sensors bring a novel insight into wearable functional electronics and cyber security in the era of Internet of Things.This work presents a highly flexible and self-powered fully fabric-based triboelectric nanogenerator(F-TENG)with sandwiched structure for biomechanical energy harvesting and real-time biometric authentication.The prepared F-TENG can power a digital watch by low-frequency motion and respond to the pressure change by the fall of leaves.A self-powered wearable keyboard(SPWK)is also fabricated by integrating large-area F-TENG sensor arrays,which not only can trace and record electrophysiological signals,but also can identify individuals’typing characteristics by means of the Haar wavelet.Based on these merits,the SPWK has promising applications in the realm of wearable electronics,self-powered sensors,cyber security,and artificial intelligences.
文摘Today’s product creative design has rendered many fe atures and has brought a great change in our everyday life, there are many new c hallenges in its traditional theory and principle. According to the traditional design theory, the FBS design model pays more attention to the function and stru cture of the product. But this model still couldn’t strengthen the relation bet ween product appearance design and human-machine design effectively. This paper adopt converse design thinking and presents an improved design thinking methodo logy based on C: FBS for product appearance design and give a general summarizat ion for the features, methods and technology based on human-machine interaction and interface. Meanwhile it also combines with the behavior design of product r elated IT fields and constructs a new outline to improve the design of product a ppearance supported by the technology of computer aided design. So the new metho d about design thinking for computer aided design, the new abstract product design model and the key problem of design thinking based on human-machine inte raction and interface are addressed in this paper. This kind of creative design theory that is driven by human-machine interaction and interface will help the development of CAD software system and the research of product design and manufa cture. Additionally, this paper gives some beneficial characters to address the theory based on human-machine interaction and interface. Meanwhile, combining with the developing of computer technology, the trends of design thinking based on t he technology of human-machine interaction and interface are also analyzed and discussed at the end of this paper.
基金financially supported by the National Key R&D Program of China(Grant No.2023YFE0108900)EU HORIZON 2021 L4DNANO(No.101086227)。
文摘Porous hydrogel sensors have attracted significant attention in fields such as smart wearables and medical monitoring due to their high sensitivity.However,existing fabrication methods typically degrade the surface smoothness of hydrogels when introducing porous structures and face significant challenges in removing fillers completely.To address these challenges,we herein introduce a novel one-step,thermosensitive spray-coating technique for the preparation of aircell hydrogel(ACH).This method leverages the rapid cooling of a thermoresponsive gelatin methacryloyl solution through atomization,enabling rapid cross-linking within seconds and air bubbles encapsulated in situ.Additionally,the transient flow of the pre-gel facilitates the repair of voids formed by ruptured surface bubbles,leading to the creation of the ACH with uniformly distributed inner air bubbles and a smooth outer surface.The mold-free fabrication method is independent of substrate surface properties,enabling the creation of a porous hydrogel film with a thickness as thin as 163 µm.Furthermore,the dual-crosslinked network endows the ACH with excellent anti-swelling properties,and the physical crosslinking between gelatin molecules allows the ACH to self-heal.The ACH exhibits excellent sensitivity in deformation sensing and can even successfully track minor external forces,which enables it to effectively complete various tasks such as facial expression recognition,pitch differentiation,and motion detection.By integrating the ACH into a sensing glove,we also demonstrate the significant potential of the ACH for applications in human-machine interaction and tactile sensing.Ultimately,the ACH sensors are also applied to motion mapping and machine tactile feedback,indicating their promising potential in human-machine interaction.
基金supported by the National Natural Science Foundation of China(Grant Nos.52222313,22075296,52321006,T2394480,and T2394484)the National Key R&D Program of China(Grant Nos.2023YFE0111500,2021YFB3200701,and 2022YFB4700804)+1 种基金Beijing National Laboratory for Molecular Sciences(Grant No.BNLMSCXXM-202005)Beijing Municipal Science&Technology Commission(Grant No.Z231100005923039).
文摘Surgical robots are designed to provide enhanced precision and dexterity compared to manual surgical procedures,which mainly rely on multimodal sensing technologies for the surgeon to seamlessly operate the robotic arms and instruments.Compared with single-mode sensors,optical and mechanical bi-modal sensors provide improved precision,enhanced safety,and robustness of human-machine interaction systems.Here,the template-guided and pneumatic printing technologies are combined to construct perovskite and graphene parallel structures with both optical and mechanical sensing capabilities.The printed uniformly crystallized perovskite microstructure exhibits fast and sensitive photoelectric response characteristics,enabling shadow recognition functionality.The combination of graphene and elastic rubber endows the great printability to prepare parallel structures near the perovskite arrays for force sensing capabilities.Thus,the printed perovskite and graphene structures possess non-contact optical sensing capabilities to detect hand position by recognizing shadows between the hand and the sensor,as well as contact mechanical sensing capabilities to detect touch force applied by the hand.It provides a synergistic platform for real-time and multidimensional feedback to improve human-machine interaction.
文摘Three-dimensional(3D) display technology—a cutting-edge medium for human-machine interaction—enhances visual information density via image dimensional expansion and reduces the cognitive load to improve the efficiency of information exchange [1–3].
基金Project supported by the National Natural Science Foundation of China(No.51221004)
文摘Exoskeleton robots and their control methods have been extensively developed to aid post-stroke rehabilitation. Most of the existing methods using linear controllers are designed for position control and are not suitable for human-machine interaction(HMI) force control, as the interaction system between the human body and exoskeleton is uncertain and nonlinear. We present an approach for HMI force control via model reference adaptive impedance control(MRAIC) to solve this problem in case of index finger exoskeleton control. First, a dynamic HMI model, which is based on a position control inner loop, is formulated. Second, the theoretical MRAC framework is implemented in the control system. Then, the adaptive controllers are designed according to the Lyapunov stability theory. To verify the performance of the proposed method, we compare it with a proportional-integral-derivative(PID) method in the time domain with real experiments and in the frequency domain with simulations. The results illustrate the effectiveness and robustness of the proposed method in solving the nonlinear HMI force control problem in hand exoskeleton.
基金supported in part by the National Science Fund for Distinguished Young Scholars(61725205)the National Natural Science Foundation of China(Grant Nos.61960206008,61772428,61972319,and61902320).
文摘At nomaly detectors are used to distinguish differences between normal and abnormal data,which are usually implemented by evaluating and ranking the anomaly scores of each instance.A static unsupervised streaming anomaly detector is difficult to dynamically adjust anomaly score calculation.In real scenarios,anomaly detection often needs to be regulated by human feedback,which benefits adjusting anomaly detectors.In this paper,we propose a human-machine interactive streaming anomaly detection method,named ISPForest,which can be adaptively updated online under the guidance of human feedback.In particular,the feedback will be used to adjust the anomaly score calculation and structure of the detector,ideally attaining more accurate anomaly scores in the future.Our main contribution is to improve the tree-based streaming anomaly detection model that can be updated online from perspectives of anomaly score calculation and model structure.Our approach is instantiated for the powerful class of tree-based streaming anomaly detectors,and we conduct experiments on a range of benchmark datasets.The results demonstrate that the utility of incorporating feedback can improve the performance of anomaly detectors with a few human efforts.
基金supported by the National Natural Science Foundation of China(NSFC,Grant Nos.61625404,61874111,61888102 and 62022079)the Youth Innovation Promotion Association of the Chinese Academy of Sciences(No.2020115).
文摘Noncontact interaction systems have attracted considerable research attention in recent years because of convenient operation,sterility,and injury prevention.However,the insufficient sensing distance and weak robustness of noncontact interaction systems for complex environments limit their practical applications.Here,we designed an integrated optical noncontact controlling system(ONCS)based on PtTe_(x)/Si optoelectronic heterojunction array.Broadband sensitive photoresponse is realized at zero bias voltage,with excellent detectivity and responsivity,boosting the noncontact sensing distance to at least 150 mm.Consequently,the system can perform noncontact detection,encoding,and control by recognizing shadow-induced spatiotemporal sequence changes in heterojunction array photocurrents.As a proof of concept,different interactive functions have been demonstrated with good accuracy and robustness by encoding finger movement above the ONCS.This study provides a new perspective for constructing high-performance noncontact interaction systems.
文摘Human-machine interaction can incorporate several components which when suitably designed,synthesized,and integrated can benefit the human decision maker in performing various tasks and activities.These interactions can be designed through multiple modalities such as textural,graphic,audio,or any tangible interfaces depending on the specific nature of the decision-making task which needs to be performed by human.The control and decision-making architecture of such humanmachine interaction can be defined in variety of ways.In this paper,we present an overview of an architecture which has been recently proposed in the literature based on the notion of open quantum systems.We present a brief interpretation of some of the main modelling and solution components of this framework.The main implication of this framework is that it presents the state of the decision maker and the interacting environment in a probabilistic framework,where the time evolution of this ensemble is estimated within the interpretation and solutions of the open quantum system.
基金Supported by National Natural Science Foundation of China(Grant Nos.U22A20246,52372382)Hefei Municipal Natural Science Foundation(Grant No.2022008)+1 种基金the Open Fund of State Key Laboratory of Mechanical Behavior and System Safety of Traffic Engineering Structures(Grant No.KF2023-06)S&T Program of Hebei(Grant No.225676162GH).
文摘In the parallel steering coordination control strategy for path tracking,it is difficult to match the current driver steering model using the fixed parameters with the actual driver,and the designed steering coordination control strategy under a single objective and simple conditions is difficult to adapt to the multi-dimensional state variables’input.In this paper,we propose a deep reinforcement learning algorithm-based multi-objective parallel human-machine steering coordination strategy for path tracking considering driver misoperation and external disturbance.Firstly,the driver steering mathematical model is constructed based on the driver preview characteristics and steering delay response,and the driver characteristic parameters are fitted after collecting the actual driver driving data.Secondly,considering that the vehicle is susceptible to the influence of external disturbances during the driving process,the Tube MPC(Tube Model Predictive Control)based path tracking steering controller is designed based on the vehicle system dynamics error model.After verifying that the driver steering model meets the driver steering operation characteristics,DQN(Deep Q-network),DDPG(Deep Deterministic Policy Gradient)and TD3(Twin Delayed Deep Deterministic Policy Gradient)deep reinforcement learning algorithms are utilized to design a multi-objective parallel steering coordination strategy which satisfies the multi-dimensional state variables’input of the vehicle.Finally,the tracking accuracy,lateral safety,human-machine conflict and driver steering load evaluation index are designed in different driver operation states and different road environments,and the performance of the parallel steering coordination control strategies with different deep reinforcement learning algorithms and fuzzy algorithms are compared by simulations and hardware in the loop experiments.The results show that the parallel steering collaborative strategy based on a deep reinforcement learning algorithm can more effectively assist the driver in tracking the target path under lateral wind interference and driver misoperation,and the TD3-based coordination control strategy has better overall performance.
基金supported by the National Natural Science Foundation of China(81930051)the Program of Shanghai Academic/Technology Research Leader(22XD1422600).
文摘Human-machine interaction(HMI)has always been at the frontier of technological innovation,making our interactions with technology more intuitive and effi-cient,as well as driving much of the research interest in this field.Wearable electronic systems can seamlessly and accurately receive,store,process,and output information.This endows them with tremendous potential applications ranging from daily life interactions to monitoring physiological signals and clinical medical treatments.Building upon this foundation,researchers have embarked on a series of innovations concerning textile fibers’materials,manufacturing techniques,and further functional payloads.
基金supported by the Fundamental Research Funds for the Central Universities(xxj022019009)。
文摘Photothermoelectric(PTE)photodetectors with selfpowered and uncooled advantages have attracted much interest due to the wide application prospects in the military and civilian fields.However,traditional PTE photodetectors lack of mechanical flexibility and cannot operate independently without the test instrument.Herein,we present a flexible PTE photodetector capable of dual-mode output,combining electrical and optical signal generation for enhanced functionality.Using solution processing,high-quality MXene thin films are assembled on asymmetric electrodes as the photosensitive layer.The geometrically asymmetric electrode design significantly enhances the responsivity,achieving 0.33 m A W^(-1)under infrared illumination,twice that of the symmetrical configuration.This improvement stems from optimized photothermal conversion and an expanded temperature gradient.The PTE device maintains stable performance after 300 bending cycles,demonstrating excellent flexibility.A new energy conversion pathway has been established by coupling the photothermal conversion of MXene with thermochromic composite materials,leading to a real-time visualization of invisible infrared radiation.Leveraging this functionality,we demonstrate the first human-machine collaborative infrared imaging system,wherein the dual-mode photodetector arrays synchronously generate human-readable pattern and machine-readable pattern.Our study not only provides a new solution for functional integration of flexible photodetectors,but also sets a new benchmark for human-machine collaborative optoelectronics.
基金Supported by the‘Automotive Glazing Application in Intelligent Cockpit Human-Machine Interface’project(SKHX2021049)a collaboration between the Saint-Go Bain Research and the Beijing Normal University。
文摘Background With an increasing number of vehicles becoming autonomous,intelligent,and connected,paying attention to the future usage of car human-machine interface with these vehicles should become more relevant.Several studies have addressed car HMI but were less attentive to designing and implementing interactive glazing for every day(autonomous)driving contexts.Methods Reflecting on the literature,we describe an engineering psychology practice and the design of six novel future user scenarios,which envision the application of a specific set of augmented reality(AR)support user interactions.Additionally,we conduct evaluations on specific scenarios and experiential prototypes,which reveal that these AR scenarios aid the target user groups in experiencing a new type of interaction.The overall evaluation is positive with valuable assessment results and suggestions.Conclusions This study can interest applied psychology educators who aspire to teach how AR can be operationalized in a human-centered design process to students with minimal pre-existing expertise or minimal scientific knowledge in engineering psychology.
