Photothermoelectric(PTE)photodetectors with selfpowered and uncooled advantages have attracted much interest due to the wide application prospects in the military and civilian fields.However,traditional PTE photodetec...Photothermoelectric(PTE)photodetectors with selfpowered and uncooled advantages have attracted much interest due to the wide application prospects in the military and civilian fields.However,traditional PTE photodetectors lack of mechanical flexibility and cannot operate independently without the test instrument.Herein,we present a flexible PTE photodetector capable of dual-mode output,combining electrical and optical signal generation for enhanced functionality.Using solution processing,high-quality MXene thin films are assembled on asymmetric electrodes as the photosensitive layer.The geometrically asymmetric electrode design significantly enhances the responsivity,achieving 0.33 m A W^(-1)under infrared illumination,twice that of the symmetrical configuration.This improvement stems from optimized photothermal conversion and an expanded temperature gradient.The PTE device maintains stable performance after 300 bending cycles,demonstrating excellent flexibility.A new energy conversion pathway has been established by coupling the photothermal conversion of MXene with thermochromic composite materials,leading to a real-time visualization of invisible infrared radiation.Leveraging this functionality,we demonstrate the first human-machine collaborative infrared imaging system,wherein the dual-mode photodetector arrays synchronously generate human-readable pattern and machine-readable pattern.Our study not only provides a new solution for functional integration of flexible photodetectors,but also sets a new benchmark for human-machine collaborative optoelectronics.展开更多
Rock discontinuities control rock mechanical behaviors and significantly influence the stability of rock masses.However,existing discontinuity mapping algorithms are susceptible to noise,and the calculation results ca...Rock discontinuities control rock mechanical behaviors and significantly influence the stability of rock masses.However,existing discontinuity mapping algorithms are susceptible to noise,and the calculation results cannot be fed back to users timely.To address this issue,we proposed a human-machine interaction(HMI)method for discontinuity mapping.Users can help the algorithm identify the noise and make real-time result judgments and parameter adjustments.For this,a regular cube was selected to illustrate the workflows:(1)point cloud was acquired using remote sensing;(2)the HMI method was employed to select reference points and angle thresholds to detect group discontinuity;(3)individual discontinuities were extracted from the group discontinuity using a density-based cluster algorithm;and(4)the orientation of each discontinuity was measured based on a plane fitting algorithm.The method was applied to a well-studied highway road cut and a complex natural slope.The consistency of the computational results with field measurements demonstrates its good accuracy,and the average error in the dip direction and dip angle for both cases was less than 3.Finally,the computational time of the proposed method was compared with two other popular algorithms,and the reduction in computational time by tens of times proves its high computational efficiency.This method provides geologists and geological engineers with a new idea to map rapidly and accurately rock structures under large amounts of noises or unclear features.展开更多
In the parallel steering coordination control strategy for path tracking,it is difficult to match the current driver steering model using the fixed parameters with the actual driver,and the designed steering coordinat...In the parallel steering coordination control strategy for path tracking,it is difficult to match the current driver steering model using the fixed parameters with the actual driver,and the designed steering coordination control strategy under a single objective and simple conditions is difficult to adapt to the multi-dimensional state variables’input.In this paper,we propose a deep reinforcement learning algorithm-based multi-objective parallel human-machine steering coordination strategy for path tracking considering driver misoperation and external disturbance.Firstly,the driver steering mathematical model is constructed based on the driver preview characteristics and steering delay response,and the driver characteristic parameters are fitted after collecting the actual driver driving data.Secondly,considering that the vehicle is susceptible to the influence of external disturbances during the driving process,the Tube MPC(Tube Model Predictive Control)based path tracking steering controller is designed based on the vehicle system dynamics error model.After verifying that the driver steering model meets the driver steering operation characteristics,DQN(Deep Q-network),DDPG(Deep Deterministic Policy Gradient)and TD3(Twin Delayed Deep Deterministic Policy Gradient)deep reinforcement learning algorithms are utilized to design a multi-objective parallel steering coordination strategy which satisfies the multi-dimensional state variables’input of the vehicle.Finally,the tracking accuracy,lateral safety,human-machine conflict and driver steering load evaluation index are designed in different driver operation states and different road environments,and the performance of the parallel steering coordination control strategies with different deep reinforcement learning algorithms and fuzzy algorithms are compared by simulations and hardware in the loop experiments.The results show that the parallel steering collaborative strategy based on a deep reinforcement learning algorithm can more effectively assist the driver in tracking the target path under lateral wind interference and driver misoperation,and the TD3-based coordination control strategy has better overall performance.展开更多
Electromyography(EMG)has already been broadly used in human-machine interaction(HMI)applications.Determining how to decode the information inside EMG signals robustly and accurately is a key problem for which we urgen...Electromyography(EMG)has already been broadly used in human-machine interaction(HMI)applications.Determining how to decode the information inside EMG signals robustly and accurately is a key problem for which we urgently need a solution.Recently,many EMG pattern recognition tasks have been addressed using deep learning methods.In this paper,we analyze recent papers and present a literature review describing the role that deep learning plays in EMG-based HMI.An overview of typical network structures and processing schemes will be provided.Recent progress in typical tasks such as movement classification,joint angle prediction,and force/torque estimation will be introduced.New issues,including multimodal sensing,inter-subject/inter-session,and robustness toward disturbances will be discussed.We attempt to provide a comprehensive analysis of current research by discussing the advantages,challenges,and opportunities brought by deep learning.We hope that deep learning can aid in eliminating factors that hinder the development of EMG-based HMI systems.Furthermore,possible future directions will be presented to pave the way for future research.展开更多
Combination flexible and stretchable textiles with self-powered sensors bring a novel insight into wearable functional electronics and cyber security in the era of Internet of Things.This work presents a highly flexib...Combination flexible and stretchable textiles with self-powered sensors bring a novel insight into wearable functional electronics and cyber security in the era of Internet of Things.This work presents a highly flexible and self-powered fully fabric-based triboelectric nanogenerator(F-TENG)with sandwiched structure for biomechanical energy harvesting and real-time biometric authentication.The prepared F-TENG can power a digital watch by low-frequency motion and respond to the pressure change by the fall of leaves.A self-powered wearable keyboard(SPWK)is also fabricated by integrating large-area F-TENG sensor arrays,which not only can trace and record electrophysiological signals,but also can identify individuals’typing characteristics by means of the Haar wavelet.Based on these merits,the SPWK has promising applications in the realm of wearable electronics,self-powered sensors,cyber security,and artificial intelligences.展开更多
Hydrogel-based triboelectric nanoge nerator(TENG)has a promising applied prospect in wearable electronic devices.However,its low performance,poor stability,insufficient recyclability and inferior self-healing seriousl...Hydrogel-based triboelectric nanoge nerator(TENG)has a promising applied prospect in wearable electronic devices.However,its low performance,poor stability,insufficient recyclability and inferior self-healing seriously hinder its development.Herein,we report a robust route to a liquid metal(LM)/polyvinyl alcohol(PVA)hydrogel-based TENG(LP-TENG).Owing to the intrinsically liquid feature of conductive LM within the flexible PVA hydrogel,the as-prepared LP-TENG exhibited comprehensiye advantages of adaptability,biocompatibility,outstanding electrical performance,superior stability,recyclability and diverse applications,which were unattainable by traditional systems.Concretely,the LP-TENG delivered appealing open circuit voltage of 250 V,short circuit current of 4μA and transferred charge of 120 nC with high stability,outperforming most advanced TENG systems.The LP-TENG was successfully employed for versatile applications with multifunctionality,including human motion detection,handwriting recognition,energy collection,message transmission and human-machine interaction.This work presents significant prospects for crafting advanced materials and devices in the fields of wearable electronics,flexible skin and smart robots.展开更多
We outline problems and potential solutions for feasible human-machine interfaces using cable-based parallel manipulators for physiotherapy applications.From an engineering perspective,we discuss the design constraint...We outline problems and potential solutions for feasible human-machine interfaces using cable-based parallel manipulators for physiotherapy applications.From an engineering perspective,we discuss the design constraints related to acceptance by patients and physiotherapist users.To date,most designs have focused on mobile platforms that are designed to be operated as an end-effector connected to human limbs for direct patient interaction.Some specific examples are illustrated from the authors' experience with prototypes available at Laboratory of Robotics and Mechatronics (LARM),Italy.展开更多
To reduce the complexity of the configuration and control strategy for shoulder rehabilitation exoskeleton,a 2R1R1P2R serial of shoulder exoskeleton based on gravity balance is proposed.Based on three basic rotatory s...To reduce the complexity of the configuration and control strategy for shoulder rehabilitation exoskeleton,a 2R1R1P2R serial of shoulder exoskeleton based on gravity balance is proposed.Based on three basic rotatory shoulder joints,an exact kinematic constraint system can be formed between the exoskeleton and the upper arm by introducing a passive sliding pair and a center of glenohumeral(CGH)unpowered compensation mechanism,which realizes the human-machine kinematic compatibility.Gravity balance is used in the CGH compensation mechanism to provide shoulder joint support.Meanwhile,the motion of the compensation mechanism is pulled by doing reverse leading through the arm to realize the kinematic self-adaptive,which decreases control complexity.Besides,a simple and intuitive spring adjustment strategy is proposed to ensure the gravity balance of any prescribed quality.Furthermore,according to the influencing factors analysis of the scapulohumeral rhythm,the kinematic analysis of CGH mechanism is performed,which shows that the mechanism can fit the trajectory of CGH under various conditions.Finally,the dynamic simulation of the mechanism is carried out.Results indicate that the compensation torques are reduced to below 0.22 N·m,and the feasibility of the mechanism is also verified.展开更多
The Chinese express delivery industry processes nearly 110 billion items in 2022,averaging an annual growth rate of 200%.Among the various types of sorting systems used for handling express items,cross-belt sorting sy...The Chinese express delivery industry processes nearly 110 billion items in 2022,averaging an annual growth rate of 200%.Among the various types of sorting systems used for handling express items,cross-belt sorting systems stand out as the most crucial.However,despite their high degree of automation,the workload for operators has intensified owing to the surging volume of express items.In the era of Industry 5.0,it is imperative to adopt new technologies that not only enhance worker welfare but also improve the efficiency of cross-belt systems.Striking a balance between efficiency in handling express items and operator well-being is challenging.Digital twin technology offers a promising solution in this respect.A realization method of a human-machine integrated digital twin is proposed in this study,enabling the interaction of biological human bodies,virtual human bodies,virtual equipment,and logistics equipment in a closed loop,thus setting an operating framework.Key technologies in the proposed framework include a collection of heterogeneous data from multiple sources,construction of the relationship between operator fatigue and operation efficiency based on physiological measurements,virtual model construction,and an online optimization module based on real-time simulation.The feasibility of the proposed method was verified in an express distribution center.展开更多
The fusion of VlSI （visual identity system Internet）, digital maps and Web GIS is presented. Web GIS interface interactive design with VISI needs to consider more new factors. VISI can provide the design principle, ...The fusion of VlSI （visual identity system Internet）, digital maps and Web GIS is presented. Web GIS interface interactive design with VISI needs to consider more new factors. VISI can provide the design principle, elements and contents for the Web GIS. The design of the Wuhan Bus Search System is fulfilled to confirm the validity and practicability of the fusion.展开更多
Speech recognition rate will deteriorate greatly in human-machine interaction when the speaker's speech mixes with a bystander's voice. This paper proposes a time-frequency approach for Blind Source Seperation...Speech recognition rate will deteriorate greatly in human-machine interaction when the speaker's speech mixes with a bystander's voice. This paper proposes a time-frequency approach for Blind Source Seperation (BSS) for intelligent Human-Machine Interaction(HMI). Main idea of the algorithm is to simultaneously diagonalize the correlation matrix of the pre-whitened signals at different time delays for every frequency bins in time-frequency domain. The prososed method has two merits: (1) fast convergence speed; (2) high signal to interference ratio of the separated signals. Numerical evaluations are used to compare the performance of the proposed algorithm with two other deconvolution algorithms. An efficient algorithm to resolve permutation ambiguity is also proposed in this paper. The algorithm proposed saves more than 10% of computational time with properly selected parameters and achieves good performances for both simulated convolutive mixtures and real room recorded speeches.展开更多
Teleoperation is of great importance in the area of robotics,especially when people are unavailable in the robot workshop.It provides a way for people to control robots remotely using human intelligence.In this paper,...Teleoperation is of great importance in the area of robotics,especially when people are unavailable in the robot workshop.It provides a way for people to control robots remotely using human intelligence.In this paper,a robotic teleoperation system for precise robotic manipulation is established.The data glove and the 7-degrees of freedom(DOFs)force feedback controller are used for the remote control interaction.The control system and the monitor system are designed for the remote precise manipulation.The monitor system contains an image acquisition system and a human-machine interaction module,and aims to simulate and detect the robot running state.Besides,a visual object tracking algorithm is developed to estimate the states of the dynamic system from noisy observations.The established robotic teleoperation systemis applied to a series of experiments,and high-precision results are obtained,showing the effectiveness of the physical system.展开更多
Background With an increasing number of vehicles becoming autonomous,intelligent,and connected,paying attention to the future usage of car human-machine interface with these vehicles should become more relevant.Severa...Background With an increasing number of vehicles becoming autonomous,intelligent,and connected,paying attention to the future usage of car human-machine interface with these vehicles should become more relevant.Several studies have addressed car HMI but were less attentive to designing and implementing interactive glazing for every day(autonomous)driving contexts.Methods Reflecting on the literature,we describe an engineering psychology practice and the design of six novel future user scenarios,which envision the application of a specific set of augmented reality(AR)support user interactions.Additionally,we conduct evaluations on specific scenarios and experiential prototypes,which reveal that these AR scenarios aid the target user groups in experiencing a new type of interaction.The overall evaluation is positive with valuable assessment results and suggestions.Conclusions This study can interest applied psychology educators who aspire to teach how AR can be operationalized in a human-centered design process to students with minimal pre-existing expertise or minimal scientific knowledge in engineering psychology.展开更多
As the Internet of Things advances,gesture recognition emerges as a prominent domain in human-machine interaction(HMI).However,interactive wearables based on conductive hydrogels for individuals with single-arm functi...As the Internet of Things advances,gesture recognition emerges as a prominent domain in human-machine interaction(HMI).However,interactive wearables based on conductive hydrogels for individuals with single-arm functionality or disabilities remain underexplored.Here,we devised a wearable one-handed keyboard with gesture recognition,employing machine learning algorithms and hydrogel-based mechanical sensors to boost productivity.PCG(PAM/CMC/rGO)hydrogels are composed of polyacrylamide(PAM),sodium carboxymethyl cellulose(CMC),and reduced graphene oxide(rGO),which function as a strain,pressure sensor,and electrode material.The PAM chains offer the gel’s elasticity by covalent cross-linking,while the biocompatible CMC improves the dispersion of rGO and promotes electromechanical properties.Integrating rGO sheets into the polymer matrix facilitates cross-linking and generates supple-mentary conductive pathways,thereby augmenting the gel system’s elasticity,sensitivity,and durability.Our hydrogel sensors include high sensitivity(gage factor(GF)=8.18,395.6%-551.96%)and superior pressure sensing capabilities(Sensitivity(S)=0.3116 kPa^(-1),0-9.82 kPa).Furthermore,we developed a wearable keyboard with up to 98.13%accuracy using convolutional neural networks and a custom data acquisition system.This study establishes the groundwork for creating multifunctional gel sensors for intelligent machines,wearable devices,and brain-computer interfaces.展开更多
In order to ensure the safety of children while using machineries and avoid harm caused by mechanical toys,this paper analyzes the types and detection standards of children’s toys,discusses the reasons for the harm c...In order to ensure the safety of children while using machineries and avoid harm caused by mechanical toys,this paper analyzes the types and detection standards of children’s toys,discusses the reasons for the harm caused by these toys,and proposes human-machine safety design strategies for children’s toys as reference.展开更多
With the rapid development of wearable electronic skin technology, flexible strain sensors have shown great application prospects in the fields of human motion and physiological signal detection, medical diagnostics, ...With the rapid development of wearable electronic skin technology, flexible strain sensors have shown great application prospects in the fields of human motion and physiological signal detection, medical diagnostics, and human-computer interaction owing to their outstanding sensing performance. This paper reports a strain sensor with synergistic conductive network, consisting of stable carbon nanotube dispersion (CNT) layer and brittle MXene layer by dip-coating and electrostatic self-assembly method, and breathable three-dimensional (3D) flexible substrate of thermoplastic polyurethane (TPU) fibrous membrane prepared through electrospinning technology. The MXene/CNT@PDA-TPU (MC@p-TPU) flexible strain sensor had excellent air permeability, wide operating range (0–450 %), high sensitivity (Gauge Factor, GFmax = 8089.7), ultra-low detection limit (0.05 %), rapid response and recovery times (40 ms/60 ms), and excellent cycle stability and durability (10,000 cycles). Given its superior strain sensing capabilities, this sensor can be applied in physiological signals detection, human motion pattern recognition, and driving exoskeleton robots. In addition, MC@p-TPU fibrous membrane also exhibited excellent photothermal conversion performance and can be used as a wearable photo-heater, which has far-reaching application potential in the photothermal therapy of human joint diseases.展开更多
Wearable wristband systems leverage deep learning to revolutionize hand gesture recognition in daily activities.Unlike existing approaches that often focus on static gestures and require extensive labeled data,the pro...Wearable wristband systems leverage deep learning to revolutionize hand gesture recognition in daily activities.Unlike existing approaches that often focus on static gestures and require extensive labeled data,the proposed wearable wristband with selfsupervised contrastive learning excels at dynamic motion tracking and adapts rapidly across multiple scenarios.It features a four-channel sensing array composed of an ionic hydrogel with hierarchical microcone structures and ultrathin flexible electrodes,resulting in high-sensitivity capacitance output.Through wireless transmission from a Wi-Fi module,the proposed algorithm learns latent features from the unlabeled signals of random wrist movements.Remarkably,only few-shot labeled data are sufficient for fine-tuning the model,enabling rapid adaptation to various tasks.The system achieves a high accuracy of 94.9%in different scenarios,including the prediction of eight-direction commands,and air-writing of all numbers and letters.The proposed method facilitates smooth transitions between multiple tasks without the need for modifying the structure or undergoing extensive task-specific training.Its utility has been further extended to enhance human–machine interaction over digital platforms,such as game controls,calculators,and three-language login systems,offering users a natural and intuitive way of communication.展开更多
With the rapid advancement of artificial intelligence(AI)technology,high school history teaching is undergoing a profound and unprecedented transformation.The 2024 Artificial Intelligence Index Report published by Sta...With the rapid advancement of artificial intelligence(AI)technology,high school history teaching is undergoing a profound and unprecedented transformation.The 2024 Artificial Intelligence Index Report published by Stanford University indicates that AI applications in education are expanding steadily,with an increasing number of educational institutions adopting AI to optimize teaching processes and enhance instructional effectiveness.Grounded in the current context and practical demands of AI integration in education,this study examines practical cases of AI-empowered high school history teaching,systematically analyzing its application scenarios,implementation pathways,and actual outcomes.Furthermore,this paper critically reflects on the challenges currently facing AI integration in high school history teaching and proposes actionable recommendations for future development,aiming to provide insights for advancing the digital transformation and intelligent upgrading of history education.展开更多
Surgical robots are designed to provide enhanced precision and dexterity compared to manual surgical procedures,which mainly rely on multimodal sensing technologies for the surgeon to seamlessly operate the robotic ar...Surgical robots are designed to provide enhanced precision and dexterity compared to manual surgical procedures,which mainly rely on multimodal sensing technologies for the surgeon to seamlessly operate the robotic arms and instruments.Compared with single-mode sensors,optical and mechanical bi-modal sensors provide improved precision,enhanced safety,and robustness of human-machine interaction systems.Here,the template-guided and pneumatic printing technologies are combined to construct perovskite and graphene parallel structures with both optical and mechanical sensing capabilities.The printed uniformly crystallized perovskite microstructure exhibits fast and sensitive photoelectric response characteristics,enabling shadow recognition functionality.The combination of graphene and elastic rubber endows the great printability to prepare parallel structures near the perovskite arrays for force sensing capabilities.Thus,the printed perovskite and graphene structures possess non-contact optical sensing capabilities to detect hand position by recognizing shadows between the hand and the sensor,as well as contact mechanical sensing capabilities to detect touch force applied by the hand.It provides a synergistic platform for real-time and multidimensional feedback to improve human-machine interaction.展开更多
Stretchable strain sensors are a crucial component in various applications,such as wearable devices,human-machine interfaces,and soft robotics.Hence,strain sensors with low hysteresis,high fidelity,and accurate sensin...Stretchable strain sensors are a crucial component in various applications,such as wearable devices,human-machine interfaces,and soft robotics.Hence,strain sensors with low hysteresis,high fidelity,and accurate sensing ability are urgently required for the precise measurement of large and high-frequency dynamic deformations.However,the existing hysteresis of the current functional materials utilized in strain sensors significantly impedes the achievement of these properties.Herein,we introduce an ultralow dynamic hysteresis capacitive strain sensor using a low-hysteresis and high-relative-permittivity ionic liquid-elastomer composite as the dielectric material.Based on the low-hysteresis dielectric,the prepared capacitive strain sensors exhibit ultralow electrical hysteresis(2.20%at a strain rate of 100% s^(-1)and strain of100%)and maintain low electrical hysteresis(4.35%)even under extremely high strain rates and large dynamic strain loads(a strain rate of 500% s^(-1)and strain of 100%).Moreover,the strain sensor manifests exceptional cyclic stability under 50,000 cycles of 100%strain at a strain rate of 200% s^(-1);the response curves remain nearly identical throughout these 50,000 cycles.Furthermore,the ultralowhysteresis strain sensor was successfully applied to accurate and reliable real-time human-machine interactions,revealing its great potential in various fields,including electronic skin,flexible robotics,wearable electronics,and virtual reality.展开更多
基金supported by the Fundamental Research Funds for the Central Universities(xxj022019009)。
文摘Photothermoelectric(PTE)photodetectors with selfpowered and uncooled advantages have attracted much interest due to the wide application prospects in the military and civilian fields.However,traditional PTE photodetectors lack of mechanical flexibility and cannot operate independently without the test instrument.Herein,we present a flexible PTE photodetector capable of dual-mode output,combining electrical and optical signal generation for enhanced functionality.Using solution processing,high-quality MXene thin films are assembled on asymmetric electrodes as the photosensitive layer.The geometrically asymmetric electrode design significantly enhances the responsivity,achieving 0.33 m A W^(-1)under infrared illumination,twice that of the symmetrical configuration.This improvement stems from optimized photothermal conversion and an expanded temperature gradient.The PTE device maintains stable performance after 300 bending cycles,demonstrating excellent flexibility.A new energy conversion pathway has been established by coupling the photothermal conversion of MXene with thermochromic composite materials,leading to a real-time visualization of invisible infrared radiation.Leveraging this functionality,we demonstrate the first human-machine collaborative infrared imaging system,wherein the dual-mode photodetector arrays synchronously generate human-readable pattern and machine-readable pattern.Our study not only provides a new solution for functional integration of flexible photodetectors,but also sets a new benchmark for human-machine collaborative optoelectronics.
基金supported by the National Key R&D Program of China(No.2023YFC3081200)the National Natural Science Foundation of China(No.42077264)the Scientific Research Project of PowerChina Huadong Engineering Corporation Limited(HDEC-2022-0301).
文摘Rock discontinuities control rock mechanical behaviors and significantly influence the stability of rock masses.However,existing discontinuity mapping algorithms are susceptible to noise,and the calculation results cannot be fed back to users timely.To address this issue,we proposed a human-machine interaction(HMI)method for discontinuity mapping.Users can help the algorithm identify the noise and make real-time result judgments and parameter adjustments.For this,a regular cube was selected to illustrate the workflows:(1)point cloud was acquired using remote sensing;(2)the HMI method was employed to select reference points and angle thresholds to detect group discontinuity;(3)individual discontinuities were extracted from the group discontinuity using a density-based cluster algorithm;and(4)the orientation of each discontinuity was measured based on a plane fitting algorithm.The method was applied to a well-studied highway road cut and a complex natural slope.The consistency of the computational results with field measurements demonstrates its good accuracy,and the average error in the dip direction and dip angle for both cases was less than 3.Finally,the computational time of the proposed method was compared with two other popular algorithms,and the reduction in computational time by tens of times proves its high computational efficiency.This method provides geologists and geological engineers with a new idea to map rapidly and accurately rock structures under large amounts of noises or unclear features.
基金Supported by National Natural Science Foundation of China(Grant Nos.U22A20246,52372382)Hefei Municipal Natural Science Foundation(Grant No.2022008)+1 种基金the Open Fund of State Key Laboratory of Mechanical Behavior and System Safety of Traffic Engineering Structures(Grant No.KF2023-06)S&T Program of Hebei(Grant No.225676162GH).
文摘In the parallel steering coordination control strategy for path tracking,it is difficult to match the current driver steering model using the fixed parameters with the actual driver,and the designed steering coordination control strategy under a single objective and simple conditions is difficult to adapt to the multi-dimensional state variables’input.In this paper,we propose a deep reinforcement learning algorithm-based multi-objective parallel human-machine steering coordination strategy for path tracking considering driver misoperation and external disturbance.Firstly,the driver steering mathematical model is constructed based on the driver preview characteristics and steering delay response,and the driver characteristic parameters are fitted after collecting the actual driver driving data.Secondly,considering that the vehicle is susceptible to the influence of external disturbances during the driving process,the Tube MPC(Tube Model Predictive Control)based path tracking steering controller is designed based on the vehicle system dynamics error model.After verifying that the driver steering model meets the driver steering operation characteristics,DQN(Deep Q-network),DDPG(Deep Deterministic Policy Gradient)and TD3(Twin Delayed Deep Deterministic Policy Gradient)deep reinforcement learning algorithms are utilized to design a multi-objective parallel steering coordination strategy which satisfies the multi-dimensional state variables’input of the vehicle.Finally,the tracking accuracy,lateral safety,human-machine conflict and driver steering load evaluation index are designed in different driver operation states and different road environments,and the performance of the parallel steering coordination control strategies with different deep reinforcement learning algorithms and fuzzy algorithms are compared by simulations and hardware in the loop experiments.The results show that the parallel steering collaborative strategy based on a deep reinforcement learning algorithm can more effectively assist the driver in tracking the target path under lateral wind interference and driver misoperation,and the TD3-based coordination control strategy has better overall performance.
基金supported in part by the National Natural Science Foundation of China(U181321461773369+2 种基金61903360)the Selfplanned Project of the State Key Laboratory of Robotics(2020-Z12)China Postdoctoral Science Foundation funded project(2019M661155)。
文摘Electromyography(EMG)has already been broadly used in human-machine interaction(HMI)applications.Determining how to decode the information inside EMG signals robustly and accurately is a key problem for which we urgently need a solution.Recently,many EMG pattern recognition tasks have been addressed using deep learning methods.In this paper,we analyze recent papers and present a literature review describing the role that deep learning plays in EMG-based HMI.An overview of typical network structures and processing schemes will be provided.Recent progress in typical tasks such as movement classification,joint angle prediction,and force/torque estimation will be introduced.New issues,including multimodal sensing,inter-subject/inter-session,and robustness toward disturbances will be discussed.We attempt to provide a comprehensive analysis of current research by discussing the advantages,challenges,and opportunities brought by deep learning.We hope that deep learning can aid in eliminating factors that hinder the development of EMG-based HMI systems.Furthermore,possible future directions will be presented to pave the way for future research.
基金the National Key R&D Project from Minister of Science and Technology(Grant No.2016YFA0202704)the Beijing Municipal Natural Science Foundation(Grant No.2212052)+1 种基金the Shanghai Sailing Program(Grant No.19S28101)the Fundamental Research Funds for the Central Universities(Grant No.19D128102).
文摘Combination flexible and stretchable textiles with self-powered sensors bring a novel insight into wearable functional electronics and cyber security in the era of Internet of Things.This work presents a highly flexible and self-powered fully fabric-based triboelectric nanogenerator(F-TENG)with sandwiched structure for biomechanical energy harvesting and real-time biometric authentication.The prepared F-TENG can power a digital watch by low-frequency motion and respond to the pressure change by the fall of leaves.A self-powered wearable keyboard(SPWK)is also fabricated by integrating large-area F-TENG sensor arrays,which not only can trace and record electrophysiological signals,but also can identify individuals’typing characteristics by means of the Haar wavelet.Based on these merits,the SPWK has promising applications in the realm of wearable electronics,self-powered sensors,cyber security,and artificial intelligences.
基金financially supported by the Natural Science Foundation of China(Nos.22109120,62104170 and 82202757)Zhejiang Provincial Natural Science Foundation of China(Nos.LQ21B030002 and LY23F040001)。
文摘Hydrogel-based triboelectric nanoge nerator(TENG)has a promising applied prospect in wearable electronic devices.However,its low performance,poor stability,insufficient recyclability and inferior self-healing seriously hinder its development.Herein,we report a robust route to a liquid metal(LM)/polyvinyl alcohol(PVA)hydrogel-based TENG(LP-TENG).Owing to the intrinsically liquid feature of conductive LM within the flexible PVA hydrogel,the as-prepared LP-TENG exhibited comprehensiye advantages of adaptability,biocompatibility,outstanding electrical performance,superior stability,recyclability and diverse applications,which were unattainable by traditional systems.Concretely,the LP-TENG delivered appealing open circuit voltage of 250 V,short circuit current of 4μA and transferred charge of 120 nC with high stability,outperforming most advanced TENG systems.The LP-TENG was successfully employed for versatile applications with multifunctionality,including human motion detection,handwriting recognition,energy collection,message transmission and human-machine interaction.This work presents significant prospects for crafting advanced materials and devices in the fields of wearable electronics,flexible skin and smart robots.
基金supported by the research project RORAS 2 of the Mediterranean Program funded by INRIA,France
文摘We outline problems and potential solutions for feasible human-machine interfaces using cable-based parallel manipulators for physiotherapy applications.From an engineering perspective,we discuss the design constraints related to acceptance by patients and physiotherapist users.To date,most designs have focused on mobile platforms that are designed to be operated as an end-effector connected to human limbs for direct patient interaction.Some specific examples are illustrated from the authors' experience with prototypes available at Laboratory of Robotics and Mechatronics (LARM),Italy.
基金The National Natural Science Foundation of China(No.51675098)。
文摘To reduce the complexity of the configuration and control strategy for shoulder rehabilitation exoskeleton,a 2R1R1P2R serial of shoulder exoskeleton based on gravity balance is proposed.Based on three basic rotatory shoulder joints,an exact kinematic constraint system can be formed between the exoskeleton and the upper arm by introducing a passive sliding pair and a center of glenohumeral(CGH)unpowered compensation mechanism,which realizes the human-machine kinematic compatibility.Gravity balance is used in the CGH compensation mechanism to provide shoulder joint support.Meanwhile,the motion of the compensation mechanism is pulled by doing reverse leading through the arm to realize the kinematic self-adaptive,which decreases control complexity.Besides,a simple and intuitive spring adjustment strategy is proposed to ensure the gravity balance of any prescribed quality.Furthermore,according to the influencing factors analysis of the scapulohumeral rhythm,the kinematic analysis of CGH mechanism is performed,which shows that the mechanism can fit the trajectory of CGH under various conditions.Finally,the dynamic simulation of the mechanism is carried out.Results indicate that the compensation torques are reduced to below 0.22 N·m,and the feasibility of the mechanism is also verified.
基金Supported by National Natural Science Foundation of China(Grant No.52075036)Key Technologies Research and Development Program of China(Grant No.2022YFC3302204).
文摘The Chinese express delivery industry processes nearly 110 billion items in 2022,averaging an annual growth rate of 200%.Among the various types of sorting systems used for handling express items,cross-belt sorting systems stand out as the most crucial.However,despite their high degree of automation,the workload for operators has intensified owing to the surging volume of express items.In the era of Industry 5.0,it is imperative to adopt new technologies that not only enhance worker welfare but also improve the efficiency of cross-belt systems.Striking a balance between efficiency in handling express items and operator well-being is challenging.Digital twin technology offers a promising solution in this respect.A realization method of a human-machine integrated digital twin is proposed in this study,enabling the interaction of biological human bodies,virtual human bodies,virtual equipment,and logistics equipment in a closed loop,thus setting an operating framework.Key technologies in the proposed framework include a collection of heterogeneous data from multiple sources,construction of the relationship between operator fatigue and operation efficiency based on physiological measurements,virtual model construction,and an online optimization module based on real-time simulation.The feasibility of the proposed method was verified in an express distribution center.
基金Supported by the National Natural Science Foundation of China （No. 40071071）.
文摘The fusion of VlSI （visual identity system Internet）, digital maps and Web GIS is presented. Web GIS interface interactive design with VISI needs to consider more new factors. VISI can provide the design principle, elements and contents for the Web GIS. The design of the Wuhan Bus Search System is fulfilled to confirm the validity and practicability of the fusion.
文摘Speech recognition rate will deteriorate greatly in human-machine interaction when the speaker's speech mixes with a bystander's voice. This paper proposes a time-frequency approach for Blind Source Seperation (BSS) for intelligent Human-Machine Interaction(HMI). Main idea of the algorithm is to simultaneously diagonalize the correlation matrix of the pre-whitened signals at different time delays for every frequency bins in time-frequency domain. The prososed method has two merits: (1) fast convergence speed; (2) high signal to interference ratio of the separated signals. Numerical evaluations are used to compare the performance of the proposed algorithm with two other deconvolution algorithms. An efficient algorithm to resolve permutation ambiguity is also proposed in this paper. The algorithm proposed saves more than 10% of computational time with properly selected parameters and achieves good performances for both simulated convolutive mixtures and real room recorded speeches.
基金NSFC-Shenzhen Robotics Research Center Project(No.U2013207)the Beijing Science and Technology Plan Project(No.Z191100008019008)。
文摘Teleoperation is of great importance in the area of robotics,especially when people are unavailable in the robot workshop.It provides a way for people to control robots remotely using human intelligence.In this paper,a robotic teleoperation system for precise robotic manipulation is established.The data glove and the 7-degrees of freedom(DOFs)force feedback controller are used for the remote control interaction.The control system and the monitor system are designed for the remote precise manipulation.The monitor system contains an image acquisition system and a human-machine interaction module,and aims to simulate and detect the robot running state.Besides,a visual object tracking algorithm is developed to estimate the states of the dynamic system from noisy observations.The established robotic teleoperation systemis applied to a series of experiments,and high-precision results are obtained,showing the effectiveness of the physical system.
基金Supported by the‘Automotive Glazing Application in Intelligent Cockpit Human-Machine Interface’project(SKHX2021049)a collaboration between the Saint-Go Bain Research and the Beijing Normal University。
文摘Background With an increasing number of vehicles becoming autonomous,intelligent,and connected,paying attention to the future usage of car human-machine interface with these vehicles should become more relevant.Several studies have addressed car HMI but were less attentive to designing and implementing interactive glazing for every day(autonomous)driving contexts.Methods Reflecting on the literature,we describe an engineering psychology practice and the design of six novel future user scenarios,which envision the application of a specific set of augmented reality(AR)support user interactions.Additionally,we conduct evaluations on specific scenarios and experiential prototypes,which reveal that these AR scenarios aid the target user groups in experiencing a new type of interaction.The overall evaluation is positive with valuable assessment results and suggestions.Conclusions This study can interest applied psychology educators who aspire to teach how AR can be operationalized in a human-centered design process to students with minimal pre-existing expertise or minimal scientific knowledge in engineering psychology.
基金supported by the China Postdoctoral Science Foundation(No.2022BG011)the Fundamental Research Funds for Central Universities(No.2020CDJ-LHZZ-077)+1 种基金the Natural Science Foundation of Chongqing,China(No.c stc2020jcyj-msxmX0397)the Fundamental Research Funds for Central Universities(No.00007717).
文摘As the Internet of Things advances,gesture recognition emerges as a prominent domain in human-machine interaction(HMI).However,interactive wearables based on conductive hydrogels for individuals with single-arm functionality or disabilities remain underexplored.Here,we devised a wearable one-handed keyboard with gesture recognition,employing machine learning algorithms and hydrogel-based mechanical sensors to boost productivity.PCG(PAM/CMC/rGO)hydrogels are composed of polyacrylamide(PAM),sodium carboxymethyl cellulose(CMC),and reduced graphene oxide(rGO),which function as a strain,pressure sensor,and electrode material.The PAM chains offer the gel’s elasticity by covalent cross-linking,while the biocompatible CMC improves the dispersion of rGO and promotes electromechanical properties.Integrating rGO sheets into the polymer matrix facilitates cross-linking and generates supple-mentary conductive pathways,thereby augmenting the gel system’s elasticity,sensitivity,and durability.Our hydrogel sensors include high sensitivity(gage factor(GF)=8.18,395.6%-551.96%)and superior pressure sensing capabilities(Sensitivity(S)=0.3116 kPa^(-1),0-9.82 kPa).Furthermore,we developed a wearable keyboard with up to 98.13%accuracy using convolutional neural networks and a custom data acquisition system.This study establishes the groundwork for creating multifunctional gel sensors for intelligent machines,wearable devices,and brain-computer interfaces.
文摘In order to ensure the safety of children while using machineries and avoid harm caused by mechanical toys,this paper analyzes the types and detection standards of children’s toys,discusses the reasons for the harm caused by these toys,and proposes human-machine safety design strategies for children’s toys as reference.
基金supported by the National Natural Science Foundation of China(Nos.52373093 and 12072325)the Outstanding Youth Fund of Henan Province(No.242300421062)+1 种基金National Key R&D Program of China(No.2019YFA0706802)the 111 project(No.D18023).
文摘With the rapid development of wearable electronic skin technology, flexible strain sensors have shown great application prospects in the fields of human motion and physiological signal detection, medical diagnostics, and human-computer interaction owing to their outstanding sensing performance. This paper reports a strain sensor with synergistic conductive network, consisting of stable carbon nanotube dispersion (CNT) layer and brittle MXene layer by dip-coating and electrostatic self-assembly method, and breathable three-dimensional (3D) flexible substrate of thermoplastic polyurethane (TPU) fibrous membrane prepared through electrospinning technology. The MXene/CNT@PDA-TPU (MC@p-TPU) flexible strain sensor had excellent air permeability, wide operating range (0–450 %), high sensitivity (Gauge Factor, GFmax = 8089.7), ultra-low detection limit (0.05 %), rapid response and recovery times (40 ms/60 ms), and excellent cycle stability and durability (10,000 cycles). Given its superior strain sensing capabilities, this sensor can be applied in physiological signals detection, human motion pattern recognition, and driving exoskeleton robots. In addition, MC@p-TPU fibrous membrane also exhibited excellent photothermal conversion performance and can be used as a wearable photo-heater, which has far-reaching application potential in the photothermal therapy of human joint diseases.
基金supported by the Research Grant Fund from Kwangwoon University in 2023,the National Natural Science Foundation of China under Grant(62311540155)the Taishan Scholars Project Special Funds(tsqn202312035)the open research foundation of State Key Laboratory of Integrated Chips and Systems.
文摘Wearable wristband systems leverage deep learning to revolutionize hand gesture recognition in daily activities.Unlike existing approaches that often focus on static gestures and require extensive labeled data,the proposed wearable wristband with selfsupervised contrastive learning excels at dynamic motion tracking and adapts rapidly across multiple scenarios.It features a four-channel sensing array composed of an ionic hydrogel with hierarchical microcone structures and ultrathin flexible electrodes,resulting in high-sensitivity capacitance output.Through wireless transmission from a Wi-Fi module,the proposed algorithm learns latent features from the unlabeled signals of random wrist movements.Remarkably,only few-shot labeled data are sufficient for fine-tuning the model,enabling rapid adaptation to various tasks.The system achieves a high accuracy of 94.9%in different scenarios,including the prediction of eight-direction commands,and air-writing of all numbers and letters.The proposed method facilitates smooth transitions between multiple tasks without the need for modifying the structure or undergoing extensive task-specific training.Its utility has been further extended to enhance human–machine interaction over digital platforms,such as game controls,calculators,and three-language login systems,offering users a natural and intuitive way of communication.
文摘With the rapid advancement of artificial intelligence(AI)technology,high school history teaching is undergoing a profound and unprecedented transformation.The 2024 Artificial Intelligence Index Report published by Stanford University indicates that AI applications in education are expanding steadily,with an increasing number of educational institutions adopting AI to optimize teaching processes and enhance instructional effectiveness.Grounded in the current context and practical demands of AI integration in education,this study examines practical cases of AI-empowered high school history teaching,systematically analyzing its application scenarios,implementation pathways,and actual outcomes.Furthermore,this paper critically reflects on the challenges currently facing AI integration in high school history teaching and proposes actionable recommendations for future development,aiming to provide insights for advancing the digital transformation and intelligent upgrading of history education.
基金supported by the National Natural Science Foundation of China(Grant Nos.52222313,22075296,52321006,T2394480,and T2394484)the National Key R&D Program of China(Grant Nos.2023YFE0111500,2021YFB3200701,and 2022YFB4700804)+1 种基金Beijing National Laboratory for Molecular Sciences(Grant No.BNLMSCXXM-202005)Beijing Municipal Science&Technology Commission(Grant No.Z231100005923039).
文摘Surgical robots are designed to provide enhanced precision and dexterity compared to manual surgical procedures,which mainly rely on multimodal sensing technologies for the surgeon to seamlessly operate the robotic arms and instruments.Compared with single-mode sensors,optical and mechanical bi-modal sensors provide improved precision,enhanced safety,and robustness of human-machine interaction systems.Here,the template-guided and pneumatic printing technologies are combined to construct perovskite and graphene parallel structures with both optical and mechanical sensing capabilities.The printed uniformly crystallized perovskite microstructure exhibits fast and sensitive photoelectric response characteristics,enabling shadow recognition functionality.The combination of graphene and elastic rubber endows the great printability to prepare parallel structures near the perovskite arrays for force sensing capabilities.Thus,the printed perovskite and graphene structures possess non-contact optical sensing capabilities to detect hand position by recognizing shadows between the hand and the sensor,as well as contact mechanical sensing capabilities to detect touch force applied by the hand.It provides a synergistic platform for real-time and multidimensional feedback to improve human-machine interaction.
基金financially supported by the National Natural Science Foundation of China(Nos.52250398,52125205 and U20A20166)the Natural Science Foundation of Beijing Municipality(No.2222088)+1 种基金Shenzhen Science and Technology Program(No.KQTD20170810105439418)the Fundamental Research Funds for the Central Universities
文摘Stretchable strain sensors are a crucial component in various applications,such as wearable devices,human-machine interfaces,and soft robotics.Hence,strain sensors with low hysteresis,high fidelity,and accurate sensing ability are urgently required for the precise measurement of large and high-frequency dynamic deformations.However,the existing hysteresis of the current functional materials utilized in strain sensors significantly impedes the achievement of these properties.Herein,we introduce an ultralow dynamic hysteresis capacitive strain sensor using a low-hysteresis and high-relative-permittivity ionic liquid-elastomer composite as the dielectric material.Based on the low-hysteresis dielectric,the prepared capacitive strain sensors exhibit ultralow electrical hysteresis(2.20%at a strain rate of 100% s^(-1)and strain of100%)and maintain low electrical hysteresis(4.35%)even under extremely high strain rates and large dynamic strain loads(a strain rate of 500% s^(-1)and strain of 100%).Moreover,the strain sensor manifests exceptional cyclic stability under 50,000 cycles of 100%strain at a strain rate of 200% s^(-1);the response curves remain nearly identical throughout these 50,000 cycles.Furthermore,the ultralowhysteresis strain sensor was successfully applied to accurate and reliable real-time human-machine interactions,revealing its great potential in various fields,including electronic skin,flexible robotics,wearable electronics,and virtual reality.
