Rock discontinuities control rock mechanical behaviors and significantly influence the stability of rock masses.However,existing discontinuity mapping algorithms are susceptible to noise,and the calculation results ca...Rock discontinuities control rock mechanical behaviors and significantly influence the stability of rock masses.However,existing discontinuity mapping algorithms are susceptible to noise,and the calculation results cannot be fed back to users timely.To address this issue,we proposed a human-machine interaction(HMI)method for discontinuity mapping.Users can help the algorithm identify the noise and make real-time result judgments and parameter adjustments.For this,a regular cube was selected to illustrate the workflows:(1)point cloud was acquired using remote sensing;(2)the HMI method was employed to select reference points and angle thresholds to detect group discontinuity;(3)individual discontinuities were extracted from the group discontinuity using a density-based cluster algorithm;and(4)the orientation of each discontinuity was measured based on a plane fitting algorithm.The method was applied to a well-studied highway road cut and a complex natural slope.The consistency of the computational results with field measurements demonstrates its good accuracy,and the average error in the dip direction and dip angle for both cases was less than 3.Finally,the computational time of the proposed method was compared with two other popular algorithms,and the reduction in computational time by tens of times proves its high computational efficiency.This method provides geologists and geological engineers with a new idea to map rapidly and accurately rock structures under large amounts of noises or unclear features.展开更多
The fusion of VlSI （visual identity system Internet）, digital maps and Web GIS is presented. Web GIS interface interactive design with VISI needs to consider more new factors. VISI can provide the design principle, ...The fusion of VlSI （visual identity system Internet）, digital maps and Web GIS is presented. Web GIS interface interactive design with VISI needs to consider more new factors. VISI can provide the design principle, elements and contents for the Web GIS. The design of the Wuhan Bus Search System is fulfilled to confirm the validity and practicability of the fusion.展开更多
Background With an increasing number of vehicles becoming autonomous,intelligent,and connected,paying attention to the future usage of car human-machine interface with these vehicles should become more relevant.Severa...Background With an increasing number of vehicles becoming autonomous,intelligent,and connected,paying attention to the future usage of car human-machine interface with these vehicles should become more relevant.Several studies have addressed car HMI but were less attentive to designing and implementing interactive glazing for every day(autonomous)driving contexts.Methods Reflecting on the literature,we describe an engineering psychology practice and the design of six novel future user scenarios,which envision the application of a specific set of augmented reality(AR)support user interactions.Additionally,we conduct evaluations on specific scenarios and experiential prototypes,which reveal that these AR scenarios aid the target user groups in experiencing a new type of interaction.The overall evaluation is positive with valuable assessment results and suggestions.Conclusions This study can interest applied psychology educators who aspire to teach how AR can be operationalized in a human-centered design process to students with minimal pre-existing expertise or minimal scientific knowledge in engineering psychology.展开更多
Electromyography(EMG)has already been broadly used in human-machine interaction(HMI)applications.Determining how to decode the information inside EMG signals robustly and accurately is a key problem for which we urgen...Electromyography(EMG)has already been broadly used in human-machine interaction(HMI)applications.Determining how to decode the information inside EMG signals robustly and accurately is a key problem for which we urgently need a solution.Recently,many EMG pattern recognition tasks have been addressed using deep learning methods.In this paper,we analyze recent papers and present a literature review describing the role that deep learning plays in EMG-based HMI.An overview of typical network structures and processing schemes will be provided.Recent progress in typical tasks such as movement classification,joint angle prediction,and force/torque estimation will be introduced.New issues,including multimodal sensing,inter-subject/inter-session,and robustness toward disturbances will be discussed.We attempt to provide a comprehensive analysis of current research by discussing the advantages,challenges,and opportunities brought by deep learning.We hope that deep learning can aid in eliminating factors that hinder the development of EMG-based HMI systems.Furthermore,possible future directions will be presented to pave the way for future research.展开更多
Hydrogel-based triboelectric nanoge nerator(TENG)has a promising applied prospect in wearable electronic devices.However,its low performance,poor stability,insufficient recyclability and inferior self-healing seriousl...Hydrogel-based triboelectric nanoge nerator(TENG)has a promising applied prospect in wearable electronic devices.However,its low performance,poor stability,insufficient recyclability and inferior self-healing seriously hinder its development.Herein,we report a robust route to a liquid metal(LM)/polyvinyl alcohol(PVA)hydrogel-based TENG(LP-TENG).Owing to the intrinsically liquid feature of conductive LM within the flexible PVA hydrogel,the as-prepared LP-TENG exhibited comprehensiye advantages of adaptability,biocompatibility,outstanding electrical performance,superior stability,recyclability and diverse applications,which were unattainable by traditional systems.Concretely,the LP-TENG delivered appealing open circuit voltage of 250 V,short circuit current of 4μA and transferred charge of 120 nC with high stability,outperforming most advanced TENG systems.The LP-TENG was successfully employed for versatile applications with multifunctionality,including human motion detection,handwriting recognition,energy collection,message transmission and human-machine interaction.This work presents significant prospects for crafting advanced materials and devices in the fields of wearable electronics,flexible skin and smart robots.展开更多
Speech recognition rate will deteriorate greatly in human-machine interaction when the speaker's speech mixes with a bystander's voice. This paper proposes a time-frequency approach for Blind Source Seperation...Speech recognition rate will deteriorate greatly in human-machine interaction when the speaker's speech mixes with a bystander's voice. This paper proposes a time-frequency approach for Blind Source Seperation (BSS) for intelligent Human-Machine Interaction(HMI). Main idea of the algorithm is to simultaneously diagonalize the correlation matrix of the pre-whitened signals at different time delays for every frequency bins in time-frequency domain. The prososed method has two merits: (1) fast convergence speed; (2) high signal to interference ratio of the separated signals. Numerical evaluations are used to compare the performance of the proposed algorithm with two other deconvolution algorithms. An efficient algorithm to resolve permutation ambiguity is also proposed in this paper. The algorithm proposed saves more than 10% of computational time with properly selected parameters and achieves good performances for both simulated convolutive mixtures and real room recorded speeches.展开更多
The periphery of the Qinghai-Tibet Plateau is renowned for its susceptibility to landslides.However,the northwestern margin of this region,characterised by limited human activities and challenging transportation,remai...The periphery of the Qinghai-Tibet Plateau is renowned for its susceptibility to landslides.However,the northwestern margin of this region,characterised by limited human activities and challenging transportation,remains insufficiently explored concerning landslide occurrence and dispersion.With the planning and construction of the Xinjiang-Xizang Railway,a comprehensive investigation into disastrous landslides in this area is essential for effective disaster preparedness and mitigation strategies.By using the human-computer interaction interpretation approach,the authors established a landslide database encompassing 13003 landslides,collectively spanning an area of 3351.24 km^(2)(36°N-40°N,73°E-78°E).The database incorporates diverse topographical and environmental parameters,including regional elevation,slope angle,slope aspect,distance to faults,distance to roads,distance to rivers,annual precipitation,and stratum.The statistical characteristics of number and area of landslides,landslide number density(LND),and landslide area percentage(LAP)are analyzed.The authors found that a predominant concentration of landslide origins within high slope angle regions,with the highest incidence observed in intervals characterised by average slopes of 20°to 30°,maximum slope angle above 80°,along with orientations towards the north(N),northeast(NE),and southwest(SW).Additionally,elevations above 4.5 km,distance to rivers below 1 km,rainfall between 20-30 mm and 30-40 mm emerge as particularly susceptible to landslide development.The study area’s geological composition primarily comprises Mesozoic and Upper Paleozoic outcrops.Both fault and human engineering activities have different degrees of influence on landslide development.Furthermore,the significance of the landslide database,the relationship between landslide distribution and environmental factors,and the geometric and morphological characteristics of landslides are discussed.The landslide H/L ratios in the study area are mainly concentrated between 0.4 and 0.64.It means the landslides mobility in the region is relatively low,and the authors speculate that landslides in this region more possibly triggered by earthquakes or located in meizoseismal area.展开更多
Teleoperation is of great importance in the area of robotics,especially when people are unavailable in the robot workshop.It provides a way for people to control robots remotely using human intelligence.In this paper,...Teleoperation is of great importance in the area of robotics,especially when people are unavailable in the robot workshop.It provides a way for people to control robots remotely using human intelligence.In this paper,a robotic teleoperation system for precise robotic manipulation is established.The data glove and the 7-degrees of freedom(DOFs)force feedback controller are used for the remote control interaction.The control system and the monitor system are designed for the remote precise manipulation.The monitor system contains an image acquisition system and a human-machine interaction module,and aims to simulate and detect the robot running state.Besides,a visual object tracking algorithm is developed to estimate the states of the dynamic system from noisy observations.The established robotic teleoperation systemis applied to a series of experiments,and high-precision results are obtained,showing the effectiveness of the physical system.展开更多
As the Internet of Things advances,gesture recognition emerges as a prominent domain in human-machine interaction(HMI).However,interactive wearables based on conductive hydrogels for individuals with single-arm functi...As the Internet of Things advances,gesture recognition emerges as a prominent domain in human-machine interaction(HMI).However,interactive wearables based on conductive hydrogels for individuals with single-arm functionality or disabilities remain underexplored.Here,we devised a wearable one-handed keyboard with gesture recognition,employing machine learning algorithms and hydrogel-based mechanical sensors to boost productivity.PCG(PAM/CMC/rGO)hydrogels are composed of polyacrylamide(PAM),sodium carboxymethyl cellulose(CMC),and reduced graphene oxide(rGO),which function as a strain,pressure sensor,and electrode material.The PAM chains offer the gel’s elasticity by covalent cross-linking,while the biocompatible CMC improves the dispersion of rGO and promotes electromechanical properties.Integrating rGO sheets into the polymer matrix facilitates cross-linking and generates supple-mentary conductive pathways,thereby augmenting the gel system’s elasticity,sensitivity,and durability.Our hydrogel sensors include high sensitivity(gage factor(GF)=8.18,395.6%-551.96%)and superior pressure sensing capabilities(Sensitivity(S)=0.3116 kPa^(-1),0-9.82 kPa).Furthermore,we developed a wearable keyboard with up to 98.13%accuracy using convolutional neural networks and a custom data acquisition system.This study establishes the groundwork for creating multifunctional gel sensors for intelligent machines,wearable devices,and brain-computer interfaces.展开更多
In this paper, we conduct research on the interactive interpreting teaching mode under the multimedia and primary traditional microteaching environment. English interpretation course system construction request from t...In this paper, we conduct research on the interactive interpreting teaching mode under the multimedia and primary traditional microteaching environment. English interpretation course system construction request from the student reality, on the basis of the actual situation, improving students＇ comprehensive ability in English interpretation as communicative teaching method in the very great degree to overall effective guide students to practice real interpreting scene comprehensively improve students＇ intercultural business negotiation, reception and comprehensive ability of the exhibition, and is advantageous to the interpretation of curriculum system construction and the improvement of the students＇ comprehensive quality. Our research integrates the general principles of the multimedia and primary traditional microteaching environment to form the better paradigm for the education that will enhance the contemporary teaching condition.展开更多
In view of the current gesture recognition algorithm based on skin color segmentation is not flexible and has weak resistance to the environment, this paper puts forward a new method of skin color modeling to improve ...In view of the current gesture recognition algorithm based on skin color segmentation is not flexible and has weak resistance to the environment, this paper puts forward a new method of skin color modeling to improve the adaptability of gesture segmentation when it face to different states. The modeling built by double color space instead of only one is compatible both in YCbCr and HSV color space to training the Gaussian model which can update the threshold value for binarization. Finally, this paper designed a natural gesture recognition and interactive systems based on the double color space model. It has shown that the system has a good interactive experience in different environments.展开更多
This paper explores the paradigm reconstruction of interpreting pedagogy driven by generative AI technology.With the breakthroughs of AI technologies such as ChatGPT in natural language processing,traditional interpre...This paper explores the paradigm reconstruction of interpreting pedagogy driven by generative AI technology.With the breakthroughs of AI technologies such as ChatGPT in natural language processing,traditional interpreting education faces dual challenges of technological substitution and pedagogical transformation.Based on Kuhn’s paradigm theory,the study analyzes the limitations of three traditional interpreting teaching paradigms,language-centric,knowledge-based,and skill-acquisition-oriented,and proposes a novel“teacher-AI-learner”triadic collaborative paradigm.Through reconstructing teaching subjects,environments,and curriculum systems,the integration of real-time translation tools and intelligent terminology databases facilitates the transition from static skill training to dynamic human-machine collaboration.The research simultaneously highlights challenges in technological ethics and curriculum design transformation pressures,emphasizing the necessity to balance technological empowerment with humanistic education.展开更多
Triboelectric nanogenerators(TENGs)represent a promising technology for next generation human–computer interaction.The effective enhancement of induced charges are critical factors that determine the recognition accu...Triboelectric nanogenerators(TENGs)represent a promising technology for next generation human–computer interaction.The effective enhancement of induced charges are critical factors that determine the recognition accuracy of TENGbased tactile sensors.Here,we propose a magnetic fieldassisted TENG device utilizing waveform feature enrichment strategies to significantly enhance the tactile recognition accuracy in natural environments.An elastic micro-nano structure was fabricated on a polydimethylsiloxane(PDMS)film via a facile templating method.Leveraging the inherent hydrophobicity and microscale surface roughness of PDMS,our device demonstrates stable and distinct waveform characteristics under natural operating conditions.Importantly,the introduction of a magnetic field generates a Lorentz force,which effectively modulates induced charges within the electrode,yet minimally affects triboelectric charges at the PDMS interface.This selective modulation induces an asymmetric charge distribution inside the electrode,substantially increasing the induced charge density,consequently,subtle waveform features are markedly enhanced.These enriched signal features play a crucial role in elevating material recognition accuracy.As a result,the sensor achieves a remarkable recognition accuracy of 99%when distinguishing among ten different materials under magnetic field assistance.This work provides valuable guidelines for advancing the performance and accuracy of TENG-based tactile sensing systems.展开更多
Jef Verschueren is the representative of European Continental pragmatic thought.He puts forward a new theory that pragmatics is a perspective on language and he uses the theory of adaptation to analyze pragmatics.&quo...Jef Verschueren is the representative of European Continental pragmatic thought.He puts forward a new theory that pragmatics is a perspective on language and he uses the theory of adaptation to analyze pragmatics."The general concern for the study of linguistic pragmatics is to understand the meaningful functioning of a language as a dynamic process operating on context-structure relationships at various levels of salience"(Verschuren 2000:69).The focal points in contexts are the utterer and the interpreter,for the physical,social and mental aspects of contexts are activated by language users’cognitive processes.Verschueren divided interpreter’s roles into five types:addressee,side participant,bystander,listener-in and eavesdropper,which can explain the adaptation of context and language choices.This is also applicable in college English classroom as the English class is also a context.At present students taught at the same time by the same teacher do not master the knowledge at the same level.One of the reason is that students are not engaged in the class at the same level.According to the Verschueren’s theory,the best English teaching class is one that each student in the addressee of teachers.Addressee is a metaphor which means everyone should follow the teachers’explanation carefully and take part in the teaching activities.It has something to do with interaction theory,which considers students as active individuals but not passive receivers.One of the common interaction patterns is questioning.In this thesis,the question how to make students addresses through adoption of questioning approach in college English class will be researched.展开更多
Surgical robots are designed to provide enhanced precision and dexterity compared to manual surgical procedures,which mainly rely on multimodal sensing technologies for the surgeon to seamlessly operate the robotic ar...Surgical robots are designed to provide enhanced precision and dexterity compared to manual surgical procedures,which mainly rely on multimodal sensing technologies for the surgeon to seamlessly operate the robotic arms and instruments.Compared with single-mode sensors,optical and mechanical bi-modal sensors provide improved precision,enhanced safety,and robustness of human-machine interaction systems.Here,the template-guided and pneumatic printing technologies are combined to construct perovskite and graphene parallel structures with both optical and mechanical sensing capabilities.The printed uniformly crystallized perovskite microstructure exhibits fast and sensitive photoelectric response characteristics,enabling shadow recognition functionality.The combination of graphene and elastic rubber endows the great printability to prepare parallel structures near the perovskite arrays for force sensing capabilities.Thus,the printed perovskite and graphene structures possess non-contact optical sensing capabilities to detect hand position by recognizing shadows between the hand and the sensor,as well as contact mechanical sensing capabilities to detect touch force applied by the hand.It provides a synergistic platform for real-time and multidimensional feedback to improve human-machine interaction.展开更多
A complete characterization of the behavior in human-robot interactions(HRI) includes both: the behavioral dynamics and the control laws that characterize how the behavior is regulated with the perception data. In thi...A complete characterization of the behavior in human-robot interactions(HRI) includes both: the behavioral dynamics and the control laws that characterize how the behavior is regulated with the perception data. In this way, this work proposes a leader-follower coordinate control based on an impedance control that allows to establish a dynamic relation between social forces and motion error. For this, a scheme is presented to identify the impedance based on fictitious social forces, which are described by distance-based potential fields.As part of the validation procedure, we present an experimental comparison to select the better of two different fictitious force structures. The criteria are determined by two qualities: least impedance errors during the validation procedure and least parameter variance during the recursive estimation procedure.Finally, with the best fictitious force and its identified impedance,an impedance control is designed for a mobile robot Pioneer 3AT,which is programmed to follow a human in a structured scenario.According to results, and under the hypothesis that moving like humans will be acceptable by humans, it is believed that the proposed control improves the social acceptance of the robot for this kind of interaction.展开更多
In human-machine interaction,robotic hands are useful in many scenarios.To operate robotic hands via gestures instead of handles will greatly improve the convenience and intuition of human-machine interaction.Here,we ...In human-machine interaction,robotic hands are useful in many scenarios.To operate robotic hands via gestures instead of handles will greatly improve the convenience and intuition of human-machine interaction.Here,we present a magnetic array assisted sliding triboelectric sensor for achieving a real-time gesture interaction between a human hand and robotic hand.With a finger’s traction movement of flexion or extension,the sensor can induce positive/negative pulse signals.Through counting the pulses in unit time,the degree,speed,and direction of finger motion can be judged in realtime.The magnetic array plays an important role in generating the quantifiable pulses.The designed two parts of magnetic array can transform sliding motion into contact-separation and constrain the sliding pathway,respectively,thus improve the durability,low speed signal amplitude,and stability of the system.This direct quantization approach and optimization of wearable gesture sensor provide a new strategy for achieving a natural,intuitive,and real-time human-robotic interaction.展开更多
Multifunctional supramolecular ultra-tough bionic e-skin with unique durability for human–machine interaction in complex scenarios still remains challenging.Herein,we develop a skininspired ultra-tough e-skin with tu...Multifunctional supramolecular ultra-tough bionic e-skin with unique durability for human–machine interaction in complex scenarios still remains challenging.Herein,we develop a skininspired ultra-tough e-skin with tunable mechanical properties by a physical cross-linking salting-freezing-thawing method.The gelling agent(β-Glycerophosphate sodium:Gp)induces the aggregation and binding of PVA molecular chains and thereby toughens them(stress up to 5.79 MPa,toughness up to 13.96 MJ m^(−3)).Notably,due to molecular self-assembly,hydrogels can be fully recycled and reprocessed by direct heating(100°C for a few seconds),and the tensile strength can still be maintained at about 100%after six recoveries.The hydrogel integrates transparency(>60%),super toughness(up to 13.96 MJ m^(−3),bearing 1500 times of its own tensile weight),good antibacterial properties(E.coli and S.aureus),UV protection(Filtration:80%–90%),high electrical conductivity(4.72 S m^(−1)),anti-swelling and recyclability.The hydrogel can not only monitor daily physiological activities,but also be used for complex activities underwater and message encryption/decryption.We also used it to create a complete finger joint rehabilitation system with an interactive interface that dynamically presents the user’s health status.Our multifunctional electronic skin will have a profound impact on the future of new rehabilitation medical,human–machine interaction,VR/AR and the metaverse fields.展开更多
At nomaly detectors are used to distinguish differences between normal and abnormal data,which are usually implemented by evaluating and ranking the anomaly scores of each instance.A static unsupervised streaming anom...At nomaly detectors are used to distinguish differences between normal and abnormal data,which are usually implemented by evaluating and ranking the anomaly scores of each instance.A static unsupervised streaming anomaly detector is difficult to dynamically adjust anomaly score calculation.In real scenarios,anomaly detection often needs to be regulated by human feedback,which benefits adjusting anomaly detectors.In this paper,we propose a human-machine interactive streaming anomaly detection method,named ISPForest,which can be adaptively updated online under the guidance of human feedback.In particular,the feedback will be used to adjust the anomaly score calculation and structure of the detector,ideally attaining more accurate anomaly scores in the future.Our main contribution is to improve the tree-based streaming anomaly detection model that can be updated online from perspectives of anomaly score calculation and model structure.Our approach is instantiated for the powerful class of tree-based streaming anomaly detectors,and we conduct experiments on a range of benchmark datasets.The results demonstrate that the utility of incorporating feedback can improve the performance of anomaly detectors with a few human efforts.展开更多
In this article I will address the issue of the meaning of Embodied Artificial Intelligence(EAI)as it is configured today.My starting point is the refined interactive perspective on the semantics of EAI,as was recentl...In this article I will address the issue of the meaning of Embodied Artificial Intelligence(EAI)as it is configured today.My starting point is the refined interactive perspective on the semantics of EAI,as was recently suggested by Froese and colleagues.This perspective rests on the assumption that the concept of human bodily subjectivity must be extended to include meaning-making processes,which are enabled by advanced AI systems that may be incorporated in the human biological body.After having clarified the technical background,I will introduce the genetic component of the phenomenological method as a suitable tool to face the aforementioned issue.Towards this end,I will place the genetic method in the context of the so-called New Human-Machine Interaction(New HMI).I will further outline a genetic phenomenology of visual embodiment,suggesting a futuristic application based on the thesis of the“technological supplementation of phenomenological methodology”through the synthetic method.The case at stake is that of patients with a severe clinical picture characterised by the loss of corneal function,who in the near future could be treated with synthetic corneal prosthetic implants produced by a 3D bio-printing process by using an advanced EAI technique.I will conclude this article with a brief review of the main problems that still remain open.展开更多
基金supported by the National Key R&D Program of China(No.2023YFC3081200)the National Natural Science Foundation of China(No.42077264)the Scientific Research Project of PowerChina Huadong Engineering Corporation Limited(HDEC-2022-0301).
文摘Rock discontinuities control rock mechanical behaviors and significantly influence the stability of rock masses.However,existing discontinuity mapping algorithms are susceptible to noise,and the calculation results cannot be fed back to users timely.To address this issue,we proposed a human-machine interaction(HMI)method for discontinuity mapping.Users can help the algorithm identify the noise and make real-time result judgments and parameter adjustments.For this,a regular cube was selected to illustrate the workflows:(1)point cloud was acquired using remote sensing;(2)the HMI method was employed to select reference points and angle thresholds to detect group discontinuity;(3)individual discontinuities were extracted from the group discontinuity using a density-based cluster algorithm;and(4)the orientation of each discontinuity was measured based on a plane fitting algorithm.The method was applied to a well-studied highway road cut and a complex natural slope.The consistency of the computational results with field measurements demonstrates its good accuracy,and the average error in the dip direction and dip angle for both cases was less than 3.Finally,the computational time of the proposed method was compared with two other popular algorithms,and the reduction in computational time by tens of times proves its high computational efficiency.This method provides geologists and geological engineers with a new idea to map rapidly and accurately rock structures under large amounts of noises or unclear features.
基金Supported by the National Natural Science Foundation of China （No. 40071071）.
文摘The fusion of VlSI （visual identity system Internet）, digital maps and Web GIS is presented. Web GIS interface interactive design with VISI needs to consider more new factors. VISI can provide the design principle, elements and contents for the Web GIS. The design of the Wuhan Bus Search System is fulfilled to confirm the validity and practicability of the fusion.
基金Supported by the‘Automotive Glazing Application in Intelligent Cockpit Human-Machine Interface’project(SKHX2021049)a collaboration between the Saint-Go Bain Research and the Beijing Normal University。
文摘Background With an increasing number of vehicles becoming autonomous,intelligent,and connected,paying attention to the future usage of car human-machine interface with these vehicles should become more relevant.Several studies have addressed car HMI but were less attentive to designing and implementing interactive glazing for every day(autonomous)driving contexts.Methods Reflecting on the literature,we describe an engineering psychology practice and the design of six novel future user scenarios,which envision the application of a specific set of augmented reality(AR)support user interactions.Additionally,we conduct evaluations on specific scenarios and experiential prototypes,which reveal that these AR scenarios aid the target user groups in experiencing a new type of interaction.The overall evaluation is positive with valuable assessment results and suggestions.Conclusions This study can interest applied psychology educators who aspire to teach how AR can be operationalized in a human-centered design process to students with minimal pre-existing expertise or minimal scientific knowledge in engineering psychology.
基金supported in part by the National Natural Science Foundation of China(U181321461773369+2 种基金61903360)the Selfplanned Project of the State Key Laboratory of Robotics(2020-Z12)China Postdoctoral Science Foundation funded project(2019M661155)。
文摘Electromyography(EMG)has already been broadly used in human-machine interaction(HMI)applications.Determining how to decode the information inside EMG signals robustly and accurately is a key problem for which we urgently need a solution.Recently,many EMG pattern recognition tasks have been addressed using deep learning methods.In this paper,we analyze recent papers and present a literature review describing the role that deep learning plays in EMG-based HMI.An overview of typical network structures and processing schemes will be provided.Recent progress in typical tasks such as movement classification,joint angle prediction,and force/torque estimation will be introduced.New issues,including multimodal sensing,inter-subject/inter-session,and robustness toward disturbances will be discussed.We attempt to provide a comprehensive analysis of current research by discussing the advantages,challenges,and opportunities brought by deep learning.We hope that deep learning can aid in eliminating factors that hinder the development of EMG-based HMI systems.Furthermore,possible future directions will be presented to pave the way for future research.
基金financially supported by the Natural Science Foundation of China(Nos.22109120,62104170 and 82202757)Zhejiang Provincial Natural Science Foundation of China(Nos.LQ21B030002 and LY23F040001)。
文摘Hydrogel-based triboelectric nanoge nerator(TENG)has a promising applied prospect in wearable electronic devices.However,its low performance,poor stability,insufficient recyclability and inferior self-healing seriously hinder its development.Herein,we report a robust route to a liquid metal(LM)/polyvinyl alcohol(PVA)hydrogel-based TENG(LP-TENG).Owing to the intrinsically liquid feature of conductive LM within the flexible PVA hydrogel,the as-prepared LP-TENG exhibited comprehensiye advantages of adaptability,biocompatibility,outstanding electrical performance,superior stability,recyclability and diverse applications,which were unattainable by traditional systems.Concretely,the LP-TENG delivered appealing open circuit voltage of 250 V,short circuit current of 4μA and transferred charge of 120 nC with high stability,outperforming most advanced TENG systems.The LP-TENG was successfully employed for versatile applications with multifunctionality,including human motion detection,handwriting recognition,energy collection,message transmission and human-machine interaction.This work presents significant prospects for crafting advanced materials and devices in the fields of wearable electronics,flexible skin and smart robots.
文摘Speech recognition rate will deteriorate greatly in human-machine interaction when the speaker's speech mixes with a bystander's voice. This paper proposes a time-frequency approach for Blind Source Seperation (BSS) for intelligent Human-Machine Interaction(HMI). Main idea of the algorithm is to simultaneously diagonalize the correlation matrix of the pre-whitened signals at different time delays for every frequency bins in time-frequency domain. The prososed method has two merits: (1) fast convergence speed; (2) high signal to interference ratio of the separated signals. Numerical evaluations are used to compare the performance of the proposed algorithm with two other deconvolution algorithms. An efficient algorithm to resolve permutation ambiguity is also proposed in this paper. The algorithm proposed saves more than 10% of computational time with properly selected parameters and achieves good performances for both simulated convolutive mixtures and real room recorded speeches.
基金supported by the National Key Research and Development Program of China(2021YFB3901205)National Institute of Natural Hazards,Ministry of Emergency Management of China(2023-JBKY-57)。
文摘The periphery of the Qinghai-Tibet Plateau is renowned for its susceptibility to landslides.However,the northwestern margin of this region,characterised by limited human activities and challenging transportation,remains insufficiently explored concerning landslide occurrence and dispersion.With the planning and construction of the Xinjiang-Xizang Railway,a comprehensive investigation into disastrous landslides in this area is essential for effective disaster preparedness and mitigation strategies.By using the human-computer interaction interpretation approach,the authors established a landslide database encompassing 13003 landslides,collectively spanning an area of 3351.24 km^(2)(36°N-40°N,73°E-78°E).The database incorporates diverse topographical and environmental parameters,including regional elevation,slope angle,slope aspect,distance to faults,distance to roads,distance to rivers,annual precipitation,and stratum.The statistical characteristics of number and area of landslides,landslide number density(LND),and landslide area percentage(LAP)are analyzed.The authors found that a predominant concentration of landslide origins within high slope angle regions,with the highest incidence observed in intervals characterised by average slopes of 20°to 30°,maximum slope angle above 80°,along with orientations towards the north(N),northeast(NE),and southwest(SW).Additionally,elevations above 4.5 km,distance to rivers below 1 km,rainfall between 20-30 mm and 30-40 mm emerge as particularly susceptible to landslide development.The study area’s geological composition primarily comprises Mesozoic and Upper Paleozoic outcrops.Both fault and human engineering activities have different degrees of influence on landslide development.Furthermore,the significance of the landslide database,the relationship between landslide distribution and environmental factors,and the geometric and morphological characteristics of landslides are discussed.The landslide H/L ratios in the study area are mainly concentrated between 0.4 and 0.64.It means the landslides mobility in the region is relatively low,and the authors speculate that landslides in this region more possibly triggered by earthquakes or located in meizoseismal area.
基金NSFC-Shenzhen Robotics Research Center Project(No.U2013207)the Beijing Science and Technology Plan Project(No.Z191100008019008)。
文摘Teleoperation is of great importance in the area of robotics,especially when people are unavailable in the robot workshop.It provides a way for people to control robots remotely using human intelligence.In this paper,a robotic teleoperation system for precise robotic manipulation is established.The data glove and the 7-degrees of freedom(DOFs)force feedback controller are used for the remote control interaction.The control system and the monitor system are designed for the remote precise manipulation.The monitor system contains an image acquisition system and a human-machine interaction module,and aims to simulate and detect the robot running state.Besides,a visual object tracking algorithm is developed to estimate the states of the dynamic system from noisy observations.The established robotic teleoperation systemis applied to a series of experiments,and high-precision results are obtained,showing the effectiveness of the physical system.
基金supported by the China Postdoctoral Science Foundation(No.2022BG011)the Fundamental Research Funds for Central Universities(No.2020CDJ-LHZZ-077)+1 种基金the Natural Science Foundation of Chongqing,China(No.c stc2020jcyj-msxmX0397)the Fundamental Research Funds for Central Universities(No.00007717).
文摘As the Internet of Things advances,gesture recognition emerges as a prominent domain in human-machine interaction(HMI).However,interactive wearables based on conductive hydrogels for individuals with single-arm functionality or disabilities remain underexplored.Here,we devised a wearable one-handed keyboard with gesture recognition,employing machine learning algorithms and hydrogel-based mechanical sensors to boost productivity.PCG(PAM/CMC/rGO)hydrogels are composed of polyacrylamide(PAM),sodium carboxymethyl cellulose(CMC),and reduced graphene oxide(rGO),which function as a strain,pressure sensor,and electrode material.The PAM chains offer the gel’s elasticity by covalent cross-linking,while the biocompatible CMC improves the dispersion of rGO and promotes electromechanical properties.Integrating rGO sheets into the polymer matrix facilitates cross-linking and generates supple-mentary conductive pathways,thereby augmenting the gel system’s elasticity,sensitivity,and durability.Our hydrogel sensors include high sensitivity(gage factor(GF)=8.18,395.6%-551.96%)and superior pressure sensing capabilities(Sensitivity(S)=0.3116 kPa^(-1),0-9.82 kPa).Furthermore,we developed a wearable keyboard with up to 98.13%accuracy using convolutional neural networks and a custom data acquisition system.This study establishes the groundwork for creating multifunctional gel sensors for intelligent machines,wearable devices,and brain-computer interfaces.
文摘In this paper, we conduct research on the interactive interpreting teaching mode under the multimedia and primary traditional microteaching environment. English interpretation course system construction request from the student reality, on the basis of the actual situation, improving students＇ comprehensive ability in English interpretation as communicative teaching method in the very great degree to overall effective guide students to practice real interpreting scene comprehensively improve students＇ intercultural business negotiation, reception and comprehensive ability of the exhibition, and is advantageous to the interpretation of curriculum system construction and the improvement of the students＇ comprehensive quality. Our research integrates the general principles of the multimedia and primary traditional microteaching environment to form the better paradigm for the education that will enhance the contemporary teaching condition.
文摘In view of the current gesture recognition algorithm based on skin color segmentation is not flexible and has weak resistance to the environment, this paper puts forward a new method of skin color modeling to improve the adaptability of gesture segmentation when it face to different states. The modeling built by double color space instead of only one is compatible both in YCbCr and HSV color space to training the Gaussian model which can update the threshold value for binarization. Finally, this paper designed a natural gesture recognition and interactive systems based on the double color space model. It has shown that the system has a good interactive experience in different environments.
基金2025 General Project of Humanities and Social Sciences Research in Henan Higher Education Institutions,“Research on the Dynamic Mechanisms and Paths of Innovative Development of Undergraduate Translation Programs Empowered by New Productive Forces”(Project No.:2025-ZDJH-885)2024 College-Level Undergraduate Teaching Reform Project of the School of Foreign Languages,Henan University of Technology,“Research on Implementation Paths of New Models for Interpreter Training Based on AI Large Models”(Project No.:2024YJWYJG06)+1 种基金2025 First-Class Undergraduate Program Construction Special Project of the School of Foreign Languages,Henan University of Technology,titled“Research on Development Paths for Innovative Development of Undergraduate Translation Programs Empowered by New Productive Forces”(Project No.:2025WYZYJS30)2025 Educational Reform Project of the School of International Education,Henan University of Technology,“A Study on the Language Competence Development Model for International Talents Based on the Al Large Model-Taking IELTS Reading and Writing Teaching Practice as an Example”(Project No.:GJXY202533)。
文摘This paper explores the paradigm reconstruction of interpreting pedagogy driven by generative AI technology.With the breakthroughs of AI technologies such as ChatGPT in natural language processing,traditional interpreting education faces dual challenges of technological substitution and pedagogical transformation.Based on Kuhn’s paradigm theory,the study analyzes the limitations of three traditional interpreting teaching paradigms,language-centric,knowledge-based,and skill-acquisition-oriented,and proposes a novel“teacher-AI-learner”triadic collaborative paradigm.Through reconstructing teaching subjects,environments,and curriculum systems,the integration of real-time translation tools and intelligent terminology databases facilitates the transition from static skill training to dynamic human-machine collaboration.The research simultaneously highlights challenges in technological ethics and curriculum design transformation pressures,emphasizing the necessity to balance technological empowerment with humanistic education.
基金supports by the Guangxi Science and Technology Base and Talent Special Project(No.AD25069020)Major project of scientific research in colleges and universities of Anhui Province(No.2024AH040211)+3 种基金Department of Education team project(No.2022AH010096)Anhui Province key research and development program(Nos.202423i08050016 and 202304a05020027)the National Natural Science Foundation of China(No.52472190)Beijing Nova Program(Nos.20220484036 and 20240484565).
文摘Triboelectric nanogenerators(TENGs)represent a promising technology for next generation human–computer interaction.The effective enhancement of induced charges are critical factors that determine the recognition accuracy of TENGbased tactile sensors.Here,we propose a magnetic fieldassisted TENG device utilizing waveform feature enrichment strategies to significantly enhance the tactile recognition accuracy in natural environments.An elastic micro-nano structure was fabricated on a polydimethylsiloxane(PDMS)film via a facile templating method.Leveraging the inherent hydrophobicity and microscale surface roughness of PDMS,our device demonstrates stable and distinct waveform characteristics under natural operating conditions.Importantly,the introduction of a magnetic field generates a Lorentz force,which effectively modulates induced charges within the electrode,yet minimally affects triboelectric charges at the PDMS interface.This selective modulation induces an asymmetric charge distribution inside the electrode,substantially increasing the induced charge density,consequently,subtle waveform features are markedly enhanced.These enriched signal features play a crucial role in elevating material recognition accuracy.As a result,the sensor achieves a remarkable recognition accuracy of 99%when distinguishing among ten different materials under magnetic field assistance.This work provides valuable guidelines for advancing the performance and accuracy of TENG-based tactile sensing systems.
文摘Jef Verschueren is the representative of European Continental pragmatic thought.He puts forward a new theory that pragmatics is a perspective on language and he uses the theory of adaptation to analyze pragmatics."The general concern for the study of linguistic pragmatics is to understand the meaningful functioning of a language as a dynamic process operating on context-structure relationships at various levels of salience"(Verschuren 2000:69).The focal points in contexts are the utterer and the interpreter,for the physical,social and mental aspects of contexts are activated by language users’cognitive processes.Verschueren divided interpreter’s roles into five types:addressee,side participant,bystander,listener-in and eavesdropper,which can explain the adaptation of context and language choices.This is also applicable in college English classroom as the English class is also a context.At present students taught at the same time by the same teacher do not master the knowledge at the same level.One of the reason is that students are not engaged in the class at the same level.According to the Verschueren’s theory,the best English teaching class is one that each student in the addressee of teachers.Addressee is a metaphor which means everyone should follow the teachers’explanation carefully and take part in the teaching activities.It has something to do with interaction theory,which considers students as active individuals but not passive receivers.One of the common interaction patterns is questioning.In this thesis,the question how to make students addresses through adoption of questioning approach in college English class will be researched.
基金supported by the National Natural Science Foundation of China(Grant Nos.52222313,22075296,52321006,T2394480,and T2394484)the National Key R&D Program of China(Grant Nos.2023YFE0111500,2021YFB3200701,and 2022YFB4700804)+1 种基金Beijing National Laboratory for Molecular Sciences(Grant No.BNLMSCXXM-202005)Beijing Municipal Science&Technology Commission(Grant No.Z231100005923039).
文摘Surgical robots are designed to provide enhanced precision and dexterity compared to manual surgical procedures,which mainly rely on multimodal sensing technologies for the surgeon to seamlessly operate the robotic arms and instruments.Compared with single-mode sensors,optical and mechanical bi-modal sensors provide improved precision,enhanced safety,and robustness of human-machine interaction systems.Here,the template-guided and pneumatic printing technologies are combined to construct perovskite and graphene parallel structures with both optical and mechanical sensing capabilities.The printed uniformly crystallized perovskite microstructure exhibits fast and sensitive photoelectric response characteristics,enabling shadow recognition functionality.The combination of graphene and elastic rubber endows the great printability to prepare parallel structures near the perovskite arrays for force sensing capabilities.Thus,the printed perovskite and graphene structures possess non-contact optical sensing capabilities to detect hand position by recognizing shadows between the hand and the sensor,as well as contact mechanical sensing capabilities to detect touch force applied by the hand.It provides a synergistic platform for real-time and multidimensional feedback to improve human-machine interaction.
文摘A complete characterization of the behavior in human-robot interactions(HRI) includes both: the behavioral dynamics and the control laws that characterize how the behavior is regulated with the perception data. In this way, this work proposes a leader-follower coordinate control based on an impedance control that allows to establish a dynamic relation between social forces and motion error. For this, a scheme is presented to identify the impedance based on fictitious social forces, which are described by distance-based potential fields.As part of the validation procedure, we present an experimental comparison to select the better of two different fictitious force structures. The criteria are determined by two qualities: least impedance errors during the validation procedure and least parameter variance during the recursive estimation procedure.Finally, with the best fictitious force and its identified impedance,an impedance control is designed for a mobile robot Pioneer 3AT,which is programmed to follow a human in a structured scenario.According to results, and under the hypothesis that moving like humans will be acceptable by humans, it is believed that the proposed control improves the social acceptance of the robot for this kind of interaction.
基金This work was supported by National Natural Science Foundation of China(51902035 and 52073037)Natural Science Foundation of Chongqing(cstc2020jcyj-msxmX0807)+1 种基金the Fundamental Research Funds for the Central Universities(2020CDJ-LHSS-001 and 2019CDXZWL001)Chongqing graduate tutor team construction project(ydstd1832).
文摘In human-machine interaction,robotic hands are useful in many scenarios.To operate robotic hands via gestures instead of handles will greatly improve the convenience and intuition of human-machine interaction.Here,we present a magnetic array assisted sliding triboelectric sensor for achieving a real-time gesture interaction between a human hand and robotic hand.With a finger’s traction movement of flexion or extension,the sensor can induce positive/negative pulse signals.Through counting the pulses in unit time,the degree,speed,and direction of finger motion can be judged in realtime.The magnetic array plays an important role in generating the quantifiable pulses.The designed two parts of magnetic array can transform sliding motion into contact-separation and constrain the sliding pathway,respectively,thus improve the durability,low speed signal amplitude,and stability of the system.This direct quantization approach and optimization of wearable gesture sensor provide a new strategy for achieving a natural,intuitive,and real-time human-robotic interaction.
基金support from the National Natural Science Foundation of China(32201179)Guangdong Basic and Applied Basic Research Foundation(2020A1515110126 and 2021A1515010130)the Fundamental Research Funds for the Central Universities(N2119006 and N2224001-10)is gratefully acknowledged.
文摘Multifunctional supramolecular ultra-tough bionic e-skin with unique durability for human–machine interaction in complex scenarios still remains challenging.Herein,we develop a skininspired ultra-tough e-skin with tunable mechanical properties by a physical cross-linking salting-freezing-thawing method.The gelling agent(β-Glycerophosphate sodium:Gp)induces the aggregation and binding of PVA molecular chains and thereby toughens them(stress up to 5.79 MPa,toughness up to 13.96 MJ m^(−3)).Notably,due to molecular self-assembly,hydrogels can be fully recycled and reprocessed by direct heating(100°C for a few seconds),and the tensile strength can still be maintained at about 100%after six recoveries.The hydrogel integrates transparency(>60%),super toughness(up to 13.96 MJ m^(−3),bearing 1500 times of its own tensile weight),good antibacterial properties(E.coli and S.aureus),UV protection(Filtration:80%–90%),high electrical conductivity(4.72 S m^(−1)),anti-swelling and recyclability.The hydrogel can not only monitor daily physiological activities,but also be used for complex activities underwater and message encryption/decryption.We also used it to create a complete finger joint rehabilitation system with an interactive interface that dynamically presents the user’s health status.Our multifunctional electronic skin will have a profound impact on the future of new rehabilitation medical,human–machine interaction,VR/AR and the metaverse fields.
基金supported in part by the National Science Fund for Distinguished Young Scholars(61725205)the National Natural Science Foundation of China(Grant Nos.61960206008,61772428,61972319,and61902320).
文摘At nomaly detectors are used to distinguish differences between normal and abnormal data,which are usually implemented by evaluating and ranking the anomaly scores of each instance.A static unsupervised streaming anomaly detector is difficult to dynamically adjust anomaly score calculation.In real scenarios,anomaly detection often needs to be regulated by human feedback,which benefits adjusting anomaly detectors.In this paper,we propose a human-machine interactive streaming anomaly detection method,named ISPForest,which can be adaptively updated online under the guidance of human feedback.In particular,the feedback will be used to adjust the anomaly score calculation and structure of the detector,ideally attaining more accurate anomaly scores in the future.Our main contribution is to improve the tree-based streaming anomaly detection model that can be updated online from perspectives of anomaly score calculation and model structure.Our approach is instantiated for the powerful class of tree-based streaming anomaly detectors,and we conduct experiments on a range of benchmark datasets.The results demonstrate that the utility of incorporating feedback can improve the performance of anomaly detectors with a few human efforts.
文摘In this article I will address the issue of the meaning of Embodied Artificial Intelligence(EAI)as it is configured today.My starting point is the refined interactive perspective on the semantics of EAI,as was recently suggested by Froese and colleagues.This perspective rests on the assumption that the concept of human bodily subjectivity must be extended to include meaning-making processes,which are enabled by advanced AI systems that may be incorporated in the human biological body.After having clarified the technical background,I will introduce the genetic component of the phenomenological method as a suitable tool to face the aforementioned issue.Towards this end,I will place the genetic method in the context of the so-called New Human-Machine Interaction(New HMI).I will further outline a genetic phenomenology of visual embodiment,suggesting a futuristic application based on the thesis of the“technological supplementation of phenomenological methodology”through the synthetic method.The case at stake is that of patients with a severe clinical picture characterised by the loss of corneal function,who in the near future could be treated with synthetic corneal prosthetic implants produced by a 3D bio-printing process by using an advanced EAI technique.I will conclude this article with a brief review of the main problems that still remain open.
