In recent years,railway construction in China has developed vigorously.With continuous improvements in the highspeed railway network,the focus is gradually shifting from large-scale construction to large-scale operati...In recent years,railway construction in China has developed vigorously.With continuous improvements in the highspeed railway network,the focus is gradually shifting from large-scale construction to large-scale operations.However,several challenges have emerged within the high-speed railway dispatching and command system,including the heavy workload faced by dispatchers,the difficulty of quantifying subjective expertise,and the need for effective training of professionals.Amid the growing application of artificial intelligence technologies in railway systems,this study leverages Large Language Model(LLM)technology.LLMs bring enhanced intelligence,predictive capabilities,robust memory,and adaptability to diverse real-world scenarios.This study proposes a human-computer interactive intelligent scheduling auxiliary training system built on LLM technology.The system offers capabilities including natural dialogue,knowledge reasoning,and human feedback learning.With broad applicability,the system is suitable for vocational education,guided inquiry,knowledge-based Q&A,and other training scenarios.Validation results demonstrate its effectiveness in auxiliary training,providing substantial support for educators,students,and dispatching personnel in colleges and professional settings.展开更多
To solve the problem of risk identification and quantitative assessment for human-computer interaction(HCI)in complex avionics systems,an HCI safety analysis framework based on system-theoretical process analysis(STPA...To solve the problem of risk identification and quantitative assessment for human-computer interaction(HCI)in complex avionics systems,an HCI safety analysis framework based on system-theoretical process analysis(STPA)and cognitive reliability and error analysis method(CREAM)is proposed.STPACREAM can identify unsafe control actions and find the causal path during the interaction of avionics systems and pilot with the help of formal verification tools automatically.The common performance conditions(CPC)of avionics systems in the aviation environment is established and a quantitative analysis of human failure is carried out.Taking the head-up display(HUD)system interaction process as an example,a case analysis is carried out,the layered safety control structure and formal model of the HUD interaction process are established.For the interactive behavior“Pilots approaching with HUD”,four unsafe control actions and35 causal scenarios are identified and the impact of common performance conditions at different levels on the pilot decision model are analyzed.The results show that HUD's HCI level gradually improves as the scores of CPC increase,and the quality of crew member cooperation and time sufficiency of the task is the key to its HCI.Through case analysis,it is shown that STPACREAM can quantitatively assess the hazards in HCI and identify the key factors that impact safety.展开更多
The periphery of the Qinghai-Tibet Plateau is renowned for its susceptibility to landslides.However,the northwestern margin of this region,characterised by limited human activities and challenging transportation,remai...The periphery of the Qinghai-Tibet Plateau is renowned for its susceptibility to landslides.However,the northwestern margin of this region,characterised by limited human activities and challenging transportation,remains insufficiently explored concerning landslide occurrence and dispersion.With the planning and construction of the Xinjiang-Xizang Railway,a comprehensive investigation into disastrous landslides in this area is essential for effective disaster preparedness and mitigation strategies.By using the human-computer interaction interpretation approach,the authors established a landslide database encompassing 13003 landslides,collectively spanning an area of 3351.24 km^(2)(36°N-40°N,73°E-78°E).The database incorporates diverse topographical and environmental parameters,including regional elevation,slope angle,slope aspect,distance to faults,distance to roads,distance to rivers,annual precipitation,and stratum.The statistical characteristics of number and area of landslides,landslide number density(LND),and landslide area percentage(LAP)are analyzed.The authors found that a predominant concentration of landslide origins within high slope angle regions,with the highest incidence observed in intervals characterised by average slopes of 20°to 30°,maximum slope angle above 80°,along with orientations towards the north(N),northeast(NE),and southwest(SW).Additionally,elevations above 4.5 km,distance to rivers below 1 km,rainfall between 20-30 mm and 30-40 mm emerge as particularly susceptible to landslide development.The study area’s geological composition primarily comprises Mesozoic and Upper Paleozoic outcrops.Both fault and human engineering activities have different degrees of influence on landslide development.Furthermore,the significance of the landslide database,the relationship between landslide distribution and environmental factors,and the geometric and morphological characteristics of landslides are discussed.The landslide H/L ratios in the study area are mainly concentrated between 0.4 and 0.64.It means the landslides mobility in the region is relatively low,and the authors speculate that landslides in this region more possibly triggered by earthquakes or located in meizoseismal area.展开更多
Background Haptic feedback plays a crucial role in virtual reality(VR)interaction,helping to improve the precision of user operation and enhancing the immersion of the user experience.Instrumental haptic feedback in v...Background Haptic feedback plays a crucial role in virtual reality(VR)interaction,helping to improve the precision of user operation and enhancing the immersion of the user experience.Instrumental haptic feedback in virtual environments is primarily realized using grounded force or vibration feedback devices.However,improvements are required in terms of the active space and feedback realism.Methods We propose a lightweight and flexible haptic feedback glove that can haptically render objects in VR environments via kinesthetic and vibration feedback,thereby enabling users to enjoy a rich virtual piano-playing experience.The kinesthetic feedback of the glove relies on a cable-pulling mechanism that rotates the mechanism and pulls the two cables connected to it,thereby changing the amount of force generated to simulate the hardness or softness of the object.Vibration feedback is provided by small vibration motors embedded in the bottom of the fingertips of the glove.We designed a piano-playing scenario in the virtual environment and conducted user tests.The evaluation metrics were clarity,realism,enjoyment,and satisfaction.Results A total of 14 subjects participated in the test,and the results showed that our proposed glove scored significantly higher on the four evaluation metrics than the nofeedback and vibration feedback methods.Conclusions Our proposed glove significantly enhances the user experience when interacting with virtual objects.展开更多
The period of infancy is important for the formation of social behaviors due to the rapid postnatal development of the brain functions underlying emotions and social skills.Ilustration of the neural circuits involved ...The period of infancy is important for the formation of social behaviors due to the rapid postnatal development of the brain functions underlying emotions and social skills.Ilustration of the neural circuits involved in the developmental process of infant social behaviors could foster new therapies for some social impairments occurring in the infant period.展开更多
Recently,vision-based gesture recognition(VGR)has become a hot research spot in human-computer interaction(HCI).Unlike other gesture recognition methods with data gloves or other wearable sensors,vision-based gesture ...Recently,vision-based gesture recognition(VGR)has become a hot research spot in human-computer interaction(HCI).Unlike other gesture recognition methods with data gloves or other wearable sensors,vision-based gesture recognition could lead to more natural and intuitive HCI interactions.This paper reviews the state-of-the-art vision-based gestures recognition methods,from different stages of gesture recognition process,i.e.,(1)image acquisition and pre-processing,(2)gesture segmentation,(3)gesture tracking,(4)feature extraction,and(5)gesture classification.This paper also analyzes the advantages and disadvantages of these various methods in detail.Finally,the challenges of vision-based gesture recognition in haptic rendering and future research directions are discussed.展开更多
With the popularity of new intelligent mobile devices in people’s lives,the development of mobile applications has paid increasing attention to the interactive experience of users.As the content of traditional Human-...With the popularity of new intelligent mobile devices in people’s lives,the development of mobile applications has paid increasing attention to the interactive experience of users.As the content of traditional Human-Computer Interaction(HCI)course and teaching material is out of date,it cannot meet the needs of mobile application interaction design and enterprises for students.Therefore,we need a new generation HCI course based on intelligent mobile devices to study the relationship between users and systems.The HCI course not only teaches students HCI theory and model,but also needs to cultivate students’interaction-oriented design practical ability.This paper proposes a set of HCI teaching material design and teaching methods for improving HCI class quality on mobile application interaction design,so as to make students more suitable for the employment requirements of enterprises.展开更多
Based on the traditional Human-Computer Interaction method which is mainly touch input system, the way of capturing the movement of people by using cameras is proposed. This is a convenient technique which can provide...Based on the traditional Human-Computer Interaction method which is mainly touch input system, the way of capturing the movement of people by using cameras is proposed. This is a convenient technique which can provide users more experience. In the article, a new way of detecting moving things is given on the basis of development of the image processing technique. The system architecture decides that the communication should be used between two different applications. After considered, named pipe is selected from many ways of communication to make sure that video is keeping in step with the movement from the analysis of the people moving. According to a large amount of data and principal knowledge, thinking of the need of actual project, a detailed system design and realization is finished. The system consists of three important modules: detecting of the people's movement, information transition between applications and video showing in step with people's movement. The article introduces the idea of each module and technique.展开更多
Real-time train rescheduling plays a vital role in railway transportation as it is crucial for maintaining punctuality and reliability in rail operations.In this paper,we propose a rescheduling model that incorporates...Real-time train rescheduling plays a vital role in railway transportation as it is crucial for maintaining punctuality and reliability in rail operations.In this paper,we propose a rescheduling model that incorporates constraints and objectives generated through human-computer interaction.This approach ensures that the model is aligned with practical requirements and daily operational tasks while facilitating iterative train rescheduling.The dispatcher’s empirical knowledge is integrated into the train rescheduling process using a human-computer interaction framework.We introduce six interfaces to dynamically construct constraints and objectives that capture human intentions.By summarizing rescheduling rules,we devise a rule-based conflict detection-resolution heuristic algorithm to effectively solve the formulated model.A series of numerical experiments are presented,demonstrating strong performance across the entire system.Furthermore,theflexibility of rescheduling is enhanced through secondary analysis-driven solutions derived from the outcomes of humancomputer interactions in the previous step.This proposed interaction method complements existing literature on rescheduling methods involving human-computer interactions.It serves as a tool to aid dispatchers in identifying more feasible solutions in accordance with their empirical rescheduling strategies.展开更多
The existence of specific biorhythms and the role of geomagnetic and/or solar magnetic activities are well-established by appropriate correlations in chronobiology. From a physical viewpoint, there are two different a...The existence of specific biorhythms and the role of geomagnetic and/or solar magnetic activities are well-established by appropriate correlations in chronobiology. From a physical viewpoint, there are two different accesses to biorhythms to set up connections to molecular processes: quantum mechanical perturbation theoretical methods and their resonance dominators to characterize specific interactions between constituents. These methods permit the treatment of molecular processes by circuits with characteristic resonances and “beat-frequencies”, which result from primarily fast physical processes. As examples, the tunneling processes between DNA base pairs (H bonds), the ATP decomposition and the irradiation of tumor cells are accounted for.展开更多
We propose a scheme to enable a controllable cross-Kerr interaction between microwave photons in a circuit quantum electrodynamics （QED） system. In this scheme we use two transmission-line resonators （TLRs） and on...We propose a scheme to enable a controllable cross-Kerr interaction between microwave photons in a circuit quantum electrodynamics （QED） system. In this scheme we use two transmission-line resonators （TLRs） and one superconducting quantum interference device （SQUID） type charge qubit, which acts as an artificial atom. It is shown that in the dispersive regime of the eircuit-QED system, a controllable cross-Kerr interaction can be obtained by properly preparing the initial state of the qubit, and a large cross-phase shift between two microwave fields in the two TLRs can then be reached. Based on this cross-Kerr interaction, we show how to create a macroscopic entangled state between the two TLRs.展开更多
To improve the accuracy and interactivity of soft tissue delormatlon simulation, a new plate spring model based on physics is proposed. The model is parameterized and thus can be adapted to simulate different organs. ...To improve the accuracy and interactivity of soft tissue delormatlon simulation, a new plate spring model based on physics is proposed. The model is parameterized and thus can be adapted to simulate different organs. Different soft tissues are modeled by changing the width, number of pieces, thickness, and length of a single plate spring. In this paper, the structural design, calcula- tion of soft tissue deformation and real-time feedback operations of our system are also introduced. To evaluate the feasibility of the system and validate the model, an experimental system of haptic in- teraction, in which users can use virtual hands to pull virtual brain tissues, is built using PHANTOM OMNI devices. Experimental results show that the proposed system is stable, accurate and promising for modeling instantaneous soft tissue deformation.展开更多
Triboelectric nanogenerator(TENG)converts mechanical energy into valuable electrical energy,offering a solution for future energy needs.As an indispensable part of TENG,textile TENG(T-TENG)has incredible advantages in...Triboelectric nanogenerator(TENG)converts mechanical energy into valuable electrical energy,offering a solution for future energy needs.As an indispensable part of TENG,textile TENG(T-TENG)has incredible advantages in harvesting biomechanical energy and physiological signal monitoring.However,the application of T-TENG is restricted,partly because the fabric structure parameter and structure on T-TENG performance have not been fully exploited.This study comprehensively investigates the effect of weaving structure on fabric TENGs(F-TENGs)for direct-weaving yarn TENGs and post-coating fabric TENGs.For direct-weaving F-TENGs,a single-yarn TENG(Y-TENG)with a core-sheath structure is fabricated using conductive yarn as the core layer yarn and polytetrafluoroethylene(PTFE)filaments as the sheath yarn.Twelve fabrics with five different sets of parameters were designed and investigated.For post-coating F-TENGs,fabrics with weaving structures of plain,twill,satin,and reinforced twill were fabricated and coated with conductive silver paint.Overall,the twill F-TENGs have the best electrical outputs,followed by the satin F-TENGs and plain weave F-TENGs.Besides,the increase of the Y-TENG gap spacing was demonstrated to improve the electrical output performance.Moreover,T-TENGs are demonstrated for human-computer interaction and self-powered real-time monitoring.This systematic work provides guidance for the future T-TENG’s design.展开更多
Gaze estimation is one of the most promising technologies for supporting indoor monitoring and interaction systems.However,previous gaze estimation techniques generally work only in a controlled laboratory environment...Gaze estimation is one of the most promising technologies for supporting indoor monitoring and interaction systems.However,previous gaze estimation techniques generally work only in a controlled laboratory environment because they require a number of high-resolution eye images.This makes them unsuitable for welfare and healthcare facilities with the following challenging characteristics:1)users’continuous movements,2)various lighting conditions,and 3)a limited amount of available data.To address these issues,we introduce a multi-view multi-modal head-gaze estimation system that translates the user’s head orientation into the gaze direction.The proposed system captures the user using multiple cameras with depth and infrared modalities to train more robust gaze estimators under the aforementioned conditions.To this end,we implemented a deep learning pipeline that can handle different types and combinations of data.The proposed system was evaluated using the data collected from 10 volunteer participants to analyze how the use of single/multiple cameras and modalities affect the performance of head-gaze estimators.Through various experiments,we found that 1)an infrared-modality provides more useful features than a depth-modality,2)multi-view multi-modal approaches provide better accuracy than singleview single-modal approaches,and 3)the proposed estimators achieve a high inference efficiency that can be used in real-time applications.展开更多
Artificial entities,such as virtual agents,have become more pervasive.Their long-term presence among humans requires the virtual agent’s ability to express appropriate emotions to elicit the necessary empathy from th...Artificial entities,such as virtual agents,have become more pervasive.Their long-term presence among humans requires the virtual agent’s ability to express appropriate emotions to elicit the necessary empathy from the users.Affective empathy involves behavioral mimicry,a synchronized co-movement between dyadic pairs.However,the characteristics of such synchrony between humans and virtual agents remain unclear in empathic interactions.Our study evaluates the participant’s behavioral synchronization when a virtual agent exhibits an emotional expression congruent with the emotional context through facial expressions,behavioral gestures,and voice.Participants viewed an emotion-eliciting video stimulus(negative or positive)with a virtual agent.The participants then conversed with the virtual agent about the video,such as how the participant felt about the content.The virtual agent expressed emotions congruent with the video or neutral emotion during the dialog.The participants’facial expressions,such as the facial expressive intensity and facial muscle movement,were measured during the dialog using a camera.The results showed the participants’significant behavioral synchronization(i.e.,cosine similarity≥.05)in both the negative and positive emotion conditions,evident in the participant’s facial mimicry with the virtual agent.Additionally,the participants’facial expressions,both movement and intensity,were significantly stronger in the emotional virtual agent than in the neutral virtual agent.In particular,we found that the facial muscle intensity of AU45(Blink)is an effective index to assess the participant’s synchronization that differs by the individual’s empathic capability(low,mid,high).Based on the results,we suggest an appraisal criterion to provide empirical conditions to validate empathic interaction based on the facial expression measures.展开更多
In this paper,we investigate methodologies to improve direct-touch interaction on invisible and intangible spatial input.We firstly discuss about the motive of looking for a new input method for whole body interaction...In this paper,we investigate methodologies to improve direct-touch interaction on invisible and intangible spatial input.We firstly discuss about the motive of looking for a new input method for whole body interaction and how it can be meaningful.We also describe the role that can play spatial interaction to improve the freedom of interaction for a user.We propose a method of spatial centered interaction using invisible and intangible spatial inputs.However,given their lack of tactile feedback and visual representation,direct touch interaction on such input can be confused.In order to make a step toward understanding causes and solutions for such phenomena,we made 2 user experiments.In the first one,we test 5 setups of helper that provide information of the location of the input by constraining the dimension it is located at.The results show that using marker on the ground and a relationship with the height of the user’s body improve significantly the locative task.In the second experiment,we create a dancing game using invisible and intangible spatial inputs and we stress the results obtained in the first experiment within this cognitively demanding context.Results show that the same setup of helper is still providing very good results in that context.展开更多
Our analysis of published results of experiments in the Polar Regions substantiates and further develops our new approach to the photochemical processes in the polar stratosphere involving the charged particles. The d...Our analysis of published results of experiments in the Polar Regions substantiates and further develops our new approach to the photochemical processes in the polar stratosphere involving the charged particles. The dipole interaction of molecules with charged particles, primarily with ions, leads to the adhesion and disintegration of a number of molecules including ozone. Molecules acquire additional energy on the surface of the charged particles, enabling reactions that are not possible in space. Galactic cosmic rays are the main source of ions in the polar stratosphere, their equilibrium concentration at altitudes of 15 to 25 km can reach up ~ （1-5） ~ 103 ions/cm3. Estimations show that if the ozone destruction in the regime of＂collision＂ with ions then the lifetime of ozone will vary from 10 days to 2 months. We suppose that alongside with the chlorine mechanism of ozone destruction there is a mechanism of ozone decay on a charged particle which can act also at those latitudes and altitudes where chlorine oxide CIO is absent, as well as in the night conditions. Here, we demonstrated the close connection of photochemical processes with the dynamic, electrical and condensational phenomena in the stratosphere, in particular, with the accumulation of unipolar charged particles on the upper and lower boundaries of the polar stratospheric clouds and aerosol layers as a result of the activity of the global electric circuit.展开更多
Integrated electro-absorption-modulated distributed feedback laser diodes(EMLs)are attracting much interest in optical communications for the advantages of a compact structure,low power consumption,and high-speed modu...Integrated electro-absorption-modulated distributed feedback laser diodes(EMLs)are attracting much interest in optical communications for the advantages of a compact structure,low power consumption,and high-speed modulation.In integrated EML,the microwave interaction between the distributed feedback laser diode(DFB-LD)and the electro-absorption modulator(EAM)has a nonnegligible influence on the modulation performance,especially at the high-frequency region.In this paper,integrated EML was investigated as a three-port network with two electrical inputs and a single optical output,where the scattering matrix of the integrated device was theoretically deduced and experimentally measured.Based on the theoretical model and the measured data,the microwave equivalent circuit model of the integrated device was established,from which the microwave interaction between DFB-LD and EAM was successfully extracted.The results reveal that the microwave interaction within integrated EML contains both the electrical isolation and optical coupling.The electrical isolation is bidirectional while the optical coupling is directional,which aggravates the microwave interaction in the direction from DFB-LD to EAM.展开更多
The emergence of the somatosensory interactive technology has changed the ways of the interaction between the users and the computers, so that people can control the computers more freely. This paper focuses on the in...The emergence of the somatosensory interactive technology has changed the ways of the interaction between the users and the computers, so that people can control the computers more freely. This paper focuses on the interactive design of the somatosensory games, and combines the Kinect interactive devices with the popular Unity 3D game engines, and analyzes and designs the realization principles of the somatosensory games, the somatosensory games and the digital somatosensory interactive display. Through the design and production of the original game ＂Dream＂, the author discusses the design methods of the game interactive experience while abandoning the traditional human-comouter interactive mode.展开更多
基金the Talent Fund of Beijing Jiaotong University(Grant No.2024XKRC055).
文摘In recent years,railway construction in China has developed vigorously.With continuous improvements in the highspeed railway network,the focus is gradually shifting from large-scale construction to large-scale operations.However,several challenges have emerged within the high-speed railway dispatching and command system,including the heavy workload faced by dispatchers,the difficulty of quantifying subjective expertise,and the need for effective training of professionals.Amid the growing application of artificial intelligence technologies in railway systems,this study leverages Large Language Model(LLM)technology.LLMs bring enhanced intelligence,predictive capabilities,robust memory,and adaptability to diverse real-world scenarios.This study proposes a human-computer interactive intelligent scheduling auxiliary training system built on LLM technology.The system offers capabilities including natural dialogue,knowledge reasoning,and human feedback learning.With broad applicability,the system is suitable for vocational education,guided inquiry,knowledge-based Q&A,and other training scenarios.Validation results demonstrate its effectiveness in auxiliary training,providing substantial support for educators,students,and dispatching personnel in colleges and professional settings.
基金supported by the National Key Research and Development Program of China(2021YFB1600601)the Joint Funds of the National Natural Science Foundation of China and the Civil Aviation Administration of China(U1933106)+2 种基金the Scientific Research Project of Tianjin Educational Committee(2019KJ134)the Natural Science Foundation of TianjinIntelligent Civil Aviation Program(21JCQNJ C00900)。
文摘To solve the problem of risk identification and quantitative assessment for human-computer interaction(HCI)in complex avionics systems,an HCI safety analysis framework based on system-theoretical process analysis(STPA)and cognitive reliability and error analysis method(CREAM)is proposed.STPACREAM can identify unsafe control actions and find the causal path during the interaction of avionics systems and pilot with the help of formal verification tools automatically.The common performance conditions(CPC)of avionics systems in the aviation environment is established and a quantitative analysis of human failure is carried out.Taking the head-up display(HUD)system interaction process as an example,a case analysis is carried out,the layered safety control structure and formal model of the HUD interaction process are established.For the interactive behavior“Pilots approaching with HUD”,four unsafe control actions and35 causal scenarios are identified and the impact of common performance conditions at different levels on the pilot decision model are analyzed.The results show that HUD's HCI level gradually improves as the scores of CPC increase,and the quality of crew member cooperation and time sufficiency of the task is the key to its HCI.Through case analysis,it is shown that STPACREAM can quantitatively assess the hazards in HCI and identify the key factors that impact safety.
基金supported by the National Key Research and Development Program of China(2021YFB3901205)National Institute of Natural Hazards,Ministry of Emergency Management of China(2023-JBKY-57)。
文摘The periphery of the Qinghai-Tibet Plateau is renowned for its susceptibility to landslides.However,the northwestern margin of this region,characterised by limited human activities and challenging transportation,remains insufficiently explored concerning landslide occurrence and dispersion.With the planning and construction of the Xinjiang-Xizang Railway,a comprehensive investigation into disastrous landslides in this area is essential for effective disaster preparedness and mitigation strategies.By using the human-computer interaction interpretation approach,the authors established a landslide database encompassing 13003 landslides,collectively spanning an area of 3351.24 km^(2)(36°N-40°N,73°E-78°E).The database incorporates diverse topographical and environmental parameters,including regional elevation,slope angle,slope aspect,distance to faults,distance to roads,distance to rivers,annual precipitation,and stratum.The statistical characteristics of number and area of landslides,landslide number density(LND),and landslide area percentage(LAP)are analyzed.The authors found that a predominant concentration of landslide origins within high slope angle regions,with the highest incidence observed in intervals characterised by average slopes of 20°to 30°,maximum slope angle above 80°,along with orientations towards the north(N),northeast(NE),and southwest(SW).Additionally,elevations above 4.5 km,distance to rivers below 1 km,rainfall between 20-30 mm and 30-40 mm emerge as particularly susceptible to landslide development.The study area’s geological composition primarily comprises Mesozoic and Upper Paleozoic outcrops.Both fault and human engineering activities have different degrees of influence on landslide development.Furthermore,the significance of the landslide database,the relationship between landslide distribution and environmental factors,and the geometric and morphological characteristics of landslides are discussed.The landslide H/L ratios in the study area are mainly concentrated between 0.4 and 0.64.It means the landslides mobility in the region is relatively low,and the authors speculate that landslides in this region more possibly triggered by earthquakes or located in meizoseismal area.
基金Supported by the Natienal Natural Science Foundation of China(U23A20287).
文摘Background Haptic feedback plays a crucial role in virtual reality(VR)interaction,helping to improve the precision of user operation and enhancing the immersion of the user experience.Instrumental haptic feedback in virtual environments is primarily realized using grounded force or vibration feedback devices.However,improvements are required in terms of the active space and feedback realism.Methods We propose a lightweight and flexible haptic feedback glove that can haptically render objects in VR environments via kinesthetic and vibration feedback,thereby enabling users to enjoy a rich virtual piano-playing experience.The kinesthetic feedback of the glove relies on a cable-pulling mechanism that rotates the mechanism and pulls the two cables connected to it,thereby changing the amount of force generated to simulate the hardness or softness of the object.Vibration feedback is provided by small vibration motors embedded in the bottom of the fingertips of the glove.We designed a piano-playing scenario in the virtual environment and conducted user tests.The evaluation metrics were clarity,realism,enjoyment,and satisfaction.Results A total of 14 subjects participated in the test,and the results showed that our proposed glove scored significantly higher on the four evaluation metrics than the nofeedback and vibration feedback methods.Conclusions Our proposed glove significantly enhances the user experience when interacting with virtual objects.
基金supported by grants from the National Natural Science Foundation of China(32125018,32071005,and 32171079)Zhejiang Provincial Natural Science Foundation of China(LD24H090002 and LZ24C090001)+2 种基金the Fundamental Research Funds for the Central Universities(226-2024-00133)the Innovative Research Team of High-level Local Universities in Shanghai(SHSMU-ZDCX20211102)the MOE Frontiers Science Center for Brain Science&Brain-Machine Integration of Zhejiang University.
文摘The period of infancy is important for the formation of social behaviors due to the rapid postnatal development of the brain functions underlying emotions and social skills.Ilustration of the neural circuits involved in the developmental process of infant social behaviors could foster new therapies for some social impairments occurring in the infant period.
基金Supported by the National Natural Science Foundation of China(61773205,61773219)the Fundamental Research Funds for the Central Universities(NS2016032,NS2019018,Nanjing University of Aeronautics and Astronautics)+1 种基金the Scholarship from China Scholarship Council(201906835020)the Fundamental Research Funds for the Central Universities(the Graduate Student Innovation Base Open Fund Project of NUAA,kfjj20190307)。
文摘Recently,vision-based gesture recognition(VGR)has become a hot research spot in human-computer interaction(HCI).Unlike other gesture recognition methods with data gloves or other wearable sensors,vision-based gesture recognition could lead to more natural and intuitive HCI interactions.This paper reviews the state-of-the-art vision-based gestures recognition methods,from different stages of gesture recognition process,i.e.,(1)image acquisition and pre-processing,(2)gesture segmentation,(3)gesture tracking,(4)feature extraction,and(5)gesture classification.This paper also analyzes the advantages and disadvantages of these various methods in detail.Finally,the challenges of vision-based gesture recognition in haptic rendering and future research directions are discussed.
文摘With the popularity of new intelligent mobile devices in people’s lives,the development of mobile applications has paid increasing attention to the interactive experience of users.As the content of traditional Human-Computer Interaction(HCI)course and teaching material is out of date,it cannot meet the needs of mobile application interaction design and enterprises for students.Therefore,we need a new generation HCI course based on intelligent mobile devices to study the relationship between users and systems.The HCI course not only teaches students HCI theory and model,but also needs to cultivate students’interaction-oriented design practical ability.This paper proposes a set of HCI teaching material design and teaching methods for improving HCI class quality on mobile application interaction design,so as to make students more suitable for the employment requirements of enterprises.
文摘Based on the traditional Human-Computer Interaction method which is mainly touch input system, the way of capturing the movement of people by using cameras is proposed. This is a convenient technique which can provide users more experience. In the article, a new way of detecting moving things is given on the basis of development of the image processing technique. The system architecture decides that the communication should be used between two different applications. After considered, named pipe is selected from many ways of communication to make sure that video is keeping in step with the movement from the analysis of the people moving. According to a large amount of data and principal knowledge, thinking of the need of actual project, a detailed system design and realization is finished. The system consists of three important modules: detecting of the people's movement, information transition between applications and video showing in step with people's movement. The article introduces the idea of each module and technique.
基金supported by the China Fundamental Research Funds for the Central Universities(2022JBQY006)。
文摘Real-time train rescheduling plays a vital role in railway transportation as it is crucial for maintaining punctuality and reliability in rail operations.In this paper,we propose a rescheduling model that incorporates constraints and objectives generated through human-computer interaction.This approach ensures that the model is aligned with practical requirements and daily operational tasks while facilitating iterative train rescheduling.The dispatcher’s empirical knowledge is integrated into the train rescheduling process using a human-computer interaction framework.We introduce six interfaces to dynamically construct constraints and objectives that capture human intentions.By summarizing rescheduling rules,we devise a rule-based conflict detection-resolution heuristic algorithm to effectively solve the formulated model.A series of numerical experiments are presented,demonstrating strong performance across the entire system.Furthermore,theflexibility of rescheduling is enhanced through secondary analysis-driven solutions derived from the outcomes of humancomputer interactions in the previous step.This proposed interaction method complements existing literature on rescheduling methods involving human-computer interactions.It serves as a tool to aid dispatchers in identifying more feasible solutions in accordance with their empirical rescheduling strategies.
文摘The existence of specific biorhythms and the role of geomagnetic and/or solar magnetic activities are well-established by appropriate correlations in chronobiology. From a physical viewpoint, there are two different accesses to biorhythms to set up connections to molecular processes: quantum mechanical perturbation theoretical methods and their resonance dominators to characterize specific interactions between constituents. These methods permit the treatment of molecular processes by circuits with characteristic resonances and “beat-frequencies”, which result from primarily fast physical processes. As examples, the tunneling processes between DNA base pairs (H bonds), the ATP decomposition and the irradiation of tumor cells are accounted for.
基金supported by the National Natural Science Foundation of China (Grant Nos. 10775048 and 11075050)the National Basic Research Program of China (Grant No. 2007CB925204)the Education Department of Hunan Province,China (GrantNo. 08W012)
文摘We propose a scheme to enable a controllable cross-Kerr interaction between microwave photons in a circuit quantum electrodynamics （QED） system. In this scheme we use two transmission-line resonators （TLRs） and one superconducting quantum interference device （SQUID） type charge qubit, which acts as an artificial atom. It is shown that in the dispersive regime of the eircuit-QED system, a controllable cross-Kerr interaction can be obtained by properly preparing the initial state of the qubit, and a large cross-phase shift between two microwave fields in the two TLRs can then be reached. Based on this cross-Kerr interaction, we show how to create a macroscopic entangled state between the two TLRs.
基金Supported by the National High Technology Research and Development Programme of China(No.2013AA010803,2009AA01Z311,2009AA01Z314)the National Natural Science Foundation of China(No.61304205,61203316,61272379,61103086,41301037)+3 种基金the Natural Science Foundation of Jiangsu Province(BK20141002)the Open Funding Project of State Key Laboratory of Virtual Reality Technology and Systems,Beihang University,Jiangsu Ordinary University Science Research Project(No.13KJB120007)Innovation and Entrepreneurship Training Project of College Students(No.201410300153,201410300165)the Excellent Undergraduate Paper(design)Supporting Project of NUIST
文摘To improve the accuracy and interactivity of soft tissue delormatlon simulation, a new plate spring model based on physics is proposed. The model is parameterized and thus can be adapted to simulate different organs. Different soft tissues are modeled by changing the width, number of pieces, thickness, and length of a single plate spring. In this paper, the structural design, calcula- tion of soft tissue deformation and real-time feedback operations of our system are also introduced. To evaluate the feasibility of the system and validate the model, an experimental system of haptic in- teraction, in which users can use virtual hands to pull virtual brain tissues, is built using PHANTOM OMNI devices. Experimental results show that the proposed system is stable, accurate and promising for modeling instantaneous soft tissue deformation.
基金the National Undergraduate Innovation Program Training Project(No.202110755022)。
文摘Triboelectric nanogenerator(TENG)converts mechanical energy into valuable electrical energy,offering a solution for future energy needs.As an indispensable part of TENG,textile TENG(T-TENG)has incredible advantages in harvesting biomechanical energy and physiological signal monitoring.However,the application of T-TENG is restricted,partly because the fabric structure parameter and structure on T-TENG performance have not been fully exploited.This study comprehensively investigates the effect of weaving structure on fabric TENGs(F-TENGs)for direct-weaving yarn TENGs and post-coating fabric TENGs.For direct-weaving F-TENGs,a single-yarn TENG(Y-TENG)with a core-sheath structure is fabricated using conductive yarn as the core layer yarn and polytetrafluoroethylene(PTFE)filaments as the sheath yarn.Twelve fabrics with five different sets of parameters were designed and investigated.For post-coating F-TENGs,fabrics with weaving structures of plain,twill,satin,and reinforced twill were fabricated and coated with conductive silver paint.Overall,the twill F-TENGs have the best electrical outputs,followed by the satin F-TENGs and plain weave F-TENGs.Besides,the increase of the Y-TENG gap spacing was demonstrated to improve the electrical output performance.Moreover,T-TENGs are demonstrated for human-computer interaction and self-powered real-time monitoring.This systematic work provides guidance for the future T-TENG’s design.
基金This work was supported by the Basic Research Program through the National Research Foundation of Korea(NRF)grant funded by the Korea Government(MSIT)under Grant 2019R1F1A1045329 and Grant 2020R1A4A1017775.
文摘Gaze estimation is one of the most promising technologies for supporting indoor monitoring and interaction systems.However,previous gaze estimation techniques generally work only in a controlled laboratory environment because they require a number of high-resolution eye images.This makes them unsuitable for welfare and healthcare facilities with the following challenging characteristics:1)users’continuous movements,2)various lighting conditions,and 3)a limited amount of available data.To address these issues,we introduce a multi-view multi-modal head-gaze estimation system that translates the user’s head orientation into the gaze direction.The proposed system captures the user using multiple cameras with depth and infrared modalities to train more robust gaze estimators under the aforementioned conditions.To this end,we implemented a deep learning pipeline that can handle different types and combinations of data.The proposed system was evaluated using the data collected from 10 volunteer participants to analyze how the use of single/multiple cameras and modalities affect the performance of head-gaze estimators.Through various experiments,we found that 1)an infrared-modality provides more useful features than a depth-modality,2)multi-view multi-modal approaches provide better accuracy than singleview single-modal approaches,and 3)the proposed estimators achieve a high inference efficiency that can be used in real-time applications.
文摘Artificial entities,such as virtual agents,have become more pervasive.Their long-term presence among humans requires the virtual agent’s ability to express appropriate emotions to elicit the necessary empathy from the users.Affective empathy involves behavioral mimicry,a synchronized co-movement between dyadic pairs.However,the characteristics of such synchrony between humans and virtual agents remain unclear in empathic interactions.Our study evaluates the participant’s behavioral synchronization when a virtual agent exhibits an emotional expression congruent with the emotional context through facial expressions,behavioral gestures,and voice.Participants viewed an emotion-eliciting video stimulus(negative or positive)with a virtual agent.The participants then conversed with the virtual agent about the video,such as how the participant felt about the content.The virtual agent expressed emotions congruent with the video or neutral emotion during the dialog.The participants’facial expressions,such as the facial expressive intensity and facial muscle movement,were measured during the dialog using a camera.The results showed the participants’significant behavioral synchronization(i.e.,cosine similarity≥.05)in both the negative and positive emotion conditions,evident in the participant’s facial mimicry with the virtual agent.Additionally,the participants’facial expressions,both movement and intensity,were significantly stronger in the emotional virtual agent than in the neutral virtual agent.In particular,we found that the facial muscle intensity of AU45(Blink)is an effective index to assess the participant’s synchronization that differs by the individual’s empathic capability(low,mid,high).Based on the results,we suggest an appraisal criterion to provide empirical conditions to validate empathic interaction based on the facial expression measures.
文摘In this paper,we investigate methodologies to improve direct-touch interaction on invisible and intangible spatial input.We firstly discuss about the motive of looking for a new input method for whole body interaction and how it can be meaningful.We also describe the role that can play spatial interaction to improve the freedom of interaction for a user.We propose a method of spatial centered interaction using invisible and intangible spatial inputs.However,given their lack of tactile feedback and visual representation,direct touch interaction on such input can be confused.In order to make a step toward understanding causes and solutions for such phenomena,we made 2 user experiments.In the first one,we test 5 setups of helper that provide information of the location of the input by constraining the dimension it is located at.The results show that using marker on the ground and a relationship with the height of the user’s body improve significantly the locative task.In the second experiment,we create a dancing game using invisible and intangible spatial inputs and we stress the results obtained in the first experiment within this cognitively demanding context.Results show that the same setup of helper is still providing very good results in that context.
文摘Our analysis of published results of experiments in the Polar Regions substantiates and further develops our new approach to the photochemical processes in the polar stratosphere involving the charged particles. The dipole interaction of molecules with charged particles, primarily with ions, leads to the adhesion and disintegration of a number of molecules including ozone. Molecules acquire additional energy on the surface of the charged particles, enabling reactions that are not possible in space. Galactic cosmic rays are the main source of ions in the polar stratosphere, their equilibrium concentration at altitudes of 15 to 25 km can reach up ~ （1-5） ~ 103 ions/cm3. Estimations show that if the ozone destruction in the regime of＂collision＂ with ions then the lifetime of ozone will vary from 10 days to 2 months. We suppose that alongside with the chlorine mechanism of ozone destruction there is a mechanism of ozone decay on a charged particle which can act also at those latitudes and altitudes where chlorine oxide CIO is absent, as well as in the night conditions. Here, we demonstrated the close connection of photochemical processes with the dynamic, electrical and condensational phenomena in the stratosphere, in particular, with the accumulation of unipolar charged particles on the upper and lower boundaries of the polar stratospheric clouds and aerosol layers as a result of the activity of the global electric circuit.
基金This work was supported by the National Key Research and Development Program of China under Grant No.2018YFE0201900the National Natural Science Foundation of China under Grants No.61927821 and No.61875240the Joint Research Fund of Ministry of Education of China under Grant No.6141A02022436.
文摘Integrated electro-absorption-modulated distributed feedback laser diodes(EMLs)are attracting much interest in optical communications for the advantages of a compact structure,low power consumption,and high-speed modulation.In integrated EML,the microwave interaction between the distributed feedback laser diode(DFB-LD)and the electro-absorption modulator(EAM)has a nonnegligible influence on the modulation performance,especially at the high-frequency region.In this paper,integrated EML was investigated as a three-port network with two electrical inputs and a single optical output,where the scattering matrix of the integrated device was theoretically deduced and experimentally measured.Based on the theoretical model and the measured data,the microwave equivalent circuit model of the integrated device was established,from which the microwave interaction between DFB-LD and EAM was successfully extracted.The results reveal that the microwave interaction within integrated EML contains both the electrical isolation and optical coupling.The electrical isolation is bidirectional while the optical coupling is directional,which aggravates the microwave interaction in the direction from DFB-LD to EAM.
文摘The emergence of the somatosensory interactive technology has changed the ways of the interaction between the users and the computers, so that people can control the computers more freely. This paper focuses on the interactive design of the somatosensory games, and combines the Kinect interactive devices with the popular Unity 3D game engines, and analyzes and designs the realization principles of the somatosensory games, the somatosensory games and the digital somatosensory interactive display. Through the design and production of the original game ＂Dream＂, the author discusses the design methods of the game interactive experience while abandoning the traditional human-comouter interactive mode.
