In recent years,railway construction in China has developed vigorously.With continuous improvements in the highspeed railway network,the focus is gradually shifting from large-scale construction to large-scale operati...In recent years,railway construction in China has developed vigorously.With continuous improvements in the highspeed railway network,the focus is gradually shifting from large-scale construction to large-scale operations.However,several challenges have emerged within the high-speed railway dispatching and command system,including the heavy workload faced by dispatchers,the difficulty of quantifying subjective expertise,and the need for effective training of professionals.Amid the growing application of artificial intelligence technologies in railway systems,this study leverages Large Language Model(LLM)technology.LLMs bring enhanced intelligence,predictive capabilities,robust memory,and adaptability to diverse real-world scenarios.This study proposes a human-computer interactive intelligent scheduling auxiliary training system built on LLM technology.The system offers capabilities including natural dialogue,knowledge reasoning,and human feedback learning.With broad applicability,the system is suitable for vocational education,guided inquiry,knowledge-based Q&A,and other training scenarios.Validation results demonstrate its effectiveness in auxiliary training,providing substantial support for educators,students,and dispatching personnel in colleges and professional settings.展开更多
This study examines the advent of agent interaction(AIx)as a transformative paradigm in humancomputer interaction(HCI),signifying a notable evolution beyond traditional graphical interfaces and touchscreen interaction...This study examines the advent of agent interaction(AIx)as a transformative paradigm in humancomputer interaction(HCI),signifying a notable evolution beyond traditional graphical interfaces and touchscreen interactions.Within the context of large models,AIx is characterized by its innovative interaction patterns and a plethora of application scenarios that hold great potential.The paper highlights the pivotal role of AIx in shaping the future landscape of the large model industry,emphasizing its adoption and necessity from a user's perspective.This study underscores the pivotal role of AIx in dictating the future trajectory of a large model industry by emphasizing the importance of its adoption and necessity from a user-centric perspective.The fundamental drivers of AIx include the introduction of novel capabilities,replication of capabilities(both anthropomorphic and superhuman),migration of capabilities,aggregation of intelligence,and multiplication of capabilities.These elements are essential for propelling innovation,expanding the frontiers of capability,and realizing the exponential superposition of capabilities,thereby mitigating labor redundancy and addressing a spectrum of human needs.Furthermore,this study provides an in-depth analysis of the structural components and operational mechanisms of agents supported by large models.Such advancements significantly enhance the capacity of agents to tackle complex problems and provide intelligent services,thereby facilitating a more intuitive,adaptive,and personalized engagement between humans and machines.The study further delineates four principal categories of interaction patterns that encompass eight distinct modalities of interaction,corresponding to twenty-one specific scenarios,including applications in smart home systems,health assistance,and elderly care.This emphasizes the significance of this new paradigm in advancing HCI,fostering technological advancements,and redefining user experiences.However,it also acknowledges the challenges and ethical considerations that accompany this paradigm shift,recognizing the need for a balanced approach to harness the full potential of AIx in modern society.展开更多
Recently,vision-based gesture recognition(VGR)has become a hot research spot in human-computer interaction(HCI).Unlike other gesture recognition methods with data gloves or other wearable sensors,vision-based gesture ...Recently,vision-based gesture recognition(VGR)has become a hot research spot in human-computer interaction(HCI).Unlike other gesture recognition methods with data gloves or other wearable sensors,vision-based gesture recognition could lead to more natural and intuitive HCI interactions.This paper reviews the state-of-the-art vision-based gestures recognition methods,from different stages of gesture recognition process,i.e.,(1)image acquisition and pre-processing,(2)gesture segmentation,(3)gesture tracking,(4)feature extraction,and(5)gesture classification.This paper also analyzes the advantages and disadvantages of these various methods in detail.Finally,the challenges of vision-based gesture recognition in haptic rendering and future research directions are discussed.展开更多
To solve the problem of risk identification and quantitative assessment for human-computer interaction(HCI)in complex avionics systems,an HCI safety analysis framework based on system-theoretical process analysis(STPA...To solve the problem of risk identification and quantitative assessment for human-computer interaction(HCI)in complex avionics systems,an HCI safety analysis framework based on system-theoretical process analysis(STPA)and cognitive reliability and error analysis method(CREAM)is proposed.STPACREAM can identify unsafe control actions and find the causal path during the interaction of avionics systems and pilot with the help of formal verification tools automatically.The common performance conditions(CPC)of avionics systems in the aviation environment is established and a quantitative analysis of human failure is carried out.Taking the head-up display(HUD)system interaction process as an example,a case analysis is carried out,the layered safety control structure and formal model of the HUD interaction process are established.For the interactive behavior“Pilots approaching with HUD”,four unsafe control actions and35 causal scenarios are identified and the impact of common performance conditions at different levels on the pilot decision model are analyzed.The results show that HUD's HCI level gradually improves as the scores of CPC increase,and the quality of crew member cooperation and time sufficiency of the task is the key to its HCI.Through case analysis,it is shown that STPACREAM can quantitatively assess the hazards in HCI and identify the key factors that impact safety.展开更多
The periphery of the Qinghai-Tibet Plateau is renowned for its susceptibility to landslides.However,the northwestern margin of this region,characterised by limited human activities and challenging transportation,remai...The periphery of the Qinghai-Tibet Plateau is renowned for its susceptibility to landslides.However,the northwestern margin of this region,characterised by limited human activities and challenging transportation,remains insufficiently explored concerning landslide occurrence and dispersion.With the planning and construction of the Xinjiang-Xizang Railway,a comprehensive investigation into disastrous landslides in this area is essential for effective disaster preparedness and mitigation strategies.By using the human-computer interaction interpretation approach,the authors established a landslide database encompassing 13003 landslides,collectively spanning an area of 3351.24 km^(2)(36°N-40°N,73°E-78°E).The database incorporates diverse topographical and environmental parameters,including regional elevation,slope angle,slope aspect,distance to faults,distance to roads,distance to rivers,annual precipitation,and stratum.The statistical characteristics of number and area of landslides,landslide number density(LND),and landslide area percentage(LAP)are analyzed.The authors found that a predominant concentration of landslide origins within high slope angle regions,with the highest incidence observed in intervals characterised by average slopes of 20°to 30°,maximum slope angle above 80°,along with orientations towards the north(N),northeast(NE),and southwest(SW).Additionally,elevations above 4.5 km,distance to rivers below 1 km,rainfall between 20-30 mm and 30-40 mm emerge as particularly susceptible to landslide development.The study area’s geological composition primarily comprises Mesozoic and Upper Paleozoic outcrops.Both fault and human engineering activities have different degrees of influence on landslide development.Furthermore,the significance of the landslide database,the relationship between landslide distribution and environmental factors,and the geometric and morphological characteristics of landslides are discussed.The landslide H/L ratios in the study area are mainly concentrated between 0.4 and 0.64.It means the landslides mobility in the region is relatively low,and the authors speculate that landslides in this region more possibly triggered by earthquakes or located in meizoseismal area.展开更多
With the popularity of new intelligent mobile devices in people’s lives,the development of mobile applications has paid increasing attention to the interactive experience of users.As the content of traditional Human-...With the popularity of new intelligent mobile devices in people’s lives,the development of mobile applications has paid increasing attention to the interactive experience of users.As the content of traditional Human-Computer Interaction(HCI)course and teaching material is out of date,it cannot meet the needs of mobile application interaction design and enterprises for students.Therefore,we need a new generation HCI course based on intelligent mobile devices to study the relationship between users and systems.The HCI course not only teaches students HCI theory and model,but also needs to cultivate students’interaction-oriented design practical ability.This paper proposes a set of HCI teaching material design and teaching methods for improving HCI class quality on mobile application interaction design,so as to make students more suitable for the employment requirements of enterprises.展开更多
Real-time train rescheduling plays a vital role in railway transportation as it is crucial for maintaining punctuality and reliability in rail operations.In this paper,we propose a rescheduling model that incorporates...Real-time train rescheduling plays a vital role in railway transportation as it is crucial for maintaining punctuality and reliability in rail operations.In this paper,we propose a rescheduling model that incorporates constraints and objectives generated through human-computer interaction.This approach ensures that the model is aligned with practical requirements and daily operational tasks while facilitating iterative train rescheduling.The dispatcher’s empirical knowledge is integrated into the train rescheduling process using a human-computer interaction framework.We introduce six interfaces to dynamically construct constraints and objectives that capture human intentions.By summarizing rescheduling rules,we devise a rule-based conflict detection-resolution heuristic algorithm to effectively solve the formulated model.A series of numerical experiments are presented,demonstrating strong performance across the entire system.Furthermore,theflexibility of rescheduling is enhanced through secondary analysis-driven solutions derived from the outcomes of humancomputer interactions in the previous step.This proposed interaction method complements existing literature on rescheduling methods involving human-computer interactions.It serves as a tool to aid dispatchers in identifying more feasible solutions in accordance with their empirical rescheduling strategies.展开更多
Recent advancements in the Internet of Things IoT and cloud computing have paved the way for mobile Healthcare(mHealthcare)services.A patient within the hospital is monitored by several devices.Moreover,upon leaving t...Recent advancements in the Internet of Things IoT and cloud computing have paved the way for mobile Healthcare(mHealthcare)services.A patient within the hospital is monitored by several devices.Moreover,upon leaving the hospital,the patient can be remotely monitored whether directly using body wearable sensors or using a smartphone equipped with sensors to monitor different user-health parameters.This raises potential challenges for intelligent monitoring of patient's health.In this paper,an improved architecture for smart mHealthcare is proposed that is supported by HCI design principles.The HCI also provides the support for the User-Centric Design(UCD)for smart mHealthcare models.Furthermore,the HCI along with IoT's(Internet of Things)5-layered architecture has the potential of improving User Experience(UX)in mHealthcare design and help saving lives.The intelligent mHealthcare system is supported by the IoT sensing and communication layers and health care providers are supported by the application layer for the medical,behavioral,and health-related information.Health care providers and users are further supported by an intelligent layer performing critical situation assessment and performing a multi-modal communication using an intelligent assistant.The HCI design focuses on the ease-of-use,including user experience and safety,alarms,and error-resistant displays of the end-user,and improves user's experience and user satisfaction.展开更多
Based on the traditional Human-Computer Interaction method which is mainly touch input system, the way of capturing the movement of people by using cameras is proposed. This is a convenient technique which can provide...Based on the traditional Human-Computer Interaction method which is mainly touch input system, the way of capturing the movement of people by using cameras is proposed. This is a convenient technique which can provide users more experience. In the article, a new way of detecting moving things is given on the basis of development of the image processing technique. The system architecture decides that the communication should be used between two different applications. After considered, named pipe is selected from many ways of communication to make sure that video is keeping in step with the movement from the analysis of the people moving. According to a large amount of data and principal knowledge, thinking of the need of actual project, a detailed system design and realization is finished. The system consists of three important modules: detecting of the people's movement, information transition between applications and video showing in step with people's movement. The article introduces the idea of each module and technique.展开更多
The shop floor dynamic scheduling system based on human-computer interaction is the use of computer-aided decision-making and human-computer interaction to solve the dynamic scheduling problem.A human-computer interac...The shop floor dynamic scheduling system based on human-computer interaction is the use of computer-aided decision-making and human-computer interaction to solve the dynamic scheduling problem.A human-computer interaction interface based on Gantt chart is designed,which can not only comprehensively and quantitatively represent the scheduling process and scheduling scheme,but also have friendly human-computer interaction performance.The data transmission and interaction architecture is constructed to realize the rapid response to shop floor disturbance events.A priority calculation algorithm integrating priority rules and dispatcher preference is proposed,which realizes the automatic calculation of priority for the dispatcher's reference and reduces theirburden.A man-machine interactive shop floor dynamic scheduling strategy is proposed.When solving the dynamic flexible job shop scheduling problem caused by machine tool breakdown and urgent order,the origin moments obtained by using this strategy are 0.4190 and 0.3703 respectively.As can be seen from the origin moment indicator,the dynamic shop floor scheduling system based on the human-computer interaction is efficient and reliable in solving dynamic scheduling problems,and related strategies of this system are also feasible and stable.展开更多
Triboelectric nanogenerator(TENG)converts mechanical energy into valuable electrical energy,offering a solution for future energy needs.As an indispensable part of TENG,textile TENG(T-TENG)has incredible advantages in...Triboelectric nanogenerator(TENG)converts mechanical energy into valuable electrical energy,offering a solution for future energy needs.As an indispensable part of TENG,textile TENG(T-TENG)has incredible advantages in harvesting biomechanical energy and physiological signal monitoring.However,the application of T-TENG is restricted,partly because the fabric structure parameter and structure on T-TENG performance have not been fully exploited.This study comprehensively investigates the effect of weaving structure on fabric TENGs(F-TENGs)for direct-weaving yarn TENGs and post-coating fabric TENGs.For direct-weaving F-TENGs,a single-yarn TENG(Y-TENG)with a core-sheath structure is fabricated using conductive yarn as the core layer yarn and polytetrafluoroethylene(PTFE)filaments as the sheath yarn.Twelve fabrics with five different sets of parameters were designed and investigated.For post-coating F-TENGs,fabrics with weaving structures of plain,twill,satin,and reinforced twill were fabricated and coated with conductive silver paint.Overall,the twill F-TENGs have the best electrical outputs,followed by the satin F-TENGs and plain weave F-TENGs.Besides,the increase of the Y-TENG gap spacing was demonstrated to improve the electrical output performance.Moreover,T-TENGs are demonstrated for human-computer interaction and self-powered real-time monitoring.This systematic work provides guidance for the future T-TENG’s design.展开更多
With the rapid development of artificial intelligence technology,AIGC(Artificial Intelligence-Generated Content)has triggered profound changes in the field of high-level language programming courses.This paper deeply ...With the rapid development of artificial intelligence technology,AIGC(Artificial Intelligence-Generated Content)has triggered profound changes in the field of high-level language programming courses.This paper deeply explored the application principles,advantages,and limitations of AIGC in intelligent code generation,analyzed the new mode of human-computer collaboration in high-level language programming courses driven by AIGC,discussed the impact of human-computer collaboration on programming efficiency and code quality through practical case studies,and looks forward to future development trends.This research aims to provide theoretical and practical guidance for high-level language programming courses and promote innovative development of high-level language programming courses under the human-computer collaboration paradigm.展开更多
Voice, motion, and mimicry are naturalistic control modalities that have replaced text or display-driven control in human-computer communication (HCC). Specifically, the vocals contain a lot of knowledge, revealing de...Voice, motion, and mimicry are naturalistic control modalities that have replaced text or display-driven control in human-computer communication (HCC). Specifically, the vocals contain a lot of knowledge, revealing details about the speaker’s goals and desires, as well as their internal condition. Certain vocal characteristics reveal the speaker’s mood, intention, and motivation, while word study assists the speaker’s demand to be understood. Voice emotion recognition has become an essential component of modern HCC networks. Integrating findings from the various disciplines involved in identifying vocal emotions is also challenging. Many sound analysis techniques were developed in the past. Learning about the development of artificial intelligence (AI), and especially Deep Learning (DL) technology, research incorporating real data is becoming increasingly common these days. Thus, this research presents a novel selfish herd optimization-tuned long/short-term memory (SHO-LSTM) strategy to identify vocal emotions in human communication. The RAVDESS public dataset is used to train the suggested SHO-LSTM technique. Mel-frequency cepstral coefficient (MFCC) and wiener filter (WF) techniques are used, respectively, to remove noise and extract features from the data. LSTM and SHO are applied to the extracted data to optimize the LSTM network’s parameters for effective emotion recognition. Python Software was used to execute our proposed framework. In the finding assessment phase, Numerous metrics are used to evaluate the proposed model’s detection capability, Such as F1-score (95%), precision (95%), recall (96%), and accuracy (97%). The suggested approach is tested on a Python platform, and the SHO-LSTM’s outcomes are contrasted with those of other previously conducted research. Based on comparative assessments, our suggested approach outperforms the current approaches in vocal emotion recognition.展开更多
Videogames feature non-player-characters. Such ingame entities are controlled by artificial intelligence that is sought to match the user＇s skill. Defining and understanding the given human-computer-interaction video...Videogames feature non-player-characters. Such ingame entities are controlled by artificial intelligence that is sought to match the user＇s skill. Defining and understanding the given human-computer-interaction videogame genres can be differentiated in either competitive matches or coherent plays. While artificial intelligence answers in responsive patterns only, natural intelligence holds creative qualities. A match is a game that creates suspense over the question of who is going to prevail. It can thus only be a game that features competing human players, since a computerized opponent is unaware of the game＇s significance. The nature of the match lies within the interactive trial. In a play, however, there is no battle but only cooperation. The aesthetics of such a play unfold to the audience, its purpose is showing rather than experiencing and/or competitively interacting. Artificial intelligence is then a surrogate that is often used in videogames to create an illusion of competition or battle. Its actual purpose is not to feature a worthy opponent, but to be a programmatic loser. In narrative and linear videogames, such as AI takes the role of a supporting actor whose function in the plot is, to signalize the player＇s dominance.展开更多
Human-machine interactions(HMIs)have advanced rapidly in recent decades in the fields of healthcare,work,and life.However,people with disabilities and other mobility problems do not have corresponding high-tech aids f...Human-machine interactions(HMIs)have advanced rapidly in recent decades in the fields of healthcare,work,and life.However,people with disabilities and other mobility problems do not have corresponding high-tech aids for them to enjoy the convenience of HMIs.In this paper,we propose a sensor with a wave-shaped(corrugated)electrode embedded in a friction layer,which exhibits high sensitivity to skin fold excitation and enormous potential in HMIs.Attributing to the wave-shaped electrode design,it has no built-in cavities,and its small size allows it to flexibly cope with folds at different angles.By specifying the carbon nanotube hybrid silicone film as the electrode layer material and silicone film as the friction layer,good electrical output performance,tensile properties,and biocompatibility can be achieved.Then,the sensor is tested on various joints and skin folds of the human body,the output signals of which can be distinguished between normal physiological behavior and test behavior.Based on this sensor,we designed a medical alarm system,a robotic arm assistive system,and a cell phone application control system for the disabled to help them in the fields of healthcare,work,and life.In conclusion,our research presents a feasible technology to enhance HMIs and makes a valuable contribution to the development of high-tech aids for the disabled.展开更多
Augmented Reality is a technique that allows users to overlap digital information with their physical world.The Augmented Reality(AR)displays have an exceptional characteristic from the Human–Computer Interaction(HCI...Augmented Reality is a technique that allows users to overlap digital information with their physical world.The Augmented Reality(AR)displays have an exceptional characteristic from the Human–Computer Interaction(HCI)perspective.Due to its increasing popularity and application in diverse domains,increasing user-friendliness and AR usage are critical.Context-aware is one approach since an AR application can adapt to the user,environment,needs and enhance ergonomic principles and functionality.This paper proposes the Intelligent Contextaware Augmented Reality Model(ICAARM)for Human–Computer Interaction systems.This study explores and reduces interaction uncertainty by semantically modeling user-specific interaction with context,allowing personalised interaction.Sensory information is captured from an AR device to understand user interactions and context.These depictions carry semantics to Augmented Reality applications about the user’s intention to interact with a specific device affordance.Thus,this study describes personalised gesture interaction in VR/AR applications for immersive/intelligent environments.展开更多
Luminescent metal-organic frameworks(MOFs)have garnered significant attention due to their structural tunability and potential applications in solid-state lighting,bioimaging,sensing,anticounterfeiting,and other field...Luminescent metal-organic frameworks(MOFs)have garnered significant attention due to their structural tunability and potential applications in solid-state lighting,bioimaging,sensing,anticounterfeiting,and other fields.Nevertheless,due to the tendency of1,4-benzenedicarboxylic acid(BDC)to rotate within the framework,MOFs composed of it exhibit significant non-radiative energy dissipation and thus impair the emissive properties.In this study,efficient luminescence of MIL-140A nanocrystals(NCs)with BDC rotors as ligands is achieved by pressure treatment strategy.Pressure treatment effectively modulates the pore structure of the framework,enhancing the interactions between the N,N-dimethylformamide vip molecules and the BDC ligands.The enhanced host-vip interaction contributes to the structural rigidity of the MOF,thereby suppressing the rotation-induced excited-state energy loss.As a result,the pressure-treated MIL-140A NCs displayed bright blue-light emission,with the photoluminescence quantum yield increasing from an initial 6.8%to 69.2%.This study developed an effective strategy to improve the luminescence performance of rotor ligand MOFs,offers a new avenue for the rational design and synthesis of MOFs with superior luminescent properties.展开更多
Background Haptic feedback plays a crucial role in virtual reality(VR)interaction,helping to improve the precision of user operation and enhancing the immersion of the user experience.Instrumental haptic feedback in v...Background Haptic feedback plays a crucial role in virtual reality(VR)interaction,helping to improve the precision of user operation and enhancing the immersion of the user experience.Instrumental haptic feedback in virtual environments is primarily realized using grounded force or vibration feedback devices.However,improvements are required in terms of the active space and feedback realism.Methods We propose a lightweight and flexible haptic feedback glove that can haptically render objects in VR environments via kinesthetic and vibration feedback,thereby enabling users to enjoy a rich virtual piano-playing experience.The kinesthetic feedback of the glove relies on a cable-pulling mechanism that rotates the mechanism and pulls the two cables connected to it,thereby changing the amount of force generated to simulate the hardness or softness of the object.Vibration feedback is provided by small vibration motors embedded in the bottom of the fingertips of the glove.We designed a piano-playing scenario in the virtual environment and conducted user tests.The evaluation metrics were clarity,realism,enjoyment,and satisfaction.Results A total of 14 subjects participated in the test,and the results showed that our proposed glove scored significantly higher on the four evaluation metrics than the nofeedback and vibration feedback methods.Conclusions Our proposed glove significantly enhances the user experience when interacting with virtual objects.展开更多
Optimization design of hydraulic manifold blocks (HMB) is studied as acomplex solid spatial layout problem. Based on comprehensive research into structure features anddesign rules of HMB, an optimal mathematical model...Optimization design of hydraulic manifold blocks (HMB) is studied as acomplex solid spatial layout problem. Based on comprehensive research into structure features anddesign rules of HMB, an optimal mathematical model for this problem is presented. Usinghuman-computer cooperative genetic algorithm (GA) and its hybrid optitation strategies, integratedlayout and connection design schemes of HMB can be automatically optimized. An example is given totestify it.展开更多
The cooperative work between human being and computer based on virtual reality (VR) is investigated to plan the disassembly sequences more efficiently. A three-layer model of human-computer cooperative virtual disasse...The cooperative work between human being and computer based on virtual reality (VR) is investigated to plan the disassembly sequences more efficiently. A three-layer model of human-computer cooperative virtual disassembly is built, and the corresponding human-computer system for stable virtual disassembly is developed. In this system, an immersive and interactive virtual disassembly environment has been created to provide planners with a more visual working scene. For cooperative disassembly, an intelligent module of stability analysis of disassembly operations is embedded into the human-computer system to assist planners to implement disassembly tasks better. The supporting matrix for stability analysis of disassembly operations is defined and the method of stability analysis is detailed. Based on the approach, the stability of any disassembly operation can be analyzed to instruct the manual virtual disassembly. At last, a disassembly case in the virtual environment is given to prove the validity of above ideas.展开更多
基金the Talent Fund of Beijing Jiaotong University(Grant No.2024XKRC055).
文摘In recent years,railway construction in China has developed vigorously.With continuous improvements in the highspeed railway network,the focus is gradually shifting from large-scale construction to large-scale operations.However,several challenges have emerged within the high-speed railway dispatching and command system,including the heavy workload faced by dispatchers,the difficulty of quantifying subjective expertise,and the need for effective training of professionals.Amid the growing application of artificial intelligence technologies in railway systems,this study leverages Large Language Model(LLM)technology.LLMs bring enhanced intelligence,predictive capabilities,robust memory,and adaptability to diverse real-world scenarios.This study proposes a human-computer interactive intelligent scheduling auxiliary training system built on LLM technology.The system offers capabilities including natural dialogue,knowledge reasoning,and human feedback learning.With broad applicability,the system is suitable for vocational education,guided inquiry,knowledge-based Q&A,and other training scenarios.Validation results demonstrate its effectiveness in auxiliary training,providing substantial support for educators,students,and dispatching personnel in colleges and professional settings.
文摘This study examines the advent of agent interaction(AIx)as a transformative paradigm in humancomputer interaction(HCI),signifying a notable evolution beyond traditional graphical interfaces and touchscreen interactions.Within the context of large models,AIx is characterized by its innovative interaction patterns and a plethora of application scenarios that hold great potential.The paper highlights the pivotal role of AIx in shaping the future landscape of the large model industry,emphasizing its adoption and necessity from a user's perspective.This study underscores the pivotal role of AIx in dictating the future trajectory of a large model industry by emphasizing the importance of its adoption and necessity from a user-centric perspective.The fundamental drivers of AIx include the introduction of novel capabilities,replication of capabilities(both anthropomorphic and superhuman),migration of capabilities,aggregation of intelligence,and multiplication of capabilities.These elements are essential for propelling innovation,expanding the frontiers of capability,and realizing the exponential superposition of capabilities,thereby mitigating labor redundancy and addressing a spectrum of human needs.Furthermore,this study provides an in-depth analysis of the structural components and operational mechanisms of agents supported by large models.Such advancements significantly enhance the capacity of agents to tackle complex problems and provide intelligent services,thereby facilitating a more intuitive,adaptive,and personalized engagement between humans and machines.The study further delineates four principal categories of interaction patterns that encompass eight distinct modalities of interaction,corresponding to twenty-one specific scenarios,including applications in smart home systems,health assistance,and elderly care.This emphasizes the significance of this new paradigm in advancing HCI,fostering technological advancements,and redefining user experiences.However,it also acknowledges the challenges and ethical considerations that accompany this paradigm shift,recognizing the need for a balanced approach to harness the full potential of AIx in modern society.
基金Supported by the National Natural Science Foundation of China(61773205,61773219)the Fundamental Research Funds for the Central Universities(NS2016032,NS2019018,Nanjing University of Aeronautics and Astronautics)+1 种基金the Scholarship from China Scholarship Council(201906835020)the Fundamental Research Funds for the Central Universities(the Graduate Student Innovation Base Open Fund Project of NUAA,kfjj20190307)。
文摘Recently,vision-based gesture recognition(VGR)has become a hot research spot in human-computer interaction(HCI).Unlike other gesture recognition methods with data gloves or other wearable sensors,vision-based gesture recognition could lead to more natural and intuitive HCI interactions.This paper reviews the state-of-the-art vision-based gestures recognition methods,from different stages of gesture recognition process,i.e.,(1)image acquisition and pre-processing,(2)gesture segmentation,(3)gesture tracking,(4)feature extraction,and(5)gesture classification.This paper also analyzes the advantages and disadvantages of these various methods in detail.Finally,the challenges of vision-based gesture recognition in haptic rendering and future research directions are discussed.
基金supported by the National Key Research and Development Program of China(2021YFB1600601)the Joint Funds of the National Natural Science Foundation of China and the Civil Aviation Administration of China(U1933106)+2 种基金the Scientific Research Project of Tianjin Educational Committee(2019KJ134)the Natural Science Foundation of TianjinIntelligent Civil Aviation Program(21JCQNJ C00900)。
文摘To solve the problem of risk identification and quantitative assessment for human-computer interaction(HCI)in complex avionics systems,an HCI safety analysis framework based on system-theoretical process analysis(STPA)and cognitive reliability and error analysis method(CREAM)is proposed.STPACREAM can identify unsafe control actions and find the causal path during the interaction of avionics systems and pilot with the help of formal verification tools automatically.The common performance conditions(CPC)of avionics systems in the aviation environment is established and a quantitative analysis of human failure is carried out.Taking the head-up display(HUD)system interaction process as an example,a case analysis is carried out,the layered safety control structure and formal model of the HUD interaction process are established.For the interactive behavior“Pilots approaching with HUD”,four unsafe control actions and35 causal scenarios are identified and the impact of common performance conditions at different levels on the pilot decision model are analyzed.The results show that HUD's HCI level gradually improves as the scores of CPC increase,and the quality of crew member cooperation and time sufficiency of the task is the key to its HCI.Through case analysis,it is shown that STPACREAM can quantitatively assess the hazards in HCI and identify the key factors that impact safety.
基金supported by the National Key Research and Development Program of China(2021YFB3901205)National Institute of Natural Hazards,Ministry of Emergency Management of China(2023-JBKY-57)。
文摘The periphery of the Qinghai-Tibet Plateau is renowned for its susceptibility to landslides.However,the northwestern margin of this region,characterised by limited human activities and challenging transportation,remains insufficiently explored concerning landslide occurrence and dispersion.With the planning and construction of the Xinjiang-Xizang Railway,a comprehensive investigation into disastrous landslides in this area is essential for effective disaster preparedness and mitigation strategies.By using the human-computer interaction interpretation approach,the authors established a landslide database encompassing 13003 landslides,collectively spanning an area of 3351.24 km^(2)(36°N-40°N,73°E-78°E).The database incorporates diverse topographical and environmental parameters,including regional elevation,slope angle,slope aspect,distance to faults,distance to roads,distance to rivers,annual precipitation,and stratum.The statistical characteristics of number and area of landslides,landslide number density(LND),and landslide area percentage(LAP)are analyzed.The authors found that a predominant concentration of landslide origins within high slope angle regions,with the highest incidence observed in intervals characterised by average slopes of 20°to 30°,maximum slope angle above 80°,along with orientations towards the north(N),northeast(NE),and southwest(SW).Additionally,elevations above 4.5 km,distance to rivers below 1 km,rainfall between 20-30 mm and 30-40 mm emerge as particularly susceptible to landslide development.The study area’s geological composition primarily comprises Mesozoic and Upper Paleozoic outcrops.Both fault and human engineering activities have different degrees of influence on landslide development.Furthermore,the significance of the landslide database,the relationship between landslide distribution and environmental factors,and the geometric and morphological characteristics of landslides are discussed.The landslide H/L ratios in the study area are mainly concentrated between 0.4 and 0.64.It means the landslides mobility in the region is relatively low,and the authors speculate that landslides in this region more possibly triggered by earthquakes or located in meizoseismal area.
文摘With the popularity of new intelligent mobile devices in people’s lives,the development of mobile applications has paid increasing attention to the interactive experience of users.As the content of traditional Human-Computer Interaction(HCI)course and teaching material is out of date,it cannot meet the needs of mobile application interaction design and enterprises for students.Therefore,we need a new generation HCI course based on intelligent mobile devices to study the relationship between users and systems.The HCI course not only teaches students HCI theory and model,but also needs to cultivate students’interaction-oriented design practical ability.This paper proposes a set of HCI teaching material design and teaching methods for improving HCI class quality on mobile application interaction design,so as to make students more suitable for the employment requirements of enterprises.
基金supported by the China Fundamental Research Funds for the Central Universities(2022JBQY006)。
文摘Real-time train rescheduling plays a vital role in railway transportation as it is crucial for maintaining punctuality and reliability in rail operations.In this paper,we propose a rescheduling model that incorporates constraints and objectives generated through human-computer interaction.This approach ensures that the model is aligned with practical requirements and daily operational tasks while facilitating iterative train rescheduling.The dispatcher’s empirical knowledge is integrated into the train rescheduling process using a human-computer interaction framework.We introduce six interfaces to dynamically construct constraints and objectives that capture human intentions.By summarizing rescheduling rules,we devise a rule-based conflict detection-resolution heuristic algorithm to effectively solve the formulated model.A series of numerical experiments are presented,demonstrating strong performance across the entire system.Furthermore,theflexibility of rescheduling is enhanced through secondary analysis-driven solutions derived from the outcomes of humancomputer interactions in the previous step.This proposed interaction method complements existing literature on rescheduling methods involving human-computer interactions.It serves as a tool to aid dispatchers in identifying more feasible solutions in accordance with their empirical rescheduling strategies.
文摘Recent advancements in the Internet of Things IoT and cloud computing have paved the way for mobile Healthcare(mHealthcare)services.A patient within the hospital is monitored by several devices.Moreover,upon leaving the hospital,the patient can be remotely monitored whether directly using body wearable sensors or using a smartphone equipped with sensors to monitor different user-health parameters.This raises potential challenges for intelligent monitoring of patient's health.In this paper,an improved architecture for smart mHealthcare is proposed that is supported by HCI design principles.The HCI also provides the support for the User-Centric Design(UCD)for smart mHealthcare models.Furthermore,the HCI along with IoT's(Internet of Things)5-layered architecture has the potential of improving User Experience(UX)in mHealthcare design and help saving lives.The intelligent mHealthcare system is supported by the IoT sensing and communication layers and health care providers are supported by the application layer for the medical,behavioral,and health-related information.Health care providers and users are further supported by an intelligent layer performing critical situation assessment and performing a multi-modal communication using an intelligent assistant.The HCI design focuses on the ease-of-use,including user experience and safety,alarms,and error-resistant displays of the end-user,and improves user's experience and user satisfaction.
文摘Based on the traditional Human-Computer Interaction method which is mainly touch input system, the way of capturing the movement of people by using cameras is proposed. This is a convenient technique which can provide users more experience. In the article, a new way of detecting moving things is given on the basis of development of the image processing technique. The system architecture decides that the communication should be used between two different applications. After considered, named pipe is selected from many ways of communication to make sure that video is keeping in step with the movement from the analysis of the people moving. According to a large amount of data and principal knowledge, thinking of the need of actual project, a detailed system design and realization is finished. The system consists of three important modules: detecting of the people's movement, information transition between applications and video showing in step with people's movement. The article introduces the idea of each module and technique.
基金supported by the Tianjin Enterprise Science and Technology Commissioner Project(Grant No.23YDTPJC00740,Grant No.24YDTPJC00610)the Tianjin Tiankai Higher Education Science and Technology Innovation Park Enterprise R&D Special Project(Grant No.23YFZXYC00027).
文摘The shop floor dynamic scheduling system based on human-computer interaction is the use of computer-aided decision-making and human-computer interaction to solve the dynamic scheduling problem.A human-computer interaction interface based on Gantt chart is designed,which can not only comprehensively and quantitatively represent the scheduling process and scheduling scheme,but also have friendly human-computer interaction performance.The data transmission and interaction architecture is constructed to realize the rapid response to shop floor disturbance events.A priority calculation algorithm integrating priority rules and dispatcher preference is proposed,which realizes the automatic calculation of priority for the dispatcher's reference and reduces theirburden.A man-machine interactive shop floor dynamic scheduling strategy is proposed.When solving the dynamic flexible job shop scheduling problem caused by machine tool breakdown and urgent order,the origin moments obtained by using this strategy are 0.4190 and 0.3703 respectively.As can be seen from the origin moment indicator,the dynamic shop floor scheduling system based on the human-computer interaction is efficient and reliable in solving dynamic scheduling problems,and related strategies of this system are also feasible and stable.
基金the National Undergraduate Innovation Program Training Project(No.202110755022)。
文摘Triboelectric nanogenerator(TENG)converts mechanical energy into valuable electrical energy,offering a solution for future energy needs.As an indispensable part of TENG,textile TENG(T-TENG)has incredible advantages in harvesting biomechanical energy and physiological signal monitoring.However,the application of T-TENG is restricted,partly because the fabric structure parameter and structure on T-TENG performance have not been fully exploited.This study comprehensively investigates the effect of weaving structure on fabric TENGs(F-TENGs)for direct-weaving yarn TENGs and post-coating fabric TENGs.For direct-weaving F-TENGs,a single-yarn TENG(Y-TENG)with a core-sheath structure is fabricated using conductive yarn as the core layer yarn and polytetrafluoroethylene(PTFE)filaments as the sheath yarn.Twelve fabrics with five different sets of parameters were designed and investigated.For post-coating F-TENGs,fabrics with weaving structures of plain,twill,satin,and reinforced twill were fabricated and coated with conductive silver paint.Overall,the twill F-TENGs have the best electrical outputs,followed by the satin F-TENGs and plain weave F-TENGs.Besides,the increase of the Y-TENG gap spacing was demonstrated to improve the electrical output performance.Moreover,T-TENGs are demonstrated for human-computer interaction and self-powered real-time monitoring.This systematic work provides guidance for the future T-TENG’s design.
基金Education and Teaching Research Project of Beijing University of Technology(ER2024KCB08)。
文摘With the rapid development of artificial intelligence technology,AIGC(Artificial Intelligence-Generated Content)has triggered profound changes in the field of high-level language programming courses.This paper deeply explored the application principles,advantages,and limitations of AIGC in intelligent code generation,analyzed the new mode of human-computer collaboration in high-level language programming courses driven by AIGC,discussed the impact of human-computer collaboration on programming efficiency and code quality through practical case studies,and looks forward to future development trends.This research aims to provide theoretical and practical guidance for high-level language programming courses and promote innovative development of high-level language programming courses under the human-computer collaboration paradigm.
基金The author Dr.Arshiya S.Ansari extends the appreciation to the Deanship of Postgraduate Studies and Scientific Research at Majmaah University for funding this research work through the project number(R-2025-1538).
文摘Voice, motion, and mimicry are naturalistic control modalities that have replaced text or display-driven control in human-computer communication (HCC). Specifically, the vocals contain a lot of knowledge, revealing details about the speaker’s goals and desires, as well as their internal condition. Certain vocal characteristics reveal the speaker’s mood, intention, and motivation, while word study assists the speaker’s demand to be understood. Voice emotion recognition has become an essential component of modern HCC networks. Integrating findings from the various disciplines involved in identifying vocal emotions is also challenging. Many sound analysis techniques were developed in the past. Learning about the development of artificial intelligence (AI), and especially Deep Learning (DL) technology, research incorporating real data is becoming increasingly common these days. Thus, this research presents a novel selfish herd optimization-tuned long/short-term memory (SHO-LSTM) strategy to identify vocal emotions in human communication. The RAVDESS public dataset is used to train the suggested SHO-LSTM technique. Mel-frequency cepstral coefficient (MFCC) and wiener filter (WF) techniques are used, respectively, to remove noise and extract features from the data. LSTM and SHO are applied to the extracted data to optimize the LSTM network’s parameters for effective emotion recognition. Python Software was used to execute our proposed framework. In the finding assessment phase, Numerous metrics are used to evaluate the proposed model’s detection capability, Such as F1-score (95%), precision (95%), recall (96%), and accuracy (97%). The suggested approach is tested on a Python platform, and the SHO-LSTM’s outcomes are contrasted with those of other previously conducted research. Based on comparative assessments, our suggested approach outperforms the current approaches in vocal emotion recognition.
文摘Videogames feature non-player-characters. Such ingame entities are controlled by artificial intelligence that is sought to match the user＇s skill. Defining and understanding the given human-computer-interaction videogame genres can be differentiated in either competitive matches or coherent plays. While artificial intelligence answers in responsive patterns only, natural intelligence holds creative qualities. A match is a game that creates suspense over the question of who is going to prevail. It can thus only be a game that features competing human players, since a computerized opponent is unaware of the game＇s significance. The nature of the match lies within the interactive trial. In a play, however, there is no battle but only cooperation. The aesthetics of such a play unfold to the audience, its purpose is showing rather than experiencing and/or competitively interacting. Artificial intelligence is then a surrogate that is often used in videogames to create an illusion of competition or battle. Its actual purpose is not to feature a worthy opponent, but to be a programmatic loser. In narrative and linear videogames, such as AI takes the role of a supporting actor whose function in the plot is, to signalize the player＇s dominance.
基金supported by the Guizhou Provincial Science and Technology Foundation(No.ZK[2022]General 112)the National Natural Science Foundation of China(No.42267009).
文摘Human-machine interactions(HMIs)have advanced rapidly in recent decades in the fields of healthcare,work,and life.However,people with disabilities and other mobility problems do not have corresponding high-tech aids for them to enjoy the convenience of HMIs.In this paper,we propose a sensor with a wave-shaped(corrugated)electrode embedded in a friction layer,which exhibits high sensitivity to skin fold excitation and enormous potential in HMIs.Attributing to the wave-shaped electrode design,it has no built-in cavities,and its small size allows it to flexibly cope with folds at different angles.By specifying the carbon nanotube hybrid silicone film as the electrode layer material and silicone film as the friction layer,good electrical output performance,tensile properties,and biocompatibility can be achieved.Then,the sensor is tested on various joints and skin folds of the human body,the output signals of which can be distinguished between normal physiological behavior and test behavior.Based on this sensor,we designed a medical alarm system,a robotic arm assistive system,and a cell phone application control system for the disabled to help them in the fields of healthcare,work,and life.In conclusion,our research presents a feasible technology to enhance HMIs and makes a valuable contribution to the development of high-tech aids for the disabled.
文摘Augmented Reality is a technique that allows users to overlap digital information with their physical world.The Augmented Reality(AR)displays have an exceptional characteristic from the Human–Computer Interaction(HCI)perspective.Due to its increasing popularity and application in diverse domains,increasing user-friendliness and AR usage are critical.Context-aware is one approach since an AR application can adapt to the user,environment,needs and enhance ergonomic principles and functionality.This paper proposes the Intelligent Contextaware Augmented Reality Model(ICAARM)for Human–Computer Interaction systems.This study explores and reduces interaction uncertainty by semantically modeling user-specific interaction with context,allowing personalised interaction.Sensory information is captured from an AR device to understand user interactions and context.These depictions carry semantics to Augmented Reality applications about the user’s intention to interact with a specific device affordance.Thus,this study describes personalised gesture interaction in VR/AR applications for immersive/intelligent environments.
基金supported by the National Key R&D Program of China(Grant No.2023YFA1406200)the National Natural Science Foundation of China(No.12274177 and 12304261)the China Postdoctoral Science Foundation(No.2024M751076)。
文摘Luminescent metal-organic frameworks(MOFs)have garnered significant attention due to their structural tunability and potential applications in solid-state lighting,bioimaging,sensing,anticounterfeiting,and other fields.Nevertheless,due to the tendency of1,4-benzenedicarboxylic acid(BDC)to rotate within the framework,MOFs composed of it exhibit significant non-radiative energy dissipation and thus impair the emissive properties.In this study,efficient luminescence of MIL-140A nanocrystals(NCs)with BDC rotors as ligands is achieved by pressure treatment strategy.Pressure treatment effectively modulates the pore structure of the framework,enhancing the interactions between the N,N-dimethylformamide vip molecules and the BDC ligands.The enhanced host-vip interaction contributes to the structural rigidity of the MOF,thereby suppressing the rotation-induced excited-state energy loss.As a result,the pressure-treated MIL-140A NCs displayed bright blue-light emission,with the photoluminescence quantum yield increasing from an initial 6.8%to 69.2%.This study developed an effective strategy to improve the luminescence performance of rotor ligand MOFs,offers a new avenue for the rational design and synthesis of MOFs with superior luminescent properties.
基金Supported by the Natienal Natural Science Foundation of China(U23A20287).
文摘Background Haptic feedback plays a crucial role in virtual reality(VR)interaction,helping to improve the precision of user operation and enhancing the immersion of the user experience.Instrumental haptic feedback in virtual environments is primarily realized using grounded force or vibration feedback devices.However,improvements are required in terms of the active space and feedback realism.Methods We propose a lightweight and flexible haptic feedback glove that can haptically render objects in VR environments via kinesthetic and vibration feedback,thereby enabling users to enjoy a rich virtual piano-playing experience.The kinesthetic feedback of the glove relies on a cable-pulling mechanism that rotates the mechanism and pulls the two cables connected to it,thereby changing the amount of force generated to simulate the hardness or softness of the object.Vibration feedback is provided by small vibration motors embedded in the bottom of the fingertips of the glove.We designed a piano-playing scenario in the virtual environment and conducted user tests.The evaluation metrics were clarity,realism,enjoyment,and satisfaction.Results A total of 14 subjects participated in the test,and the results showed that our proposed glove scored significantly higher on the four evaluation metrics than the nofeedback and vibration feedback methods.Conclusions Our proposed glove significantly enhances the user experience when interacting with virtual objects.
基金This project is supported by Provincial ScienceTechnology Foundation of Liaoning (No. 20022132)
文摘Optimization design of hydraulic manifold blocks (HMB) is studied as acomplex solid spatial layout problem. Based on comprehensive research into structure features anddesign rules of HMB, an optimal mathematical model for this problem is presented. Usinghuman-computer cooperative genetic algorithm (GA) and its hybrid optitation strategies, integratedlayout and connection design schemes of HMB can be automatically optimized. An example is given totestify it.
基金This project is supported by National Natural Science Foundation of China (No.59990470-2).
文摘The cooperative work between human being and computer based on virtual reality (VR) is investigated to plan the disassembly sequences more efficiently. A three-layer model of human-computer cooperative virtual disassembly is built, and the corresponding human-computer system for stable virtual disassembly is developed. In this system, an immersive and interactive virtual disassembly environment has been created to provide planners with a more visual working scene. For cooperative disassembly, an intelligent module of stability analysis of disassembly operations is embedded into the human-computer system to assist planners to implement disassembly tasks better. The supporting matrix for stability analysis of disassembly operations is defined and the method of stability analysis is detailed. Based on the approach, the stability of any disassembly operation can be analyzed to instruct the manual virtual disassembly. At last, a disassembly case in the virtual environment is given to prove the validity of above ideas.
