In recent years,railway construction in China has developed vigorously.With continuous improvements in the highspeed railway network,the focus is gradually shifting from large-scale construction to large-scale operati...In recent years,railway construction in China has developed vigorously.With continuous improvements in the highspeed railway network,the focus is gradually shifting from large-scale construction to large-scale operations.However,several challenges have emerged within the high-speed railway dispatching and command system,including the heavy workload faced by dispatchers,the difficulty of quantifying subjective expertise,and the need for effective training of professionals.Amid the growing application of artificial intelligence technologies in railway systems,this study leverages Large Language Model(LLM)technology.LLMs bring enhanced intelligence,predictive capabilities,robust memory,and adaptability to diverse real-world scenarios.This study proposes a human-computer interactive intelligent scheduling auxiliary training system built on LLM technology.The system offers capabilities including natural dialogue,knowledge reasoning,and human feedback learning.With broad applicability,the system is suitable for vocational education,guided inquiry,knowledge-based Q&A,and other training scenarios.Validation results demonstrate its effectiveness in auxiliary training,providing substantial support for educators,students,and dispatching personnel in colleges and professional settings.展开更多
The shop floor dynamic scheduling system based on human-computer interaction is the use of computer-aided decision-making and human-computer interaction to solve the dynamic scheduling problem.A human-computer interac...The shop floor dynamic scheduling system based on human-computer interaction is the use of computer-aided decision-making and human-computer interaction to solve the dynamic scheduling problem.A human-computer interaction interface based on Gantt chart is designed,which can not only comprehensively and quantitatively represent the scheduling process and scheduling scheme,but also have friendly human-computer interaction performance.The data transmission and interaction architecture is constructed to realize the rapid response to shop floor disturbance events.A priority calculation algorithm integrating priority rules and dispatcher preference is proposed,which realizes the automatic calculation of priority for the dispatcher's reference and reduces theirburden.A man-machine interactive shop floor dynamic scheduling strategy is proposed.When solving the dynamic flexible job shop scheduling problem caused by machine tool breakdown and urgent order,the origin moments obtained by using this strategy are 0.4190 and 0.3703 respectively.As can be seen from the origin moment indicator,the dynamic shop floor scheduling system based on the human-computer interaction is efficient and reliable in solving dynamic scheduling problems,and related strategies of this system are also feasible and stable.展开更多
Based on the traditional Human-Computer Interaction method which is mainly touch input system, the way of capturing the movement of people by using cameras is proposed. This is a convenient technique which can provide...Based on the traditional Human-Computer Interaction method which is mainly touch input system, the way of capturing the movement of people by using cameras is proposed. This is a convenient technique which can provide users more experience. In the article, a new way of detecting moving things is given on the basis of development of the image processing technique. The system architecture decides that the communication should be used between two different applications. After considered, named pipe is selected from many ways of communication to make sure that video is keeping in step with the movement from the analysis of the people moving. According to a large amount of data and principal knowledge, thinking of the need of actual project, a detailed system design and realization is finished. The system consists of three important modules: detecting of the people's movement, information transition between applications and video showing in step with people's movement. The article introduces the idea of each module and technique.展开更多
Interactive picking is a fundamental task for processing and images. Combining two-dimensional （2D） and three-dimensional digital graphics （3D） views is an important trend in processing medical sliced-geometries. ...Interactive picking is a fundamental task for processing and images. Combining two-dimensional （2D） and three-dimensional digital graphics （3D） views is an important trend in processing medical sliced-geometries. With the goal of accurately picking points in sliced-geometries, we present a method to pick points interactively by combining 2D and 3D views of sliced-geometries. Four view windows are constructed to render sliced-geometries using medical imaging interaction toolkit （MITK）： three for 2D slices parallel to the XY, YZ, and XZ planes and one for surface rendering. Points picked in a view window can be rendered and modified in any window. After a point is picked, it is immediately converted into a world coordinate and stored. Points are only rendered and modified based on their world coordinates. This picking method can be used for fitting, observing, and measuring local regions. This method can also be used for interactive segments. Our experiment shows that the picking method is accurate and has a real-time picking effect.展开更多
Recently,vision-based gesture recognition(VGR)has become a hot research spot in human-computer interaction(HCI).Unlike other gesture recognition methods with data gloves or other wearable sensors,vision-based gesture ...Recently,vision-based gesture recognition(VGR)has become a hot research spot in human-computer interaction(HCI).Unlike other gesture recognition methods with data gloves or other wearable sensors,vision-based gesture recognition could lead to more natural and intuitive HCI interactions.This paper reviews the state-of-the-art vision-based gestures recognition methods,from different stages of gesture recognition process,i.e.,(1)image acquisition and pre-processing,(2)gesture segmentation,(3)gesture tracking,(4)feature extraction,and(5)gesture classification.This paper also analyzes the advantages and disadvantages of these various methods in detail.Finally,the challenges of vision-based gesture recognition in haptic rendering and future research directions are discussed.展开更多
To solve the problem of risk identification and quantitative assessment for human-computer interaction(HCI)in complex avionics systems,an HCI safety analysis framework based on system-theoretical process analysis(STPA...To solve the problem of risk identification and quantitative assessment for human-computer interaction(HCI)in complex avionics systems,an HCI safety analysis framework based on system-theoretical process analysis(STPA)and cognitive reliability and error analysis method(CREAM)is proposed.STPACREAM can identify unsafe control actions and find the causal path during the interaction of avionics systems and pilot with the help of formal verification tools automatically.The common performance conditions(CPC)of avionics systems in the aviation environment is established and a quantitative analysis of human failure is carried out.Taking the head-up display(HUD)system interaction process as an example,a case analysis is carried out,the layered safety control structure and formal model of the HUD interaction process are established.For the interactive behavior“Pilots approaching with HUD”,four unsafe control actions and35 causal scenarios are identified and the impact of common performance conditions at different levels on the pilot decision model are analyzed.The results show that HUD's HCI level gradually improves as the scores of CPC increase,and the quality of crew member cooperation and time sufficiency of the task is the key to its HCI.Through case analysis,it is shown that STPACREAM can quantitatively assess the hazards in HCI and identify the key factors that impact safety.展开更多
Real-time train rescheduling plays a vital role in railway transportation as it is crucial for maintaining punctuality and reliability in rail operations.In this paper,we propose a rescheduling model that incorporates...Real-time train rescheduling plays a vital role in railway transportation as it is crucial for maintaining punctuality and reliability in rail operations.In this paper,we propose a rescheduling model that incorporates constraints and objectives generated through human-computer interaction.This approach ensures that the model is aligned with practical requirements and daily operational tasks while facilitating iterative train rescheduling.The dispatcher’s empirical knowledge is integrated into the train rescheduling process using a human-computer interaction framework.We introduce six interfaces to dynamically construct constraints and objectives that capture human intentions.By summarizing rescheduling rules,we devise a rule-based conflict detection-resolution heuristic algorithm to effectively solve the formulated model.A series of numerical experiments are presented,demonstrating strong performance across the entire system.Furthermore,theflexibility of rescheduling is enhanced through secondary analysis-driven solutions derived from the outcomes of humancomputer interactions in the previous step.This proposed interaction method complements existing literature on rescheduling methods involving human-computer interactions.It serves as a tool to aid dispatchers in identifying more feasible solutions in accordance with their empirical rescheduling strategies.展开更多
The periphery of the Qinghai-Tibet Plateau is renowned for its susceptibility to landslides.However,the northwestern margin of this region,characterised by limited human activities and challenging transportation,remai...The periphery of the Qinghai-Tibet Plateau is renowned for its susceptibility to landslides.However,the northwestern margin of this region,characterised by limited human activities and challenging transportation,remains insufficiently explored concerning landslide occurrence and dispersion.With the planning and construction of the Xinjiang-Xizang Railway,a comprehensive investigation into disastrous landslides in this area is essential for effective disaster preparedness and mitigation strategies.By using the human-computer interaction interpretation approach,the authors established a landslide database encompassing 13003 landslides,collectively spanning an area of 3351.24 km^(2)(36°N-40°N,73°E-78°E).The database incorporates diverse topographical and environmental parameters,including regional elevation,slope angle,slope aspect,distance to faults,distance to roads,distance to rivers,annual precipitation,and stratum.The statistical characteristics of number and area of landslides,landslide number density(LND),and landslide area percentage(LAP)are analyzed.The authors found that a predominant concentration of landslide origins within high slope angle regions,with the highest incidence observed in intervals characterised by average slopes of 20°to 30°,maximum slope angle above 80°,along with orientations towards the north(N),northeast(NE),and southwest(SW).Additionally,elevations above 4.5 km,distance to rivers below 1 km,rainfall between 20-30 mm and 30-40 mm emerge as particularly susceptible to landslide development.The study area’s geological composition primarily comprises Mesozoic and Upper Paleozoic outcrops.Both fault and human engineering activities have different degrees of influence on landslide development.Furthermore,the significance of the landslide database,the relationship between landslide distribution and environmental factors,and the geometric and morphological characteristics of landslides are discussed.The landslide H/L ratios in the study area are mainly concentrated between 0.4 and 0.64.It means the landslides mobility in the region is relatively low,and the authors speculate that landslides in this region more possibly triggered by earthquakes or located in meizoseismal area.展开更多
With the popularity of new intelligent mobile devices in people’s lives,the development of mobile applications has paid increasing attention to the interactive experience of users.As the content of traditional Human-...With the popularity of new intelligent mobile devices in people’s lives,the development of mobile applications has paid increasing attention to the interactive experience of users.As the content of traditional Human-Computer Interaction(HCI)course and teaching material is out of date,it cannot meet the needs of mobile application interaction design and enterprises for students.Therefore,we need a new generation HCI course based on intelligent mobile devices to study the relationship between users and systems.The HCI course not only teaches students HCI theory and model,but also needs to cultivate students’interaction-oriented design practical ability.This paper proposes a set of HCI teaching material design and teaching methods for improving HCI class quality on mobile application interaction design,so as to make students more suitable for the employment requirements of enterprises.展开更多
Due to the narrowness of space and the complexity of structure,the assembly of aircraft cabin has become one of the major bottlenecks in the whole manufacturing process.To solve the problem,at the beginning of aircraf...Due to the narrowness of space and the complexity of structure,the assembly of aircraft cabin has become one of the major bottlenecks in the whole manufacturing process.To solve the problem,at the beginning of aircraft design,the different stages of the lifecycle of aircraft must be thought about,which include the trial manufacture,assembly,maintenance,recycling and destruction of the product.Recently,thanks to the development of the virtual reality and augmented reality,some low-cost and fast solutions are found for the product assembly.This paper presents a mixed reality-based interactive technology for the aircraft cabin assembly,which can enhance the efficiency of the assemblage in a virtual environment in terms of vision,information and operation.In the mixed reality-based assembly environment,the physical scene can be obtained by a camera and then generated by a computer.The virtual parts,the features of visual assembly,the navigation information,the physical parts and the physical assembly environment will be mixed and presented in the same assembly scene.The mixed or the augmented information will provide some assembling information as a detailed assembly instruction in the mixed reality-based assembly environment.Constraint proxy and its match rules help to reconstruct and visualize the restriction relationship among different parts,and to avoid the complex calculation of constraint's match.Finally,a desktop prototype system of virtual assembly has been built to assist the assembly verification and training with the virtual hand.展开更多
Two DNA fragments encoding PDZ domain （21-110 residues） and BAR domain （ 150-360 residues） from PICK1 （1-416 residues） were amplified by PCR and then introduced into vectors, pET-32M and pMAL-e2X respectively to...Two DNA fragments encoding PDZ domain （21-110 residues） and BAR domain （ 150-360 residues） from PICK1 （1-416 residues） were amplified by PCR and then introduced into vectors, pET-32M and pMAL-e2X respectively to generate recombinant plasmids, pE-pdz and pM-bar. Having been separately transferred into the hosts E. coli BL21 and E. coli JM109, these two strains can express fusion proteins： His-tagged PDZ（PDZ domain） and maltose binding protein-BAR（ MBP-BAR domain） respectively, as confirmed by both SDS-PAGE and Wostem blotting. The interaction between these two domains is dose-dependence, as identified by a pull-down test. Moreover, it has been shown from the ELISA analysis that the actual amount of PDZ bound to MBP-BAR-amylose beads reaches （ 16 ± 0. 5）%, as calculated by the molar ratio of PDZ to MBP-BAR. In addition, the interaction between BAR（bait） and PDZ（prey） in vivo was also examined with a yeast two-hybrid system.展开更多
To improve the human-physical-virtual coordination and integration of the digital twin workshop,3D visual monitoring and human-computer interaction of the digital twin workshop was studied.First,a novel 6D model of th...To improve the human-physical-virtual coordination and integration of the digital twin workshop,3D visual monitoring and human-computer interaction of the digital twin workshop was studied.First,a novel 6D model of the 3D visualization interactive system for digital twin workshops is proposed.As the traditional 5D digital twin model ignores the importance of human-computer interaction,a new dimension of the user terminal was added.A hierarchical real-time data-driven mapping model for the workshop production process is then proposed.Moreover,a real-time data acquisition method for the industrial Internet of things is proposed based on OPC UA(object linking and embedding for process control unified architecture).Based on the 6D model of the system,the process of creating a 3D visualization virtual environment based on virtual reality is introduced,in addition to a data-driven process based on the data management cloud platform.Finally,the 6D model of the system was confirmed using the blade rotor test workshop as the object,and a 3D visualization interactive system is developed.The results show that the system is more transparent,real-time,data-driven and more efficient,as well as promotes the coordination and integration of human-physical-virtual,which has practical significance for developing digital twin workshops.展开更多
Background With an increasing number of vehicles becoming autonomous,intelligent,and connected,paying attention to the future usage of car human-machine interface with these vehicles should become more relevant.Severa...Background With an increasing number of vehicles becoming autonomous,intelligent,and connected,paying attention to the future usage of car human-machine interface with these vehicles should become more relevant.Several studies have addressed car HMI but were less attentive to designing and implementing interactive glazing for every day(autonomous)driving contexts.Methods Reflecting on the literature,we describe an engineering psychology practice and the design of six novel future user scenarios,which envision the application of a specific set of augmented reality(AR)support user interactions.Additionally,we conduct evaluations on specific scenarios and experiential prototypes,which reveal that these AR scenarios aid the target user groups in experiencing a new type of interaction.The overall evaluation is positive with valuable assessment results and suggestions.Conclusions This study can interest applied psychology educators who aspire to teach how AR can be operationalized in a human-centered design process to students with minimal pre-existing expertise or minimal scientific knowledge in engineering psychology.展开更多
Background Haptic feedback plays a crucial role in virtual reality(VR)interaction,helping to improve the precision of user operation and enhancing the immersion of the user experience.Instrumental haptic feedback in v...Background Haptic feedback plays a crucial role in virtual reality(VR)interaction,helping to improve the precision of user operation and enhancing the immersion of the user experience.Instrumental haptic feedback in virtual environments is primarily realized using grounded force or vibration feedback devices.However,improvements are required in terms of the active space and feedback realism.Methods We propose a lightweight and flexible haptic feedback glove that can haptically render objects in VR environments via kinesthetic and vibration feedback,thereby enabling users to enjoy a rich virtual piano-playing experience.The kinesthetic feedback of the glove relies on a cable-pulling mechanism that rotates the mechanism and pulls the two cables connected to it,thereby changing the amount of force generated to simulate the hardness or softness of the object.Vibration feedback is provided by small vibration motors embedded in the bottom of the fingertips of the glove.We designed a piano-playing scenario in the virtual environment and conducted user tests.The evaluation metrics were clarity,realism,enjoyment,and satisfaction.Results A total of 14 subjects participated in the test,and the results showed that our proposed glove scored significantly higher on the four evaluation metrics than the nofeedback and vibration feedback methods.Conclusions Our proposed glove significantly enhances the user experience when interacting with virtual objects.展开更多
Existing rehabilitation exoskeleton robots suffer from poor compatibility with the human limb coupling method,large internal power loss,and poor wearable performance,which seriously affect the rehabilitation ability o...Existing rehabilitation exoskeleton robots suffer from poor compatibility with the human limb coupling method,large internal power loss,and poor wearable performance,which seriously affect the rehabilitation ability of these robots.Therefore,this study proposes a variable stiffness humancomputer interaction contact unit module(VSHCUM)based on the granular jamming mechanism.It is characterized by a double-layer chamber structure:the inner layer is a granular chamber,and the outer layer is an air chamber.The interaction force is transmitted by embedding a rigid support in the inner layer.Unlike the common flexible-belt interactive contact unit,when the exoskeleton is bound to the patient's limb,vSHCUM can realize adaptive fitting of the patient's limb shape using the pressure change in the double-chamber structure.Simultaneously,by adjusting the vacuum level of the granular chamber,the stiffness of the interactive contact unit can be adjusted by a factor of more than five,and the internal work loss caused by self-pulling deformation during the auxiliary force transfer process can be reduced.展开更多
蛋白质是生命功能的执行者.生命体中某些关键蛋白的功能异常往往是导致疾病发生的根本原因.这些疾病相关蛋白极有可能成为药物靶点,为新药研发和疾病治疗提供重要线索.PICK1蛋白(protein interacting with Cαkinase1)结合能力广泛、功...蛋白质是生命功能的执行者.生命体中某些关键蛋白的功能异常往往是导致疾病发生的根本原因.这些疾病相关蛋白极有可能成为药物靶点,为新药研发和疾病治疗提供重要线索.PICK1蛋白(protein interacting with Cαkinase1)结合能力广泛、功能多样以及在多种重要疾病(如:癌症、精神分裂症、疼痛、帕金森综合症等)的发生发展过程中发挥潜在的作用,使其成为一个可能的药靶蛋白.PICK1与绝大多数配体蛋白的相互作用是通过其PDZ结构域与配体C末端区域的结合介导的,使PICK1的PDZ结构域成为一个潜在的药物靶点.因此,可以利用生物小分子物质特异性地结合PICK1的PDZ结构域,干扰或阻断PICK1与配体蛋白的天然相互作用,最终达到治疗相关疾病的目的.展开更多
Numerous sectors,such as education,the IT sector,and corporate organizations,transitioned to virtual meetings after the COVID-19 crisis.Organizations now seek to assess participants’fatigue levels in online meetings ...Numerous sectors,such as education,the IT sector,and corporate organizations,transitioned to virtual meetings after the COVID-19 crisis.Organizations now seek to assess participants’fatigue levels in online meetings to remain competitive.Instructors cannot effectively monitor every individual in a virtual environment,which raises significant concerns about participant fatigue.Our proposed system monitors fatigue,identifying attentive and drowsy individuals throughout the online session.We leverage Dlib’s pre-trained facial landmark detector and focus on the eye landmarks only,offering a more detailed analysis for predicting eye opening and closing of the eyes,rather than focusing on the entire face.We introduce an Eye Polygon Area(EPA)formula,which computes eye activity from Dlib eye landmarks by measuring the polygonal area of the eye opening.Unlike the Eye Aspect Ratio(EAR),which relies on a single distance ratio,EPA adapts to different eye shapes(round,narrow,or wide),providing a more reliable measure for fatigue detection.The VMFD system issues a warning if a participant remains in a fatigued condition for 36 consecutive frames.The proposed technology is tested under multiple scenarios,including low-to high-lighting conditions(50-1400 lux)and both with and without glasses.This study builds an OpenCV application in Python,evaluated using the iBUG 300-W dataset,achieving 97.5%accuracy in detecting active participants.We compare VMFD with conventional methods relying on the EAR and show that the EPA technique performs significantly better.展开更多
Text and speech processing technologies encounter bottlenecks in understanding complex emotions within Human-Computer Interaction(HCI),with significant limitations particularly in the semantic parsing of intonation an...Text and speech processing technologies encounter bottlenecks in understanding complex emotions within Human-Computer Interaction(HCI),with significant limitations particularly in the semantic parsing of intonation and tone.This paper employs a literature review approach to systematically synthesize core advancements in applied psychology and speech recognition technology within HCI,focusing on the intersection of emotion recognition technology and psychological intervention scenarios.The study indicates that the deep integration of these fields can significantly enhance intervention precision,especially in scenarios such as psychological diagnosis in children(e.g.,emotion recognition in autism)and personalized Cognitive Behavioral Therapy(CBT)guidance.The research further points out that Artificial Intelligence(AI)has not yet fully grasped complex human emotions,necessitating the deeper embedding of psychological theories into speech emotion analysis frameworks to improve the ability to interpret semantically ambiguous expressions.This review provides a theoretical framework and a practical pathway for the application of AI technology and applied psychology in intelligent HCI.展开更多
To improve the accuracy and interactivity of soft tissue delormatlon simulation, a new plate spring model based on physics is proposed. The model is parameterized and thus can be adapted to simulate different organs. ...To improve the accuracy and interactivity of soft tissue delormatlon simulation, a new plate spring model based on physics is proposed. The model is parameterized and thus can be adapted to simulate different organs. Different soft tissues are modeled by changing the width, number of pieces, thickness, and length of a single plate spring. In this paper, the structural design, calcula- tion of soft tissue deformation and real-time feedback operations of our system are also introduced. To evaluate the feasibility of the system and validate the model, an experimental system of haptic in- teraction, in which users can use virtual hands to pull virtual brain tissues, is built using PHANTOM OMNI devices. Experimental results show that the proposed system is stable, accurate and promising for modeling instantaneous soft tissue deformation.展开更多
基金the Talent Fund of Beijing Jiaotong University(Grant No.2024XKRC055).
文摘In recent years,railway construction in China has developed vigorously.With continuous improvements in the highspeed railway network,the focus is gradually shifting from large-scale construction to large-scale operations.However,several challenges have emerged within the high-speed railway dispatching and command system,including the heavy workload faced by dispatchers,the difficulty of quantifying subjective expertise,and the need for effective training of professionals.Amid the growing application of artificial intelligence technologies in railway systems,this study leverages Large Language Model(LLM)technology.LLMs bring enhanced intelligence,predictive capabilities,robust memory,and adaptability to diverse real-world scenarios.This study proposes a human-computer interactive intelligent scheduling auxiliary training system built on LLM technology.The system offers capabilities including natural dialogue,knowledge reasoning,and human feedback learning.With broad applicability,the system is suitable for vocational education,guided inquiry,knowledge-based Q&A,and other training scenarios.Validation results demonstrate its effectiveness in auxiliary training,providing substantial support for educators,students,and dispatching personnel in colleges and professional settings.
基金supported by the Tianjin Enterprise Science and Technology Commissioner Project(Grant No.23YDTPJC00740,Grant No.24YDTPJC00610)the Tianjin Tiankai Higher Education Science and Technology Innovation Park Enterprise R&D Special Project(Grant No.23YFZXYC00027).
文摘The shop floor dynamic scheduling system based on human-computer interaction is the use of computer-aided decision-making and human-computer interaction to solve the dynamic scheduling problem.A human-computer interaction interface based on Gantt chart is designed,which can not only comprehensively and quantitatively represent the scheduling process and scheduling scheme,but also have friendly human-computer interaction performance.The data transmission and interaction architecture is constructed to realize the rapid response to shop floor disturbance events.A priority calculation algorithm integrating priority rules and dispatcher preference is proposed,which realizes the automatic calculation of priority for the dispatcher's reference and reduces theirburden.A man-machine interactive shop floor dynamic scheduling strategy is proposed.When solving the dynamic flexible job shop scheduling problem caused by machine tool breakdown and urgent order,the origin moments obtained by using this strategy are 0.4190 and 0.3703 respectively.As can be seen from the origin moment indicator,the dynamic shop floor scheduling system based on the human-computer interaction is efficient and reliable in solving dynamic scheduling problems,and related strategies of this system are also feasible and stable.
文摘Based on the traditional Human-Computer Interaction method which is mainly touch input system, the way of capturing the movement of people by using cameras is proposed. This is a convenient technique which can provide users more experience. In the article, a new way of detecting moving things is given on the basis of development of the image processing technique. The system architecture decides that the communication should be used between two different applications. After considered, named pipe is selected from many ways of communication to make sure that video is keeping in step with the movement from the analysis of the people moving. According to a large amount of data and principal knowledge, thinking of the need of actual project, a detailed system design and realization is finished. The system consists of three important modules: detecting of the people's movement, information transition between applications and video showing in step with people's movement. The article introduces the idea of each module and technique.
文摘Interactive picking is a fundamental task for processing and images. Combining two-dimensional （2D） and three-dimensional digital graphics （3D） views is an important trend in processing medical sliced-geometries. With the goal of accurately picking points in sliced-geometries, we present a method to pick points interactively by combining 2D and 3D views of sliced-geometries. Four view windows are constructed to render sliced-geometries using medical imaging interaction toolkit （MITK）： three for 2D slices parallel to the XY, YZ, and XZ planes and one for surface rendering. Points picked in a view window can be rendered and modified in any window. After a point is picked, it is immediately converted into a world coordinate and stored. Points are only rendered and modified based on their world coordinates. This picking method can be used for fitting, observing, and measuring local regions. This method can also be used for interactive segments. Our experiment shows that the picking method is accurate and has a real-time picking effect.
基金Supported by the National Natural Science Foundation of China(61773205,61773219)the Fundamental Research Funds for the Central Universities(NS2016032,NS2019018,Nanjing University of Aeronautics and Astronautics)+1 种基金the Scholarship from China Scholarship Council(201906835020)the Fundamental Research Funds for the Central Universities(the Graduate Student Innovation Base Open Fund Project of NUAA,kfjj20190307)。
文摘Recently,vision-based gesture recognition(VGR)has become a hot research spot in human-computer interaction(HCI).Unlike other gesture recognition methods with data gloves or other wearable sensors,vision-based gesture recognition could lead to more natural and intuitive HCI interactions.This paper reviews the state-of-the-art vision-based gestures recognition methods,from different stages of gesture recognition process,i.e.,(1)image acquisition and pre-processing,(2)gesture segmentation,(3)gesture tracking,(4)feature extraction,and(5)gesture classification.This paper also analyzes the advantages and disadvantages of these various methods in detail.Finally,the challenges of vision-based gesture recognition in haptic rendering and future research directions are discussed.
基金supported by the National Key Research and Development Program of China(2021YFB1600601)the Joint Funds of the National Natural Science Foundation of China and the Civil Aviation Administration of China(U1933106)+2 种基金the Scientific Research Project of Tianjin Educational Committee(2019KJ134)the Natural Science Foundation of TianjinIntelligent Civil Aviation Program(21JCQNJ C00900)。
文摘To solve the problem of risk identification and quantitative assessment for human-computer interaction(HCI)in complex avionics systems,an HCI safety analysis framework based on system-theoretical process analysis(STPA)and cognitive reliability and error analysis method(CREAM)is proposed.STPACREAM can identify unsafe control actions and find the causal path during the interaction of avionics systems and pilot with the help of formal verification tools automatically.The common performance conditions(CPC)of avionics systems in the aviation environment is established and a quantitative analysis of human failure is carried out.Taking the head-up display(HUD)system interaction process as an example,a case analysis is carried out,the layered safety control structure and formal model of the HUD interaction process are established.For the interactive behavior“Pilots approaching with HUD”,four unsafe control actions and35 causal scenarios are identified and the impact of common performance conditions at different levels on the pilot decision model are analyzed.The results show that HUD's HCI level gradually improves as the scores of CPC increase,and the quality of crew member cooperation and time sufficiency of the task is the key to its HCI.Through case analysis,it is shown that STPACREAM can quantitatively assess the hazards in HCI and identify the key factors that impact safety.
基金supported by the China Fundamental Research Funds for the Central Universities(2022JBQY006)。
文摘Real-time train rescheduling plays a vital role in railway transportation as it is crucial for maintaining punctuality and reliability in rail operations.In this paper,we propose a rescheduling model that incorporates constraints and objectives generated through human-computer interaction.This approach ensures that the model is aligned with practical requirements and daily operational tasks while facilitating iterative train rescheduling.The dispatcher’s empirical knowledge is integrated into the train rescheduling process using a human-computer interaction framework.We introduce six interfaces to dynamically construct constraints and objectives that capture human intentions.By summarizing rescheduling rules,we devise a rule-based conflict detection-resolution heuristic algorithm to effectively solve the formulated model.A series of numerical experiments are presented,demonstrating strong performance across the entire system.Furthermore,theflexibility of rescheduling is enhanced through secondary analysis-driven solutions derived from the outcomes of humancomputer interactions in the previous step.This proposed interaction method complements existing literature on rescheduling methods involving human-computer interactions.It serves as a tool to aid dispatchers in identifying more feasible solutions in accordance with their empirical rescheduling strategies.
基金supported by the National Key Research and Development Program of China(2021YFB3901205)National Institute of Natural Hazards,Ministry of Emergency Management of China(2023-JBKY-57)。
文摘The periphery of the Qinghai-Tibet Plateau is renowned for its susceptibility to landslides.However,the northwestern margin of this region,characterised by limited human activities and challenging transportation,remains insufficiently explored concerning landslide occurrence and dispersion.With the planning and construction of the Xinjiang-Xizang Railway,a comprehensive investigation into disastrous landslides in this area is essential for effective disaster preparedness and mitigation strategies.By using the human-computer interaction interpretation approach,the authors established a landslide database encompassing 13003 landslides,collectively spanning an area of 3351.24 km^(2)(36°N-40°N,73°E-78°E).The database incorporates diverse topographical and environmental parameters,including regional elevation,slope angle,slope aspect,distance to faults,distance to roads,distance to rivers,annual precipitation,and stratum.The statistical characteristics of number and area of landslides,landslide number density(LND),and landslide area percentage(LAP)are analyzed.The authors found that a predominant concentration of landslide origins within high slope angle regions,with the highest incidence observed in intervals characterised by average slopes of 20°to 30°,maximum slope angle above 80°,along with orientations towards the north(N),northeast(NE),and southwest(SW).Additionally,elevations above 4.5 km,distance to rivers below 1 km,rainfall between 20-30 mm and 30-40 mm emerge as particularly susceptible to landslide development.The study area’s geological composition primarily comprises Mesozoic and Upper Paleozoic outcrops.Both fault and human engineering activities have different degrees of influence on landslide development.Furthermore,the significance of the landslide database,the relationship between landslide distribution and environmental factors,and the geometric and morphological characteristics of landslides are discussed.The landslide H/L ratios in the study area are mainly concentrated between 0.4 and 0.64.It means the landslides mobility in the region is relatively low,and the authors speculate that landslides in this region more possibly triggered by earthquakes or located in meizoseismal area.
文摘With the popularity of new intelligent mobile devices in people’s lives,the development of mobile applications has paid increasing attention to the interactive experience of users.As the content of traditional Human-Computer Interaction(HCI)course and teaching material is out of date,it cannot meet the needs of mobile application interaction design and enterprises for students.Therefore,we need a new generation HCI course based on intelligent mobile devices to study the relationship between users and systems.The HCI course not only teaches students HCI theory and model,but also needs to cultivate students’interaction-oriented design practical ability.This paper proposes a set of HCI teaching material design and teaching methods for improving HCI class quality on mobile application interaction design,so as to make students more suitable for the employment requirements of enterprises.
基金supported by National Defence Basic Research Foundation of China(Grant No.B1420060173)National Hi-tech Research and Development Program of China(863 Program,Grant No.2006AA04Z138)
文摘Due to the narrowness of space and the complexity of structure,the assembly of aircraft cabin has become one of the major bottlenecks in the whole manufacturing process.To solve the problem,at the beginning of aircraft design,the different stages of the lifecycle of aircraft must be thought about,which include the trial manufacture,assembly,maintenance,recycling and destruction of the product.Recently,thanks to the development of the virtual reality and augmented reality,some low-cost and fast solutions are found for the product assembly.This paper presents a mixed reality-based interactive technology for the aircraft cabin assembly,which can enhance the efficiency of the assemblage in a virtual environment in terms of vision,information and operation.In the mixed reality-based assembly environment,the physical scene can be obtained by a camera and then generated by a computer.The virtual parts,the features of visual assembly,the navigation information,the physical parts and the physical assembly environment will be mixed and presented in the same assembly scene.The mixed or the augmented information will provide some assembling information as a detailed assembly instruction in the mixed reality-based assembly environment.Constraint proxy and its match rules help to reconstruct and visualize the restriction relationship among different parts,and to avoid the complex calculation of constraint's match.Finally,a desktop prototype system of virtual assembly has been built to assist the assembly verification and training with the virtual hand.
基金the National Natural Science Foundation of China(No 30400065)
文摘Two DNA fragments encoding PDZ domain （21-110 residues） and BAR domain （ 150-360 residues） from PICK1 （1-416 residues） were amplified by PCR and then introduced into vectors, pET-32M and pMAL-e2X respectively to generate recombinant plasmids, pE-pdz and pM-bar. Having been separately transferred into the hosts E. coli BL21 and E. coli JM109, these two strains can express fusion proteins： His-tagged PDZ（PDZ domain） and maltose binding protein-BAR（ MBP-BAR domain） respectively, as confirmed by both SDS-PAGE and Wostem blotting. The interaction between these two domains is dose-dependence, as identified by a pull-down test. Moreover, it has been shown from the ELISA analysis that the actual amount of PDZ bound to MBP-BAR-amylose beads reaches （ 16 ± 0. 5）%, as calculated by the molar ratio of PDZ to MBP-BAR. In addition, the interaction between BAR（bait） and PDZ（prey） in vivo was also examined with a yeast two-hybrid system.
基金The National Natural Science Foundation of China(No.51875332)the Capacity Building Projects of Some Local Universities of Shanghai Science and Technology Commission(No.18040501600).
文摘To improve the human-physical-virtual coordination and integration of the digital twin workshop,3D visual monitoring and human-computer interaction of the digital twin workshop was studied.First,a novel 6D model of the 3D visualization interactive system for digital twin workshops is proposed.As the traditional 5D digital twin model ignores the importance of human-computer interaction,a new dimension of the user terminal was added.A hierarchical real-time data-driven mapping model for the workshop production process is then proposed.Moreover,a real-time data acquisition method for the industrial Internet of things is proposed based on OPC UA(object linking and embedding for process control unified architecture).Based on the 6D model of the system,the process of creating a 3D visualization virtual environment based on virtual reality is introduced,in addition to a data-driven process based on the data management cloud platform.Finally,the 6D model of the system was confirmed using the blade rotor test workshop as the object,and a 3D visualization interactive system is developed.The results show that the system is more transparent,real-time,data-driven and more efficient,as well as promotes the coordination and integration of human-physical-virtual,which has practical significance for developing digital twin workshops.
基金Supported by the‘Automotive Glazing Application in Intelligent Cockpit Human-Machine Interface’project(SKHX2021049)a collaboration between the Saint-Go Bain Research and the Beijing Normal University。
文摘Background With an increasing number of vehicles becoming autonomous,intelligent,and connected,paying attention to the future usage of car human-machine interface with these vehicles should become more relevant.Several studies have addressed car HMI but were less attentive to designing and implementing interactive glazing for every day(autonomous)driving contexts.Methods Reflecting on the literature,we describe an engineering psychology practice and the design of six novel future user scenarios,which envision the application of a specific set of augmented reality(AR)support user interactions.Additionally,we conduct evaluations on specific scenarios and experiential prototypes,which reveal that these AR scenarios aid the target user groups in experiencing a new type of interaction.The overall evaluation is positive with valuable assessment results and suggestions.Conclusions This study can interest applied psychology educators who aspire to teach how AR can be operationalized in a human-centered design process to students with minimal pre-existing expertise or minimal scientific knowledge in engineering psychology.
基金Supported by the Natienal Natural Science Foundation of China(U23A20287).
文摘Background Haptic feedback plays a crucial role in virtual reality(VR)interaction,helping to improve the precision of user operation and enhancing the immersion of the user experience.Instrumental haptic feedback in virtual environments is primarily realized using grounded force or vibration feedback devices.However,improvements are required in terms of the active space and feedback realism.Methods We propose a lightweight and flexible haptic feedback glove that can haptically render objects in VR environments via kinesthetic and vibration feedback,thereby enabling users to enjoy a rich virtual piano-playing experience.The kinesthetic feedback of the glove relies on a cable-pulling mechanism that rotates the mechanism and pulls the two cables connected to it,thereby changing the amount of force generated to simulate the hardness or softness of the object.Vibration feedback is provided by small vibration motors embedded in the bottom of the fingertips of the glove.We designed a piano-playing scenario in the virtual environment and conducted user tests.The evaluation metrics were clarity,realism,enjoyment,and satisfaction.Results A total of 14 subjects participated in the test,and the results showed that our proposed glove scored significantly higher on the four evaluation metrics than the nofeedback and vibration feedback methods.Conclusions Our proposed glove significantly enhances the user experience when interacting with virtual objects.
基金Supported by National Key R&D Program of China(Grant Nos.2022YFC3601704,2023YFB4706100)National Natural Science Foundation of China(Grant Nos.U23A20338,62203149).
文摘Existing rehabilitation exoskeleton robots suffer from poor compatibility with the human limb coupling method,large internal power loss,and poor wearable performance,which seriously affect the rehabilitation ability of these robots.Therefore,this study proposes a variable stiffness humancomputer interaction contact unit module(VSHCUM)based on the granular jamming mechanism.It is characterized by a double-layer chamber structure:the inner layer is a granular chamber,and the outer layer is an air chamber.The interaction force is transmitted by embedding a rigid support in the inner layer.Unlike the common flexible-belt interactive contact unit,when the exoskeleton is bound to the patient's limb,vSHCUM can realize adaptive fitting of the patient's limb shape using the pressure change in the double-chamber structure.Simultaneously,by adjusting the vacuum level of the granular chamber,the stiffness of the interactive contact unit can be adjusted by a factor of more than five,and the internal work loss caused by self-pulling deformation during the auxiliary force transfer process can be reduced.
文摘蛋白质是生命功能的执行者.生命体中某些关键蛋白的功能异常往往是导致疾病发生的根本原因.这些疾病相关蛋白极有可能成为药物靶点,为新药研发和疾病治疗提供重要线索.PICK1蛋白(protein interacting with Cαkinase1)结合能力广泛、功能多样以及在多种重要疾病(如:癌症、精神分裂症、疼痛、帕金森综合症等)的发生发展过程中发挥潜在的作用,使其成为一个可能的药靶蛋白.PICK1与绝大多数配体蛋白的相互作用是通过其PDZ结构域与配体C末端区域的结合介导的,使PICK1的PDZ结构域成为一个潜在的药物靶点.因此,可以利用生物小分子物质特异性地结合PICK1的PDZ结构域,干扰或阻断PICK1与配体蛋白的天然相互作用,最终达到治疗相关疾病的目的.
文摘Numerous sectors,such as education,the IT sector,and corporate organizations,transitioned to virtual meetings after the COVID-19 crisis.Organizations now seek to assess participants’fatigue levels in online meetings to remain competitive.Instructors cannot effectively monitor every individual in a virtual environment,which raises significant concerns about participant fatigue.Our proposed system monitors fatigue,identifying attentive and drowsy individuals throughout the online session.We leverage Dlib’s pre-trained facial landmark detector and focus on the eye landmarks only,offering a more detailed analysis for predicting eye opening and closing of the eyes,rather than focusing on the entire face.We introduce an Eye Polygon Area(EPA)formula,which computes eye activity from Dlib eye landmarks by measuring the polygonal area of the eye opening.Unlike the Eye Aspect Ratio(EAR),which relies on a single distance ratio,EPA adapts to different eye shapes(round,narrow,or wide),providing a more reliable measure for fatigue detection.The VMFD system issues a warning if a participant remains in a fatigued condition for 36 consecutive frames.The proposed technology is tested under multiple scenarios,including low-to high-lighting conditions(50-1400 lux)and both with and without glasses.This study builds an OpenCV application in Python,evaluated using the iBUG 300-W dataset,achieving 97.5%accuracy in detecting active participants.We compare VMFD with conventional methods relying on the EAR and show that the EPA technique performs significantly better.
文摘Text and speech processing technologies encounter bottlenecks in understanding complex emotions within Human-Computer Interaction(HCI),with significant limitations particularly in the semantic parsing of intonation and tone.This paper employs a literature review approach to systematically synthesize core advancements in applied psychology and speech recognition technology within HCI,focusing on the intersection of emotion recognition technology and psychological intervention scenarios.The study indicates that the deep integration of these fields can significantly enhance intervention precision,especially in scenarios such as psychological diagnosis in children(e.g.,emotion recognition in autism)and personalized Cognitive Behavioral Therapy(CBT)guidance.The research further points out that Artificial Intelligence(AI)has not yet fully grasped complex human emotions,necessitating the deeper embedding of psychological theories into speech emotion analysis frameworks to improve the ability to interpret semantically ambiguous expressions.This review provides a theoretical framework and a practical pathway for the application of AI technology and applied psychology in intelligent HCI.
基金Supported by the National High Technology Research and Development Programme of China(No.2013AA010803,2009AA01Z311,2009AA01Z314)the National Natural Science Foundation of China(No.61304205,61203316,61272379,61103086,41301037)+3 种基金the Natural Science Foundation of Jiangsu Province(BK20141002)the Open Funding Project of State Key Laboratory of Virtual Reality Technology and Systems,Beihang University,Jiangsu Ordinary University Science Research Project(No.13KJB120007)Innovation and Entrepreneurship Training Project of College Students(No.201410300153,201410300165)the Excellent Undergraduate Paper(design)Supporting Project of NUIST
文摘To improve the accuracy and interactivity of soft tissue delormatlon simulation, a new plate spring model based on physics is proposed. The model is parameterized and thus can be adapted to simulate different organs. Different soft tissues are modeled by changing the width, number of pieces, thickness, and length of a single plate spring. In this paper, the structural design, calcula- tion of soft tissue deformation and real-time feedback operations of our system are also introduced. To evaluate the feasibility of the system and validate the model, an experimental system of haptic in- teraction, in which users can use virtual hands to pull virtual brain tissues, is built using PHANTOM OMNI devices. Experimental results show that the proposed system is stable, accurate and promising for modeling instantaneous soft tissue deformation.
