To solve the problem of risk identification and quantitative assessment for human-computer interaction(HCI)in complex avionics systems,an HCI safety analysis framework based on system-theoretical process analysis(STPA...To solve the problem of risk identification and quantitative assessment for human-computer interaction(HCI)in complex avionics systems,an HCI safety analysis framework based on system-theoretical process analysis(STPA)and cognitive reliability and error analysis method(CREAM)is proposed.STPACREAM can identify unsafe control actions and find the causal path during the interaction of avionics systems and pilot with the help of formal verification tools automatically.The common performance conditions(CPC)of avionics systems in the aviation environment is established and a quantitative analysis of human failure is carried out.Taking the head-up display(HUD)system interaction process as an example,a case analysis is carried out,the layered safety control structure and formal model of the HUD interaction process are established.For the interactive behavior“Pilots approaching with HUD”,four unsafe control actions and35 causal scenarios are identified and the impact of common performance conditions at different levels on the pilot decision model are analyzed.The results show that HUD's HCI level gradually improves as the scores of CPC increase,and the quality of crew member cooperation and time sufficiency of the task is the key to its HCI.Through case analysis,it is shown that STPACREAM can quantitatively assess the hazards in HCI and identify the key factors that impact safety.展开更多
In this paper,we investigate methodologies to improve direct-touch interaction on invisible and intangible spatial input.We firstly discuss about the motive of looking for a new input method for whole body interaction...In this paper,we investigate methodologies to improve direct-touch interaction on invisible and intangible spatial input.We firstly discuss about the motive of looking for a new input method for whole body interaction and how it can be meaningful.We also describe the role that can play spatial interaction to improve the freedom of interaction for a user.We propose a method of spatial centered interaction using invisible and intangible spatial inputs.However,given their lack of tactile feedback and visual representation,direct touch interaction on such input can be confused.In order to make a step toward understanding causes and solutions for such phenomena,we made 2 user experiments.In the first one,we test 5 setups of helper that provide information of the location of the input by constraining the dimension it is located at.The results show that using marker on the ground and a relationship with the height of the user’s body improve significantly the locative task.In the second experiment,we create a dancing game using invisible and intangible spatial inputs and we stress the results obtained in the first experiment within this cognitively demanding context.Results show that the same setup of helper is still providing very good results in that context.展开更多
Text and speech processing technologies encounter bottlenecks in understanding complex emotions within Human-Computer Interaction(HCI),with significant limitations particularly in the semantic parsing of intonation an...Text and speech processing technologies encounter bottlenecks in understanding complex emotions within Human-Computer Interaction(HCI),with significant limitations particularly in the semantic parsing of intonation and tone.This paper employs a literature review approach to systematically synthesize core advancements in applied psychology and speech recognition technology within HCI,focusing on the intersection of emotion recognition technology and psychological intervention scenarios.The study indicates that the deep integration of these fields can significantly enhance intervention precision,especially in scenarios such as psychological diagnosis in children(e.g.,emotion recognition in autism)and personalized Cognitive Behavioral Therapy(CBT)guidance.The research further points out that Artificial Intelligence(AI)has not yet fully grasped complex human emotions,necessitating the deeper embedding of psychological theories into speech emotion analysis frameworks to improve the ability to interpret semantically ambiguous expressions.This review provides a theoretical framework and a practical pathway for the application of AI technology and applied psychology in intelligent HCI.展开更多
Numerous sectors,such as education,the IT sector,and corporate organizations,transitioned to virtual meetings after the COVID-19 crisis.Organizations now seek to assess participants’fatigue levels in online meetings ...Numerous sectors,such as education,the IT sector,and corporate organizations,transitioned to virtual meetings after the COVID-19 crisis.Organizations now seek to assess participants’fatigue levels in online meetings to remain competitive.Instructors cannot effectively monitor every individual in a virtual environment,which raises significant concerns about participant fatigue.Our proposed system monitors fatigue,identifying attentive and drowsy individuals throughout the online session.We leverage Dlib’s pre-trained facial landmark detector and focus on the eye landmarks only,offering a more detailed analysis for predicting eye opening and closing of the eyes,rather than focusing on the entire face.We introduce an Eye Polygon Area(EPA)formula,which computes eye activity from Dlib eye landmarks by measuring the polygonal area of the eye opening.Unlike the Eye Aspect Ratio(EAR),which relies on a single distance ratio,EPA adapts to different eye shapes(round,narrow,or wide),providing a more reliable measure for fatigue detection.The VMFD system issues a warning if a participant remains in a fatigued condition for 36 consecutive frames.The proposed technology is tested under multiple scenarios,including low-to high-lighting conditions(50-1400 lux)and both with and without glasses.This study builds an OpenCV application in Python,evaluated using the iBUG 300-W dataset,achieving 97.5%accuracy in detecting active participants.We compare VMFD with conventional methods relying on the EAR and show that the EPA technique performs significantly better.展开更多
The recent developments in technology have made noteworthy positive impacts on the human-computer interaction （HCI）. It is now possible to interact with computers using voice commands, touchscreen, eye movement, han...The recent developments in technology have made noteworthy positive impacts on the human-computer interaction （HCI）. It is now possible to interact with computers using voice commands, touchscreen, eye movement, hand gesture, etc. This paper compiles some of the innovative HCI progresses in various areas, e.g., specialised input/output devices, virtual or augmented reality, wearable technology, etc. It also identifies some future research directions.展开更多
eXplainable Recommender Systems(XRS)aim to provide users with understandable reasons for the recommendations generated by these systems,representing a crucial research direction in Artificial Intelligence(AI).Recent r...eXplainable Recommender Systems(XRS)aim to provide users with understandable reasons for the recommendations generated by these systems,representing a crucial research direction in Artificial Intelligence(AI).Recent research has increasingly focused on the algorithms,display,and evaluation methodologies of XRS.While current research and reviews primarily emphasize the algorithmic aspects,with fewer studies addressing the Human-Computer Interaction(HCI)layer of XRS.Additionally,existing reviews lack a unified taxonomy for XRS and there is insufficient attention given to the emerging area of short video recommendations.In this study,we synthesize existing literature and surveys on XRS,presenting a unified framework for its research and development.The main contributions are as follows:(1)We adopt a lifecycle perspective to systematically summarize the technologies and methods used in XRS,addressing challenges posed by the diversity and complexity of algorithmic models and explanation techniques;(2)For the first time,we highlight the application of multimedia,particularly video-based explanations,along with its potential,technical pathways,and challenges in XRS;and(3)We provide a structured overview of evaluation methods from both qualitative and quantitative dimensions.These findings provide valuable insights for the systematic design,progress,and testing of XRS.展开更多
An increasing number of studies have focused on providing rich tactile feedback in virtual reality interactive scenarios.In this study,we addressed a tapping scenario in virtual reality by designing MatStick,a solutio...An increasing number of studies have focused on providing rich tactile feedback in virtual reality interactive scenarios.In this study,we addressed a tapping scenario in virtual reality by designing MatStick,a solution capable of offering diverse tapping sensations.MatStick utilizes a soft physical base to provide force feedback and modulates the instantaneous vibration of the base using a voice coil motor,thereby altering the perception of the base material.We conducted two psychophysical experiments and a subjective evaluation to assess the capabilities of MatStick.The results demonstrate that MatStick can deliver rich tapping sensations.Although users may find it challenging to directly correlate the tapping sensation with the actual physical material based solely on tactile feedback,in immersive scenarios combined with visual and auditory cues,MatStick significantly enhances the user's interaction experience.展开更多
Background Accurate motion tracking in head-mounted displays(HMDs)has been widely used in immersive VR interaction technologies.However,tracking the head motion of users at all times is not always desirable.During a s...Background Accurate motion tracking in head-mounted displays(HMDs)has been widely used in immersive VR interaction technologies.However,tracking the head motion of users at all times is not always desirable.During a session of HMD usage,users may make scene-irrelevant head rotations,such as adjusting the head position to avoid neck pain or responding to distractions from the physical world.To the best of our knowledge,this is the first study that addresses the problem of scene-irrelevant head movements.Methods We trained a classifier to detect scene-irrelevant motions using temporal eye head-coordinated information sequences.To investigate the usefulness of the detection results,we propose a technique to suspend motion tracking in HMDs where scene-irrelevant motions are detected.Results/Conclusions Experimental results demonstrate that the scene-relevancy of movements can be detected using eye-head coordination information,and that ignoring scene-irrelevant head motions in HMDs improves user continuity without increasing sickness or breaking immersion.展开更多
With the rapid global advancement of human-computer interaction technology and the continuous development of Augmented Reality(AR),its impact on artistic creation has significantly expanded.This study explores,through...With the rapid global advancement of human-computer interaction technology and the continuous development of Augmented Reality(AR),its impact on artistic creation has significantly expanded.This study explores,through a systematic literature review,how AR technology has transformed contemporary art practices and the technological logic underlying this transformation.A total of 28 core articles published between 2011 and 2025 were analyzed,revealing the technological evolution of AR from early"imagetriggered"to"spatial-aware"approaches.The findings indicate that"no-code"tools,such as Adobe Aero,Instagram filters,and WebAR,have significantly lowered the barriers to artistic creation,expanded creative agency,and transformed viewers from passive appreciators into co-creators.In addition,AR,through spatial reconstruction,multi-sensory integration,and"temporal overlap"mechanisms,transforms artistic creation from a static physical space into a dynamic,participatory hybrid digital-physical space.This review concludes that AR,as an augmentation technology,has fundamentally changed the creative logic and aesthetic experience of contemporary art.The paper also outlines future directions for AI-driven real-time AR art and discusses emerging legal and ethical challenges.展开更多
The development of Ti_(3)C_(2)Tx MXene-based electromagnetic wave-absorbing materials faces a persistent challenge in balancing conductivity loss and polarization relaxation.To resolve this conflict,we propose an“int...The development of Ti_(3)C_(2)Tx MXene-based electromagnetic wave-absorbing materials faces a persistent challenge in balancing conductivity loss and polarization relaxation.To resolve this conflict,we propose an“interface engineering–human–computer interaction(HCI)”strategy to regulate the evolution of permittivity and decouple the interdependency between conductivity(σ)and relaxation time(τ).First,by integrating the Debye relaxation model and transmission line theory into Python-based interactive modules,an HCI framework is established that quantitatively guides the optimization of permittivity trends and provides feedback on intrinsic Debye-parameter variations.Guided by these theoretical optimizations,nitrogen-doped SiO_(2)-coated Ti_(3)C_(2)Cl_(x) MXene(SMX)composites were subsequently prepared via interface engineering.The insulating SiO_(2) layer suppresses excessiveσwhile introducing heterogeneous interfaces that prolongτ.Meanwhile,the surface heterogeneous dipole generated by nitrogen doping induces a hysteresis ofτ.Consequently,this theory-guided design enables the optimized SMX-S2-N1 to achieve a 5.2 GHz effective absorption bandwidth,overcoming the inherent limitation of narrow absorption bandwidth in MXene single-component materials.This study not only addresses the restricted absorption bandwidth of monolithic MXenes but also offers a mechanistic understanding of dielectric loss through Debye model analysis,bridging semiempirical design principles with theoretical frameworks.展开更多
We describe a user interface and interaction technique,named'Javelin',designed for large display environments.It provides quick access to random screen regions and manipulation methods for screen widgets which...We describe a user interface and interaction technique,named'Javelin',designed for large display environments.It provides quick access to random screen regions and manipulation methods for screen widgets which are difficult or impossible to reach.It consists of a dynamic global thumbnail,a touchpad widget that drives the screen cursor,and a teleport widget in which interactions are transferred to its target screen region.Javelin can be easily integrated into many programs to optimize their interaction performance in large screens.The experiment and user study show that Javelin can extend user access field and enhance widget manipulation in large displays.展开更多
基金supported by the National Key Research and Development Program of China(2021YFB1600601)the Joint Funds of the National Natural Science Foundation of China and the Civil Aviation Administration of China(U1933106)+2 种基金the Scientific Research Project of Tianjin Educational Committee(2019KJ134)the Natural Science Foundation of TianjinIntelligent Civil Aviation Program(21JCQNJ C00900)。
文摘To solve the problem of risk identification and quantitative assessment for human-computer interaction(HCI)in complex avionics systems,an HCI safety analysis framework based on system-theoretical process analysis(STPA)and cognitive reliability and error analysis method(CREAM)is proposed.STPACREAM can identify unsafe control actions and find the causal path during the interaction of avionics systems and pilot with the help of formal verification tools automatically.The common performance conditions(CPC)of avionics systems in the aviation environment is established and a quantitative analysis of human failure is carried out.Taking the head-up display(HUD)system interaction process as an example,a case analysis is carried out,the layered safety control structure and formal model of the HUD interaction process are established.For the interactive behavior“Pilots approaching with HUD”,four unsafe control actions and35 causal scenarios are identified and the impact of common performance conditions at different levels on the pilot decision model are analyzed.The results show that HUD's HCI level gradually improves as the scores of CPC increase,and the quality of crew member cooperation and time sufficiency of the task is the key to its HCI.Through case analysis,it is shown that STPACREAM can quantitatively assess the hazards in HCI and identify the key factors that impact safety.
文摘In this paper,we investigate methodologies to improve direct-touch interaction on invisible and intangible spatial input.We firstly discuss about the motive of looking for a new input method for whole body interaction and how it can be meaningful.We also describe the role that can play spatial interaction to improve the freedom of interaction for a user.We propose a method of spatial centered interaction using invisible and intangible spatial inputs.However,given their lack of tactile feedback and visual representation,direct touch interaction on such input can be confused.In order to make a step toward understanding causes and solutions for such phenomena,we made 2 user experiments.In the first one,we test 5 setups of helper that provide information of the location of the input by constraining the dimension it is located at.The results show that using marker on the ground and a relationship with the height of the user’s body improve significantly the locative task.In the second experiment,we create a dancing game using invisible and intangible spatial inputs and we stress the results obtained in the first experiment within this cognitively demanding context.Results show that the same setup of helper is still providing very good results in that context.
文摘Text and speech processing technologies encounter bottlenecks in understanding complex emotions within Human-Computer Interaction(HCI),with significant limitations particularly in the semantic parsing of intonation and tone.This paper employs a literature review approach to systematically synthesize core advancements in applied psychology and speech recognition technology within HCI,focusing on the intersection of emotion recognition technology and psychological intervention scenarios.The study indicates that the deep integration of these fields can significantly enhance intervention precision,especially in scenarios such as psychological diagnosis in children(e.g.,emotion recognition in autism)and personalized Cognitive Behavioral Therapy(CBT)guidance.The research further points out that Artificial Intelligence(AI)has not yet fully grasped complex human emotions,necessitating the deeper embedding of psychological theories into speech emotion analysis frameworks to improve the ability to interpret semantically ambiguous expressions.This review provides a theoretical framework and a practical pathway for the application of AI technology and applied psychology in intelligent HCI.
文摘Numerous sectors,such as education,the IT sector,and corporate organizations,transitioned to virtual meetings after the COVID-19 crisis.Organizations now seek to assess participants’fatigue levels in online meetings to remain competitive.Instructors cannot effectively monitor every individual in a virtual environment,which raises significant concerns about participant fatigue.Our proposed system monitors fatigue,identifying attentive and drowsy individuals throughout the online session.We leverage Dlib’s pre-trained facial landmark detector and focus on the eye landmarks only,offering a more detailed analysis for predicting eye opening and closing of the eyes,rather than focusing on the entire face.We introduce an Eye Polygon Area(EPA)formula,which computes eye activity from Dlib eye landmarks by measuring the polygonal area of the eye opening.Unlike the Eye Aspect Ratio(EAR),which relies on a single distance ratio,EPA adapts to different eye shapes(round,narrow,or wide),providing a more reliable measure for fatigue detection.The VMFD system issues a warning if a participant remains in a fatigued condition for 36 consecutive frames.The proposed technology is tested under multiple scenarios,including low-to high-lighting conditions(50-1400 lux)and both with and without glasses.This study builds an OpenCV application in Python,evaluated using the iBUG 300-W dataset,achieving 97.5%accuracy in detecting active participants.We compare VMFD with conventional methods relying on the EAR and show that the EPA technique performs significantly better.
文摘The recent developments in technology have made noteworthy positive impacts on the human-computer interaction （HCI）. It is now possible to interact with computers using voice commands, touchscreen, eye movement, hand gesture, etc. This paper compiles some of the innovative HCI progresses in various areas, e.g., specialised input/output devices, virtual or augmented reality, wearable technology, etc. It also identifies some future research directions.
基金supported by the National Natural Science Foundation of China(Nos.72304090 and 72204095).
文摘eXplainable Recommender Systems(XRS)aim to provide users with understandable reasons for the recommendations generated by these systems,representing a crucial research direction in Artificial Intelligence(AI).Recent research has increasingly focused on the algorithms,display,and evaluation methodologies of XRS.While current research and reviews primarily emphasize the algorithmic aspects,with fewer studies addressing the Human-Computer Interaction(HCI)layer of XRS.Additionally,existing reviews lack a unified taxonomy for XRS and there is insufficient attention given to the emerging area of short video recommendations.In this study,we synthesize existing literature and surveys on XRS,presenting a unified framework for its research and development.The main contributions are as follows:(1)We adopt a lifecycle perspective to systematically summarize the technologies and methods used in XRS,addressing challenges posed by the diversity and complexity of algorithmic models and explanation techniques;(2)For the first time,we highlight the application of multimedia,particularly video-based explanations,along with its potential,technical pathways,and challenges in XRS;and(3)We provide a structured overview of evaluation methods from both qualitative and quantitative dimensions.These findings provide valuable insights for the systematic design,progress,and testing of XRS.
基金Supported by the National Natural Science Foundation of China(52175493)the National Key Research and Development Program of China(2020YFB2104400).
文摘An increasing number of studies have focused on providing rich tactile feedback in virtual reality interactive scenarios.In this study,we addressed a tapping scenario in virtual reality by designing MatStick,a solution capable of offering diverse tapping sensations.MatStick utilizes a soft physical base to provide force feedback and modulates the instantaneous vibration of the base using a voice coil motor,thereby altering the perception of the base material.We conducted two psychophysical experiments and a subjective evaluation to assess the capabilities of MatStick.The results demonstrate that MatStick can deliver rich tapping sensations.Although users may find it challenging to directly correlate the tapping sensation with the actual physical material based solely on tactile feedback,in immersive scenarios combined with visual and auditory cues,MatStick significantly enhances the user's interaction experience.
文摘Background Accurate motion tracking in head-mounted displays(HMDs)has been widely used in immersive VR interaction technologies.However,tracking the head motion of users at all times is not always desirable.During a session of HMD usage,users may make scene-irrelevant head rotations,such as adjusting the head position to avoid neck pain or responding to distractions from the physical world.To the best of our knowledge,this is the first study that addresses the problem of scene-irrelevant head movements.Methods We trained a classifier to detect scene-irrelevant motions using temporal eye head-coordinated information sequences.To investigate the usefulness of the detection results,we propose a technique to suspend motion tracking in HMDs where scene-irrelevant motions are detected.Results/Conclusions Experimental results demonstrate that the scene-relevancy of movements can be detected using eye-head coordination information,and that ignoring scene-irrelevant head motions in HMDs improves user continuity without increasing sickness or breaking immersion.
文摘With the rapid global advancement of human-computer interaction technology and the continuous development of Augmented Reality(AR),its impact on artistic creation has significantly expanded.This study explores,through a systematic literature review,how AR technology has transformed contemporary art practices and the technological logic underlying this transformation.A total of 28 core articles published between 2011 and 2025 were analyzed,revealing the technological evolution of AR from early"imagetriggered"to"spatial-aware"approaches.The findings indicate that"no-code"tools,such as Adobe Aero,Instagram filters,and WebAR,have significantly lowered the barriers to artistic creation,expanded creative agency,and transformed viewers from passive appreciators into co-creators.In addition,AR,through spatial reconstruction,multi-sensory integration,and"temporal overlap"mechanisms,transforms artistic creation from a static physical space into a dynamic,participatory hybrid digital-physical space.This review concludes that AR,as an augmentation technology,has fundamentally changed the creative logic and aesthetic experience of contemporary art.The paper also outlines future directions for AI-driven real-time AR art and discusses emerging legal and ethical challenges.
基金supported by the National Natural Science Foundation of China(No.51872058)the Supporting Program for Innovation Team of Outstanding Youth in Colleges and Universities of Shandong Province(No.2020KJA005)the Natural Science Foundation of Shandong Province(No.ZR2022QB156).
文摘The development of Ti_(3)C_(2)Tx MXene-based electromagnetic wave-absorbing materials faces a persistent challenge in balancing conductivity loss and polarization relaxation.To resolve this conflict,we propose an“interface engineering–human–computer interaction(HCI)”strategy to regulate the evolution of permittivity and decouple the interdependency between conductivity(σ)and relaxation time(τ).First,by integrating the Debye relaxation model and transmission line theory into Python-based interactive modules,an HCI framework is established that quantitatively guides the optimization of permittivity trends and provides feedback on intrinsic Debye-parameter variations.Guided by these theoretical optimizations,nitrogen-doped SiO_(2)-coated Ti_(3)C_(2)Cl_(x) MXene(SMX)composites were subsequently prepared via interface engineering.The insulating SiO_(2) layer suppresses excessiveσwhile introducing heterogeneous interfaces that prolongτ.Meanwhile,the surface heterogeneous dipole generated by nitrogen doping induces a hysteresis ofτ.Consequently,this theory-guided design enables the optimized SMX-S2-N1 to achieve a 5.2 GHz effective absorption bandwidth,overcoming the inherent limitation of narrow absorption bandwidth in MXene single-component materials.This study not only addresses the restricted absorption bandwidth of monolithic MXenes but also offers a mechanistic understanding of dielectric loss through Debye model analysis,bridging semiempirical design principles with theoretical frameworks.
基金Project supported by China Academic Digital Associative Library (CADAL)
文摘We describe a user interface and interaction technique,named'Javelin',designed for large display environments.It provides quick access to random screen regions and manipulation methods for screen widgets which are difficult or impossible to reach.It consists of a dynamic global thumbnail,a touchpad widget that drives the screen cursor,and a teleport widget in which interactions are transferred to its target screen region.Javelin can be easily integrated into many programs to optimize their interaction performance in large screens.The experiment and user study show that Javelin can extend user access field and enhance widget manipulation in large displays.
