This study examines the advent of agent interaction(AIx)as a transformative paradigm in humancomputer interaction(HCI),signifying a notable evolution beyond traditional graphical interfaces and touchscreen interaction...This study examines the advent of agent interaction(AIx)as a transformative paradigm in humancomputer interaction(HCI),signifying a notable evolution beyond traditional graphical interfaces and touchscreen interactions.Within the context of large models,AIx is characterized by its innovative interaction patterns and a plethora of application scenarios that hold great potential.The paper highlights the pivotal role of AIx in shaping the future landscape of the large model industry,emphasizing its adoption and necessity from a user's perspective.This study underscores the pivotal role of AIx in dictating the future trajectory of a large model industry by emphasizing the importance of its adoption and necessity from a user-centric perspective.The fundamental drivers of AIx include the introduction of novel capabilities,replication of capabilities(both anthropomorphic and superhuman),migration of capabilities,aggregation of intelligence,and multiplication of capabilities.These elements are essential for propelling innovation,expanding the frontiers of capability,and realizing the exponential superposition of capabilities,thereby mitigating labor redundancy and addressing a spectrum of human needs.Furthermore,this study provides an in-depth analysis of the structural components and operational mechanisms of agents supported by large models.Such advancements significantly enhance the capacity of agents to tackle complex problems and provide intelligent services,thereby facilitating a more intuitive,adaptive,and personalized engagement between humans and machines.The study further delineates four principal categories of interaction patterns that encompass eight distinct modalities of interaction,corresponding to twenty-one specific scenarios,including applications in smart home systems,health assistance,and elderly care.This emphasizes the significance of this new paradigm in advancing HCI,fostering technological advancements,and redefining user experiences.However,it also acknowledges the challenges and ethical considerations that accompany this paradigm shift,recognizing the need for a balanced approach to harness the full potential of AIx in modern society.展开更多
Background Accurate motion tracking in head-mounted displays(HMDs)has been widely used in immersive VR interaction technologies.However,tracking the head motion of users at all times is not always desirable.During a s...Background Accurate motion tracking in head-mounted displays(HMDs)has been widely used in immersive VR interaction technologies.However,tracking the head motion of users at all times is not always desirable.During a session of HMD usage,users may make scene-irrelevant head rotations,such as adjusting the head position to avoid neck pain or responding to distractions from the physical world.To the best of our knowledge,this is the first study that addresses the problem of scene-irrelevant head movements.Methods We trained a classifier to detect scene-irrelevant motions using temporal eye head-coordinated information sequences.To investigate the usefulness of the detection results,we propose a technique to suspend motion tracking in HMDs where scene-irrelevant motions are detected.Results/Conclusions Experimental results demonstrate that the scene-relevancy of movements can be detected using eye-head coordination information,and that ignoring scene-irrelevant head motions in HMDs improves user continuity without increasing sickness or breaking immersion.展开更多
Immersive visualization utilizes virtual reality,mixed reality devices,and other interactive devices to create a novel visual environment that integrates multimodal perception and interaction.This technology has been ...Immersive visualization utilizes virtual reality,mixed reality devices,and other interactive devices to create a novel visual environment that integrates multimodal perception and interaction.This technology has been maturing in recent years and has found broad applications in various fields.Based on the latest research advancements in visualization,this paper summarizes the state-of-theart work in immersive visualization from the perspectives of multimodal perception and interaction in immersive environments,additionally discusses the current hardware foundations of immersive setups.By examining the design patterns and research approaches of previous immersive methods,the paper reveals the design factors for multimodal perception and interaction in current immersive environments.Furthermore,the challenges and development trends of immersive multimodal perception and interaction techniques are discussed,and potential areas of growth in immersive visualization design directions are explored.展开更多
Internet of Things（IoT）is a new paradigm that the ubiquitous smart objects,such as devices,vehicles,buildings,etc.,interact and exchange data through emerging wireless technology with the intention of improving peo...Internet of Things（IoT）is a new paradigm that the ubiquitous smart objects,such as devices,vehicles,buildings,etc.,interact and exchange data through emerging wireless technology with the intention of improving people’s quality of lives in variety areas,such as transportation,manufacturing industry,health care industry,etc：Besides benefits,展开更多
文摘This study examines the advent of agent interaction(AIx)as a transformative paradigm in humancomputer interaction(HCI),signifying a notable evolution beyond traditional graphical interfaces and touchscreen interactions.Within the context of large models,AIx is characterized by its innovative interaction patterns and a plethora of application scenarios that hold great potential.The paper highlights the pivotal role of AIx in shaping the future landscape of the large model industry,emphasizing its adoption and necessity from a user's perspective.This study underscores the pivotal role of AIx in dictating the future trajectory of a large model industry by emphasizing the importance of its adoption and necessity from a user-centric perspective.The fundamental drivers of AIx include the introduction of novel capabilities,replication of capabilities(both anthropomorphic and superhuman),migration of capabilities,aggregation of intelligence,and multiplication of capabilities.These elements are essential for propelling innovation,expanding the frontiers of capability,and realizing the exponential superposition of capabilities,thereby mitigating labor redundancy and addressing a spectrum of human needs.Furthermore,this study provides an in-depth analysis of the structural components and operational mechanisms of agents supported by large models.Such advancements significantly enhance the capacity of agents to tackle complex problems and provide intelligent services,thereby facilitating a more intuitive,adaptive,and personalized engagement between humans and machines.The study further delineates four principal categories of interaction patterns that encompass eight distinct modalities of interaction,corresponding to twenty-one specific scenarios,including applications in smart home systems,health assistance,and elderly care.This emphasizes the significance of this new paradigm in advancing HCI,fostering technological advancements,and redefining user experiences.However,it also acknowledges the challenges and ethical considerations that accompany this paradigm shift,recognizing the need for a balanced approach to harness the full potential of AIx in modern society.
文摘Background Accurate motion tracking in head-mounted displays(HMDs)has been widely used in immersive VR interaction technologies.However,tracking the head motion of users at all times is not always desirable.During a session of HMD usage,users may make scene-irrelevant head rotations,such as adjusting the head position to avoid neck pain or responding to distractions from the physical world.To the best of our knowledge,this is the first study that addresses the problem of scene-irrelevant head movements.Methods We trained a classifier to detect scene-irrelevant motions using temporal eye head-coordinated information sequences.To investigate the usefulness of the detection results,we propose a technique to suspend motion tracking in HMDs where scene-irrelevant motions are detected.Results/Conclusions Experimental results demonstrate that the scene-relevancy of movements can be detected using eye-head coordination information,and that ignoring scene-irrelevant head motions in HMDs improves user continuity without increasing sickness or breaking immersion.
基金supported in part by Beijing Natural Science Foundation(4212030).
文摘Immersive visualization utilizes virtual reality,mixed reality devices,and other interactive devices to create a novel visual environment that integrates multimodal perception and interaction.This technology has been maturing in recent years and has found broad applications in various fields.Based on the latest research advancements in visualization,this paper summarizes the state-of-theart work in immersive visualization from the perspectives of multimodal perception and interaction in immersive environments,additionally discusses the current hardware foundations of immersive setups.By examining the design patterns and research approaches of previous immersive methods,the paper reveals the design factors for multimodal perception and interaction in current immersive environments.Furthermore,the challenges and development trends of immersive multimodal perception and interaction techniques are discussed,and potential areas of growth in immersive visualization design directions are explored.
文摘Internet of Things（IoT）is a new paradigm that the ubiquitous smart objects,such as devices,vehicles,buildings,etc.,interact and exchange data through emerging wireless technology with the intention of improving people’s quality of lives in variety areas,such as transportation,manufacturing industry,health care industry,etc：Besides benefits,
