Objective The study of medicine formulas is a core component of traditional Chinese medicine(TCM),yet traditional learning methods often lack interactivity and contextual understanding,making it challenging for beginn...Objective The study of medicine formulas is a core component of traditional Chinese medicine(TCM),yet traditional learning methods often lack interactivity and contextual understanding,making it challenging for beginners to grasp the intricate composition rules of formulas.To address this gap,we introduce Formula-S,a situated visualization method for TCM formula learning in augmented reality(AR)and evaluate its performance.This study aims to evaluate the effectiveness of Formula-S in enhancing TCM formula learning for beginners by comparing it with traditional text-based formula learning and web-based visualization.Methods Formula-S is an interactive AR tool designed for TCM formula learning,featuring three modes(3D,Web,and Table).The dataset included TCM formulas and herb properties extracted from authoritative references,including textbook and the SymMap database.In Formula-S,the hierarchical visualization of the formulas as herbal medicine compositions,is linked to the multidimensional herb attribute visualization and embedded in the real world,where real herb samples are presented.To evaluate its effectiveness,a controlled study(n=30)was conducted.Participants who had no formal TCM knowledge were tasked with herbal medicine identification,formula composition,and recognition.In the study,participants interacted with the AR tool through HoloLens 2.Data were collected on both task performance(accuracy and response time)and user experience,with a focus on task efficiency,accuracy,and user preference across the different learning modes.Results The situated visualization method of Formula-S had comparable accuracy to other methods but shorter response time for herbal formula learning tasks.Regarding user experience,our new approach demonstrated the highest system usability and lowest task load,effectively reducing cognitive load and allowing users to complete tasks with greater ease and efficiency.Participants reported that Formula-S enhanced their learning experience through its intuitive interface and immersive AR environment,suggesting this approach offers usability advantages for TCM education.Conclusions The situated visualization method in Formula-S offers more efficient and accurate searching capabilities compared to traditional and web-based methods.Additionally,it provides superior contextual understanding of TCM formulas,making it a promising new solution for TCM learning.展开更多
Mimicking and extending biological sensory memory processing functions and systems—that play significant roles in enhancing interconnections of the human-physical world—are highly preferable for the Internet of Thin...Mimicking and extending biological sensory memory processing functions and systems—that play significant roles in enhancing interconnections of the human-physical world—are highly preferable for the Internet of Things.However,conventional artificial sensory systems usually consisted of separated modules or relied on perception-memory-processing devices with applications in a limited domain.Here,we propose a self-rectifying multifunctional synapse based on a unique PN optoelectrical memristor interface,achieving an augmented artificial visual system and multifunctional interconnected ports.The synapse realizes in-sensor motion perception and non-contact control beyond perception-memory-processing functions.The self-rectifying device can self-suppress the sneak current in cross-arrays,enabling large-scale and high-density integration.Further integrating synapse with quantum dot light-emitting diodes(QLEDs)evolves more powerful functions like hardware noise filtering and perception-memory-processing-displaying smart systems.展开更多
The visual perception of augmented reality(AR)geovisualization is significantly different from traditional controllable 2D and 3D visualization.In this study,we extended the rendering styles of color variables to incl...The visual perception of augmented reality(AR)geovisualization is significantly different from traditional controllable 2D and 3D visualization.In this study,we extended the rendering styles of color variables to include natural material color(NMC)and illuminating material color(IMC)and extended the size to include linear size(LS)and angular size(AS).Outdoor AR geovisualization user experiments were conducted,examining the guidance characteristics of five static variables(NMC,IMC,shape,AS,LS)and two dynamic variables(vibration,flicker).The results showed that the two dynamic variables provided the highest guidance,and among all the static variables,the order of guidance was shape,IMC,AS,NMC,and finally LS.This is a new finding that is different from the color,size,and shape guidance order in 2D visualization and the color,shape,and size order in 3D visualization.The results could be utilized to guide the selection of visual variables for symbol design in AR geovisualization.展开更多
文摘Objective The study of medicine formulas is a core component of traditional Chinese medicine(TCM),yet traditional learning methods often lack interactivity and contextual understanding,making it challenging for beginners to grasp the intricate composition rules of formulas.To address this gap,we introduce Formula-S,a situated visualization method for TCM formula learning in augmented reality(AR)and evaluate its performance.This study aims to evaluate the effectiveness of Formula-S in enhancing TCM formula learning for beginners by comparing it with traditional text-based formula learning and web-based visualization.Methods Formula-S is an interactive AR tool designed for TCM formula learning,featuring three modes(3D,Web,and Table).The dataset included TCM formulas and herb properties extracted from authoritative references,including textbook and the SymMap database.In Formula-S,the hierarchical visualization of the formulas as herbal medicine compositions,is linked to the multidimensional herb attribute visualization and embedded in the real world,where real herb samples are presented.To evaluate its effectiveness,a controlled study(n=30)was conducted.Participants who had no formal TCM knowledge were tasked with herbal medicine identification,formula composition,and recognition.In the study,participants interacted with the AR tool through HoloLens 2.Data were collected on both task performance(accuracy and response time)and user experience,with a focus on task efficiency,accuracy,and user preference across the different learning modes.Results The situated visualization method of Formula-S had comparable accuracy to other methods but shorter response time for herbal formula learning tasks.Regarding user experience,our new approach demonstrated the highest system usability and lowest task load,effectively reducing cognitive load and allowing users to complete tasks with greater ease and efficiency.Participants reported that Formula-S enhanced their learning experience through its intuitive interface and immersive AR environment,suggesting this approach offers usability advantages for TCM education.Conclusions The situated visualization method in Formula-S offers more efficient and accurate searching capabilities compared to traditional and web-based methods.Additionally,it provides superior contextual understanding of TCM formulas,making it a promising new solution for TCM learning.
基金supported by the National Natural Science Foundation of China(Grant No.62205063,62075043,62305254)Fujian Province Natural Science Foundation of China(Grant No.2023J05125,2022J05042)Fujian Normal University“Young Talent”Start-up Grant(Grant No.Y0720311K13)。
文摘Mimicking and extending biological sensory memory processing functions and systems—that play significant roles in enhancing interconnections of the human-physical world—are highly preferable for the Internet of Things.However,conventional artificial sensory systems usually consisted of separated modules or relied on perception-memory-processing devices with applications in a limited domain.Here,we propose a self-rectifying multifunctional synapse based on a unique PN optoelectrical memristor interface,achieving an augmented artificial visual system and multifunctional interconnected ports.The synapse realizes in-sensor motion perception and non-contact control beyond perception-memory-processing functions.The self-rectifying device can self-suppress the sneak current in cross-arrays,enabling large-scale and high-density integration.Further integrating synapse with quantum dot light-emitting diodes(QLEDs)evolves more powerful functions like hardware noise filtering and perception-memory-processing-displaying smart systems.
基金supported and funded by the Pilot Fund of Frontier Science and Disruptive Technology of Aerospace Information Research Institute,Chinese Academy of Sciences[Grant number E0Z211010F].
文摘The visual perception of augmented reality(AR)geovisualization is significantly different from traditional controllable 2D and 3D visualization.In this study,we extended the rendering styles of color variables to include natural material color(NMC)and illuminating material color(IMC)and extended the size to include linear size(LS)and angular size(AS).Outdoor AR geovisualization user experiments were conducted,examining the guidance characteristics of five static variables(NMC,IMC,shape,AS,LS)and two dynamic variables(vibration,flicker).The results showed that the two dynamic variables provided the highest guidance,and among all the static variables,the order of guidance was shape,IMC,AS,NMC,and finally LS.This is a new finding that is different from the color,size,and shape guidance order in 2D visualization and the color,shape,and size order in 3D visualization.The results could be utilized to guide the selection of visual variables for symbol design in AR geovisualization.
