Multimodal perception,pivotal for artificial intelligence(AI)systems demanding real-time decision-making and environmental adaptability,might be significantly improved through two-dimensional(2D)piezo-ferro-opto-elect...Multimodal perception,pivotal for artificial intelligence(AI)systems demanding real-time decision-making and environmental adaptability,might be significantly improved through two-dimensional(2D)piezo-ferro-opto-electronic(PFOE)semiconductors,like,NbOX_(2)(X=Cl,Br,I).Such improvement may enable in-sensor fusion of sense organ signals(e.g.,vision,audition,gustation,and olfaction)within a single functional component,overcoming limitations of conventional discrete sensor architectures.Such function cohesion,combined with their recently uncovered properties,not only provides a robust foundation for expanding sensory modalities and developing novel mechanisms to establish an all-in-one multimodal perception platform,but also paves the way for multisensory-integrated artificial systems beyond human sensory systems.This single-component system employing such PFOE semiconductors substantially mitigates intermodule communication latency while boosting integration density of information,thereby circumventing persistent inefficiencies in AI hardware architectures for real-time applications,such as embodied robotics and immersive human–machine interfaces.This fusion of multimodal perception and computation,enabled by multiphysics coupling of 2D NbOX_(2),drives AI systems toward biological-grade efficiency while maintaining environmental adaptability,representing a critical leap toward autonomous intelligence operating in dynamic real-world settings.展开更多
基金supported by the National Key R&D Program of China(2021YFA1200501 and 2023YFE0210800)National Natural Science Foundation of China(U22A20137 and U21A2069)+4 种基金Natural Science Foundation of Hubei Province(2024AFE009)Natural Science Foundation of Guangdong Province(2025A1515011072)Shenzhen Science and Technology Innovation Program(JCYJ20240813153403005,GJHZ20210705142542015,JCYJ20220530160811027,and CJGJZD20240729143104006)Basic Research Support Program of HUST(2025BRA006)Special Zone Program of Wuhan Natural Science Foundation.
文摘Multimodal perception,pivotal for artificial intelligence(AI)systems demanding real-time decision-making and environmental adaptability,might be significantly improved through two-dimensional(2D)piezo-ferro-opto-electronic(PFOE)semiconductors,like,NbOX_(2)(X=Cl,Br,I).Such improvement may enable in-sensor fusion of sense organ signals(e.g.,vision,audition,gustation,and olfaction)within a single functional component,overcoming limitations of conventional discrete sensor architectures.Such function cohesion,combined with their recently uncovered properties,not only provides a robust foundation for expanding sensory modalities and developing novel mechanisms to establish an all-in-one multimodal perception platform,but also paves the way for multisensory-integrated artificial systems beyond human sensory systems.This single-component system employing such PFOE semiconductors substantially mitigates intermodule communication latency while boosting integration density of information,thereby circumventing persistent inefficiencies in AI hardware architectures for real-time applications,such as embodied robotics and immersive human–machine interfaces.This fusion of multimodal perception and computation,enabled by multiphysics coupling of 2D NbOX_(2),drives AI systems toward biological-grade efficiency while maintaining environmental adaptability,representing a critical leap toward autonomous intelligence operating in dynamic real-world settings.
