Robotic computing systems play an important role in enabling intelligent robotic tasks through intelligent algo-rithms and supporting hardware.In recent years,the evolution of robotic algorithms indicates a roadmap fr...Robotic computing systems play an important role in enabling intelligent robotic tasks through intelligent algo-rithms and supporting hardware.In recent years,the evolution of robotic algorithms indicates a roadmap from traditional robotics to hierarchical and end-to-end models.This algorithmic advancement poses a critical challenge in achieving balanced system-wide performance.Therefore,algorithm-hardware co-design has emerged as the primary methodology,which ana-lyzes algorithm behaviors on hardware to identify common computational properties.These properties can motivate algo-rithm optimization to reduce computational complexity and hardware innovation from architecture to circuit for high performance and high energy efficiency.We then reviewed recent works on robotic and embodied AI algorithms and computing hard-ware to demonstrate this algorithm-hardware co-design methodology.In the end,we discuss future research opportunities by answering two questions:(1)how to adapt the computing platforms to the rapid evolution of embodied AI algorithms,and(2)how to transform the potential of emerging hardware innovations into end-to-end inference improvements.展开更多
Compared to the last decade when the convolution neu-ral network(CNN)dominated the research field,machine learn-ing(ML)algorithms have reached a pivotal moment called the generative artificial intelligence(AI)era.With...Compared to the last decade when the convolution neu-ral network(CNN)dominated the research field,machine learn-ing(ML)algorithms have reached a pivotal moment called the generative artificial intelligence(AI)era.With the emer-gence of large-scale foundation models[1],such as large multi-modal model(LMM)GPT-4[2]and text-to-image generative model DALL·E[3].展开更多
基金supported in part by NSFC under Grant 62422407in part by RGC under Grant 26204424in part by ACCESS–AI Chip Center for Emerging Smart Systems, sponsored by the Inno HK initiative of the Innovation and Technology Commission of the Hong Kong Special Administrative Region Government
文摘Robotic computing systems play an important role in enabling intelligent robotic tasks through intelligent algo-rithms and supporting hardware.In recent years,the evolution of robotic algorithms indicates a roadmap from traditional robotics to hierarchical and end-to-end models.This algorithmic advancement poses a critical challenge in achieving balanced system-wide performance.Therefore,algorithm-hardware co-design has emerged as the primary methodology,which ana-lyzes algorithm behaviors on hardware to identify common computational properties.These properties can motivate algo-rithm optimization to reduce computational complexity and hardware innovation from architecture to circuit for high performance and high energy efficiency.We then reviewed recent works on robotic and embodied AI algorithms and computing hard-ware to demonstrate this algorithm-hardware co-design methodology.In the end,we discuss future research opportunities by answering two questions:(1)how to adapt the computing platforms to the rapid evolution of embodied AI algorithms,and(2)how to transform the potential of emerging hardware innovations into end-to-end inference improvements.
基金This research was supported in part by ACCESS-AI Chip Center for Emerging Smart Systems,sponsored by InnoHK funding,Hong Kong SAR,and HKUST-HKUST(GZ)20 for 20 Cross-campus Collaborative Research Scheme C031.
文摘Compared to the last decade when the convolution neu-ral network(CNN)dominated the research field,machine learn-ing(ML)algorithms have reached a pivotal moment called the generative artificial intelligence(AI)era.With the emer-gence of large-scale foundation models[1],such as large multi-modal model(LMM)GPT-4[2]and text-to-image generative model DALL·E[3].
