Understanding the connection between brain and behavior in animals requires precise monitoring of their behaviors in three-dimensional(3-D)space.However,there is no available three-dimensional behavior capture system ...Understanding the connection between brain and behavior in animals requires precise monitoring of their behaviors in three-dimensional(3-D)space.However,there is no available three-dimensional behavior capture system that focuses on rodents.Here,we present MouseVenue3D,an automated and low-cost system for the efficient capture of 3-D skeleton trajectories in markerless rodents.We improved the most time-consuming step in 3-D behavior capturing by developing an automatic calibration module.Then,we validated this process in behavior recognition tasks,and showed that 3-D behavioral data achieved higher accuracy than 2-D data.Subsequently,MouseVenue3D was combined with fast high-resolution miniature two-photon microscopy for synchronous neural recording and behavioral tracking in the freely-moving mouse.Finally,we successfully decoded spontaneous neuronal activity from the 3-D behavior of mice.Our findings reveal that subtle,spontaneous behavior modules are strongly correlated with spontaneous neuronal activity patterns.展开更多
在突发事件场景中,个体的行为和心理具有较强的复杂性和动态性,是真实感群体行为模拟所面临的一大挑战。将虚拟现实和游戏技术相结合,设计了虚拟现实火灾逃生游戏VRFEG(Virtual Reality Fire Escape Game),并对用户的应急行为进行有效...在突发事件场景中,个体的行为和心理具有较强的复杂性和动态性,是真实感群体行为模拟所面临的一大挑战。将虚拟现实和游戏技术相结合,设计了虚拟现实火灾逃生游戏VRFEG(Virtual Reality Fire Escape Game),并对用户的应急行为进行有效的评估分析。VRFEG主要由交互式情节设计、架构设计、数据采集和行为分析等四个模块组成。实验表明,VRFEG系统具有直观、易用等特点,能让人们在感受游戏刺激的同时学习到一些应急逃生的技能,也为获取人们在突发状况下的部分行为数据提供了一个有效和有趣的通道。展开更多
基金the Key Area R&D Program of Guangdong Province,China(2018B030338001 and 2018B030331001)the National Key R&D Program of China(2018YFA0701403)+11 种基金the National Natural Science Foundation of China(31500861,31630031,91732304,and 31930047)Chang Jiang Scholars Program,the International Big Science Program Cultivating Project of the Chinese Academy of Science(CAS172644KYS820170004)the Strategic Priority Research Program of the CAS(XDB32030100)the Youth Innovation Promotion Association of the CAS(2017413)the CAS Key Laboratory of Brain Connectome and Manipulation(2019DP173024)Shenzhen Government Basic Research Grants(JCYJ20170411140807570,JCYJ20170413164535041)the Science,Technology and Innovation Commission of Shenzhen Municipality(JCYJ20160429185235132)a Helmholtz-CAS Joint Research grant(GJHZ1508)Guangdong Provincial Key Laboratory of Brain Connectome and Behavior(2017B030301017)the Ten Thousand Talent Program,the Guangdong Special Support Program,Key Laboratory of Shenzhen Institute of Advanced Technology(2019DP173024)the Shenzhen Key Science and Technology Infrastructure Planning Project(ZDKJ20190204002).
文摘Understanding the connection between brain and behavior in animals requires precise monitoring of their behaviors in three-dimensional(3-D)space.However,there is no available three-dimensional behavior capture system that focuses on rodents.Here,we present MouseVenue3D,an automated and low-cost system for the efficient capture of 3-D skeleton trajectories in markerless rodents.We improved the most time-consuming step in 3-D behavior capturing by developing an automatic calibration module.Then,we validated this process in behavior recognition tasks,and showed that 3-D behavioral data achieved higher accuracy than 2-D data.Subsequently,MouseVenue3D was combined with fast high-resolution miniature two-photon microscopy for synchronous neural recording and behavioral tracking in the freely-moving mouse.Finally,we successfully decoded spontaneous neuronal activity from the 3-D behavior of mice.Our findings reveal that subtle,spontaneous behavior modules are strongly correlated with spontaneous neuronal activity patterns.
文摘在突发事件场景中,个体的行为和心理具有较强的复杂性和动态性,是真实感群体行为模拟所面临的一大挑战。将虚拟现实和游戏技术相结合,设计了虚拟现实火灾逃生游戏VRFEG(Virtual Reality Fire Escape Game),并对用户的应急行为进行有效的评估分析。VRFEG主要由交互式情节设计、架构设计、数据采集和行为分析等四个模块组成。实验表明,VRFEG系统具有直观、易用等特点,能让人们在感受游戏刺激的同时学习到一些应急逃生的技能,也为获取人们在突发状况下的部分行为数据提供了一个有效和有趣的通道。
