目前各个研究组织和专家正在进行基于Web浏览器的P2P实时通信技术(Real time communication in browsers:RTC Web)的研究,通过此技术,浏览器可以实时运用P2P的特性传送内容而不需要中间服务器和额外的插件或者外挂程序。但阻碍这项技术...目前各个研究组织和专家正在进行基于Web浏览器的P2P实时通信技术(Real time communication in browsers:RTC Web)的研究,通过此技术,浏览器可以实时运用P2P的特性传送内容而不需要中间服务器和额外的插件或者外挂程序。但阻碍这项技术研究和应用的一大问题在于安全性。针对普遍性的P2P实时通信安全性问题及对策,做了简要的归纳;并对RTCWeb带来的新的安全性问题-暴露的JS API,浏览器直接访问本地资源,DDos,协议仿真攻击等作了简单介绍和分析。展开更多
The mixed reality conference system proposed in this paper is a robust,real-time video conference application software that makes up for the simple interaction and lack of immersion and realism of traditional video co...The mixed reality conference system proposed in this paper is a robust,real-time video conference application software that makes up for the simple interaction and lack of immersion and realism of traditional video conference,which realizes the entire process of holographic video conference from client to cloud to the client.This paper mainly focuses on designing and implementing a video conference system based on AI segmentation technology and mixed reality.Several mixed reality conference system components are discussed,including data collection,data transmission,processing,and mixed reality presentation.The data layer is mainly used for data collection,integration,and video and audio codecs.The network layer uses Web-RTC to realize peer-to-peer data communication.The data processing layer is the core part of the system,mainly for human video matting and human-computer interaction,which is the key to realizing mixed reality conferences and improving the interactive experience.The presentation layer explicitly includes the login interface of the mixed reality conference system,the presentation of real-time matting of human subjects,and the presentation objects.With the mixed reality conference system,conference participants in different places can see each other in real-time in their mixed reality scene and share presentation content and 3D models based on mixed reality technology to have a more interactive and immersive experience.展开更多
文摘目前各个研究组织和专家正在进行基于Web浏览器的P2P实时通信技术(Real time communication in browsers:RTC Web)的研究,通过此技术,浏览器可以实时运用P2P的特性传送内容而不需要中间服务器和额外的插件或者外挂程序。但阻碍这项技术研究和应用的一大问题在于安全性。针对普遍性的P2P实时通信安全性问题及对策,做了简要的归纳;并对RTCWeb带来的新的安全性问题-暴露的JS API,浏览器直接访问本地资源,DDos,协议仿真攻击等作了简单介绍和分析。
基金supported in part by the Major Fundamental Research of Natural Science Foundation of Shandong Province under Grant ZR2019ZD05Joint fund for smart computing of Shandong Natural Science Foundation under Grant ZR2020LZH013+1 种基金Open project of State Key Laboratory of Computer Architecture CARCHA202002Human Video Matting Project of Hisense Co.,Ltd.under Grant QD1170020023.
文摘The mixed reality conference system proposed in this paper is a robust,real-time video conference application software that makes up for the simple interaction and lack of immersion and realism of traditional video conference,which realizes the entire process of holographic video conference from client to cloud to the client.This paper mainly focuses on designing and implementing a video conference system based on AI segmentation technology and mixed reality.Several mixed reality conference system components are discussed,including data collection,data transmission,processing,and mixed reality presentation.The data layer is mainly used for data collection,integration,and video and audio codecs.The network layer uses Web-RTC to realize peer-to-peer data communication.The data processing layer is the core part of the system,mainly for human video matting and human-computer interaction,which is the key to realizing mixed reality conferences and improving the interactive experience.The presentation layer explicitly includes the login interface of the mixed reality conference system,the presentation of real-time matting of human subjects,and the presentation objects.With the mixed reality conference system,conference participants in different places can see each other in real-time in their mixed reality scene and share presentation content and 3D models based on mixed reality technology to have a more interactive and immersive experience.
