针对现有SLAM算法在渲染真实感、内存占用和复杂场景适应性方面的不足,提出了一种基于3D Gaussians Splatting的密集SLAM算法——TIGO-SLAM(tensor illumination and Gaussian optimization for indoor SLAM)。该算法集成了基于神经网...针对现有SLAM算法在渲染真实感、内存占用和复杂场景适应性方面的不足,提出了一种基于3D Gaussians Splatting的密集SLAM算法——TIGO-SLAM(tensor illumination and Gaussian optimization for indoor SLAM)。该算法集成了基于神经网络的张量光照模型、改进的高斯遮罩算法以及网格化神经场的几何和颜色属性表示,具体创新包括:a)基于神经网络的张量光照模型,增强镜面反射与漫反射效果,从而提升了渲染真实感;b)通过冗余高斯剔除机制改进高斯遮罩算法,有效降低了内存消耗并提高了实时性;c)结合网格化神经场的几何与颜色属性表示,采用优化的码本存储方式,显著提高了渲染性能和场景重建精度。实验结果表明,TIGO-SLAM在室内场景渲染、内存优化和复杂场景适应性方面均有显著提升,特别是在动态室内环境中的渲染和重建效果表现突出,为SLAM技术在资源受限设备上的应用提供了新的可能。展开更多
With the widespread application of 3D visualization in digital exhibition halls and virtual reality,achieving efficient rendering and high-fidelity presentation has become a key challenge.This study proposes a hybrid ...With the widespread application of 3D visualization in digital exhibition halls and virtual reality,achieving efficient rendering and high-fidelity presentation has become a key challenge.This study proposes a hybrid point cloud generation method that combines traditional sampling with 3D Gaussian splatting,aiming to address the issues of rendering delay and missing details in existing 3D displays.By improving the OBJ model parsing process and incorporating an adaptive area-weighted sampling algorithm,we achieve adaptive point cloud generation based on triangle density.Innovatively,we advance the ellipsoidal parameter estimation process of 3D Gaussian splatting to the point cloud generation stage.By establishing a mathematical relationship between the covariance matrix and local curvature,the generated point cloud naturally exhibits Gaussian distribution characteristics.Experimental results show that,compared to traditional methods,our approach reduces point cloud data by 38% while maintaining equivalent visual quality at a 4096×4096 texture resolution.By introducing mipmap texture optimization strategies and a GPU-accelerated rasterization pipeline,stable rendering at 60 frames per second is achieved in a WebGL environment.Additionally,we quantize and compress the spherical harmonic function parameters specific to 3D Gaussian splatting,reducing network transmission bandwidth to 52% of the original data.This study provides a new technical pathway for fields requiring high-precision display,such as the digitization of cultural heritage.展开更多
The mechanical properties of thermally sprayed metallic coatings are limited by the bonding between splats.In this study,tungsten coatings were deposited at different deposition temperatures by controlling the substra...The mechanical properties of thermally sprayed metallic coatings are limited by the bonding between splats.In this study,tungsten coatings were deposited at different deposition temperatures by controlling the substrate temperature through shrouded plasma spraying.The dependence of the splat bonding and mechanical properties of W coatings on deposition temperature was investigated.The results showed that the apparent porosity of the coatings decreased from 3.2%to 0.3%with the increase of the deposition temperature.The Young's modulus of W coating was significantly increased from 128 to 307 GPa as the deposition temperature increased from room temperature to 800°C.The microhardness of the coatings was less influenced by the deposition temperature.It was found that splat bonding across lamellae was formed when the deposition temperature was higher than 600°C compared to the obvious lamellae interface in the coatings deposited at temperatures lower than 600°C.The results evidently revealed that the mechanical properties of plasma-sprayed W coatings could be controlled through the splat bonding by altering deposition temperature.展开更多
Plasma sprayed coatings are built up by the accumulation of splats formed by the impacting,spreading and solidifying of molten droplets on the substrate.A three-dimensional computational model including heat transfer ...Plasma sprayed coatings are built up by the accumulation of splats formed by the impacting,spreading and solidifying of molten droplets on the substrate.A three-dimensional computational model including heat transfer and solidification is established to simulate the formation process of a single splat using the computational fluid dynamics(CFD)software,FLUENT.The fluid flow and energy equations are discretized and solved according to typical finite volume method on an unstructured grid.A volume of fluid(VOF)tracking algorithm is used to track the droplet flow with free surface.In order to understand the splat formation mechanism,the process of splat formation caused by impacting and spreading of a molten nickel droplet on a polished mild steel surface is simulated.On this basis,the simulations of impact of a molten droplet on substrate with different conditions including the surface morphology,thermal conductivity,initial temperature of the substrate and the thermal contact resistance are presented.The results clearly show the effect of those parameters on the shape of the final splat and splash behaviors.展开更多
Elliptical splats are used to represent and render the isosurface of volume data. The method consists of two steps. The first step is to extract points on the isosurface by looking up the case table. In the second ste...Elliptical splats are used to represent and render the isosurface of volume data. The method consists of two steps. The first step is to extract points on the isosurface by looking up the case table. In the second step, properties of splats are computed based on local geometry. Rendering is achieved using surface splatting algorithm. The obtained results show that the extraction time of isosurfaces can be reduced by a factor of three. So our approach is more appropriate for interactive visualization of large medical data than the classical marching cubes (MC) technique.展开更多
Plasma spray forming shows overwhelming advantages in rapid fabricating parts and moulds. The coating microstructure is strongly dependent on the splat morphology and inter-splat contact nature. Therefore,it is necess...Plasma spray forming shows overwhelming advantages in rapid fabricating parts and moulds. The coating microstructure is strongly dependent on the splat morphology and inter-splat contact nature. Therefore,it is necessary to investigate the splat formation mechanism in order to analyze the coating properties. A dynamical process of a single fully molten droplet impacting onto a smooth surface was investigated. At the same time,the interaction between the two molten droplets in the horizontal and vertical directions was also simulated. Finally,the simulations of impact of a molten droplet on an inclined plane and a sharp edge were presented. It is concluded that the relative distance of the two droplets strongly influences the dynamics of the two droplets interaction. The various surface conditions have direct effects on the dynamics of splat formation. When a droplet impacts onto an inclined surface and a sharp edge,the splat morphology changes obviously and the phenomenon of break up is observed.展开更多
Generating and inserting new objects into 3D content is a compelling approach for achieving versatile scene recreation.Existing methods,which rely on SDS optimization or single-view inpainting,often struggle to produc...Generating and inserting new objects into 3D content is a compelling approach for achieving versatile scene recreation.Existing methods,which rely on SDS optimization or single-view inpainting,often struggle to produce high-quality results.To address this,we propose a novel method for object inser-tion in 3D content represented by Gaussian Splatting.Our approach introduces a multi-view diffusion model,dubbed MVInpainter,which is built upon a pre-trained stable video diffusion model to facilitate view-consistent object inpainting.Within MVInpainter,we incorporate a ControlNet-based conditional injection module to enable controlled and more predictable multi-view generation.After generating the multi-view inpainted results,we further propose a mask-aware 3D reconstruction technique to refine Gaussian Splatting reconstruction from these sparse inpainted views.By leveraging these fabricate techniques,our approach yields diverse results,ensures view-consistent and harmonious insertions,and produces better object quality.Extensive experiments demonstrate that our approach outperforms existing methods.展开更多
文摘针对现有SLAM算法在渲染真实感、内存占用和复杂场景适应性方面的不足,提出了一种基于3D Gaussians Splatting的密集SLAM算法——TIGO-SLAM(tensor illumination and Gaussian optimization for indoor SLAM)。该算法集成了基于神经网络的张量光照模型、改进的高斯遮罩算法以及网格化神经场的几何和颜色属性表示,具体创新包括:a)基于神经网络的张量光照模型,增强镜面反射与漫反射效果,从而提升了渲染真实感;b)通过冗余高斯剔除机制改进高斯遮罩算法,有效降低了内存消耗并提高了实时性;c)结合网格化神经场的几何与颜色属性表示,采用优化的码本存储方式,显著提高了渲染性能和场景重建精度。实验结果表明,TIGO-SLAM在室内场景渲染、内存优化和复杂场景适应性方面均有显著提升,特别是在动态室内环境中的渲染和重建效果表现突出,为SLAM技术在资源受限设备上的应用提供了新的可能。
文摘With the widespread application of 3D visualization in digital exhibition halls and virtual reality,achieving efficient rendering and high-fidelity presentation has become a key challenge.This study proposes a hybrid point cloud generation method that combines traditional sampling with 3D Gaussian splatting,aiming to address the issues of rendering delay and missing details in existing 3D displays.By improving the OBJ model parsing process and incorporating an adaptive area-weighted sampling algorithm,we achieve adaptive point cloud generation based on triangle density.Innovatively,we advance the ellipsoidal parameter estimation process of 3D Gaussian splatting to the point cloud generation stage.By establishing a mathematical relationship between the covariance matrix and local curvature,the generated point cloud naturally exhibits Gaussian distribution characteristics.Experimental results show that,compared to traditional methods,our approach reduces point cloud data by 38% while maintaining equivalent visual quality at a 4096×4096 texture resolution.By introducing mipmap texture optimization strategies and a GPU-accelerated rasterization pipeline,stable rendering at 60 frames per second is achieved in a WebGL environment.Additionally,we quantize and compress the spherical harmonic function parameters specific to 3D Gaussian splatting,reducing network transmission bandwidth to 52% of the original data.This study provides a new technical pathway for fields requiring high-precision display,such as the digitization of cultural heritage.
基金National Natural Science Foundations of China(50725101)
文摘The mechanical properties of thermally sprayed metallic coatings are limited by the bonding between splats.In this study,tungsten coatings were deposited at different deposition temperatures by controlling the substrate temperature through shrouded plasma spraying.The dependence of the splat bonding and mechanical properties of W coatings on deposition temperature was investigated.The results showed that the apparent porosity of the coatings decreased from 3.2%to 0.3%with the increase of the deposition temperature.The Young's modulus of W coating was significantly increased from 128 to 307 GPa as the deposition temperature increased from room temperature to 800°C.The microhardness of the coatings was less influenced by the deposition temperature.It was found that splat bonding across lamellae was formed when the deposition temperature was higher than 600°C compared to the obvious lamellae interface in the coatings deposited at temperatures lower than 600°C.The results evidently revealed that the mechanical properties of plasma-sprayed W coatings could be controlled through the splat bonding by altering deposition temperature.
文摘Plasma sprayed coatings are built up by the accumulation of splats formed by the impacting,spreading and solidifying of molten droplets on the substrate.A three-dimensional computational model including heat transfer and solidification is established to simulate the formation process of a single splat using the computational fluid dynamics(CFD)software,FLUENT.The fluid flow and energy equations are discretized and solved according to typical finite volume method on an unstructured grid.A volume of fluid(VOF)tracking algorithm is used to track the droplet flow with free surface.In order to understand the splat formation mechanism,the process of splat formation caused by impacting and spreading of a molten nickel droplet on a polished mild steel surface is simulated.On this basis,the simulations of impact of a molten droplet on substrate with different conditions including the surface morphology,thermal conductivity,initial temperature of the substrate and the thermal contact resistance are presented.The results clearly show the effect of those parameters on the shape of the final splat and splash behaviors.
基金the Program of Advance Research between France and Chinese(No.PRA SI 03-03)the Region Rhone-Alpes of France within the Project"MIRA Research 2003"the Project of Image Guided Surgery of Shanghai,China(No.045115001)
文摘Elliptical splats are used to represent and render the isosurface of volume data. The method consists of two steps. The first step is to extract points on the isosurface by looking up the case table. In the second step, properties of splats are computed based on local geometry. Rendering is achieved using surface splatting algorithm. The obtained results show that the extraction time of isosurfaces can be reduced by a factor of three. So our approach is more appropriate for interactive visualization of large medical data than the classical marching cubes (MC) technique.
基金Project (50675072) supported by the National Natural Science Foundation of Chinaprojects (E0610018, 20062178) supported by the Natural Science Foundation of Fujian Province and Liaoning Province, China, respectively
文摘Plasma spray forming shows overwhelming advantages in rapid fabricating parts and moulds. The coating microstructure is strongly dependent on the splat morphology and inter-splat contact nature. Therefore,it is necessary to investigate the splat formation mechanism in order to analyze the coating properties. A dynamical process of a single fully molten droplet impacting onto a smooth surface was investigated. At the same time,the interaction between the two molten droplets in the horizontal and vertical directions was also simulated. Finally,the simulations of impact of a molten droplet on an inclined plane and a sharp edge were presented. It is concluded that the relative distance of the two droplets strongly influences the dynamics of the two droplets interaction. The various surface conditions have direct effects on the dynamics of splat formation. When a droplet impacts onto an inclined surface and a sharp edge,the splat morphology changes obviously and the phenomenon of break up is observed.
文摘Generating and inserting new objects into 3D content is a compelling approach for achieving versatile scene recreation.Existing methods,which rely on SDS optimization or single-view inpainting,often struggle to produce high-quality results.To address this,we propose a novel method for object inser-tion in 3D content represented by Gaussian Splatting.Our approach introduces a multi-view diffusion model,dubbed MVInpainter,which is built upon a pre-trained stable video diffusion model to facilitate view-consistent object inpainting.Within MVInpainter,we incorporate a ControlNet-based conditional injection module to enable controlled and more predictable multi-view generation.After generating the multi-view inpainted results,we further propose a mask-aware 3D reconstruction technique to refine Gaussian Splatting reconstruction from these sparse inpainted views.By leveraging these fabricate techniques,our approach yields diverse results,ensures view-consistent and harmonious insertions,and produces better object quality.Extensive experiments demonstrate that our approach outperforms existing methods.
