As 3D acquisition technology develops and 3D sensors become increasingly affordable,large quantities of 3D point cloud data are emerging.How to effectively learn and extract the geometric features from these point clo...As 3D acquisition technology develops and 3D sensors become increasingly affordable,large quantities of 3D point cloud data are emerging.How to effectively learn and extract the geometric features from these point clouds has become an urgent problem to be solved.The point cloud geometric information is hidden in disordered,unstructured points,making point cloud analysis a very challenging problem.To address this problem,we propose a novel network framework,called Tree Graph Network(TGNet),which can sample,group,and aggregate local geometric features.Specifically,we construct a Tree Graph by explicit rules,which consists of curves extending in all directions in point cloud feature space,and then aggregate the features of the graph through a cross-attention mechanism.In this way,we incorporate more point cloud geometric structure information into the representation of local geometric features,which makes our network perform better.Our model performs well on several basic point clouds processing tasks such as classification,segmentation,and normal estimation,demonstrating the effectiveness and superiority of our network.Furthermore,we provide ablation experiments and visualizations to better understand our network.展开更多
Data augmentation is a widely used regularization strategy in deep neural networks to mitigate overfitting and enhance generalization.In the context of point cloud data,mixing two samples to generate new training exam...Data augmentation is a widely used regularization strategy in deep neural networks to mitigate overfitting and enhance generalization.In the context of point cloud data,mixing two samples to generate new training examples has proven to be effective.In this paper,we propose a novel and effective approach called Farthest Point Sampling Mix(FPSMix)for augmenting point cloud data.Our method leverages farthest point sampling,a technique used in point cloud processing,to generate new samples by mixing points from two original point clouds.Another key innovation of our approach is the introduction of a significance-based loss function,which assigns weights to the soft labels of the mixed samples based on the classification loss of each part of the new sample that is separated from the two original point clouds.This way,our method takes into account the importance of different parts of the mixed sample during the training process,allowing the model to learn better global features.Experimental results demonstrate that our FPSMix,combined with the significance-based loss function,improves the classification accuracy of point cloud models and achieves comparable performance with state-of-the-art data augmentation methods.Moreover,our approach is complementary to techniques that focus on local features,and their combined use further enhances the classification accuracy of the baseline model.展开更多
基金supported by the National Natural Science Foundation of China (Grant Nos.91948203,52075532).
文摘As 3D acquisition technology develops and 3D sensors become increasingly affordable,large quantities of 3D point cloud data are emerging.How to effectively learn and extract the geometric features from these point clouds has become an urgent problem to be solved.The point cloud geometric information is hidden in disordered,unstructured points,making point cloud analysis a very challenging problem.To address this problem,we propose a novel network framework,called Tree Graph Network(TGNet),which can sample,group,and aggregate local geometric features.Specifically,we construct a Tree Graph by explicit rules,which consists of curves extending in all directions in point cloud feature space,and then aggregate the features of the graph through a cross-attention mechanism.In this way,we incorporate more point cloud geometric structure information into the representation of local geometric features,which makes our network perform better.Our model performs well on several basic point clouds processing tasks such as classification,segmentation,and normal estimation,demonstrating the effectiveness and superiority of our network.Furthermore,we provide ablation experiments and visualizations to better understand our network.
基金supported by the National Key R&D Program of China(No.2020YFB1708002)the National Natural Science Foundation of China(Grant Nos.62371009 and 61971008).
文摘Data augmentation is a widely used regularization strategy in deep neural networks to mitigate overfitting and enhance generalization.In the context of point cloud data,mixing two samples to generate new training examples has proven to be effective.In this paper,we propose a novel and effective approach called Farthest Point Sampling Mix(FPSMix)for augmenting point cloud data.Our method leverages farthest point sampling,a technique used in point cloud processing,to generate new samples by mixing points from two original point clouds.Another key innovation of our approach is the introduction of a significance-based loss function,which assigns weights to the soft labels of the mixed samples based on the classification loss of each part of the new sample that is separated from the two original point clouds.This way,our method takes into account the importance of different parts of the mixed sample during the training process,allowing the model to learn better global features.Experimental results demonstrate that our FPSMix,combined with the significance-based loss function,improves the classification accuracy of point cloud models and achieves comparable performance with state-of-the-art data augmentation methods.Moreover,our approach is complementary to techniques that focus on local features,and their combined use further enhances the classification accuracy of the baseline model.
