This paper focuses on the effective utilization of data augmentation techniques for 3Dlidar point clouds to enhance the performance of neural network models.These point clouds,which represent spatial information throu...This paper focuses on the effective utilization of data augmentation techniques for 3Dlidar point clouds to enhance the performance of neural network models.These point clouds,which represent spatial information through a collection of 3D coordinates,have found wide-ranging applications.Data augmentation has emerged as a potent solution to the challenges posed by limited labeled data and the need to enhance model generalization capabilities.Much of the existing research is devoted to crafting novel data augmentation methods specifically for 3D lidar point clouds.However,there has been a lack of focus on making the most of the numerous existing augmentation techniques.Addressing this deficiency,this research investigates the possibility of combining two fundamental data augmentation strategies.The paper introduces PolarMix andMix3D,two commonly employed augmentation techniques,and presents a new approach,named RandomFusion.Instead of using a fixed or predetermined combination of augmentation methods,RandomFusion randomly chooses one method from a pool of options for each instance or sample.This innovative data augmentation technique randomly augments each point in the point cloud with either PolarMix or Mix3D.The crux of this strategy is the random choice between PolarMix and Mix3Dfor the augmentation of each point within the point cloud data set.The results of the experiments conducted validate the efficacy of the RandomFusion strategy in enhancing the performance of neural network models for 3D lidar point cloud semantic segmentation tasks.This is achieved without compromising computational efficiency.By examining the potential of merging different augmentation techniques,the research contributes significantly to a more comprehensive understanding of how to utilize existing augmentation methods for 3D lidar point clouds.RandomFusion data augmentation technique offers a simple yet effective method to leverage the diversity of augmentation techniques and boost the robustness of models.The insights gained from this research can pave the way for future work aimed at developing more advanced and efficient data augmentation strategies for 3D lidar point cloud analysis.展开更多
针对现有基于伪点云的3D目标检测算法精度远低于基于真实激光雷达(Light Detection and ranging,LiDar)点云的3D目标检测,本文研究伪点云重构,并提出适合伪点云的3D目标检测网络.考虑到由图像深度转换得到的伪点云稠密且随深度增大逐渐...针对现有基于伪点云的3D目标检测算法精度远低于基于真实激光雷达(Light Detection and ranging,LiDar)点云的3D目标检测,本文研究伪点云重构,并提出适合伪点云的3D目标检测网络.考虑到由图像深度转换得到的伪点云稠密且随深度增大逐渐稀疏,本文提出深度相关伪点云稀疏化方法,在减少后续计算量的同时保留中远距离更多的有效伪点云,实现伪点云重构.本文提出LiDar点云指导下特征分布趋同与语义关联的3D目标检测网络,在网络训练时引入LiDar点云分支来指导伪点云目标特征的生成,使生成的伪点云特征分布趋同于LiDar点云特征分布,从而降低数据源不一致造成的检测性能损失;针对RPN(Region Proposal Network)网络获取的3D候选框内的伪点云间语义关联不足的问题,设计注意力感知模块,在伪点云特征表示中通过注意力机制嵌入点间的语义关联关系,提升3D目标检测精度.在KITTI 3D目标检测数据集上的实验结果表明:现有的3D目标检测网络采用重构后的伪点云,检测精度提升了2.61%;提出的特征分布趋同与语义关联的3D目标检测网络,将基于伪点云的3D目标检测精度再提升0.57%,相比其他优秀的3D目标检测方法在检测精度上也有提升.展开更多
针对现有的基于机载LiDAR数据的滤波算法未能充分利用数据提供的所有信息及其所采用的数据结构表达复杂、存在信息损失等缺陷,提出了一种灰度体素结构分割模型下的机载LiDAR 3D滤波算法。算法首先以综合利用机载LiDAR数据的高程及强度...针对现有的基于机载LiDAR数据的滤波算法未能充分利用数据提供的所有信息及其所采用的数据结构表达复杂、存在信息损失等缺陷,提出了一种灰度体素结构分割模型下的机载LiDAR 3D滤波算法。算法首先以综合利用机载LiDAR数据的高程及强度信息为目的将点云数据规则化为灰度(体素内激光点的平均强度的离散化表示)体素结构,然后基于各体素间的空间连通性和灰度相似性准则,将灰度体素结构分割并标记为若干个3D连通区域,最后依据地面与其它目标的高差特性提取与其对应的3D连通区域。算法优势在于:基于体素结构设计,为3D滤波算法;综合利用了地面目标的几何及辐射特征,对比传统滤波算法可应用于更复杂的场景;滤波结果为3D地面体素形式,可直接用于创建地面3D模型。实验采用国际摄影测量与遥感协会(International Society for Photogrammetry and Remote Sensing,ISPRS)提供的不同密度的机载LiDAR基准测试数据测试了邻域尺度参数的敏感性及提出的算法的有效性,并和其他经典滤波算法做对比。定量评价的结果表明,51邻域为最佳空间邻域尺度;点云密度为0.67点/m2的数据集1的滤波平均完整率、正确率及质量分别为0.9611、0.9248及0.8934;点云密度为4点/m2的数据集2的滤波平均完整率、正确率及质量分别为0.8490、0.8531及0.7404;对比其全经典滤波算法本文算法在高密度点云数据滤波时表现更佳。展开更多
基金funded in part by the Key Project of Nature Science Research for Universities of Anhui Province of China(No.2022AH051720)in part by the Science and Technology Development Fund,Macao SAR(Grant Nos.0093/2022/A2,0076/2022/A2 and 0008/2022/AGJ)in part by the China University Industry-University-Research Collaborative Innovation Fund(No.2021FNA04017).
文摘This paper focuses on the effective utilization of data augmentation techniques for 3Dlidar point clouds to enhance the performance of neural network models.These point clouds,which represent spatial information through a collection of 3D coordinates,have found wide-ranging applications.Data augmentation has emerged as a potent solution to the challenges posed by limited labeled data and the need to enhance model generalization capabilities.Much of the existing research is devoted to crafting novel data augmentation methods specifically for 3D lidar point clouds.However,there has been a lack of focus on making the most of the numerous existing augmentation techniques.Addressing this deficiency,this research investigates the possibility of combining two fundamental data augmentation strategies.The paper introduces PolarMix andMix3D,two commonly employed augmentation techniques,and presents a new approach,named RandomFusion.Instead of using a fixed or predetermined combination of augmentation methods,RandomFusion randomly chooses one method from a pool of options for each instance or sample.This innovative data augmentation technique randomly augments each point in the point cloud with either PolarMix or Mix3D.The crux of this strategy is the random choice between PolarMix and Mix3Dfor the augmentation of each point within the point cloud data set.The results of the experiments conducted validate the efficacy of the RandomFusion strategy in enhancing the performance of neural network models for 3D lidar point cloud semantic segmentation tasks.This is achieved without compromising computational efficiency.By examining the potential of merging different augmentation techniques,the research contributes significantly to a more comprehensive understanding of how to utilize existing augmentation methods for 3D lidar point clouds.RandomFusion data augmentation technique offers a simple yet effective method to leverage the diversity of augmentation techniques and boost the robustness of models.The insights gained from this research can pave the way for future work aimed at developing more advanced and efficient data augmentation strategies for 3D lidar point cloud analysis.
文摘针对现有的基于机载LiDAR数据的滤波算法未能充分利用数据提供的所有信息及其所采用的数据结构表达复杂、存在信息损失等缺陷,提出了一种灰度体素结构分割模型下的机载LiDAR 3D滤波算法。算法首先以综合利用机载LiDAR数据的高程及强度信息为目的将点云数据规则化为灰度(体素内激光点的平均强度的离散化表示)体素结构,然后基于各体素间的空间连通性和灰度相似性准则,将灰度体素结构分割并标记为若干个3D连通区域,最后依据地面与其它目标的高差特性提取与其对应的3D连通区域。算法优势在于:基于体素结构设计,为3D滤波算法;综合利用了地面目标的几何及辐射特征,对比传统滤波算法可应用于更复杂的场景;滤波结果为3D地面体素形式,可直接用于创建地面3D模型。实验采用国际摄影测量与遥感协会(International Society for Photogrammetry and Remote Sensing,ISPRS)提供的不同密度的机载LiDAR基准测试数据测试了邻域尺度参数的敏感性及提出的算法的有效性,并和其他经典滤波算法做对比。定量评价的结果表明,51邻域为最佳空间邻域尺度;点云密度为0.67点/m2的数据集1的滤波平均完整率、正确率及质量分别为0.9611、0.9248及0.8934;点云密度为4点/m2的数据集2的滤波平均完整率、正确率及质量分别为0.8490、0.8531及0.7404;对比其全经典滤波算法本文算法在高密度点云数据滤波时表现更佳。
