为了解决工厂烟草滤嘴纸盒码垛过程中易发生错误的问题,并提高码垛效率,提出了一种基于改进SGBM(Semi-Global Block Matching)算法与轻量化YOLOv5s网络结构相结合的识别检测与定位一体化方法。首先,采用MobileNetv3作为YOLOv5s的主干网...为了解决工厂烟草滤嘴纸盒码垛过程中易发生错误的问题,并提高码垛效率,提出了一种基于改进SGBM(Semi-Global Block Matching)算法与轻量化YOLOv5s网络结构相结合的识别检测与定位一体化方法。首先,采用MobileNetv3作为YOLOv5s的主干网络,以降低模型的复杂度、提高检测速率;其次,将AD-Census(Absolute Differences-Census)代价计算方法应用于SGBM算法中,以提高测距精度。实验结果显示,在自建数据集上,该方法获得的mAP(mean Average Precision)达到91.2%,帧率FPS(Frames Per Second)达到30.8,可以准确识别出纸盒的类别与位置,可为烟草滤嘴盒自动码垛机器人提供视觉系统技术支持。展开更多
Gray cross correlation matching technique is adopted to extract candidate matches with gray cross correlation coefficients less than some certain range of maximal correlation coefficient called multi-peak candidate ma...Gray cross correlation matching technique is adopted to extract candidate matches with gray cross correlation coefficients less than some certain range of maximal correlation coefficient called multi-peak candidate matches. Multi-peak candidates are extracted corresponding to three closest feature points at first. The corresponding multi-peak candidate matches are used to construct the model polygon. Correspondence is determined based on the local geometric relations between the three feature points and the multi-peak candidates. The disparity test and the global consistency checkout are applied to eliminate the remaining ambiguous matches that are not removed by the local geometric relational test. Experimental results show that the proposed algorithm is feasible and accurate.展开更多
A binocular stereo vision positioning method based on the scale-invariant feature trans- form （SIFT） algorithm is proposed. The SIFT algorithm is for extracting distinctive invariant features from images. First, ima...A binocular stereo vision positioning method based on the scale-invariant feature trans- form （SIFT） algorithm is proposed. The SIFT algorithm is for extracting distinctive invariant features from images. First, image median filtering is used to eliminate image noise. Then, according to the characteristics of the target satellite, image map is used to extract the middle part of the target satel- lite. At last, the feature match point under the SIFT algorithm is extracted, and the three-dimension- al position and orientation are calculated. The features are invariant to image scale and rotation, and are shown to provide robust matching across a substantial range of affine distortion, change in 3D viewpoint, addition of noise, and change in illumination. The experimental result shows that the al- gorithm works well and the maximum relative error is within 0. 02 m and 2.5 o展开更多
The dense and accurate measurement of 3D texture is helpful in evaluating the pavement function.To form dense mandatory constraints and improve matching accuracy,the traditional binocular reconstruction technology was...The dense and accurate measurement of 3D texture is helpful in evaluating the pavement function.To form dense mandatory constraints and improve matching accuracy,the traditional binocular reconstruction technology was improved threefold.First,a single moving laser line was introduced to carry out global scanning constraints on the target,which would well overcome the difficulty of installing and recognizing excessive laser lines.Second,four kinds of improved algorithms,namely,disparity replacement,superposition synthesis,subregion segmentation,and subregion segmentation centroid enhancement,were established based on different constraint mechanism.Last,the improved binocular reconstruction test device was developed to realize the dual functions of 3D texture measurement and precision self-evaluation.Results show that compared with traditional algorithms,the introduction of a single laser line scanning constraint is helpful in improving the measurement’s accuracy.Among various improved algorithms,the improvement effect of the subregion segmentation centroid enhancement method is the best.It has a good effect on both overall measurement and single pointmeasurement,which can be considered to be used in pavement function evaluation.展开更多
为实现完整熔池表面形貌三维传感,构建了双棱镜单摄像机立体视觉传感系统.针对熔池图像纹理缺乏造成的立体匹配困难的问题,引入了全局优化的变分立体匹配算法,通过建立包含灰度差异数据项和空间连续性约束项的能量函数的可行性泛函,经...为实现完整熔池表面形貌三维传感,构建了双棱镜单摄像机立体视觉传感系统.针对熔池图像纹理缺乏造成的立体匹配困难的问题,引入了全局优化的变分立体匹配算法,通过建立包含灰度差异数据项和空间连续性约束项的能量函数的可行性泛函,经过迭代求解获得具有丰富细节的熔池表面稠密视差图.对自制非标准凹面形状进行立体匹配和三维重建,结果表明,宽度误差小于3.16%,深度误差小于4.82%.基于该算法实现了熔化极气体保护焊(gas metal arc welding,GMAW)的堆焊及V形坡口对焊条件下,不同熔透状态熔池稠密视差图计算和表面形貌的三维重建.展开更多
文摘为了解决工厂烟草滤嘴纸盒码垛过程中易发生错误的问题,并提高码垛效率,提出了一种基于改进SGBM(Semi-Global Block Matching)算法与轻量化YOLOv5s网络结构相结合的识别检测与定位一体化方法。首先,采用MobileNetv3作为YOLOv5s的主干网络,以降低模型的复杂度、提高检测速率;其次,将AD-Census(Absolute Differences-Census)代价计算方法应用于SGBM算法中,以提高测距精度。实验结果显示,在自建数据集上,该方法获得的mAP(mean Average Precision)达到91.2%,帧率FPS(Frames Per Second)达到30.8,可以准确识别出纸盒的类别与位置,可为烟草滤嘴盒自动码垛机器人提供视觉系统技术支持。
基金the Leading Academic Discipline Project of Shanghai Educational Committee of China(J50104)the Shanghai Leading Academic Disciplines of China(T0102)
文摘Gray cross correlation matching technique is adopted to extract candidate matches with gray cross correlation coefficients less than some certain range of maximal correlation coefficient called multi-peak candidate matches. Multi-peak candidates are extracted corresponding to three closest feature points at first. The corresponding multi-peak candidate matches are used to construct the model polygon. Correspondence is determined based on the local geometric relations between the three feature points and the multi-peak candidates. The disparity test and the global consistency checkout are applied to eliminate the remaining ambiguous matches that are not removed by the local geometric relational test. Experimental results show that the proposed algorithm is feasible and accurate.
文摘A binocular stereo vision positioning method based on the scale-invariant feature trans- form （SIFT） algorithm is proposed. The SIFT algorithm is for extracting distinctive invariant features from images. First, image median filtering is used to eliminate image noise. Then, according to the characteristics of the target satellite, image map is used to extract the middle part of the target satel- lite. At last, the feature match point under the SIFT algorithm is extracted, and the three-dimension- al position and orientation are calculated. The features are invariant to image scale and rotation, and are shown to provide robust matching across a substantial range of affine distortion, change in 3D viewpoint, addition of noise, and change in illumination. The experimental result shows that the al- gorithm works well and the maximum relative error is within 0. 02 m and 2.5 o
基金supported by National Natural Science Foundation of China (52178422)Doctoral Research Foundation of Hubei University of Arts and Science (2059047)National College Students’Innovation and Entrepreneurship Training Program (202210519021).
文摘The dense and accurate measurement of 3D texture is helpful in evaluating the pavement function.To form dense mandatory constraints and improve matching accuracy,the traditional binocular reconstruction technology was improved threefold.First,a single moving laser line was introduced to carry out global scanning constraints on the target,which would well overcome the difficulty of installing and recognizing excessive laser lines.Second,four kinds of improved algorithms,namely,disparity replacement,superposition synthesis,subregion segmentation,and subregion segmentation centroid enhancement,were established based on different constraint mechanism.Last,the improved binocular reconstruction test device was developed to realize the dual functions of 3D texture measurement and precision self-evaluation.Results show that compared with traditional algorithms,the introduction of a single laser line scanning constraint is helpful in improving the measurement’s accuracy.Among various improved algorithms,the improvement effect of the subregion segmentation centroid enhancement method is the best.It has a good effect on both overall measurement and single pointmeasurement,which can be considered to be used in pavement function evaluation.
文摘为实现完整熔池表面形貌三维传感,构建了双棱镜单摄像机立体视觉传感系统.针对熔池图像纹理缺乏造成的立体匹配困难的问题,引入了全局优化的变分立体匹配算法,通过建立包含灰度差异数据项和空间连续性约束项的能量函数的可行性泛函,经过迭代求解获得具有丰富细节的熔池表面稠密视差图.对自制非标准凹面形状进行立体匹配和三维重建,结果表明,宽度误差小于3.16%,深度误差小于4.82%.基于该算法实现了熔化极气体保护焊(gas metal arc welding,GMAW)的堆焊及V形坡口对焊条件下,不同熔透状态熔池稠密视差图计算和表面形貌的三维重建.
