At present,automatic broccoli harvest in field still faces some issues.It is difficult to segment broccoli in real time under complex field background,and hard to pick tilt-growing broccoli for the end-effector of rob...At present,automatic broccoli harvest in field still faces some issues.It is difficult to segment broccoli in real time under complex field background,and hard to pick tilt-growing broccoli for the end-effector of robot.In this research,an improved YOLOv8n-seg model,named YOLO-Broccoli-Seg was proposed for broccoli recognition.Through adding a triplet attention module to YOLOv8-Seg model,the feature fusion capability of the algorithm is improved significantly.The mean average precision mAP50(Mask),mAP95(Mask),mAP50(Bounding Box,Bbox)and mAP95(Bbox)of YOLO-Broccoli-Seg are 0.973,0.683,0.973 and 0.748 respectively.Precision P-value was improved the most,with an increment of 8.7%.In addition,an attitude estimation method based on three-dimensional point cloud is proposed.When the tilt angle of broccoli is between−30°and 30°,the R2 between the estimated value and the true value is 0.934.It indicated that this method can well represent the growth attitude of broccoli.This research can provide the rich broccoli information and technical basis for the automated broccoli picking.展开更多
基金supported by National Innovation Park for Forestry and Grass Equipments[grant numbers 2023YG08]Zhejiang Province Agricultural Machinery Research,Manufacturing and Application Integration Project[grant numbers 2023-YT-06]+1 种基金the Zhejiang University-Yongkang Intelligent Agricultural Machinery Equipment Joint Research Center[grant numbers Zdyk2303Y]the Jiangsu Province and Education Ministry Co-sponsored Synergistic Innovation Center of Modern Agricultural Equipment[grant number XTCX2009].
文摘At present,automatic broccoli harvest in field still faces some issues.It is difficult to segment broccoli in real time under complex field background,and hard to pick tilt-growing broccoli for the end-effector of robot.In this research,an improved YOLOv8n-seg model,named YOLO-Broccoli-Seg was proposed for broccoli recognition.Through adding a triplet attention module to YOLOv8-Seg model,the feature fusion capability of the algorithm is improved significantly.The mean average precision mAP50(Mask),mAP95(Mask),mAP50(Bounding Box,Bbox)and mAP95(Bbox)of YOLO-Broccoli-Seg are 0.973,0.683,0.973 and 0.748 respectively.Precision P-value was improved the most,with an increment of 8.7%.In addition,an attitude estimation method based on three-dimensional point cloud is proposed.When the tilt angle of broccoli is between−30°and 30°,the R2 between the estimated value and the true value is 0.934.It indicated that this method can well represent the growth attitude of broccoli.This research can provide the rich broccoli information and technical basis for the automated broccoli picking.
