摘要
基于PyTorch深度学习框架和OpenCV开源计算机视觉库,利用CenterNet目标检测网络对餐具进行检测,实现无人化分拣装箱。工控机与工业相机通过以太网连接,同时与可编辑逻辑控制器(PLC)和机器人通过Modbus TCP通信。通过相机像素坐标与机器人的世界坐标进行标定,实现了餐具的机器人坐标定位,并控制机器人在分拣线上完成餐具的动态分拣装箱。试验结果表明:当传送速度为5 m·min^(-1)且分拣定位精度≤2 mm时,单台机器人每小时可分拣餐具1800个以上,正确率为100%,达到实用要求。
This article uses the PyTorch deep learning framework and OpenCV open-source computer vision library to detect tableware objects using the CenterNet object detection network and to realize unmanned sorting and packing.The industrial computer was connected to the industrial camera via Ethernet,and Modbus TCP communication was used between the programmable logic controller(PLC)and the robot.By calibrating the camera pixel coordinates with the robot's world coordinates,robot coordinate positioning of tableware was achieved,and the robot was controlled to dynamically sort and pack tableware on the sorting line.The experimental results show that with the conveying speed of 5 m·min^(-1) and the sorting accuracy under 2 mm,more than 1800 tableware pieces can be sorted per hour with a 100%accuracy rate,which meets the practical requirements.
作者
曾伟民
郑东强
周海峰
李波
王云超
ZENG Weimin;ZHENG Dongqiang;ZHOU Haifeng;LI Bo;WANG Yunchao(School of Marine Equipment and Mechanical Engineering,Jimei University,Xiamen 361021,China;School of Marine Engineering,Jimei University,Xiamen 361021,China)
出处
《集美大学学报(自然科学版)》
2025年第4期383-388,共6页
Journal of Jimei University:Natural Science
基金
福建省自然科学基金项目(2021J01839)
福建省教育厅项目(JAT170318)。
关键词
餐具清洗
视觉分拣
手眼标定
深度学习
cleaning of tableware
visual sorting
hand-eye calibration
deep learning
