In the aviation industry,cable bracket is one of the most common parts.The traditional assembly state inspection method of cable bracket is to manually compare by viewing 3 D models.The purpose of this paper is to add...In the aviation industry,cable bracket is one of the most common parts.The traditional assembly state inspection method of cable bracket is to manually compare by viewing 3 D models.The purpose of this paper is to address the problem of inefficiency of traditional inspection method.In order to solve the problem that machine learning algorithm requires large dataset and manually labeling of dataset is a laborious and time-consuming task,a simulation platform is developed to automatically generate synthetic realistic brackets images with pixel-level annotations based on 3 D digital mock-up.In order to obtain accurate shapes of brackets from 2 D image,a brackets recognizer based on Mask R-CNN is trained.In addition,a semi-automatic cable bracket inspection method is proposed.With this method,the inspector can easily obtain the inspection result only by taking a picture with a portable device,such as augmented reality(AR)glasses.The inspection task will be automatically executed via bracket recognition and matching.The experimental result shows that the proposed method for automatically labeling dataset is valid and the proposed cable bracket inspection method can effectively inspect cable bracket in the aircraft.Finally,a prototype system based on client-server framework has been developed for validation purpose.展开更多
基金supported by the Civil Airplane Technology Development Program。
文摘In the aviation industry,cable bracket is one of the most common parts.The traditional assembly state inspection method of cable bracket is to manually compare by viewing 3 D models.The purpose of this paper is to address the problem of inefficiency of traditional inspection method.In order to solve the problem that machine learning algorithm requires large dataset and manually labeling of dataset is a laborious and time-consuming task,a simulation platform is developed to automatically generate synthetic realistic brackets images with pixel-level annotations based on 3 D digital mock-up.In order to obtain accurate shapes of brackets from 2 D image,a brackets recognizer based on Mask R-CNN is trained.In addition,a semi-automatic cable bracket inspection method is proposed.With this method,the inspector can easily obtain the inspection result only by taking a picture with a portable device,such as augmented reality(AR)glasses.The inspection task will be automatically executed via bracket recognition and matching.The experimental result shows that the proposed method for automatically labeling dataset is valid and the proposed cable bracket inspection method can effectively inspect cable bracket in the aircraft.Finally,a prototype system based on client-server framework has been developed for validation purpose.
