Object detection plays an important role in the sorting process of mechanical fasteners.Although object detection has been studied for many years,it has always been an industrial problem.Edge-based model matching is o...Object detection plays an important role in the sorting process of mechanical fasteners.Although object detection has been studied for many years,it has always been an industrial problem.Edge-based model matching is only suitable for a small range of illumination changes,and the matching accuracy is low.The optical flow method and the difference method are sensitive to noise and light,and camshift tracking is less effective in complex backgrounds.In this paper,an improved target detection method based on YOLOv3-tiny is proposed.The redundant regression box generated by the prediction network is filtered by soft nonmaximum suppression(NMS)instead of the hard decision NMS algorithm.This not only increases the size of the network structure by 52×52 and improves the detection accuracy of small targets but also uses the basic structure block MobileNetv2 in the feature extraction network,which enhances the feature extraction ability with the increased network layer and improves network performance.The experimental results show that the improved YOLOv3-tiny target detection algorithm improves the detection ability of bolts,nuts,screws and gaskets.The accuracy of a single type has been improved,which shows that the network greatly enhances the ability to learn objects with slightly complex features.The detection result of single shape features is slightly improved,which is higher than the recognition accuracy of other types.The average accuracy is increased from 0.813 to 0.839,an increase of two percentage points.The recall rate is increased from 0.804 to 0.821.展开更多
Recently,video-based fire detection technology has become an important research topic in the field of machine vision.This paper proposes a method of combining the classification model and target detection model in dee...Recently,video-based fire detection technology has become an important research topic in the field of machine vision.This paper proposes a method of combining the classification model and target detection model in deep learning for fire detection.Firstly,the depthwise separable convolution is used to classify fire images,which saves a lot of detection time under the premise of ensuring detection accuracy.Secondly,You Only Look Once version 3(YOLOv3)target regression function is used to output the fire position information for the images whose classification result is fire,which avoids the problem that the accuracy of detection cannot be guaranteed by using YOLOv3 for target classification and position regression.At the same time,the detection time of target regression for images without fire is greatly reduced saved.The experiments were tested using a network public database.The detection accuracy reached 98%and the detection rate reached 38fps.This method not only saves the workload of manually extracting flame characteristics,reduces the calculation cost,and reduces the amount of parameters,but also improves the detection accuracy and detection rate.展开更多
Complete and efficient detection of unknown targets is the most popular application of UAV swarms. Under most situations, targets have directional characteristics so that they can only be successfully detected within ...Complete and efficient detection of unknown targets is the most popular application of UAV swarms. Under most situations, targets have directional characteristics so that they can only be successfully detected within specific angles. In such cases, how to coordinate UAVs and allocate optimal paths for them to efficiently detect all the targets is the primary issue to be solved. In this paper, an intelligent target detection method is proposed for UAV swarms to achieve real-time detection requirements. First, a target-feature-information-based disintegration method is built up to divide the search space into a set of cubes. Theoretically, when the cubes are traversed, all the targets can be detected. Then, a Kuhn-Munkres(KM)-algorithm-based path planning method is proposed for UAVs to traverse the cubes. Finally, to further improve search efficiency, a 3 D realtime probability map is established over the search space which estimates the possibility of detecting new targets at each point. This map is adopted to modify the weights in KM algorithm, thereby optimizing the UAVs’ paths during the search process. Simulation results show that with the proposed method, all targets, with detection angle limitations, can be found by UAVs. Moreover, by implementing the 3 D probability map, the search efficiency is improved by 23.4%–78.1%.展开更多
The paper designs a peripheral maximum gray differ-ence(PMGD)image segmentation method,a connected-compo-nent labeling(CCL)algorithm based on dynamic run length(DRL),and a real-time implementation streaming processor ...The paper designs a peripheral maximum gray differ-ence(PMGD)image segmentation method,a connected-compo-nent labeling(CCL)algorithm based on dynamic run length(DRL),and a real-time implementation streaming processor for DRL-CCL.And it verifies the function and performance in space target monitoring scene by the carrying experiment of Tianzhou-3 cargo spacecraft(TZ-3).The PMGD image segmentation method can segment the image into highly discrete and simple point tar-gets quickly,which reduces the generation of equivalences greatly and improves the real-time performance for DRL-CCL.Through parallel pipeline design,the storage of the streaming processor is optimized by 55%with no need for external me-mory,the logic is optimized by 60%,and the energy efficiency ratio is 12 times than that of the graphics processing unit,62 times than that of the digital signal proccessing,and 147 times than that of personal computers.Analyzing the results of 8756 images completed on-orbit,the speed is up to 5.88 FPS and the target detection rate is 100%.Our algorithm and implementation method meet the requirements of lightweight,high real-time,strong robustness,full-time,and stable operation in space irradia-tion environment.展开更多
Aiming at fast moving targets, such as ships, high-speed vehicles andathletes, this paper discusses a series of target detection algorithms based on neuralnetwork, YOLOv3 and background modeling. Compared KCF tracking...Aiming at fast moving targets, such as ships, high-speed vehicles andathletes, this paper discusses a series of target detection algorithms based on neuralnetwork, YOLOv3 and background modeling. Compared KCF tracking with SSDtracking, Gaussian filter was applied to remove noise from pictures, and edgepreserving filter was used to preserve edge features. Moreover, the algorithmcombining deepsort tracking algorithm with YOLOv3 detection algorithm canimprove the accuracy of YOLOv3 target detection, solve the problem of targetloss during target tracking, adjust the frame size in real time, and improve the fitwith the target position. Experiments show that the proposed algorithm based ondetection before tracking has strong learning ability and robustness to unknownenvironment.展开更多
基金The authors gratefully acknowledge the support provided by the National Natural Science Foundation of China(No.U20A20265)。
文摘Object detection plays an important role in the sorting process of mechanical fasteners.Although object detection has been studied for many years,it has always been an industrial problem.Edge-based model matching is only suitable for a small range of illumination changes,and the matching accuracy is low.The optical flow method and the difference method are sensitive to noise and light,and camshift tracking is less effective in complex backgrounds.In this paper,an improved target detection method based on YOLOv3-tiny is proposed.The redundant regression box generated by the prediction network is filtered by soft nonmaximum suppression(NMS)instead of the hard decision NMS algorithm.This not only increases the size of the network structure by 52×52 and improves the detection accuracy of small targets but also uses the basic structure block MobileNetv2 in the feature extraction network,which enhances the feature extraction ability with the increased network layer and improves network performance.The experimental results show that the improved YOLOv3-tiny target detection algorithm improves the detection ability of bolts,nuts,screws and gaskets.The accuracy of a single type has been improved,which shows that the network greatly enhances the ability to learn objects with slightly complex features.The detection result of single shape features is slightly improved,which is higher than the recognition accuracy of other types.The average accuracy is increased from 0.813 to 0.839,an increase of two percentage points.The recall rate is increased from 0.804 to 0.821.
基金This work was supported by Liaoning Provincial Science Public Welfare Research Fund Project(No.2016002006)Liaoning Provincial Department of Education Scientific Research Service Local Project(No.L201708).
文摘Recently,video-based fire detection technology has become an important research topic in the field of machine vision.This paper proposes a method of combining the classification model and target detection model in deep learning for fire detection.Firstly,the depthwise separable convolution is used to classify fire images,which saves a lot of detection time under the premise of ensuring detection accuracy.Secondly,You Only Look Once version 3(YOLOv3)target regression function is used to output the fire position information for the images whose classification result is fire,which avoids the problem that the accuracy of detection cannot be guaranteed by using YOLOv3 for target classification and position regression.At the same time,the detection time of target regression for images without fire is greatly reduced saved.The experiments were tested using a network public database.The detection accuracy reached 98%and the detection rate reached 38fps.This method not only saves the workload of manually extracting flame characteristics,reduces the calculation cost,and reduces the amount of parameters,but also improves the detection accuracy and detection rate.
文摘Complete and efficient detection of unknown targets is the most popular application of UAV swarms. Under most situations, targets have directional characteristics so that they can only be successfully detected within specific angles. In such cases, how to coordinate UAVs and allocate optimal paths for them to efficiently detect all the targets is the primary issue to be solved. In this paper, an intelligent target detection method is proposed for UAV swarms to achieve real-time detection requirements. First, a target-feature-information-based disintegration method is built up to divide the search space into a set of cubes. Theoretically, when the cubes are traversed, all the targets can be detected. Then, a Kuhn-Munkres(KM)-algorithm-based path planning method is proposed for UAVs to traverse the cubes. Finally, to further improve search efficiency, a 3 D realtime probability map is established over the search space which estimates the possibility of detecting new targets at each point. This map is adopted to modify the weights in KM algorithm, thereby optimizing the UAVs’ paths during the search process. Simulation results show that with the proposed method, all targets, with detection angle limitations, can be found by UAVs. Moreover, by implementing the 3 D probability map, the search efficiency is improved by 23.4%–78.1%.
文摘The paper designs a peripheral maximum gray differ-ence(PMGD)image segmentation method,a connected-compo-nent labeling(CCL)algorithm based on dynamic run length(DRL),and a real-time implementation streaming processor for DRL-CCL.And it verifies the function and performance in space target monitoring scene by the carrying experiment of Tianzhou-3 cargo spacecraft(TZ-3).The PMGD image segmentation method can segment the image into highly discrete and simple point tar-gets quickly,which reduces the generation of equivalences greatly and improves the real-time performance for DRL-CCL.Through parallel pipeline design,the storage of the streaming processor is optimized by 55%with no need for external me-mory,the logic is optimized by 60%,and the energy efficiency ratio is 12 times than that of the graphics processing unit,62 times than that of the digital signal proccessing,and 147 times than that of personal computers.Analyzing the results of 8756 images completed on-orbit,the speed is up to 5.88 FPS and the target detection rate is 100%.Our algorithm and implementation method meet the requirements of lightweight,high real-time,strong robustness,full-time,and stable operation in space irradia-tion environment.
文摘Aiming at fast moving targets, such as ships, high-speed vehicles andathletes, this paper discusses a series of target detection algorithms based on neuralnetwork, YOLOv3 and background modeling. Compared KCF tracking with SSDtracking, Gaussian filter was applied to remove noise from pictures, and edgepreserving filter was used to preserve edge features. Moreover, the algorithmcombining deepsort tracking algorithm with YOLOv3 detection algorithm canimprove the accuracy of YOLOv3 target detection, solve the problem of targetloss during target tracking, adjust the frame size in real time, and improve the fitwith the target position. Experiments show that the proposed algorithm based ondetection before tracking has strong learning ability and robustness to unknownenvironment.
