Face recognition has emerged as one of the most prominent applications of image analysis and under-standing,gaining considerable attention in recent years.This growing interest is driven by two key factors:its extensi...Face recognition has emerged as one of the most prominent applications of image analysis and under-standing,gaining considerable attention in recent years.This growing interest is driven by two key factors:its extensive applications in law enforcement and the commercial domain,and the rapid advancement of practical technologies.Despite the significant advancements,modern recognition algorithms still struggle in real-world conditions such as varying lighting conditions,occlusion,and diverse facial postures.In such scenarios,human perception is still well above the capabilities of present technology.Using the systematic mapping study,this paper presents an in-depth review of face detection algorithms and face recognition algorithms,presenting a detailed survey of advancements made between 2015 and 2024.We analyze key methodologies,highlighting their strengths and restrictions in the application context.Additionally,we examine various datasets used for face detection/recognition datasets focusing on the task-specific applications,size,diversity,and complexity.By analyzing these algorithms and datasets,this survey works as a valuable resource for researchers,identifying the research gap in the field of face detection and recognition and outlining potential directions for future research.展开更多
Since the coal mine in-pit personnel positioning system neither can effectively achieve the function to detect the uniqueness of in-pit coal-mine personnel nor can identify and eliminate violations in attendance manag...Since the coal mine in-pit personnel positioning system neither can effectively achieve the function to detect the uniqueness of in-pit coal-mine personnel nor can identify and eliminate violations in attendance management such as multiple cards for one person, and swiping one's cards by others in China at present. Therefore, the research introduces a uniqueness detection system and method for in-pit coal-mine personnel integrated into the in-pit coal mine personnel positioning system, establishing a system mode based on face recognition + recognition of personnel positioning card + release by automatic detection. Aiming at the facts that the in-pit personnel are wearing helmets and faces are prone to be stained during the face recognition, the study proposes the ideas that pre-process face images using the 2D-wavelet-transformation-based Mallat algorithm and extracts three face features: miner light, eyes and mouths, using the generalized symmetry transformation-based algorithm. This research carried out test with 40 clean face images with no helmets and 40 lightly-stained face images, and then compared with results with the one using the face feature extraction method based on grey-scale transformation and edge detection. The results show that the method described in the paper can detect accurately face features in the above-mentioned two cases, and the accuracy to detect face features is 97.5% in the case of wearing helmets and lightly-stained faces.展开更多
The hypersonic target detection and recognition system is studied,on the basis of overall planning and design,a multi-agent system(MAS)structure and intelligent+information processing mechanism based on target detecti...The hypersonic target detection and recognition system is studied,on the basis of overall planning and design,a multi-agent system(MAS)structure and intelligent+information processing mechanism based on target detection and recognition are proposed,and the multi-agent operation process is analyzed and designed in detail.In the specific agents construction,the information fusion technology is introduced to defining the embedded agents and their interrelations in the system structure,and the intelligent processing ability of complex and uncertain problems is emphatically analyzed from the aspects of autonomy and collaboration.The aim is to optimize the information processing strategy of the hypersonic target detection and recognition system and improve the robustness and rapidity of the system.展开更多
In this paper,transient electromagnetic method was used to carry out the feasibility study on the detection and recognition of chamber blasting misfire.Firstly,an electromagnetic background field was established in th...In this paper,transient electromagnetic method was used to carry out the feasibility study on the detection and recognition of chamber blasting misfire.Firstly,an electromagnetic background field was established in the test;secondly,a benign conductor was preset in the chamber,and then the background field was eliminated after the electromagnetic field was measured;thirdly,the transient electromagnetic field was measured again after blasting;at last,the chamber blasting misfire was detected and recognized by comparing the change of eddy current field of the preset benign conductor before and after blasting.The test results showed that:When the buried depth of aluminum box target was no more than 30 m,transient electromagnetic method can clearly identify the position of the aluminum box;when the buried depth of aluminum box was more than30 m,the buried depth and position of the aluminum box was not sure due to the unknown level of secondary eddy current field generated by aluminum box.展开更多
Top-view fisheye cameras are widely used in personnel surveillance for their broad field of view,but their unique imaging characteristics pose challenges like distortion,complex scenes,scale variations,and small objec...Top-view fisheye cameras are widely used in personnel surveillance for their broad field of view,but their unique imaging characteristics pose challenges like distortion,complex scenes,scale variations,and small objects near image edges.To tackle these,we proposed peripheral focus you only look once(PF-YOLO),an enhanced YOLOv8n-based method.Firstly,we introduced a cutting-patch data augmentation strategy to mitigate the problem of insufficient small-object samples in various scenes.Secondly,to enhance the model's focus on small objects near the edges,we designed the peripheral focus loss,which uses dynamic focus coefficients to provide greater gradient gains for these objects,improving their regression accuracy.Finally,we designed the three dimensional(3D)spatial-channel coordinate attention C2f module,enhancing spatial and channel perception,suppressing noise,and improving personnel detection.Experimental results demonstrate that PF-YOLO achieves strong performance on the challenging events for person detection from overhead fisheye images(CEPDTOF)and in-the-wild events for people detection and tracking from overhead fisheye cameras(WEPDTOF)datasets.Compared to the original YOLOv8n model,PFYOLO achieves improvements on CEPDTOF with increases of 2.1%,1.7%and 2.9%in mean average precision 50(mAP 50),mAP 50-95,and tively.On WEPDTOF,PF-YOLO achieves substantial improvements with increases of 31.4%,14.9%,61.1%and 21.0%in 91.2%and 57.2%,respectively.展开更多
As an important part of railway lines, the healthy service status of track fasteners was very important to ensure the safety of trains. The application of deep learning algorithms was becoming an important method to r...As an important part of railway lines, the healthy service status of track fasteners was very important to ensure the safety of trains. The application of deep learning algorithms was becoming an important method to realize its state detection. However, there was often a deficiency that the detection accuracy and calculation speed of model were difficult to balance, when the traditional deep learning model is used to detect the service state of track fasteners. Targeting this issue, an improved Yolov4 model for detecting the service status of track fasteners was proposed. Firstly, the Mixup data augmentation technology was introduced into Yolov4 model to enhance the generalization ability of model. Secondly, the MobileNet-V2 lightweight network was employed in lieu of the CSPDarknet53 network as the backbone, thereby reducing the number of algorithm parameters and improving the model’s computational efficiency. Finally, the SE attention mechanism was incorporated to boost the importance of rail fastener identification by emphasizing relevant image features, ensuring that the network’s focus was primarily on the fasteners being inspected. The algorithm achieved both high precision and high speed operation of the rail fastener service state detection, while realizing the lightweight of model. The experimental results revealed that, the MAP value of the rail fastener service state detection algorithm based on the improved Yolov4 model reaches 83.2%, which is 2.83% higher than that of the traditional Yolov4 model, and the calculation speed was improved by 67.39%. Compared with the traditional Yolov4 model, the proposed method achieved the collaborative optimization of detection accuracy and calculation speed.展开更多
In order to monitor dangerous areas in coal mines automatically,we propose to detect helmets from underground coal mine videos for detecting miners.This method can overcome the impact of similarity between the targets...In order to monitor dangerous areas in coal mines automatically,we propose to detect helmets from underground coal mine videos for detecting miners.This method can overcome the impact of similarity between the targets and their background.We constructed standard images of helmets,extracted four directional features,modeled the distribution of these features using a Gaussian function and separated local images of frames into helmet and non-helmet classes.Out experimental results show that this method can detect helmets effectively.The detection rate was 83.7%.展开更多
Traffic light detection and recognition is essential for autonomous driving in urban environments. A camera based algorithm for real-time robust traffic light detection and recognition was proposed, and especially des...Traffic light detection and recognition is essential for autonomous driving in urban environments. A camera based algorithm for real-time robust traffic light detection and recognition was proposed, and especially designed for autonomous vehicles. Although the current reliable traffic light recognition algorithms operate well under way, most of them are mainly designed for detection at a fixed position and the effect on autonomous vehicles under real-world conditions is still limited. Some methods achieve high accuracy on autonomous vehicle, but they can＇t work normally without the aid of high-precision priori map. The authors presented a camera-based algorithm for the problem. The image processing flow can be divided into three steps, including pre-processing, detection and recognition. Firstly, red-green-blue （RGB） color space is converted to hue-saturation-value （HSV） as main content of pre-processing. In detection step, the transcendental color threshold method is used for initial filterings, meanwhile, the prior knowledge is performed to scan the scene in order to quickly establish candidate regions. For recognition, this article use histogram of oriented gradients （HOG） features and support vector machine （SVM） as well to recognize the state of traffic light. The proposed system on our autonomous vehicle was evaluated. With voting schemes, the proposed can provide a sufficient accuracy for autonomous vehicles in urban enviroment.展开更多
With the rapid development of road traffic,the number of high-speed rail passengers is huge,and the flow of people is dense.In epidemic situation,it is prone to intensive infection in high-speed rail carriages,which i...With the rapid development of road traffic,the number of high-speed rail passengers is huge,and the flow of people is dense.In epidemic situation,it is prone to intensive infection in high-speed rail carriages,which is not conducive to national prevention and control work.Based on face recognition technology,the intelligent service robot for high-speed rail passengers walks in accordance with the set route and detects the face mask of high-speed rail passengers.The face database of high-speed rail passengers is compared in real time.The passengers who do not wear masks are reminded in time to reduce the risk of infection.Moreover,the robot can accurately remind the passengers of leaving the station in time,and has the functions of automatic selling and student ticket checking.The experimental result is shown to promote the further development of high-speed rail services.展开更多
Can WiFi signals be used for sensing purpose？ The growing PHY layer capabilities of WiFi has made it possible to reuse WiFi signals for both communication and sensing. Sensing via WiFi would enable remote sensing wit...Can WiFi signals be used for sensing purpose？ The growing PHY layer capabilities of WiFi has made it possible to reuse WiFi signals for both communication and sensing. Sensing via WiFi would enable remote sensing without wearable sensors, simultaneous perception and data transmission without extra communication infrastructure, and contactless sensing in privacy-preserving mode. Due to the popularity of WiFi devices and the ubiquitous deployment of WiFi networks, WiFi-based sensing networks, if fully connected, would potentially rank as one of the world＇s largest wireless sensor networks. Yet the concept of wireless and sensorless sensing is not the simple combination of WiFi and radar. It seeks breakthroughs from dedicated radar systems, and aims to balance between low cost and high accuracy, to meet the rising demand for pervasive environment perception in everyday life. Despite increasing research interest, wireless sensing is still in its infancy. Through introductions on basic principles and working prototypes, we review the feasibilities and limitations of wireless, sensorless, and contactless sensing via WiFi. We envision this article as a brief primer on wireless sensing for interested readers to explore this open and largely unexplored field and create next-generation wireless and mobile computing applications.展开更多
文摘Face recognition has emerged as one of the most prominent applications of image analysis and under-standing,gaining considerable attention in recent years.This growing interest is driven by two key factors:its extensive applications in law enforcement and the commercial domain,and the rapid advancement of practical technologies.Despite the significant advancements,modern recognition algorithms still struggle in real-world conditions such as varying lighting conditions,occlusion,and diverse facial postures.In such scenarios,human perception is still well above the capabilities of present technology.Using the systematic mapping study,this paper presents an in-depth review of face detection algorithms and face recognition algorithms,presenting a detailed survey of advancements made between 2015 and 2024.We analyze key methodologies,highlighting their strengths and restrictions in the application context.Additionally,we examine various datasets used for face detection/recognition datasets focusing on the task-specific applications,size,diversity,and complexity.By analyzing these algorithms and datasets,this survey works as a valuable resource for researchers,identifying the research gap in the field of face detection and recognition and outlining potential directions for future research.
基金financial supports from the National Natural Science Foundation of China (No. 51134024)the National High Technology Research and Development Program of China (No. 2012AA062203)are gratefully acknowledged
文摘Since the coal mine in-pit personnel positioning system neither can effectively achieve the function to detect the uniqueness of in-pit coal-mine personnel nor can identify and eliminate violations in attendance management such as multiple cards for one person, and swiping one's cards by others in China at present. Therefore, the research introduces a uniqueness detection system and method for in-pit coal-mine personnel integrated into the in-pit coal mine personnel positioning system, establishing a system mode based on face recognition + recognition of personnel positioning card + release by automatic detection. Aiming at the facts that the in-pit personnel are wearing helmets and faces are prone to be stained during the face recognition, the study proposes the ideas that pre-process face images using the 2D-wavelet-transformation-based Mallat algorithm and extracts three face features: miner light, eyes and mouths, using the generalized symmetry transformation-based algorithm. This research carried out test with 40 clean face images with no helmets and 40 lightly-stained face images, and then compared with results with the one using the face feature extraction method based on grey-scale transformation and edge detection. The results show that the method described in the paper can detect accurately face features in the above-mentioned two cases, and the accuracy to detect face features is 97.5% in the case of wearing helmets and lightly-stained faces.
基金This work was supported by the National Natural Science Foundation of China(61471391).
文摘The hypersonic target detection and recognition system is studied,on the basis of overall planning and design,a multi-agent system(MAS)structure and intelligent+information processing mechanism based on target detection and recognition are proposed,and the multi-agent operation process is analyzed and designed in detail.In the specific agents construction,the information fusion technology is introduced to defining the embedded agents and their interrelations in the system structure,and the intelligent processing ability of complex and uncertain problems is emphatically analyzed from the aspects of autonomy and collaboration.The aim is to optimize the information processing strategy of the hypersonic target detection and recognition system and improve the robustness and rapidity of the system.
文摘In this paper,transient electromagnetic method was used to carry out the feasibility study on the detection and recognition of chamber blasting misfire.Firstly,an electromagnetic background field was established in the test;secondly,a benign conductor was preset in the chamber,and then the background field was eliminated after the electromagnetic field was measured;thirdly,the transient electromagnetic field was measured again after blasting;at last,the chamber blasting misfire was detected and recognized by comparing the change of eddy current field of the preset benign conductor before and after blasting.The test results showed that:When the buried depth of aluminum box target was no more than 30 m,transient electromagnetic method can clearly identify the position of the aluminum box;when the buried depth of aluminum box was more than30 m,the buried depth and position of the aluminum box was not sure due to the unknown level of secondary eddy current field generated by aluminum box.
基金supported by National Natural Science Foundation of China(Nos.62171042,62102033,U24A20331)the R&D Program of Beijing Municipal Education Commission(No.KZ202211417048)+2 种基金the Project of Construction and Support for High-Level Innovative Teams of Beijing Municipal Institutions(No.BPHR20220121)Beijing Natural Science Foundation(Nos.4232026,4242020)the Academic Research Projects of Beijing Union University(Nos.ZKZD202302,ZK20202403)。
文摘Top-view fisheye cameras are widely used in personnel surveillance for their broad field of view,but their unique imaging characteristics pose challenges like distortion,complex scenes,scale variations,and small objects near image edges.To tackle these,we proposed peripheral focus you only look once(PF-YOLO),an enhanced YOLOv8n-based method.Firstly,we introduced a cutting-patch data augmentation strategy to mitigate the problem of insufficient small-object samples in various scenes.Secondly,to enhance the model's focus on small objects near the edges,we designed the peripheral focus loss,which uses dynamic focus coefficients to provide greater gradient gains for these objects,improving their regression accuracy.Finally,we designed the three dimensional(3D)spatial-channel coordinate attention C2f module,enhancing spatial and channel perception,suppressing noise,and improving personnel detection.Experimental results demonstrate that PF-YOLO achieves strong performance on the challenging events for person detection from overhead fisheye images(CEPDTOF)and in-the-wild events for people detection and tracking from overhead fisheye cameras(WEPDTOF)datasets.Compared to the original YOLOv8n model,PFYOLO achieves improvements on CEPDTOF with increases of 2.1%,1.7%and 2.9%in mean average precision 50(mAP 50),mAP 50-95,and tively.On WEPDTOF,PF-YOLO achieves substantial improvements with increases of 31.4%,14.9%,61.1%and 21.0%in 91.2%and 57.2%,respectively.
文摘As an important part of railway lines, the healthy service status of track fasteners was very important to ensure the safety of trains. The application of deep learning algorithms was becoming an important method to realize its state detection. However, there was often a deficiency that the detection accuracy and calculation speed of model were difficult to balance, when the traditional deep learning model is used to detect the service state of track fasteners. Targeting this issue, an improved Yolov4 model for detecting the service status of track fasteners was proposed. Firstly, the Mixup data augmentation technology was introduced into Yolov4 model to enhance the generalization ability of model. Secondly, the MobileNet-V2 lightweight network was employed in lieu of the CSPDarknet53 network as the backbone, thereby reducing the number of algorithm parameters and improving the model’s computational efficiency. Finally, the SE attention mechanism was incorporated to boost the importance of rail fastener identification by emphasizing relevant image features, ensuring that the network’s focus was primarily on the fasteners being inspected. The algorithm achieved both high precision and high speed operation of the rail fastener service state detection, while realizing the lightweight of model. The experimental results revealed that, the MAP value of the rail fastener service state detection algorithm based on the improved Yolov4 model reaches 83.2%, which is 2.83% higher than that of the traditional Yolov4 model, and the calculation speed was improved by 67.39%. Compared with the traditional Yolov4 model, the proposed method achieved the collaborative optimization of detection accuracy and calculation speed.
基金provided by the National High Technology Research and Development Program of China (No.2008AA062202)
文摘In order to monitor dangerous areas in coal mines automatically,we propose to detect helmets from underground coal mine videos for detecting miners.This method can overcome the impact of similarity between the targets and their background.We constructed standard images of helmets,extracted four directional features,modeled the distribution of these features using a Gaussian function and separated local images of frames into helmet and non-helmet classes.Out experimental results show that this method can detect helmets effectively.The detection rate was 83.7%.
基金supported by Natural Basic Research Program of China (91120306, 61203366)
文摘Traffic light detection and recognition is essential for autonomous driving in urban environments. A camera based algorithm for real-time robust traffic light detection and recognition was proposed, and especially designed for autonomous vehicles. Although the current reliable traffic light recognition algorithms operate well under way, most of them are mainly designed for detection at a fixed position and the effect on autonomous vehicles under real-world conditions is still limited. Some methods achieve high accuracy on autonomous vehicle, but they can＇t work normally without the aid of high-precision priori map. The authors presented a camera-based algorithm for the problem. The image processing flow can be divided into three steps, including pre-processing, detection and recognition. Firstly, red-green-blue （RGB） color space is converted to hue-saturation-value （HSV） as main content of pre-processing. In detection step, the transcendental color threshold method is used for initial filterings, meanwhile, the prior knowledge is performed to scan the scene in order to quickly establish candidate regions. For recognition, this article use histogram of oriented gradients （HOG） features and support vector machine （SVM） as well to recognize the state of traffic light. The proposed system on our autonomous vehicle was evaluated. With voting schemes, the proposed can provide a sufficient accuracy for autonomous vehicles in urban enviroment.
基金This article is supported by the 2020 Innovation and Entrepreneurship Training Program forCollege Students in Jiangsu Province(Project name:high-speed railway passenger behavior management system,No.202011460091T)This article is supported by the National Natural Science Foundation of China Youth Science Foundation project(Project name:research on Deep Discriminant Spares Representation Learning Method for Feature Extraction,No.61806098)This article is supported by Scientific Research Project of Nanjing Xiaozhuang University(Project name:multi-robot collaborative system,No.2017NXY16)。
文摘With the rapid development of road traffic,the number of high-speed rail passengers is huge,and the flow of people is dense.In epidemic situation,it is prone to intensive infection in high-speed rail carriages,which is not conducive to national prevention and control work.Based on face recognition technology,the intelligent service robot for high-speed rail passengers walks in accordance with the set route and detects the face mask of high-speed rail passengers.The face database of high-speed rail passengers is compared in real time.The passengers who do not wear masks are reminded in time to reduce the risk of infection.Moreover,the robot can accurately remind the passengers of leaving the station in time,and has the functions of automatic selling and student ticket checking.The experimental result is shown to promote the further development of high-speed rail services.
文摘Can WiFi signals be used for sensing purpose？ The growing PHY layer capabilities of WiFi has made it possible to reuse WiFi signals for both communication and sensing. Sensing via WiFi would enable remote sensing without wearable sensors, simultaneous perception and data transmission without extra communication infrastructure, and contactless sensing in privacy-preserving mode. Due to the popularity of WiFi devices and the ubiquitous deployment of WiFi networks, WiFi-based sensing networks, if fully connected, would potentially rank as one of the world＇s largest wireless sensor networks. Yet the concept of wireless and sensorless sensing is not the simple combination of WiFi and radar. It seeks breakthroughs from dedicated radar systems, and aims to balance between low cost and high accuracy, to meet the rising demand for pervasive environment perception in everyday life. Despite increasing research interest, wireless sensing is still in its infancy. Through introductions on basic principles and working prototypes, we review the feasibilities and limitations of wireless, sensorless, and contactless sensing via WiFi. We envision this article as a brief primer on wireless sensing for interested readers to explore this open and largely unexplored field and create next-generation wireless and mobile computing applications.
