A novel reconstruction method to improve the recognition of license plate texts of moving vehicles in real traffic videos is proposed, which fuses complimentary information among low resolution （LR） images to yield ...A novel reconstruction method to improve the recognition of license plate texts of moving vehicles in real traffic videos is proposed, which fuses complimentary information among low resolution （LR） images to yield a high resolution （HR） image. Based on the regularization super-resolution （SR） reconstruction schemes, this paper first introduces a residual gradient （RG） term as a new regularization term to improve the quality of the reconstructed image. Moreover, L1 norm is used to measure the residual data （RD） term and the RG term in order to improve the robustness of the proposed method. Finally, the steepest descent method is exploited to solve the energy functional. Simulated and real acquired video sequence experiments show the effectiveness and practicability of the proposed method and demonstrate its superiority over the bi-cubic interpolation and discontinuity adaptive Markov random field （DAMRF） SR method in both signal to noise ratios （SNR） and visual effects.展开更多
Multi-license plate detection in complex scenes is still a challenging task because of multiple vehicle license plates with different sizes and classes in the images having complex background.The edge features of high...Multi-license plate detection in complex scenes is still a challenging task because of multiple vehicle license plates with different sizes and classes in the images having complex background.The edge features of high-density distribution and the high curvature features of stroke turning of Chinese character are important signs to distinguish Chinese license plate from other objects.To accurately detect multiple vehicle license plates with different sizes and classes in complex scenes,a multi-object detection of Chinese license plate method based on improved YOLOv3 network was proposed in this research.The improvements include replacing the residual block of the YOLOv3 backbone network with the Inception-ResNet-A block,imbedding the SPP block into the detection network,cutting the redundant Inception-ResNet-A block to suit for the multi-license plate detection task,and clustering the ground truth boxes of license plates to obtain a new set of anchor boxes.A Chinese vehicle license plate image dataset was built for training and testing the improved network,and the location and class of the license plates in each image were accurately labeled.The dataset has 62,153 pieces of images and 4 classes of China vehicle license plates,almost images have multiple license plates with different sizes.Experiments demonstrated that the multilicense plate detection method obtained 83.4%mAP,98.88%precision,98.17%recall,98.52 F1 score,89.196 BFLOPS and 22 FPS on the test dataset,and whole performance was better than the other five compared networks including YOLOv3,SSD,Faster-RCNN,EfficientDet and RetinaNet.展开更多
An efficient vehicle detection approach is proposed for traffic surveillance images, which is based on information fusion of vehicle symmetrical contour and license plate position. The vertical symmetry axis of the ve...An efficient vehicle detection approach is proposed for traffic surveillance images, which is based on information fusion of vehicle symmetrical contour and license plate position. The vertical symmetry axis of the vehicle contour in an image is. first detected, and then the vertical and the horizontal symmetry axes of the license plate are detected using the symmetry axis of the vehicle contour as a reference. The vehicle location in an image is determined using license plate symmetry axes and the vertical and the horizontal projection maps of the vehicle edge image. A dataset consisting of 450 images （15 classes of vehicles） is used to test the proposed method. The experimental results indicate that compared with the vehicle contour-based, the license plate location-based, the vehicle texture-based and the Gabor feature-based methods, the proposed method is the best with a detection accuracy of 90.7% and an elapsed time of 125 ms.展开更多
The development of scientific inquiry and research has yielded numerous benefits in the realm of intelligent traffic control systems, particularly in the realm of automatic license plate recognition for vehicles. The ...The development of scientific inquiry and research has yielded numerous benefits in the realm of intelligent traffic control systems, particularly in the realm of automatic license plate recognition for vehicles. The design of license plate recognition algorithms has undergone digitalization through the utilization of neural networks. In contemporary times, there is a growing demand for vehicle surveillance due to the need for efficient vehicle processing and traffic management. The design, development, and implementation of a license plate recognition system hold significant social, economic, and academic importance. The study aims to present contemporary methodologies and empirical findings pertaining to automated license plate recognition. The primary focus of the automatic license plate recognition algorithm was on image extraction, character segmentation, and recognition. The task of character segmentation has been identified as the most challenging function based on my observations. The license plate recognition project that we designed demonstrated the effectiveness of this method across various observed conditions. Particularly in low-light environments, such as during periods of limited illumination or inclement weather characterized by precipitation. The method has been subjected to testing using a sample size of fifty images, resulting in a 100% accuracy rate. The findings of this study demonstrate the project’s ability to effectively determine the optimal outcomes of simulations.展开更多
Vehicle license plate (VLP) character segmentation is an important part of the vehicle license plate recognition system (VLPRS).This paper proposes a least square method (LSM) to treat horizontal tilt and vertical til...Vehicle license plate (VLP) character segmentation is an important part of the vehicle license plate recognition system (VLPRS).This paper proposes a least square method (LSM) to treat horizontal tilt and vertical tilt in VLP images.Auxiliary lines are added into the image (or the tilt-corrected image) to make the separated parts of each Chinese character to be an interconnected region.The noise regions will be eliminated after two fusing images are merged according to the minimum principle of gray values. Then,the characters are segmented by projection method (PM) and the final character images are obtained.The experimental results show that this method features fast processing and good performance in segmentation.展开更多
The latest advancements in highway research domain and increase in the number of vehicles everyday led to wider exposure and attention towards the development of efficient Intelligent Transportation System(ITS).One of...The latest advancements in highway research domain and increase in the number of vehicles everyday led to wider exposure and attention towards the development of efficient Intelligent Transportation System(ITS).One of the popular research areas i.e.,Vehicle License Plate Recognition(VLPR)aims at determining the characters that exist in the license plate of the vehicles.The VLPR process is a difficult one due to the differences in viewpoint,shapes,colors,patterns,and non-uniform illumination at the time of capturing images.The current study develops a robust Deep Learning(DL)-based VLPR model using Squirrel Search Algorithm(SSA)-based Convolutional Neural Network(CNN),called the SSA-CNN model.The presented technique has a total of four major processes namely preprocessing,License Plate(LP)localization and detection,character segmentation,and recognition.Hough Transform(HT)is applied as a feature extractor and SSA-CNN algorithm is applied for character recognition in LP.The SSA-CNN method effectively recognizes the characters that exist in the segmented image by optimal tuning of CNN parameters.The HT-SSA-CNN model was experimentally validated using the Stanford Car,FZU Car,and HumAIn 2019 Challenge datasets.The experimentation outcome verified that the presented method was better under several aspects.The projected HT-SSA-CNN model implied the best performance with optimal overall accuracy of 0.983%.展开更多
Wearing helmetswhile riding electric bicycles can significantly reduce head injuries resulting fromtraffic accidents.To effectively monitor compliance,the utilization of target detection algorithms through traffic cam...Wearing helmetswhile riding electric bicycles can significantly reduce head injuries resulting fromtraffic accidents.To effectively monitor compliance,the utilization of target detection algorithms through traffic cameras plays a vital role in identifying helmet usage by electric bicycle riders and recognizing license plates on electric bicycles.However,manual enforcement by traffic police is time-consuming and labor-intensive.Traditional methods face challenges in accurately identifying small targets such as helmets and license plates using deep learning techniques.This paper proposes an enhanced model for detecting helmets and license plates on electric bicycles,addressing these challenges.The proposedmodel improves uponYOLOv8n by deepening the network structure,incorporating weighted connections,and introducing lightweight convolutional modules.These modifications aim to enhance the precision of small target recognition while reducing the model’s parameters,making it suitable for deployment on low-performance devices in real traffic scenarios.Experimental results demonstrate that the model achieves an mAP@0.5 of 91.8%,showing an 11.5%improvement over the baselinemodel,with a 16.2%reduction in parameters.Additionally,themodel achieves a frames per second(FPS)rate of 58,meeting the accuracy and speed requirements for detection in actual traffic scenarios.展开更多
Privacy and trust are significant issues in intelligent transportation systems(ITS).Data security is critical in ITS systems since sensitive user data is communicated to another user over the internet through wireless...Privacy and trust are significant issues in intelligent transportation systems(ITS).Data security is critical in ITS systems since sensitive user data is communicated to another user over the internet through wireless devices and routes such as radio channels,optical fiber,and blockchain technology.The Internet of Things(IoT)is a network of connected,interconnected gadgets.Privacy issues occasionally arise due to the amount of data generated.However,they have been primarily addressed by blockchain and smart contract technology.While there are still security issues with smart contracts,primarily due to the complexity of writing the code,there are still many challenges to consider when designing blockchain designs for the IoT environment.This study uses traditional blockchain technology with the“You Only Look Once”(YOLO)object detection method to accurately locate and identify license plates.While YOLO and blockchain technologies used for intelligent vehicle license plate recognition are promising,they have received limited research attention.Real-time object identification and recognition would be possible by combining a cutting-edge object detection technique with a regional convolutional neural network(RCNN)built with the tensor flow core open source libraries.This method works reasonably well for identifying any license plate.The Automatic License Plate Recognition(ALPR)approach delivered outstanding results in various datasets.First,with a recognition rate of 96.2%,our system(UFPR-ALPR)surpassed the previously used technology,consisting of 4500 frames and around 150 films.Second,a deep learning algorithm was trained to recognize images of license plate numbers using the UFPR-ALPR dataset.Third,the license plate’s characters were complicated for standard methods to identify because of the shifting lighting correctly.The proposed model,however,produced beneficial outcomes.展开更多
License plate recognition technology use widely in intelligent trafficmanagement and control. Researchers have been committed to improving thespeed and accuracy of license plate recognition for nearly 30 years. This p...License plate recognition technology use widely in intelligent trafficmanagement and control. Researchers have been committed to improving thespeed and accuracy of license plate recognition for nearly 30 years. This paperis the first to propose combining the attention mechanism with YOLO-v5and LPRnet to construct a new license plate recognition model (LPR-CBAMNet).Through the attention mechanism CBAM(Convolutional Block AttentionModule), the importance of different feature channels in license platerecognition can be re-calibrated to obtain proper attention to features. Forceinformation to achieve the purpose of improving recognition speed andaccuracy. Experimental results show that the model construction methodis superior in speed and accuracy to traditional license plate recognitionalgorithms. The accuracy of the recognition model of the CBAM model isincreased by two percentage points to 97.2%, and the size of the constructedmodel is only 1.8 M, which can meet the requirements of real-time executionof embedded low-power devices. The codes for training and evaluating LPRCBAM-Net are available under the open-source MIT License at: https://github.com/To2rk/LPR-CBAM-Net.展开更多
Smart city-aspiring urban areas should have a number of necessary elements in place to achieve the intended objective.Precise controlling and management of traffic conditions,increased safety and surveillance,and enha...Smart city-aspiring urban areas should have a number of necessary elements in place to achieve the intended objective.Precise controlling and management of traffic conditions,increased safety and surveillance,and enhanced incident avoidance and management should be top priorities in smart city management.At the same time,Vehicle License Plate Number Recognition(VLPNR)has become a hot research topic,owing to several real-time applications like automated toll fee processing,traffic law enforcement,private space access control,and road traffic surveillance.Automated VLPNR is a computer vision-based technique which is employed in the recognition of automobiles based on vehicle number plates.The current research paper presents an effective Deep Learning(DL)-based VLPNR called DLVLPNR model to identify and recognize the alphanumeric characters present in license plate.The proposed model involves two main stages namely,license plate detection and Tesseract-based character recognition.The detection of alphanumeric characters present in license plate takes place with the help of fast RCNN with Inception V2 model.Then,the characters in the detected number plate are extracted using Tesseract Optical Character Recognition(OCR)model.The performance of DL-VLPNR model was tested in this paper using two benchmark databases,and the experimental outcome established the superior performance of the model compared to other methods.展开更多
In this paper, a novel method of licence plate recognition (LPR) using the vertical traverse density (VTD) and horizontal traverse density (HTD) is presented. The neutral network algorithm using VTD and HTD features i...In this paper, a novel method of licence plate recognition (LPR) using the vertical traverse density (VTD) and horizontal traverse density (HTD) is presented. The neutral network algorithm using VTD and HTD features is also an innovation. In addition, a so called secondary recognition method which splits characters into different parts is developed. Experimental results show that it is a simple and fast algorithm, which meets the request of real time and nicety performances of LPR and thus has applied value in intelligence transportation system (ITS).展开更多
Nowadays, license plate recognition for parking systems is a critical task to provide automatic control of customers and payment. This paper introduces a new method for automatic recognition of license plates of vehic...Nowadays, license plate recognition for parking systems is a critical task to provide automatic control of customers and payment. This paper introduces a new method for automatic recognition of license plates of vehicles by mathematical morphology. The proposed method can provide the license plate number of the plates in different light conditions, colors, sizes, and inclination （angles）. The algorithm can recognize the license plates of European Union vehicles quickly and correctly. The pattern learning of mathematical skeletons has high efficiency in the process. The performance of the algorithm is demonstrated well by the test in a parking control system.展开更多
The license plate recognition system(LPRS)has been widely adopted in daily life due to its efficiency and high accuracy.Deep neural networks are commonly used in the LPRS to improve the recognition accuracy.However,re...The license plate recognition system(LPRS)has been widely adopted in daily life due to its efficiency and high accuracy.Deep neural networks are commonly used in the LPRS to improve the recognition accuracy.However,researchers have found that deep neural networks have their own security problems that may lead to unexpected results.Specifically,they can be easily attacked by the adversarial examples that are generated by adding small perturbations to the original images,resulting in incorrect license plate recognition.There are some classic methods to generate adversarial examples,but they cannot be adopted on LPRS directly.In this paper,we modify some classic methods to generate adversarial examples that could mislead the LPRS.We conduct extensive evaluations on the HyperLPR system and the results show that the system could be easily attacked by such adversarial examples.In addition,we show that the generated images could also attack the black-box systems;we show some examples that the Baidu LPR system also makes incorrect recognitions.We hope this paper could help improve the LPRS by realizing the existence of such adversarial attacks.展开更多
This paper analyzes and dissertates the discrete wavelet transform and improved projection algorithm in four kernel stages （image preprocessing, license plate localization, character segmentation, license plate recog...This paper analyzes and dissertates the discrete wavelet transform and improved projection algorithm in four kernel stages （image preprocessing, license plate localization, character segmentation, license plate recognition, i.e.） of license plate recognition system in detail. At last, it gives some conclusions and suggestions on future research.展开更多
In this paper, a kind of practical image segmentation algorithm for segment characters from car license plate is presented, based on morphology and labeling. First by morphological operation, noise in the binary image...In this paper, a kind of practical image segmentation algorithm for segment characters from car license plate is presented, based on morphology and labeling. First by morphological operation, noise in the binary image of license plate can be greatly decreased. Then, by labeling, each connected pixel component is given a unique label. Finally, by the known data of license plate, each character is extracted correctly. The advantage of this method is that it can deal with plates with different sizes and connected characters plates, and inclined plates. The experiment results show that it is an effective way to extract characters from the license plate, and can be put into practical use.展开更多
Recent technological advancements have been used to improve the quality of living in smart cities.At the same time,automated detection of vehicles can be utilized to reduce crime rate and improve public security.On th...Recent technological advancements have been used to improve the quality of living in smart cities.At the same time,automated detection of vehicles can be utilized to reduce crime rate and improve public security.On the other hand,the automatic identification of vehicle license plate(LP)character becomes an essential process to recognize vehicles in real time scenarios,which can be achieved by the exploitation of optimal deep learning(DL)approaches.In this article,a novel hybrid metaheuristic optimization based deep learning model for automated license plate character recognition(HMODL-ALPCR)technique has been presented for smart city environments.The major intention of the HMODL-ALPCR technique is to detect LPs and recognize the characters that exist in them.For effective LP detection process,mask regional convolutional neural network(Mask-RCNN)model is applied and the Inception with Residual Network(ResNet)-v2 as the baseline network.In addition,hybrid sunflower optimization with butterfly optimization algorithm(HSFO-BOA)is utilized for the hyperparameter tuning of the Inception-ResNetv2 model.Finally,Tesseract based character recognition model is applied to effectively recognize the characters present in the LPs.The experimental result analysis of the HMODL-ALPCR technique takes place against the benchmark dataset and the experimental outcomes pointed out the improved efficacy of the HMODL-ALPCR technique over the recent methods.展开更多
In recent years,license plate recognition system(LPRS)is widely used in various places.Fast and accurate license plate detection is the first and critical step in LPRS.In order to improve the performance of license pl...In recent years,license plate recognition system(LPRS)is widely used in various places.Fast and accurate license plate detection is the first and critical step in LPRS.In order to improve the performance of license plate detection in complex environment,we propose a novel attention U-net with multilevel fusion(AUMF).At first,input images are fed to the network.Then,the feature maps of each level are generated by convolution operations of the original images.Before the feature connection,there are multi-layer splicing and convolution to detect more features.The attention mechanisms are used to retain the information of important regions.In order to ensure that the size of the input and output images are the same,down-sampling and up-sampling are employed to resize the feature mappings between the upper and lower levels.In the complex environment,the AUMF can accurately detect the license plate.To validate the effectiveness of the proposed method,we conducted a series of experiments on the AOLP dataset.The experimental results show that our approach effectively improves the performance of license plate detection under the three different license plate environments of AOLP dataset.展开更多
The shortage of current different approaches of the vehicle license plate(VLP) tilt correction is analyzed in the paper and a new rotary correction method put forward based on the former ways of the VLP tilt correctio...The shortage of current different approaches of the vehicle license plate(VLP) tilt correction is analyzed in the paper and a new rotary correction method put forward based on the former ways of the VLP tilt correction in the horizontal direction and the vertical direction Owing to the VLP tilt taking place in the vertical direction,the array of the image’s pixels of the same column is broken,and even different rows come into being superposition.The VLP tilt taking place in the horizontal direction,by which the array of the image’s pixels of the same row broken,and so much as different columns come into being superposition.展开更多
In this paper, the performance of you only look once(YOLO) series detectors on Chinese license plate recognition(LPR) in the real intelligent transportation system(ITS) monitoring scene is investigated. Specially, a p...In this paper, the performance of you only look once(YOLO) series detectors on Chinese license plate recognition(LPR) in the real intelligent transportation system(ITS) monitoring scene is investigated. Specially, a precise and efficient automatic license plate recognition(ALPR) system based on the YOLOv4 detector is proposed. The proposed ALPR system contains three stages including vehicle detection, license plate detection(LPD) and LPR. In vehicle detection stage, YOLOv4 detector is directly applied. In LPD stage, YOLOv4-tiny detector is exploited. In the last stage, the YOLOv4-tiny detector with attention mechanism for LPR is proposed to use. In addition, a large Chinese license plate dataset containing 10 500 images collected from all 31 provinces in the Chinese mainland is created. This Chinese license plate dataset is named Hefei University of Technology license plate version 1(HFUT-LP v1). Particularly, HFUT-LP v1 dataset is collected in the real ITS monitoring scene. In order to compare the performance of different object detection algorithms for ALPR, a variety of object detection algorithms are used to make a comprehensive performance evaluation. Experimental results show that the proposed ALPR system achieves very high accuracy and has very fast processing speed, which is suitable for real-time LPR.展开更多
Traffic signal control is essential to the efficiency of the road network’s operation.In recent years,more and more detailed detection data provide potential data support for traffic signal control,such as license pl...Traffic signal control is essential to the efficiency of the road network’s operation.In recent years,more and more detailed detection data provide potential data support for traffic signal control,such as license plate recognition(LPR)data.This study aims to develop a traffic signal control optimization method based on model predictive control(MPC)and LPR data.The proposed framework of a closed-loop control system is described in detail.First,the control objectives and queue prediction model for signalized intersection are determined.Then,online optimization and feedback compensation are discussed and implemented.Calculations of the arrival rate at the downstream are based on the LPR data detected at the upstream intersection,and dynamic optimization method of the offset is proposed for a coordinated control.The model is validated using the LPR data of two consecutive intersections with a traffic simulation platform.Results demonstrate that the model can restrain extreme long queuing,improve intersection capacity,and reduce intersection average delay.The developed model promotes the system operating efficiency and shows the general advantage of real-time optimization,feedback,and control.The proposed framework can be potentially applied by local traffic management centers to improve the quality of traffic signal control.展开更多
基金The National Natural Science Foundation of China (No.60972001)the National Key Technology R&D Program of China duringthe 11th Five-Year Plan Period (No.2009BAG13A06)
文摘A novel reconstruction method to improve the recognition of license plate texts of moving vehicles in real traffic videos is proposed, which fuses complimentary information among low resolution （LR） images to yield a high resolution （HR） image. Based on the regularization super-resolution （SR） reconstruction schemes, this paper first introduces a residual gradient （RG） term as a new regularization term to improve the quality of the reconstructed image. Moreover, L1 norm is used to measure the residual data （RD） term and the RG term in order to improve the robustness of the proposed method. Finally, the steepest descent method is exploited to solve the energy functional. Simulated and real acquired video sequence experiments show the effectiveness and practicability of the proposed method and demonstrate its superiority over the bi-cubic interpolation and discontinuity adaptive Markov random field （DAMRF） SR method in both signal to noise ratios （SNR） and visual effects.
基金supported by the China Sichuan Science and Technology Program under Grant 2019YFG0299the Fundamental Research Funds of China West Normal University under Grant 19B045the Research Foundation for Talents of China Normal University under Grant 17YC163。
文摘Multi-license plate detection in complex scenes is still a challenging task because of multiple vehicle license plates with different sizes and classes in the images having complex background.The edge features of high-density distribution and the high curvature features of stroke turning of Chinese character are important signs to distinguish Chinese license plate from other objects.To accurately detect multiple vehicle license plates with different sizes and classes in complex scenes,a multi-object detection of Chinese license plate method based on improved YOLOv3 network was proposed in this research.The improvements include replacing the residual block of the YOLOv3 backbone network with the Inception-ResNet-A block,imbedding the SPP block into the detection network,cutting the redundant Inception-ResNet-A block to suit for the multi-license plate detection task,and clustering the ground truth boxes of license plates to obtain a new set of anchor boxes.A Chinese vehicle license plate image dataset was built for training and testing the improved network,and the location and class of the license plates in each image were accurately labeled.The dataset has 62,153 pieces of images and 4 classes of China vehicle license plates,almost images have multiple license plates with different sizes.Experiments demonstrated that the multilicense plate detection method obtained 83.4%mAP,98.88%precision,98.17%recall,98.52 F1 score,89.196 BFLOPS and 22 FPS on the test dataset,and whole performance was better than the other five compared networks including YOLOv3,SSD,Faster-RCNN,EfficientDet and RetinaNet.
基金The National Natural Science Foundation of China(No. 40804015,61101163)
文摘An efficient vehicle detection approach is proposed for traffic surveillance images, which is based on information fusion of vehicle symmetrical contour and license plate position. The vertical symmetry axis of the vehicle contour in an image is. first detected, and then the vertical and the horizontal symmetry axes of the license plate are detected using the symmetry axis of the vehicle contour as a reference. The vehicle location in an image is determined using license plate symmetry axes and the vertical and the horizontal projection maps of the vehicle edge image. A dataset consisting of 450 images （15 classes of vehicles） is used to test the proposed method. The experimental results indicate that compared with the vehicle contour-based, the license plate location-based, the vehicle texture-based and the Gabor feature-based methods, the proposed method is the best with a detection accuracy of 90.7% and an elapsed time of 125 ms.
文摘The development of scientific inquiry and research has yielded numerous benefits in the realm of intelligent traffic control systems, particularly in the realm of automatic license plate recognition for vehicles. The design of license plate recognition algorithms has undergone digitalization through the utilization of neural networks. In contemporary times, there is a growing demand for vehicle surveillance due to the need for efficient vehicle processing and traffic management. The design, development, and implementation of a license plate recognition system hold significant social, economic, and academic importance. The study aims to present contemporary methodologies and empirical findings pertaining to automated license plate recognition. The primary focus of the automatic license plate recognition algorithm was on image extraction, character segmentation, and recognition. The task of character segmentation has been identified as the most challenging function based on my observations. The license plate recognition project that we designed demonstrated the effectiveness of this method across various observed conditions. Particularly in low-light environments, such as during periods of limited illumination or inclement weather characterized by precipitation. The method has been subjected to testing using a sample size of fifty images, resulting in a 100% accuracy rate. The findings of this study demonstrate the project’s ability to effectively determine the optimal outcomes of simulations.
基金Scientific Research Fund of Hunan Province,PRC (No.07JJ6141)Scientific Research Fund of Hunan Provincial Education Department,PRC (No.05C720).
文摘Vehicle license plate (VLP) character segmentation is an important part of the vehicle license plate recognition system (VLPRS).This paper proposes a least square method (LSM) to treat horizontal tilt and vertical tilt in VLP images.Auxiliary lines are added into the image (or the tilt-corrected image) to make the separated parts of each Chinese character to be an interconnected region.The noise regions will be eliminated after two fusing images are merged according to the minimum principle of gray values. Then,the characters are segmented by projection method (PM) and the final character images are obtained.The experimental results show that this method features fast processing and good performance in segmentation.
文摘The latest advancements in highway research domain and increase in the number of vehicles everyday led to wider exposure and attention towards the development of efficient Intelligent Transportation System(ITS).One of the popular research areas i.e.,Vehicle License Plate Recognition(VLPR)aims at determining the characters that exist in the license plate of the vehicles.The VLPR process is a difficult one due to the differences in viewpoint,shapes,colors,patterns,and non-uniform illumination at the time of capturing images.The current study develops a robust Deep Learning(DL)-based VLPR model using Squirrel Search Algorithm(SSA)-based Convolutional Neural Network(CNN),called the SSA-CNN model.The presented technique has a total of four major processes namely preprocessing,License Plate(LP)localization and detection,character segmentation,and recognition.Hough Transform(HT)is applied as a feature extractor and SSA-CNN algorithm is applied for character recognition in LP.The SSA-CNN method effectively recognizes the characters that exist in the segmented image by optimal tuning of CNN parameters.The HT-SSA-CNN model was experimentally validated using the Stanford Car,FZU Car,and HumAIn 2019 Challenge datasets.The experimentation outcome verified that the presented method was better under several aspects.The projected HT-SSA-CNN model implied the best performance with optimal overall accuracy of 0.983%.
基金supported by the Ningxia Key Research and Development Program(Talent Introduction Special Project)Project(2022YCZX0013)North Minzu University 2022 School-Level Scientific Research Platform“Digital Agriculture Enabling Ningxia Rural Revitalization Innovation Team”(2022PT_S10)+1 种基金Yinchuan City University-Enterprise Joint Innovation Project(2022XQZD009)Ningxia Key Research and Development Program(Key Project)Project(2023BDE02001).
文摘Wearing helmetswhile riding electric bicycles can significantly reduce head injuries resulting fromtraffic accidents.To effectively monitor compliance,the utilization of target detection algorithms through traffic cameras plays a vital role in identifying helmet usage by electric bicycle riders and recognizing license plates on electric bicycles.However,manual enforcement by traffic police is time-consuming and labor-intensive.Traditional methods face challenges in accurately identifying small targets such as helmets and license plates using deep learning techniques.This paper proposes an enhanced model for detecting helmets and license plates on electric bicycles,addressing these challenges.The proposedmodel improves uponYOLOv8n by deepening the network structure,incorporating weighted connections,and introducing lightweight convolutional modules.These modifications aim to enhance the precision of small target recognition while reducing the model’s parameters,making it suitable for deployment on low-performance devices in real traffic scenarios.Experimental results demonstrate that the model achieves an mAP@0.5 of 91.8%,showing an 11.5%improvement over the baselinemodel,with a 16.2%reduction in parameters.Additionally,themodel achieves a frames per second(FPS)rate of 58,meeting the accuracy and speed requirements for detection in actual traffic scenarios.
基金extend their appreciation to the deanship of scientific research at Shaqra University for funding this research work through the Project Number(SU-ANN-202248).
文摘Privacy and trust are significant issues in intelligent transportation systems(ITS).Data security is critical in ITS systems since sensitive user data is communicated to another user over the internet through wireless devices and routes such as radio channels,optical fiber,and blockchain technology.The Internet of Things(IoT)is a network of connected,interconnected gadgets.Privacy issues occasionally arise due to the amount of data generated.However,they have been primarily addressed by blockchain and smart contract technology.While there are still security issues with smart contracts,primarily due to the complexity of writing the code,there are still many challenges to consider when designing blockchain designs for the IoT environment.This study uses traditional blockchain technology with the“You Only Look Once”(YOLO)object detection method to accurately locate and identify license plates.While YOLO and blockchain technologies used for intelligent vehicle license plate recognition are promising,they have received limited research attention.Real-time object identification and recognition would be possible by combining a cutting-edge object detection technique with a regional convolutional neural network(RCNN)built with the tensor flow core open source libraries.This method works reasonably well for identifying any license plate.The Automatic License Plate Recognition(ALPR)approach delivered outstanding results in various datasets.First,with a recognition rate of 96.2%,our system(UFPR-ALPR)surpassed the previously used technology,consisting of 4500 frames and around 150 films.Second,a deep learning algorithm was trained to recognize images of license plate numbers using the UFPR-ALPR dataset.Third,the license plate’s characters were complicated for standard methods to identify because of the shifting lighting correctly.The proposed model,however,produced beneficial outcomes.
基金supported in part by the Natural Science Foundation of Hainan Province under Grant 621MS017the National Natural Science Foundation of China under Grant U19B2044.
文摘License plate recognition technology use widely in intelligent trafficmanagement and control. Researchers have been committed to improving thespeed and accuracy of license plate recognition for nearly 30 years. This paperis the first to propose combining the attention mechanism with YOLO-v5and LPRnet to construct a new license plate recognition model (LPR-CBAMNet).Through the attention mechanism CBAM(Convolutional Block AttentionModule), the importance of different feature channels in license platerecognition can be re-calibrated to obtain proper attention to features. Forceinformation to achieve the purpose of improving recognition speed andaccuracy. Experimental results show that the model construction methodis superior in speed and accuracy to traditional license plate recognitionalgorithms. The accuracy of the recognition model of the CBAM model isincreased by two percentage points to 97.2%, and the size of the constructedmodel is only 1.8 M, which can meet the requirements of real-time executionof embedded low-power devices. The codes for training and evaluating LPRCBAM-Net are available under the open-source MIT License at: https://github.com/To2rk/LPR-CBAM-Net.
基金This research was funded by the Deanship of Scientific Research at Princess Nourah bint Abdulrahman University through the Fast-track Research Funding Program。
文摘Smart city-aspiring urban areas should have a number of necessary elements in place to achieve the intended objective.Precise controlling and management of traffic conditions,increased safety and surveillance,and enhanced incident avoidance and management should be top priorities in smart city management.At the same time,Vehicle License Plate Number Recognition(VLPNR)has become a hot research topic,owing to several real-time applications like automated toll fee processing,traffic law enforcement,private space access control,and road traffic surveillance.Automated VLPNR is a computer vision-based technique which is employed in the recognition of automobiles based on vehicle number plates.The current research paper presents an effective Deep Learning(DL)-based VLPNR called DLVLPNR model to identify and recognize the alphanumeric characters present in license plate.The proposed model involves two main stages namely,license plate detection and Tesseract-based character recognition.The detection of alphanumeric characters present in license plate takes place with the help of fast RCNN with Inception V2 model.Then,the characters in the detected number plate are extracted using Tesseract Optical Character Recognition(OCR)model.The performance of DL-VLPNR model was tested in this paper using two benchmark databases,and the experimental outcome established the superior performance of the model compared to other methods.
基金funded by the NSFC program with grant 60672117supported in part by Xian Desheng Scientific Tech. Inc., Xian, P. R. China
文摘In this paper, a novel method of licence plate recognition (LPR) using the vertical traverse density (VTD) and horizontal traverse density (HTD) is presented. The neutral network algorithm using VTD and HTD features is also an innovation. In addition, a so called secondary recognition method which splits characters into different parts is developed. Experimental results show that it is a simple and fast algorithm, which meets the request of real time and nicety performances of LPR and thus has applied value in intelligence transportation system (ITS).
基金supported by the University of Alicante Project under Grant No.PPC–1928273/A
文摘Nowadays, license plate recognition for parking systems is a critical task to provide automatic control of customers and payment. This paper introduces a new method for automatic recognition of license plates of vehicles by mathematical morphology. The proposed method can provide the license plate number of the plates in different light conditions, colors, sizes, and inclination （angles）. The algorithm can recognize the license plates of European Union vehicles quickly and correctly. The pattern learning of mathematical skeletons has high efficiency in the process. The performance of the algorithm is demonstrated well by the test in a parking control system.
基金This work is supported by the National Natural Science Foundation of China under Grant Nos.U1636215,61902082the Guangdong Key R&D Program of China 2019B010136003National Key R&D Program of China 2019YFB1706003.
文摘The license plate recognition system(LPRS)has been widely adopted in daily life due to its efficiency and high accuracy.Deep neural networks are commonly used in the LPRS to improve the recognition accuracy.However,researchers have found that deep neural networks have their own security problems that may lead to unexpected results.Specifically,they can be easily attacked by the adversarial examples that are generated by adding small perturbations to the original images,resulting in incorrect license plate recognition.There are some classic methods to generate adversarial examples,but they cannot be adopted on LPRS directly.In this paper,we modify some classic methods to generate adversarial examples that could mislead the LPRS.We conduct extensive evaluations on the HyperLPR system and the results show that the system could be easily attacked by such adversarial examples.In addition,we show that the generated images could also attack the black-box systems;we show some examples that the Baidu LPR system also makes incorrect recognitions.We hope this paper could help improve the LPRS by realizing the existence of such adversarial attacks.
文摘This paper analyzes and dissertates the discrete wavelet transform and improved projection algorithm in four kernel stages （image preprocessing, license plate localization, character segmentation, license plate recognition, i.e.） of license plate recognition system in detail. At last, it gives some conclusions and suggestions on future research.
文摘In this paper, a kind of practical image segmentation algorithm for segment characters from car license plate is presented, based on morphology and labeling. First by morphological operation, noise in the binary image of license plate can be greatly decreased. Then, by labeling, each connected pixel component is given a unique label. Finally, by the known data of license plate, each character is extracted correctly. The advantage of this method is that it can deal with plates with different sizes and connected characters plates, and inclined plates. The experiment results show that it is an effective way to extract characters from the license plate, and can be put into practical use.
文摘Recent technological advancements have been used to improve the quality of living in smart cities.At the same time,automated detection of vehicles can be utilized to reduce crime rate and improve public security.On the other hand,the automatic identification of vehicle license plate(LP)character becomes an essential process to recognize vehicles in real time scenarios,which can be achieved by the exploitation of optimal deep learning(DL)approaches.In this article,a novel hybrid metaheuristic optimization based deep learning model for automated license plate character recognition(HMODL-ALPCR)technique has been presented for smart city environments.The major intention of the HMODL-ALPCR technique is to detect LPs and recognize the characters that exist in them.For effective LP detection process,mask regional convolutional neural network(Mask-RCNN)model is applied and the Inception with Residual Network(ResNet)-v2 as the baseline network.In addition,hybrid sunflower optimization with butterfly optimization algorithm(HSFO-BOA)is utilized for the hyperparameter tuning of the Inception-ResNetv2 model.Finally,Tesseract based character recognition model is applied to effectively recognize the characters present in the LPs.The experimental result analysis of the HMODL-ALPCR technique takes place against the benchmark dataset and the experimental outcomes pointed out the improved efficacy of the HMODL-ALPCR technique over the recent methods.
基金Supported by the National Natural Science Foundation of China(62006150)Shanghai Young Science and Technology Talents Sailing Program(19YF1418400)+1 种基金Shanghai Key Laboratory of Multidimensional Information Processing(2020MIP001)Fundamental Research Funds for the Central Universities
文摘In recent years,license plate recognition system(LPRS)is widely used in various places.Fast and accurate license plate detection is the first and critical step in LPRS.In order to improve the performance of license plate detection in complex environment,we propose a novel attention U-net with multilevel fusion(AUMF).At first,input images are fed to the network.Then,the feature maps of each level are generated by convolution operations of the original images.Before the feature connection,there are multi-layer splicing and convolution to detect more features.The attention mechanisms are used to retain the information of important regions.In order to ensure that the size of the input and output images are the same,down-sampling and up-sampling are employed to resize the feature mappings between the upper and lower levels.In the complex environment,the AUMF can accurately detect the license plate.To validate the effectiveness of the proposed method,we conducted a series of experiments on the AOLP dataset.The experimental results show that our approach effectively improves the performance of license plate detection under the three different license plate environments of AOLP dataset.
文摘The shortage of current different approaches of the vehicle license plate(VLP) tilt correction is analyzed in the paper and a new rotary correction method put forward based on the former ways of the VLP tilt correction in the horizontal direction and the vertical direction Owing to the VLP tilt taking place in the vertical direction,the array of the image’s pixels of the same column is broken,and even different rows come into being superposition.The VLP tilt taking place in the horizontal direction,by which the array of the image’s pixels of the same row broken,and so much as different columns come into being superposition.
基金supported by the National Natural Science Foundation of China(62076086)the Key Research and Development Program in Anhui Province(202004d07020008)。
文摘In this paper, the performance of you only look once(YOLO) series detectors on Chinese license plate recognition(LPR) in the real intelligent transportation system(ITS) monitoring scene is investigated. Specially, a precise and efficient automatic license plate recognition(ALPR) system based on the YOLOv4 detector is proposed. The proposed ALPR system contains three stages including vehicle detection, license plate detection(LPD) and LPR. In vehicle detection stage, YOLOv4 detector is directly applied. In LPD stage, YOLOv4-tiny detector is exploited. In the last stage, the YOLOv4-tiny detector with attention mechanism for LPR is proposed to use. In addition, a large Chinese license plate dataset containing 10 500 images collected from all 31 provinces in the Chinese mainland is created. This Chinese license plate dataset is named Hefei University of Technology license plate version 1(HFUT-LP v1). Particularly, HFUT-LP v1 dataset is collected in the real ITS monitoring scene. In order to compare the performance of different object detection algorithms for ALPR, a variety of object detection algorithms are used to make a comprehensive performance evaluation. Experimental results show that the proposed ALPR system achieves very high accuracy and has very fast processing speed, which is suitable for real-time LPR.
基金The National Key Research and Development Program of China(No.2018YFB1601000)Key Program of National Natural Science Foundation of China(Grant No.U21B2089).
文摘Traffic signal control is essential to the efficiency of the road network’s operation.In recent years,more and more detailed detection data provide potential data support for traffic signal control,such as license plate recognition(LPR)data.This study aims to develop a traffic signal control optimization method based on model predictive control(MPC)and LPR data.The proposed framework of a closed-loop control system is described in detail.First,the control objectives and queue prediction model for signalized intersection are determined.Then,online optimization and feedback compensation are discussed and implemented.Calculations of the arrival rate at the downstream are based on the LPR data detected at the upstream intersection,and dynamic optimization method of the offset is proposed for a coordinated control.The model is validated using the LPR data of two consecutive intersections with a traffic simulation platform.Results demonstrate that the model can restrain extreme long queuing,improve intersection capacity,and reduce intersection average delay.The developed model promotes the system operating efficiency and shows the general advantage of real-time optimization,feedback,and control.The proposed framework can be potentially applied by local traffic management centers to improve the quality of traffic signal control.
