Computer-vision and deep-learning techniques are widely applied to detect,monitor,and assess pavement conditions including road crack detection.Traditional methods fail to achieve satisfactory accuracy and generalizat...Computer-vision and deep-learning techniques are widely applied to detect,monitor,and assess pavement conditions including road crack detection.Traditional methods fail to achieve satisfactory accuracy and generalization performance in for crack detection.Complex network model can generate redundant feature maps and computational complexity.Therefore,this paper proposes a novel model compression framework based on deep learning to detect road cracks,which can improve the detection efficiency and accuracy.A distillation loss function is proposed to compress the teacher model,followed by channel pruning.Meanwhile,a multi-dilation model is proposed to improve the accuracy of the model pruned.The proposed method is tested on the public database CrackForest dataset(CFD).The experimental results show that the proposed method is more efficient and accurate than other state-of-art methods.展开更多
Nowadays, asphalt road has dominated highways around the world. Among various defects of asphalt road, crackshave been paid more attention, since cracks often cause major engineering and personnel safety incidents. Cu...Nowadays, asphalt road has dominated highways around the world. Among various defects of asphalt road, crackshave been paid more attention, since cracks often cause major engineering and personnel safety incidents. Currentmanual crack inspection methods are time-consuming and labor-intensive, and most segmentation methods cannot detect cracks at the pixel level. This paper proposes an intelligent segmentation and measurement model basedon the modified Mask R-CNN algorithm to automatically and accurately detect asphalt road cracks. The modelproposed in this paper mainly includes a convolutional neural network (CNN), an optimized region proposalnetwork (RPN), a region of interest (RoI) Align layer, a candidate area classification network and a Mask branch offully convolutional network (FCN). The ratio and size of anchors in the RPN are adjusted to improve the accuracyand efficiency of segmentation. Soft non-maximum suppression (Soft-NMS) algorithm is developed to improvethe segmentation accuracy. A dataset including 8,689 images (512× 512 pixels) of asphalt cracks is established andthe road crack is manually marked. Transfer learning is used to initialize the model parameters in the trainingprocess. To optimize the model training parameters, multiple comparison experiments are performed, and the testresults show that the mean average precision (mAP) value and F1-score of the optimal trained model are 0.952 and0.949. Subsequently, the robustness verification test and comparative test of the trained model are conducted andthe topological features of the crack are extracted. Then, the damage area, length and average width of the crackare measured automatically and accurately at pixel level. More importantly, this paper develops an automatic crackdetection platform for asphalt roads to automatically extract the number, area, length and average width of cracks,which can significantly improve the crack detection efficiency for the road maintenance industry.展开更多
The increasing global population at a rapid pace makes road trafficdense;managing such massive traffic is challenging. In developing countrieslike Pakistan, road traffic accidents (RTA) have the highest mortality perc...The increasing global population at a rapid pace makes road trafficdense;managing such massive traffic is challenging. In developing countrieslike Pakistan, road traffic accidents (RTA) have the highest mortality percentageamong other Asian countries. The main reasons for RTAs are roadcracks and potholes. Understanding the need for an automated system forthe detection of cracks and potholes, this study proposes a decision supportsystem (DSS) for an autonomous road information system for smart citydevelopment with the use of deep learning. The proposed DSS works in layerswhere initially the image of roads is captured and coordinates attached to theimage with the help of global positioning system (GPS), communicated tothe decision layer to find about the cracks and potholes in the roads, andeventually, that information is passed to the road management informationsystem, which gives information to drivers and the maintenance department.For the decision layer, we projected a CNN-based model for pothole crackdetection (PCD). Aimed at training, a K-fold cross-validation strategy wasused where the value of K was set to 10. The training of PCD was completedwith a self-collected dataset consisting of 6000 images from Pakistani roads.The proposed PCD achieved 98% of precision, 97% recall, and accuracy whiletesting on unseen images. The results produced by our model are higher thanthe existing model in terms of performance and computational cost, whichproves its significance.展开更多
In light of the limited efficacy of conventional methods for identifying pavement cracks and the absence of comprehensive depth and location data in two-dimensional photographs,this study presents an intelligent strat...In light of the limited efficacy of conventional methods for identifying pavement cracks and the absence of comprehensive depth and location data in two-dimensional photographs,this study presents an intelligent strategy for extracting road cracks.This methodology involves the integration of laser point cloud data obtained from a vehicle-mounted system and a panoramic sequence of images.The study employs a vehicle-mounted LiDAR measurement system to acquire laser point cloud and panoramic sequence image data simultaneously.A convolutional neural network is utilized to extract cracks from the panoramic sequence image.The extracted sequence image is then aligned with the laser point cloud,enabling the assignment of RGB information to the vehicle-mounted three dimensional(3D)point cloud and location information to the two dimensional(2D)panoramic image.Additionally,a threshold value is set based on the crack elevation change to extract the aligned roadway point cloud.The three-dimensional data pertaining to the cracks can be acquired.The experimental findings demonstrate that the use of convolutional neural networks has yielded noteworthy outcomes in the extraction of road cracks.The utilization of point cloud and image alignment techniques enables the extraction of precise location data pertaining to road cracks.This approach exhibits superior accuracy when compared to conventional methods.Moreover,it facilitates rapid and accurate identification and localization of road cracks,thereby playing a crucial role in ensuring road maintenance and traffic safety.Consequently,this technique finds extensive application in the domains of intelligent transportation and urbanization development.The technology exhibits significant promise for use in the domains of intelligent transportation and city development.展开更多
This study aimed to propose road crack detection method based on infrared image fusion technology.By analyzing the characteristics of road crack images,this method uses a variety of infrared image fusion methods to pr...This study aimed to propose road crack detection method based on infrared image fusion technology.By analyzing the characteristics of road crack images,this method uses a variety of infrared image fusion methods to process different types of images.The use of this method allows the detection of road cracks,which not only reduces the professional requirements for inspectors,but also improves the accuracy of road crack detection.Based on infrared image processing technology,on the basis of in-depth analysis of infrared image features,a road crack detection method is proposed,which can accurately identify the road crack location,direction,length,and other characteristic information.Experiments showed that this method has a good effect,and can meet the requirement of road crack detection.展开更多
Road damage detection is an important aspect of road maintenance.Traditional manual inspections are laborious and imprecise.With the rise of deep learning technology,pavement detection methods employing deep neural ne...Road damage detection is an important aspect of road maintenance.Traditional manual inspections are laborious and imprecise.With the rise of deep learning technology,pavement detection methods employing deep neural networks give an efficient and accurate solution.However,due to background diversity,limited resolution,and fracture similarity,it is tough to detect road cracks with high accuracy.In this study,we offer a unique,efficient and accurate road crack damage detection,namely YOLOv8-ES.We present a novel dynamic convolutional layer(EDCM)that successfully increases the feature extraction capabilities for small fractures.At the same time,we also present a new attention mechanism(SGAM).It can effectively retain crucial information and increase the network feature extraction capacity.The Wise-IoU technique contains a dynamic,non-monotonic focusing mechanism designed to return to the goal-bounding box more precisely,especially for low-quality samples.We validate our method on both RDD2022 and VOC2007 datasets.The experimental results suggest that YOLOv8-ES performs well.This unique approach provides great support for the development of intelligent road maintenance systems and is projected to achieve further advances in future applications.展开更多
The detection of crack defects on the walls of road tunnels is a crucial step in the process of ensuring travel safetyand performing routine tunnel maintenance. The automatic and accurate detection of cracks on the su...The detection of crack defects on the walls of road tunnels is a crucial step in the process of ensuring travel safetyand performing routine tunnel maintenance. The automatic and accurate detection of cracks on the surface of roadtunnels is the key to improving the maintenance efficiency of road tunnels. Machine vision technology combinedwith a deep neural network model is an effective means to realize the localization and identification of crackdefects on the surface of road tunnels.We propose a complete set of automatic inspection methods for identifyingcracks on the walls of road tunnels as a solution to the problem of difficulty in identifying cracks during manualmaintenance. First, a set of equipment applied to the real-time acquisition of high-definition images of walls inroad tunnels is designed. Images of walls in road tunnels are acquired based on the designed equipment, whereimages containing crack defects are manually identified and selected. Subsequently, the training and validationsets used to construct the crack inspection model are obtained based on the acquired images, whereas the regionscontaining cracks and the pixels of the cracks are finely labeled. After that, a crack area sensing module is designedbased on the proposed you only look once version 7 model combined with coordinate attention mechanism (CAYOLOV7) network to locate the crack regions in the road tunnel surface images. Only subimages containingcracks are acquired and sent to the multiscale semantic segmentation module for extraction of the pixels to whichthe cracks belong based on the DeepLab V3+ network. The precision and recall of the crack region localizationon the surface of a road tunnel based on our proposed method are 82.4% and 93.8%, respectively. Moreover, themean intersection over union (MIoU) and pixel accuracy (PA) values for achieving pixel-level detection accuracyare 76.84% and 78.29%, respectively. The experimental results on the dataset show that our proposed two-stagedetection method outperforms other state-of-the-art models in crack region localization and detection. Based onour proposedmethod, the images captured on the surface of a road tunnel can complete crack detection at a speed often frames/second, and the detection accuracy can reach 0.25 mm, which meets the requirements for maintenanceof an actual project. The designed CA-YOLO V7 network enables precise localization of the area to which a crackbelongs in images acquired under different environmental and lighting conditions in road tunnels. The improvedDeepLab V3+ network based on lightweighting is able to extract crack morphology in a given region more quicklywhile maintaining segmentation accuracy. The established model combines defect localization and segmentationmodels for the first time, realizing pixel-level defect localization and extraction on the surface of road tunnelsin complex environments, and is capable of determining the actual size of cracks based on the physical coordinatesystemafter camera calibration. The trainedmodelhas highaccuracy andcanbe extendedandapplied to embeddedcomputing devices for the assessment and repair of damaged areas in different types of road tunnels.展开更多
为解决现有道路裂缝检测模型精度低、易漏检误检等问题,提出了一种基于混合局部通道注意力机制的YOLOv10n道路裂缝检测模型。针对道路裂缝细长且不规则的形状特点,首先在模型特征提取网络引入混合局部通道注意力机制(mixed local channe...为解决现有道路裂缝检测模型精度低、易漏检误检等问题,提出了一种基于混合局部通道注意力机制的YOLOv10n道路裂缝检测模型。针对道路裂缝细长且不规则的形状特点,首先在模型特征提取网络引入混合局部通道注意力机制(mixed local channel attention,MLCA),增强模型对道路裂缝特征的提取能力;其次,采用重参数化泛化特征金字塔网络(reparameterized generalized feature pyramid network,RepGFPN)优化原始颈部网络,充分融合多尺度下的裂缝特征信息;最后使用Focaler-IoU替换CIoU损失函数,调整模型训练不同裂缝样本的权重,加快收敛速度。在RDD2022_China数据集上的实验结果表明,改进后的模型相较于原始YOLOv10n模型检测准确率提升4.4%,平均精度均值(mean average precision,mAP)提高2.9%。与其他主流目标检测模型相比,改进后的模型在准确率、召回率和计算成本等方面均展现出最佳性能,验证了本文方法在道路裂缝检测任务中的有效性和优越性。展开更多
基金supported in part by the Jiangsu Province Construction System Science and Technology Project(No.2024ZD056)the Research Development Fund of Xi’an Jiaotong-Liverpool University(No.RDF-24-01-097).
文摘Computer-vision and deep-learning techniques are widely applied to detect,monitor,and assess pavement conditions including road crack detection.Traditional methods fail to achieve satisfactory accuracy and generalization performance in for crack detection.Complex network model can generate redundant feature maps and computational complexity.Therefore,this paper proposes a novel model compression framework based on deep learning to detect road cracks,which can improve the detection efficiency and accuracy.A distillation loss function is proposed to compress the teacher model,followed by channel pruning.Meanwhile,a multi-dilation model is proposed to improve the accuracy of the model pruned.The proposed method is tested on the public database CrackForest dataset(CFD).The experimental results show that the proposed method is more efficient and accurate than other state-of-art methods.
基金This research was funded by the National Key Research and Development Program of China(No.2017YFC1501204)the National Natural Science Foundation of China(No.51678536)+4 种基金the Guangdong Innovative and Entrepreneurial Research Team Program(2016ZT06N340)the Program for Science and Technology Innovation Talents in Universities of Henan Province(Grant No.19HASTIT043)the Outstanding Young Talent Research Fund of Zhengzhou University(1621323001)the Program for Innovative Research Team(in Science and Technology)in University of Henan Province(18IRTSTHN007)the Research on NonDestructive Testing(NDT)and Rapid Evaluation Technology for Grouting Quality of Prestressed Ducts(Contract No.HG-GCKY-01-002).The authors would like to thank for these financial supports.
文摘Nowadays, asphalt road has dominated highways around the world. Among various defects of asphalt road, crackshave been paid more attention, since cracks often cause major engineering and personnel safety incidents. Currentmanual crack inspection methods are time-consuming and labor-intensive, and most segmentation methods cannot detect cracks at the pixel level. This paper proposes an intelligent segmentation and measurement model basedon the modified Mask R-CNN algorithm to automatically and accurately detect asphalt road cracks. The modelproposed in this paper mainly includes a convolutional neural network (CNN), an optimized region proposalnetwork (RPN), a region of interest (RoI) Align layer, a candidate area classification network and a Mask branch offully convolutional network (FCN). The ratio and size of anchors in the RPN are adjusted to improve the accuracyand efficiency of segmentation. Soft non-maximum suppression (Soft-NMS) algorithm is developed to improvethe segmentation accuracy. A dataset including 8,689 images (512× 512 pixels) of asphalt cracks is established andthe road crack is manually marked. Transfer learning is used to initialize the model parameters in the trainingprocess. To optimize the model training parameters, multiple comparison experiments are performed, and the testresults show that the mean average precision (mAP) value and F1-score of the optimal trained model are 0.952 and0.949. Subsequently, the robustness verification test and comparative test of the trained model are conducted andthe topological features of the crack are extracted. Then, the damage area, length and average width of the crackare measured automatically and accurately at pixel level. More importantly, this paper develops an automatic crackdetection platform for asphalt roads to automatically extract the number, area, length and average width of cracks,which can significantly improve the crack detection efficiency for the road maintenance industry.
基金Hunan Provincial Science and Technology Innovation Leader Project,Grant/Award Number:2021RC4025National Natural ScienceFoundation of China,Grant/Award Number:51808209Hunan Provincial Innovation Foundation for Postgraduate,Grant/Award Number:QL20210106.
文摘The increasing global population at a rapid pace makes road trafficdense;managing such massive traffic is challenging. In developing countrieslike Pakistan, road traffic accidents (RTA) have the highest mortality percentageamong other Asian countries. The main reasons for RTAs are roadcracks and potholes. Understanding the need for an automated system forthe detection of cracks and potholes, this study proposes a decision supportsystem (DSS) for an autonomous road information system for smart citydevelopment with the use of deep learning. The proposed DSS works in layerswhere initially the image of roads is captured and coordinates attached to theimage with the help of global positioning system (GPS), communicated tothe decision layer to find about the cracks and potholes in the roads, andeventually, that information is passed to the road management informationsystem, which gives information to drivers and the maintenance department.For the decision layer, we projected a CNN-based model for pothole crackdetection (PCD). Aimed at training, a K-fold cross-validation strategy wasused where the value of K was set to 10. The training of PCD was completedwith a self-collected dataset consisting of 6000 images from Pakistani roads.The proposed PCD achieved 98% of precision, 97% recall, and accuracy whiletesting on unseen images. The results produced by our model are higher thanthe existing model in terms of performance and computational cost, whichproves its significance.
基金founded by National Key R&D Program of China (No.2021YFB2601200)National Natural Science Foundation of China (No.42171416)Teacher Support Program for Pyramid Talent Training Project of Beijing University of Civil Engineering and Architecture (No.JDJQ20200307).
文摘In light of the limited efficacy of conventional methods for identifying pavement cracks and the absence of comprehensive depth and location data in two-dimensional photographs,this study presents an intelligent strategy for extracting road cracks.This methodology involves the integration of laser point cloud data obtained from a vehicle-mounted system and a panoramic sequence of images.The study employs a vehicle-mounted LiDAR measurement system to acquire laser point cloud and panoramic sequence image data simultaneously.A convolutional neural network is utilized to extract cracks from the panoramic sequence image.The extracted sequence image is then aligned with the laser point cloud,enabling the assignment of RGB information to the vehicle-mounted three dimensional(3D)point cloud and location information to the two dimensional(2D)panoramic image.Additionally,a threshold value is set based on the crack elevation change to extract the aligned roadway point cloud.The three-dimensional data pertaining to the cracks can be acquired.The experimental findings demonstrate that the use of convolutional neural networks has yielded noteworthy outcomes in the extraction of road cracks.The utilization of point cloud and image alignment techniques enables the extraction of precise location data pertaining to road cracks.This approach exhibits superior accuracy when compared to conventional methods.Moreover,it facilitates rapid and accurate identification and localization of road cracks,thereby playing a crucial role in ensuring road maintenance and traffic safety.Consequently,this technique finds extensive application in the domains of intelligent transportation and urbanization development.The technology exhibits significant promise for use in the domains of intelligent transportation and city development.
文摘This study aimed to propose road crack detection method based on infrared image fusion technology.By analyzing the characteristics of road crack images,this method uses a variety of infrared image fusion methods to process different types of images.The use of this method allows the detection of road cracks,which not only reduces the professional requirements for inspectors,but also improves the accuracy of road crack detection.Based on infrared image processing technology,on the basis of in-depth analysis of infrared image features,a road crack detection method is proposed,which can accurately identify the road crack location,direction,length,and other characteristic information.Experiments showed that this method has a good effect,and can meet the requirement of road crack detection.
文摘Road damage detection is an important aspect of road maintenance.Traditional manual inspections are laborious and imprecise.With the rise of deep learning technology,pavement detection methods employing deep neural networks give an efficient and accurate solution.However,due to background diversity,limited resolution,and fracture similarity,it is tough to detect road cracks with high accuracy.In this study,we offer a unique,efficient and accurate road crack damage detection,namely YOLOv8-ES.We present a novel dynamic convolutional layer(EDCM)that successfully increases the feature extraction capabilities for small fractures.At the same time,we also present a new attention mechanism(SGAM).It can effectively retain crucial information and increase the network feature extraction capacity.The Wise-IoU technique contains a dynamic,non-monotonic focusing mechanism designed to return to the goal-bounding box more precisely,especially for low-quality samples.We validate our method on both RDD2022 and VOC2007 datasets.The experimental results suggest that YOLOv8-ES performs well.This unique approach provides great support for the development of intelligent road maintenance systems and is projected to achieve further advances in future applications.
基金the Changsha Science and Technology Plan 2004081in part by the Science and Technology Program of Hunan Provincial Department of Transportation 202117in part by the Science and Technology Research and Development Program Project of the China Railway Group Limited 2021-Special-08.
文摘The detection of crack defects on the walls of road tunnels is a crucial step in the process of ensuring travel safetyand performing routine tunnel maintenance. The automatic and accurate detection of cracks on the surface of roadtunnels is the key to improving the maintenance efficiency of road tunnels. Machine vision technology combinedwith a deep neural network model is an effective means to realize the localization and identification of crackdefects on the surface of road tunnels.We propose a complete set of automatic inspection methods for identifyingcracks on the walls of road tunnels as a solution to the problem of difficulty in identifying cracks during manualmaintenance. First, a set of equipment applied to the real-time acquisition of high-definition images of walls inroad tunnels is designed. Images of walls in road tunnels are acquired based on the designed equipment, whereimages containing crack defects are manually identified and selected. Subsequently, the training and validationsets used to construct the crack inspection model are obtained based on the acquired images, whereas the regionscontaining cracks and the pixels of the cracks are finely labeled. After that, a crack area sensing module is designedbased on the proposed you only look once version 7 model combined with coordinate attention mechanism (CAYOLOV7) network to locate the crack regions in the road tunnel surface images. Only subimages containingcracks are acquired and sent to the multiscale semantic segmentation module for extraction of the pixels to whichthe cracks belong based on the DeepLab V3+ network. The precision and recall of the crack region localizationon the surface of a road tunnel based on our proposed method are 82.4% and 93.8%, respectively. Moreover, themean intersection over union (MIoU) and pixel accuracy (PA) values for achieving pixel-level detection accuracyare 76.84% and 78.29%, respectively. The experimental results on the dataset show that our proposed two-stagedetection method outperforms other state-of-the-art models in crack region localization and detection. Based onour proposedmethod, the images captured on the surface of a road tunnel can complete crack detection at a speed often frames/second, and the detection accuracy can reach 0.25 mm, which meets the requirements for maintenanceof an actual project. The designed CA-YOLO V7 network enables precise localization of the area to which a crackbelongs in images acquired under different environmental and lighting conditions in road tunnels. The improvedDeepLab V3+ network based on lightweighting is able to extract crack morphology in a given region more quicklywhile maintaining segmentation accuracy. The established model combines defect localization and segmentationmodels for the first time, realizing pixel-level defect localization and extraction on the surface of road tunnelsin complex environments, and is capable of determining the actual size of cracks based on the physical coordinatesystemafter camera calibration. The trainedmodelhas highaccuracy andcanbe extendedandapplied to embeddedcomputing devices for the assessment and repair of damaged areas in different types of road tunnels.
文摘为解决现有道路裂缝检测模型精度低、易漏检误检等问题,提出了一种基于混合局部通道注意力机制的YOLOv10n道路裂缝检测模型。针对道路裂缝细长且不规则的形状特点,首先在模型特征提取网络引入混合局部通道注意力机制(mixed local channel attention,MLCA),增强模型对道路裂缝特征的提取能力;其次,采用重参数化泛化特征金字塔网络(reparameterized generalized feature pyramid network,RepGFPN)优化原始颈部网络,充分融合多尺度下的裂缝特征信息;最后使用Focaler-IoU替换CIoU损失函数,调整模型训练不同裂缝样本的权重,加快收敛速度。在RDD2022_China数据集上的实验结果表明,改进后的模型相较于原始YOLOv10n模型检测准确率提升4.4%,平均精度均值(mean average precision,mAP)提高2.9%。与其他主流目标检测模型相比,改进后的模型在准确率、召回率和计算成本等方面均展现出最佳性能,验证了本文方法在道路裂缝检测任务中的有效性和优越性。
