This study investigates the application of Learnable Memory Vision Transformers(LMViT)for detecting metal surface flaws,comparing their performance with traditional CNNs,specifically ResNet18 and ResNet50,as well as o...This study investigates the application of Learnable Memory Vision Transformers(LMViT)for detecting metal surface flaws,comparing their performance with traditional CNNs,specifically ResNet18 and ResNet50,as well as other transformer-based models including Token to Token ViT,ViT withoutmemory,and Parallel ViT.Leveraging awidely-used steel surface defect dataset,the research applies data augmentation and t-distributed stochastic neighbor embedding(t-SNE)to enhance feature extraction and understanding.These techniques mitigated overfitting,stabilized training,and improved generalization capabilities.The LMViT model achieved a test accuracy of 97.22%,significantly outperforming ResNet18(88.89%)and ResNet50(88.90%),aswell as the Token to TokenViT(88.46%),ViT without memory(87.18),and Parallel ViT(91.03%).Furthermore,LMViT exhibited superior training and validation performance,attaining a validation accuracy of 98.2%compared to 91.0%for ResNet 18,96.0%for ResNet50,and 89.12%,87.51%,and 91.21%for Token to Token ViT,ViT without memory,and Parallel ViT,respectively.The findings highlight the LMViT’s ability to capture long-range dependencies in images,an areawhere CNNs struggle due to their reliance on local receptive fields and hierarchical feature extraction.The additional transformer-based models also demonstrate improved performance in capturing complex features over CNNs,with LMViT excelling particularly at detecting subtle and complex defects,which is critical for maintaining product quality and operational efficiency in industrial applications.For instance,the LMViT model successfully identified fine scratches and minor surface irregularities that CNNs often misclassify.This study not only demonstrates LMViT’s potential for real-world defect detection but also underscores the promise of other transformer-based architectures like Token to Token ViT,ViT without memory,and Parallel ViT in industrial scenarios where complex spatial relationships are key.Future research may focus on enhancing LMViT’s computational efficiency for deployment in real-time quality control systems.展开更多
The service life of internal combustion engines is significantly influenced by surface defects in cylinder liners.To address the limitations of traditional detection methods,we propose an enhanced YOLOv8 model with Sw...The service life of internal combustion engines is significantly influenced by surface defects in cylinder liners.To address the limitations of traditional detection methods,we propose an enhanced YOLOv8 model with Swin Transformer as the backbone network.This approach leverages Swin Transformer's multi-head self-attention mechanism for improved feature extraction of defects spanning various scales.Integrated with the YOLOv8 detection head,our model achieves a mean average precision of 85.1%on our dataset,outperforming baseline methods by 1.4%.The model's effectiveness is further demonstrated on a steel-surface defect dataset,indicating its broad applicability in industrial surface defect detection.Our work highlights the potential of combining Swin Transformer and YOLOv8 for accurate and efficient defect detection.展开更多
Aiming at the problems of low detection efficiency and difficult positioning of traditional steel surface defect detection methods,a lightweight steel surface defect detection model based on you only look once version...Aiming at the problems of low detection efficiency and difficult positioning of traditional steel surface defect detection methods,a lightweight steel surface defect detection model based on you only look once version 7(YOLOv7)is proposed.First,a cascading style sheets(CSS)block module is proposed,which uses more lightweight operations to obtain redundant information in the feature map,reduces the amount of computation,and effectively improves the detection speed.Secondly,the improved spatial pyramid pooling with cross stage partial convolutions(SPPCSPC)structure is adopted to ensure that the model can also pay attention to the defect location information while predicting the defect category information,obtain richer defect features.In addition,the convolution operation in the original model is simplified,which significantly reduces the size of the model and helps to improve the detection speed.Finally,using efficient intersection over union(EIOU)loss to focus on high-quality anchors,speed up convergence and improve positioning accuracy.Experiments were carried out on the Northeastern University-defect(NEU-DET)steel surface defect dataset.Compared with the original YOLOv7 model,the number of parameters of this model was reduced by 40%,the frames per second(FPS)reached 112,and the average accuracy reached 79.1%,the detection accuracy and speed have been improved,which can meet the needs of steel surface defect detection.展开更多
Efficient detection of surface defects is primary for ensuring product quality during manufacturing processes.To enhance the performance of deep learning-based methods in practical applications,the authors propose Den...Efficient detection of surface defects is primary for ensuring product quality during manufacturing processes.To enhance the performance of deep learning-based methods in practical applications,the authors propose Dense-YOLO,a fast surface defect detection network that combines the strengths of DenseNet and you only look once version 3(YOLOv3).The authors design a lightweight backbone network with improved densely connected blocks,optimising the utilisation of shallow features while maintaining high detection speeds.Additionally,the authors refine the feature pyramid network of YOLOv3 to increase the recall of tiny defects and overall positioning accuracy.Furthermore,an online multi-angle template matching technique is introduced based on normalised cross-correlation to precisely locate the detection area.This refined template matching method not only accelerates detection speed but also mitigates the influence of the background.To validate the effectiveness of our enhancements,the authors conduct comparative experiments across two private datasets and one public dataset.Results show that Dense-YOLO outperforms existing methods,such as faster R-CNN,YOLOv3,YOLOv5s,YOLOv7,and SSD,in terms of mean average precision(mAP)and detection speed.Moreover,Dense-YOLO outperforms networks inherited from VGG and ResNet,including improved faster R-CNN,FCOS,M2Det-320 and FRCN,in mAP.展开更多
The detection of surface defects in concrete bridges using deep learning is of significant importance for reducing operational risks,saving maintenance costs,and driving the intelligent transformation of bridge defect...The detection of surface defects in concrete bridges using deep learning is of significant importance for reducing operational risks,saving maintenance costs,and driving the intelligent transformation of bridge defect detection.In contrast to the subjective and inefficient manual visual inspection,deep learning-based algorithms for concrete defect detection exhibit remarkable advantages,emerging as a focal point in recent research.This paper comprehensively analyzes the research progress of deep learning algorithms in the field of surface defect detection in concrete bridges in recent years.It introduces the early detection methods for surface defects in concrete bridges and the development of deep learning.Subsequently,it provides an overview of deep learning-based concrete bridge surface defect detection research from three aspects:image classification,object detection,and semantic segmentation.The paper summarizes the strengths and weaknesses of existing methods and the challenges they face.Additionally,it analyzes and prospects the development trends of surface defect detection in concrete bridges.展开更多
Detecting surface defects on unused rails is crucial for evaluating rail quality and durability to ensure the safety of rail transportation.However,existing detection methods often struggle with challenges such as com...Detecting surface defects on unused rails is crucial for evaluating rail quality and durability to ensure the safety of rail transportation.However,existing detection methods often struggle with challenges such as complex defect morphology,texture similarity,and fuzzy edges,leading to poor accuracy and missed detections.In order to resolve these problems,we propose MSCM-Net(Multi-Scale Cross-Modal Network),a multiscale cross-modal framework focused on detecting rail surface defects.MSCM-Net introduces an attention mechanism to dynamically weight the fusion of RGB and depth maps,effectively capturing and enhancing features at different scales for each modality.To further enrich feature representation and improve edge detection in blurred areas,we propose a multi-scale void fusion module that integrates multi-scale feature information.To improve cross-modal feature fusion,we develop a cross-enhanced fusion module that transfers fused features between layers to incorporate interlayer information.We also introduce a multimodal feature integration module,which merges modality-specific features from separate decoders into a shared decoder,enhancing detection by leveraging richer complementary information.Finally,we validate MSCM-Net on the NEU RSDDS-AUG RGB-depth dataset,comparing it against 12 leading methods,and the results show that MSCM-Net achieves superior performance on all metrics.展开更多
In response to themissed and false detections that are easily caused by the large variety of and significant differences among aluminum surface defects,a detection algorithm based on an improved You Only Look Once(YOL...In response to themissed and false detections that are easily caused by the large variety of and significant differences among aluminum surface defects,a detection algorithm based on an improved You Only Look Once(YOLO)v8n network is proposed.First,a C2f_DWR_DRB module is constructed by introducing a dilation-wise residual(DWR)module and a dilated reparameterization block(DRB)to replace the C2f module at the high level of the backbone network,enriching the gradient flow information and increasing the effective receptive field(ERF).Second,an efficient local attention(ELA)mechanism is fused with the high-level screening-feature pyramid networks(HS-FPN)module,and an ELA_HSFPN is designed to replace the original feature fusion module,enhancing the ability of the network to cope with multiscale detection tasks.Moreover,a lightweight shared convolutional detection head(SCDH)is introduced to reduce the number of parameters and the computational complexity of the module while enhancing the performance and generalizability of the model.Finally,the soft intersection over union(SIoU)replaces the original loss function to improve the convergence speed and prediction accuracy of the model.Experimental results show that compared with that of the original YOLOv8n model,the mAP@0.5 of the improved algorithm is increased by 5.1%,the number of parameters and computational complexity are reduced by 33.3%and 32.1%,respectively,and the FPS is increased by 4.9%.Compared with other mainstream object detection algorithms,the improved algorithm still leads in terms of core indicators and has good generalizability for surface defects encountered in other industrial scenarios.展开更多
A novel dual-branch decoding fusion convolutional neural network model(DDFNet)specifically designed for real-time salient object detection(SOD)on steel surfaces is proposed.DDFNet is based on a standard encoder–decod...A novel dual-branch decoding fusion convolutional neural network model(DDFNet)specifically designed for real-time salient object detection(SOD)on steel surfaces is proposed.DDFNet is based on a standard encoder–decoder architecture.DDFNet integrates three key innovations:first,we introduce a novel,lightweight multi-scale progressive aggregation residual network that effectively suppresses background interference and refines defect details,enabling efficient salient feature extraction.Then,we propose an innovative dual-branch decoding fusion structure,comprising the refined defect representation branch and the enhanced defect representation branch,which enhance accuracy in defect region identification and feature representation.Additionally,to further improve the detection of small and complex defects,we incorporate a multi-scale attention fusion module.Experimental results on the public ESDIs-SOD dataset show that DDFNet,with only 3.69 million parameters,achieves detection performance comparable to current state-of-the-art models,demonstrating its potential for real-time industrial applications.Furthermore,our DDFNet-L variant consistently outperforms leading methods in detection performance.The code is available at https://github.com/13140W/DDFNet.展开更多
Near-surface geological defects pose a serious threat to human life and infrastructure.Hence,the exploration of geological hazards is essential.Currently,there are various geological hazard exploration methods;however...Near-surface geological defects pose a serious threat to human life and infrastructure.Hence,the exploration of geological hazards is essential.Currently,there are various geological hazard exploration methods;however,those require improvements in terms of economic feasibility,convenience,and lateral resolution.To address this,this study examined an extraction method to determine spatial autocorrelation velocity dispersion curves for application in near-surface exploration.展开更多
In order to meet the requirements of accurate identification of surface defects on copper strip in industrial production,a detection model of surface defects based on machine vision,CSC-YOLO,is proposed.The model uses...In order to meet the requirements of accurate identification of surface defects on copper strip in industrial production,a detection model of surface defects based on machine vision,CSC-YOLO,is proposed.The model uses YOLOv4-tiny as the benchmark network.First,K-means clustering is introduced into the benchmark network to obtain anchor frames that match the self-built dataset.Second,a cross-region fusion module is introduced in the backbone network to solve the difficult target recognition problem by fusing contextual semantic information.Third,the spatial pyramid pooling-efficient channel attention network(SPP-E)module is introduced in the path aggregation network(PANet)to enhance the extraction of features.Fourth,to prevent the loss of channel information,a lightweight attention mechanism is introduced to improve the performance of the network.Finally,the performance of the model is improved by adding adjustment factors to correct the loss function for the dimensional characteristics of the surface defects.CSC-YOLO was tested on the self-built dataset of surface defects in copper strip,and the experimental results showed that the mAP of the model can reach 93.58%,which is a 3.37% improvement compared with the benchmark network,and FPS,although decreasing compared with the benchmark network,reached 104.CSC-YOLO takes into account the real-time requirements of copper strip production.The comparison experiments with Faster RCNN,SSD300,YOLOv3,YOLOv4,Resnet50-YOLOv4,YOLOv5s,YOLOv7,and other algorithms show that the algorithm obtains a faster computation speed while maintaining a higher detection accuracy.展开更多
The aim of the present study is to improve the capabilities and precision of a recently introduced Sea Surface Acoustic Simulator(SSAS) developed based on optimization of the Helmholtz–Kirchhoff–Fresnel(HKF) method....The aim of the present study is to improve the capabilities and precision of a recently introduced Sea Surface Acoustic Simulator(SSAS) developed based on optimization of the Helmholtz–Kirchhoff–Fresnel(HKF) method. The improved acoustic simulator, hereby known as the Modified SSAS(MSSAS), is capable of determining sound scattering from the sea surface and includes an extended Hall–Novarini model and optimized HKF method. The extended Hall–Novarini model is used for considering the effects of sub-surface bubbles over a wider range of radii of sub-surface bubbles compared to the previous SSAS version. Furthermore, MSSAS has the capability of making a three-dimensional simulation of scattered sound from the rough bubbly sea surface with less error than that of the Critical Sea Tests(CST) experiments. Also, it presents scattered pressure levels from the rough bubbly sea surface based on various incident angles of sound. Wind speed, frequency, incident angle, and pressure level of the sound source are considered as input data, and scattered pressure levels and scattering coefficients are provided. Finally, different parametric studies were conducted on wind speeds, frequencies, and incident angles to indicate that MSSAS is quite capable of simulating sound scattering from the rough bubbly sea surface, according to the scattering mechanisms determined by Ogden and Erskine. Therefore, it is concluded that MSSAS is valid for both scattering mechanisms and the transition region between them that are defined by Ogden and Erskine.展开更多
Defect inspection of specular curved surface is a challenging job. Taking steel balls for example, a new method based on reflected pattern integrity recognition is put forward. The specular steel ball surfac...Defect inspection of specular curved surface is a challenging job. Taking steel balls for example, a new method based on reflected pattern integrity recognition is put forward. The specular steel ball surface will totally reflect the patterns when it is placed inside a dome-shaped light source, whose inner wall is modified by patterns with certain regular. Distortion or intermittence of reflected pattern will occur at the defective part, which indicates the pattern has lost its integrity. Based on the integrity analysis of reflected pattern images？ surface defects can be revealed. In this paper, a set of concentric circles are used as the pattern and an image processing algorithm is customized to extract the surface defects. Results show that the proposed method is effective for the specular curved surface defect inspection展开更多
To improve the accuracy in recognizing defects on wood surfaces,a method fusing near infrared spectroscopy(NIR)and machine vision was examined.Larix gmelinii was selected as the raw material,and the experiments focuse...To improve the accuracy in recognizing defects on wood surfaces,a method fusing near infrared spectroscopy(NIR)and machine vision was examined.Larix gmelinii was selected as the raw material,and the experiments focused on the ability of the model to sort defects into four types:live knots,dead knots,pinholes,and cracks.Sample images were taken using an industrial camera,and a morphological algorithm was applied to locate the position of the defects.A portable near infrared spectrometer(900–1800 nm)collected the spectra of these positions.In addition,principal component analysis was utilized on these variables from spectral information and principal component vectors were extracted as the inputs of the model.The results show that a back propagation neural network model exhibited better discrimination accuracy of 92.7%for the training set and 92.0%for the test set.The research reveals that the NIR fusing machine vision is a feasible tool for detecting defects on board surfaces.展开更多
A more effective and accurate improved Sobel algorithm has been developed to detect surface defects on heavy rails. The proposed method can make up for the mere sensitivity to X and Y directions of the Sobel algorithm...A more effective and accurate improved Sobel algorithm has been developed to detect surface defects on heavy rails. The proposed method can make up for the mere sensitivity to X and Y directions of the Sobel algorithm by adding six templates at different directions. Meanwhile, an experimental platform for detecting surface defects consisting of the bed-jig, image-forming system with CCD cameras and light sources, parallel computer system and cable system has been constructed. The detection results of the backfin defects show that the improved Sobel algorithm can achieve an accurate and efficient positioning with decreasing interference noises to the defect edge. It can also extract more precise features and characteristic parameters of the backfin defect. Furthermore, the BP neural network adopted for defects classification with the inputting characteristic parameters of improved Sobel algorithm can obtain the optimal training precision of 0.0095827 with 106 iterative steps and time of 3 s less than Sobel algorithm with 146 steps and 5 s. Finally, an enhanced identification rate of 10% for the defects is also confirmed after the Sobel algorithm is improved.展开更多
Hepatitis B virus(HBV) infection is a global public health concern. HBV causes chronic infection in patients and can lead to liver cirrhosis, hepatocellular carcinoma, and other severe liver diseases. Thus, understand...Hepatitis B virus(HBV) infection is a global public health concern. HBV causes chronic infection in patients and can lead to liver cirrhosis, hepatocellular carcinoma, and other severe liver diseases. Thus, understanding HBV-related pathogenesis is of particular importance for prevention and clinical intervention. HBV surface antigens are indispensable for HBV virion formation and are useful viral markers for diagnosis and clinical assessment. During chronic HBV infection, HBV genomes may acquire and accumulate mutations and deletions, leading to the expression of defective HBV surface antigens. These defective HBV surface antigens have been found to play important roles in the progression of HBV-associated liver diseases. In this review, we focus our discussion on the nature of defective HBV surface antigen mutations and their contribution to the pathogenesis of fulminant hepatitis B. The relationship between defective surface antigens and occult HBV infection are also discussed.展开更多
Feature extraction is essential to the classification of surface defect images. The defects of hot-rolled steels distribute in different directions. Therefore, the methods of multi-scale geometric analysis （MGA） wer...Feature extraction is essential to the classification of surface defect images. The defects of hot-rolled steels distribute in different directions. Therefore, the methods of multi-scale geometric analysis （MGA） were employed to decompose the image into several directional subba^ds at several scales. Then, the statistical features of each subband were calculated to produce a high-dimensional feature vector, which was reduced to a lower-dimensional vector by graph embedding algorithms. Finally, support vector machine （SVM） was used for defect classification. The multi-scale feature extraction method was implemented via curvelet transform and kernel locality preserving projections （KLPP）. Experiment results show that the proposed method is effective for classifying the surface defects of hot-rolled steels and the total classification rate is up to 97.33%.展开更多
Surface defects of the cold-rolled sheets of Ti-IF steel were studied and analyzed. After analyzing surface defects of cold-rolled sheets, such as shelling defects, holes and sliver defects by SEM/EDS, a variety of in...Surface defects of the cold-rolled sheets of Ti-IF steel were studied and analyzed. After analyzing surface defects of cold-rolled sheets, such as shelling defects, holes and sliver defects by SEM/EDS, a variety of inclusions were found. In addition, the distribution of macro-inclusions in slabs was analyzed by MIDAS method. The results show the macroscopic inclusion bands of head slabs and normal slabs are in 1/8 slab thickness regions of both inner arc side and outer arc side. The formation process of the defects in the cold-rolled sheets was simulated with an experimental cold-rolling machine for comparison. The results show that there were three kinds of inclusions underneath the surface defects: Al2O3, SiO2 and particles from slag entrainment, which were the main reason for defect formation during cold rolling.展开更多
Based on the finite element method,the angled surface defects have been investigated by using the laser generated surface acoustic wave(SAW).The feature of laser generated SAW interaction with the angled defect is ana...Based on the finite element method,the angled surface defects have been investigated by using the laser generated surface acoustic wave(SAW).The feature of laser generated SAW interaction with the angled defect is analyzed in time and frequency domains.An increase in the amplitude of SAW at the edge of the defect is observed,and the spectral feature is angle dependent.With the angle decreasing from 120°to 30°,the maximum amplitude of frequency spectrum of SAW increases gradually.The corresponding experimental results verify the feasibility of numerical analyses and reach a good agreement with simulation results.展开更多
The formations of defective MgC12 surfaces, and subsequent adsorption of Ti species and electron donor, as well as propylene polymerization over the Ziegler-Natta catalyst have been investigated using density function...The formations of defective MgC12 surfaces, and subsequent adsorption of Ti species and electron donor, as well as propylene polymerization over the Ziegler-Natta catalyst have been investigated using density functional theory （DFT） method. Twelve possible support models of regular and defective MgC12 （110） and （100） surfaces were built. The individual adsorptions of titanium chlorides as mononuclear or dinuclear, and ethyl benzoate （EB） as electron donor, on these models were evaluated. The analysis of energies presented the cases of EB adsorption were generally more stable than titanium chlorides on both surfaces. Thus, EB as internal electron donor mainly prevented TIC14 from coordinating on the MgC12 surfaces where mostly non-stereospecific active sites could be formed. Exceptionally, A5 the site model with terminal Cl-vacancy on the MgC12 support, presented stronger adsorption of TiCl4 than that of EB on （110） surface. Since the TIC14 and ethyl benzoate （EB） would compete to adsorb on the support surface, it seems reasonable to assume that TIC14 might predominately occupy this site, which can act as the most plausible active site for propylene polymerization. The first insertion of propylene monomer into the A5 active site model showed that it exhibited good regioselectivity but poor stereospecificity in the absence of electron donor.展开更多
Considering that the surface defects of cold rolled strips are hard to be recognized by human eyes under high-speed circumstances, an automatic recognition technique was discussed. Spectrum images of defects can be go...Considering that the surface defects of cold rolled strips are hard to be recognized by human eyes under high-speed circumstances, an automatic recognition technique was discussed. Spectrum images of defects can be got by fast Fourier transform （FFF） and sum of valid pixels （SVP）, and its optimized center region, which concentrates nearly all energies, are extracted as an original feature set. Using genetic algorithm to optimize the feature set, an optimized feature set with 51 features can be achieved. Using the optimized feature set as an input vector of neural networks, the recognition effects of LVQ neural networks have been studied. Experiment results show that the new method can get a higher classification rate and can settle the automatic recognition problem of surface defects on cold rolled strips ideally.展开更多
基金funded by Woosong University Academic Research 2024.
文摘This study investigates the application of Learnable Memory Vision Transformers(LMViT)for detecting metal surface flaws,comparing their performance with traditional CNNs,specifically ResNet18 and ResNet50,as well as other transformer-based models including Token to Token ViT,ViT withoutmemory,and Parallel ViT.Leveraging awidely-used steel surface defect dataset,the research applies data augmentation and t-distributed stochastic neighbor embedding(t-SNE)to enhance feature extraction and understanding.These techniques mitigated overfitting,stabilized training,and improved generalization capabilities.The LMViT model achieved a test accuracy of 97.22%,significantly outperforming ResNet18(88.89%)and ResNet50(88.90%),aswell as the Token to TokenViT(88.46%),ViT without memory(87.18),and Parallel ViT(91.03%).Furthermore,LMViT exhibited superior training and validation performance,attaining a validation accuracy of 98.2%compared to 91.0%for ResNet 18,96.0%for ResNet50,and 89.12%,87.51%,and 91.21%for Token to Token ViT,ViT without memory,and Parallel ViT,respectively.The findings highlight the LMViT’s ability to capture long-range dependencies in images,an areawhere CNNs struggle due to their reliance on local receptive fields and hierarchical feature extraction.The additional transformer-based models also demonstrate improved performance in capturing complex features over CNNs,with LMViT excelling particularly at detecting subtle and complex defects,which is critical for maintaining product quality and operational efficiency in industrial applications.For instance,the LMViT model successfully identified fine scratches and minor surface irregularities that CNNs often misclassify.This study not only demonstrates LMViT’s potential for real-world defect detection but also underscores the promise of other transformer-based architectures like Token to Token ViT,ViT without memory,and Parallel ViT in industrial scenarios where complex spatial relationships are key.Future research may focus on enhancing LMViT’s computational efficiency for deployment in real-time quality control systems.
基金supported by the Scientific and technological key project in Henan Province 22210224002the Natural Science Foundation of Henan Polytechnic University B2021-38.
文摘The service life of internal combustion engines is significantly influenced by surface defects in cylinder liners.To address the limitations of traditional detection methods,we propose an enhanced YOLOv8 model with Swin Transformer as the backbone network.This approach leverages Swin Transformer's multi-head self-attention mechanism for improved feature extraction of defects spanning various scales.Integrated with the YOLOv8 detection head,our model achieves a mean average precision of 85.1%on our dataset,outperforming baseline methods by 1.4%.The model's effectiveness is further demonstrated on a steel-surface defect dataset,indicating its broad applicability in industrial surface defect detection.Our work highlights the potential of combining Swin Transformer and YOLOv8 for accurate and efficient defect detection.
基金supported by the National Natural Science Foundation of China(No.62103298)the Natural Science Foundation of Hebei Province(No.F2018209289)。
文摘Aiming at the problems of low detection efficiency and difficult positioning of traditional steel surface defect detection methods,a lightweight steel surface defect detection model based on you only look once version 7(YOLOv7)is proposed.First,a cascading style sheets(CSS)block module is proposed,which uses more lightweight operations to obtain redundant information in the feature map,reduces the amount of computation,and effectively improves the detection speed.Secondly,the improved spatial pyramid pooling with cross stage partial convolutions(SPPCSPC)structure is adopted to ensure that the model can also pay attention to the defect location information while predicting the defect category information,obtain richer defect features.In addition,the convolution operation in the original model is simplified,which significantly reduces the size of the model and helps to improve the detection speed.Finally,using efficient intersection over union(EIOU)loss to focus on high-quality anchors,speed up convergence and improve positioning accuracy.Experiments were carried out on the Northeastern University-defect(NEU-DET)steel surface defect dataset.Compared with the original YOLOv7 model,the number of parameters of this model was reduced by 40%,the frames per second(FPS)reached 112,and the average accuracy reached 79.1%,the detection accuracy and speed have been improved,which can meet the needs of steel surface defect detection.
基金Program for Young Excellent Talents in the University of Fujian Province,Grant/Award Number:201847The National Key Research and Development Program of China,Grant/Award Number:2022YFB3206605Natural Science Foundation of Xiamen Municipality,Grant/Award Number:3502Z20227189。
文摘Efficient detection of surface defects is primary for ensuring product quality during manufacturing processes.To enhance the performance of deep learning-based methods in practical applications,the authors propose Dense-YOLO,a fast surface defect detection network that combines the strengths of DenseNet and you only look once version 3(YOLOv3).The authors design a lightweight backbone network with improved densely connected blocks,optimising the utilisation of shallow features while maintaining high detection speeds.Additionally,the authors refine the feature pyramid network of YOLOv3 to increase the recall of tiny defects and overall positioning accuracy.Furthermore,an online multi-angle template matching technique is introduced based on normalised cross-correlation to precisely locate the detection area.This refined template matching method not only accelerates detection speed but also mitigates the influence of the background.To validate the effectiveness of our enhancements,the authors conduct comparative experiments across two private datasets and one public dataset.Results show that Dense-YOLO outperforms existing methods,such as faster R-CNN,YOLOv3,YOLOv5s,YOLOv7,and SSD,in terms of mean average precision(mAP)and detection speed.Moreover,Dense-YOLO outperforms networks inherited from VGG and ResNet,including improved faster R-CNN,FCOS,M2Det-320 and FRCN,in mAP.
基金supported by the Key Research and Development Program of Shaanxi Province-International Science and Technology Cooperation Program Project (No.2020KW-001)the Contract for Xi'an Municipal Science and Technology Plan Project-Xi'an City Strong Foundation Innovation Plan (No.21XJZZ0074)the Key Project of Graduate Student Innovation Fund at Xi'an University of Posts and Telecommunications (No.CXJJZL2023013)。
文摘The detection of surface defects in concrete bridges using deep learning is of significant importance for reducing operational risks,saving maintenance costs,and driving the intelligent transformation of bridge defect detection.In contrast to the subjective and inefficient manual visual inspection,deep learning-based algorithms for concrete defect detection exhibit remarkable advantages,emerging as a focal point in recent research.This paper comprehensively analyzes the research progress of deep learning algorithms in the field of surface defect detection in concrete bridges in recent years.It introduces the early detection methods for surface defects in concrete bridges and the development of deep learning.Subsequently,it provides an overview of deep learning-based concrete bridge surface defect detection research from three aspects:image classification,object detection,and semantic segmentation.The paper summarizes the strengths and weaknesses of existing methods and the challenges they face.Additionally,it analyzes and prospects the development trends of surface defect detection in concrete bridges.
基金funded by the National Natural Science Foundation of China(grant number 62306186)the Technology Plan Joint Foundation of Liaoning Province(grant number 2023-MSLH-246)the Technology Plan Joint Foundation of Liaoning Province(grant number 2023-BSBA-238).
文摘Detecting surface defects on unused rails is crucial for evaluating rail quality and durability to ensure the safety of rail transportation.However,existing detection methods often struggle with challenges such as complex defect morphology,texture similarity,and fuzzy edges,leading to poor accuracy and missed detections.In order to resolve these problems,we propose MSCM-Net(Multi-Scale Cross-Modal Network),a multiscale cross-modal framework focused on detecting rail surface defects.MSCM-Net introduces an attention mechanism to dynamically weight the fusion of RGB and depth maps,effectively capturing and enhancing features at different scales for each modality.To further enrich feature representation and improve edge detection in blurred areas,we propose a multi-scale void fusion module that integrates multi-scale feature information.To improve cross-modal feature fusion,we develop a cross-enhanced fusion module that transfers fused features between layers to incorporate interlayer information.We also introduce a multimodal feature integration module,which merges modality-specific features from separate decoders into a shared decoder,enhancing detection by leveraging richer complementary information.Finally,we validate MSCM-Net on the NEU RSDDS-AUG RGB-depth dataset,comparing it against 12 leading methods,and the results show that MSCM-Net achieves superior performance on all metrics.
基金supported by the Jiangsu Province Science and Technology Policy Guidance Program(Industry-University-Research Cooperation)/Forward-Looking Joint Research Project(BY2016005-05).
文摘In response to themissed and false detections that are easily caused by the large variety of and significant differences among aluminum surface defects,a detection algorithm based on an improved You Only Look Once(YOLO)v8n network is proposed.First,a C2f_DWR_DRB module is constructed by introducing a dilation-wise residual(DWR)module and a dilated reparameterization block(DRB)to replace the C2f module at the high level of the backbone network,enriching the gradient flow information and increasing the effective receptive field(ERF).Second,an efficient local attention(ELA)mechanism is fused with the high-level screening-feature pyramid networks(HS-FPN)module,and an ELA_HSFPN is designed to replace the original feature fusion module,enhancing the ability of the network to cope with multiscale detection tasks.Moreover,a lightweight shared convolutional detection head(SCDH)is introduced to reduce the number of parameters and the computational complexity of the module while enhancing the performance and generalizability of the model.Finally,the soft intersection over union(SIoU)replaces the original loss function to improve the convergence speed and prediction accuracy of the model.Experimental results show that compared with that of the original YOLOv8n model,the mAP@0.5 of the improved algorithm is increased by 5.1%,the number of parameters and computational complexity are reduced by 33.3%and 32.1%,respectively,and the FPS is increased by 4.9%.Compared with other mainstream object detection algorithms,the improved algorithm still leads in terms of core indicators and has good generalizability for surface defects encountered in other industrial scenarios.
基金supported in part by the National Key R&D Program of China(Grant No.2023YFB3307604)the Shanxi Province Basic Research Program Youth Science Research Project(Grant Nos.202303021212054 and 202303021212046)+3 种基金the Key Projects Supported by Hebei Natural Science Foundation(Grant No.E2024203125)the National Science Foundation of China(Grant No.52105391)the Hebei Provincial Science and Technology Major Project(Grant No.23280101Z)the National Key Laboratory of Metal Forming Technology and Heavy Equipment Open Fund(Grant No.S2308100.W17).
文摘A novel dual-branch decoding fusion convolutional neural network model(DDFNet)specifically designed for real-time salient object detection(SOD)on steel surfaces is proposed.DDFNet is based on a standard encoder–decoder architecture.DDFNet integrates three key innovations:first,we introduce a novel,lightweight multi-scale progressive aggregation residual network that effectively suppresses background interference and refines defect details,enabling efficient salient feature extraction.Then,we propose an innovative dual-branch decoding fusion structure,comprising the refined defect representation branch and the enhanced defect representation branch,which enhance accuracy in defect region identification and feature representation.Additionally,to further improve the detection of small and complex defects,we incorporate a multi-scale attention fusion module.Experimental results on the public ESDIs-SOD dataset show that DDFNet,with only 3.69 million parameters,achieves detection performance comparable to current state-of-the-art models,demonstrating its potential for real-time industrial applications.Furthermore,our DDFNet-L variant consistently outperforms leading methods in detection performance.The code is available at https://github.com/13140W/DDFNet.
基金supported by the Henan Province science and technology research project(Grant No.242102321031)National Natural Science Foundation of China(grant numbers 42207200).
文摘Near-surface geological defects pose a serious threat to human life and infrastructure.Hence,the exploration of geological hazards is essential.Currently,there are various geological hazard exploration methods;however,those require improvements in terms of economic feasibility,convenience,and lateral resolution.To address this,this study examined an extraction method to determine spatial autocorrelation velocity dispersion curves for application in near-surface exploration.
基金the Key Project of Basic Research of Yunnan Province(No.202101AS070016)。
文摘In order to meet the requirements of accurate identification of surface defects on copper strip in industrial production,a detection model of surface defects based on machine vision,CSC-YOLO,is proposed.The model uses YOLOv4-tiny as the benchmark network.First,K-means clustering is introduced into the benchmark network to obtain anchor frames that match the self-built dataset.Second,a cross-region fusion module is introduced in the backbone network to solve the difficult target recognition problem by fusing contextual semantic information.Third,the spatial pyramid pooling-efficient channel attention network(SPP-E)module is introduced in the path aggregation network(PANet)to enhance the extraction of features.Fourth,to prevent the loss of channel information,a lightweight attention mechanism is introduced to improve the performance of the network.Finally,the performance of the model is improved by adding adjustment factors to correct the loss function for the dimensional characteristics of the surface defects.CSC-YOLO was tested on the self-built dataset of surface defects in copper strip,and the experimental results showed that the mAP of the model can reach 93.58%,which is a 3.37% improvement compared with the benchmark network,and FPS,although decreasing compared with the benchmark network,reached 104.CSC-YOLO takes into account the real-time requirements of copper strip production.The comparison experiments with Faster RCNN,SSD300,YOLOv3,YOLOv4,Resnet50-YOLOv4,YOLOv5s,YOLOv7,and other algorithms show that the algorithm obtains a faster computation speed while maintaining a higher detection accuracy.
文摘The aim of the present study is to improve the capabilities and precision of a recently introduced Sea Surface Acoustic Simulator(SSAS) developed based on optimization of the Helmholtz–Kirchhoff–Fresnel(HKF) method. The improved acoustic simulator, hereby known as the Modified SSAS(MSSAS), is capable of determining sound scattering from the sea surface and includes an extended Hall–Novarini model and optimized HKF method. The extended Hall–Novarini model is used for considering the effects of sub-surface bubbles over a wider range of radii of sub-surface bubbles compared to the previous SSAS version. Furthermore, MSSAS has the capability of making a three-dimensional simulation of scattered sound from the rough bubbly sea surface with less error than that of the Critical Sea Tests(CST) experiments. Also, it presents scattered pressure levels from the rough bubbly sea surface based on various incident angles of sound. Wind speed, frequency, incident angle, and pressure level of the sound source are considered as input data, and scattered pressure levels and scattering coefficients are provided. Finally, different parametric studies were conducted on wind speeds, frequencies, and incident angles to indicate that MSSAS is quite capable of simulating sound scattering from the rough bubbly sea surface, according to the scattering mechanisms determined by Ogden and Erskine. Therefore, it is concluded that MSSAS is valid for both scattering mechanisms and the transition region between them that are defined by Ogden and Erskine.
基金Tianjin Research Program of Application Foundation and Advanced Technology(No.14JCYBJC18600,No.14JCZDJC39700)National Key Scientific Instrument and Equipment Development Project(No.2013YQ17053903)
文摘Defect inspection of specular curved surface is a challenging job. Taking steel balls for example, a new method based on reflected pattern integrity recognition is put forward. The specular steel ball surface will totally reflect the patterns when it is placed inside a dome-shaped light source, whose inner wall is modified by patterns with certain regular. Distortion or intermittence of reflected pattern will occur at the defective part, which indicates the pattern has lost its integrity. Based on the integrity analysis of reflected pattern images？ surface defects can be revealed. In this paper, a set of concentric circles are used as the pattern and an image processing algorithm is customized to extract the surface defects. Results show that the proposed method is effective for the specular curved surface defect inspection
基金supported by the State Administration of Forestry and Grass of the 948 Project of China(Grant No.2015-4-52)the support of the Fundamental Research Funds for the Central Universities(Grant No.2572017DB05)the support of the Natural Science Foundation of Heilongjiang Province(Grant No.C2017005)
文摘To improve the accuracy in recognizing defects on wood surfaces,a method fusing near infrared spectroscopy(NIR)and machine vision was examined.Larix gmelinii was selected as the raw material,and the experiments focused on the ability of the model to sort defects into four types:live knots,dead knots,pinholes,and cracks.Sample images were taken using an industrial camera,and a morphological algorithm was applied to locate the position of the defects.A portable near infrared spectrometer(900–1800 nm)collected the spectra of these positions.In addition,principal component analysis was utilized on these variables from spectral information and principal component vectors were extracted as the inputs of the model.The results show that a back propagation neural network model exhibited better discrimination accuracy of 92.7%for the training set and 92.0%for the test set.The research reveals that the NIR fusing machine vision is a feasible tool for detecting defects on board surfaces.
基金Project(51174151)supported by the National Natural Science Foundation of ChinaProject(2010Z19003)supported by the Major Scientific Research Program of Hubei Provincial Department of Education,ChinaProject(2010CDB03403)supported by the Natural Science Foundation of Science and Technology Department of Hubei Province,China
文摘A more effective and accurate improved Sobel algorithm has been developed to detect surface defects on heavy rails. The proposed method can make up for the mere sensitivity to X and Y directions of the Sobel algorithm by adding six templates at different directions. Meanwhile, an experimental platform for detecting surface defects consisting of the bed-jig, image-forming system with CCD cameras and light sources, parallel computer system and cable system has been constructed. The detection results of the backfin defects show that the improved Sobel algorithm can achieve an accurate and efficient positioning with decreasing interference noises to the defect edge. It can also extract more precise features and characteristic parameters of the backfin defect. Furthermore, the BP neural network adopted for defects classification with the inputting characteristic parameters of improved Sobel algorithm can obtain the optimal training precision of 0.0095827 with 106 iterative steps and time of 3 s less than Sobel algorithm with 146 steps and 5 s. Finally, an enhanced identification rate of 10% for the defects is also confirmed after the Sobel algorithm is improved.
基金supported by the National Nature Science Foundation of China,No.31770180the Youth Innovation Promotion Association CAS,No.2016303
文摘Hepatitis B virus(HBV) infection is a global public health concern. HBV causes chronic infection in patients and can lead to liver cirrhosis, hepatocellular carcinoma, and other severe liver diseases. Thus, understanding HBV-related pathogenesis is of particular importance for prevention and clinical intervention. HBV surface antigens are indispensable for HBV virion formation and are useful viral markers for diagnosis and clinical assessment. During chronic HBV infection, HBV genomes may acquire and accumulate mutations and deletions, leading to the expression of defective HBV surface antigens. These defective HBV surface antigens have been found to play important roles in the progression of HBV-associated liver diseases. In this review, we focus our discussion on the nature of defective HBV surface antigen mutations and their contribution to the pathogenesis of fulminant hepatitis B. The relationship between defective surface antigens and occult HBV infection are also discussed.
基金supports by the Program for New Century Excellent Talents in Chinese Universities (No.NCET-08-0726)Beijing Nova Program (No. 2007B027)the Fundamental Research Funds for the Central Universities (No. FRF-TP-09-027B)
文摘Feature extraction is essential to the classification of surface defect images. The defects of hot-rolled steels distribute in different directions. Therefore, the methods of multi-scale geometric analysis （MGA） were employed to decompose the image into several directional subba^ds at several scales. Then, the statistical features of each subband were calculated to produce a high-dimensional feature vector, which was reduced to a lower-dimensional vector by graph embedding algorithms. Finally, support vector machine （SVM） was used for defect classification. The multi-scale feature extraction method was implemented via curvelet transform and kernel locality preserving projections （KLPP）. Experiment results show that the proposed method is effective for classifying the surface defects of hot-rolled steels and the total classification rate is up to 97.33%.
文摘Surface defects of the cold-rolled sheets of Ti-IF steel were studied and analyzed. After analyzing surface defects of cold-rolled sheets, such as shelling defects, holes and sliver defects by SEM/EDS, a variety of inclusions were found. In addition, the distribution of macro-inclusions in slabs was analyzed by MIDAS method. The results show the macroscopic inclusion bands of head slabs and normal slabs are in 1/8 slab thickness regions of both inner arc side and outer arc side. The formation process of the defects in the cold-rolled sheets was simulated with an experimental cold-rolling machine for comparison. The results show that there were three kinds of inclusions underneath the surface defects: Al2O3, SiO2 and particles from slag entrainment, which were the main reason for defect formation during cold rolling.
基金supported by the National Natural Science Foundation of China(No.51505220)
文摘Based on the finite element method,the angled surface defects have been investigated by using the laser generated surface acoustic wave(SAW).The feature of laser generated SAW interaction with the angled defect is analyzed in time and frequency domains.An increase in the amplitude of SAW at the edge of the defect is observed,and the spectral feature is angle dependent.With the angle decreasing from 120°to 30°,the maximum amplitude of frequency spectrum of SAW increases gradually.The corresponding experimental results verify the feasibility of numerical analyses and reach a good agreement with simulation results.
基金supported by the Program of Introducing Talents of Discipline to Universities (B08021)Fundamental Research Funds for the Central Universities
文摘The formations of defective MgC12 surfaces, and subsequent adsorption of Ti species and electron donor, as well as propylene polymerization over the Ziegler-Natta catalyst have been investigated using density functional theory （DFT） method. Twelve possible support models of regular and defective MgC12 （110） and （100） surfaces were built. The individual adsorptions of titanium chlorides as mononuclear or dinuclear, and ethyl benzoate （EB） as electron donor, on these models were evaluated. The analysis of energies presented the cases of EB adsorption were generally more stable than titanium chlorides on both surfaces. Thus, EB as internal electron donor mainly prevented TIC14 from coordinating on the MgC12 surfaces where mostly non-stereospecific active sites could be formed. Exceptionally, A5 the site model with terminal Cl-vacancy on the MgC12 support, presented stronger adsorption of TiCl4 than that of EB on （110） surface. Since the TIC14 and ethyl benzoate （EB） would compete to adsorb on the support surface, it seems reasonable to assume that TIC14 might predominately occupy this site, which can act as the most plausible active site for propylene polymerization. The first insertion of propylene monomer into the A5 active site model showed that it exhibited good regioselectivity but poor stereospecificity in the absence of electron donor.
基金This work was financially supported by the National High Technology Research and Development Program of China (No.2003AA331080 and 2001AA339030)the Talent Science Research Foundation of Henan University of Science & Technology (No.09001121).
文摘Considering that the surface defects of cold rolled strips are hard to be recognized by human eyes under high-speed circumstances, an automatic recognition technique was discussed. Spectrum images of defects can be got by fast Fourier transform （FFF） and sum of valid pixels （SVP）, and its optimized center region, which concentrates nearly all energies, are extracted as an original feature set. Using genetic algorithm to optimize the feature set, an optimized feature set with 51 features can be achieved. Using the optimized feature set as an input vector of neural networks, the recognition effects of LVQ neural networks have been studied. Experiment results show that the new method can get a higher classification rate and can settle the automatic recognition problem of surface defects on cold rolled strips ideally.
