Detecting keypoints in dairy cows aims to locate and track the motion trajectories of the body's joints,which plays a crucial role in behavior analysis and lameness detection.However,real farming scenarios,charact...Detecting keypoints in dairy cows aims to locate and track the motion trajectories of the body's joints,which plays a crucial role in behavior analysis and lameness detection.However,real farming scenarios,characterized by occlusions and large variations in object scale may result in poor detection results.Therefore,we introduce the atrous spatial pyramid pooling(ASPP) module into the shallow layers network of ResNet101,designed to improve the multi-scale feature extraction capability of the model.The ASPP module enhances the robustness of recognition for different dimensional sizes and occluded keypoints using different dilatation rates in the parallel atrous convolutional layers to expand the model's receptive field.Furthermore,seven types of motion features,including tracking up,gait symmetry,step height balance,motion speed variability,head swing amplitude,head-neck slope and back curvature are extracted simultaneously by monitoring and tracking the motion trajectory of distinct keypoints.Several of these features represent innovative extraction models and attributes,first proposed in this study.Multiple models are trained and tested on datasets containing 2,385 frames for ablation experiments.The experiments show that,in comparison with the ResNet50,MobileNet_v2_1.0,and EfficientNet-b0backbone networks,the training error and test error of ResNet101 are reduced by 4.04-30.12 pixels and 3.81-28.14 pixels.Therefore,ResNet101 is used as the benchmark for subsequent model improvement by adding the ASPP module.The training error and test error of the ResNet101-ASPP network are reduced by 0.27 and 0.24 pixels,respectively,compared to the benchmark network.The prediction confidence improves by 1.65-2.50% at three different dairy cow object scales.In addition,the keypoints under different occlusion conditions improve considerably,especially for small-scale keypoints,demonstrating the capability of the ASPP module for multi-scale feature extraction.By analyzing the distribution of the seven features and health,mild lameness,and severe lameness in dairy cows,it is shown that all the different features play an important role in distinguishing between different levels of lameness.展开更多
Multiple Sclerosis(MS)poses significant health risks.Patients may face neurodegeneration,mobility issues,cognitive decline,and a reduced quality of life.Manual diagnosis by neurologists is prone to limitations,making ...Multiple Sclerosis(MS)poses significant health risks.Patients may face neurodegeneration,mobility issues,cognitive decline,and a reduced quality of life.Manual diagnosis by neurologists is prone to limitations,making AI-based classification crucial for early detection.Therefore,automated classification using Artificial Intelligence(AI)techniques has a crucial role in addressing the limitations of manual classification and preventing the development of MS to advanced stages.This study developed hybrid systems integrating XGBoost(eXtreme Gradient Boosting)with multi-CNN(Convolutional Neural Networks)features based on Ant Colony Optimization(ACO)and Maximum Entropy Score-based Selection(MESbS)algorithms for early classification of MRI(Magnetic Resonance Imaging)images in a multi-class and binary-class MS dataset.All hybrid systems started by enhancing MRI images using the fusion processes of a Gaussian filter and Contrast-Limited Adaptive Histogram Equalization(CLAHE).Then,the Gradient Vector Flow(GVF)algorithm was applied to select white matter(regions of interest)within the brain and segment them from the surrounding brain structures.These regions of interest were processed by CNN models(ResNet101,DenseNet201,and MobileNet)to extract deep feature maps,which were then combined into fused feature vectors of multi-CNN model combinations(ResNet101-DenseNet201,DenseNet201-MobileNet,ResNet101-MobileNet,and ResNet101-DenseNet201-MobileNet).The multi-CNN features underwent dimensionality reduction using ACO and MESbS algorithms to remove unimportant features and retain important features.The XGBoost classifier employed the resultant feature vectors for classification.All developed hybrid systems displayed promising outcomes.For multiclass classification,the XGBoost model using ResNet101-DenseNet201-MobileNet features selected by ACO attained 99.4%accuracy,99.45%precision,and 99.75%specificity,surpassing prior studies(93.76%accuracy).It reached 99.6%accuracy,99.65%precision,and 99.55%specificity in binary-class classification.These results demonstrate the effectiveness of multi-CNN fusion with feature selection in improving MS classification accuracy.展开更多
Zn vapour is easily generated on the surface by fusion welding galvanized steel sheet,resulting in the formation of defects.Rapidly developing computer vision sensing technology collects weld images in the welding pro...Zn vapour is easily generated on the surface by fusion welding galvanized steel sheet,resulting in the formation of defects.Rapidly developing computer vision sensing technology collects weld images in the welding process,then obtains laser fringe information through digital image processing,identifies welding defects,and finally realizes online control of weld defects.The performance of a convolutional neural network is related to its structure and the quality of the input image.The acquired original images are labeled with LabelMe,and repeated attempts are made to determine the appropriate filtering and edge detection image preprocessing methods.Two-stage convolutional neural networks with different structures are built on the Tensorflow deep learning framework,different thresholds of intersection over union are set,and deep learning methods are used to evaluate the collected original images and the preprocessed images separately.Compared with the test results,the comprehensive performance of the improved feature pyramid networks algorithm based on the basic network VGG16 is lower than that of the basic network Resnet101.Edge detection of the image will significantly improve the accuracy of the model.Adding blur will reduce the accuracy of the model slightly;however,the overall performance of the improved algorithm is still relatively good,which proves the stability of the algorithm.The self-developed software inspection system can be used for image preprocessing and defect recognition,which can be used to record the number and location of typical defects in continuous welds.展开更多
基金supported by the National Natural Science Foundation of China (32102600)the Central Publicinterest Scientific Institution Basal Research Fund, China (Y2023XK13, JBYW-AII-2024-28/40, and JBYWAII-2023-33/37/42)+1 种基金Science and Technology Innovation Project of the Chinese Academy of Agricultural Sciences (CAAS-ASTIP-2021-AII)the Wuhu Science and Technology Bureau Two Strong One Increase Project, China (2023ly12)。
文摘Detecting keypoints in dairy cows aims to locate and track the motion trajectories of the body's joints,which plays a crucial role in behavior analysis and lameness detection.However,real farming scenarios,characterized by occlusions and large variations in object scale may result in poor detection results.Therefore,we introduce the atrous spatial pyramid pooling(ASPP) module into the shallow layers network of ResNet101,designed to improve the multi-scale feature extraction capability of the model.The ASPP module enhances the robustness of recognition for different dimensional sizes and occluded keypoints using different dilatation rates in the parallel atrous convolutional layers to expand the model's receptive field.Furthermore,seven types of motion features,including tracking up,gait symmetry,step height balance,motion speed variability,head swing amplitude,head-neck slope and back curvature are extracted simultaneously by monitoring and tracking the motion trajectory of distinct keypoints.Several of these features represent innovative extraction models and attributes,first proposed in this study.Multiple models are trained and tested on datasets containing 2,385 frames for ablation experiments.The experiments show that,in comparison with the ResNet50,MobileNet_v2_1.0,and EfficientNet-b0backbone networks,the training error and test error of ResNet101 are reduced by 4.04-30.12 pixels and 3.81-28.14 pixels.Therefore,ResNet101 is used as the benchmark for subsequent model improvement by adding the ASPP module.The training error and test error of the ResNet101-ASPP network are reduced by 0.27 and 0.24 pixels,respectively,compared to the benchmark network.The prediction confidence improves by 1.65-2.50% at three different dairy cow object scales.In addition,the keypoints under different occlusion conditions improve considerably,especially for small-scale keypoints,demonstrating the capability of the ASPP module for multi-scale feature extraction.By analyzing the distribution of the seven features and health,mild lameness,and severe lameness in dairy cows,it is shown that all the different features play an important role in distinguishing between different levels of lameness.
文摘Multiple Sclerosis(MS)poses significant health risks.Patients may face neurodegeneration,mobility issues,cognitive decline,and a reduced quality of life.Manual diagnosis by neurologists is prone to limitations,making AI-based classification crucial for early detection.Therefore,automated classification using Artificial Intelligence(AI)techniques has a crucial role in addressing the limitations of manual classification and preventing the development of MS to advanced stages.This study developed hybrid systems integrating XGBoost(eXtreme Gradient Boosting)with multi-CNN(Convolutional Neural Networks)features based on Ant Colony Optimization(ACO)and Maximum Entropy Score-based Selection(MESbS)algorithms for early classification of MRI(Magnetic Resonance Imaging)images in a multi-class and binary-class MS dataset.All hybrid systems started by enhancing MRI images using the fusion processes of a Gaussian filter and Contrast-Limited Adaptive Histogram Equalization(CLAHE).Then,the Gradient Vector Flow(GVF)algorithm was applied to select white matter(regions of interest)within the brain and segment them from the surrounding brain structures.These regions of interest were processed by CNN models(ResNet101,DenseNet201,and MobileNet)to extract deep feature maps,which were then combined into fused feature vectors of multi-CNN model combinations(ResNet101-DenseNet201,DenseNet201-MobileNet,ResNet101-MobileNet,and ResNet101-DenseNet201-MobileNet).The multi-CNN features underwent dimensionality reduction using ACO and MESbS algorithms to remove unimportant features and retain important features.The XGBoost classifier employed the resultant feature vectors for classification.All developed hybrid systems displayed promising outcomes.For multiclass classification,the XGBoost model using ResNet101-DenseNet201-MobileNet features selected by ACO attained 99.4%accuracy,99.45%precision,and 99.75%specificity,surpassing prior studies(93.76%accuracy).It reached 99.6%accuracy,99.65%precision,and 99.55%specificity in binary-class classification.These results demonstrate the effectiveness of multi-CNN fusion with feature selection in improving MS classification accuracy.
基金the National Natural Science Foundation of China(No.12064027)。
文摘Zn vapour is easily generated on the surface by fusion welding galvanized steel sheet,resulting in the formation of defects.Rapidly developing computer vision sensing technology collects weld images in the welding process,then obtains laser fringe information through digital image processing,identifies welding defects,and finally realizes online control of weld defects.The performance of a convolutional neural network is related to its structure and the quality of the input image.The acquired original images are labeled with LabelMe,and repeated attempts are made to determine the appropriate filtering and edge detection image preprocessing methods.Two-stage convolutional neural networks with different structures are built on the Tensorflow deep learning framework,different thresholds of intersection over union are set,and deep learning methods are used to evaluate the collected original images and the preprocessed images separately.Compared with the test results,the comprehensive performance of the improved feature pyramid networks algorithm based on the basic network VGG16 is lower than that of the basic network Resnet101.Edge detection of the image will significantly improve the accuracy of the model.Adding blur will reduce the accuracy of the model slightly;however,the overall performance of the improved algorithm is still relatively good,which proves the stability of the algorithm.The self-developed software inspection system can be used for image preprocessing and defect recognition,which can be used to record the number and location of typical defects in continuous welds.
