Realizing the point-of-care tumor markers biodetection with good convenience and high sensitivity possesses great significance for prompting cancer monitoring and screening in biomedical study field.Herein,the quantum...Realizing the point-of-care tumor markers biodetection with good convenience and high sensitivity possesses great significance for prompting cancer monitoring and screening in biomedical study field.Herein,the quantum dots luminescence and microfluidic biochip with machine vision algorithm-based intelligent biosensing platform have been designed and manufactured for point-of-care tumor markers diagnostics.The employed quantum dots with excellent photoluminescent performance are modified with specific antibody as the optical labeling agents for the designed sandwich structure immunoassay.The corresponding biosensing investigations of the designed biodetection platform illustrate several advantages involving high sensitivity(~0.021 ng mL^(−1)),outstanding accessibility,and great integrability.Moreover,related test results of human-sourced artificial saliva samples demonstrate better detection capabilities compared with commercially utilized rapid test strips.Combining these infusive abilities,our elaborate biosensing platform is expected to exhibit potential applications for the future point-of-care tumor markers diagnostic area.展开更多
During the sizing process,yarn congestion fault occurs at the reed teeth of a sizing machine.At present,the yarn congestion fault is generally handled by manual detection.The sizing production line operates on a large...During the sizing process,yarn congestion fault occurs at the reed teeth of a sizing machine.At present,the yarn congestion fault is generally handled by manual detection.The sizing production line operates on a large scale and runs continuously.Untimely handling of the yarn congestion fault causes a large amount of yarn waste.In this research,a machine vision-based algorithm for yarn congestion fault detection is developed.Through the analysis of the congestion fault and interference contour characteristics,the basic idea of image phase subtraction to identify the congestion fault is determined.To address the interference information appearing after image phase subtraction,the image pre-processing methods of Canny edge extraction and mean filtering are employed.According to the fault size and location characteristics,the fault contour detection algorithm based on inter-frame difference is designed.To mitigate the camera vibration interference,the anti-vibration interference algorithm based on affine transformation is studied,and the fault detection algorithm for the total yarn congestion fault is determined.The detection of 20 sets of field data is carried out,and the detection rate reaches 90%.This fault detection algorithm realizes the automatic detection of yarn congestion fault of sizing machine with certain real-time performance and accuracy.展开更多
Objective:To explore a rapid and accurate method for evaluating the quality of Prunus mandshurica(Maxim.)Koehne(P.mandshurica,Ku Xing Ren)during rancidity using machine vision and learning.Methods:Sensory evaluation a...Objective:To explore a rapid and accurate method for evaluating the quality of Prunus mandshurica(Maxim.)Koehne(P.mandshurica,Ku Xing Ren)during rancidity using machine vision and learning.Methods:Sensory evaluation and chemometrics were used to classify P.mandshurica quality grades after rancidity.Chemical indicators of the P.mandshurica quality change were determined to verify the ob-tained grades and support the subsequent modeling.The International Commission on Illumination color space was used to extract the color features of the P.mandshurica.Discrimination and prediction models based on color features combined with multiple machine learning algorithms were established using 10-fold cross-validation and external test set validation.Results:The P.mandshurica rancidity samples were allocated to three quality grades.The Bayes net model based on powder color successfully identified the P.mandshurica at different grades with an accuracy of 88.89%and 100%using two validations,and the naive Bayes model based on section color achieved the same accuracy with an receiver operating characteristic area of 0.979.The instance-based k-nearest neighbors model based on powder color performed best in predicting the amygdalin content[R^(2)=0.9801,mean absolute error(MAE)=0.2071,root mean squared error(RMSE)=0.4170],followed by the random com-mittee model in predicting the acid value(R^(2)=0.9580,MAE=1.5121,RMSE=1.9099)and the random forest model in predicting the peroxide value(R^(2)=0.8857,MAE=0.0027,RMSE=0.0035).Conclusion:This study demonstrates that color digitization analysis is a potential method for rapidly evaluating the quality of P.mandshurica across the rancidity process,providing a new reference for the quality assessment of traditional Chinese medicines.展开更多
Vibration cutting has emerged as a promising method for creating surface functional microstructures.However,achieving precise tool setting is a time-consuming process that significantly impacts process efficiency.This...Vibration cutting has emerged as a promising method for creating surface functional microstructures.However,achieving precise tool setting is a time-consuming process that significantly impacts process efficiency.This study proposes an intelligent approach for tool setting in vibration cutting using machine vision and hearing,divided into two steps.In the first step,machine vision is employed to achieve rough precision in tool setting within tens of micrometers.Subsequently,in the second step,machine hearing utilizes sound pickup to capture vibration audio signals,enabling fine tool adjustment within 1μm precision.The relationship between the spectral intensity of vibration audio and cutting depth is analyzed to establish criteria for tool–workpiece contact.Finally,the efficacy of this approach is validated on an ultra-precision platform,demonstrating that the automated tool-setting process takes no more than 74 s.The total cost of the vision and hearing sensors is less than$1500.展开更多
With the rapid development of computer vision technology,artificial intelligence algorithms,and high-performance computing platforms,machine vision technology has gradually shown its great potential in automated produ...With the rapid development of computer vision technology,artificial intelligence algorithms,and high-performance computing platforms,machine vision technology has gradually shown its great potential in automated production lines,especially in defect detection.Machine vision technology can be applied in many industries such as semiconductor,automobile manufacturing,aerospace,food,and drugs,which can significantly improve detection efficiency and accuracy,reduce labor costs,improve product quality,enhance market competitiveness,and provide strong support for the arrival of Industry 4.0 era.In this article,the concept,advantages,and disadvantages of machine vision and the algorithm framework of machine vision in the defect detection system are briefly described,aiming to promote the rapid development of industry and strengthen China’s industry.展开更多
Prompt radiation emitted during accelerator operation poses a significant health risk,necessitating a thorough search and securing of hazardous areas prior to initiation.Currently,manual sweep methods are employed.How...Prompt radiation emitted during accelerator operation poses a significant health risk,necessitating a thorough search and securing of hazardous areas prior to initiation.Currently,manual sweep methods are employed.However,the limitations of manual sweeps have become increasingly evident with the implementation of large-scale accelerators.By leveraging advancements in machine vision technology,the automatic identification of stranded personnel in controlled areas through camera imagery presents a viable solution for efficient search and security.Given the criticality of personal safety for stranded individuals,search and security processes must be sufficiently reliable.To ensure comprehensive coverage,180°camera groups were strategically positioned on both sides of the accelerator tunnel to eliminate blind spots within the monitoring range.The YOLOV8 network model was modified to enable the detection of small targets,such as hands and feet,as well as larger targets formed by individuals near the cameras.Furthermore,the system incorporates a pedestrian recognition model that detects human body parts,and an information fusion strategy is used to integrate the detected head,hands,and feet with the identified pedestrians as a cohesive unit.This strategy enhanced the capability of the model to identify pedestrians obstructed by equipment,resulting in a notable improvement in the recall rate.Specifically,recall rates of 0.915 and 0.82were obtained for Datasets 1 and 2,respectively.Although there was a slight decrease in accuracy,it aligned with the intended purpose of the search-and-secure software design.Experimental tests conducted within an accelerator tunnel demonstrated the effectiveness of this approach in achieving reliable recognition outcomes.展开更多
Refractory materials,as the crucial foundational materials in high-temperature industrial processes such as metallurgy and construction,are inevitably subjected to corrosion and penetration from high-temperature media...Refractory materials,as the crucial foundational materials in high-temperature industrial processes such as metallurgy and construction,are inevitably subjected to corrosion and penetration from high-temperature media during their service.Traditionally,observing the in-situ degradation process of refractory materials in complex high-temperature environments has presented challenges.Post-corrosion analysis are commonly employed to assess the slag resistance of refractory materials and understand the corrosion mechanisms.However,these methods often lack information on the process under the conditions of thermal-chemical-mechanical coupling,leading to potential biases in the analysis results.In this work,we developed a non-contact high-temperature machine vision technology by the integrating Digital Image Correlation(DIC)with a high-temperature visualization system to explore the corrosion behavior of Al2O3-SiO2 refractories against molten glass and Al2O3-MgO dry ramming refractories against molten slag at different temperatures.This technology enables realtime monitoring of the 2D or 3D overall strain and average strain curves of the refractory materials and provides continuous feedback on the progressive corrosion of the materials under the coupling conditions of thermal,chemical,and mechanical factors.Therefore,it is an innovative approach for evaluating the service behavior and performance of refractory materials,and is expected to promote the digitization and intelligence of the refractory industry,contributing to the optimization and upgrading of product performance.展开更多
An automatic monitoring method of the 3-D deformation is presented for crustal fault based on laser and machine vision. The laser source and screen are independently set up in the headwall and footwall, the collimated...An automatic monitoring method of the 3-D deformation is presented for crustal fault based on laser and machine vision. The laser source and screen are independently set up in the headwall and footwall, the collimated laser beam creates a circular spot on the screen, meanwhile, the industrial camera captures the tiny deformation of the crustal fault by monitoring the change of the spot position. This method significantly reduces the cost of equipment and labor, provides daily sampling to ensure high continuity of data. A prototype of the automatic monitoring system is developed, and a repeatability test indicates that the error of spot jitter can be minimized by consecutive samples. Meanwhile, the environmental correction model is determined to ensure that environmental changes do not disturb the system. Furthermore, the automatic monitoring system has been applied at the deformation monitoring station(KJX02) of China Beishan underground research laboratory, where continuous deformation monitoring is underway.展开更多
To realize high-precision automatic measurement of two-dimensional geometric features on parts, a cooperative measurement system based on machine vision is constructed. Its hardware structure, functional composition a...To realize high-precision automatic measurement of two-dimensional geometric features on parts, a cooperative measurement system based on machine vision is constructed. Its hardware structure, functional composition and working principle are introduced. The mapping relationship between the feature image coordinates and the measuring space coordinates is established. The method of measuring path planning of small field of view (FOV) images is proposed. With the cooperation of the panoramic image of the object to be measured, the small FOV images with high object plane resolution are acquired automatically. Then, the auxiliary measuring characteristics are constructed and the parameters of the features to be measured are automatically extracted. Experimental results show that the absolute value of relative error is less than 0. 03% when applying the cooperative measurement system to gauge the hole distance of 100 mm nominal size. When the object plane resolving power of the small FOV images is 16 times that of the large FOV image, the measurement accuracy of small FOV images is improved by 14 times compared with the large FOV image. It is suitable for high-precision automatic measurement of two-dimensional complex geometric features distributed on large scale parts.展开更多
Drogue recognition and 3D locating is a key problem during the docking phase of the autonomous aerial refueling (AAR). To solve this problem, a novel and effective method based on monocular vision is presented in th...Drogue recognition and 3D locating is a key problem during the docking phase of the autonomous aerial refueling (AAR). To solve this problem, a novel and effective method based on monocular vision is presented in this paper. Firstly, by employing computer vision with red-ring-shape feature, a drogue detection and recognition algorithm is proposed to guarantee safety and ensure the robustness to the drogue diversity and the changes in environmental condi- tions, without using a set of infrared light emitting diodes (LEDs) on the parachute part of the dro- gue. Secondly, considering camera lens distortion, a monocular vision measurement algorithm for drogue 3D locating is designed to ensure the accuracy and real-time performance of the system, with the drogue attitude provided. Finally, experiments are conducted to demonstrate the effective- ness of the proposed method. Experimental results show the performances of the entire system in contrast with other methods, which validates that the proposed method can recognize and locate the drogue three dimensionally, rapidly and precisely.展开更多
Monitring pest populations in paddy fields is important to effectively implement integrated pest management.Light traps are widely used to monitor field pests all over the world.Most conventional light traps still inv...Monitring pest populations in paddy fields is important to effectively implement integrated pest management.Light traps are widely used to monitor field pests all over the world.Most conventional light traps still involve manual identification of target pests from lots of trapped insects,which is time-consuming,labor-intensive and error-prone,especially in pest peak periods.In this paper,we developed an automatic monitoring system for rice light-trap pests based on machine vision.This system is composed of an itelligent light trap,a computer or mobile phone client platform and a cloud server.The light trap firstly traps,kills and disperses insects,then collects images of trapped insects and sends each image to the cloud server.Five target pests in images are automatically identifed and counted by pest identification models loaded in the server.To avoid light-trap insects piling up,a vibration plate and a moving rotation conveyor belt are adopted to disperse these trapped insects.There was a close correlation(r=0.92)between our automatic and manual identification methods based on the daily pest number of one-year images from one light trap.Field experiments demonstrated the effectiveness and accuracy of our automatic light trap monitoring system.展开更多
Tubes are used widely in aerospace vehicles, and their accurate assembly can directly affect the assembling reliability and the quality of products. It is important to measure the processed tube's endpoints and then ...Tubes are used widely in aerospace vehicles, and their accurate assembly can directly affect the assembling reliability and the quality of products. It is important to measure the processed tube's endpoints and then fix any geometric errors correspondingly. However, the traditional tube inspection method is time-consuming and complex operations. Therefore, a new measurement method for a tube's endpoints based on machine vision is proposed. First, reflected light on tube's surface can be removed by using photometric linearization. Then, based on the optimization model for the tube's endpoint measurements and the principle of stereo matching, the global coordinates and the relative distance of the tube's endpoint are obtained. To confirm the feasibility, ll tubes are processed to remove the reflected light and then the endpoint's positions of tubes are measured. The experiment results show that the measurement repeatability accuracy is 0.167 mm, and the absolute accuracy is 0.328 ram. The measurement takes less than 1 min. The proposed method based on machine vision can measure the tube's endpoints without any surface treatment or any tools and can realize on line measurement.展开更多
This research aimed to improve selection of pepper seeds for separating high-quality seeds from low-quality seeds. Past research has shown that seed vigor is significantly related to the seed color and size, thus seve...This research aimed to improve selection of pepper seeds for separating high-quality seeds from low-quality seeds. Past research has shown that seed vigor is significantly related to the seed color and size, thus several physical features were identified as candidate predictors of high seed quality. Image recognition software was used to automate recognition of seed feature quality using 400 kernels of pepper cultivar 101. In addition, binary logistic regression and a neural network were applied to determine models with high predictive value of seed germination. Single-kernel germination tests were conducted to validate the predictive value of the identified features. The best predictors of seed vigor were determined by the highest correlation observed between the physical features and the subsequent fresh weight of seedlings that germinated from the 400 seeds. Correlation analysis showed that fresh weight was significantly positively correlated with eight physical features: three color features (R, a*, brightness), width, length, projected area, and single-kernel density, and weight. In contrast, fresh weight significantly negatively correlated with the feature of hue. In analyses of two of the highest correlating single features,' germination percentage increased from 59.3 to 71.8% when a*〉3, and selection rate peaked at 57.8%. Germination percentage increased from 59.3 to 79.4%, and the selection rate reached 76.8%, when single-kernel weight 〉0.0064 g. The most effective model was based on a multilayer perceptron (MLP) neural network, consisting of 15 physical traits as variables, and a stability calculated as 99.4%. Germination percentage in a calibration set of seeds was 79.1% and the selection rate was 90.0%. These results indicated that the model was effective in predicting seed germination based on physical features and could be used as a guide for quality control in seed selection. Automated systems based on machine vision and model classifiers can contribute to reducing the costs and labor required in the selection of pepper seeds.展开更多
When characterizing flows in miniaturized channels, the determination of the dynamic contact angle is important. By measuring the dynamic contact angle, the flow properties of the flowing liquid and the effect of mate...When characterizing flows in miniaturized channels, the determination of the dynamic contact angle is important. By measuring the dynamic contact angle, the flow properties of the flowing liquid and the effect of material properties on the flow can be characterized. A machine vision based system to measure the contact angle of front or rear menisci of a moving liquid plug is described in this article. In this research, transparent flow channels fabricated on thermoplastic polymer and sealed with an adhesive tape are used. The transparency of the channels enables image based monitoring and measurement of flow variables, including the dynamic contact angle. It is shown that the dynamic angle can be measured from a liquid flow in a channel using the image based measurement system. An image processing algorithm has been developed in a MATLAB environment. Images are taken using a CCD camera and the channels are illuminated using a custom made ring light. Two fitting methods, a circle and two parabolas, are experimented and the results are compared in the measurement of the dynamic contact angles.展开更多
In this study, we established a dynamic morphological model using the accumulated thermal effectiveness and photosynthetic active radiation (PAR) (A-TEP), aiming to explore the relationship between muskmelon (Cuc...In this study, we established a dynamic morphological model using the accumulated thermal effectiveness and photosynthetic active radiation (PAR) (A-TEP), aiming to explore the relationship between muskmelon (Cucumis melo L.) fruit attributes and environmental factors. Muskmelon surface color was described by parameters of red, green, blue, hue, saturation and brightness (HSI). Three characteristic parameters, gray level co-occurrence matrix (GLCM), angular second moment (ASM), entropy, contrast, and the coverage rate were used to describe the process of muskmelon fruit netting formation. ASM was not significant difference during muskmelon fruit growth. The number and deep of netting stripes gradually increased with fruit growth. Coverage rate increased rapidly for 15-30 d after pollination. The vertical and horizontal diameters of muskmelon fruit were followed a logistic curve. And root mean squared errors (RMSE) between the simulated and measured vertical and horizontal diameters were 3.527 and 4.696 mm, respectively. RMSE of red, green, blue, saturation and brightness were 0.999, 2.690, 2.992, 0.033 and 5.51, respectively, and the RMSE for entropy, contrast and coverage rates were 0.077, 0.063 and 0.015, respectively, indicating a well consistent between measured and simulated values.展开更多
A machine vision system was developed to inspect the quality of rice seeds. Five varieties of Jinyou402, Shanyou10, Zhongyou207, Jiayou and IIyou were evaluated. The images of both sides of rice seed with black backg...A machine vision system was developed to inspect the quality of rice seeds. Five varieties of Jinyou402, Shanyou10, Zhongyou207, Jiayou and IIyou were evaluated. The images of both sides of rice seed with black background and white background were acquired with the image processing system for identifying external features of rice seeds. Five image sets consisting of 600 original images each were obtained. Then a digital image processing algorithm based on Hough transform was developed to inspect the rice seeds with incompletely closed glumes. The algorithm was implemented with all image sets using a Matlab 6.5 procedure. The results showed that the algorithm achieved an average accuracy of 96% for normal seeds, 92% for seeds with fine fissure and 87% for seeds with incompletely closed glumes. The algorithm was proved to be applicable to different seed varieties and insensitive to the color of the background.展开更多
The purpose of this study is to develop a standard methodology for measuring the surface free energy (SFE),and its component parts of bamboo fiber materials.The current methods was reviewed to determine the surface te...The purpose of this study is to develop a standard methodology for measuring the surface free energy (SFE),and its component parts of bamboo fiber materials.The current methods was reviewed to determine the surface tension of natural fibers and the disadvantages of techniques used were discussed.Although numerous techniques have been employed to characterize surface tension of natural fibers,it seems that the credibility of results obtained may often be dubious.In this paper,critical surface tension estimates were obtained from computer aided machine vision based measurement.Data were then analyzed by the least squares method to estimate the components of SFE.SFE was estimated by least squares analysis and also by Schultz' method.By using the Fowkes method the polar and disperse fractions of the surface free energy of bamboo fiber materials can be obtained.Strictly speaking,this method is based on a combination of the knowledge of Fowkes theory. SFE is desirable when adhesion is required,and it avoids some of the limitations of existing studies which has been proposed.The calculation steps described in this research are only intended to explain the methods.The results show that the method that only determines SFE as a single parameter may be unable to differentiate adequately between bamboo fiber materials,but it is feasible and very efficient.In order to obtain the maximum performance from the computer aided machine vision based measurement instruments,this measurement should be recommended and kept available for reference.展开更多
Coal is heterogeneous in nature,and thus the characterization of coal is essential before its use for a specific purpose.Thus,the current study aims to develop a machine vision system for automated coal characterizati...Coal is heterogeneous in nature,and thus the characterization of coal is essential before its use for a specific purpose.Thus,the current study aims to develop a machine vision system for automated coal characterizations.The model was calibrated using 80 image samples that are captured for different coal samples in different angles.All the images were captured in RGB color space and converted into five other color spaces(HSI,CMYK,Lab,xyz,Gray)for feature extraction.The intensity component image of HSI color space was further transformed into four frequency components(discrete cosine transform,discrete wavelet transform,discrete Fourier transform,and Gabor filter)for the texture features extraction.A total of 280 image features was extracted and optimized using a step-wise linear regression-based algorithm for model development.The datasets of the optimized features were used as an input for the model,and their respective coal characteristics(analyzed in the laboratory)were used as outputs of the model.The R-squared values were found to be 0.89,0.92,0.92,and 0.84,respectively,for fixed carbon,ash content,volatile matter,and moisture content.The performance of the proposed artificial neural network model was also compared with the performances of performances of Gaussian process regression,support vector regression,and radial basis neural network models.The study demonstrates the potential of the machine vision system in automated coal characterization.展开更多
Food processing companies pursue the distribution of ingredientsthat were packaged according to a certain weight. Particularly, foods like fishare highly demanded and supplied. However, despite the high quantity offis...Food processing companies pursue the distribution of ingredientsthat were packaged according to a certain weight. Particularly, foods like fishare highly demanded and supplied. However, despite the high quantity offish to be supplied, most seafood processing companies have yet to installautomation equipment. Such absence of automation equipment for seafoodprocessing incurs a considerable cost regarding labor force, economy, andtime. Moreover, workers responsible for fish processing are exposed to risksbecause fish processing tasks require the use of dangerous tools, such aspower saws or knives. To solve these problems observed in the fish processingfield, this study proposed a fish cutting point prediction method based onAI machine vision and target weight. The proposed method performs threedimensional(3D) modeling of a fish’s form based on image processing techniquesand partitioned random sample consensus (RANSAC) and extracts 3Dfeature information. Then, it generates a neural network model for predictingfish cutting points according to the target weight by performing machinelearning of the extracted 3D feature information and measured weight information.This study allows for the direct cutting of fish based on cutting pointspredicted by the proposed method. Subsequently, we compared the measuredweight of the cut pieces with the target weight. The comparison result verifiedthat the proposed method showed a mean error rate of approximately 3%.展开更多
基金supported by grants from the Research Grants Council of the Hong Kong Special Administrative Region,China(Project No.CRF No.PolyU C5110-20G)PolyU Grants(1-CE0H,1-W30M,1-CD4S).
文摘Realizing the point-of-care tumor markers biodetection with good convenience and high sensitivity possesses great significance for prompting cancer monitoring and screening in biomedical study field.Herein,the quantum dots luminescence and microfluidic biochip with machine vision algorithm-based intelligent biosensing platform have been designed and manufactured for point-of-care tumor markers diagnostics.The employed quantum dots with excellent photoluminescent performance are modified with specific antibody as the optical labeling agents for the designed sandwich structure immunoassay.The corresponding biosensing investigations of the designed biodetection platform illustrate several advantages involving high sensitivity(~0.021 ng mL^(−1)),outstanding accessibility,and great integrability.Moreover,related test results of human-sourced artificial saliva samples demonstrate better detection capabilities compared with commercially utilized rapid test strips.Combining these infusive abilities,our elaborate biosensing platform is expected to exhibit potential applications for the future point-of-care tumor markers diagnostic area.
基金National Key Research and Development Program of China(No.2017YFB1304001)。
文摘During the sizing process,yarn congestion fault occurs at the reed teeth of a sizing machine.At present,the yarn congestion fault is generally handled by manual detection.The sizing production line operates on a large scale and runs continuously.Untimely handling of the yarn congestion fault causes a large amount of yarn waste.In this research,a machine vision-based algorithm for yarn congestion fault detection is developed.Through the analysis of the congestion fault and interference contour characteristics,the basic idea of image phase subtraction to identify the congestion fault is determined.To address the interference information appearing after image phase subtraction,the image pre-processing methods of Canny edge extraction and mean filtering are employed.According to the fault size and location characteristics,the fault contour detection algorithm based on inter-frame difference is designed.To mitigate the camera vibration interference,the anti-vibration interference algorithm based on affine transformation is studied,and the fault detection algorithm for the total yarn congestion fault is determined.The detection of 20 sets of field data is carried out,and the detection rate reaches 90%.This fault detection algorithm realizes the automatic detection of yarn congestion fault of sizing machine with certain real-time performance and accuracy.
基金funded by the National Natural Science Foundation of China(81573542)Shanxi Province's Traditional Chinese Medicine Technology Innovation Project(2100601).
文摘Objective:To explore a rapid and accurate method for evaluating the quality of Prunus mandshurica(Maxim.)Koehne(P.mandshurica,Ku Xing Ren)during rancidity using machine vision and learning.Methods:Sensory evaluation and chemometrics were used to classify P.mandshurica quality grades after rancidity.Chemical indicators of the P.mandshurica quality change were determined to verify the ob-tained grades and support the subsequent modeling.The International Commission on Illumination color space was used to extract the color features of the P.mandshurica.Discrimination and prediction models based on color features combined with multiple machine learning algorithms were established using 10-fold cross-validation and external test set validation.Results:The P.mandshurica rancidity samples were allocated to three quality grades.The Bayes net model based on powder color successfully identified the P.mandshurica at different grades with an accuracy of 88.89%and 100%using two validations,and the naive Bayes model based on section color achieved the same accuracy with an receiver operating characteristic area of 0.979.The instance-based k-nearest neighbors model based on powder color performed best in predicting the amygdalin content[R^(2)=0.9801,mean absolute error(MAE)=0.2071,root mean squared error(RMSE)=0.4170],followed by the random com-mittee model in predicting the acid value(R^(2)=0.9580,MAE=1.5121,RMSE=1.9099)and the random forest model in predicting the peroxide value(R^(2)=0.8857,MAE=0.0027,RMSE=0.0035).Conclusion:This study demonstrates that color digitization analysis is a potential method for rapidly evaluating the quality of P.mandshurica across the rancidity process,providing a new reference for the quality assessment of traditional Chinese medicines.
基金the financial support for this research provided by the National Natural Science Foundation of China(Grant Nos.52275470,124115301,and 52105458)the Natural Science Foundation of Beijing(Grant No.3222009).
文摘Vibration cutting has emerged as a promising method for creating surface functional microstructures.However,achieving precise tool setting is a time-consuming process that significantly impacts process efficiency.This study proposes an intelligent approach for tool setting in vibration cutting using machine vision and hearing,divided into two steps.In the first step,machine vision is employed to achieve rough precision in tool setting within tens of micrometers.Subsequently,in the second step,machine hearing utilizes sound pickup to capture vibration audio signals,enabling fine tool adjustment within 1μm precision.The relationship between the spectral intensity of vibration audio and cutting depth is analyzed to establish criteria for tool–workpiece contact.Finally,the efficacy of this approach is validated on an ultra-precision platform,demonstrating that the automated tool-setting process takes no more than 74 s.The total cost of the vision and hearing sensors is less than$1500.
文摘With the rapid development of computer vision technology,artificial intelligence algorithms,and high-performance computing platforms,machine vision technology has gradually shown its great potential in automated production lines,especially in defect detection.Machine vision technology can be applied in many industries such as semiconductor,automobile manufacturing,aerospace,food,and drugs,which can significantly improve detection efficiency and accuracy,reduce labor costs,improve product quality,enhance market competitiveness,and provide strong support for the arrival of Industry 4.0 era.In this article,the concept,advantages,and disadvantages of machine vision and the algorithm framework of machine vision in the defect detection system are briefly described,aiming to promote the rapid development of industry and strengthen China’s industry.
文摘Prompt radiation emitted during accelerator operation poses a significant health risk,necessitating a thorough search and securing of hazardous areas prior to initiation.Currently,manual sweep methods are employed.However,the limitations of manual sweeps have become increasingly evident with the implementation of large-scale accelerators.By leveraging advancements in machine vision technology,the automatic identification of stranded personnel in controlled areas through camera imagery presents a viable solution for efficient search and security.Given the criticality of personal safety for stranded individuals,search and security processes must be sufficiently reliable.To ensure comprehensive coverage,180°camera groups were strategically positioned on both sides of the accelerator tunnel to eliminate blind spots within the monitoring range.The YOLOV8 network model was modified to enable the detection of small targets,such as hands and feet,as well as larger targets formed by individuals near the cameras.Furthermore,the system incorporates a pedestrian recognition model that detects human body parts,and an information fusion strategy is used to integrate the detected head,hands,and feet with the identified pedestrians as a cohesive unit.This strategy enhanced the capability of the model to identify pedestrians obstructed by equipment,resulting in a notable improvement in the recall rate.Specifically,recall rates of 0.915 and 0.82were obtained for Datasets 1 and 2,respectively.Although there was a slight decrease in accuracy,it aligned with the intended purpose of the search-and-secure software design.Experimental tests conducted within an accelerator tunnel demonstrated the effectiveness of this approach in achieving reliable recognition outcomes.
基金supported by the National Natural Science Foundation of China(52272022)Key Program of Natural Science Foundation of Hubei Province(2021CFA071).
文摘Refractory materials,as the crucial foundational materials in high-temperature industrial processes such as metallurgy and construction,are inevitably subjected to corrosion and penetration from high-temperature media during their service.Traditionally,observing the in-situ degradation process of refractory materials in complex high-temperature environments has presented challenges.Post-corrosion analysis are commonly employed to assess the slag resistance of refractory materials and understand the corrosion mechanisms.However,these methods often lack information on the process under the conditions of thermal-chemical-mechanical coupling,leading to potential biases in the analysis results.In this work,we developed a non-contact high-temperature machine vision technology by the integrating Digital Image Correlation(DIC)with a high-temperature visualization system to explore the corrosion behavior of Al2O3-SiO2 refractories against molten glass and Al2O3-MgO dry ramming refractories against molten slag at different temperatures.This technology enables realtime monitoring of the 2D or 3D overall strain and average strain curves of the refractory materials and provides continuous feedback on the progressive corrosion of the materials under the coupling conditions of thermal,chemical,and mechanical factors.Therefore,it is an innovative approach for evaluating the service behavior and performance of refractory materials,and is expected to promote the digitization and intelligence of the refractory industry,contributing to the optimization and upgrading of product performance.
基金supported by Earthquake Sciences Spark Programs of China Earthquake Administration(No.XH22020YA)Science Innovation Fund granted by the First Monitoring and Application Center of China Earthquake Administration(No.FMC202309).
文摘An automatic monitoring method of the 3-D deformation is presented for crustal fault based on laser and machine vision. The laser source and screen are independently set up in the headwall and footwall, the collimated laser beam creates a circular spot on the screen, meanwhile, the industrial camera captures the tiny deformation of the crustal fault by monitoring the change of the spot position. This method significantly reduces the cost of equipment and labor, provides daily sampling to ensure high continuity of data. A prototype of the automatic monitoring system is developed, and a repeatability test indicates that the error of spot jitter can be minimized by consecutive samples. Meanwhile, the environmental correction model is determined to ensure that environmental changes do not disturb the system. Furthermore, the automatic monitoring system has been applied at the deformation monitoring station(KJX02) of China Beishan underground research laboratory, where continuous deformation monitoring is underway.
基金The National Natural Science Foundation of China(No.51175267)the Natural Science Foundation of Jiangsu Province(No.BK2010481)+2 种基金the Ph.D.Programs Foundation of Ministry of Education of China(No.20113219120004)China Postdoctoral Science Foundation(No.20100481148)the Postdoctoral Science Foundation of Jiangsu Province(No.1001004B)
文摘To realize high-precision automatic measurement of two-dimensional geometric features on parts, a cooperative measurement system based on machine vision is constructed. Its hardware structure, functional composition and working principle are introduced. The mapping relationship between the feature image coordinates and the measuring space coordinates is established. The method of measuring path planning of small field of view (FOV) images is proposed. With the cooperation of the panoramic image of the object to be measured, the small FOV images with high object plane resolution are acquired automatically. Then, the auxiliary measuring characteristics are constructed and the parameters of the features to be measured are automatically extracted. Experimental results show that the absolute value of relative error is less than 0. 03% when applying the cooperative measurement system to gauge the hole distance of 100 mm nominal size. When the object plane resolving power of the small FOV images is 16 times that of the large FOV image, the measurement accuracy of small FOV images is improved by 14 times compared with the large FOV image. It is suitable for high-precision automatic measurement of two-dimensional complex geometric features distributed on large scale parts.
基金supported by the National Natural Science Foundation of China(Nos.61473307,61304120)
文摘Drogue recognition and 3D locating is a key problem during the docking phase of the autonomous aerial refueling (AAR). To solve this problem, a novel and effective method based on monocular vision is presented in this paper. Firstly, by employing computer vision with red-ring-shape feature, a drogue detection and recognition algorithm is proposed to guarantee safety and ensure the robustness to the drogue diversity and the changes in environmental condi- tions, without using a set of infrared light emitting diodes (LEDs) on the parachute part of the dro- gue. Secondly, considering camera lens distortion, a monocular vision measurement algorithm for drogue 3D locating is designed to ensure the accuracy and real-time performance of the system, with the drogue attitude provided. Finally, experiments are conducted to demonstrate the effective- ness of the proposed method. Experimental results show the performances of the entire system in contrast with other methods, which validates that the proposed method can recognize and locate the drogue three dimensionally, rapidly and precisely.
基金Supported by the Fundamental Public Welfare Research Program of Zhejiang Provincial Natural Science Foundation,China(LGN18C140007 and Y20C140024)the National High Technology Research and Development Program of China(863 Program,2013AA102402)the Agricultural Science and Technology Innovation Program of Chinese Academy of Agricultural Sciences.
文摘Monitring pest populations in paddy fields is important to effectively implement integrated pest management.Light traps are widely used to monitor field pests all over the world.Most conventional light traps still involve manual identification of target pests from lots of trapped insects,which is time-consuming,labor-intensive and error-prone,especially in pest peak periods.In this paper,we developed an automatic monitoring system for rice light-trap pests based on machine vision.This system is composed of an itelligent light trap,a computer or mobile phone client platform and a cloud server.The light trap firstly traps,kills and disperses insects,then collects images of trapped insects and sends each image to the cloud server.Five target pests in images are automatically identifed and counted by pest identification models loaded in the server.To avoid light-trap insects piling up,a vibration plate and a moving rotation conveyor belt are adopted to disperse these trapped insects.There was a close correlation(r=0.92)between our automatic and manual identification methods based on the daily pest number of one-year images from one light trap.Field experiments demonstrated the effectiveness and accuracy of our automatic light trap monitoring system.
基金Supported by National Natural Science Foundation of China(Grant No51305031)
文摘Tubes are used widely in aerospace vehicles, and their accurate assembly can directly affect the assembling reliability and the quality of products. It is important to measure the processed tube's endpoints and then fix any geometric errors correspondingly. However, the traditional tube inspection method is time-consuming and complex operations. Therefore, a new measurement method for a tube's endpoints based on machine vision is proposed. First, reflected light on tube's surface can be removed by using photometric linearization. Then, based on the optimization model for the tube's endpoint measurements and the principle of stereo matching, the global coordinates and the relative distance of the tube's endpoint are obtained. To confirm the feasibility, ll tubes are processed to remove the reflected light and then the endpoint's positions of tubes are measured. The experiment results show that the measurement repeatability accuracy is 0.167 mm, and the absolute accuracy is 0.328 ram. The measurement takes less than 1 min. The proposed method based on machine vision can measure the tube's endpoints without any surface treatment or any tools and can realize on line measurement.
基金supported by the Beijing Municipal Science and Technology Project,China (Z151100001015004)
文摘This research aimed to improve selection of pepper seeds for separating high-quality seeds from low-quality seeds. Past research has shown that seed vigor is significantly related to the seed color and size, thus several physical features were identified as candidate predictors of high seed quality. Image recognition software was used to automate recognition of seed feature quality using 400 kernels of pepper cultivar 101. In addition, binary logistic regression and a neural network were applied to determine models with high predictive value of seed germination. Single-kernel germination tests were conducted to validate the predictive value of the identified features. The best predictors of seed vigor were determined by the highest correlation observed between the physical features and the subsequent fresh weight of seedlings that germinated from the 400 seeds. Correlation analysis showed that fresh weight was significantly positively correlated with eight physical features: three color features (R, a*, brightness), width, length, projected area, and single-kernel density, and weight. In contrast, fresh weight significantly negatively correlated with the feature of hue. In analyses of two of the highest correlating single features,' germination percentage increased from 59.3 to 71.8% when a*〉3, and selection rate peaked at 57.8%. Germination percentage increased from 59.3 to 79.4%, and the selection rate reached 76.8%, when single-kernel weight 〉0.0064 g. The most effective model was based on a multilayer perceptron (MLP) neural network, consisting of 15 physical traits as variables, and a stability calculated as 99.4%. Germination percentage in a calibration set of seeds was 79.1% and the selection rate was 90.0%. These results indicated that the model was effective in predicting seed germination based on physical features and could be used as a guide for quality control in seed selection. Automated systems based on machine vision and model classifiers can contribute to reducing the costs and labor required in the selection of pepper seeds.
基金This research was done as part of TEKES-funded PanFlow project and as part of a project OPTIMI funded by the Academy of Finland (grant number 117587) in Micro- and Nanosystems Research Group, Tampere University of Technology, Finland.
文摘When characterizing flows in miniaturized channels, the determination of the dynamic contact angle is important. By measuring the dynamic contact angle, the flow properties of the flowing liquid and the effect of material properties on the flow can be characterized. A machine vision based system to measure the contact angle of front or rear menisci of a moving liquid plug is described in this article. In this research, transparent flow channels fabricated on thermoplastic polymer and sealed with an adhesive tape are used. The transparency of the channels enables image based monitoring and measurement of flow variables, including the dynamic contact angle. It is shown that the dynamic angle can be measured from a liquid flow in a channel using the image based measurement system. An image processing algorithm has been developed in a MATLAB environment. Images are taken using a CCD camera and the channels are illuminated using a custom made ring light. Two fitting methods, a circle and two parabolas, are experimented and the results are compared in the measurement of the dynamic contact angles.
基金supported by the National Natural Science Foundation of China (31471411)the Shanghai Agriculture Applied Technology Development Program,China ((2017)3-8-4)
文摘In this study, we established a dynamic morphological model using the accumulated thermal effectiveness and photosynthetic active radiation (PAR) (A-TEP), aiming to explore the relationship between muskmelon (Cucumis melo L.) fruit attributes and environmental factors. Muskmelon surface color was described by parameters of red, green, blue, hue, saturation and brightness (HSI). Three characteristic parameters, gray level co-occurrence matrix (GLCM), angular second moment (ASM), entropy, contrast, and the coverage rate were used to describe the process of muskmelon fruit netting formation. ASM was not significant difference during muskmelon fruit growth. The number and deep of netting stripes gradually increased with fruit growth. Coverage rate increased rapidly for 15-30 d after pollination. The vertical and horizontal diameters of muskmelon fruit were followed a logistic curve. And root mean squared errors (RMSE) between the simulated and measured vertical and horizontal diameters were 3.527 and 4.696 mm, respectively. RMSE of red, green, blue, saturation and brightness were 0.999, 2.690, 2.992, 0.033 and 5.51, respectively, and the RMSE for entropy, contrast and coverage rates were 0.077, 0.063 and 0.015, respectively, indicating a well consistent between measured and simulated values.
基金Project supported by the National Natural Science Foundation ofChina (No. 60008001) and the Natural Science Foundation of Zhe-jiang Province (No. 300297), China
文摘A machine vision system was developed to inspect the quality of rice seeds. Five varieties of Jinyou402, Shanyou10, Zhongyou207, Jiayou and IIyou were evaluated. The images of both sides of rice seed with black background and white background were acquired with the image processing system for identifying external features of rice seeds. Five image sets consisting of 600 original images each were obtained. Then a digital image processing algorithm based on Hough transform was developed to inspect the rice seeds with incompletely closed glumes. The algorithm was implemented with all image sets using a Matlab 6.5 procedure. The results showed that the algorithm achieved an average accuracy of 96% for normal seeds, 92% for seeds with fine fissure and 87% for seeds with incompletely closed glumes. The algorithm was proved to be applicable to different seed varieties and insensitive to the color of the background.
基金the National Natural Science Foundation of China(No.31101085)the Scientific Research and Development Foundation for Start-up Projects of Zhejiang Agriculture and Forestry University (No.2034020044)
文摘The purpose of this study is to develop a standard methodology for measuring the surface free energy (SFE),and its component parts of bamboo fiber materials.The current methods was reviewed to determine the surface tension of natural fibers and the disadvantages of techniques used were discussed.Although numerous techniques have been employed to characterize surface tension of natural fibers,it seems that the credibility of results obtained may often be dubious.In this paper,critical surface tension estimates were obtained from computer aided machine vision based measurement.Data were then analyzed by the least squares method to estimate the components of SFE.SFE was estimated by least squares analysis and also by Schultz' method.By using the Fowkes method the polar and disperse fractions of the surface free energy of bamboo fiber materials can be obtained.Strictly speaking,this method is based on a combination of the knowledge of Fowkes theory. SFE is desirable when adhesion is required,and it avoids some of the limitations of existing studies which has been proposed.The calculation steps described in this research are only intended to explain the methods.The results show that the method that only determines SFE as a single parameter may be unable to differentiate adequately between bamboo fiber materials,but it is feasible and very efficient.In order to obtain the maximum performance from the computer aided machine vision based measurement instruments,this measurement should be recommended and kept available for reference.
文摘Coal is heterogeneous in nature,and thus the characterization of coal is essential before its use for a specific purpose.Thus,the current study aims to develop a machine vision system for automated coal characterizations.The model was calibrated using 80 image samples that are captured for different coal samples in different angles.All the images were captured in RGB color space and converted into five other color spaces(HSI,CMYK,Lab,xyz,Gray)for feature extraction.The intensity component image of HSI color space was further transformed into four frequency components(discrete cosine transform,discrete wavelet transform,discrete Fourier transform,and Gabor filter)for the texture features extraction.A total of 280 image features was extracted and optimized using a step-wise linear regression-based algorithm for model development.The datasets of the optimized features were used as an input for the model,and their respective coal characteristics(analyzed in the laboratory)were used as outputs of the model.The R-squared values were found to be 0.89,0.92,0.92,and 0.84,respectively,for fixed carbon,ash content,volatile matter,and moisture content.The performance of the proposed artificial neural network model was also compared with the performances of performances of Gaussian process regression,support vector regression,and radial basis neural network models.The study demonstrates the potential of the machine vision system in automated coal characterization.
基金supported by the Basic Science Research Program through the National Research Foundation of Korea (NRF)funded by the Ministry of Education (NRF-2020R1I1A3073313).
文摘Food processing companies pursue the distribution of ingredientsthat were packaged according to a certain weight. Particularly, foods like fishare highly demanded and supplied. However, despite the high quantity offish to be supplied, most seafood processing companies have yet to installautomation equipment. Such absence of automation equipment for seafoodprocessing incurs a considerable cost regarding labor force, economy, andtime. Moreover, workers responsible for fish processing are exposed to risksbecause fish processing tasks require the use of dangerous tools, such aspower saws or knives. To solve these problems observed in the fish processingfield, this study proposed a fish cutting point prediction method based onAI machine vision and target weight. The proposed method performs threedimensional(3D) modeling of a fish’s form based on image processing techniquesand partitioned random sample consensus (RANSAC) and extracts 3Dfeature information. Then, it generates a neural network model for predictingfish cutting points according to the target weight by performing machinelearning of the extracted 3D feature information and measured weight information.This study allows for the direct cutting of fish based on cutting pointspredicted by the proposed method. Subsequently, we compared the measuredweight of the cut pieces with the target weight. The comparison result verifiedthat the proposed method showed a mean error rate of approximately 3%.