Two-dimensional endoscopic images are susceptible to interferences such as specular reflections and monotonous texture illumination,hindering accurate three-dimensional lesion reconstruction by surgical robots.This st...Two-dimensional endoscopic images are susceptible to interferences such as specular reflections and monotonous texture illumination,hindering accurate three-dimensional lesion reconstruction by surgical robots.This study proposes a novel end-to-end disparity estimation model to address these challenges.Our approach combines a Pseudo-Siamese neural network architecture with pyramid dilated convolutions,integrating multi-scale image information to enhance robustness against lighting interferences.This study introduces a Pseudo-Siamese structure-based disparity regression model that simplifies left-right image comparison,improving accuracy and efficiency.The model was evaluated using a dataset of stereo endoscopic videos captured by the Da Vinci surgical robot,comprising simulated silicone heart sequences and real heart video data.Experimental results demonstrate significant improvement in the network’s resistance to lighting interference without substantially increasing parameters.Moreover,the model exhibited faster convergence during training,contributing to overall performance enhancement.This study advances endoscopic image processing accuracy and has potential implications for surgical robot applications in complex environments.展开更多
Passive optical motion capture technology is an effective mean to conduct high-precision pose estimation of small scenes of mobile robots;nevertheless,in the case of complex background and stray light interference in ...Passive optical motion capture technology is an effective mean to conduct high-precision pose estimation of small scenes of mobile robots;nevertheless,in the case of complex background and stray light interference in the scene,due to the infuence of target adhesion and environmental reflection,this technology cannot estimate the pose accurately.A passive binocular optical motion capture technology under complex illumination based on binocular camera and fixed retroreflective marker balls has been proposed.By fixing multiple hemispherical retrorefective marker balls on a rigid base,it uses binocular camera for depth estimation to obtain the fixed position relationship between the feature points.After performing unsupervised state estimation without manual operation,it overcomes the infuence of refection spots in the background.Meanwhile,contour extraction and ellipse least square fitting are used to extract the marker balls with incomplete shape as the feature points,so as to solve the problem of target adhesion in the scene.A FANUC m10i-a robot moving with 6-DOF is used for verification using the above methods in a complex lighting environment of a welding laboratory.The result shows that the average of absolute position errors is 5.793mm,the average of absolute rotation errors is 1.997°the average of relative position errors is 0.972 mm,and the average of relative rotation errors is 0.002°.Therefore,this technology meets the requirements of high-precision measurement in a complex lighting environment when estimating the 6-DOF-motion mobile robot and has very significant application prospects in complex scenes.展开更多
AIM:To evaluate the effect of femtosecond laser small incision lenticule extraction(SMILE)on the binocular visual function in myopic patients with glasses-free threedimensional(3D)technique.METHODS:Totally 50 myopic p...AIM:To evaluate the effect of femtosecond laser small incision lenticule extraction(SMILE)on the binocular visual function in myopic patients with glasses-free threedimensional(3D)technique.METHODS:Totally 50 myopic patients(39 females and 11 males)with SMILE were enrolled in this prospective study.The glasses-free 3D technique was used to evaluate the binocular visual function in these subjects including static stereopsis,dynamic stereopsis,foveal suppression,and binocular balance point of signal to noise ratio(s/n ratio).All subjects received measurements in 1d before operation,and 1d,1wk,and 1mo postoperatively.RESULTS:Both static and dynamic stereopsis showed no significant difference after SMILE.The foveal suppression improved significantly 1wk and 1mo after SMILE(P=0.005 and P=0.007 respectively).The binocular balance point of signal to noise ratio showed a significant improvement 1d,1wk and 1mo after SMILE for both eyes(P<0.001 for each eye respectively).CONCLUSION:Glasses-free 3D technique can be used to evaluate the effect of SMILE on the binocular visual function in myopic patients perceptively,and SMILE can improve both foveal suppression and binocular imbalance in these patients.展开更多
AIM:To evaluate the effects of refractive errors and binocular vision anomalies on the quality of life(QOL)of university students.METHODS:This cross-sectional analytical study was conducted on university students usin...AIM:To evaluate the effects of refractive errors and binocular vision anomalies on the quality of life(QOL)of university students.METHODS:This cross-sectional analytical study was conducted on university students using simple random sampling.Objective refraction,ocular alignment,vergence and accommodative performance were measured and assessed in all participants.Data on QOL were collected using the College of Optometrists in Vision Development-Quality of Life(COVD-QOL)Questionnaire.The effect of mentioned parameters on the QOL were evaluated.RESULTS:Totally 726 students with mean age of 21.35±1.88y were evaluated in this study,51.5%of whom were female.Esophoria was caused significantly lower QOL in the domains of somatic symptoms and occupationalphysical symptoms(P<0.05);Besides,esotropia decreased QOL in domains of somatic symptoms P=0.002 and psychological factors(P=0.023).Students with accommodation insufficiency experienced more symptoms in all domains(P<0.05)except for psychological factors(P=0.07).Increasing in the near point of convergence and accommodation and decreases QOL and increasing accommodative facility increases QOL(all P<0.05).Myopia and astigmatism cause decrease in QOL(both P<0.05),but hyperopic students had better QOL in comparison with others(P<0.05).CONCLUSION:Screening programs and treatment of refractive errors and binocular vision anomalies,especially phoria and accommodative insufficiency,positively impact the QOL and academic achievements of university students.展开更多
AIM:To investigate the frequency and associated factors of accommodation and non-strabismic binocular vision dysfunction among medical university students.METHODS:Totally 158 student volunteers underwent routine visio...AIM:To investigate the frequency and associated factors of accommodation and non-strabismic binocular vision dysfunction among medical university students.METHODS:Totally 158 student volunteers underwent routine vision examination in the optometry clinic of Guangxi Medical University.Their data were used to identify the different types of accommodation and nonstrabismic binocular vision dysfunction and to determine their frequency.Correlation analysis and logistic regression were used to examine the factors associated with these abnormalities.RESULTS:The results showed that 36.71%of the subjects had accommodation and non-strabismic binocular vision issues,with 8.86%being attributed to accommodation dysfunction and 27.85%to binocular abnormalities.Convergence insufficiency(CI)was the most common abnormality,accounting for 13.29%.Those with these abnormalities experienced higher levels of eyestrain(χ2=69.518,P<0.001).The linear correlations were observed between the difference of binocular spherical equivalent(SE)and the index of horizontal esotropia at a distance(r=0.231,P=0.004)and the asthenopia survey scale(ASS)score(r=0.346,P<0.001).Furthermore,the right eye's SE was inversely correlated with the convergence of positive and negative fusion images at close range(r=-0.321,P<0.001),the convergence of negative fusion images at close range(r=-0.294,P<0.001),the vergence facility(VF;r=-0.234,P=0.003),and the set of negative fusion images at far range(r=-0.237,P=0.003).Logistic regression analysis indicated that gender,age,and the difference in right and binocular SE did not influence the emergence of these abnormalities.CONCLUSION:Binocular vision abnormalities are more prevalent than accommodation dysfunction,with CI being the most frequent type.Greater binocular refractive disparity leads to more severe eyestrain symptoms.展开更多
Passive binocular measurement systems are being increasingly utilized in the in-situ industries of automobiles,aviation,and aerospace,etc.due to their excellent qualities of accuracy,efficiency,and cost performance.Wh...Passive binocular measurement systems are being increasingly utilized in the in-situ industries of automobiles,aviation,and aerospace,etc.due to their excellent qualities of accuracy,efficiency,and cost performance.Whereas the barrier of evaluating the accuracy of measured objects resulted from the unequal equivalent focal length and quantization of pixels,has limited their further development and application of high requirements for in-situ machining,e.g.,the measurement of machining reference points for the positioning of robotic drilling in aerospace manufacturing.In this paper,an accuracy evaluation method is proposed to address the problem.Firstly,the unequal equivalent focal length is considered to improve the accuracy of 3D reconstruction.Next,the credibility probability model is developed to calculate the probability of the observed error in the public view of the binocular measurement system and indicates the direction of improvement.Finally,the in-situ experiment is carried out to validate the method within the effective public view range of 300 mm×300 mm.The experiment results show that the RMSs of observed errors are superior to 0.035 mm,and the credibility probabilities are all higher than 0.91;the maximum 3D reconstruction accuracy improvement is 60.3%,with the error reduced from 0.078 mm to 0.031 mm.展开更多
AIM： To determine the presence of symptomatic accommodative and non-strabismic binocular dysfunctions （A.sBD） in a non-presbyopic population of video display unit （VDU） users with flat-panel displays. METHODS： ...AIM： To determine the presence of symptomatic accommodative and non-strabismic binocular dysfunctions （A.sBD） in a non-presbyopic population of video display unit （VDU） users with flat-panel displays. METHODS： One hundred and one VDU users, aged between 20 to 34y, initially participated in the study. This study excluded contact-lens wearers and subjects who had undergone refractive surgery or had any systemic or ocular disease. First, subjects were asked about the type and nature of eye symptoms they experienced during VDU use. Then, a thorough eye examination excluded those subjects with a significant uncorrected refractive error or other problem, such as ocular motility disorders, vertical deviation, strabismus and eye diseases. Finally, the remaining participants underwent an exhaustive assessment of their accommodative and binocular vision status. RESULTS： Eighty-nine VDU users （46 females and 43 males） were included in this study. They used flat-panel displays for an average of 5±1.9h a day. Twenty subjects presented A.sBD （22.5%）. Convergence excess was the most frequent non-strabismic binocular dysfunction （9 subjects）, followed by fusional vergence dysfunction （3 subjects） and convergence insufficiency （2 subjects）. Within the accommodative dysfunctions, accommodative excess was the most common （4 subjects）, followed by accommodative insufficiency （2 subjects）. Moderate to severe eye symptoms were found in 13 subjects with ANSBD. CONCLUSION： Significant eye symptoms in VDU users with accommodative and/or non-strabismic binocular dysfunctions often occur and should not be underestimated; therefore, an appropriate evaluation of accommodative and binocular vision status is more important for this population,展开更多
A stereo matching algorithm based on the epipolar line constraint is designed to meet the real-time and the accuracy requirements. The algorithm is applied to photodynamic therapy binocular surveillance system for por...A stereo matching algorithm based on the epipolar line constraint is designed to meet the real-time and the accuracy requirements. The algorithm is applied to photodynamic therapy binocular surveillance system for port wine stain （PWS） when it monitors the position of the treatment region. The corner matching based on Hu moments is used to calculate the fundamental matrix of the binocular vision system. Experimental results are in agreement with the theoretical calculation.展开更多
Cluster warhead has become the main ammunition of gun,rocket projectile and missile and it has been widely equipped in almost every country.More and more attention is paid to the damage effect of cluster warhead.The s...Cluster warhead has become the main ammunition of gun,rocket projectile and missile and it has been widely equipped in almost every country.More and more attention is paid to the damage effect of cluster warhead.The size of the dispersion area of cluster warhead is the main standard by which the damage effect of cluster warhead is estimated.The practical method of measuring the dispersion area was developed based on binocular stereo vision measurement theory.The calibration principle of the binocular stereo vision cameras was studied.The matching algorithm that relies on the gradient fields of the neighborhood of a pixel has been used to obtain the spatial information of matched points by acquiring apair of corresponding points in the left and right images of binocular cameras.The 3Dpositions of the flying path of cluster warhead were calculated.The umbrella that is similar to the dispersion track of static explosive cluster warhead was applied in the experiment to get the projection area of the umbrella on the ground.Experiment results verify the feasibility of the proposed method.展开更多
Current research of binocular vision systems mainly need to resolve the camera’s intrinsic parameters before the reconstruction of three-dimensional(3D)objects.The classical Zhang’calibration is hardly to calculate ...Current research of binocular vision systems mainly need to resolve the camera’s intrinsic parameters before the reconstruction of three-dimensional(3D)objects.The classical Zhang’calibration is hardly to calculate all errors caused by perspective distortion and lens distortion.Also,the image-matching algorithm of the binocular vision system still needs to be improved to accelerate the reconstruction speed of welding pool surfaces.In this paper,a preset coordinate system was utilized for camera calibration instead of Zhang’calibration.The binocular vision system was modified to capture images of welding pool surfaces by suppressing the strong arc interference during gas metal arc welding.Combining and improving the algorithms of speeded up robust features,binary robust invariant scalable keypoints,and KAZE,the feature information of points(i.e.,RGB values,pixel coordinates)was extracted as the feature vector of the welding pool surface.Based on the characteristics of the welding images,a mismatch-elimination algorithm was developed to increase the accuracy of image-matching algorithms.The world coordinates of matching feature points were calculated to reconstruct the 3D shape of the welding pool surface.The effectiveness and accuracy of the reconstruction of welding pool surfaces were verified by experimental results.This research proposes the development of binocular vision algorithms that can reconstruct the surface of welding pools accurately to realize intelligent welding control systems in the future.展开更多
An active stereo vision system based on a model of neural pathways of human binocular motor system is proposed. With this model, it is guaranteed that the two cameras of the active stereo vision system can keep their ...An active stereo vision system based on a model of neural pathways of human binocular motor system is proposed. With this model, it is guaranteed that the two cameras of the active stereo vision system can keep their lines of sight fixed on the same target object during smooth pursuit. This feature is very important for active stereo vision systems, since not only 3D reconstruction needs the two cameras have an overlapping field of vision, but also it can facilitate the 3D reconstruction algorithm. To evaluate the effectiveness of the proposed method, some software simulations are done to demonstrate the same target tracking characteristic in a virtual environment apt to mistracking easily. Here, mistracking means two eyes track two different objects separately. Then the proposed method is implemented in our active stereo vision system to perform real tracking task in a laboratory scene where several persons walk self-determining. Before the proposed model is implemented in the system, mistracking occurred frequently. After it is enabled, mistracking never occurred. The result shows that the vision system based on neural pathways of human binocular motor system can reliably avoid mistracking.展开更多
In order to improve the low positioning accuracy and execution efficiency of the robot binocular vision,a binocular vision positioning method based on coarse-fine stereo matching is proposed to achieve object position...In order to improve the low positioning accuracy and execution efficiency of the robot binocular vision,a binocular vision positioning method based on coarse-fine stereo matching is proposed to achieve object positioning.The random fern is used in the coarse matching to identify objects in the left and right images,and the pixel coordinates of the object center points in the two images are calculated to complete the center matching.In the fine matching,the right center point is viewed as an estimated value to set the search range of the right image,in which the region matching is implemented to find the best matched point of the left center point.Then,the similar triangle principle of the binocular vision model is used to calculate the 3D coordinates of the center point,achieving fast and accurate object positioning.Finally,the proposed method is applied to the object scene images and the robotic arm grasping platform.The experimental results show that the average absolute positioning error and average relative positioning error of the proposed method are 8.22 mm and 1.96%respectively when the object's depth distance is within 600 mm,the time consumption is less than 1.029s.The method can meet the needs of the robot grasping system,and has better accuracy and robustness.展开更多
BACKGROUND Medical robot is a promising surgical tool,but no specific one has been designed for interventional treatment of chronic pain.We developed a computed tomography-image based navigation robot using a new regi...BACKGROUND Medical robot is a promising surgical tool,but no specific one has been designed for interventional treatment of chronic pain.We developed a computed tomography-image based navigation robot using a new registration method with binocular vision.This kind of robot is appropriate for minimal invasive interventional procedures and easy to operate.The feasibility,accuracy and stability of this new robot need to be tested.AIM To assess quantitatively the feasibility,accuracy and stability of the binocularstereo-vision-based navigation robot for minimally invasive interventional procedures.METHODS A box model was designed for assessing the accuracy for targets at different distances.Nine(three sets)lead spheres were embedded in the model as puncture goals.The entry-to-target distances were set 50 mm(short-distance),100 mm(medium-distance)and 150 mm(long-distance).Puncture procedure was repeated three times for each goal.The Euclidian error of each puncture was calculated and statistically analyzed.Three head phantoms were used to explore the clinical feasibility and stability.Three independent operators conducted foramen ovale placement on head phantoms(both sides)by freehand or under the guidance of robot(18 punctures with each method).The operation time,adjustment time and one-time success rate were recorded,and the two guidancemethods were compared.RESULTS On the box model,the mean puncture errors of navigation robot were 1.7±0.9 mm for the short-distance target,2.4±1.0 mm for the moderate target and 4.4±1.4 mm for the long-distance target.On the head phantom,no obvious differences in operation time and adjustment time were found among the three performers(P>0.05).The median adjustment time was significantly less under the guidance of the robot than under free hand.The one-time success rate was significantly higher with the robot(P<0.05).There was no obvious difference in operation time between the two methods(P>0.05).CONCLUSION In the laboratory environment,accuracy of binocular-stereo-vision-based navigation robot is acceptable for target at 100 mm depth or less.Compared with freehand,foramen ovale placement accuracy can be improved with robot guidance.展开更多
AIM:To explore the effect of visual perception learning software training(VPT)on binocular visual function reconstruction in children with intermittent exotropia after strabismus surgery.METHODS:Ninety children with i...AIM:To explore the effect of visual perception learning software training(VPT)on binocular visual function reconstruction in children with intermittent exotropia after strabismus surgery.METHODS:Ninety children with intermittent exotropia admitted to our hospital from June 2018 to December 2018 were included,and randomly divided into VPT and control groups.Children in the control group received basic binocular vision training,while those in the VPT group received VPT after strabismus surgery.Tertiary visual function,visual perception function,Newcastle Control Score(NCS),and ocular position retraction rate were compared at 3 and 12mo after the surgery.RESULTS:At 3 and 12mo after the surgery,the proportion of simultaneous perception,binocular fusion version and binocular stereo vision in the VPT group was conspicuously higher than that in the control group(P<0.05).After the vision training,the binocular visual perception functions of children in both groups were significantly improved compared with that before training(P<0.05).Interestingly,the grating sharpness,texture perception and texture motion perception in the VPT group were dramatically better than control group(P<0.01).The NCS in the VPT group was significantly lower than that in the control group(P<0.05).The ocular position retraction rate in the VPT group was significantly lower than that in the control group at 12mo(8.89%vs 26.67%,P=0.03).CONCLUSION:VPT effectively promotes binocular visual function reconstruction in intermittent exotropia children after strabismus surgery and reduces the strabismus severity and ocular position retraction rate.展开更多
This paper presents a pure vision based technique for 3D reconstruction of planet terrain. The reconstruction accuracy depends ultimately on an optimization technique known as 'bundle adjustment'. In vision te...This paper presents a pure vision based technique for 3D reconstruction of planet terrain. The reconstruction accuracy depends ultimately on an optimization technique known as 'bundle adjustment'. In vision techniques, the translation is only known up to a scale factor, and a single scale factor is assumed for the whole sequence of images if only one camera is used. If an extra camera is available, stereo vision based reconstruction can be obtained by binocular views. If the baseline of the stereo setup is known, the scale factor problem is solved. We found that direct application of classical bundle adjustment on the constraints inherent between the binocular views has not been tested. Our method incorporated this constraint into the conventional bundle adjustment method. This special binocular bundle adjustment has been performed on image sequences similar to planet terrain circumstances. Experimental results show that our special method enhances not only the localization accuracy, but also the terrain mapping quality.展开更多
Aiming at achieving complex moving targets perception,this paper designs a novel fusion-information detection and tracking system for moving targets.The system includes three modules:target detection,target tracking a...Aiming at achieving complex moving targets perception,this paper designs a novel fusion-information detection and tracking system for moving targets.The system includes three modules:target detection,target tracking and trajectory prediction.The target detection module can detect fast moving objects which can be used as a template.The target tracking module tracks the object and records its historical position.Finally,the trajectory prediction module can predict the trajectory of the moving object based on the historical position.After verification by the table tennis detection tracking and prediction binocular vision system,the system has high accuracy and speed in detection and tracking,and can basically meet the actual application needs.展开更多
Propeller blade width measurement has been extensively studied in the past using direct and indirect methods, and it plays a great role in determining the quality of the finished products. It has surveyed that previou...Propeller blade width measurement has been extensively studied in the past using direct and indirect methods, and it plays a great role in determining the quality of the finished products. It has surveyed that previous techniques are usually time-consuming and erroneous due to a large number of points to be processed in blade width measurement. This paper proposes a new method of measuring blade width using two images acquired from different viewpoints of the same blade. And a new feature points matching approach for propeller blade image is proposed in stereo vision measurement. Based on these, pixel coordinates of contour points of the blade in two images are extracted and converted to real world coordinates by image algorithm and binocular stereo machine vision theory. Then, from the real world coordinates, the blade width at any position can be determined by simple geometrical method.展开更多
AIM： To determine the association between the binocular vision and an abnormal head posture（AHP）when watching television（TV） in children 7-14 y of age.·METHODS： Fifty normal children in the normal group and...AIM： To determine the association between the binocular vision and an abnormal head posture（AHP）when watching television（TV） in children 7-14 y of age.·METHODS： Fifty normal children in the normal group and 52 children with an AHP when watching TV in the AHP group were tested for spherical equivalents, far and near fusional convergence（FC） and fusional divergence（FD） amplitudes, near point of convergence, far and near heterophoria, accommodative convergence/accommodation ratio and stereoacuity. The values of these tests were compared between the two groups. The independent t test was applied at a confidence level of95%.·RESULTS： The far and near FC amplitudes and far FD amplitudes were lower in the AHP group（the far FC amplitudes： break point 13.6±5.4~△, recovery point 8.7±5.4~△.The near FC amplitudes： break point 14.5 ±7.3~△, recovery point 10. 3 ± 5. 1~△. The far FD amplitudes ： break point3.9±2.7~△, recovery point 2.6±2.3~△） compared with those in the normal group（the far FC amplitudes： break point19.1 ±6.2△, recovery point 12.4 ±4.5~△. The near FC amplitudes： break point 22.3 ±8.0~△, recovery point 16.1 ±5.7~△. The far FD amplitudes： break point 7.0 ±2.1~△,recovery point 4.6 ±1.9~△）. Other tests presented no statistically significant differences.·CONCLUSION： An association between the reduced FC and FD amplitudes and the AHP in children when watching TV is proposed in the study. This kind of AHP is considered to be an anomalous manifestation which appears in a part of puerile patients of fusional vergence dysfunction.展开更多
In this paper,we consider eyes from the human binocular system,that simultaneously gaze on stationary point targets in space,while optimalal skipping from one target to the next,by rotaing their individual gaze drecto...In this paper,we consider eyes from the human binocular system,that simultaneously gaze on stationary point targets in space,while optimalal skipping from one target to the next,by rotaing their individual gaze drecton.The head is assume fixed on the torso and the rotaing gaze direction of the two eyes are assumed restricted to pass through a point in the visual space.It is further assumed that,individullly the rotations of the two eyes satisfy the well known Listing's law.We formulate and study acombined optimal gaze rotation for the two eyes,by constructing a single Riemanmian metric,on the asociaced parameter space.The goal is to optimally rotate so that the convergent gaze changes between two pre-specified target points in a finite time interval[0,1].The cost function we choose is the total energy,measured by the L2?norm,of the six extenal torques on the binocular system.The torque functions are synthesized by solving an associated*two-point boundary value problem.The paper demonstrates,via simulation,the shape of the optimal gaze trajectory of the focused point of the bin-ocular system.The Euclidean distance between the initial and the final point is compared to the arc:length of the optimal trajectory.The consumed energy.is computed for diferent eye movement chores and discussed in the paper.Via simulation we observe that certain eye movement maneuvers are energy fficicnt and demonstrate that the optimal external torque is a linear function in time.We also explore and conclude that spitting an arbitry opimal eye movement into optimal vergence and version components is not energy fficient although this is how the human oculomotor control seems to operate.Opimal gaze tajectories and opimal extermal torque functions reported in this paper is new.展开更多
In nowadays society,the safety of the elderly population is becoming a pressing concern,especially for those who live alone.There might be daily risks such as accidental falling or treatment attack on them.Aiming at t...In nowadays society,the safety of the elderly population is becoming a pressing concern,especially for those who live alone.There might be daily risks such as accidental falling or treatment attack on them.Aiming at these problems,indoor positioning could be a critical way to monitor their states.With the rapidly development of the imaging techniques,wearable and portable cameras are very popular,which could be set on human individual.And in view of the advantages of the visual positioning,the authors propose a binocular visual positioning algorithm to real-timely locate the elderly indoor.In this paper,the imaging model has been established with the corrected image data from the binocular camera;then feature extraction has been completed to provide reference to adjacent image matching based on the binary robust independent elementary feature(BRIEF)descriptor,finally the camera movement and the states of the elderly have been estimated to distinguish their falling risk.In the experiments,the real-sense D435i sensors were adopted as the binocular cameras to obtain indoor images,and three experimental scenarios have been carried out to test the proposed method.The results show that the proposed algorithm can effectively locate the elderly indoor and improve the real-time monitoring capability.展开更多
基金Supported by Sichuan Science and Technology Program(2023YFSY0026,2023YFH0004)Supported by the Institute of Information&Communications Technology Planning&Evaluation(IITP)grant funded by the Korean government(MSIT)(No.RS-2022-00155885,Artificial Intelligence Convergence Innovation Human Resources Development(Hanyang University ERICA)).
文摘Two-dimensional endoscopic images are susceptible to interferences such as specular reflections and monotonous texture illumination,hindering accurate three-dimensional lesion reconstruction by surgical robots.This study proposes a novel end-to-end disparity estimation model to address these challenges.Our approach combines a Pseudo-Siamese neural network architecture with pyramid dilated convolutions,integrating multi-scale image information to enhance robustness against lighting interferences.This study introduces a Pseudo-Siamese structure-based disparity regression model that simplifies left-right image comparison,improving accuracy and efficiency.The model was evaluated using a dataset of stereo endoscopic videos captured by the Da Vinci surgical robot,comprising simulated silicone heart sequences and real heart video data.Experimental results demonstrate significant improvement in the network’s resistance to lighting interference without substantially increasing parameters.Moreover,the model exhibited faster convergence during training,contributing to overall performance enhancement.This study advances endoscopic image processing accuracy and has potential implications for surgical robot applications in complex environments.
基金the National Key Research and Development Program of China(No.2018YFB1305005)。
文摘Passive optical motion capture technology is an effective mean to conduct high-precision pose estimation of small scenes of mobile robots;nevertheless,in the case of complex background and stray light interference in the scene,due to the infuence of target adhesion and environmental reflection,this technology cannot estimate the pose accurately.A passive binocular optical motion capture technology under complex illumination based on binocular camera and fixed retroreflective marker balls has been proposed.By fixing multiple hemispherical retrorefective marker balls on a rigid base,it uses binocular camera for depth estimation to obtain the fixed position relationship between the feature points.After performing unsupervised state estimation without manual operation,it overcomes the infuence of refection spots in the background.Meanwhile,contour extraction and ellipse least square fitting are used to extract the marker balls with incomplete shape as the feature points,so as to solve the problem of target adhesion in the scene.A FANUC m10i-a robot moving with 6-DOF is used for verification using the above methods in a complex lighting environment of a welding laboratory.The result shows that the average of absolute position errors is 5.793mm,the average of absolute rotation errors is 1.997°the average of relative position errors is 0.972 mm,and the average of relative rotation errors is 0.002°.Therefore,this technology meets the requirements of high-precision measurement in a complex lighting environment when estimating the 6-DOF-motion mobile robot and has very significant application prospects in complex scenes.
基金Supported by Sichuan Science and Technology Program(No.23NSFSC0856).
文摘AIM:To evaluate the effect of femtosecond laser small incision lenticule extraction(SMILE)on the binocular visual function in myopic patients with glasses-free threedimensional(3D)technique.METHODS:Totally 50 myopic patients(39 females and 11 males)with SMILE were enrolled in this prospective study.The glasses-free 3D technique was used to evaluate the binocular visual function in these subjects including static stereopsis,dynamic stereopsis,foveal suppression,and binocular balance point of signal to noise ratio(s/n ratio).All subjects received measurements in 1d before operation,and 1d,1wk,and 1mo postoperatively.RESULTS:Both static and dynamic stereopsis showed no significant difference after SMILE.The foveal suppression improved significantly 1wk and 1mo after SMILE(P=0.005 and P=0.007 respectively).The binocular balance point of signal to noise ratio showed a significant improvement 1d,1wk and 1mo after SMILE for both eyes(P<0.001 for each eye respectively).CONCLUSION:Glasses-free 3D technique can be used to evaluate the effect of SMILE on the binocular visual function in myopic patients perceptively,and SMILE can improve both foveal suppression and binocular imbalance in these patients.
文摘AIM:To evaluate the effects of refractive errors and binocular vision anomalies on the quality of life(QOL)of university students.METHODS:This cross-sectional analytical study was conducted on university students using simple random sampling.Objective refraction,ocular alignment,vergence and accommodative performance were measured and assessed in all participants.Data on QOL were collected using the College of Optometrists in Vision Development-Quality of Life(COVD-QOL)Questionnaire.The effect of mentioned parameters on the QOL were evaluated.RESULTS:Totally 726 students with mean age of 21.35±1.88y were evaluated in this study,51.5%of whom were female.Esophoria was caused significantly lower QOL in the domains of somatic symptoms and occupationalphysical symptoms(P<0.05);Besides,esotropia decreased QOL in domains of somatic symptoms P=0.002 and psychological factors(P=0.023).Students with accommodation insufficiency experienced more symptoms in all domains(P<0.05)except for psychological factors(P=0.07).Increasing in the near point of convergence and accommodation and decreases QOL and increasing accommodative facility increases QOL(all P<0.05).Myopia and astigmatism cause decrease in QOL(both P<0.05),but hyperopic students had better QOL in comparison with others(P<0.05).CONCLUSION:Screening programs and treatment of refractive errors and binocular vision anomalies,especially phoria and accommodative insufficiency,positively impact the QOL and academic achievements of university students.
基金Supported by the Innovat ion and Entrepreneurship Project for College Students of the First Affiliated Hospital of Guangxi Medical University in 2022 and the Development and Application of Appropriate Medical and Health Technologies in Guangxi(No.S2021093).
文摘AIM:To investigate the frequency and associated factors of accommodation and non-strabismic binocular vision dysfunction among medical university students.METHODS:Totally 158 student volunteers underwent routine vision examination in the optometry clinic of Guangxi Medical University.Their data were used to identify the different types of accommodation and nonstrabismic binocular vision dysfunction and to determine their frequency.Correlation analysis and logistic regression were used to examine the factors associated with these abnormalities.RESULTS:The results showed that 36.71%of the subjects had accommodation and non-strabismic binocular vision issues,with 8.86%being attributed to accommodation dysfunction and 27.85%to binocular abnormalities.Convergence insufficiency(CI)was the most common abnormality,accounting for 13.29%.Those with these abnormalities experienced higher levels of eyestrain(χ2=69.518,P<0.001).The linear correlations were observed between the difference of binocular spherical equivalent(SE)and the index of horizontal esotropia at a distance(r=0.231,P=0.004)and the asthenopia survey scale(ASS)score(r=0.346,P<0.001).Furthermore,the right eye's SE was inversely correlated with the convergence of positive and negative fusion images at close range(r=-0.321,P<0.001),the convergence of negative fusion images at close range(r=-0.294,P<0.001),the vergence facility(VF;r=-0.234,P=0.003),and the set of negative fusion images at far range(r=-0.237,P=0.003).Logistic regression analysis indicated that gender,age,and the difference in right and binocular SE did not influence the emergence of these abnormalities.CONCLUSION:Binocular vision abnormalities are more prevalent than accommodation dysfunction,with CI being the most frequent type.Greater binocular refractive disparity leads to more severe eyestrain symptoms.
基金co-supported by the Key Technologies Research and Development Plan of China(No.2018YFA0703304)the National Science Fund for Distinguished Young Scholars,China(No.52125504)the Liaoning Revitalization Talents Program,China(Nos.XLYC1801008 and XLYC1807086)。
文摘Passive binocular measurement systems are being increasingly utilized in the in-situ industries of automobiles,aviation,and aerospace,etc.due to their excellent qualities of accuracy,efficiency,and cost performance.Whereas the barrier of evaluating the accuracy of measured objects resulted from the unequal equivalent focal length and quantization of pixels,has limited their further development and application of high requirements for in-situ machining,e.g.,the measurement of machining reference points for the positioning of robotic drilling in aerospace manufacturing.In this paper,an accuracy evaluation method is proposed to address the problem.Firstly,the unequal equivalent focal length is considered to improve the accuracy of 3D reconstruction.Next,the credibility probability model is developed to calculate the probability of the observed error in the public view of the binocular measurement system and indicates the direction of improvement.Finally,the in-situ experiment is carried out to validate the method within the effective public view range of 300 mm×300 mm.The experiment results show that the RMSs of observed errors are superior to 0.035 mm,and the credibility probabilities are all higher than 0.91;the maximum 3D reconstruction accuracy improvement is 60.3%,with the error reduced from 0.078 mm to 0.031 mm.
文摘AIM： To determine the presence of symptomatic accommodative and non-strabismic binocular dysfunctions （A.sBD） in a non-presbyopic population of video display unit （VDU） users with flat-panel displays. METHODS： One hundred and one VDU users, aged between 20 to 34y, initially participated in the study. This study excluded contact-lens wearers and subjects who had undergone refractive surgery or had any systemic or ocular disease. First, subjects were asked about the type and nature of eye symptoms they experienced during VDU use. Then, a thorough eye examination excluded those subjects with a significant uncorrected refractive error or other problem, such as ocular motility disorders, vertical deviation, strabismus and eye diseases. Finally, the remaining participants underwent an exhaustive assessment of their accommodative and binocular vision status. RESULTS： Eighty-nine VDU users （46 females and 43 males） were included in this study. They used flat-panel displays for an average of 5±1.9h a day. Twenty subjects presented A.sBD （22.5%）. Convergence excess was the most frequent non-strabismic binocular dysfunction （9 subjects）, followed by fusional vergence dysfunction （3 subjects） and convergence insufficiency （2 subjects）. Within the accommodative dysfunctions, accommodative excess was the most common （4 subjects）, followed by accommodative insufficiency （2 subjects）. Moderate to severe eye symptoms were found in 13 subjects with ANSBD. CONCLUSION： Significant eye symptoms in VDU users with accommodative and/or non-strabismic binocular dysfunctions often occur and should not be underestimated; therefore, an appropriate evaluation of accommodative and binocular vision status is more important for this population,
基金Supported by the National High Technology Research and Development Program of China("863"Program)(2007AA04Z231)~~
文摘A stereo matching algorithm based on the epipolar line constraint is designed to meet the real-time and the accuracy requirements. The algorithm is applied to photodynamic therapy binocular surveillance system for port wine stain （PWS） when it monitors the position of the treatment region. The corner matching based on Hu moments is used to calculate the fundamental matrix of the binocular vision system. Experimental results are in agreement with the theoretical calculation.
基金National Major Scientific Equipment Development Projects of China(No.2013YQ240803)Natural Science Foundation for Young Scientists of Shanxi Province(No.2012021011-1)Scientific and Technological Project in Shanxi Province(No.20140321010-02)
文摘Cluster warhead has become the main ammunition of gun,rocket projectile and missile and it has been widely equipped in almost every country.More and more attention is paid to the damage effect of cluster warhead.The size of the dispersion area of cluster warhead is the main standard by which the damage effect of cluster warhead is estimated.The practical method of measuring the dispersion area was developed based on binocular stereo vision measurement theory.The calibration principle of the binocular stereo vision cameras was studied.The matching algorithm that relies on the gradient fields of the neighborhood of a pixel has been used to obtain the spatial information of matched points by acquiring apair of corresponding points in the left and right images of binocular cameras.The 3Dpositions of the flying path of cluster warhead were calculated.The umbrella that is similar to the dispersion track of static explosive cluster warhead was applied in the experiment to get the projection area of the umbrella on the ground.Experiment results verify the feasibility of the proposed method.
基金Supported by National Natural Science Foundation of China(Grant No.51775313)Major Program of Shandong Province Natural Science Foundation(Grant No.ZR2018ZC1760)Young Scholars Program of Shandong University(Grant No.2017WLJH24).
文摘Current research of binocular vision systems mainly need to resolve the camera’s intrinsic parameters before the reconstruction of three-dimensional(3D)objects.The classical Zhang’calibration is hardly to calculate all errors caused by perspective distortion and lens distortion.Also,the image-matching algorithm of the binocular vision system still needs to be improved to accelerate the reconstruction speed of welding pool surfaces.In this paper,a preset coordinate system was utilized for camera calibration instead of Zhang’calibration.The binocular vision system was modified to capture images of welding pool surfaces by suppressing the strong arc interference during gas metal arc welding.Combining and improving the algorithms of speeded up robust features,binary robust invariant scalable keypoints,and KAZE,the feature information of points(i.e.,RGB values,pixel coordinates)was extracted as the feature vector of the welding pool surface.Based on the characteristics of the welding images,a mismatch-elimination algorithm was developed to increase the accuracy of image-matching algorithms.The world coordinates of matching feature points were calculated to reconstruct the 3D shape of the welding pool surface.The effectiveness and accuracy of the reconstruction of welding pool surfaces were verified by experimental results.This research proposes the development of binocular vision algorithms that can reconstruct the surface of welding pools accurately to realize intelligent welding control systems in the future.
文摘An active stereo vision system based on a model of neural pathways of human binocular motor system is proposed. With this model, it is guaranteed that the two cameras of the active stereo vision system can keep their lines of sight fixed on the same target object during smooth pursuit. This feature is very important for active stereo vision systems, since not only 3D reconstruction needs the two cameras have an overlapping field of vision, but also it can facilitate the 3D reconstruction algorithm. To evaluate the effectiveness of the proposed method, some software simulations are done to demonstrate the same target tracking characteristic in a virtual environment apt to mistracking easily. Here, mistracking means two eyes track two different objects separately. Then the proposed method is implemented in our active stereo vision system to perform real tracking task in a laboratory scene where several persons walk self-determining. Before the proposed model is implemented in the system, mistracking occurred frequently. After it is enabled, mistracking never occurred. The result shows that the vision system based on neural pathways of human binocular motor system can reliably avoid mistracking.
基金supported by National Natural Science Foundation of China(No.61125101)。
文摘In order to improve the low positioning accuracy and execution efficiency of the robot binocular vision,a binocular vision positioning method based on coarse-fine stereo matching is proposed to achieve object positioning.The random fern is used in the coarse matching to identify objects in the left and right images,and the pixel coordinates of the object center points in the two images are calculated to complete the center matching.In the fine matching,the right center point is viewed as an estimated value to set the search range of the right image,in which the region matching is implemented to find the best matched point of the left center point.Then,the similar triangle principle of the binocular vision model is used to calculate the 3D coordinates of the center point,achieving fast and accurate object positioning.Finally,the proposed method is applied to the object scene images and the robotic arm grasping platform.The experimental results show that the average absolute positioning error and average relative positioning error of the proposed method are 8.22 mm and 1.96%respectively when the object's depth distance is within 600 mm,the time consumption is less than 1.029s.The method can meet the needs of the robot grasping system,and has better accuracy and robustness.
基金Supported by Jiangsu Provincial Department of Science and Technology,No.BE2017603 and No.BE2017675。
文摘BACKGROUND Medical robot is a promising surgical tool,but no specific one has been designed for interventional treatment of chronic pain.We developed a computed tomography-image based navigation robot using a new registration method with binocular vision.This kind of robot is appropriate for minimal invasive interventional procedures and easy to operate.The feasibility,accuracy and stability of this new robot need to be tested.AIM To assess quantitatively the feasibility,accuracy and stability of the binocularstereo-vision-based navigation robot for minimally invasive interventional procedures.METHODS A box model was designed for assessing the accuracy for targets at different distances.Nine(three sets)lead spheres were embedded in the model as puncture goals.The entry-to-target distances were set 50 mm(short-distance),100 mm(medium-distance)and 150 mm(long-distance).Puncture procedure was repeated three times for each goal.The Euclidian error of each puncture was calculated and statistically analyzed.Three head phantoms were used to explore the clinical feasibility and stability.Three independent operators conducted foramen ovale placement on head phantoms(both sides)by freehand or under the guidance of robot(18 punctures with each method).The operation time,adjustment time and one-time success rate were recorded,and the two guidancemethods were compared.RESULTS On the box model,the mean puncture errors of navigation robot were 1.7±0.9 mm for the short-distance target,2.4±1.0 mm for the moderate target and 4.4±1.4 mm for the long-distance target.On the head phantom,no obvious differences in operation time and adjustment time were found among the three performers(P>0.05).The median adjustment time was significantly less under the guidance of the robot than under free hand.The one-time success rate was significantly higher with the robot(P<0.05).There was no obvious difference in operation time between the two methods(P>0.05).CONCLUSION In the laboratory environment,accuracy of binocular-stereo-vision-based navigation robot is acceptable for target at 100 mm depth or less.Compared with freehand,foramen ovale placement accuracy can be improved with robot guidance.
文摘AIM:To explore the effect of visual perception learning software training(VPT)on binocular visual function reconstruction in children with intermittent exotropia after strabismus surgery.METHODS:Ninety children with intermittent exotropia admitted to our hospital from June 2018 to December 2018 were included,and randomly divided into VPT and control groups.Children in the control group received basic binocular vision training,while those in the VPT group received VPT after strabismus surgery.Tertiary visual function,visual perception function,Newcastle Control Score(NCS),and ocular position retraction rate were compared at 3 and 12mo after the surgery.RESULTS:At 3 and 12mo after the surgery,the proportion of simultaneous perception,binocular fusion version and binocular stereo vision in the VPT group was conspicuously higher than that in the control group(P<0.05).After the vision training,the binocular visual perception functions of children in both groups were significantly improved compared with that before training(P<0.05).Interestingly,the grating sharpness,texture perception and texture motion perception in the VPT group were dramatically better than control group(P<0.01).The NCS in the VPT group was significantly lower than that in the control group(P<0.05).The ocular position retraction rate in the VPT group was significantly lower than that in the control group at 12mo(8.89%vs 26.67%,P=0.03).CONCLUSION:VPT effectively promotes binocular visual function reconstruction in intermittent exotropia children after strabismus surgery and reduces the strabismus severity and ocular position retraction rate.
基金the National Natural Science Foundation of China (Nos. 60505017 and 60534070)the Science Planning Project of Zhejiang Province, China (No. 2005C14008)
文摘This paper presents a pure vision based technique for 3D reconstruction of planet terrain. The reconstruction accuracy depends ultimately on an optimization technique known as 'bundle adjustment'. In vision techniques, the translation is only known up to a scale factor, and a single scale factor is assumed for the whole sequence of images if only one camera is used. If an extra camera is available, stereo vision based reconstruction can be obtained by binocular views. If the baseline of the stereo setup is known, the scale factor problem is solved. We found that direct application of classical bundle adjustment on the constraints inherent between the binocular views has not been tested. Our method incorporated this constraint into the conventional bundle adjustment method. This special binocular bundle adjustment has been performed on image sequences similar to planet terrain circumstances. Experimental results show that our special method enhances not only the localization accuracy, but also the terrain mapping quality.
基金the National Key Research and Development Program of China(2018YFB1305001)。
文摘Aiming at achieving complex moving targets perception,this paper designs a novel fusion-information detection and tracking system for moving targets.The system includes three modules:target detection,target tracking and trajectory prediction.The target detection module can detect fast moving objects which can be used as a template.The target tracking module tracks the object and records its historical position.Finally,the trajectory prediction module can predict the trajectory of the moving object based on the historical position.After verification by the table tennis detection tracking and prediction binocular vision system,the system has high accuracy and speed in detection and tracking,and can basically meet the actual application needs.
基金Supported by the Natural Science Foundation of China (50975133)the Innovative Foundation for Ph.D of the Jiangsu Province, China (2010-227)
文摘Propeller blade width measurement has been extensively studied in the past using direct and indirect methods, and it plays a great role in determining the quality of the finished products. It has surveyed that previous techniques are usually time-consuming and erroneous due to a large number of points to be processed in blade width measurement. This paper proposes a new method of measuring blade width using two images acquired from different viewpoints of the same blade. And a new feature points matching approach for propeller blade image is proposed in stereo vision measurement. Based on these, pixel coordinates of contour points of the blade in two images are extracted and converted to real world coordinates by image algorithm and binocular stereo machine vision theory. Then, from the real world coordinates, the blade width at any position can be determined by simple geometrical method.
基金Supported by the Scientific and Technological Project of Henan Scientific Committee(No.112102310193No.122102310132+2 种基金No.132102310132)the Key Scientific Research Project of Education Department of HenanProvince(No.12A320068)the Medical Science Research Project of Henan Province(No.201003112)
文摘AIM： To determine the association between the binocular vision and an abnormal head posture（AHP）when watching television（TV） in children 7-14 y of age.·METHODS： Fifty normal children in the normal group and 52 children with an AHP when watching TV in the AHP group were tested for spherical equivalents, far and near fusional convergence（FC） and fusional divergence（FD） amplitudes, near point of convergence, far and near heterophoria, accommodative convergence/accommodation ratio and stereoacuity. The values of these tests were compared between the two groups. The independent t test was applied at a confidence level of95%.·RESULTS： The far and near FC amplitudes and far FD amplitudes were lower in the AHP group（the far FC amplitudes： break point 13.6±5.4~△, recovery point 8.7±5.4~△.The near FC amplitudes： break point 14.5 ±7.3~△, recovery point 10. 3 ± 5. 1~△. The far FD amplitudes ： break point3.9±2.7~△, recovery point 2.6±2.3~△） compared with those in the normal group（the far FC amplitudes： break point19.1 ±6.2△, recovery point 12.4 ±4.5~△. The near FC amplitudes： break point 22.3 ±8.0~△, recovery point 16.1 ±5.7~△. The far FD amplitudes： break point 7.0 ±2.1~△,recovery point 4.6 ±1.9~△）. Other tests presented no statistically significant differences.·CONCLUSION： An association between the reduced FC and FD amplitudes and the AHP in children when watching TV is proposed in the study. This kind of AHP is considered to be an anomalous manifestation which appears in a part of puerile patients of fusional vergence dysfunction.
文摘In this paper,we consider eyes from the human binocular system,that simultaneously gaze on stationary point targets in space,while optimalal skipping from one target to the next,by rotaing their individual gaze drecton.The head is assume fixed on the torso and the rotaing gaze direction of the two eyes are assumed restricted to pass through a point in the visual space.It is further assumed that,individullly the rotations of the two eyes satisfy the well known Listing's law.We formulate and study acombined optimal gaze rotation for the two eyes,by constructing a single Riemanmian metric,on the asociaced parameter space.The goal is to optimally rotate so that the convergent gaze changes between two pre-specified target points in a finite time interval[0,1].The cost function we choose is the total energy,measured by the L2?norm,of the six extenal torques on the binocular system.The torque functions are synthesized by solving an associated*two-point boundary value problem.The paper demonstrates,via simulation,the shape of the optimal gaze trajectory of the focused point of the bin-ocular system.The Euclidean distance between the initial and the final point is compared to the arc:length of the optimal trajectory.The consumed energy.is computed for diferent eye movement chores and discussed in the paper.Via simulation we observe that certain eye movement maneuvers are energy fficicnt and demonstrate that the optimal external torque is a linear function in time.We also explore and conclude that spitting an arbitry opimal eye movement into optimal vergence and version components is not energy fficient although this is how the human oculomotor control seems to operate.Opimal gaze tajectories and opimal extermal torque functions reported in this paper is new.
基金This work was supported by the National Natural Science Foundation of China(No.61803203).
文摘In nowadays society,the safety of the elderly population is becoming a pressing concern,especially for those who live alone.There might be daily risks such as accidental falling or treatment attack on them.Aiming at these problems,indoor positioning could be a critical way to monitor their states.With the rapidly development of the imaging techniques,wearable and portable cameras are very popular,which could be set on human individual.And in view of the advantages of the visual positioning,the authors propose a binocular visual positioning algorithm to real-timely locate the elderly indoor.In this paper,the imaging model has been established with the corrected image data from the binocular camera;then feature extraction has been completed to provide reference to adjacent image matching based on the binary robust independent elementary feature(BRIEF)descriptor,finally the camera movement and the states of the elderly have been estimated to distinguish their falling risk.In the experiments,the real-sense D435i sensors were adopted as the binocular cameras to obtain indoor images,and three experimental scenarios have been carried out to test the proposed method.The results show that the proposed algorithm can effectively locate the elderly indoor and improve the real-time monitoring capability.
