In daily life,human need various senses to obtain information about their surroundings,and touch is one of the five major human sensing signals.Similarly,it is extremely important for robots to be endowed with tactile...In daily life,human need various senses to obtain information about their surroundings,and touch is one of the five major human sensing signals.Similarly,it is extremely important for robots to be endowed with tactile sensing ability.In recent years,vision-based tactile sensing technology has been the research hotspot and frontier in the field of tactile perception.Compared to conventional tactile sensing technologies,vision-based tactile sensing technologies are capable of obtaining highquality and high-resolution tactile information at a lower cost,while not being limited by the size and shape of sensors.Several previous articles have reviewed the sensing mechanism and electrical components of vision-based sensors,greatly promoting the innovation of tactile sensing.Different from existing reviews,this article concentrates on the underlying tracking method which converts real-time images into deformation information,including contact,sliding and friction.We will show the history and development of both model-based and model-free tracking methods,among which model-based approaches rely on schematic mechanical theories,and model-free approaches mainly involve machine learning algorithms.Comparing the efficiency and accuracy of existing deformation tracking methods,future research directions of vision-based tactile sensors for smart manipulations and robots are also discussed.展开更多
To improve the safety of construction workers and help workers remotely control humanoid robots in construc-tion,this study designs and implements a computer vision based virtual construction simulation system.For thi...To improve the safety of construction workers and help workers remotely control humanoid robots in construc-tion,this study designs and implements a computer vision based virtual construction simulation system.For this pur-pose,human skeleton motion data are collected using a Ki-nect depth camera,and the obtained data are optimized via abnormal data elimination,smoothing,and normalization.MediaPipe extracts three-dimensional hand motion coordi-nates for accurate human posture tracking.Blender is used to build a virtual worker and site model,and the virtual worker motion is controlled based on the quaternion inverse kinematics algorithm while limiting the joint angle to en-hance the authenticity of motion simulation.Experimental results show that the system frame rate is stable at 60 frame/s,end-to-end delay is less than 20 ms,and virtual task comple-tion time is close to the real scene,verifying its engineering applicability.The proposed system can drive virtual work-ers to perform tasks and provide technical support for con-struction safety training.展开更多
Vision-based air-to-air tracking of multi-UAV swarms is crucial for effective swarm perception.UAVs in a swarm typically share similar appearance features and exhibit nonlinear motion,as they are usually of the same t...Vision-based air-to-air tracking of multi-UAV swarms is crucial for effective swarm perception.UAVs in a swarm typically share similar appearance features and exhibit nonlinear motion,as they are usually of the same type.This homogeneity poses challenges for the existing multi-object tracking(MOT)algorithms,which often suffer performance degradation due to the difficulties in capturing instance-specific appearance and motion cues.In this paper,we propose a novel multiframe pose-attention-based appearance feature extraction component that captures instance-level pose features of UAVs across consecutive frames.Additionally,we introduce a motion difference accumulation strategy to extract spatial and motion cues from multiple adjacent frames.By combining these techniques,we design a multi-frame association framework that effectively distinguishes between similar UAVs in a swarm by leveraging object features over consecutive frames.To address the lack of relevant datasets,we create the AIRMOT dataset,specifically tailored for air-to-air tracking of homogeneous UAV swarms.Our method is evaluated on the AIRMOT dataset as well as the publicly available MOT-FLY and UAVSwarm datasets.The experimental results demonstrate that our approach outperforms other state-of-the-art(SOTA)methods,delivering superior tracking performance.展开更多
This article investigates the robust current tracking control problem of three-phase grid-connected inverters with LCL filter under external disturbance by a dynamic state feedback control method.First,this paper cons...This article investigates the robust current tracking control problem of three-phase grid-connected inverters with LCL filter under external disturbance by a dynamic state feedback control method.First,this paper constructs an internal model to learn the information of the states and input of the grid-connected inverter under steady state.Second,by utilizing the internal model principle,the paper turns the tracking control problem into the robust stabilization control problem based on some appropriate coordinate transformations.Then,The paper designs a dynamics state feedback control law to deal with this robust stabilization problem,and thus the solution of the robust current tracking control problem of three-phase grid-connected inverters can be obtained.This control method can ensure the asymptotic stability of the closedloop system.Finally,the paper illustrates the effectiveness of the proposed control approach through several groups of simulations,and compares it with the feedforward control method to verify the robustness of the proposed control method to uncertain parameters.展开更多
The focus of this paper is on distributed average tracking(DAT)in the context of external disturbances,utilizing an event-triggered control mechanism.First,an event-triggered anti-disturbance DAT(ETAD-DAT)algorithm is...The focus of this paper is on distributed average tracking(DAT)in the context of external disturbances,utilizing an event-triggered control mechanism.First,an event-triggered anti-disturbance DAT(ETAD-DAT)algorithm is proposed to reduce communication load in networked control systems by redesigning existing anti-disturbance DAT algorithms and disturbance observers.Furthermore,a fully distributed event-triggering condition is employed to schedule event times for each agent.Simulation results demonstrate that the proposed ETAD-DAT algorithm is able to achieve accurate average tracking of multiple time-varying reference signals despite the presence of external disturbances,while the communication efficiency can be improved obviously.展开更多
Understanding fish movement trajectories in aquaculture is essential for practical applications,such as disease warning,feeding optimization,and breeding management.These trajectories reveal key information about the ...Understanding fish movement trajectories in aquaculture is essential for practical applications,such as disease warning,feeding optimization,and breeding management.These trajectories reveal key information about the fish’s behavior,health,and environmental adaptability.However,when multi-object tracking(MOT)algorithms are applied to the high-density aquaculture environment,occlusion and overlapping among fish may result in missed detections,false detections,and identity switching problems,which limit the tracking accuracy.To address these issues,this paper proposes FishTracker,a MOT algorithm,by utilizing a Tracking-by-Detection framework.First,the neck part of the YOLOv8 model is enhanced by introducing a Multi-Scale Dilated Attention(MSDA)module to improve object localization and classification confidence.Second,an Adaptive Kalman Filter(AKF)is employed in the tracking phase to dynamically adjust motion prediction parameters,thereby overcoming target adhesion and nonlinear motion in complex scenarios.Experimental results show that FishTracker achieves a multi-object tracking accuracy(MOTA)of 93.22% and 87.24% in bright and dark illumination conditions,respectively.Further validation in a real aquaculture scenario reveal that FishTracker achieves aMOTA of 76.70%,which is 5.34% higher than the baselinemodel.The higher order tracking accuracy(HOTA)reaches 50.5%,which is 3.4% higher than the benchmark.In conclusion,FishTracker can provide reliable technical support for accurate tracking and behavioral analysis of high-density fish populations.展开更多
To address the issues of frequent identity switches(IDs)and degraded identification accuracy in multi object tracking(MOT)under complex occlusion scenarios,this study proposes an occlusion-robust tracking framework ba...To address the issues of frequent identity switches(IDs)and degraded identification accuracy in multi object tracking(MOT)under complex occlusion scenarios,this study proposes an occlusion-robust tracking framework based on face-pedestrian joint feature modeling.By constructing a joint tracking model centered on“intra-class independent tracking+cross-category dynamic binding”,designing a multi-modal matching metric with spatio-temporal and appearance constraints,and innovatively introducing a cross-category feature mutual verification mechanism and a dual matching strategy,this work effectively resolves performance degradation in traditional single-category tracking methods caused by short-term occlusion,cross-camera tracking,and crowded environments.Experiments on the Chokepoint_Face_Pedestrian_Track test set demonstrate that in complex scenes,the proposed method improves Face-Pedestrian Matching F1 area under the curve(F1 AUC)by approximately 4 to 43 percentage points compared to several traditional methods.The joint tracking model achieves overall performance metrics of IDF1:85.1825%and MOTA:86.5956%,representing improvements of 0.91 and 0.06 percentage points,respectively,over the baseline model.Ablation studies confirm the effectiveness of key modules such as the Intersection over Area(IoA)/Intersection over Union(IoU)joint metric and dynamic threshold adjustment,validating the significant role of the cross-category identity matching mechanism in enhancing tracking stability.Our_model shows a 16.7%frame per second(FPS)drop vs.fairness of detection and re-identification in multiple object tracking(FairMOT),with its cross-category binding module adding aboute 10%overhead,yet maintains near-real-time performance for essential face-pedestrian tracking at small resolutions.展开更多
Great Snipe(Gallinago media) is a shore bird which has a Near Threatened status on the global scale.However,little is known about its migration strategy from the breeding range in Russia.This study is the first one ai...Great Snipe(Gallinago media) is a shore bird which has a Near Threatened status on the global scale.However,little is known about its migration strategy from the breeding range in Russia.This study is the first one aiming to reveal migration routes,stopovers and wintering grounds of adult Great Snipes from their breeding range in Russia using GPS devices.We also analyzed connectivity of Great Snipes from different breeding populations of this species during non-breeding season.In 2021,we equipped seven males and three females with satellite transmitters,ICARUS Basic Tags,in the breeding range in central European Russia(56°75′N,37°65 E).One female appeared later in tundra of north-eastern Europe.In the second half of July to early September,birds migrated to Africa in a fairly wide front and made stopovers in Europe before crossing seas and the Sahara.Our data allowed to suppose high mortality of birds on migration,especially during the trans-Saharan flight.Only four Great Snipes reached Africa alive during southward migration.These birds spread over across wide area from Eritrea to Ghana after the trans-Saharan flight,after which they moved in a general westward direction and made final prolonged stopovers in Ghana or to the south of Chad Lake.In October/December birds relocated to wintering grounds in Sub-Equatorial Afrotropics as far as the south of Democratic Republic of the Congo and Zambia;with intermediate winter sites in low and middle reaches of the Congo Basin.Together with other published results,our data showed wide overlap of African non-breeding grounds of birds coming from lowland Eastern European and mountain Scandinavian breeding populations.The results also indicated insufficient conservation status of migration stopovers and wintering sites,used by Great Snipes,and demonstrated high importance of West Africa for conservation of this species.展开更多
Accurately estimating depth from underwater monocular images is essential for the target tracking task of unmanned underwater vehicles.This work proposes a method based on the Lpg-Lap Unet architecture.First,the Unet ...Accurately estimating depth from underwater monocular images is essential for the target tracking task of unmanned underwater vehicles.This work proposes a method based on the Lpg-Lap Unet architecture.First,the Unet architecture integrates Laplacian pyramid depth residuals and Sobel operators to improve the boundary details in depth images,which may suffer from the feature loss caused by upsampling and the blurriness of underwater images.Multiscale local planar guidance layers then fully exploit the intermediate depth features,and a comprehensive loss function ensures robustness and accuracy.Experimental results on benchmarks demonstrate the effectiveness of Lpg-Lap Unet and its superior performance over state-of-the-art models.An underwater target tracking system is then designed to further validate its real-time capabilities in the AirSim simulation platform.展开更多
Mobile service robots(MSRs)in hospital environments require precise and robust trajectory tracking to ensure reliable operation under dynamic conditions,including model uncertainties and external disturbances.This stu...Mobile service robots(MSRs)in hospital environments require precise and robust trajectory tracking to ensure reliable operation under dynamic conditions,including model uncertainties and external disturbances.This study presents a cognitive control strategy that integrates a Numerical Feedforward Inverse Dynamic Controller(NFIDC)with a Feedback Radial Basis Function Neural Network(FRBFNN).The robot’s mechanical structure was designed in SolidWorks 2022 SP2.0 and validated under operational loads using finite element analysis in ANSYS 2022 R1.The NFIDC-FRBFNN framework merges proactive inverse dynamic compensation with adaptive neural learning to achieve smooth torque responses and accurate motion control.A two-stage simulation evaluation was conducted.In the first stage,the controller was tested in a simulated hospital environment under both ideal and non-ideal conditions.In the second,it was benchmarked against four established controllers-Neural Network Model Reference Adaptive(NNMRA),Z-number Fuzzy Logic(Z-FL),Adaptive Dynamic Controller(ADC),and Fuzzy Logic-PID(FL-PID)—using circular and lemniscate trajectories.Across ten runs,the proposed controller achieved the lowest tracking errors under all conditions.Under ideal conditions,it achieved average improvements of 55.24%,75.75%,and 55.20%in integral absolute error(IAE),integral squared error(ISE),and mean absolute error(MAE),respectively,with coefficient of variation(CV)reductions above 55%.Under non-ideal conditions,average improvements exceeded 64%in IAE,77%in ISE,and 66%in MAE,while maintaining CV reductions above 57%.These results confirm that the NFIDC-FRBFNN controller offers superior accuracy,robustness,and consistency for real-time path tracking in healthcare robotics.展开更多
Controlling multiple multi-joint fish-like robots has long captivated the attention of engineers and biologists,for which a fundamental but challenging topic is to robustly track the postures of the individuals in rea...Controlling multiple multi-joint fish-like robots has long captivated the attention of engineers and biologists,for which a fundamental but challenging topic is to robustly track the postures of the individuals in real time.This requires detecting multiple robots,estimating multi-joint postures,and tracking identities,as well as processing fast in real time.To the best of our knowledge,this challenge has not been tackled in the previous studies.In this paper,to precisely track the planar postures of multiple swimming multi-joint fish-like robots in real time,we propose a novel deep neural network-based method,named TAB-IOL.Its TAB part fuses the top-down and bottom-up approaches for vision-based pose estimation,while the IOL part with long short-term memory considers the motion constraints among joints for precise pose tracking.The satisfying performance of our TAB-IOL is verified by testing on a group of freely swimming fish-like robots in various scenarios with strong disturbances and by a deed comparison of accuracy,speed,and robustness with most state-of-the-art algorithms.Further,based on the precise pose estimation and tracking realized by our TAB-IOL,several formation control experiments are conducted for the group of fish-like robots.The results clearly demonstrate that our TAB-IOL lays a solid foundation for the coordination control of multiple fish-like robots in a real working environment.We believe our proposed method will facilitate the growth and development of related fields.展开更多
This paper synchronizes control theory with computer vision by formalizing object tracking as a sequential decision-making process.A reinforcement learning(RL)agent successfully tracks an interface between two liquids...This paper synchronizes control theory with computer vision by formalizing object tracking as a sequential decision-making process.A reinforcement learning(RL)agent successfully tracks an interface between two liquids,which is often a critical variable to track in many chemical,petrochemical,metallurgical,and oil industries.This method utilizes less than 100 images for creating an environment,from which the agent generates its own data without the need for expert knowledge.Unlike supervised learning(SL)methods that rely on a huge number of parameters,this approach requires far fewer parameters,which naturally reduces its maintenance cost.Besides its frugal nature,the agent is robust to environmental uncertainties such as occlusion,intensity changes,and excessive noise.From a closed-loop control context,an interface location-based deviation is chosen as the optimization goal during training.The methodology showcases RL for real-time object-tracking applications in the oil sands industry.Along with a presentation of the interface tracking problem,this paper provides a detailed review of one of the most effective RL methodologies:actor–critic policy.展开更多
An important and challenging aspect of developing an intelligent transportation system is the identification of nighttime vehicles. Most accidents occur at night owing to the absence of night lighting conditions. Vehi...An important and challenging aspect of developing an intelligent transportation system is the identification of nighttime vehicles. Most accidents occur at night owing to the absence of night lighting conditions. Vehicle detection has become a vital subject for research to ensure safety and avoid accidents. New vision-based on-road nighttime vehicle detection and tracking system are suggested in this survey paper using taillight and headlight features. Using computer vision and some image processing techniques, the proposed system can identify vehicles based on taillight and headlight features. For vehicle tracking, a centroid tracking algorithm has been used. Euclidean Distance method has been used for measuring the distances between two neighboring objects and tracks the nearest neighbor. In the proposed system two flexible fixed Region of Interest (ROI) have been used, one is the Headlight ROI, and another is the Taillight ROI that could adapt to different resolutions of the images and videos. The achievement of this research work is that the proposed two ROIs can work simultaneously in a frame to identify oncoming and preceding vehicles at night. The segmentation techniques and double thresholding method have been used to extract the red and white components from the scene to identify the vehicle headlights and taillights. To evaluate the capability of the proposed process, two types of datasets have been used. Experimental findings indicate that the performance of the proposed technique is reliable and effective in distinct nighttime environments for detection and tracking of vehicles. The proposed method has been able to detect and track double lights as well as single light such as motorcycle light and achieved average accuracy and average processing time of vehicle detection about 97.22% and 0.01 s per frame respectively.展开更多
Atom tracking technology enhanced with innovative algorithms has been implemented in this study,utilizing a comprehensive suite of controllers and software independently developed domestically.Leveraging an on-board f...Atom tracking technology enhanced with innovative algorithms has been implemented in this study,utilizing a comprehensive suite of controllers and software independently developed domestically.Leveraging an on-board field-programmable gate array(FPGA)with a core frequency of 100 MHz,our system facilitates reading and writing operations across 16 channels,performing discrete incremental proportional-integral-derivative(PID)calculations within 3.4 microseconds.Building upon this foundation,gradient and extremum algorithms are further integrated,incorporating circular and spiral scanning modes with a horizontal movement accuracy of 0.38 pm.This integration enhances the real-time performance and significantly increases the accuracy of atom tracking.Atom tracking achieves an equivalent precision of at least 142 pm on a highly oriented pyrolytic graphite(HOPG)surface under room temperature atmospheric conditions.Through applying computer vision and image processing algorithms,atom tracking can be used when scanning a large area.The techniques primarily consist of two algorithms:the region of interest(ROI)-based feature matching algorithm,which achieves 97.92%accuracy,and the feature description-based matching algorithm,with an impressive 99.99%accuracy.Both implementation approaches have been tested for scanner drift measurements,and these technologies are scalable and applicable in various domains of scanning probe microscopy with broad application prospects in the field of nanoengineering.展开更多
Unmanned aerial vehicles(UAVs)have become crucial tools in moving target tracking due to their agility and ability to operate in complex,dynamic environments.UAVs must meet several requirements to achieve stable track...Unmanned aerial vehicles(UAVs)have become crucial tools in moving target tracking due to their agility and ability to operate in complex,dynamic environments.UAVs must meet several requirements to achieve stable tracking,including maintaining continuous target visibility amidst occlusions,ensuring flight safety,and achieving smooth trajectory planning.This paper reviews the latest advancements in UAV-based target tracking,highlighting information prediction,tracking strategies,and swarm cooperation.To address challenges including target visibility and occlusion,real-time prediction and tracking in dynamic environments,flight safety and coordination,resource management and energy efficiency,the paper identifies future research directions aimed at improving the performance,reliability,and scalability of UAV tracking system.展开更多
In the parallel steering coordination control strategy for path tracking,it is difficult to match the current driver steering model using the fixed parameters with the actual driver,and the designed steering coordinat...In the parallel steering coordination control strategy for path tracking,it is difficult to match the current driver steering model using the fixed parameters with the actual driver,and the designed steering coordination control strategy under a single objective and simple conditions is difficult to adapt to the multi-dimensional state variables’input.In this paper,we propose a deep reinforcement learning algorithm-based multi-objective parallel human-machine steering coordination strategy for path tracking considering driver misoperation and external disturbance.Firstly,the driver steering mathematical model is constructed based on the driver preview characteristics and steering delay response,and the driver characteristic parameters are fitted after collecting the actual driver driving data.Secondly,considering that the vehicle is susceptible to the influence of external disturbances during the driving process,the Tube MPC(Tube Model Predictive Control)based path tracking steering controller is designed based on the vehicle system dynamics error model.After verifying that the driver steering model meets the driver steering operation characteristics,DQN(Deep Q-network),DDPG(Deep Deterministic Policy Gradient)and TD3(Twin Delayed Deep Deterministic Policy Gradient)deep reinforcement learning algorithms are utilized to design a multi-objective parallel steering coordination strategy which satisfies the multi-dimensional state variables’input of the vehicle.Finally,the tracking accuracy,lateral safety,human-machine conflict and driver steering load evaluation index are designed in different driver operation states and different road environments,and the performance of the parallel steering coordination control strategies with different deep reinforcement learning algorithms and fuzzy algorithms are compared by simulations and hardware in the loop experiments.The results show that the parallel steering collaborative strategy based on a deep reinforcement learning algorithm can more effectively assist the driver in tracking the target path under lateral wind interference and driver misoperation,and the TD3-based coordination control strategy has better overall performance.展开更多
This paper studies the tracking control problem for stratospheric airships with userspecified performance.Dealing with the infinite gain phenomenon in the prescribed-time stability,a new stability criterion with bound...This paper studies the tracking control problem for stratospheric airships with userspecified performance.Dealing with the infinite gain phenomenon in the prescribed-time stability,a new stability criterion with bounded gain is proposed by using a new time-varying scaling function.Moreover,a same-side performance function and a novel barrier Lyapunov function are incorporated into the control algorithm,which can compress the feasible domain of tracking error to minimize the overshoot and solve the difficult in tracking error not converging to zero simultaneously.The proposed scheme guarantees the airship capable of operating autonomously with satisfactory transient performance and tracking accuracy,where the performance parameters can be designed artificially and link to the physical process directly.Finally,the effectiveness of the proposed control scheme is verified by theoretical analysis and numerical simulation.展开更多
This work proposes the application of an iterative learning model predictive control(ILMPC)approach based on an adaptive fault observer(FOBILMPC)for fault-tolerant control and trajectory tracking in air-breathing hype...This work proposes the application of an iterative learning model predictive control(ILMPC)approach based on an adaptive fault observer(FOBILMPC)for fault-tolerant control and trajectory tracking in air-breathing hypersonic vehicles.In order to increase the control amount,this online control legislation makes use of model predictive control(MPC)that is based on the concept of iterative learning control(ILC).By using offline data to decrease the linearized model’s faults,the strategy may effectively increase the robustness of the control system and guarantee that disturbances can be suppressed.An adaptive fault observer is created based on the suggested ILMPC approach in order to enhance overall fault tolerance by estimating and compensating for actuator disturbance and fault degree.During the derivation process,a linearized model of longitudinal dynamics is established.The suggested ILMPC approach is likely to be used in the design of hypersonic vehicle control systems since numerical simulations have demonstrated that it can decrease tracking error and speed up convergence when compared to the offline controller.展开更多
This paper investigates the challenges associated with Unmanned Aerial Vehicle (UAV) collaborative search and target tracking in dynamic and unknown environments characterized by limited field of view. The primary obj...This paper investigates the challenges associated with Unmanned Aerial Vehicle (UAV) collaborative search and target tracking in dynamic and unknown environments characterized by limited field of view. The primary objective is to explore the unknown environments to locate and track targets effectively. To address this problem, we propose a novel Multi-Agent Reinforcement Learning (MARL) method based on Graph Neural Network (GNN). Firstly, a method is introduced for encoding continuous-space multi-UAV problem data into spatial graphs which establish essential relationships among agents, obstacles, and targets. Secondly, a Graph AttenTion network (GAT) model is presented, which focuses exclusively on adjacent nodes, learns attention weights adaptively and allows agents to better process information in dynamic environments. Reward functions are specifically designed to tackle exploration challenges in environments with sparse rewards. By introducing a framework that integrates centralized training and distributed execution, the advancement of models is facilitated. Simulation results show that the proposed method outperforms the existing MARL method in search rate and tracking performance with less collisions. The experiments show that the proposed method can be extended to applications with a larger number of agents, which provides a potential solution to the challenging problem of multi-UAV autonomous tracking in dynamic unknown environments.展开更多
基金supported by the National Key Research and Development of China(Grant No.2022YFB3805700)the National Natural Science Foundation of China(Grant Nos.12122202 and 12372162)the Fundamental Research Funds for the Central Universities(Grant No.2024CX06021).
文摘In daily life,human need various senses to obtain information about their surroundings,and touch is one of the five major human sensing signals.Similarly,it is extremely important for robots to be endowed with tactile sensing ability.In recent years,vision-based tactile sensing technology has been the research hotspot and frontier in the field of tactile perception.Compared to conventional tactile sensing technologies,vision-based tactile sensing technologies are capable of obtaining highquality and high-resolution tactile information at a lower cost,while not being limited by the size and shape of sensors.Several previous articles have reviewed the sensing mechanism and electrical components of vision-based sensors,greatly promoting the innovation of tactile sensing.Different from existing reviews,this article concentrates on the underlying tracking method which converts real-time images into deformation information,including contact,sliding and friction.We will show the history and development of both model-based and model-free tracking methods,among which model-based approaches rely on schematic mechanical theories,and model-free approaches mainly involve machine learning algorithms.Comparing the efficiency and accuracy of existing deformation tracking methods,future research directions of vision-based tactile sensors for smart manipulations and robots are also discussed.
基金The Eighth National “Ten Thousand Talents Plan for Top Young Talents” of Chinathe National Natural Science Foundation of China (No. 52478117, 52378120)。
文摘To improve the safety of construction workers and help workers remotely control humanoid robots in construc-tion,this study designs and implements a computer vision based virtual construction simulation system.For this pur-pose,human skeleton motion data are collected using a Ki-nect depth camera,and the obtained data are optimized via abnormal data elimination,smoothing,and normalization.MediaPipe extracts three-dimensional hand motion coordi-nates for accurate human posture tracking.Blender is used to build a virtual worker and site model,and the virtual worker motion is controlled based on the quaternion inverse kinematics algorithm while limiting the joint angle to en-hance the authenticity of motion simulation.Experimental results show that the system frame rate is stable at 60 frame/s,end-to-end delay is less than 20 ms,and virtual task comple-tion time is close to the real scene,verifying its engineering applicability.The proposed system can drive virtual work-ers to perform tasks and provide technical support for con-struction safety training.
基金co-supported by the National Key Research and Development Program of China(No.2021YFF0601304)the National Natural Science Foundation of China(No.62206020)。
文摘Vision-based air-to-air tracking of multi-UAV swarms is crucial for effective swarm perception.UAVs in a swarm typically share similar appearance features and exhibit nonlinear motion,as they are usually of the same type.This homogeneity poses challenges for the existing multi-object tracking(MOT)algorithms,which often suffer performance degradation due to the difficulties in capturing instance-specific appearance and motion cues.In this paper,we propose a novel multiframe pose-attention-based appearance feature extraction component that captures instance-level pose features of UAVs across consecutive frames.Additionally,we introduce a motion difference accumulation strategy to extract spatial and motion cues from multiple adjacent frames.By combining these techniques,we design a multi-frame association framework that effectively distinguishes between similar UAVs in a swarm by leveraging object features over consecutive frames.To address the lack of relevant datasets,we create the AIRMOT dataset,specifically tailored for air-to-air tracking of homogeneous UAV swarms.Our method is evaluated on the AIRMOT dataset as well as the publicly available MOT-FLY and UAVSwarm datasets.The experimental results demonstrate that our approach outperforms other state-of-the-art(SOTA)methods,delivering superior tracking performance.
基金Supported by the Fundamental Research Funds for the Central Universities(2024ZYGXZR047)the National Natural Science Foundation of China(62373156)the Guangdong Basic and Applied Basic Research Foundation(2024A1515011736)。
文摘This article investigates the robust current tracking control problem of three-phase grid-connected inverters with LCL filter under external disturbance by a dynamic state feedback control method.First,this paper constructs an internal model to learn the information of the states and input of the grid-connected inverter under steady state.Second,by utilizing the internal model principle,the paper turns the tracking control problem into the robust stabilization control problem based on some appropriate coordinate transformations.Then,The paper designs a dynamics state feedback control law to deal with this robust stabilization problem,and thus the solution of the robust current tracking control problem of three-phase grid-connected inverters can be obtained.This control method can ensure the asymptotic stability of the closedloop system.Finally,the paper illustrates the effectiveness of the proposed control approach through several groups of simulations,and compares it with the feedforward control method to verify the robustness of the proposed control method to uncertain parameters.
基金part supported by the National Natural Science Foundation(62203034,62273126,62203035)the Ling-Yan Research and Development Project of Zhejiang Province of China(2023C03185)。
文摘The focus of this paper is on distributed average tracking(DAT)in the context of external disturbances,utilizing an event-triggered control mechanism.First,an event-triggered anti-disturbance DAT(ETAD-DAT)algorithm is proposed to reduce communication load in networked control systems by redesigning existing anti-disturbance DAT algorithms and disturbance observers.Furthermore,a fully distributed event-triggering condition is employed to schedule event times for each agent.Simulation results demonstrate that the proposed ETAD-DAT algorithm is able to achieve accurate average tracking of multiple time-varying reference signals despite the presence of external disturbances,while the communication efficiency can be improved obviously.
基金funded by the Fundamental Research Funds for the Central Universities(Grant No.106-YDZX2025022)the Startup Foundation of New Professor at Nanjing Agricultural University(Grant No.106-804005)the“Qing Lan Project”of Jiangsu Higher Education Institutions.
文摘Understanding fish movement trajectories in aquaculture is essential for practical applications,such as disease warning,feeding optimization,and breeding management.These trajectories reveal key information about the fish’s behavior,health,and environmental adaptability.However,when multi-object tracking(MOT)algorithms are applied to the high-density aquaculture environment,occlusion and overlapping among fish may result in missed detections,false detections,and identity switching problems,which limit the tracking accuracy.To address these issues,this paper proposes FishTracker,a MOT algorithm,by utilizing a Tracking-by-Detection framework.First,the neck part of the YOLOv8 model is enhanced by introducing a Multi-Scale Dilated Attention(MSDA)module to improve object localization and classification confidence.Second,an Adaptive Kalman Filter(AKF)is employed in the tracking phase to dynamically adjust motion prediction parameters,thereby overcoming target adhesion and nonlinear motion in complex scenarios.Experimental results show that FishTracker achieves a multi-object tracking accuracy(MOTA)of 93.22% and 87.24% in bright and dark illumination conditions,respectively.Further validation in a real aquaculture scenario reveal that FishTracker achieves aMOTA of 76.70%,which is 5.34% higher than the baselinemodel.The higher order tracking accuracy(HOTA)reaches 50.5%,which is 3.4% higher than the benchmark.In conclusion,FishTracker can provide reliable technical support for accurate tracking and behavioral analysis of high-density fish populations.
基金supported by the confidential research grant No.a8317。
文摘To address the issues of frequent identity switches(IDs)and degraded identification accuracy in multi object tracking(MOT)under complex occlusion scenarios,this study proposes an occlusion-robust tracking framework based on face-pedestrian joint feature modeling.By constructing a joint tracking model centered on“intra-class independent tracking+cross-category dynamic binding”,designing a multi-modal matching metric with spatio-temporal and appearance constraints,and innovatively introducing a cross-category feature mutual verification mechanism and a dual matching strategy,this work effectively resolves performance degradation in traditional single-category tracking methods caused by short-term occlusion,cross-camera tracking,and crowded environments.Experiments on the Chokepoint_Face_Pedestrian_Track test set demonstrate that in complex scenes,the proposed method improves Face-Pedestrian Matching F1 area under the curve(F1 AUC)by approximately 4 to 43 percentage points compared to several traditional methods.The joint tracking model achieves overall performance metrics of IDF1:85.1825%and MOTA:86.5956%,representing improvements of 0.91 and 0.06 percentage points,respectively,over the baseline model.Ablation studies confirm the effectiveness of key modules such as the Intersection over Area(IoA)/Intersection over Union(IoU)joint metric and dynamic threshold adjustment,validating the significant role of the cross-category identity matching mechanism in enhancing tracking stability.Our_model shows a 16.7%frame per second(FPS)drop vs.fairness of detection and re-identification in multiple object tracking(FairMOT),with its cross-category binding module adding aboute 10%overhead,yet maintains near-real-time performance for essential face-pedestrian tracking at small resolutions.
基金A support for different activities in the framework of this research was provided by Max Planck Institute of Animal Behavior,the Russian space agency (Roskosmos),German Aerospace Center and Institute for Geography of the Russian Academy of Sciences via International Cooperation for Animal Research Using Space as well as by NABU–The Nature and Biodiversity Conservation Union2021 was carried out as a joint project of Birds Russia and Manfred-Hermsen Stiftung+2 种基金funded under state assignments of the Severtsov Institute of Ecology and Evolution of the Russian Academy of Science (No. 0089-2021-0004, FFER-2024-0013No. 0089-2021-0010, FFER-2024-0022No. 1022040700480-0-1.6.15)。
文摘Great Snipe(Gallinago media) is a shore bird which has a Near Threatened status on the global scale.However,little is known about its migration strategy from the breeding range in Russia.This study is the first one aiming to reveal migration routes,stopovers and wintering grounds of adult Great Snipes from their breeding range in Russia using GPS devices.We also analyzed connectivity of Great Snipes from different breeding populations of this species during non-breeding season.In 2021,we equipped seven males and three females with satellite transmitters,ICARUS Basic Tags,in the breeding range in central European Russia(56°75′N,37°65 E).One female appeared later in tundra of north-eastern Europe.In the second half of July to early September,birds migrated to Africa in a fairly wide front and made stopovers in Europe before crossing seas and the Sahara.Our data allowed to suppose high mortality of birds on migration,especially during the trans-Saharan flight.Only four Great Snipes reached Africa alive during southward migration.These birds spread over across wide area from Eritrea to Ghana after the trans-Saharan flight,after which they moved in a general westward direction and made final prolonged stopovers in Ghana or to the south of Chad Lake.In October/December birds relocated to wintering grounds in Sub-Equatorial Afrotropics as far as the south of Democratic Republic of the Congo and Zambia;with intermediate winter sites in low and middle reaches of the Congo Basin.Together with other published results,our data showed wide overlap of African non-breeding grounds of birds coming from lowland Eastern European and mountain Scandinavian breeding populations.The results also indicated insufficient conservation status of migration stopovers and wintering sites,used by Great Snipes,and demonstrated high importance of West Africa for conservation of this species.
基金partially supported by the Natural Science Foundation of Shandong Province,China(No.ZR2023ME009)the National Natural Science Foundation of China(No.51909252)。
文摘Accurately estimating depth from underwater monocular images is essential for the target tracking task of unmanned underwater vehicles.This work proposes a method based on the Lpg-Lap Unet architecture.First,the Unet architecture integrates Laplacian pyramid depth residuals and Sobel operators to improve the boundary details in depth images,which may suffer from the feature loss caused by upsampling and the blurriness of underwater images.Multiscale local planar guidance layers then fully exploit the intermediate depth features,and a comprehensive loss function ensures robustness and accuracy.Experimental results on benchmarks demonstrate the effectiveness of Lpg-Lap Unet and its superior performance over state-of-the-art models.An underwater target tracking system is then designed to further validate its real-time capabilities in the AirSim simulation platform.
基金supported by the Malaysia Ministry of Higher Education under Fundamental Research Grant Scheme with Project Code:FRGS/1/2024/TK07/USM/02/3.
文摘Mobile service robots(MSRs)in hospital environments require precise and robust trajectory tracking to ensure reliable operation under dynamic conditions,including model uncertainties and external disturbances.This study presents a cognitive control strategy that integrates a Numerical Feedforward Inverse Dynamic Controller(NFIDC)with a Feedback Radial Basis Function Neural Network(FRBFNN).The robot’s mechanical structure was designed in SolidWorks 2022 SP2.0 and validated under operational loads using finite element analysis in ANSYS 2022 R1.The NFIDC-FRBFNN framework merges proactive inverse dynamic compensation with adaptive neural learning to achieve smooth torque responses and accurate motion control.A two-stage simulation evaluation was conducted.In the first stage,the controller was tested in a simulated hospital environment under both ideal and non-ideal conditions.In the second,it was benchmarked against four established controllers-Neural Network Model Reference Adaptive(NNMRA),Z-number Fuzzy Logic(Z-FL),Adaptive Dynamic Controller(ADC),and Fuzzy Logic-PID(FL-PID)—using circular and lemniscate trajectories.Across ten runs,the proposed controller achieved the lowest tracking errors under all conditions.Under ideal conditions,it achieved average improvements of 55.24%,75.75%,and 55.20%in integral absolute error(IAE),integral squared error(ISE),and mean absolute error(MAE),respectively,with coefficient of variation(CV)reductions above 55%.Under non-ideal conditions,average improvements exceeded 64%in IAE,77%in ISE,and 66%in MAE,while maintaining CV reductions above 57%.These results confirm that the NFIDC-FRBFNN controller offers superior accuracy,robustness,and consistency for real-time path tracking in healthcare robotics.
基金This work was supported in part by the National Natural Science Foundation of China(61973007,61633002).
文摘Controlling multiple multi-joint fish-like robots has long captivated the attention of engineers and biologists,for which a fundamental but challenging topic is to robustly track the postures of the individuals in real time.This requires detecting multiple robots,estimating multi-joint postures,and tracking identities,as well as processing fast in real time.To the best of our knowledge,this challenge has not been tackled in the previous studies.In this paper,to precisely track the planar postures of multiple swimming multi-joint fish-like robots in real time,we propose a novel deep neural network-based method,named TAB-IOL.Its TAB part fuses the top-down and bottom-up approaches for vision-based pose estimation,while the IOL part with long short-term memory considers the motion constraints among joints for precise pose tracking.The satisfying performance of our TAB-IOL is verified by testing on a group of freely swimming fish-like robots in various scenarios with strong disturbances and by a deed comparison of accuracy,speed,and robustness with most state-of-the-art algorithms.Further,based on the precise pose estimation and tracking realized by our TAB-IOL,several formation control experiments are conducted for the group of fish-like robots.The results clearly demonstrate that our TAB-IOL lays a solid foundation for the coordination control of multiple fish-like robots in a real working environment.We believe our proposed method will facilitate the growth and development of related fields.
文摘This paper synchronizes control theory with computer vision by formalizing object tracking as a sequential decision-making process.A reinforcement learning(RL)agent successfully tracks an interface between two liquids,which is often a critical variable to track in many chemical,petrochemical,metallurgical,and oil industries.This method utilizes less than 100 images for creating an environment,from which the agent generates its own data without the need for expert knowledge.Unlike supervised learning(SL)methods that rely on a huge number of parameters,this approach requires far fewer parameters,which naturally reduces its maintenance cost.Besides its frugal nature,the agent is robust to environmental uncertainties such as occlusion,intensity changes,and excessive noise.From a closed-loop control context,an interface location-based deviation is chosen as the optimization goal during training.The methodology showcases RL for real-time object-tracking applications in the oil sands industry.Along with a presentation of the interface tracking problem,this paper provides a detailed review of one of the most effective RL methodologies:actor–critic policy.
文摘An important and challenging aspect of developing an intelligent transportation system is the identification of nighttime vehicles. Most accidents occur at night owing to the absence of night lighting conditions. Vehicle detection has become a vital subject for research to ensure safety and avoid accidents. New vision-based on-road nighttime vehicle detection and tracking system are suggested in this survey paper using taillight and headlight features. Using computer vision and some image processing techniques, the proposed system can identify vehicles based on taillight and headlight features. For vehicle tracking, a centroid tracking algorithm has been used. Euclidean Distance method has been used for measuring the distances between two neighboring objects and tracks the nearest neighbor. In the proposed system two flexible fixed Region of Interest (ROI) have been used, one is the Headlight ROI, and another is the Taillight ROI that could adapt to different resolutions of the images and videos. The achievement of this research work is that the proposed two ROIs can work simultaneously in a frame to identify oncoming and preceding vehicles at night. The segmentation techniques and double thresholding method have been used to extract the red and white components from the scene to identify the vehicle headlights and taillights. To evaluate the capability of the proposed process, two types of datasets have been used. Experimental findings indicate that the performance of the proposed technique is reliable and effective in distinct nighttime environments for detection and tracking of vehicles. The proposed method has been able to detect and track double lights as well as single light such as motorcycle light and achieved average accuracy and average processing time of vehicle detection about 97.22% and 0.01 s per frame respectively.
基金Project supported by the National Science Fund for Distinguished Young Scholars(Grant No.T2125014)the Special Fund for Research on National Major Research Instruments of the National Natural Science Foundation of China(Grant No.11927808)the CAS Key Technology Research and Development Team Project(Grant No.GJJSTD20200005)。
文摘Atom tracking technology enhanced with innovative algorithms has been implemented in this study,utilizing a comprehensive suite of controllers and software independently developed domestically.Leveraging an on-board field-programmable gate array(FPGA)with a core frequency of 100 MHz,our system facilitates reading and writing operations across 16 channels,performing discrete incremental proportional-integral-derivative(PID)calculations within 3.4 microseconds.Building upon this foundation,gradient and extremum algorithms are further integrated,incorporating circular and spiral scanning modes with a horizontal movement accuracy of 0.38 pm.This integration enhances the real-time performance and significantly increases the accuracy of atom tracking.Atom tracking achieves an equivalent precision of at least 142 pm on a highly oriented pyrolytic graphite(HOPG)surface under room temperature atmospheric conditions.Through applying computer vision and image processing algorithms,atom tracking can be used when scanning a large area.The techniques primarily consist of two algorithms:the region of interest(ROI)-based feature matching algorithm,which achieves 97.92%accuracy,and the feature description-based matching algorithm,with an impressive 99.99%accuracy.Both implementation approaches have been tested for scanner drift measurements,and these technologies are scalable and applicable in various domains of scanning probe microscopy with broad application prospects in the field of nanoengineering.
基金financial support provided by the Natural Science Foundation of Hunan Province of China(Grant No.2021JJ10045)the Open Research Subject of State Key Laboratory of Intelligent Game(Grant No.ZBKF-24-01)+1 种基金the Postdoctoral Fellowship Program of CPSF(Grant No.GZB20240989)the China Postdoctoral Science Foundation(Grant No.2024M754304)。
文摘Unmanned aerial vehicles(UAVs)have become crucial tools in moving target tracking due to their agility and ability to operate in complex,dynamic environments.UAVs must meet several requirements to achieve stable tracking,including maintaining continuous target visibility amidst occlusions,ensuring flight safety,and achieving smooth trajectory planning.This paper reviews the latest advancements in UAV-based target tracking,highlighting information prediction,tracking strategies,and swarm cooperation.To address challenges including target visibility and occlusion,real-time prediction and tracking in dynamic environments,flight safety and coordination,resource management and energy efficiency,the paper identifies future research directions aimed at improving the performance,reliability,and scalability of UAV tracking system.
基金Supported by National Natural Science Foundation of China(Grant Nos.U22A20246,52372382)Hefei Municipal Natural Science Foundation(Grant No.2022008)+1 种基金the Open Fund of State Key Laboratory of Mechanical Behavior and System Safety of Traffic Engineering Structures(Grant No.KF2023-06)S&T Program of Hebei(Grant No.225676162GH).
文摘In the parallel steering coordination control strategy for path tracking,it is difficult to match the current driver steering model using the fixed parameters with the actual driver,and the designed steering coordination control strategy under a single objective and simple conditions is difficult to adapt to the multi-dimensional state variables’input.In this paper,we propose a deep reinforcement learning algorithm-based multi-objective parallel human-machine steering coordination strategy for path tracking considering driver misoperation and external disturbance.Firstly,the driver steering mathematical model is constructed based on the driver preview characteristics and steering delay response,and the driver characteristic parameters are fitted after collecting the actual driver driving data.Secondly,considering that the vehicle is susceptible to the influence of external disturbances during the driving process,the Tube MPC(Tube Model Predictive Control)based path tracking steering controller is designed based on the vehicle system dynamics error model.After verifying that the driver steering model meets the driver steering operation characteristics,DQN(Deep Q-network),DDPG(Deep Deterministic Policy Gradient)and TD3(Twin Delayed Deep Deterministic Policy Gradient)deep reinforcement learning algorithms are utilized to design a multi-objective parallel steering coordination strategy which satisfies the multi-dimensional state variables’input of the vehicle.Finally,the tracking accuracy,lateral safety,human-machine conflict and driver steering load evaluation index are designed in different driver operation states and different road environments,and the performance of the parallel steering coordination control strategies with different deep reinforcement learning algorithms and fuzzy algorithms are compared by simulations and hardware in the loop experiments.The results show that the parallel steering collaborative strategy based on a deep reinforcement learning algorithm can more effectively assist the driver in tracking the target path under lateral wind interference and driver misoperation,and the TD3-based coordination control strategy has better overall performance.
基金supported by the National Natural Science Foundation of China(Nos.51775021,52302511)the Fundamental Research Funds for the Central Universities,China(Nos.501JCGG2024129003,501JCGG2024129005,501JCGG2024129006),the Fundamental Research Funds for the Central Universities,China(No.YWF-24-JC-09)the National Key Research and Development Program of China(No.2018YFC1506401)。
文摘This paper studies the tracking control problem for stratospheric airships with userspecified performance.Dealing with the infinite gain phenomenon in the prescribed-time stability,a new stability criterion with bounded gain is proposed by using a new time-varying scaling function.Moreover,a same-side performance function and a novel barrier Lyapunov function are incorporated into the control algorithm,which can compress the feasible domain of tracking error to minimize the overshoot and solve the difficult in tracking error not converging to zero simultaneously.The proposed scheme guarantees the airship capable of operating autonomously with satisfactory transient performance and tracking accuracy,where the performance parameters can be designed artificially and link to the physical process directly.Finally,the effectiveness of the proposed control scheme is verified by theoretical analysis and numerical simulation.
基金supported by the National Natural Science Foundation of China(12072090).
文摘This work proposes the application of an iterative learning model predictive control(ILMPC)approach based on an adaptive fault observer(FOBILMPC)for fault-tolerant control and trajectory tracking in air-breathing hypersonic vehicles.In order to increase the control amount,this online control legislation makes use of model predictive control(MPC)that is based on the concept of iterative learning control(ILC).By using offline data to decrease the linearized model’s faults,the strategy may effectively increase the robustness of the control system and guarantee that disturbances can be suppressed.An adaptive fault observer is created based on the suggested ILMPC approach in order to enhance overall fault tolerance by estimating and compensating for actuator disturbance and fault degree.During the derivation process,a linearized model of longitudinal dynamics is established.The suggested ILMPC approach is likely to be used in the design of hypersonic vehicle control systems since numerical simulations have demonstrated that it can decrease tracking error and speed up convergence when compared to the offline controller.
基金supported by the National Natural Science Foundation of China(Nos.12272104,U22B2013).
文摘This paper investigates the challenges associated with Unmanned Aerial Vehicle (UAV) collaborative search and target tracking in dynamic and unknown environments characterized by limited field of view. The primary objective is to explore the unknown environments to locate and track targets effectively. To address this problem, we propose a novel Multi-Agent Reinforcement Learning (MARL) method based on Graph Neural Network (GNN). Firstly, a method is introduced for encoding continuous-space multi-UAV problem data into spatial graphs which establish essential relationships among agents, obstacles, and targets. Secondly, a Graph AttenTion network (GAT) model is presented, which focuses exclusively on adjacent nodes, learns attention weights adaptively and allows agents to better process information in dynamic environments. Reward functions are specifically designed to tackle exploration challenges in environments with sparse rewards. By introducing a framework that integrates centralized training and distributed execution, the advancement of models is facilitated. Simulation results show that the proposed method outperforms the existing MARL method in search rate and tracking performance with less collisions. The experiments show that the proposed method can be extended to applications with a larger number of agents, which provides a potential solution to the challenging problem of multi-UAV autonomous tracking in dynamic unknown environments.
