In order to solve the problem of small object size and low detection accuracy under the unmanned aerial vehicle(UAV)platform,the object detection algorithm based on deep aggregation network and high-resolution fusion ...In order to solve the problem of small object size and low detection accuracy under the unmanned aerial vehicle(UAV)platform,the object detection algorithm based on deep aggregation network and high-resolution fusion module is studied.Furthermore,a joint network of object detection and feature extraction is studied to construct a real-time multi-object tracking algorithm.For the problem of object association failure caused by UAV movement,image registration is applied to multi-object tracking and a camera motion discrimination model is proposed to improve the speed of the multi-object tracking algorithm.The simulation results show that the algorithm proposed in this study can improve the accuracy of multi-object tracking under the UAV platform,and effectively solve the problem of association failure caused by UAV movement.展开更多
Multi-object tracking(MOT)has seen rapid improvements in recent years.However,frequent occlusion remains a significant challenge in MOT,as it can cause targets to become smaller or disappear entirely,resulting in lowq...Multi-object tracking(MOT)has seen rapid improvements in recent years.However,frequent occlusion remains a significant challenge in MOT,as it can cause targets to become smaller or disappear entirely,resulting in lowquality targets,leading to trajectory interruptions and reduced tracking performance.Different from some existing methods,which discarded the low-quality targets or ignored low-quality target attributes.LQTTrack,with a lowquality association strategy(LQA),is proposed to pay more attention to low-quality targets.In the association scheme of LQTTrack,firstly,multi-scale feature fusion of FPN(MSFF-FPN)is utilized to enrich the feature information and assist in subsequent data association.Secondly,the normalized Wasserstein distance(NWD)is integrated to replace the original Inter over Union(IoU),thus overcoming the limitations of the traditional IoUbased methods that are sensitive to low-quality targets with small sizes and enhancing the robustness of low-quality target tracking.Moreover,the third association stage is proposed to improve the matching between the current frame’s low-quality targets and previously interrupted trajectories from earlier frames to reduce the problem of track fragmentation or error tracking,thereby increasing the association success rate and improving overall multi-object tracking performance.Extensive experimental results demonstrate the competitive performance of LQTTrack on benchmark datasets(MOT17,MOT20,and DanceTrack).展开更多
To cope with multi-object tracking under real-world complex situations, a new video-based method is proposed. In the detecting step, the moving objects are segmented with the third level DWT （discrete wavelet transfo...To cope with multi-object tracking under real-world complex situations, a new video-based method is proposed. In the detecting step, the moving objects are segmented with the third level DWT （discrete wavelet transform ）and background difference. In the tracking step, the Kalman filter and scale parameter are used first to estimate the object position and bounding box. Then, the center-association-based projection ratio and region-association-based occlusion ratio are defined and combined to judge object behaviours. Finally, the tracking scheme and Kalman parameters are adaptively adjusted according to object behaviour. Under occlusion, partial observability is utilized to obtain the object measurements and optimum box dimensions. This method is robust in tracking mobile objects under such situations as occlusion, new appearing and stablization, etc. Experimental results show that the proposed method is efficient.展开更多
Multi-object tracking(MOT) techniques have been increasingly applied in a diverse range of tasks. Unmanned aerial vehicle(UAV) is one of its typical application scenarios. Due to the scene complexity and the low resol...Multi-object tracking(MOT) techniques have been increasingly applied in a diverse range of tasks. Unmanned aerial vehicle(UAV) is one of its typical application scenarios. Due to the scene complexity and the low resolution of moving targets in UAV applications, it is difficult to extract target features and identify them. In order to solve this problem, we propose a new re-identification(re-ID) network to extract association features for tracking in the association stage. Moreover, in order to reduce the complexity of detection model, we perform the lightweight optimization for it. Experimental results show that the proposed re-ID network can effectively reduce the number of identity switches, and surpass current state-of-the-art algorithms. In the meantime, the optimized detector can increase the speed by 27% owing to its lightweight design, which enables it to further meet the requirements of UAV tracking tasks.展开更多
Pig farmers want to have an effective solution for automatically detecting and tracking multiple pigs and alerting their conditions in order to recognize disease risk factors quickly.In this paper,therefore,we propose...Pig farmers want to have an effective solution for automatically detecting and tracking multiple pigs and alerting their conditions in order to recognize disease risk factors quickly.In this paper,therefore,we propose a novel monitoring system using an Artificial Intelligence of Things(AIoT)technique combining artificial intelligence and Internet of Things(IoT).The proposed system consists of AIoT edge devices and a central monitoring server.First,an AIoT edge device extracts video frame images from a CCTV camera installed in a pig pen by a frame extraction method,detects multiple pigs in the images by a faster region-based convolutional neural network(RCNN)model,and tracks them by an object center-point tracking algorithm(OCTA)based on bounding box regression outputs of the faster RCNN.Finally,it sends multi-pig tracking images to the central monitoring server,which alerts them to pig farmers through a social networking service(SNS)agent in cooperation with an oneM2M-compliant IoT alerting method.Experimental results showed that the multi-pig tracking method achieved the multi-object tracking accuracy performance of about 77%.In addition,we verified alerting operation by confirming the images received in the SNS smartphone application.展开更多
In this study,a multi-object tracking(MOT)scheme based on a light detection and ranging sensor was proposed to overcome imprecise velocity observations in object occlusion scenarios.By applying real-time velocity esti...In this study,a multi-object tracking(MOT)scheme based on a light detection and ranging sensor was proposed to overcome imprecise velocity observations in object occlusion scenarios.By applying real-time velocity estimation,a modified unscented Kalman filter(UKF)was proposed for the state estimation of a target object.The proposed method can reduce the calculation cost by obviating unscented transformations.Additionally,combined with the advantages of a two-reference-point selection scheme based on a center point and a corner point,a reference point switching approach was introduced to improve tracking accuracy and consistency.The state estimation capability of the proposed UKF was verified by comparing it with the standard UKF in single-target tracking simulations.Moreover,the performance of the proposed MOT system was evaluated using real traffic datasets.展开更多
An approach to track multiple objects in crowded scenes with long-term partial occlusions is proposed. Tracking-by-detection is a successful strategy to address the task of tracking multiple objects in unconstrained s...An approach to track multiple objects in crowded scenes with long-term partial occlusions is proposed. Tracking-by-detection is a successful strategy to address the task of tracking multiple objects in unconstrained scenarios,but an obvious shortcoming of this method is that most information available in image sequences is simply ignored due to thresholding weak detection responses and applying non-maximum suppression. This paper proposes a multi-label conditional random field（ CRF） model which integrates the superpixel information and detection responses into a unified energy optimization framework to handle the task of tracking multiple targets. A key characteristic of the model is that the pairwise potential is constructed to enforce collision avoidance between objects,which can offer the advantage to improve the tracking performance in crowded scenes. Experiments on standard benchmark databases demonstrate that the proposed algorithm significantly outperforms the state-of-the-art tracking-by-detection methods.展开更多
A simple yet efficient tracking framework is proposed for real-time multi-object tracking with micro aerial vehicles(MAVs). It's basic missions for MAVs to detect specific targets and then track them automatically...A simple yet efficient tracking framework is proposed for real-time multi-object tracking with micro aerial vehicles(MAVs). It's basic missions for MAVs to detect specific targets and then track them automatically. In our method, candidate regions are generated using the salient detection in each frame and then classified by an eural network. A kernelized correlation filter(KCF) is employed to track each target until it disappears or the peak-sidelobe ratio is lower than a threshold. Besides, we define the birth and death of each tracker for the targets. The tracker is recycled if its target disappears and can be assigned to a new target. The algorithm is evaluated on the PAFISS and UAV123 datasets. The results show a good performance on both the tracking accuracy and speed.展开更多
Although the joint-detection-and-tracking paradigm has promoted the development of multi-object tracking(MOT)significantly,the long-term occlusion problem is still unsolved.After a period of trajectory inactivation du...Although the joint-detection-and-tracking paradigm has promoted the development of multi-object tracking(MOT)significantly,the long-term occlusion problem is still unsolved.After a period of trajectory inactivation due to occlusion,it is difficult to achieve trajectory reconnection with appearance features because they are no longer reliable.Although using motion cues does not suffer from occlusion,the commonly used Kalman Filter is also ineffective in its long-term inertia prediction in cases of no observation updates or wrong updates.Besides,occlusion is prone to cause multiple track-detection pairs to have close similarity scores during the data association phase.The direct use of the Hungarian algorithm to give the global optimal solution may generate the identity switching problem.In this paper,we propose the Long-term Spatio-Temporal Prediction(LSTP)module and the Ordered Association(OA)module to alleviate the occlusion problem in terms of motion prediction and data association,respectively.The LSTP module estimates the states of all tracked objects over time using a combination of spatial and temporal Transformers.The spatial Transformer models crowd interaction and learns the influence of neighbors,while the temporal Transformer models the temporal continuity of historical trajectories.Besides,the LSTP module also predicts the visibilities of the motion prediction boxes,which denote the occlusion attributes of trajectories.Based on the occlusion attribute and active state,the association priority is defined in the OA module to associate trajectories in order,which helps to alleviate the identity switching problem.Comprehensive experiments on the MOT17 and MOT20 benchmarks indicate the superiority of the proposed MOT framework,namely Occlusion-Robust Tracker(ORT).Without using any appearance information,our ORT can achieve competitive performance beyond other state-of-the-art trackers in terms of trajectory accuracy and purity.展开更多
Purpose-With the rapid advancement of China’s high-speed rail network,the density of train operations is on the rise.To address the challenge of shortening train tracking intervals while enhancing transportation effi...Purpose-With the rapid advancement of China’s high-speed rail network,the density of train operations is on the rise.To address the challenge of shortening train tracking intervals while enhancing transportation efficiency,the multi-objective dynamic optimization of the train operation process has emerged as a critical issue.Design/methodology/approach-Train dynamic model is established by analyzing the force of the train in the process of tracing operation.The train tracing operation model is established according to the dynamic mechanical model of the train tracking process,and the dynamic optimization analysis is carried out with comfort,energy saving and punctuality as optimization objectives.To achieve multi-objective dynamic optimization,a novel train tracking operation calculation method is proposed,utilizing the improved grey wolf optimization algorithm(MOGWO).The proposed method is simulated and verified based on the train characteristics and line data of CR400AF electric multiple units.Findings-The simulation results prove that the optimized MOGWO algorithm can be computed quickly during train tracks,the optimum results can be given within 5s and the algorithm can converge effectively in different optimization target directions.The optimized speed profile of the MOGWO algorithm is smoother and more stable and meets the target requirements of energy saving,punctuality and comfort while maximally respecting the speed limit profile.Originality/value-The MOGWO train tracking interval optimization method enhances the tracking process while ensuring a safe tracking interval.This approach enables the trailing train to operate more comfortably,energy-efficiently and punctually,aligning with passenger needs and industry trends.The method offers valuable insights for optimizing the high-speed train tracking process.展开更多
In the parallel steering coordination control strategy for path tracking,it is difficult to match the current driver steering model using the fixed parameters with the actual driver,and the designed steering coordinat...In the parallel steering coordination control strategy for path tracking,it is difficult to match the current driver steering model using the fixed parameters with the actual driver,and the designed steering coordination control strategy under a single objective and simple conditions is difficult to adapt to the multi-dimensional state variables’input.In this paper,we propose a deep reinforcement learning algorithm-based multi-objective parallel human-machine steering coordination strategy for path tracking considering driver misoperation and external disturbance.Firstly,the driver steering mathematical model is constructed based on the driver preview characteristics and steering delay response,and the driver characteristic parameters are fitted after collecting the actual driver driving data.Secondly,considering that the vehicle is susceptible to the influence of external disturbances during the driving process,the Tube MPC(Tube Model Predictive Control)based path tracking steering controller is designed based on the vehicle system dynamics error model.After verifying that the driver steering model meets the driver steering operation characteristics,DQN(Deep Q-network),DDPG(Deep Deterministic Policy Gradient)and TD3(Twin Delayed Deep Deterministic Policy Gradient)deep reinforcement learning algorithms are utilized to design a multi-objective parallel steering coordination strategy which satisfies the multi-dimensional state variables’input of the vehicle.Finally,the tracking accuracy,lateral safety,human-machine conflict and driver steering load evaluation index are designed in different driver operation states and different road environments,and the performance of the parallel steering coordination control strategies with different deep reinforcement learning algorithms and fuzzy algorithms are compared by simulations and hardware in the loop experiments.The results show that the parallel steering collaborative strategy based on a deep reinforcement learning algorithm can more effectively assist the driver in tracking the target path under lateral wind interference and driver misoperation,and the TD3-based coordination control strategy has better overall performance.展开更多
Multiple Object Tracking(MOT)is essential for applications such as autonomous driving,surveillance,and analytics;However,challenges such as occlusion,low-resolution imaging,and identity switches remain persistent.We p...Multiple Object Tracking(MOT)is essential for applications such as autonomous driving,surveillance,and analytics;However,challenges such as occlusion,low-resolution imaging,and identity switches remain persistent.We propose HAMOT,a hierarchical adaptive multi-object tracker that solves these challenges with a novel,unified framework.Unlike previous methods that rely on isolated components,HAMOT incorporates a Swin Transformer-based Adaptive Enhancement(STAE)module—comprising Scene-Adaptive Transformer Enhancement and Confidence-Adaptive Feature Refinement—to improve detection under low-visibility conditions.The hierarchical DynamicGraphNeuralNetworkwith TemporalAttention(DGNN-TA)models both short-and long-termassociations,and the Adaptive Unscented Kalman Filter with Gated Recurrent Unit(AUKF-GRU)ensures accurate motion prediction.The novel Graph-Based Density-Aware Clustering(GDAC)improves occlusion recovery by adapting to scene density,preserving identity integrity.This integrated approach enables adaptive responses to complex visual scenarios,Achieving exceptional performance across all evaluation metrics,including aHigher Order TrackingAccuracy(HOTA)of 67.05%,a Multiple Object Tracking Accuracy(MOTA)of 82.4%,an ID F1 Score(IDF1)of 83.1%,and a total of 1052 Identity Switches(IDSW)on theMOT17;66.61%HOTA,78.3%MOTA,82.1%IDF1,and a total of 748 IDSWonMOT20;and 66.4%HOTA,92.32%MOTA,and 68.96%IDF1 on DanceTrack.With fixed thresholds,the full HAMOT model(all six components)achieves real-time functionality at 24 FPS on MOT17 using RTX3090,ensuring robustness and scalability for real-world MOT applications.展开更多
To address the issues of frequent identity switches(IDs)and degraded identification accuracy in multi object tracking(MOT)under complex occlusion scenarios,this study proposes an occlusion-robust tracking framework ba...To address the issues of frequent identity switches(IDs)and degraded identification accuracy in multi object tracking(MOT)under complex occlusion scenarios,this study proposes an occlusion-robust tracking framework based on face-pedestrian joint feature modeling.By constructing a joint tracking model centered on“intra-class independent tracking+cross-category dynamic binding”,designing a multi-modal matching metric with spatio-temporal and appearance constraints,and innovatively introducing a cross-category feature mutual verification mechanism and a dual matching strategy,this work effectively resolves performance degradation in traditional single-category tracking methods caused by short-term occlusion,cross-camera tracking,and crowded environments.Experiments on the Chokepoint_Face_Pedestrian_Track test set demonstrate that in complex scenes,the proposed method improves Face-Pedestrian Matching F1 area under the curve(F1 AUC)by approximately 4 to 43 percentage points compared to several traditional methods.The joint tracking model achieves overall performance metrics of IDF1:85.1825%and MOTA:86.5956%,representing improvements of 0.91 and 0.06 percentage points,respectively,over the baseline model.Ablation studies confirm the effectiveness of key modules such as the Intersection over Area(IoA)/Intersection over Union(IoU)joint metric and dynamic threshold adjustment,validating the significant role of the cross-category identity matching mechanism in enhancing tracking stability.Our_model shows a 16.7%frame per second(FPS)drop vs.fairness of detection and re-identification in multiple object tracking(FairMOT),with its cross-category binding module adding aboute 10%overhead,yet maintains near-real-time performance for essential face-pedestrian tracking at small resolutions.展开更多
Multi-Object Tracking(MOT)represents a fundamental but computationally demanding task in computer vision,with particular challenges arising in occluded and densely populated environments.While contemporary tracking sy...Multi-Object Tracking(MOT)represents a fundamental but computationally demanding task in computer vision,with particular challenges arising in occluded and densely populated environments.While contemporary tracking systems have demonstrated considerable progress,persistent limitations—notably frequent occlusion-induced identity switches and tracking inaccuracies—continue to impede reliable real-world deployment.This work introduces an advanced tracking framework that enhances association robustness through a two-stage matching paradigm combining spatial and appearance features.Proposed framework employs:(1)a Height Modulated and Scale Adaptive Spatial Intersection-over-Union(HMSIoU)metric for improved spatial correspondence estimation across variable object scales and partial occlusions;(2)a feature extraction module generating discriminative appearance descriptors for identity maintenance;and(3)a recovery association mechanism for refining matches between unassociated tracks and detections.Comprehensive evaluation on standard MOT17 and MOT20 benchmarks demonstrates significant improvements in tracking consistency,with state-of-the-art performance across key metrics including HOTA(64),MOTA(80.7),IDF1(79.8),and IDs(1379).These results substantiate the efficacy of our Cue-Tracker framework in complex real-world scenarios characterized by occlusions and crowd interactions.展开更多
This paper investigates the challenges associated with Unmanned Aerial Vehicle (UAV) collaborative search and target tracking in dynamic and unknown environments characterized by limited field of view. The primary obj...This paper investigates the challenges associated with Unmanned Aerial Vehicle (UAV) collaborative search and target tracking in dynamic and unknown environments characterized by limited field of view. The primary objective is to explore the unknown environments to locate and track targets effectively. To address this problem, we propose a novel Multi-Agent Reinforcement Learning (MARL) method based on Graph Neural Network (GNN). Firstly, a method is introduced for encoding continuous-space multi-UAV problem data into spatial graphs which establish essential relationships among agents, obstacles, and targets. Secondly, a Graph AttenTion network (GAT) model is presented, which focuses exclusively on adjacent nodes, learns attention weights adaptively and allows agents to better process information in dynamic environments. Reward functions are specifically designed to tackle exploration challenges in environments with sparse rewards. By introducing a framework that integrates centralized training and distributed execution, the advancement of models is facilitated. Simulation results show that the proposed method outperforms the existing MARL method in search rate and tracking performance with less collisions. The experiments show that the proposed method can be extended to applications with a larger number of agents, which provides a potential solution to the challenging problem of multi-UAV autonomous tracking in dynamic unknown environments.展开更多
This work proposes the application of an iterative learning model predictive control(ILMPC)approach based on an adaptive fault observer(FOBILMPC)for fault-tolerant control and trajectory tracking in air-breathing hype...This work proposes the application of an iterative learning model predictive control(ILMPC)approach based on an adaptive fault observer(FOBILMPC)for fault-tolerant control and trajectory tracking in air-breathing hypersonic vehicles.In order to increase the control amount,this online control legislation makes use of model predictive control(MPC)that is based on the concept of iterative learning control(ILC).By using offline data to decrease the linearized model’s faults,the strategy may effectively increase the robustness of the control system and guarantee that disturbances can be suppressed.An adaptive fault observer is created based on the suggested ILMPC approach in order to enhance overall fault tolerance by estimating and compensating for actuator disturbance and fault degree.During the derivation process,a linearized model of longitudinal dynamics is established.The suggested ILMPC approach is likely to be used in the design of hypersonic vehicle control systems since numerical simulations have demonstrated that it can decrease tracking error and speed up convergence when compared to the offline controller.展开更多
To realize effective co-phasing adjustment in large-aperture sparse-aperture telescopes,a multichannel stripe tracking approach is employed,allowing simultaneous interferometric measurements of multiple optical paths ...To realize effective co-phasing adjustment in large-aperture sparse-aperture telescopes,a multichannel stripe tracking approach is employed,allowing simultaneous interferometric measurements of multiple optical paths and circumventing the need for pairwise measurements along the mirror boundaries in traditional interferometric methods.This approach enhances detection efficiency and reduces system complexity.Here,the principles of the multibeam interference process and construction of a co-phasing detection module based on direct optical fiber connections were analyzed using wavefront optics theory.Error analysis was conducted on the system surface obtained through multipath interference.Potential applications of the interferometric method were explored.Finally,the principle was verified by experiment,an interferometric fringe contrast better than 0.4 is achieved through flat field calibration and incoherent digital synthesis.The dynamic range of the measurement exceeds 10 times of the center wavelength of the working band(1550 nm).Moreover,a resolution better than one-tenth of the working center wavelength(1550 nm)was achieved.Simultaneous three-beam interference can be achieved,leading to a 50%improvement in detection efficiency.This method can effectively enhance the efficiency of sparse aperture telescope co-phasing,meeting the requirements for observations of 8-10 m telescopes.This study provides a technological foundation for observing distant and faint celestial objects.展开更多
Unmanned aerial vehicles(UAVs)have become crucial tools in moving target tracking due to their agility and ability to operate in complex,dynamic environments.UAVs must meet several requirements to achieve stable track...Unmanned aerial vehicles(UAVs)have become crucial tools in moving target tracking due to their agility and ability to operate in complex,dynamic environments.UAVs must meet several requirements to achieve stable tracking,including maintaining continuous target visibility amidst occlusions,ensuring flight safety,and achieving smooth trajectory planning.This paper reviews the latest advancements in UAV-based target tracking,highlighting information prediction,tracking strategies,and swarm cooperation.To address challenges including target visibility and occlusion,real-time prediction and tracking in dynamic environments,flight safety and coordination,resource management and energy efficiency,the paper identifies future research directions aimed at improving the performance,reliability,and scalability of UAV tracking system.展开更多
Unlike ensemble-averaging measurements,single-molecule tracking provides quantitative information on the kinetics of individual molecules within living cells in real time and may provide insight into the respective mo...Unlike ensemble-averaging measurements,single-molecule tracking provides quantitative information on the kinetics of individual molecules within living cells in real time and may provide insight into the respective molecular interactions behind that.The advancement of single-molecule tracking has been signi-cantly boosted by the development of high-resolution microscopy techniques.In this review,we will discuss this aspect with a particular focus on their recent advance in MINFLUX nanoscopy with feedback approaches where tracking is performed in real time.MINFLUX localization requires fewer than 100 photons from a-1 nm-sized°uorophore,enabling precise tracking.This approach,which demands over an order of magnitude fewer photons than other localization-based techniques(such as STORM,PLAM),allows molecular tracking with single-digit nanometer accuracy in less than 1 ms—an achievement previously unattainable.展开更多
Background:Early identification of concussion-related vision disorders(CRVDs)may improve outcomes by enabling earlier management,referral,and treatment.Objective eye tracking may provide additional data to support the...Background:Early identification of concussion-related vision disorders(CRVDs)may improve outcomes by enabling earlier management,referral,and treatment.Objective eye tracking may provide additional data to support the diagnose of CRVDs.The purpose of this study was to determine the utility of objective infrared eye tracking in identifying CRVDs among adolescents experiencing persisting post-concussive symptoms(PPCS)more than 28 days after injury.Methods:This was a prospective study of adolescents with PPCS evaluated with visio-vestibular examination(VVE),comprehensive vision examination,and an eye tracking device.Results:Of the 108 adolescents enrolled,67(62%)were diagnosed with a CRVD by comprehensive vision examination.On VVE,the near point of convergence break(5.5±3.2 cm vs.3.9±1.7 cm(mean±SD),p<0.001)and recovery(8.1±3.3 cm vs.6.8±2.3 cm,p=0.02)distinguished between those with and without CRVD.Concussion symptom provocation on VVE with horizontal saccades(35(52%)vs.12(29%),p=0.02)and horizontal vestibulo-ocular reflex testing(37(55%)vs.14(34%),p=0.03),and sway on tandem gait under the forward eyes closed condition(25(37%)vs.6(15%),p=0.01)also identified those with CRVD.From the eye tracking device,the BOX score(8.1±5.8 vs.5.2±4.1,p=0.007)and a metric of the left eye tracking along the bottom of the visual target(0.094±0.500 vs.-0.124±0.410,p=0.02)identified those with CRVD,with a multivariable receiver operating characteristic curve analysis,including the BOX score,achieving an area under the receiver operating characteristic curve of 0.7637.Conclusion:CRVDs are common in those with PPCS,with impact on recovery after concussion.Novel eye-tracking metrics can serve as an aid in the identification of those with CRVDs who would benefit from referral for comprehensive diagnosis and treatment.展开更多
基金the National Natural Science Foundation of China (No.61627810)the National Science and Technology Major Program of China (No.2018YFB1305003)the National Defense Science and Technology Outstanding Youth Science Foundation (No.2017-JCJQ-ZQ-031)。
文摘In order to solve the problem of small object size and low detection accuracy under the unmanned aerial vehicle(UAV)platform,the object detection algorithm based on deep aggregation network and high-resolution fusion module is studied.Furthermore,a joint network of object detection and feature extraction is studied to construct a real-time multi-object tracking algorithm.For the problem of object association failure caused by UAV movement,image registration is applied to multi-object tracking and a camera motion discrimination model is proposed to improve the speed of the multi-object tracking algorithm.The simulation results show that the algorithm proposed in this study can improve the accuracy of multi-object tracking under the UAV platform,and effectively solve the problem of association failure caused by UAV movement.
基金supported by the National Natural Science Foundation of China(No.62202143)Key Research and Promotion Projects of Henan Province(Nos.232102240023,232102210063,222102210040).
文摘Multi-object tracking(MOT)has seen rapid improvements in recent years.However,frequent occlusion remains a significant challenge in MOT,as it can cause targets to become smaller or disappear entirely,resulting in lowquality targets,leading to trajectory interruptions and reduced tracking performance.Different from some existing methods,which discarded the low-quality targets or ignored low-quality target attributes.LQTTrack,with a lowquality association strategy(LQA),is proposed to pay more attention to low-quality targets.In the association scheme of LQTTrack,firstly,multi-scale feature fusion of FPN(MSFF-FPN)is utilized to enrich the feature information and assist in subsequent data association.Secondly,the normalized Wasserstein distance(NWD)is integrated to replace the original Inter over Union(IoU),thus overcoming the limitations of the traditional IoUbased methods that are sensitive to low-quality targets with small sizes and enhancing the robustness of low-quality target tracking.Moreover,the third association stage is proposed to improve the matching between the current frame’s low-quality targets and previously interrupted trajectories from earlier frames to reduce the problem of track fragmentation or error tracking,thereby increasing the association success rate and improving overall multi-object tracking performance.Extensive experimental results demonstrate the competitive performance of LQTTrack on benchmark datasets(MOT17,MOT20,and DanceTrack).
基金The National Natural Science Foundation of China(No.60574006,60804017)
文摘To cope with multi-object tracking under real-world complex situations, a new video-based method is proposed. In the detecting step, the moving objects are segmented with the third level DWT （discrete wavelet transform ）and background difference. In the tracking step, the Kalman filter and scale parameter are used first to estimate the object position and bounding box. Then, the center-association-based projection ratio and region-association-based occlusion ratio are defined and combined to judge object behaviours. Finally, the tracking scheme and Kalman parameters are adaptively adjusted according to object behaviour. Under occlusion, partial observability is utilized to obtain the object measurements and optimum box dimensions. This method is robust in tracking mobile objects under such situations as occlusion, new appearing and stablization, etc. Experimental results show that the proposed method is efficient.
基金supported by the Research Foundation of Nanjing University of Posts and Telecommunications (No.NY219076)。
文摘Multi-object tracking(MOT) techniques have been increasingly applied in a diverse range of tasks. Unmanned aerial vehicle(UAV) is one of its typical application scenarios. Due to the scene complexity and the low resolution of moving targets in UAV applications, it is difficult to extract target features and identify them. In order to solve this problem, we propose a new re-identification(re-ID) network to extract association features for tracking in the association stage. Moreover, in order to reduce the complexity of detection model, we perform the lightweight optimization for it. Experimental results show that the proposed re-ID network can effectively reduce the number of identity switches, and surpass current state-of-the-art algorithms. In the meantime, the optimized detector can increase the speed by 27% owing to its lightweight design, which enables it to further meet the requirements of UAV tracking tasks.
基金supported by Institute of Information&communications Technology Planning&Evaluation(IITP)Grant funded by the Korea government(MSIT)(No.2018-0-00387Development of ICT based Intelligent Smart Welfare Housing System for the Prevention and Control of Livestock Disease).
文摘Pig farmers want to have an effective solution for automatically detecting and tracking multiple pigs and alerting their conditions in order to recognize disease risk factors quickly.In this paper,therefore,we propose a novel monitoring system using an Artificial Intelligence of Things(AIoT)technique combining artificial intelligence and Internet of Things(IoT).The proposed system consists of AIoT edge devices and a central monitoring server.First,an AIoT edge device extracts video frame images from a CCTV camera installed in a pig pen by a frame extraction method,detects multiple pigs in the images by a faster region-based convolutional neural network(RCNN)model,and tracks them by an object center-point tracking algorithm(OCTA)based on bounding box regression outputs of the faster RCNN.Finally,it sends multi-pig tracking images to the central monitoring server,which alerts them to pig farmers through a social networking service(SNS)agent in cooperation with an oneM2M-compliant IoT alerting method.Experimental results showed that the multi-pig tracking method achieved the multi-object tracking accuracy performance of about 77%.In addition,we verified alerting operation by confirming the images received in the SNS smartphone application.
基金the National Natural Science Foundation of China(No.51775331)。
文摘In this study,a multi-object tracking(MOT)scheme based on a light detection and ranging sensor was proposed to overcome imprecise velocity observations in object occlusion scenarios.By applying real-time velocity estimation,a modified unscented Kalman filter(UKF)was proposed for the state estimation of a target object.The proposed method can reduce the calculation cost by obviating unscented transformations.Additionally,combined with the advantages of a two-reference-point selection scheme based on a center point and a corner point,a reference point switching approach was introduced to improve tracking accuracy and consistency.The state estimation capability of the proposed UKF was verified by comparing it with the standard UKF in single-target tracking simulations.Moreover,the performance of the proposed MOT system was evaluated using real traffic datasets.
基金Supported by the National Natural Science Foundation of China(61471225)Scientific Research Foundation of Shandong University of Science and Technology for Recruited Talents(2014RCJJ055)
文摘An approach to track multiple objects in crowded scenes with long-term partial occlusions is proposed. Tracking-by-detection is a successful strategy to address the task of tracking multiple objects in unconstrained scenarios,but an obvious shortcoming of this method is that most information available in image sequences is simply ignored due to thresholding weak detection responses and applying non-maximum suppression. This paper proposes a multi-label conditional random field（ CRF） model which integrates the superpixel information and detection responses into a unified energy optimization framework to handle the task of tracking multiple targets. A key characteristic of the model is that the pairwise potential is constructed to enforce collision avoidance between objects,which can offer the advantage to improve the tracking performance in crowded scenes. Experiments on standard benchmark databases demonstrate that the proposed algorithm significantly outperforms the state-of-the-art tracking-by-detection methods.
基金Supported by the National Natural Science Foundation of China(6160303040,61433003)Yunnan Applied Basic Research Project of China(201701CF00037)Yunnan Provincial Science and Technology Department Key Research Program(Engineering)(2018BA070)
文摘A simple yet efficient tracking framework is proposed for real-time multi-object tracking with micro aerial vehicles(MAVs). It's basic missions for MAVs to detect specific targets and then track them automatically. In our method, candidate regions are generated using the salient detection in each frame and then classified by an eural network. A kernelized correlation filter(KCF) is employed to track each target until it disappears or the peak-sidelobe ratio is lower than a threshold. Besides, we define the birth and death of each tracker for the targets. The tracker is recycled if its target disappears and can be assigned to a new target. The algorithm is evaluated on the PAFISS and UAV123 datasets. The results show a good performance on both the tracking accuracy and speed.
基金supported by the National Key Laboratory Foundation of Science and Technology on Multispectral Information Processing(6142113220208)Science and Technology Plan Project of Jinan(202214002)National Natural Science Foundation of China(61105006).
文摘Although the joint-detection-and-tracking paradigm has promoted the development of multi-object tracking(MOT)significantly,the long-term occlusion problem is still unsolved.After a period of trajectory inactivation due to occlusion,it is difficult to achieve trajectory reconnection with appearance features because they are no longer reliable.Although using motion cues does not suffer from occlusion,the commonly used Kalman Filter is also ineffective in its long-term inertia prediction in cases of no observation updates or wrong updates.Besides,occlusion is prone to cause multiple track-detection pairs to have close similarity scores during the data association phase.The direct use of the Hungarian algorithm to give the global optimal solution may generate the identity switching problem.In this paper,we propose the Long-term Spatio-Temporal Prediction(LSTP)module and the Ordered Association(OA)module to alleviate the occlusion problem in terms of motion prediction and data association,respectively.The LSTP module estimates the states of all tracked objects over time using a combination of spatial and temporal Transformers.The spatial Transformer models crowd interaction and learns the influence of neighbors,while the temporal Transformer models the temporal continuity of historical trajectories.Besides,the LSTP module also predicts the visibilities of the motion prediction boxes,which denote the occlusion attributes of trajectories.Based on the occlusion attribute and active state,the association priority is defined in the OA module to associate trajectories in order,which helps to alleviate the identity switching problem.Comprehensive experiments on the MOT17 and MOT20 benchmarks indicate the superiority of the proposed MOT framework,namely Occlusion-Robust Tracker(ORT).Without using any appearance information,our ORT can achieve competitive performance beyond other state-of-the-art trackers in terms of trajectory accuracy and purity.
基金funded by the China Academy of Railway Sciences Corporation Limited Scientific Research Project(No:2023YJ080).
文摘Purpose-With the rapid advancement of China’s high-speed rail network,the density of train operations is on the rise.To address the challenge of shortening train tracking intervals while enhancing transportation efficiency,the multi-objective dynamic optimization of the train operation process has emerged as a critical issue.Design/methodology/approach-Train dynamic model is established by analyzing the force of the train in the process of tracing operation.The train tracing operation model is established according to the dynamic mechanical model of the train tracking process,and the dynamic optimization analysis is carried out with comfort,energy saving and punctuality as optimization objectives.To achieve multi-objective dynamic optimization,a novel train tracking operation calculation method is proposed,utilizing the improved grey wolf optimization algorithm(MOGWO).The proposed method is simulated and verified based on the train characteristics and line data of CR400AF electric multiple units.Findings-The simulation results prove that the optimized MOGWO algorithm can be computed quickly during train tracks,the optimum results can be given within 5s and the algorithm can converge effectively in different optimization target directions.The optimized speed profile of the MOGWO algorithm is smoother and more stable and meets the target requirements of energy saving,punctuality and comfort while maximally respecting the speed limit profile.Originality/value-The MOGWO train tracking interval optimization method enhances the tracking process while ensuring a safe tracking interval.This approach enables the trailing train to operate more comfortably,energy-efficiently and punctually,aligning with passenger needs and industry trends.The method offers valuable insights for optimizing the high-speed train tracking process.
基金Supported by National Natural Science Foundation of China(Grant Nos.U22A20246,52372382)Hefei Municipal Natural Science Foundation(Grant No.2022008)+1 种基金the Open Fund of State Key Laboratory of Mechanical Behavior and System Safety of Traffic Engineering Structures(Grant No.KF2023-06)S&T Program of Hebei(Grant No.225676162GH).
文摘In the parallel steering coordination control strategy for path tracking,it is difficult to match the current driver steering model using the fixed parameters with the actual driver,and the designed steering coordination control strategy under a single objective and simple conditions is difficult to adapt to the multi-dimensional state variables’input.In this paper,we propose a deep reinforcement learning algorithm-based multi-objective parallel human-machine steering coordination strategy for path tracking considering driver misoperation and external disturbance.Firstly,the driver steering mathematical model is constructed based on the driver preview characteristics and steering delay response,and the driver characteristic parameters are fitted after collecting the actual driver driving data.Secondly,considering that the vehicle is susceptible to the influence of external disturbances during the driving process,the Tube MPC(Tube Model Predictive Control)based path tracking steering controller is designed based on the vehicle system dynamics error model.After verifying that the driver steering model meets the driver steering operation characteristics,DQN(Deep Q-network),DDPG(Deep Deterministic Policy Gradient)and TD3(Twin Delayed Deep Deterministic Policy Gradient)deep reinforcement learning algorithms are utilized to design a multi-objective parallel steering coordination strategy which satisfies the multi-dimensional state variables’input of the vehicle.Finally,the tracking accuracy,lateral safety,human-machine conflict and driver steering load evaluation index are designed in different driver operation states and different road environments,and the performance of the parallel steering coordination control strategies with different deep reinforcement learning algorithms and fuzzy algorithms are compared by simulations and hardware in the loop experiments.The results show that the parallel steering collaborative strategy based on a deep reinforcement learning algorithm can more effectively assist the driver in tracking the target path under lateral wind interference and driver misoperation,and the TD3-based coordination control strategy has better overall performance.
基金supported in part by Multimedia University under the Research Fellow Grant MMUI/250008in part by Telekom Research&Development Sdn Bhd under Grants RDTC/241149 and RDTC/231095+1 种基金Princess Nourah bint Abdulrahman University Researchers Supporting Project number(PNURSP2025R140)Princess Nourah bint Abdulrahman University,Riyadh,Saudi Arabia.
文摘Multiple Object Tracking(MOT)is essential for applications such as autonomous driving,surveillance,and analytics;However,challenges such as occlusion,low-resolution imaging,and identity switches remain persistent.We propose HAMOT,a hierarchical adaptive multi-object tracker that solves these challenges with a novel,unified framework.Unlike previous methods that rely on isolated components,HAMOT incorporates a Swin Transformer-based Adaptive Enhancement(STAE)module—comprising Scene-Adaptive Transformer Enhancement and Confidence-Adaptive Feature Refinement—to improve detection under low-visibility conditions.The hierarchical DynamicGraphNeuralNetworkwith TemporalAttention(DGNN-TA)models both short-and long-termassociations,and the Adaptive Unscented Kalman Filter with Gated Recurrent Unit(AUKF-GRU)ensures accurate motion prediction.The novel Graph-Based Density-Aware Clustering(GDAC)improves occlusion recovery by adapting to scene density,preserving identity integrity.This integrated approach enables adaptive responses to complex visual scenarios,Achieving exceptional performance across all evaluation metrics,including aHigher Order TrackingAccuracy(HOTA)of 67.05%,a Multiple Object Tracking Accuracy(MOTA)of 82.4%,an ID F1 Score(IDF1)of 83.1%,and a total of 1052 Identity Switches(IDSW)on theMOT17;66.61%HOTA,78.3%MOTA,82.1%IDF1,and a total of 748 IDSWonMOT20;and 66.4%HOTA,92.32%MOTA,and 68.96%IDF1 on DanceTrack.With fixed thresholds,the full HAMOT model(all six components)achieves real-time functionality at 24 FPS on MOT17 using RTX3090,ensuring robustness and scalability for real-world MOT applications.
基金supported by the confidential research grant No.a8317。
文摘To address the issues of frequent identity switches(IDs)and degraded identification accuracy in multi object tracking(MOT)under complex occlusion scenarios,this study proposes an occlusion-robust tracking framework based on face-pedestrian joint feature modeling.By constructing a joint tracking model centered on“intra-class independent tracking+cross-category dynamic binding”,designing a multi-modal matching metric with spatio-temporal and appearance constraints,and innovatively introducing a cross-category feature mutual verification mechanism and a dual matching strategy,this work effectively resolves performance degradation in traditional single-category tracking methods caused by short-term occlusion,cross-camera tracking,and crowded environments.Experiments on the Chokepoint_Face_Pedestrian_Track test set demonstrate that in complex scenes,the proposed method improves Face-Pedestrian Matching F1 area under the curve(F1 AUC)by approximately 4 to 43 percentage points compared to several traditional methods.The joint tracking model achieves overall performance metrics of IDF1:85.1825%and MOTA:86.5956%,representing improvements of 0.91 and 0.06 percentage points,respectively,over the baseline model.Ablation studies confirm the effectiveness of key modules such as the Intersection over Area(IoA)/Intersection over Union(IoU)joint metric and dynamic threshold adjustment,validating the significant role of the cross-category identity matching mechanism in enhancing tracking stability.Our_model shows a 16.7%frame per second(FPS)drop vs.fairness of detection and re-identification in multiple object tracking(FairMOT),with its cross-category binding module adding aboute 10%overhead,yet maintains near-real-time performance for essential face-pedestrian tracking at small resolutions.
文摘Multi-Object Tracking(MOT)represents a fundamental but computationally demanding task in computer vision,with particular challenges arising in occluded and densely populated environments.While contemporary tracking systems have demonstrated considerable progress,persistent limitations—notably frequent occlusion-induced identity switches and tracking inaccuracies—continue to impede reliable real-world deployment.This work introduces an advanced tracking framework that enhances association robustness through a two-stage matching paradigm combining spatial and appearance features.Proposed framework employs:(1)a Height Modulated and Scale Adaptive Spatial Intersection-over-Union(HMSIoU)metric for improved spatial correspondence estimation across variable object scales and partial occlusions;(2)a feature extraction module generating discriminative appearance descriptors for identity maintenance;and(3)a recovery association mechanism for refining matches between unassociated tracks and detections.Comprehensive evaluation on standard MOT17 and MOT20 benchmarks demonstrates significant improvements in tracking consistency,with state-of-the-art performance across key metrics including HOTA(64),MOTA(80.7),IDF1(79.8),and IDs(1379).These results substantiate the efficacy of our Cue-Tracker framework in complex real-world scenarios characterized by occlusions and crowd interactions.
基金supported by the National Natural Science Foundation of China(Nos.12272104,U22B2013).
文摘This paper investigates the challenges associated with Unmanned Aerial Vehicle (UAV) collaborative search and target tracking in dynamic and unknown environments characterized by limited field of view. The primary objective is to explore the unknown environments to locate and track targets effectively. To address this problem, we propose a novel Multi-Agent Reinforcement Learning (MARL) method based on Graph Neural Network (GNN). Firstly, a method is introduced for encoding continuous-space multi-UAV problem data into spatial graphs which establish essential relationships among agents, obstacles, and targets. Secondly, a Graph AttenTion network (GAT) model is presented, which focuses exclusively on adjacent nodes, learns attention weights adaptively and allows agents to better process information in dynamic environments. Reward functions are specifically designed to tackle exploration challenges in environments with sparse rewards. By introducing a framework that integrates centralized training and distributed execution, the advancement of models is facilitated. Simulation results show that the proposed method outperforms the existing MARL method in search rate and tracking performance with less collisions. The experiments show that the proposed method can be extended to applications with a larger number of agents, which provides a potential solution to the challenging problem of multi-UAV autonomous tracking in dynamic unknown environments.
基金supported by the National Natural Science Foundation of China(12072090).
文摘This work proposes the application of an iterative learning model predictive control(ILMPC)approach based on an adaptive fault observer(FOBILMPC)for fault-tolerant control and trajectory tracking in air-breathing hypersonic vehicles.In order to increase the control amount,this online control legislation makes use of model predictive control(MPC)that is based on the concept of iterative learning control(ILC).By using offline data to decrease the linearized model’s faults,the strategy may effectively increase the robustness of the control system and guarantee that disturbances can be suppressed.An adaptive fault observer is created based on the suggested ILMPC approach in order to enhance overall fault tolerance by estimating and compensating for actuator disturbance and fault degree.During the derivation process,a linearized model of longitudinal dynamics is established.The suggested ILMPC approach is likely to be used in the design of hypersonic vehicle control systems since numerical simulations have demonstrated that it can decrease tracking error and speed up convergence when compared to the offline controller.
文摘To realize effective co-phasing adjustment in large-aperture sparse-aperture telescopes,a multichannel stripe tracking approach is employed,allowing simultaneous interferometric measurements of multiple optical paths and circumventing the need for pairwise measurements along the mirror boundaries in traditional interferometric methods.This approach enhances detection efficiency and reduces system complexity.Here,the principles of the multibeam interference process and construction of a co-phasing detection module based on direct optical fiber connections were analyzed using wavefront optics theory.Error analysis was conducted on the system surface obtained through multipath interference.Potential applications of the interferometric method were explored.Finally,the principle was verified by experiment,an interferometric fringe contrast better than 0.4 is achieved through flat field calibration and incoherent digital synthesis.The dynamic range of the measurement exceeds 10 times of the center wavelength of the working band(1550 nm).Moreover,a resolution better than one-tenth of the working center wavelength(1550 nm)was achieved.Simultaneous three-beam interference can be achieved,leading to a 50%improvement in detection efficiency.This method can effectively enhance the efficiency of sparse aperture telescope co-phasing,meeting the requirements for observations of 8-10 m telescopes.This study provides a technological foundation for observing distant and faint celestial objects.
基金financial support provided by the Natural Science Foundation of Hunan Province of China(Grant No.2021JJ10045)the Open Research Subject of State Key Laboratory of Intelligent Game(Grant No.ZBKF-24-01)+1 种基金the Postdoctoral Fellowship Program of CPSF(Grant No.GZB20240989)the China Postdoctoral Science Foundation(Grant No.2024M754304)。
文摘Unmanned aerial vehicles(UAVs)have become crucial tools in moving target tracking due to their agility and ability to operate in complex,dynamic environments.UAVs must meet several requirements to achieve stable tracking,including maintaining continuous target visibility amidst occlusions,ensuring flight safety,and achieving smooth trajectory planning.This paper reviews the latest advancements in UAV-based target tracking,highlighting information prediction,tracking strategies,and swarm cooperation.To address challenges including target visibility and occlusion,real-time prediction and tracking in dynamic environments,flight safety and coordination,resource management and energy efficiency,the paper identifies future research directions aimed at improving the performance,reliability,and scalability of UAV tracking system.
基金supported by the Science and Technology Commission of Shanghai Municipality(21DZ1100500)the Shanghai Municipal Science and Technology Major Project+2 种基金the Shanghai Frontiers Science Center Program(2021–2025 No.20)The National Natural Science Foundation of China(32471545)the Natural Science Foundation of Shanghai(24ZR1454300).
文摘Unlike ensemble-averaging measurements,single-molecule tracking provides quantitative information on the kinetics of individual molecules within living cells in real time and may provide insight into the respective molecular interactions behind that.The advancement of single-molecule tracking has been signi-cantly boosted by the development of high-resolution microscopy techniques.In this review,we will discuss this aspect with a particular focus on their recent advance in MINFLUX nanoscopy with feedback approaches where tracking is performed in real time.MINFLUX localization requires fewer than 100 photons from a-1 nm-sized°uorophore,enabling precise tracking.This approach,which demands over an order of magnitude fewer photons than other localization-based techniques(such as STORM,PLAM),allows molecular tracking with single-digit nanometer accuracy in less than 1 ms—an achievement previously unattainable.
基金supported by funding from the National Institution of Neurological Disorders and Stroke(1R41NS103698-01A1 to CLM)。
文摘Background:Early identification of concussion-related vision disorders(CRVDs)may improve outcomes by enabling earlier management,referral,and treatment.Objective eye tracking may provide additional data to support the diagnose of CRVDs.The purpose of this study was to determine the utility of objective infrared eye tracking in identifying CRVDs among adolescents experiencing persisting post-concussive symptoms(PPCS)more than 28 days after injury.Methods:This was a prospective study of adolescents with PPCS evaluated with visio-vestibular examination(VVE),comprehensive vision examination,and an eye tracking device.Results:Of the 108 adolescents enrolled,67(62%)were diagnosed with a CRVD by comprehensive vision examination.On VVE,the near point of convergence break(5.5±3.2 cm vs.3.9±1.7 cm(mean±SD),p<0.001)and recovery(8.1±3.3 cm vs.6.8±2.3 cm,p=0.02)distinguished between those with and without CRVD.Concussion symptom provocation on VVE with horizontal saccades(35(52%)vs.12(29%),p=0.02)and horizontal vestibulo-ocular reflex testing(37(55%)vs.14(34%),p=0.03),and sway on tandem gait under the forward eyes closed condition(25(37%)vs.6(15%),p=0.01)also identified those with CRVD.From the eye tracking device,the BOX score(8.1±5.8 vs.5.2±4.1,p=0.007)and a metric of the left eye tracking along the bottom of the visual target(0.094±0.500 vs.-0.124±0.410,p=0.02)identified those with CRVD,with a multivariable receiver operating characteristic curve analysis,including the BOX score,achieving an area under the receiver operating characteristic curve of 0.7637.Conclusion:CRVDs are common in those with PPCS,with impact on recovery after concussion.Novel eye-tracking metrics can serve as an aid in the identification of those with CRVDs who would benefit from referral for comprehensive diagnosis and treatment.
