In order to solve the problem of small object size and low detection accuracy under the unmanned aerial vehicle(UAV)platform,the object detection algorithm based on deep aggregation network and high-resolution fusion ...In order to solve the problem of small object size and low detection accuracy under the unmanned aerial vehicle(UAV)platform,the object detection algorithm based on deep aggregation network and high-resolution fusion module is studied.Furthermore,a joint network of object detection and feature extraction is studied to construct a real-time multi-object tracking algorithm.For the problem of object association failure caused by UAV movement,image registration is applied to multi-object tracking and a camera motion discrimination model is proposed to improve the speed of the multi-object tracking algorithm.The simulation results show that the algorithm proposed in this study can improve the accuracy of multi-object tracking under the UAV platform,and effectively solve the problem of association failure caused by UAV movement.展开更多
As a vital technology in Cyber-Physical Social Intelligence (CPSI), Multi-Object-Tracking (MOT) can support comprehensive perception and analysis of the physical environment and social virtual space, promoting an in-d...As a vital technology in Cyber-Physical Social Intelligence (CPSI), Multi-Object-Tracking (MOT) can support comprehensive perception and analysis of the physical environment and social virtual space, promoting an in-depth understanding of human behavior, object movement, and social interaction. Most MOT methods often adopt simple interpolation or prediction strategies when dealing with temporarily lost targets, but ignore the comprehensive consideration of the state of the target before its reappearance. This approach may lead to an incomplete understanding of the target’s behavior and dynamics, which affects the accuracy and depth of the comprehensive understanding of social and physical space interactions in the real world. To improve it, we propose an online multi-object tracking method based on Record Confidence and Hierarchical Association (RCHA), which is represented as RCHA-Track. The Kalman filter combined with an Enhanced Correlation Coefficient (ECC) provides more accurate motion prediction under the influence of camera motion. The record confidence is designed to evaluate the loss status of the unseen object and refine the tracking trajectory. The normally tracked targets and the temporarily lost targets are combined to perform a hierarchical association based on the number of lost frames to achieve more accurate data associations. Compared with the latest ByteTrack, RCHA-Track improves MOTA, IDF1, and HOTA by 1.7%, 1.6%, and 1.3% on the benchmark dataset MOT17, and 1.3%, 2.1%, and 2.0% on MOT20, respectively, achieving state-of-the-art performance. Extensive ablation experiments demonstrate the effectiveness of each key module in the proposed RCHA-Track.展开更多
Understanding fish movement trajectories in aquaculture is essential for practical applications,such as disease warning,feeding optimization,and breeding management.These trajectories reveal key information about the ...Understanding fish movement trajectories in aquaculture is essential for practical applications,such as disease warning,feeding optimization,and breeding management.These trajectories reveal key information about the fish’s behavior,health,and environmental adaptability.However,when multi-object tracking(MOT)algorithms are applied to the high-density aquaculture environment,occlusion and overlapping among fish may result in missed detections,false detections,and identity switching problems,which limit the tracking accuracy.To address these issues,this paper proposes FishTracker,a MOT algorithm,by utilizing a Tracking-by-Detection framework.First,the neck part of the YOLOv8 model is enhanced by introducing a Multi-Scale Dilated Attention(MSDA)module to improve object localization and classification confidence.Second,an Adaptive Kalman Filter(AKF)is employed in the tracking phase to dynamically adjust motion prediction parameters,thereby overcoming target adhesion and nonlinear motion in complex scenarios.Experimental results show that FishTracker achieves a multi-object tracking accuracy(MOTA)of 93.22% and 87.24% in bright and dark illumination conditions,respectively.Further validation in a real aquaculture scenario reveal that FishTracker achieves aMOTA of 76.70%,which is 5.34% higher than the baselinemodel.The higher order tracking accuracy(HOTA)reaches 50.5%,which is 3.4% higher than the benchmark.In conclusion,FishTracker can provide reliable technical support for accurate tracking and behavioral analysis of high-density fish populations.展开更多
In this paper, a fault-tolerant-based online critic learning algorithm is developed to solve the optimal tracking control issue for nonaffine nonlinear systems with actuator faults.First, a novel augmented plant is co...In this paper, a fault-tolerant-based online critic learning algorithm is developed to solve the optimal tracking control issue for nonaffine nonlinear systems with actuator faults.First, a novel augmented plant is constructed by fusing the system state and the reference trajectory, which aims to transform the optimal fault-tolerant tracking control design with actuator faults into the optimal regulation problem of the conventional nonlinear error system. Subsequently, in order to ensure the normal execution of the online learning algorithm, a stability criterion condition is created to obtain an initial admissible tracking policy. Then, the constructed model neural network(NN) is pretrained to recognize the system dynamics and calculate trajectory control. The critic and action NNs are constructed to output the approximate cost function and approximate tracking control,respectively. The Hamilton-Jacobi-Bellman equation of the error system is solved online through the action-critic framework. In theoretical analysis, it is proved that all concerned signals are uniformly ultimately bounded according to the Lyapunov principle.The tracking control law can approach the optimal tracking control within a finite approximation error. Finally, two experimental examples are conducted to indicate the effectiveness and superiority of the developed fault-tolerant tracking control scheme.展开更多
Purpose-With the rapid advancement of China’s high-speed rail network,the density of train operations is on the rise.To address the challenge of shortening train tracking intervals while enhancing transportation effi...Purpose-With the rapid advancement of China’s high-speed rail network,the density of train operations is on the rise.To address the challenge of shortening train tracking intervals while enhancing transportation efficiency,the multi-objective dynamic optimization of the train operation process has emerged as a critical issue.Design/methodology/approach-Train dynamic model is established by analyzing the force of the train in the process of tracing operation.The train tracing operation model is established according to the dynamic mechanical model of the train tracking process,and the dynamic optimization analysis is carried out with comfort,energy saving and punctuality as optimization objectives.To achieve multi-objective dynamic optimization,a novel train tracking operation calculation method is proposed,utilizing the improved grey wolf optimization algorithm(MOGWO).The proposed method is simulated and verified based on the train characteristics and line data of CR400AF electric multiple units.Findings-The simulation results prove that the optimized MOGWO algorithm can be computed quickly during train tracks,the optimum results can be given within 5s and the algorithm can converge effectively in different optimization target directions.The optimized speed profile of the MOGWO algorithm is smoother and more stable and meets the target requirements of energy saving,punctuality and comfort while maximally respecting the speed limit profile.Originality/value-The MOGWO train tracking interval optimization method enhances the tracking process while ensuring a safe tracking interval.This approach enables the trailing train to operate more comfortably,energy-efficiently and punctually,aligning with passenger needs and industry trends.The method offers valuable insights for optimizing the high-speed train tracking process.展开更多
Existing tracking algorithms often suffer from the drift and lost problems caused by factors such as pose variation, illumination change, occlusion and motion. Therefore, developing a robust and effective tracker is s...Existing tracking algorithms often suffer from the drift and lost problems caused by factors such as pose variation, illumination change, occlusion and motion. Therefore, developing a robust and effective tracker is still a challenging task. In this paper, we propose a real-time compressive tracking based on online Hough forest. The gray and texture features of discrete samples are extracted and compressed via the random measurement matrix. Online Hough forest classifier is used to vote the location probability of the target, and it optimizes the confidence map estimation for the target detection. The location of target being tracked is determined by combining the upper frame of the target center location and the probability confidence map of the incremental Hough forest. Finally, the classifier parameters are updated online by introducing the illumination variation and target occlusion feedback mechanism adaptively. The experiments with state-of-the-art algorithms on challenging sequences demonstrated that the proposed algorithm can effectively enhance the robustness and accuracy, and inherit the real-time performance of the compressive tracking algorithm.展开更多
The multi-armored target tracking(MATT)plays a crucial role in coordinated tracking and strike.The occlusion and insertion among targets and target scale variation is the key problems in MATT.Most stateof-the-art mult...The multi-armored target tracking(MATT)plays a crucial role in coordinated tracking and strike.The occlusion and insertion among targets and target scale variation is the key problems in MATT.Most stateof-the-art multi-object tracking(MOT)works adopt the tracking-by-detection strategy,which rely on compute-intensive sliding window or anchoring scheme in detection module and neglect the target scale variation in tracking module.In this work,we proposed a more efficient and effective spatial-temporal attention scheme to track multi-armored target in the ground battlefield.By simulating the structure of the retina,a novel visual-attention Gabor filter branch is proposed to enhance detection.By introducing temporal information,some online learned target-specific Convolutional Neural Networks(CNNs)are adopted to address occlusion.More importantly,we built a MOT dataset for armored targets,called Armored Target Tracking dataset(ATTD),based on which several comparable experiments with state-ofthe-art methods are conducted.Experimental results show that the proposed method achieves outstanding tracking performance and meets the actual application requirements.展开更多
Multi-object tracking is a vital problem as many applications require better tracking approaches.Although learning-based detectors are becoming extremely powerful,there are few tracking methods designed to work with t...Multi-object tracking is a vital problem as many applications require better tracking approaches.Although learning-based detectors are becoming extremely powerful,there are few tracking methods designed to work with them in real time.We explored an efficient flexible online vehicle tracking-by-detection framework suitable for real-virtual mapping systems,which combines a non-recursive temporal window search with delayed output and produces stable trajectories despite noisy detection responses.Its computation speed meets the real-time requirements,whereas its performance is comparable with that of state-of-the-art online trackers on the DETRAC dataset.The trajectories from our approach also contain the target class and color information important for virtual vehicle motion reconstruction.展开更多
To cope with multi-object tracking under real-world complex situations, a new video-based method is proposed. In the detecting step, the moving objects are segmented with the third level DWT （discrete wavelet transfo...To cope with multi-object tracking under real-world complex situations, a new video-based method is proposed. In the detecting step, the moving objects are segmented with the third level DWT （discrete wavelet transform ）and background difference. In the tracking step, the Kalman filter and scale parameter are used first to estimate the object position and bounding box. Then, the center-association-based projection ratio and region-association-based occlusion ratio are defined and combined to judge object behaviours. Finally, the tracking scheme and Kalman parameters are adaptively adjusted according to object behaviour. Under occlusion, partial observability is utilized to obtain the object measurements and optimum box dimensions. This method is robust in tracking mobile objects under such situations as occlusion, new appearing and stablization, etc. Experimental results show that the proposed method is efficient.展开更多
Multi-object tracking(MOT) techniques have been increasingly applied in a diverse range of tasks. Unmanned aerial vehicle(UAV) is one of its typical application scenarios. Due to the scene complexity and the low resol...Multi-object tracking(MOT) techniques have been increasingly applied in a diverse range of tasks. Unmanned aerial vehicle(UAV) is one of its typical application scenarios. Due to the scene complexity and the low resolution of moving targets in UAV applications, it is difficult to extract target features and identify them. In order to solve this problem, we propose a new re-identification(re-ID) network to extract association features for tracking in the association stage. Moreover, in order to reduce the complexity of detection model, we perform the lightweight optimization for it. Experimental results show that the proposed re-ID network can effectively reduce the number of identity switches, and surpass current state-of-the-art algorithms. In the meantime, the optimized detector can increase the speed by 27% owing to its lightweight design, which enables it to further meet the requirements of UAV tracking tasks.展开更多
Pig farmers want to have an effective solution for automatically detecting and tracking multiple pigs and alerting their conditions in order to recognize disease risk factors quickly.In this paper,therefore,we propose...Pig farmers want to have an effective solution for automatically detecting and tracking multiple pigs and alerting their conditions in order to recognize disease risk factors quickly.In this paper,therefore,we propose a novel monitoring system using an Artificial Intelligence of Things(AIoT)technique combining artificial intelligence and Internet of Things(IoT).The proposed system consists of AIoT edge devices and a central monitoring server.First,an AIoT edge device extracts video frame images from a CCTV camera installed in a pig pen by a frame extraction method,detects multiple pigs in the images by a faster region-based convolutional neural network(RCNN)model,and tracks them by an object center-point tracking algorithm(OCTA)based on bounding box regression outputs of the faster RCNN.Finally,it sends multi-pig tracking images to the central monitoring server,which alerts them to pig farmers through a social networking service(SNS)agent in cooperation with an oneM2M-compliant IoT alerting method.Experimental results showed that the multi-pig tracking method achieved the multi-object tracking accuracy performance of about 77%.In addition,we verified alerting operation by confirming the images received in the SNS smartphone application.展开更多
A simple yet efficient tracking framework is proposed for real-time multi-object tracking with micro aerial vehicles(MAVs). It's basic missions for MAVs to detect specific targets and then track them automatically...A simple yet efficient tracking framework is proposed for real-time multi-object tracking with micro aerial vehicles(MAVs). It's basic missions for MAVs to detect specific targets and then track them automatically. In our method, candidate regions are generated using the salient detection in each frame and then classified by an eural network. A kernelized correlation filter(KCF) is employed to track each target until it disappears or the peak-sidelobe ratio is lower than a threshold. Besides, we define the birth and death of each tracker for the targets. The tracker is recycled if its target disappears and can be assigned to a new target. The algorithm is evaluated on the PAFISS and UAV123 datasets. The results show a good performance on both the tracking accuracy and speed.展开更多
Target tracking in wireless sensor network usually schedules a subset of sensor nodes to constitute a tasking cluster to collaboratively track a target.For the goals of saving energy consumption,prolonging network lif...Target tracking in wireless sensor network usually schedules a subset of sensor nodes to constitute a tasking cluster to collaboratively track a target.For the goals of saving energy consumption,prolonging network lifetime and improving tracking accuracy,sensor node scheduling for target tracking is indeed a multi-objective optimization problem.In this paper,a multi-objective optimization sensor node scheduling algorithm is proposed.It employs the unscented Kalman filtering algorithm for target state estimation and establishes tracking accuracy index,predicts the energy consumption of candidate sensor nodes,analyzes the relationship between network lifetime and remaining energy balance so as to construct energy efficiency index.Simulation results show that,compared with the existing sensor node scheduling,our proposed algorithm can achieve superior tracking accuracy and energy efficiency.展开更多
Contour error is the deviation between the actual displacement and reference trajectory,which is directly related to the machining accuracy.Contour error compensation poses substantial challenges because of the time-v...Contour error is the deviation between the actual displacement and reference trajectory,which is directly related to the machining accuracy.Contour error compensation poses substantial challenges because of the time-varying,nonlinear,and strongly coupled characteristics of parallel machining modules.In addition,the time delay in the system reduces the timeliness of the feedback data,thereby making online contour error calculations and compensation particularly difficult.To solve this problem,the generation mechanism of the time delay of the feedback data and contour error is revealed,and a systematic method for the identification of the time-delay parameter based on Beckhoff’s tracking error calculation mechanism is proposed.The temporal alignment between the position commands and feedback data enables the online calculation of the contour error.On this basis,the tracking error of the drive axes(an important factor resulting in end-effector contour errors)is used for the contour error calculation.Considering the ambiguous parameter-setting logic of the servo drive,the servo parameter is calculated in reverse using the steady-state error to obtain the tracking error model of the drive axes.Furthermore,combined with the system time-delay model,an online correction method for the tracking error estimation model is established.To achieve an accurate mapping of the drive-axis tracking error and end-effector contour error,a bounded iterative search method for the nearest contour point and online calculation model for the contour error are respectively established.Finally,an online compensation controller for contour error is designed.Its effectiveness is verified by a machining experiment on a frame workpiece.The machining results show that the contour error reduces from 68μm to 45μm,and the finish machining accuracy increases by 34%.This study provides a feasible method for online compensation of contour error in a system with time delay.展开更多
Advancements in animal behavior quantification methods have driven the development of computational ethology,enabling fully automated behavior analysis.Existing multianimal pose estimation workflows rely on tracking-b...Advancements in animal behavior quantification methods have driven the development of computational ethology,enabling fully automated behavior analysis.Existing multianimal pose estimation workflows rely on tracking-bydetection frameworks for either bottom-up or top-down approaches,requiring retraining to accommodate diverse animal appearances.This study introduces InteBOMB,an integrated workflow that enhances top-down approaches by incorporating generic object tracking,eliminating the need for prior knowledge of target animals while maintaining broad generalizability.InteBOMB includes two key strategies for tracking and segmentation in laboratory environments and two techniques for pose estimation in natural settings.The“background enhancement”strategy optimizesforeground-backgroundcontrastiveloss,generating more discriminative correlation maps.The“online proofreading”strategy stores human-in-the-loop long-term memory and dynamic short-term memory,enabling adaptive updates to object visual features.The“automated labeling suggestion”technique reuses the visual features saved during tracking to identify representative frames for training set labeling.Additionally,the“joint behavior analysis”technique integrates these features with multimodal data,expanding the latent space for behavior classification and clustering.To evaluate the framework,six datasets of mice and six datasets of nonhuman primates were compiled,covering laboratory and natural scenes.Benchmarking results demonstrated a24%improvement in zero-shot generic tracking and a 21%enhancement in joint latent space performance across datasets,highlighting the effectiveness of this approach in robust,generalizable behavior analysis.展开更多
Multi-object tracking(MOT)has seen rapid improvements in recent years.However,frequent occlusion remains a significant challenge in MOT,as it can cause targets to become smaller or disappear entirely,resulting in lowq...Multi-object tracking(MOT)has seen rapid improvements in recent years.However,frequent occlusion remains a significant challenge in MOT,as it can cause targets to become smaller or disappear entirely,resulting in lowquality targets,leading to trajectory interruptions and reduced tracking performance.Different from some existing methods,which discarded the low-quality targets or ignored low-quality target attributes.LQTTrack,with a lowquality association strategy(LQA),is proposed to pay more attention to low-quality targets.In the association scheme of LQTTrack,firstly,multi-scale feature fusion of FPN(MSFF-FPN)is utilized to enrich the feature information and assist in subsequent data association.Secondly,the normalized Wasserstein distance(NWD)is integrated to replace the original Inter over Union(IoU),thus overcoming the limitations of the traditional IoUbased methods that are sensitive to low-quality targets with small sizes and enhancing the robustness of low-quality target tracking.Moreover,the third association stage is proposed to improve the matching between the current frame’s low-quality targets and previously interrupted trajectories from earlier frames to reduce the problem of track fragmentation or error tracking,thereby increasing the association success rate and improving overall multi-object tracking performance.Extensive experimental results demonstrate the competitive performance of LQTTrack on benchmark datasets(MOT17,MOT20,and DanceTrack).展开更多
Recent advances in automation and digitization enable the close integration of physical devices with their virtual counterparts, facilitating the real-time modeling and optimization of a multitude of processes in an a...Recent advances in automation and digitization enable the close integration of physical devices with their virtual counterparts, facilitating the real-time modeling and optimization of a multitude of processes in an automatic way. The rich and continuously updated data environment provided by such systems makes it possible for decisions to be made over time to drive the process toward optimal targets. In many man- ufacturing processes, in order to achieve an overall optimal process, the simultaneous assessment of mul- tiple objective functions related to process performance and cost is necessary. In this work, a multi- objective optimal experimental design framework is proposed to enhance the ef ciency of online model-identi cation platforms. The proposed framework permits exibility in the choice of trade-off experimental design solutions, which are calculated online that is, during the execution of experiments. The application of this framework to improve the online identi cation of kinetic models in ow reactors is illustrated using a case study in which a kinetic model is identi ed for the esteri cation of benzoic acid and ethanol in a microreactor.展开更多
Background With the rapid development of Web3D, virtual reality, and digital twins, virtual trajectories and decision data considerably rely on the analysis and understanding of real video data, particularly in emerge...Background With the rapid development of Web3D, virtual reality, and digital twins, virtual trajectories and decision data considerably rely on the analysis and understanding of real video data, particularly in emergency evacuation scenarios. Correctly and effectively evacuating crowds in virtual emergency scenarios are becoming increasingly urgent. One good solution is to extract pedestrian trajectories from videos of emergency situations using a multi-target tracking algorithm and use them to define evacuation procedures. Methods To implement this solution, a trajectory extraction and optimization framework based on multi-target tracking is developed in this study. First, a multi-target tracking algorithm is used to extract and preprocess the trajectory data of the crowd in a video. Then, the trajectory is optimized by combining the trajectory point extraction algorithm and Savitzky-Golay smoothing filtering method. Finally, related experiments are conducted, and the results show that the proposed approach can effectively and accurately extract the trajectories of multiple target objects in real time. Results In addition, the proposed approach retains the real characteristics of the trajectories as much as possible while improving the trajectory smoothing index, which can provide data support for the analysis of pedestrian trajectory data and formulation of personnel evacuation schemes in emergency scenarios. Conclusions Further comparisons with methods used in related studies confirm the feasibility and superiority of the proposed framework.展开更多
On grounds of the advent of real-time applications,like autonomous driving,visual surveillance,and sports analysis,there is an augmenting focus of attention towards Multiple-Object Tracking(MOT).The tracking-by-detect...On grounds of the advent of real-time applications,like autonomous driving,visual surveillance,and sports analysis,there is an augmenting focus of attention towards Multiple-Object Tracking(MOT).The tracking-by-detection paradigm,a commonly utilized approach,connects the existing recognition hypotheses to the formerly assessed object trajectories by comparing the simila-rities of the appearance or the motion between them.For an efficient detection and tracking of the numerous objects in a complex environment,a Pearson Simi-larity-centred Kuhn-Munkres(PS-KM)algorithm was proposed in the present study.In this light,the input videos were,initially,gathered from the MOT dataset and converted into frames.The background subtraction occurred whichfiltered the inappropriate data concerning the frames after the frame conversion stage.Then,the extraction of features from the frames was executed.Afterwards,the higher dimensional features were transformed into lower-dimensional features,and feature reduction process was performed with the aid of Information Gain-centred Singular Value Decomposition(IG-SVD).Next,using the Modified Recurrent Neural Network(MRNN)method,classification was executed which identified the categories of the objects additionally.The PS-KM algorithm identi-fied that the recognized objects were tracked.Finally,the experimental outcomes exhibited that numerous targets were precisely tracked by the proposed system with 97%accuracy with a low false positive rate(FPR)of 2.3%.It was also proved that the present techniques viz.RNN,CNN,and KNN,were effective with regard to the existing models.展开更多
In this study,a multi-object tracking(MOT)scheme based on a light detection and ranging sensor was proposed to overcome imprecise velocity observations in object occlusion scenarios.By applying real-time velocity esti...In this study,a multi-object tracking(MOT)scheme based on a light detection and ranging sensor was proposed to overcome imprecise velocity observations in object occlusion scenarios.By applying real-time velocity estimation,a modified unscented Kalman filter(UKF)was proposed for the state estimation of a target object.The proposed method can reduce the calculation cost by obviating unscented transformations.Additionally,combined with the advantages of a two-reference-point selection scheme based on a center point and a corner point,a reference point switching approach was introduced to improve tracking accuracy and consistency.The state estimation capability of the proposed UKF was verified by comparing it with the standard UKF in single-target tracking simulations.Moreover,the performance of the proposed MOT system was evaluated using real traffic datasets.展开更多
基金the National Natural Science Foundation of China (No.61627810)the National Science and Technology Major Program of China (No.2018YFB1305003)the National Defense Science and Technology Outstanding Youth Science Foundation (No.2017-JCJQ-ZQ-031)。
文摘In order to solve the problem of small object size and low detection accuracy under the unmanned aerial vehicle(UAV)platform,the object detection algorithm based on deep aggregation network and high-resolution fusion module is studied.Furthermore,a joint network of object detection and feature extraction is studied to construct a real-time multi-object tracking algorithm.For the problem of object association failure caused by UAV movement,image registration is applied to multi-object tracking and a camera motion discrimination model is proposed to improve the speed of the multi-object tracking algorithm.The simulation results show that the algorithm proposed in this study can improve the accuracy of multi-object tracking under the UAV platform,and effectively solve the problem of association failure caused by UAV movement.
基金supported by the National Natural Science Foundation of China(No.62302130).
文摘As a vital technology in Cyber-Physical Social Intelligence (CPSI), Multi-Object-Tracking (MOT) can support comprehensive perception and analysis of the physical environment and social virtual space, promoting an in-depth understanding of human behavior, object movement, and social interaction. Most MOT methods often adopt simple interpolation or prediction strategies when dealing with temporarily lost targets, but ignore the comprehensive consideration of the state of the target before its reappearance. This approach may lead to an incomplete understanding of the target’s behavior and dynamics, which affects the accuracy and depth of the comprehensive understanding of social and physical space interactions in the real world. To improve it, we propose an online multi-object tracking method based on Record Confidence and Hierarchical Association (RCHA), which is represented as RCHA-Track. The Kalman filter combined with an Enhanced Correlation Coefficient (ECC) provides more accurate motion prediction under the influence of camera motion. The record confidence is designed to evaluate the loss status of the unseen object and refine the tracking trajectory. The normally tracked targets and the temporarily lost targets are combined to perform a hierarchical association based on the number of lost frames to achieve more accurate data associations. Compared with the latest ByteTrack, RCHA-Track improves MOTA, IDF1, and HOTA by 1.7%, 1.6%, and 1.3% on the benchmark dataset MOT17, and 1.3%, 2.1%, and 2.0% on MOT20, respectively, achieving state-of-the-art performance. Extensive ablation experiments demonstrate the effectiveness of each key module in the proposed RCHA-Track.
基金funded by the Fundamental Research Funds for the Central Universities(Grant No.106-YDZX2025022)the Startup Foundation of New Professor at Nanjing Agricultural University(Grant No.106-804005)the“Qing Lan Project”of Jiangsu Higher Education Institutions.
文摘Understanding fish movement trajectories in aquaculture is essential for practical applications,such as disease warning,feeding optimization,and breeding management.These trajectories reveal key information about the fish’s behavior,health,and environmental adaptability.However,when multi-object tracking(MOT)algorithms are applied to the high-density aquaculture environment,occlusion and overlapping among fish may result in missed detections,false detections,and identity switching problems,which limit the tracking accuracy.To address these issues,this paper proposes FishTracker,a MOT algorithm,by utilizing a Tracking-by-Detection framework.First,the neck part of the YOLOv8 model is enhanced by introducing a Multi-Scale Dilated Attention(MSDA)module to improve object localization and classification confidence.Second,an Adaptive Kalman Filter(AKF)is employed in the tracking phase to dynamically adjust motion prediction parameters,thereby overcoming target adhesion and nonlinear motion in complex scenarios.Experimental results show that FishTracker achieves a multi-object tracking accuracy(MOTA)of 93.22% and 87.24% in bright and dark illumination conditions,respectively.Further validation in a real aquaculture scenario reveal that FishTracker achieves aMOTA of 76.70%,which is 5.34% higher than the baselinemodel.The higher order tracking accuracy(HOTA)reaches 50.5%,which is 3.4% higher than the benchmark.In conclusion,FishTracker can provide reliable technical support for accurate tracking and behavioral analysis of high-density fish populations.
基金supported in part by the National Natural Science Foundation of China(62222301,62373012,62473012,62021003)the National Science and Technology Major Project(2021ZD0112302,2021ZD0112301)the Beijing Natural Science Foundation(JQ19013)
文摘In this paper, a fault-tolerant-based online critic learning algorithm is developed to solve the optimal tracking control issue for nonaffine nonlinear systems with actuator faults.First, a novel augmented plant is constructed by fusing the system state and the reference trajectory, which aims to transform the optimal fault-tolerant tracking control design with actuator faults into the optimal regulation problem of the conventional nonlinear error system. Subsequently, in order to ensure the normal execution of the online learning algorithm, a stability criterion condition is created to obtain an initial admissible tracking policy. Then, the constructed model neural network(NN) is pretrained to recognize the system dynamics and calculate trajectory control. The critic and action NNs are constructed to output the approximate cost function and approximate tracking control,respectively. The Hamilton-Jacobi-Bellman equation of the error system is solved online through the action-critic framework. In theoretical analysis, it is proved that all concerned signals are uniformly ultimately bounded according to the Lyapunov principle.The tracking control law can approach the optimal tracking control within a finite approximation error. Finally, two experimental examples are conducted to indicate the effectiveness and superiority of the developed fault-tolerant tracking control scheme.
基金funded by the China Academy of Railway Sciences Corporation Limited Scientific Research Project(No:2023YJ080).
文摘Purpose-With the rapid advancement of China’s high-speed rail network,the density of train operations is on the rise.To address the challenge of shortening train tracking intervals while enhancing transportation efficiency,the multi-objective dynamic optimization of the train operation process has emerged as a critical issue.Design/methodology/approach-Train dynamic model is established by analyzing the force of the train in the process of tracing operation.The train tracing operation model is established according to the dynamic mechanical model of the train tracking process,and the dynamic optimization analysis is carried out with comfort,energy saving and punctuality as optimization objectives.To achieve multi-objective dynamic optimization,a novel train tracking operation calculation method is proposed,utilizing the improved grey wolf optimization algorithm(MOGWO).The proposed method is simulated and verified based on the train characteristics and line data of CR400AF electric multiple units.Findings-The simulation results prove that the optimized MOGWO algorithm can be computed quickly during train tracks,the optimum results can be given within 5s and the algorithm can converge effectively in different optimization target directions.The optimized speed profile of the MOGWO algorithm is smoother and more stable and meets the target requirements of energy saving,punctuality and comfort while maximally respecting the speed limit profile.Originality/value-The MOGWO train tracking interval optimization method enhances the tracking process while ensuring a safe tracking interval.This approach enables the trailing train to operate more comfortably,energy-efficiently and punctually,aligning with passenger needs and industry trends.The method offers valuable insights for optimizing the high-speed train tracking process.
基金supported by National Natural Science Foundation of China(No.61203343)Natural Science Foundation of Hebei Province(No.E2014209106)+1 种基金Science and Technology Research Project of Hebei Provincial Department of Education(Nos.QN2016102 and QN2016105)the Graduate Student Innovation Fund of North China University of Science and Technology(No.2016S10)
文摘Existing tracking algorithms often suffer from the drift and lost problems caused by factors such as pose variation, illumination change, occlusion and motion. Therefore, developing a robust and effective tracker is still a challenging task. In this paper, we propose a real-time compressive tracking based on online Hough forest. The gray and texture features of discrete samples are extracted and compressed via the random measurement matrix. Online Hough forest classifier is used to vote the location probability of the target, and it optimizes the confidence map estimation for the target detection. The location of target being tracked is determined by combining the upper frame of the target center location and the probability confidence map of the incremental Hough forest. Finally, the classifier parameters are updated online by introducing the illumination variation and target occlusion feedback mechanism adaptively. The experiments with state-of-the-art algorithms on challenging sequences demonstrated that the proposed algorithm can effectively enhance the robustness and accuracy, and inherit the real-time performance of the compressive tracking algorithm.
基金This work was supported by the National Key Research and Development Program of China(No.2016YFC0802904)National Natural Science Foundation of China(No.61671470)+1 种基金Natural Science Foundation of Jiangsu Province(BK20161470)62nd batch of funded projects of China Postdoctoral Science Foundation(No.2017M623423).
文摘The multi-armored target tracking(MATT)plays a crucial role in coordinated tracking and strike.The occlusion and insertion among targets and target scale variation is the key problems in MATT.Most stateof-the-art multi-object tracking(MOT)works adopt the tracking-by-detection strategy,which rely on compute-intensive sliding window or anchoring scheme in detection module and neglect the target scale variation in tracking module.In this work,we proposed a more efficient and effective spatial-temporal attention scheme to track multi-armored target in the ground battlefield.By simulating the structure of the retina,a novel visual-attention Gabor filter branch is proposed to enhance detection.By introducing temporal information,some online learned target-specific Convolutional Neural Networks(CNNs)are adopted to address occlusion.More importantly,we built a MOT dataset for armored targets,called Armored Target Tracking dataset(ATTD),based on which several comparable experiments with state-ofthe-art methods are conducted.Experimental results show that the proposed method achieves outstanding tracking performance and meets the actual application requirements.
文摘Multi-object tracking is a vital problem as many applications require better tracking approaches.Although learning-based detectors are becoming extremely powerful,there are few tracking methods designed to work with them in real time.We explored an efficient flexible online vehicle tracking-by-detection framework suitable for real-virtual mapping systems,which combines a non-recursive temporal window search with delayed output and produces stable trajectories despite noisy detection responses.Its computation speed meets the real-time requirements,whereas its performance is comparable with that of state-of-the-art online trackers on the DETRAC dataset.The trajectories from our approach also contain the target class and color information important for virtual vehicle motion reconstruction.
基金The National Natural Science Foundation of China(No.60574006,60804017)
文摘To cope with multi-object tracking under real-world complex situations, a new video-based method is proposed. In the detecting step, the moving objects are segmented with the third level DWT （discrete wavelet transform ）and background difference. In the tracking step, the Kalman filter and scale parameter are used first to estimate the object position and bounding box. Then, the center-association-based projection ratio and region-association-based occlusion ratio are defined and combined to judge object behaviours. Finally, the tracking scheme and Kalman parameters are adaptively adjusted according to object behaviour. Under occlusion, partial observability is utilized to obtain the object measurements and optimum box dimensions. This method is robust in tracking mobile objects under such situations as occlusion, new appearing and stablization, etc. Experimental results show that the proposed method is efficient.
基金supported by the Research Foundation of Nanjing University of Posts and Telecommunications (No.NY219076)。
文摘Multi-object tracking(MOT) techniques have been increasingly applied in a diverse range of tasks. Unmanned aerial vehicle(UAV) is one of its typical application scenarios. Due to the scene complexity and the low resolution of moving targets in UAV applications, it is difficult to extract target features and identify them. In order to solve this problem, we propose a new re-identification(re-ID) network to extract association features for tracking in the association stage. Moreover, in order to reduce the complexity of detection model, we perform the lightweight optimization for it. Experimental results show that the proposed re-ID network can effectively reduce the number of identity switches, and surpass current state-of-the-art algorithms. In the meantime, the optimized detector can increase the speed by 27% owing to its lightweight design, which enables it to further meet the requirements of UAV tracking tasks.
基金supported by Institute of Information&communications Technology Planning&Evaluation(IITP)Grant funded by the Korea government(MSIT)(No.2018-0-00387Development of ICT based Intelligent Smart Welfare Housing System for the Prevention and Control of Livestock Disease).
文摘Pig farmers want to have an effective solution for automatically detecting and tracking multiple pigs and alerting their conditions in order to recognize disease risk factors quickly.In this paper,therefore,we propose a novel monitoring system using an Artificial Intelligence of Things(AIoT)technique combining artificial intelligence and Internet of Things(IoT).The proposed system consists of AIoT edge devices and a central monitoring server.First,an AIoT edge device extracts video frame images from a CCTV camera installed in a pig pen by a frame extraction method,detects multiple pigs in the images by a faster region-based convolutional neural network(RCNN)model,and tracks them by an object center-point tracking algorithm(OCTA)based on bounding box regression outputs of the faster RCNN.Finally,it sends multi-pig tracking images to the central monitoring server,which alerts them to pig farmers through a social networking service(SNS)agent in cooperation with an oneM2M-compliant IoT alerting method.Experimental results showed that the multi-pig tracking method achieved the multi-object tracking accuracy performance of about 77%.In addition,we verified alerting operation by confirming the images received in the SNS smartphone application.
基金Supported by the National Natural Science Foundation of China(6160303040,61433003)Yunnan Applied Basic Research Project of China(201701CF00037)Yunnan Provincial Science and Technology Department Key Research Program(Engineering)(2018BA070)
文摘A simple yet efficient tracking framework is proposed for real-time multi-object tracking with micro aerial vehicles(MAVs). It's basic missions for MAVs to detect specific targets and then track them automatically. In our method, candidate regions are generated using the salient detection in each frame and then classified by an eural network. A kernelized correlation filter(KCF) is employed to track each target until it disappears or the peak-sidelobe ratio is lower than a threshold. Besides, we define the birth and death of each tracker for the targets. The tracker is recycled if its target disappears and can be assigned to a new target. The algorithm is evaluated on the PAFISS and UAV123 datasets. The results show a good performance on both the tracking accuracy and speed.
基金Supported by the National Natural Science Foundation of China(No.90820302,60805027)the Research Fund for Doctoral Program of Higher Education(No.200805330005)the Academician Foundation of Hunan(No.2009FJ4030)
文摘Target tracking in wireless sensor network usually schedules a subset of sensor nodes to constitute a tasking cluster to collaboratively track a target.For the goals of saving energy consumption,prolonging network lifetime and improving tracking accuracy,sensor node scheduling for target tracking is indeed a multi-objective optimization problem.In this paper,a multi-objective optimization sensor node scheduling algorithm is proposed.It employs the unscented Kalman filtering algorithm for target state estimation and establishes tracking accuracy index,predicts the energy consumption of candidate sensor nodes,analyzes the relationship between network lifetime and remaining energy balance so as to construct energy efficiency index.Simulation results show that,compared with the existing sensor node scheduling,our proposed algorithm can achieve superior tracking accuracy and energy efficiency.
基金Supported by National Natural Science Foundation of China(Grant Nos.52375018,92148301).
文摘Contour error is the deviation between the actual displacement and reference trajectory,which is directly related to the machining accuracy.Contour error compensation poses substantial challenges because of the time-varying,nonlinear,and strongly coupled characteristics of parallel machining modules.In addition,the time delay in the system reduces the timeliness of the feedback data,thereby making online contour error calculations and compensation particularly difficult.To solve this problem,the generation mechanism of the time delay of the feedback data and contour error is revealed,and a systematic method for the identification of the time-delay parameter based on Beckhoff’s tracking error calculation mechanism is proposed.The temporal alignment between the position commands and feedback data enables the online calculation of the contour error.On this basis,the tracking error of the drive axes(an important factor resulting in end-effector contour errors)is used for the contour error calculation.Considering the ambiguous parameter-setting logic of the servo drive,the servo parameter is calculated in reverse using the steady-state error to obtain the tracking error model of the drive axes.Furthermore,combined with the system time-delay model,an online correction method for the tracking error estimation model is established.To achieve an accurate mapping of the drive-axis tracking error and end-effector contour error,a bounded iterative search method for the nearest contour point and online calculation model for the contour error are respectively established.Finally,an online compensation controller for contour error is designed.Its effectiveness is verified by a machining experiment on a frame workpiece.The machining results show that the contour error reduces from 68μm to 45μm,and the finish machining accuracy increases by 34%.This study provides a feasible method for online compensation of contour error in a system with time delay.
基金supported by the STI 2030-Major Projects(2022ZD0211900,2022ZD0211902)STI 2030-Major Projects(2021ZD0204500,2021ZD0204503)+1 种基金National Natural Science Foundation of China(32171461)National Key Research and Development Program of China(2023YFC3208303)。
文摘Advancements in animal behavior quantification methods have driven the development of computational ethology,enabling fully automated behavior analysis.Existing multianimal pose estimation workflows rely on tracking-bydetection frameworks for either bottom-up or top-down approaches,requiring retraining to accommodate diverse animal appearances.This study introduces InteBOMB,an integrated workflow that enhances top-down approaches by incorporating generic object tracking,eliminating the need for prior knowledge of target animals while maintaining broad generalizability.InteBOMB includes two key strategies for tracking and segmentation in laboratory environments and two techniques for pose estimation in natural settings.The“background enhancement”strategy optimizesforeground-backgroundcontrastiveloss,generating more discriminative correlation maps.The“online proofreading”strategy stores human-in-the-loop long-term memory and dynamic short-term memory,enabling adaptive updates to object visual features.The“automated labeling suggestion”technique reuses the visual features saved during tracking to identify representative frames for training set labeling.Additionally,the“joint behavior analysis”technique integrates these features with multimodal data,expanding the latent space for behavior classification and clustering.To evaluate the framework,six datasets of mice and six datasets of nonhuman primates were compiled,covering laboratory and natural scenes.Benchmarking results demonstrated a24%improvement in zero-shot generic tracking and a 21%enhancement in joint latent space performance across datasets,highlighting the effectiveness of this approach in robust,generalizable behavior analysis.
基金supported by the National Natural Science Foundation of China(No.62202143)Key Research and Promotion Projects of Henan Province(Nos.232102240023,232102210063,222102210040).
文摘Multi-object tracking(MOT)has seen rapid improvements in recent years.However,frequent occlusion remains a significant challenge in MOT,as it can cause targets to become smaller or disappear entirely,resulting in lowquality targets,leading to trajectory interruptions and reduced tracking performance.Different from some existing methods,which discarded the low-quality targets or ignored low-quality target attributes.LQTTrack,with a lowquality association strategy(LQA),is proposed to pay more attention to low-quality targets.In the association scheme of LQTTrack,firstly,multi-scale feature fusion of FPN(MSFF-FPN)is utilized to enrich the feature information and assist in subsequent data association.Secondly,the normalized Wasserstein distance(NWD)is integrated to replace the original Inter over Union(IoU),thus overcoming the limitations of the traditional IoUbased methods that are sensitive to low-quality targets with small sizes and enhancing the robustness of low-quality target tracking.Moreover,the third association stage is proposed to improve the matching between the current frame’s low-quality targets and previously interrupted trajectories from earlier frames to reduce the problem of track fragmentation or error tracking,thereby increasing the association success rate and improving overall multi-object tracking performance.Extensive experimental results demonstrate the competitive performance of LQTTrack on benchmark datasets(MOT17,MOT20,and DanceTrack).
文摘Recent advances in automation and digitization enable the close integration of physical devices with their virtual counterparts, facilitating the real-time modeling and optimization of a multitude of processes in an automatic way. The rich and continuously updated data environment provided by such systems makes it possible for decisions to be made over time to drive the process toward optimal targets. In many man- ufacturing processes, in order to achieve an overall optimal process, the simultaneous assessment of mul- tiple objective functions related to process performance and cost is necessary. In this work, a multi- objective optimal experimental design framework is proposed to enhance the ef ciency of online model-identi cation platforms. The proposed framework permits exibility in the choice of trade-off experimental design solutions, which are calculated online that is, during the execution of experiments. The application of this framework to improve the online identi cation of kinetic models in ow reactors is illustrated using a case study in which a kinetic model is identi ed for the esteri cation of benzoic acid and ethanol in a microreactor.
文摘Background With the rapid development of Web3D, virtual reality, and digital twins, virtual trajectories and decision data considerably rely on the analysis and understanding of real video data, particularly in emergency evacuation scenarios. Correctly and effectively evacuating crowds in virtual emergency scenarios are becoming increasingly urgent. One good solution is to extract pedestrian trajectories from videos of emergency situations using a multi-target tracking algorithm and use them to define evacuation procedures. Methods To implement this solution, a trajectory extraction and optimization framework based on multi-target tracking is developed in this study. First, a multi-target tracking algorithm is used to extract and preprocess the trajectory data of the crowd in a video. Then, the trajectory is optimized by combining the trajectory point extraction algorithm and Savitzky-Golay smoothing filtering method. Finally, related experiments are conducted, and the results show that the proposed approach can effectively and accurately extract the trajectories of multiple target objects in real time. Results In addition, the proposed approach retains the real characteristics of the trajectories as much as possible while improving the trajectory smoothing index, which can provide data support for the analysis of pedestrian trajectory data and formulation of personnel evacuation schemes in emergency scenarios. Conclusions Further comparisons with methods used in related studies confirm the feasibility and superiority of the proposed framework.
文摘On grounds of the advent of real-time applications,like autonomous driving,visual surveillance,and sports analysis,there is an augmenting focus of attention towards Multiple-Object Tracking(MOT).The tracking-by-detection paradigm,a commonly utilized approach,connects the existing recognition hypotheses to the formerly assessed object trajectories by comparing the simila-rities of the appearance or the motion between them.For an efficient detection and tracking of the numerous objects in a complex environment,a Pearson Simi-larity-centred Kuhn-Munkres(PS-KM)algorithm was proposed in the present study.In this light,the input videos were,initially,gathered from the MOT dataset and converted into frames.The background subtraction occurred whichfiltered the inappropriate data concerning the frames after the frame conversion stage.Then,the extraction of features from the frames was executed.Afterwards,the higher dimensional features were transformed into lower-dimensional features,and feature reduction process was performed with the aid of Information Gain-centred Singular Value Decomposition(IG-SVD).Next,using the Modified Recurrent Neural Network(MRNN)method,classification was executed which identified the categories of the objects additionally.The PS-KM algorithm identi-fied that the recognized objects were tracked.Finally,the experimental outcomes exhibited that numerous targets were precisely tracked by the proposed system with 97%accuracy with a low false positive rate(FPR)of 2.3%.It was also proved that the present techniques viz.RNN,CNN,and KNN,were effective with regard to the existing models.
基金the National Natural Science Foundation of China(No.51775331)。
文摘In this study,a multi-object tracking(MOT)scheme based on a light detection and ranging sensor was proposed to overcome imprecise velocity observations in object occlusion scenarios.By applying real-time velocity estimation,a modified unscented Kalman filter(UKF)was proposed for the state estimation of a target object.The proposed method can reduce the calculation cost by obviating unscented transformations.Additionally,combined with the advantages of a two-reference-point selection scheme based on a center point and a corner point,a reference point switching approach was introduced to improve tracking accuracy and consistency.The state estimation capability of the proposed UKF was verified by comparing it with the standard UKF in single-target tracking simulations.Moreover,the performance of the proposed MOT system was evaluated using real traffic datasets.
