To address the issues of frequent identity switches(IDs)and degraded identification accuracy in multi object tracking(MOT)under complex occlusion scenarios,this study proposes an occlusion-robust tracking framework ba...To address the issues of frequent identity switches(IDs)and degraded identification accuracy in multi object tracking(MOT)under complex occlusion scenarios,this study proposes an occlusion-robust tracking framework based on face-pedestrian joint feature modeling.By constructing a joint tracking model centered on“intra-class independent tracking+cross-category dynamic binding”,designing a multi-modal matching metric with spatio-temporal and appearance constraints,and innovatively introducing a cross-category feature mutual verification mechanism and a dual matching strategy,this work effectively resolves performance degradation in traditional single-category tracking methods caused by short-term occlusion,cross-camera tracking,and crowded environments.Experiments on the Chokepoint_Face_Pedestrian_Track test set demonstrate that in complex scenes,the proposed method improves Face-Pedestrian Matching F1 area under the curve(F1 AUC)by approximately 4 to 43 percentage points compared to several traditional methods.The joint tracking model achieves overall performance metrics of IDF1:85.1825%and MOTA:86.5956%,representing improvements of 0.91 and 0.06 percentage points,respectively,over the baseline model.Ablation studies confirm the effectiveness of key modules such as the Intersection over Area(IoA)/Intersection over Union(IoU)joint metric and dynamic threshold adjustment,validating the significant role of the cross-category identity matching mechanism in enhancing tracking stability.Our_model shows a 16.7%frame per second(FPS)drop vs.fairness of detection and re-identification in multiple object tracking(FairMOT),with its cross-category binding module adding aboute 10%overhead,yet maintains near-real-time performance for essential face-pedestrian tracking at small resolutions.展开更多
This paper synchronizes control theory with computer vision by formalizing object tracking as a sequential decision-making process.A reinforcement learning(RL)agent successfully tracks an interface between two liquids...This paper synchronizes control theory with computer vision by formalizing object tracking as a sequential decision-making process.A reinforcement learning(RL)agent successfully tracks an interface between two liquids,which is often a critical variable to track in many chemical,petrochemical,metallurgical,and oil industries.This method utilizes less than 100 images for creating an environment,from which the agent generates its own data without the need for expert knowledge.Unlike supervised learning(SL)methods that rely on a huge number of parameters,this approach requires far fewer parameters,which naturally reduces its maintenance cost.Besides its frugal nature,the agent is robust to environmental uncertainties such as occlusion,intensity changes,and excessive noise.From a closed-loop control context,an interface location-based deviation is chosen as the optimization goal during training.The methodology showcases RL for real-time object-tracking applications in the oil sands industry.Along with a presentation of the interface tracking problem,this paper provides a detailed review of one of the most effective RL methodologies:actor–critic policy.展开更多
An important and challenging aspect of developing an intelligent transportation system is the identification of nighttime vehicles. Most accidents occur at night owing to the absence of night lighting conditions. Vehi...An important and challenging aspect of developing an intelligent transportation system is the identification of nighttime vehicles. Most accidents occur at night owing to the absence of night lighting conditions. Vehicle detection has become a vital subject for research to ensure safety and avoid accidents. New vision-based on-road nighttime vehicle detection and tracking system are suggested in this survey paper using taillight and headlight features. Using computer vision and some image processing techniques, the proposed system can identify vehicles based on taillight and headlight features. For vehicle tracking, a centroid tracking algorithm has been used. Euclidean Distance method has been used for measuring the distances between two neighboring objects and tracks the nearest neighbor. In the proposed system two flexible fixed Region of Interest (ROI) have been used, one is the Headlight ROI, and another is the Taillight ROI that could adapt to different resolutions of the images and videos. The achievement of this research work is that the proposed two ROIs can work simultaneously in a frame to identify oncoming and preceding vehicles at night. The segmentation techniques and double thresholding method have been used to extract the red and white components from the scene to identify the vehicle headlights and taillights. To evaluate the capability of the proposed process, two types of datasets have been used. Experimental findings indicate that the performance of the proposed technique is reliable and effective in distinct nighttime environments for detection and tracking of vehicles. The proposed method has been able to detect and track double lights as well as single light such as motorcycle light and achieved average accuracy and average processing time of vehicle detection about 97.22% and 0.01 s per frame respectively.展开更多
Controlling multiple multi-joint fish-like robots has long captivated the attention of engineers and biologists,for which a fundamental but challenging topic is to robustly track the postures of the individuals in rea...Controlling multiple multi-joint fish-like robots has long captivated the attention of engineers and biologists,for which a fundamental but challenging topic is to robustly track the postures of the individuals in real time.This requires detecting multiple robots,estimating multi-joint postures,and tracking identities,as well as processing fast in real time.To the best of our knowledge,this challenge has not been tackled in the previous studies.In this paper,to precisely track the planar postures of multiple swimming multi-joint fish-like robots in real time,we propose a novel deep neural network-based method,named TAB-IOL.Its TAB part fuses the top-down and bottom-up approaches for vision-based pose estimation,while the IOL part with long short-term memory considers the motion constraints among joints for precise pose tracking.The satisfying performance of our TAB-IOL is verified by testing on a group of freely swimming fish-like robots in various scenarios with strong disturbances and by a deed comparison of accuracy,speed,and robustness with most state-of-the-art algorithms.Further,based on the precise pose estimation and tracking realized by our TAB-IOL,several formation control experiments are conducted for the group of fish-like robots.The results clearly demonstrate that our TAB-IOL lays a solid foundation for the coordination control of multiple fish-like robots in a real working environment.We believe our proposed method will facilitate the growth and development of related fields.展开更多
Atom tracking technology enhanced with innovative algorithms has been implemented in this study,utilizing a comprehensive suite of controllers and software independently developed domestically.Leveraging an on-board f...Atom tracking technology enhanced with innovative algorithms has been implemented in this study,utilizing a comprehensive suite of controllers and software independently developed domestically.Leveraging an on-board field-programmable gate array(FPGA)with a core frequency of 100 MHz,our system facilitates reading and writing operations across 16 channels,performing discrete incremental proportional-integral-derivative(PID)calculations within 3.4 microseconds.Building upon this foundation,gradient and extremum algorithms are further integrated,incorporating circular and spiral scanning modes with a horizontal movement accuracy of 0.38 pm.This integration enhances the real-time performance and significantly increases the accuracy of atom tracking.Atom tracking achieves an equivalent precision of at least 142 pm on a highly oriented pyrolytic graphite(HOPG)surface under room temperature atmospheric conditions.Through applying computer vision and image processing algorithms,atom tracking can be used when scanning a large area.The techniques primarily consist of two algorithms:the region of interest(ROI)-based feature matching algorithm,which achieves 97.92%accuracy,and the feature description-based matching algorithm,with an impressive 99.99%accuracy.Both implementation approaches have been tested for scanner drift measurements,and these technologies are scalable and applicable in various domains of scanning probe microscopy with broad application prospects in the field of nanoengineering.展开更多
This work proposes the application of an iterative learning model predictive control(ILMPC)approach based on an adaptive fault observer(FOBILMPC)for fault-tolerant control and trajectory tracking in air-breathing hype...This work proposes the application of an iterative learning model predictive control(ILMPC)approach based on an adaptive fault observer(FOBILMPC)for fault-tolerant control and trajectory tracking in air-breathing hypersonic vehicles.In order to increase the control amount,this online control legislation makes use of model predictive control(MPC)that is based on the concept of iterative learning control(ILC).By using offline data to decrease the linearized model’s faults,the strategy may effectively increase the robustness of the control system and guarantee that disturbances can be suppressed.An adaptive fault observer is created based on the suggested ILMPC approach in order to enhance overall fault tolerance by estimating and compensating for actuator disturbance and fault degree.During the derivation process,a linearized model of longitudinal dynamics is established.The suggested ILMPC approach is likely to be used in the design of hypersonic vehicle control systems since numerical simulations have demonstrated that it can decrease tracking error and speed up convergence when compared to the offline controller.展开更多
This paper investigates the challenges associated with Unmanned Aerial Vehicle (UAV) collaborative search and target tracking in dynamic and unknown environments characterized by limited field of view. The primary obj...This paper investigates the challenges associated with Unmanned Aerial Vehicle (UAV) collaborative search and target tracking in dynamic and unknown environments characterized by limited field of view. The primary objective is to explore the unknown environments to locate and track targets effectively. To address this problem, we propose a novel Multi-Agent Reinforcement Learning (MARL) method based on Graph Neural Network (GNN). Firstly, a method is introduced for encoding continuous-space multi-UAV problem data into spatial graphs which establish essential relationships among agents, obstacles, and targets. Secondly, a Graph AttenTion network (GAT) model is presented, which focuses exclusively on adjacent nodes, learns attention weights adaptively and allows agents to better process information in dynamic environments. Reward functions are specifically designed to tackle exploration challenges in environments with sparse rewards. By introducing a framework that integrates centralized training and distributed execution, the advancement of models is facilitated. Simulation results show that the proposed method outperforms the existing MARL method in search rate and tracking performance with less collisions. The experiments show that the proposed method can be extended to applications with a larger number of agents, which provides a potential solution to the challenging problem of multi-UAV autonomous tracking in dynamic unknown environments.展开更多
To realize effective co-phasing adjustment in large-aperture sparse-aperture telescopes,a multichannel stripe tracking approach is employed,allowing simultaneous interferometric measurements of multiple optical paths ...To realize effective co-phasing adjustment in large-aperture sparse-aperture telescopes,a multichannel stripe tracking approach is employed,allowing simultaneous interferometric measurements of multiple optical paths and circumventing the need for pairwise measurements along the mirror boundaries in traditional interferometric methods.This approach enhances detection efficiency and reduces system complexity.Here,the principles of the multibeam interference process and construction of a co-phasing detection module based on direct optical fiber connections were analyzed using wavefront optics theory.Error analysis was conducted on the system surface obtained through multipath interference.Potential applications of the interferometric method were explored.Finally,the principle was verified by experiment,an interferometric fringe contrast better than 0.4 is achieved through flat field calibration and incoherent digital synthesis.The dynamic range of the measurement exceeds 10 times of the center wavelength of the working band(1550 nm).Moreover,a resolution better than one-tenth of the working center wavelength(1550 nm)was achieved.Simultaneous three-beam interference can be achieved,leading to a 50%improvement in detection efficiency.This method can effectively enhance the efficiency of sparse aperture telescope co-phasing,meeting the requirements for observations of 8-10 m telescopes.This study provides a technological foundation for observing distant and faint celestial objects.展开更多
This paper presents the design and ground verification for vision-based relative navigation systems of microsatellites,which offers a comprehensive hardware design solution and a robust experimental verification metho...This paper presents the design and ground verification for vision-based relative navigation systems of microsatellites,which offers a comprehensive hardware design solution and a robust experimental verification methodology for practical implementation of vision-based navigation technology on the microsatellite platform.Firstly,a low power consumption,light weight,and high performance vision-based relative navigation optical sensor is designed.Subsequently,a set of ground verification system is designed for the hardware-in-the-loop testing of the vision-based relative navigation systems.Finally,the designed vision-based relative navigation optical sensor and the proposed angles-only navigation algorithms are tested on the ground verification system.The results verify that the optical simulator after geometrical calibration can meet the requirements of the hardware-in-the-loop testing of vision-based relative navigation systems.Based on experimental results,the relative position accuracy of the angles-only navigation filter at terminal time is increased by 25.5%,and the relative speed accuracy is increased by 31.3% compared with those of optical simulator before geometrical calibration.展开更多
Unmanned aerial vehicles(UAVs)have become crucial tools in moving target tracking due to their agility and ability to operate in complex,dynamic environments.UAVs must meet several requirements to achieve stable track...Unmanned aerial vehicles(UAVs)have become crucial tools in moving target tracking due to their agility and ability to operate in complex,dynamic environments.UAVs must meet several requirements to achieve stable tracking,including maintaining continuous target visibility amidst occlusions,ensuring flight safety,and achieving smooth trajectory planning.This paper reviews the latest advancements in UAV-based target tracking,highlighting information prediction,tracking strategies,and swarm cooperation.To address challenges including target visibility and occlusion,real-time prediction and tracking in dynamic environments,flight safety and coordination,resource management and energy efficiency,the paper identifies future research directions aimed at improving the performance,reliability,and scalability of UAV tracking system.展开更多
Multiple Object Tracking(MOT)is essential for applications such as autonomous driving,surveillance,and analytics;However,challenges such as occlusion,low-resolution imaging,and identity switches remain persistent.We p...Multiple Object Tracking(MOT)is essential for applications such as autonomous driving,surveillance,and analytics;However,challenges such as occlusion,low-resolution imaging,and identity switches remain persistent.We propose HAMOT,a hierarchical adaptive multi-object tracker that solves these challenges with a novel,unified framework.Unlike previous methods that rely on isolated components,HAMOT incorporates a Swin Transformer-based Adaptive Enhancement(STAE)module—comprising Scene-Adaptive Transformer Enhancement and Confidence-Adaptive Feature Refinement—to improve detection under low-visibility conditions.The hierarchical DynamicGraphNeuralNetworkwith TemporalAttention(DGNN-TA)models both short-and long-termassociations,and the Adaptive Unscented Kalman Filter with Gated Recurrent Unit(AUKF-GRU)ensures accurate motion prediction.The novel Graph-Based Density-Aware Clustering(GDAC)improves occlusion recovery by adapting to scene density,preserving identity integrity.This integrated approach enables adaptive responses to complex visual scenarios,Achieving exceptional performance across all evaluation metrics,including aHigher Order TrackingAccuracy(HOTA)of 67.05%,a Multiple Object Tracking Accuracy(MOTA)of 82.4%,an ID F1 Score(IDF1)of 83.1%,and a total of 1052 Identity Switches(IDSW)on theMOT17;66.61%HOTA,78.3%MOTA,82.1%IDF1,and a total of 748 IDSWonMOT20;and 66.4%HOTA,92.32%MOTA,and 68.96%IDF1 on DanceTrack.With fixed thresholds,the full HAMOT model(all six components)achieves real-time functionality at 24 FPS on MOT17 using RTX3090,ensuring robustness and scalability for real-world MOT applications.展开更多
Unlike ensemble-averaging measurements,single-molecule tracking provides quantitative information on the kinetics of individual molecules within living cells in real time and may provide insight into the respective mo...Unlike ensemble-averaging measurements,single-molecule tracking provides quantitative information on the kinetics of individual molecules within living cells in real time and may provide insight into the respective molecular interactions behind that.The advancement of single-molecule tracking has been signi-cantly boosted by the development of high-resolution microscopy techniques.In this review,we will discuss this aspect with a particular focus on their recent advance in MINFLUX nanoscopy with feedback approaches where tracking is performed in real time.MINFLUX localization requires fewer than 100 photons from a-1 nm-sized°uorophore,enabling precise tracking.This approach,which demands over an order of magnitude fewer photons than other localization-based techniques(such as STORM,PLAM),allows molecular tracking with single-digit nanometer accuracy in less than 1 ms—an achievement previously unattainable.展开更多
Background:Early identification of concussion-related vision disorders(CRVDs)may improve outcomes by enabling earlier management,referral,and treatment.Objective eye tracking may provide additional data to support the...Background:Early identification of concussion-related vision disorders(CRVDs)may improve outcomes by enabling earlier management,referral,and treatment.Objective eye tracking may provide additional data to support the diagnose of CRVDs.The purpose of this study was to determine the utility of objective infrared eye tracking in identifying CRVDs among adolescents experiencing persisting post-concussive symptoms(PPCS)more than 28 days after injury.Methods:This was a prospective study of adolescents with PPCS evaluated with visio-vestibular examination(VVE),comprehensive vision examination,and an eye tracking device.Results:Of the 108 adolescents enrolled,67(62%)were diagnosed with a CRVD by comprehensive vision examination.On VVE,the near point of convergence break(5.5±3.2 cm vs.3.9±1.7 cm(mean±SD),p<0.001)and recovery(8.1±3.3 cm vs.6.8±2.3 cm,p=0.02)distinguished between those with and without CRVD.Concussion symptom provocation on VVE with horizontal saccades(35(52%)vs.12(29%),p=0.02)and horizontal vestibulo-ocular reflex testing(37(55%)vs.14(34%),p=0.03),and sway on tandem gait under the forward eyes closed condition(25(37%)vs.6(15%),p=0.01)also identified those with CRVD.From the eye tracking device,the BOX score(8.1±5.8 vs.5.2±4.1,p=0.007)and a metric of the left eye tracking along the bottom of the visual target(0.094±0.500 vs.-0.124±0.410,p=0.02)identified those with CRVD,with a multivariable receiver operating characteristic curve analysis,including the BOX score,achieving an area under the receiver operating characteristic curve of 0.7637.Conclusion:CRVDs are common in those with PPCS,with impact on recovery after concussion.Novel eye-tracking metrics can serve as an aid in the identification of those with CRVDs who would benefit from referral for comprehensive diagnosis and treatment.展开更多
The publisher regrets that the Appendix A.Supplementary data was not updated as per author and editor’s request.The publisher would like to apologise for any inconvenience caused.
Syntax and semantics are two important factors that influence sentence processing.Studies have found different aging effects in syntactic and semantic processing during sentence comprehension.While there is consensus ...Syntax and semantics are two important factors that influence sentence processing.Studies have found different aging effects in syntactic and semantic processing during sentence comprehension.While there is consensus on the aging effects in syntactic processing,the presence of aging in semantic processing remains debated.The present study aimed to explore whether there were aging effects in lexical-semantic information processing in complex sentence.79 participants were recruited to take part in this study,including 40 younger adults(mean age of 21.1±1.19 years)and 39 older adults(mean age of 66.24±3.02 years).Using eye-movement tracking technology and manipulating the animacy of head nouns in Chinese subject relative clauses(SRCs)and object relative clauses(ORCs),we investigated the abilities of young and old adults in relative clauses(RCs)processing.The results of comprehension accuracy revealed a significant effect of aging in RCs processing,with older participants exhibiting poor performance compared with younger counterparts across all four clause conditions.Furthermore,younger participants demonstrated a clear animacy effect in RCs processing,but this effect was not found in older participants.Reading times indicated a prominent aging effect in clause processing,with older participants showing significantly longer reading times across all four types of RCs compared to younger participants.It was observed that processing ORCs in Chinese was relatively easier than processing SRCs.Additionally,a noticeable aging effect in semantic processing was found,specifically,the difficulties of processing SRCs and ORCs vary with the animacy configuration of the head nouns for younger participants but were not observed in older participants.In summary,aging in cognition would also inhinder semantic processing in complex sentence comprehension.展开更多
Siamese tracking algorithms usually take convolutional neural networks(CNNs)as feature extractors owing to their capability of extracting deep discriminative features.However,the convolution kernels in CNNs have limit...Siamese tracking algorithms usually take convolutional neural networks(CNNs)as feature extractors owing to their capability of extracting deep discriminative features.However,the convolution kernels in CNNs have limited receptive fields,making it difficult to capture global feature dependencies which is important for object detection,especially when the target undergoes large-scale variations or movement.In view of this,we develop a novel network called effective convolution mixed Transformer Siamese network(SiamCMT)for visual tracking,which integrates CNN-based and Transformer-based architectures to capture both local information and long-range dependencies.Specifically,we design a Transformer-based module named lightweight multi-head attention(LWMHA)which can be flexibly embedded into stage-wise CNNs and improve the network’s representation ability.Additionally,we introduce a stage-wise feature aggregation mechanism which integrates features learned from multiple stages.By leveraging both location and semantic information,this mechanism helps the SiamCMT to better locate and find the target.Moreover,to distinguish the contribution of different channels,a channel-wise attention mechanism is introduced to enhance the important channels and suppress the others.Extensive experiments on seven challenging benchmarks,i.e.,OTB2015,UAV123,GOT10K,LaSOT,DTB70,UAVTrack112_L,and VOT2018,demonstrate the effectiveness of the proposed algorithm.Specially,the proposed method outperforms the baseline by 3.5%and 3.1%in terms of precision and success rates with a real-time speed of 59.77 FPS on UAV123.展开更多
Crack length measurement algorithms based on computer vision have shown promising engineering application prospects in the field of aircraft fatigue crack monitoring.However,due to the complexity of the monitoring env...Crack length measurement algorithms based on computer vision have shown promising engineering application prospects in the field of aircraft fatigue crack monitoring.However,due to the complexity of the monitoring environment,the subtle visual features of small fatigue cracks,and the impact of structural elastic deformation,directly applying object segmentation algorithms often results in significant measurement errors.Therefore,this paper proposes a high-precision crack length measurement method based on Bidirectional Target Tracking Model(Bi2TM),which integrates crack tip localization,interference identification,and length compensation.First,a general object segmentation model is used to perform rough crack segmentation.Then,the Bi2TM network,combined with the visual features of the structure in different stress states,is employed to track the bidirectional position of the crack tip in the“open”and“closed”states.This ultimately enables interference identification within the rough segmented crack region,achieving highprecision length measurement.In a high-interference environment of aircraft fatigue testing,the proposed method is used to measure 1000 crack images ranging from 1 mm to 11 mm.For more than 90%of the samples,the measurement error is less than 5 pixels,demonstrating significant advantages over the existing methods.展开更多
As a tool for quantifying individuals’visual attention and information processing,eye-tracking technology is gradually being applied in the reform of higher education.This paper focuses on issues in university mathem...As a tool for quantifying individuals’visual attention and information processing,eye-tracking technology is gradually being applied in the reform of higher education.This paper focuses on issues in university mathematics teaching,such as heavy cognitive load,delayed feedback,and insufficient adaptability.Based on theories of cognitive psychology,the study explores application pathways of this technology in cognitive diagnosis,instructional optimization,classroom regulation,personalized support,and teaching assessment.Research shows that eye-tracking data can reveal key cognitive features during the learning process,enhance the visualization of instructional feedback,and improve the scientific basis of decision-making.This provides both theoretical support and practical reference for data-driven and precise transformation in university mathematics education.展开更多
This article investigates the time-varying output group formation tracking control(GFTC)problem for heterogeneous multi-agent systems(HMASs)under switching topologies.The objective is to design a distributed control s...This article investigates the time-varying output group formation tracking control(GFTC)problem for heterogeneous multi-agent systems(HMASs)under switching topologies.The objective is to design a distributed control strategy that enables the outputs of the followers to form the desired sub-formations and track the outputs of the leader in each subgroup.Firstly,novel distributed observers are developed to estimate the states of the leaders under switching topologies.Then,GFTC protocols are designed based on the proposed observers.It is shown that with the distributed protocol,the GFTC problem for HMASs under switching topologies is solved if the average dwell time associated with the switching topologies is larger than a fixed threshold.Finally,an example is provided to illustrate the effectiveness of the proposed control strategy.展开更多
Multiple quadrotors target encirclement is widely used in the intelligent field,as it can effectively monitor and control target behavior.However,it faces the danger of collision,as well as difficulties in localizatio...Multiple quadrotors target encirclement is widely used in the intelligent field,as it can effectively monitor and control target behavior.However,it faces the danger of collision,as well as difficulties in localization and tracking.Therefore,we propose a complete target encirclement method.Firstly,based on Hooke's law,a collision avoidance controller is designed to maintain a safe flying distance among quadrotors.Then,based on the consensus theory,a formation tracking controller is designed to meet the requirements of formation transformation and encirclement tasks,and a stability proof based on Lyapunov was provided.Besides,the target detection is designed based on YOLOv5s,and the target location model is constructed based on the principle of pinhole projection and triangle similarity.Finally,we conducted experiments on the built platform,with 3 reconnaissance quadrotors detecting and localization 3 target vehicles and 7 hunter quadrotors tracking them.The results show that the minimum average error for localization targets with reconnaissance quadrotors can reach 0.1354 m,while the minimum average error for tracking with hunter quadrotors is only 0.2960 m.No quadrotors collision occurred in the whole formation transformation and tracking experiment.In addition,compared with the advanced methods,the proposed method has better performance.展开更多
基金supported by the confidential research grant No.a8317。
文摘To address the issues of frequent identity switches(IDs)and degraded identification accuracy in multi object tracking(MOT)under complex occlusion scenarios,this study proposes an occlusion-robust tracking framework based on face-pedestrian joint feature modeling.By constructing a joint tracking model centered on“intra-class independent tracking+cross-category dynamic binding”,designing a multi-modal matching metric with spatio-temporal and appearance constraints,and innovatively introducing a cross-category feature mutual verification mechanism and a dual matching strategy,this work effectively resolves performance degradation in traditional single-category tracking methods caused by short-term occlusion,cross-camera tracking,and crowded environments.Experiments on the Chokepoint_Face_Pedestrian_Track test set demonstrate that in complex scenes,the proposed method improves Face-Pedestrian Matching F1 area under the curve(F1 AUC)by approximately 4 to 43 percentage points compared to several traditional methods.The joint tracking model achieves overall performance metrics of IDF1:85.1825%and MOTA:86.5956%,representing improvements of 0.91 and 0.06 percentage points,respectively,over the baseline model.Ablation studies confirm the effectiveness of key modules such as the Intersection over Area(IoA)/Intersection over Union(IoU)joint metric and dynamic threshold adjustment,validating the significant role of the cross-category identity matching mechanism in enhancing tracking stability.Our_model shows a 16.7%frame per second(FPS)drop vs.fairness of detection and re-identification in multiple object tracking(FairMOT),with its cross-category binding module adding aboute 10%overhead,yet maintains near-real-time performance for essential face-pedestrian tracking at small resolutions.
文摘This paper synchronizes control theory with computer vision by formalizing object tracking as a sequential decision-making process.A reinforcement learning(RL)agent successfully tracks an interface between two liquids,which is often a critical variable to track in many chemical,petrochemical,metallurgical,and oil industries.This method utilizes less than 100 images for creating an environment,from which the agent generates its own data without the need for expert knowledge.Unlike supervised learning(SL)methods that rely on a huge number of parameters,this approach requires far fewer parameters,which naturally reduces its maintenance cost.Besides its frugal nature,the agent is robust to environmental uncertainties such as occlusion,intensity changes,and excessive noise.From a closed-loop control context,an interface location-based deviation is chosen as the optimization goal during training.The methodology showcases RL for real-time object-tracking applications in the oil sands industry.Along with a presentation of the interface tracking problem,this paper provides a detailed review of one of the most effective RL methodologies:actor–critic policy.
文摘An important and challenging aspect of developing an intelligent transportation system is the identification of nighttime vehicles. Most accidents occur at night owing to the absence of night lighting conditions. Vehicle detection has become a vital subject for research to ensure safety and avoid accidents. New vision-based on-road nighttime vehicle detection and tracking system are suggested in this survey paper using taillight and headlight features. Using computer vision and some image processing techniques, the proposed system can identify vehicles based on taillight and headlight features. For vehicle tracking, a centroid tracking algorithm has been used. Euclidean Distance method has been used for measuring the distances between two neighboring objects and tracks the nearest neighbor. In the proposed system two flexible fixed Region of Interest (ROI) have been used, one is the Headlight ROI, and another is the Taillight ROI that could adapt to different resolutions of the images and videos. The achievement of this research work is that the proposed two ROIs can work simultaneously in a frame to identify oncoming and preceding vehicles at night. The segmentation techniques and double thresholding method have been used to extract the red and white components from the scene to identify the vehicle headlights and taillights. To evaluate the capability of the proposed process, two types of datasets have been used. Experimental findings indicate that the performance of the proposed technique is reliable and effective in distinct nighttime environments for detection and tracking of vehicles. The proposed method has been able to detect and track double lights as well as single light such as motorcycle light and achieved average accuracy and average processing time of vehicle detection about 97.22% and 0.01 s per frame respectively.
基金This work was supported in part by the National Natural Science Foundation of China(61973007,61633002).
文摘Controlling multiple multi-joint fish-like robots has long captivated the attention of engineers and biologists,for which a fundamental but challenging topic is to robustly track the postures of the individuals in real time.This requires detecting multiple robots,estimating multi-joint postures,and tracking identities,as well as processing fast in real time.To the best of our knowledge,this challenge has not been tackled in the previous studies.In this paper,to precisely track the planar postures of multiple swimming multi-joint fish-like robots in real time,we propose a novel deep neural network-based method,named TAB-IOL.Its TAB part fuses the top-down and bottom-up approaches for vision-based pose estimation,while the IOL part with long short-term memory considers the motion constraints among joints for precise pose tracking.The satisfying performance of our TAB-IOL is verified by testing on a group of freely swimming fish-like robots in various scenarios with strong disturbances and by a deed comparison of accuracy,speed,and robustness with most state-of-the-art algorithms.Further,based on the precise pose estimation and tracking realized by our TAB-IOL,several formation control experiments are conducted for the group of fish-like robots.The results clearly demonstrate that our TAB-IOL lays a solid foundation for the coordination control of multiple fish-like robots in a real working environment.We believe our proposed method will facilitate the growth and development of related fields.
基金Project supported by the National Science Fund for Distinguished Young Scholars(Grant No.T2125014)the Special Fund for Research on National Major Research Instruments of the National Natural Science Foundation of China(Grant No.11927808)the CAS Key Technology Research and Development Team Project(Grant No.GJJSTD20200005)。
文摘Atom tracking technology enhanced with innovative algorithms has been implemented in this study,utilizing a comprehensive suite of controllers and software independently developed domestically.Leveraging an on-board field-programmable gate array(FPGA)with a core frequency of 100 MHz,our system facilitates reading and writing operations across 16 channels,performing discrete incremental proportional-integral-derivative(PID)calculations within 3.4 microseconds.Building upon this foundation,gradient and extremum algorithms are further integrated,incorporating circular and spiral scanning modes with a horizontal movement accuracy of 0.38 pm.This integration enhances the real-time performance and significantly increases the accuracy of atom tracking.Atom tracking achieves an equivalent precision of at least 142 pm on a highly oriented pyrolytic graphite(HOPG)surface under room temperature atmospheric conditions.Through applying computer vision and image processing algorithms,atom tracking can be used when scanning a large area.The techniques primarily consist of two algorithms:the region of interest(ROI)-based feature matching algorithm,which achieves 97.92%accuracy,and the feature description-based matching algorithm,with an impressive 99.99%accuracy.Both implementation approaches have been tested for scanner drift measurements,and these technologies are scalable and applicable in various domains of scanning probe microscopy with broad application prospects in the field of nanoengineering.
基金supported by the National Natural Science Foundation of China(12072090).
文摘This work proposes the application of an iterative learning model predictive control(ILMPC)approach based on an adaptive fault observer(FOBILMPC)for fault-tolerant control and trajectory tracking in air-breathing hypersonic vehicles.In order to increase the control amount,this online control legislation makes use of model predictive control(MPC)that is based on the concept of iterative learning control(ILC).By using offline data to decrease the linearized model’s faults,the strategy may effectively increase the robustness of the control system and guarantee that disturbances can be suppressed.An adaptive fault observer is created based on the suggested ILMPC approach in order to enhance overall fault tolerance by estimating and compensating for actuator disturbance and fault degree.During the derivation process,a linearized model of longitudinal dynamics is established.The suggested ILMPC approach is likely to be used in the design of hypersonic vehicle control systems since numerical simulations have demonstrated that it can decrease tracking error and speed up convergence when compared to the offline controller.
基金supported by the National Natural Science Foundation of China(Nos.12272104,U22B2013).
文摘This paper investigates the challenges associated with Unmanned Aerial Vehicle (UAV) collaborative search and target tracking in dynamic and unknown environments characterized by limited field of view. The primary objective is to explore the unknown environments to locate and track targets effectively. To address this problem, we propose a novel Multi-Agent Reinforcement Learning (MARL) method based on Graph Neural Network (GNN). Firstly, a method is introduced for encoding continuous-space multi-UAV problem data into spatial graphs which establish essential relationships among agents, obstacles, and targets. Secondly, a Graph AttenTion network (GAT) model is presented, which focuses exclusively on adjacent nodes, learns attention weights adaptively and allows agents to better process information in dynamic environments. Reward functions are specifically designed to tackle exploration challenges in environments with sparse rewards. By introducing a framework that integrates centralized training and distributed execution, the advancement of models is facilitated. Simulation results show that the proposed method outperforms the existing MARL method in search rate and tracking performance with less collisions. The experiments show that the proposed method can be extended to applications with a larger number of agents, which provides a potential solution to the challenging problem of multi-UAV autonomous tracking in dynamic unknown environments.
文摘To realize effective co-phasing adjustment in large-aperture sparse-aperture telescopes,a multichannel stripe tracking approach is employed,allowing simultaneous interferometric measurements of multiple optical paths and circumventing the need for pairwise measurements along the mirror boundaries in traditional interferometric methods.This approach enhances detection efficiency and reduces system complexity.Here,the principles of the multibeam interference process and construction of a co-phasing detection module based on direct optical fiber connections were analyzed using wavefront optics theory.Error analysis was conducted on the system surface obtained through multipath interference.Potential applications of the interferometric method were explored.Finally,the principle was verified by experiment,an interferometric fringe contrast better than 0.4 is achieved through flat field calibration and incoherent digital synthesis.The dynamic range of the measurement exceeds 10 times of the center wavelength of the working band(1550 nm).Moreover,a resolution better than one-tenth of the working center wavelength(1550 nm)was achieved.Simultaneous three-beam interference can be achieved,leading to a 50%improvement in detection efficiency.This method can effectively enhance the efficiency of sparse aperture telescope co-phasing,meeting the requirements for observations of 8-10 m telescopes.This study provides a technological foundation for observing distant and faint celestial objects.
基金supported in part by the Doctoral Initiation Fund of Nanchang Hangkong University(No.EA202403107)Jiangxi Province Early Career Youth Science and Technology Talent Training Project(No.CK202403509).
文摘This paper presents the design and ground verification for vision-based relative navigation systems of microsatellites,which offers a comprehensive hardware design solution and a robust experimental verification methodology for practical implementation of vision-based navigation technology on the microsatellite platform.Firstly,a low power consumption,light weight,and high performance vision-based relative navigation optical sensor is designed.Subsequently,a set of ground verification system is designed for the hardware-in-the-loop testing of the vision-based relative navigation systems.Finally,the designed vision-based relative navigation optical sensor and the proposed angles-only navigation algorithms are tested on the ground verification system.The results verify that the optical simulator after geometrical calibration can meet the requirements of the hardware-in-the-loop testing of vision-based relative navigation systems.Based on experimental results,the relative position accuracy of the angles-only navigation filter at terminal time is increased by 25.5%,and the relative speed accuracy is increased by 31.3% compared with those of optical simulator before geometrical calibration.
基金financial support provided by the Natural Science Foundation of Hunan Province of China(Grant No.2021JJ10045)the Open Research Subject of State Key Laboratory of Intelligent Game(Grant No.ZBKF-24-01)+1 种基金the Postdoctoral Fellowship Program of CPSF(Grant No.GZB20240989)the China Postdoctoral Science Foundation(Grant No.2024M754304)。
文摘Unmanned aerial vehicles(UAVs)have become crucial tools in moving target tracking due to their agility and ability to operate in complex,dynamic environments.UAVs must meet several requirements to achieve stable tracking,including maintaining continuous target visibility amidst occlusions,ensuring flight safety,and achieving smooth trajectory planning.This paper reviews the latest advancements in UAV-based target tracking,highlighting information prediction,tracking strategies,and swarm cooperation.To address challenges including target visibility and occlusion,real-time prediction and tracking in dynamic environments,flight safety and coordination,resource management and energy efficiency,the paper identifies future research directions aimed at improving the performance,reliability,and scalability of UAV tracking system.
基金supported in part by Multimedia University under the Research Fellow Grant MMUI/250008in part by Telekom Research&Development Sdn Bhd under Grants RDTC/241149 and RDTC/231095+1 种基金Princess Nourah bint Abdulrahman University Researchers Supporting Project number(PNURSP2025R140)Princess Nourah bint Abdulrahman University,Riyadh,Saudi Arabia.
文摘Multiple Object Tracking(MOT)is essential for applications such as autonomous driving,surveillance,and analytics;However,challenges such as occlusion,low-resolution imaging,and identity switches remain persistent.We propose HAMOT,a hierarchical adaptive multi-object tracker that solves these challenges with a novel,unified framework.Unlike previous methods that rely on isolated components,HAMOT incorporates a Swin Transformer-based Adaptive Enhancement(STAE)module—comprising Scene-Adaptive Transformer Enhancement and Confidence-Adaptive Feature Refinement—to improve detection under low-visibility conditions.The hierarchical DynamicGraphNeuralNetworkwith TemporalAttention(DGNN-TA)models both short-and long-termassociations,and the Adaptive Unscented Kalman Filter with Gated Recurrent Unit(AUKF-GRU)ensures accurate motion prediction.The novel Graph-Based Density-Aware Clustering(GDAC)improves occlusion recovery by adapting to scene density,preserving identity integrity.This integrated approach enables adaptive responses to complex visual scenarios,Achieving exceptional performance across all evaluation metrics,including aHigher Order TrackingAccuracy(HOTA)of 67.05%,a Multiple Object Tracking Accuracy(MOTA)of 82.4%,an ID F1 Score(IDF1)of 83.1%,and a total of 1052 Identity Switches(IDSW)on theMOT17;66.61%HOTA,78.3%MOTA,82.1%IDF1,and a total of 748 IDSWonMOT20;and 66.4%HOTA,92.32%MOTA,and 68.96%IDF1 on DanceTrack.With fixed thresholds,the full HAMOT model(all six components)achieves real-time functionality at 24 FPS on MOT17 using RTX3090,ensuring robustness and scalability for real-world MOT applications.
基金supported by the Science and Technology Commission of Shanghai Municipality(21DZ1100500)the Shanghai Municipal Science and Technology Major Project+2 种基金the Shanghai Frontiers Science Center Program(2021–2025 No.20)The National Natural Science Foundation of China(32471545)the Natural Science Foundation of Shanghai(24ZR1454300).
文摘Unlike ensemble-averaging measurements,single-molecule tracking provides quantitative information on the kinetics of individual molecules within living cells in real time and may provide insight into the respective molecular interactions behind that.The advancement of single-molecule tracking has been signi-cantly boosted by the development of high-resolution microscopy techniques.In this review,we will discuss this aspect with a particular focus on their recent advance in MINFLUX nanoscopy with feedback approaches where tracking is performed in real time.MINFLUX localization requires fewer than 100 photons from a-1 nm-sized°uorophore,enabling precise tracking.This approach,which demands over an order of magnitude fewer photons than other localization-based techniques(such as STORM,PLAM),allows molecular tracking with single-digit nanometer accuracy in less than 1 ms—an achievement previously unattainable.
基金supported by funding from the National Institution of Neurological Disorders and Stroke(1R41NS103698-01A1 to CLM)。
文摘Background:Early identification of concussion-related vision disorders(CRVDs)may improve outcomes by enabling earlier management,referral,and treatment.Objective eye tracking may provide additional data to support the diagnose of CRVDs.The purpose of this study was to determine the utility of objective infrared eye tracking in identifying CRVDs among adolescents experiencing persisting post-concussive symptoms(PPCS)more than 28 days after injury.Methods:This was a prospective study of adolescents with PPCS evaluated with visio-vestibular examination(VVE),comprehensive vision examination,and an eye tracking device.Results:Of the 108 adolescents enrolled,67(62%)were diagnosed with a CRVD by comprehensive vision examination.On VVE,the near point of convergence break(5.5±3.2 cm vs.3.9±1.7 cm(mean±SD),p<0.001)and recovery(8.1±3.3 cm vs.6.8±2.3 cm,p=0.02)distinguished between those with and without CRVD.Concussion symptom provocation on VVE with horizontal saccades(35(52%)vs.12(29%),p=0.02)and horizontal vestibulo-ocular reflex testing(37(55%)vs.14(34%),p=0.03),and sway on tandem gait under the forward eyes closed condition(25(37%)vs.6(15%),p=0.01)also identified those with CRVD.From the eye tracking device,the BOX score(8.1±5.8 vs.5.2±4.1,p=0.007)and a metric of the left eye tracking along the bottom of the visual target(0.094±0.500 vs.-0.124±0.410,p=0.02)identified those with CRVD,with a multivariable receiver operating characteristic curve analysis,including the BOX score,achieving an area under the receiver operating characteristic curve of 0.7637.Conclusion:CRVDs are common in those with PPCS,with impact on recovery after concussion.Novel eye-tracking metrics can serve as an aid in the identification of those with CRVDs who would benefit from referral for comprehensive diagnosis and treatment.
文摘The publisher regrets that the Appendix A.Supplementary data was not updated as per author and editor’s request.The publisher would like to apologise for any inconvenience caused.
基金supported by the National Social Science Foundation of China(Grant No.24BYY117).
文摘Syntax and semantics are two important factors that influence sentence processing.Studies have found different aging effects in syntactic and semantic processing during sentence comprehension.While there is consensus on the aging effects in syntactic processing,the presence of aging in semantic processing remains debated.The present study aimed to explore whether there were aging effects in lexical-semantic information processing in complex sentence.79 participants were recruited to take part in this study,including 40 younger adults(mean age of 21.1±1.19 years)and 39 older adults(mean age of 66.24±3.02 years).Using eye-movement tracking technology and manipulating the animacy of head nouns in Chinese subject relative clauses(SRCs)and object relative clauses(ORCs),we investigated the abilities of young and old adults in relative clauses(RCs)processing.The results of comprehension accuracy revealed a significant effect of aging in RCs processing,with older participants exhibiting poor performance compared with younger counterparts across all four clause conditions.Furthermore,younger participants demonstrated a clear animacy effect in RCs processing,but this effect was not found in older participants.Reading times indicated a prominent aging effect in clause processing,with older participants showing significantly longer reading times across all four types of RCs compared to younger participants.It was observed that processing ORCs in Chinese was relatively easier than processing SRCs.Additionally,a noticeable aging effect in semantic processing was found,specifically,the difficulties of processing SRCs and ORCs vary with the animacy configuration of the head nouns for younger participants but were not observed in older participants.In summary,aging in cognition would also inhinder semantic processing in complex sentence comprehension.
基金supported by the National Natural Science Foundation of China(Grant No.62033007)the Major Fundamental Research Program of Shandong Province(Grant No.ZR2023ZD37).
文摘Siamese tracking algorithms usually take convolutional neural networks(CNNs)as feature extractors owing to their capability of extracting deep discriminative features.However,the convolution kernels in CNNs have limited receptive fields,making it difficult to capture global feature dependencies which is important for object detection,especially when the target undergoes large-scale variations or movement.In view of this,we develop a novel network called effective convolution mixed Transformer Siamese network(SiamCMT)for visual tracking,which integrates CNN-based and Transformer-based architectures to capture both local information and long-range dependencies.Specifically,we design a Transformer-based module named lightweight multi-head attention(LWMHA)which can be flexibly embedded into stage-wise CNNs and improve the network’s representation ability.Additionally,we introduce a stage-wise feature aggregation mechanism which integrates features learned from multiple stages.By leveraging both location and semantic information,this mechanism helps the SiamCMT to better locate and find the target.Moreover,to distinguish the contribution of different channels,a channel-wise attention mechanism is introduced to enhance the important channels and suppress the others.Extensive experiments on seven challenging benchmarks,i.e.,OTB2015,UAV123,GOT10K,LaSOT,DTB70,UAVTrack112_L,and VOT2018,demonstrate the effectiveness of the proposed algorithm.Specially,the proposed method outperforms the baseline by 3.5%and 3.1%in terms of precision and success rates with a real-time speed of 59.77 FPS on UAV123.
基金supported by the New Cornerstone Science Foundation through the XPLORER PRIZE,China(No.XPLORER-2024-1036)the independent research project of the National Key Laboratory of Strength and Structural Integrity,China(No.BYST-QZSYS-24-072-5)。
文摘Crack length measurement algorithms based on computer vision have shown promising engineering application prospects in the field of aircraft fatigue crack monitoring.However,due to the complexity of the monitoring environment,the subtle visual features of small fatigue cracks,and the impact of structural elastic deformation,directly applying object segmentation algorithms often results in significant measurement errors.Therefore,this paper proposes a high-precision crack length measurement method based on Bidirectional Target Tracking Model(Bi2TM),which integrates crack tip localization,interference identification,and length compensation.First,a general object segmentation model is used to perform rough crack segmentation.Then,the Bi2TM network,combined with the visual features of the structure in different stress states,is employed to track the bidirectional position of the crack tip in the“open”and“closed”states.This ultimately enables interference identification within the rough segmented crack region,achieving highprecision length measurement.In a high-interference environment of aircraft fatigue testing,the proposed method is used to measure 1000 crack images ranging from 1 mm to 11 mm.For more than 90%of the samples,the measurement error is less than 5 pixels,demonstrating significant advantages over the existing methods.
基金The 2024 Education and Teaching Reform Project,“Exploration and Practice of University Mathematics Teaching Reform Driven by Eye-Tracking Technology”(Project No.:JG2024047)。
文摘As a tool for quantifying individuals’visual attention and information processing,eye-tracking technology is gradually being applied in the reform of higher education.This paper focuses on issues in university mathematics teaching,such as heavy cognitive load,delayed feedback,and insufficient adaptability.Based on theories of cognitive psychology,the study explores application pathways of this technology in cognitive diagnosis,instructional optimization,classroom regulation,personalized support,and teaching assessment.Research shows that eye-tracking data can reveal key cognitive features during the learning process,enhance the visualization of instructional feedback,and improve the scientific basis of decision-making.This provides both theoretical support and practical reference for data-driven and precise transformation in university mathematics education.
文摘This article investigates the time-varying output group formation tracking control(GFTC)problem for heterogeneous multi-agent systems(HMASs)under switching topologies.The objective is to design a distributed control strategy that enables the outputs of the followers to form the desired sub-formations and track the outputs of the leader in each subgroup.Firstly,novel distributed observers are developed to estimate the states of the leaders under switching topologies.Then,GFTC protocols are designed based on the proposed observers.It is shown that with the distributed protocol,the GFTC problem for HMASs under switching topologies is solved if the average dwell time associated with the switching topologies is larger than a fixed threshold.Finally,an example is provided to illustrate the effectiveness of the proposed control strategy.
基金the National Natural Science Foundation of China(Grant Nos.62303348 and 62173242)the Aeronautical Science Foundation of China(Grant No.2024M071048002)the National Science Fund for Distinguished Young Scholars(Grant No.62225308)to provide fund for conducting experiments.
文摘Multiple quadrotors target encirclement is widely used in the intelligent field,as it can effectively monitor and control target behavior.However,it faces the danger of collision,as well as difficulties in localization and tracking.Therefore,we propose a complete target encirclement method.Firstly,based on Hooke's law,a collision avoidance controller is designed to maintain a safe flying distance among quadrotors.Then,based on the consensus theory,a formation tracking controller is designed to meet the requirements of formation transformation and encirclement tasks,and a stability proof based on Lyapunov was provided.Besides,the target detection is designed based on YOLOv5s,and the target location model is constructed based on the principle of pinhole projection and triangle similarity.Finally,we conducted experiments on the built platform,with 3 reconnaissance quadrotors detecting and localization 3 target vehicles and 7 hunter quadrotors tracking them.The results show that the minimum average error for localization targets with reconnaissance quadrotors can reach 0.1354 m,while the minimum average error for tracking with hunter quadrotors is only 0.2960 m.No quadrotors collision occurred in the whole formation transformation and tracking experiment.In addition,compared with the advanced methods,the proposed method has better performance.
