Photomechanics is a crucial branch of solid mechanics.The localization of point targets constitutes a fundamental problem in optical experimental mechanics,with extensive applications in various missions of unmanned a...Photomechanics is a crucial branch of solid mechanics.The localization of point targets constitutes a fundamental problem in optical experimental mechanics,with extensive applications in various missions of unmanned aerial vehicles.Localizing moving targets is crucial for analyzing their motion characteristics and dynamic properties.Reconstructing the trajectories of points from asynchronous cameras is a significant challenge.It encompasses two coupled sub-problems:Trajectory reconstruction and camera synchronization.Present methods typically address only one of these sub-problems individually.This paper proposes a 3D trajectory reconstruction method for point targets based on asynchronous cameras,simultaneously solving both sub-problems.Firstly,we extend the trajectory intersection method to asynchronous cameras to resolve the limitation of traditional triangulation that requires camera synchronization.Secondly,we develop models for camera temporal information and target motion,based on imaging mechanisms and target dynamics characteristics.The parameters are optimized simultaneously to achieve trajectory reconstruction without accurate time parameters.Thirdly,we optimize the camera rotations alongside the camera time information and target motion parameters,using tighter and more continuous constraints on moving points.The reconstruction accuracy is significantly improved,especially when the camera rotations are inaccurate.Finally,the simulated and real-world experimental results demonstrate the feasibility and accuracy of the proposed method.The real-world results indicate that the proposed algorithm achieved a localization error of 112.95 m at an observation distance range of 15-20 km.展开更多
We present the Fourier lightfield multiview stereoscope(FiLM-Scope).This imaging device combines concepts from Fourier lightfield microscopy and multiview stereo imaging to capture high-resolution 3D videos over large...We present the Fourier lightfield multiview stereoscope(FiLM-Scope).This imaging device combines concepts from Fourier lightfield microscopy and multiview stereo imaging to capture high-resolution 3D videos over large fields of view.The FiLM-Scope optical hardware consists of a multicamera array,with 48 individual microcameras,placed behind a high-throughput primary lens.This allows the FiLM-Scope to simultaneously capture 48 unique 12.8 megapixel images of a 28×37 mm field-of-view,from unique angular perspectives over a 21 deg×29 deg range,with down to 22μm lateral resolution.We also describe a self-supervised algorithm to reconstruct 3D height maps from these images.Our approach demonstrates height accuracy down to 11μm.To showcase the utility of our system,we perform tool tracking over the surface of an ex vivo rat skull and visualize the 3D deformation in stretching human skin,with videos captured at up to 100 frames per second.The FiLM-Scope has the potential to improve 3D visualization in a range of microsurgical settings.展开更多
基金supported by the Hunan Provin〓〓cial Natural Science Foundation for Excellent Young Scholars(Grant No.2023JJ20045)the National Natural Science Foundation of China(Grant No.12372189)。
文摘Photomechanics is a crucial branch of solid mechanics.The localization of point targets constitutes a fundamental problem in optical experimental mechanics,with extensive applications in various missions of unmanned aerial vehicles.Localizing moving targets is crucial for analyzing their motion characteristics and dynamic properties.Reconstructing the trajectories of points from asynchronous cameras is a significant challenge.It encompasses two coupled sub-problems:Trajectory reconstruction and camera synchronization.Present methods typically address only one of these sub-problems individually.This paper proposes a 3D trajectory reconstruction method for point targets based on asynchronous cameras,simultaneously solving both sub-problems.Firstly,we extend the trajectory intersection method to asynchronous cameras to resolve the limitation of traditional triangulation that requires camera synchronization.Secondly,we develop models for camera temporal information and target motion,based on imaging mechanisms and target dynamics characteristics.The parameters are optimized simultaneously to achieve trajectory reconstruction without accurate time parameters.Thirdly,we optimize the camera rotations alongside the camera time information and target motion parameters,using tighter and more continuous constraints on moving points.The reconstruction accuracy is significantly improved,especially when the camera rotations are inaccurate.Finally,the simulated and real-world experimental results demonstrate the feasibility and accuracy of the proposed method.The real-world results indicate that the proposed algorithm achieved a localization error of 112.95 m at an observation distance range of 15-20 km.
基金supported by the National Cancer Institute(NCI)of the National Institutes of Health(Grant No.R44CA250877)the Office of Research Infrastructure Programs(ORIP),Office of the Director,National Institutes of Health,and the National Institute of Environmental Health Sciences(NIEHS)of the National Institutes of Health(Grant No.R44OD024879)+2 种基金the National Institute of Biomedical Imaging and Bioengineering(NIBIB)of the National Institutes of Health(Grant No.R43EB030979)the National Science Foundation(Grant Nos.2036439 and 2238845)the Duke Coulter Translational Part-nership Award,the Fitzpatrick Institute at the Duke University.
文摘We present the Fourier lightfield multiview stereoscope(FiLM-Scope).This imaging device combines concepts from Fourier lightfield microscopy and multiview stereo imaging to capture high-resolution 3D videos over large fields of view.The FiLM-Scope optical hardware consists of a multicamera array,with 48 individual microcameras,placed behind a high-throughput primary lens.This allows the FiLM-Scope to simultaneously capture 48 unique 12.8 megapixel images of a 28×37 mm field-of-view,from unique angular perspectives over a 21 deg×29 deg range,with down to 22μm lateral resolution.We also describe a self-supervised algorithm to reconstruct 3D height maps from these images.Our approach demonstrates height accuracy down to 11μm.To showcase the utility of our system,we perform tool tracking over the surface of an ex vivo rat skull and visualize the 3D deformation in stretching human skin,with videos captured at up to 100 frames per second.The FiLM-Scope has the potential to improve 3D visualization in a range of microsurgical settings.
