The technique of imaging or tracking objects outside the field of view(FOV)through a reflective relay surface,usually called non-line-of-sight(NLOS)imaging,has been a popular research topic in recent years.Although NL...The technique of imaging or tracking objects outside the field of view(FOV)through a reflective relay surface,usually called non-line-of-sight(NLOS)imaging,has been a popular research topic in recent years.Although NLOS imaging can be achieved through methods such as detector design,optical path inverse operation algorithm design,or deep learning,challenges such as high costs,complex algorithms,and poor results remain.This study introduces a simple algorithm-based rapid depth imaging device,namely,the continuous-wave time-offlight range imaging camera(CW-TOF camera),to address the decoupled imaging challenge of differential scattering characteristics in an object-relay surface by quantifying the differential scattering signatures through statistical analysis of light propagation paths.A scalable scattering mapping(SSM)theory has been proposed to explain the degradation process of clear images.High-quality NLOS object 3D imaging has been achieved through a data-driven approach.To verify the effectiveness of the proposed algorithm,experiments were conducted using an optical platform and real-world scenarios.The objects on the optical platform include plaster sculptures and plastic letters,while relay surfaces consist of polypropylene(PP)plastic boards,acrylic boards,and standard Lambertian diffusers.In real-world scenarios,the object is clothing,with relay surfaces including painted doors and white plaster walls.Imaging data were collected for different combinations of objects and relay surfaces for training and testing,totaling 210,000 depth images.The reconstruction of NLOS images in the laboratory and real-world is excellent according to subjective evaluation;thus,our approach can realize NLOS imaging in harsh natural scenes and advances the practical application of NLOS imaging.展开更多
基金National Key Research and Development Program of China(2023YFC3321600)Special Project for Research and Development in Key Areas of Guangdong Province(2023ZDZX1044)+1 种基金Zhuhai Multimodal Intelligent Vision Engineering Technology Research Center(2320004002292)Zhuhai Basic and Applied Basic Research Foundation(2220004002937)。
文摘The technique of imaging or tracking objects outside the field of view(FOV)through a reflective relay surface,usually called non-line-of-sight(NLOS)imaging,has been a popular research topic in recent years.Although NLOS imaging can be achieved through methods such as detector design,optical path inverse operation algorithm design,or deep learning,challenges such as high costs,complex algorithms,and poor results remain.This study introduces a simple algorithm-based rapid depth imaging device,namely,the continuous-wave time-offlight range imaging camera(CW-TOF camera),to address the decoupled imaging challenge of differential scattering characteristics in an object-relay surface by quantifying the differential scattering signatures through statistical analysis of light propagation paths.A scalable scattering mapping(SSM)theory has been proposed to explain the degradation process of clear images.High-quality NLOS object 3D imaging has been achieved through a data-driven approach.To verify the effectiveness of the proposed algorithm,experiments were conducted using an optical platform and real-world scenarios.The objects on the optical platform include plaster sculptures and plastic letters,while relay surfaces consist of polypropylene(PP)plastic boards,acrylic boards,and standard Lambertian diffusers.In real-world scenarios,the object is clothing,with relay surfaces including painted doors and white plaster walls.Imaging data were collected for different combinations of objects and relay surfaces for training and testing,totaling 210,000 depth images.The reconstruction of NLOS images in the laboratory and real-world is excellent according to subjective evaluation;thus,our approach can realize NLOS imaging in harsh natural scenes and advances the practical application of NLOS imaging.
