We present the Fourier lightfield multiview stereoscope(FiLM-Scope).This imaging device combines concepts from Fourier lightfield microscopy and multiview stereo imaging to capture high-resolution 3D videos over large...We present the Fourier lightfield multiview stereoscope(FiLM-Scope).This imaging device combines concepts from Fourier lightfield microscopy and multiview stereo imaging to capture high-resolution 3D videos over large fields of view.The FiLM-Scope optical hardware consists of a multicamera array,with 48 individual microcameras,placed behind a high-throughput primary lens.This allows the FiLM-Scope to simultaneously capture 48 unique 12.8 megapixel images of a 28×37 mm field-of-view,from unique angular perspectives over a 21 deg×29 deg range,with down to 22μm lateral resolution.We also describe a self-supervised algorithm to reconstruct 3D height maps from these images.Our approach demonstrates height accuracy down to 11μm.To showcase the utility of our system,we perform tool tracking over the surface of an ex vivo rat skull and visualize the 3D deformation in stretching human skin,with videos captured at up to 100 frames per second.The FiLM-Scope has the potential to improve 3D visualization in a range of microsurgical settings.展开更多
Until recently,conventional biochemical staining had the undisputed status as well-established benchmark for most biomedical problems related to clinical diagnostics,fundamental research and biotechnology.Despite this...Until recently,conventional biochemical staining had the undisputed status as well-established benchmark for most biomedical problems related to clinical diagnostics,fundamental research and biotechnology.Despite this role as gold-standard,staining protocols face several challenges,such as a need for extensive,manual processing of samples,substantial time delays,altered tissue homeostasis,limited choice of contrast agents,2D imaging instead of 3D tomography and many more.Label-free optical technologies,on the other hand,do not rely on exogenous and artificial markers,by exploiting intrinsic optical contrast mechanisms,where the specificity is typically less obvious to the human observer.Over the past few years,digital staining has emerged as a promising concept to use modern deep learning for the translation from optical contrast to established biochemical contrast of actual stainings.In this review article,we provide an in-depth analysis of the current state-of-the-art in this field,suggest methods of good practice,identify pitfalls and challenges and postulate promising advances towards potential future implementations and applications.展开更多
We report tensorial tomographic Fourier ptychography(T^(2)oFu),a nonscanning label-free tomographic microscopy method for simultaneous imaging of quantitative phase and anisotropic specimen information in 3D.Built upo...We report tensorial tomographic Fourier ptychography(T^(2)oFu),a nonscanning label-free tomographic microscopy method for simultaneous imaging of quantitative phase and anisotropic specimen information in 3D.Built upon Fourier ptychography,a quantitative phase imaging technique,T^(2)oFu additionally highlights the vectorial nature of light.The imaging setup consists of a standard microscope equipped with an LED matrix,a polarization generator,and a polarization-sensitive camera.Permittivity tensors of anisotropic samples are computationally recovered from polarized intensity measurements across three dimensions.We demonstrate T^(2)oFu’s efficiency through volumetric reconstructions of refractive index,birefringence,and orientation for various validation samples,as well as tissue samples from muscle fibers and diseased heart tissue.Our reconstructions of healthy muscle fibers reveal their 3D fine-filament structures with consistent orientations.Additionally,we demonstrate reconstructions of a heart tissue sample that carries important polarization information for detecting cardiac amyloidosis.展开更多
基金supported by the National Cancer Institute(NCI)of the National Institutes of Health(Grant No.R44CA250877)the Office of Research Infrastructure Programs(ORIP),Office of the Director,National Institutes of Health,and the National Institute of Environmental Health Sciences(NIEHS)of the National Institutes of Health(Grant No.R44OD024879)+2 种基金the National Institute of Biomedical Imaging and Bioengineering(NIBIB)of the National Institutes of Health(Grant No.R43EB030979)the National Science Foundation(Grant Nos.2036439 and 2238845)the Duke Coulter Translational Part-nership Award,the Fitzpatrick Institute at the Duke University.
文摘We present the Fourier lightfield multiview stereoscope(FiLM-Scope).This imaging device combines concepts from Fourier lightfield microscopy and multiview stereo imaging to capture high-resolution 3D videos over large fields of view.The FiLM-Scope optical hardware consists of a multicamera array,with 48 individual microcameras,placed behind a high-throughput primary lens.This allows the FiLM-Scope to simultaneously capture 48 unique 12.8 megapixel images of a 28×37 mm field-of-view,from unique angular perspectives over a 21 deg×29 deg range,with down to 22μm lateral resolution.We also describe a self-supervised algorithm to reconstruct 3D height maps from these images.Our approach demonstrates height accuracy down to 11μm.To showcase the utility of our system,we perform tool tracking over the surface of an ex vivo rat skull and visualize the 3D deformation in stretching human skin,with videos captured at up to 100 frames per second.The FiLM-Scope has the potential to improve 3D visualization in a range of microsurgical settings.
基金This project has received funding from the European Union’s Horizon 2022 Marie Skłodowska-Curie Action(grant agreement 101103200,‘MICS’to L.K.)K.C.Z.was supported in part by Schmidt Science Fellows,in partnership with the Rhodes Trust+2 种基金K.C.L.was supported by a grant of the Korea Health Technology R&D Project through the Korea Health Industry Development Institute(KHIDI),funded by the Ministry of Health&Welfare,Republic of Korea(grant number:HI21C0977060102002)Commercialization Promotion Agency for R&D Outcomes(COMPA)funded by the Ministry of Science and ICT(MSIT)(1711198540)This material is based upon work supported in part by the Air Force Office of Scientific Research under award number FA9550-21-1-0401,the National Science Foundation under Grant 2238845,and a Hartwell Foundation Individual Biomedical Researcher Award.
文摘Until recently,conventional biochemical staining had the undisputed status as well-established benchmark for most biomedical problems related to clinical diagnostics,fundamental research and biotechnology.Despite this role as gold-standard,staining protocols face several challenges,such as a need for extensive,manual processing of samples,substantial time delays,altered tissue homeostasis,limited choice of contrast agents,2D imaging instead of 3D tomography and many more.Label-free optical technologies,on the other hand,do not rely on exogenous and artificial markers,by exploiting intrinsic optical contrast mechanisms,where the specificity is typically less obvious to the human observer.Over the past few years,digital staining has emerged as a promising concept to use modern deep learning for the translation from optical contrast to established biochemical contrast of actual stainings.In this review article,we provide an in-depth analysis of the current state-of-the-art in this field,suggest methods of good practice,identify pitfalls and challenges and postulate promising advances towards potential future implementations and applications.
基金a Duke-Coulter Translational Partnership and funding from a 3M Nontenured Faculty Awarda grant of the Korea Health Technology R&D Project through the Korea Health Industry Development Institute(KHIDI),funded by the Ministry of Health&Welfare,Republic of Korea(Grant No.HI19C1344)funding from the German academic exchange service(DAAD,project 57698081)
文摘We report tensorial tomographic Fourier ptychography(T^(2)oFu),a nonscanning label-free tomographic microscopy method for simultaneous imaging of quantitative phase and anisotropic specimen information in 3D.Built upon Fourier ptychography,a quantitative phase imaging technique,T^(2)oFu additionally highlights the vectorial nature of light.The imaging setup consists of a standard microscope equipped with an LED matrix,a polarization generator,and a polarization-sensitive camera.Permittivity tensors of anisotropic samples are computationally recovered from polarized intensity measurements across three dimensions.We demonstrate T^(2)oFu’s efficiency through volumetric reconstructions of refractive index,birefringence,and orientation for various validation samples,as well as tissue samples from muscle fibers and diseased heart tissue.Our reconstructions of healthy muscle fibers reveal their 3D fine-filament structures with consistent orientations.Additionally,we demonstrate reconstructions of a heart tissue sample that carries important polarization information for detecting cardiac amyloidosis.
