Fourier ptychographic microscopy(FPM)is an innovative computational microscopy approach that enables high-throughput imaging with high resolution,wide field of view,and quantitative phase imaging(QPI)by simultaneously...Fourier ptychographic microscopy(FPM)is an innovative computational microscopy approach that enables high-throughput imaging with high resolution,wide field of view,and quantitative phase imaging(QPI)by simultaneously capturing bright-field and dark-field images.However,effectively utilizing dark-field intensity images,including both normally exposed and overexposed data,which contain valuable high-angle illumination information,remains a complex challenge.Successfully extracting and applying this information could significantly enhance phase reconstruction,benefiting processes such as virtual staining and QPI imaging.To address this,we introduce a multi-exposure image fusion(MEIF)framework that optimizes dark-field information by incorporating it into the FPM preprocessing workflow.MEIF increases the data available for reconstruction without requiring changes to the optical setup.We evaluate the framework using both feature-domain and traditional FPM,demonstrating that it achieves substantial improvements in intensity resolution and phase information for biological samples that exceed the performance of conventional high dynamic range(HDR)methods.This image preprocessing-based information-maximization strategy fully leverages existing datasets and offers promising potential to drive advancements in fields such as microscopy,remote sensing,and crystallography.展开更多
In this paper[1],Figure 5(a)is mistakenly used with the figure of ground truth,which is taken and stitched by 10×/0.3NA objective and the operations have been detailed in the main text.The correction is as follow...In this paper[1],Figure 5(a)is mistakenly used with the figure of ground truth,which is taken and stitched by 10×/0.3NA objective and the operations have been detailed in the main text.The correction is as follows(Figure 1).This error does not affect the conclusion of this paper.The authors have also checked other figures such as Figure 6,and they are used correctly.展开更多
Full-color imaging is of critical importance in digital pathology for analyzing labeled tissue sections.In our previous cover story[Sci.China:Phys.,Mech.Astron.64,114211(2021)],a color transfer approach was implemente...Full-color imaging is of critical importance in digital pathology for analyzing labeled tissue sections.In our previous cover story[Sci.China:Phys.,Mech.Astron.64,114211(2021)],a color transfer approach was implemented on Fourier ptychographic microscopy(FPM)for achieving high-throughput full-color whole slide imaging without mechanical scanning.The approach was able to reduce both acquisition and reconstruction time of FPM by three-fold with negligible trade-off on color accuracy.However,the method cannot properly stain samples with two or more dyes due to the lack of spatial constraints in the color transfer process.It also requires a high computation cost in histogram matching of individual patches.Here we report a modified full-color imaging algorithm for FPM,termed color-transfer filtering FPM(CFFPM).In CFFPM,we replace the original histogram matching process with a combination of block processing and trilateral spatial filtering.The former step reduces the search of the solution space for colorization,and the latter introduces spatial constraints that match the low-resolution measurement.We further adopt an iterative process to refine the results.We show that this method can perform accurate and fast color transfer for various specimens,including those with multiple stains.The statistical results of 26 samples show that the average root mean square error is only 1.26%higher than that of the red-green-blue sequential acquisition method.For some cases,CFFPM outperforms the sequential method because of the coherent artifacts introduced by dust particles.The reported CFFPM strategy provides a turnkey solution for digital pathology via computational optical imaging.展开更多
The usage of full-color imaging in digital pathology produces significant results.Compared with a grayscale image or a pseudocolor image containing contrast information,a full-color image can identify and detect the t...The usage of full-color imaging in digital pathology produces significant results.Compared with a grayscale image or a pseudocolor image containing contrast information,a full-color image can identify and detect the target object better with color texture information.Fourier ptychographic microscopy(FPM)is a high-throughput computational imaging technique that breaks the tradeoff between high resolution(HR)and a large field of view.It also eliminates the artifacts of scanning and stitching in digital pathology and improves its imaging efficiency.However,the conventional full-color digital pathology based on FPM is still time-consuming because of the repeated experiments with tri-wavelengths.A color transfer FPM approach termed“CFPM”was reported.The color texture information of a low-resolution full-color pathologic image is directly transferred to the HR grayscale FPM image captured by only a single wavelength.Both of the color space of FPM based on the standard CIE-XYZ color model and the display based on the standard RGB color space were established.Different FPM colorization schemes were analyzed and compared with 30 biological samples.Three types of evaluation approaches were provided,including the root-mean-square error(RMSE),the difference maps,and the image histogram cosine similarity.The average RMSE values of the conventional method and CFPM compared with the ground truth were 5.3%and 5.7%,respectively.Therefore,the reconstruction time is significantly reduced by 2/3 with the sacrifice of precision of only 0.4%.The CFPM method is also compatible with advanced fast FPM approaches to further reduce computation time.展开更多
基金supported by the National Natural Science Foundation of China(Grant No.12104500)the Key Research and Development Projects of Shaanxi Province of China(Grant No.2023-YBSF-263).
文摘Fourier ptychographic microscopy(FPM)is an innovative computational microscopy approach that enables high-throughput imaging with high resolution,wide field of view,and quantitative phase imaging(QPI)by simultaneously capturing bright-field and dark-field images.However,effectively utilizing dark-field intensity images,including both normally exposed and overexposed data,which contain valuable high-angle illumination information,remains a complex challenge.Successfully extracting and applying this information could significantly enhance phase reconstruction,benefiting processes such as virtual staining and QPI imaging.To address this,we introduce a multi-exposure image fusion(MEIF)framework that optimizes dark-field information by incorporating it into the FPM preprocessing workflow.MEIF increases the data available for reconstruction without requiring changes to the optical setup.We evaluate the framework using both feature-domain and traditional FPM,demonstrating that it achieves substantial improvements in intensity resolution and phase information for biological samples that exceed the performance of conventional high dynamic range(HDR)methods.This image preprocessing-based information-maximization strategy fully leverages existing datasets and offers promising potential to drive advancements in fields such as microscopy,remote sensing,and crystallography.
文摘In this paper[1],Figure 5(a)is mistakenly used with the figure of ground truth,which is taken and stitched by 10×/0.3NA objective and the operations have been detailed in the main text.The correction is as follows(Figure 1).This error does not affect the conclusion of this paper.The authors have also checked other figures such as Figure 6,and they are used correctly.
基金National Natural Science Foundation of China (12104500).
文摘Full-color imaging is of critical importance in digital pathology for analyzing labeled tissue sections.In our previous cover story[Sci.China:Phys.,Mech.Astron.64,114211(2021)],a color transfer approach was implemented on Fourier ptychographic microscopy(FPM)for achieving high-throughput full-color whole slide imaging without mechanical scanning.The approach was able to reduce both acquisition and reconstruction time of FPM by three-fold with negligible trade-off on color accuracy.However,the method cannot properly stain samples with two or more dyes due to the lack of spatial constraints in the color transfer process.It also requires a high computation cost in histogram matching of individual patches.Here we report a modified full-color imaging algorithm for FPM,termed color-transfer filtering FPM(CFFPM).In CFFPM,we replace the original histogram matching process with a combination of block processing and trilateral spatial filtering.The former step reduces the search of the solution space for colorization,and the latter introduces spatial constraints that match the low-resolution measurement.We further adopt an iterative process to refine the results.We show that this method can perform accurate and fast color transfer for various specimens,including those with multiple stains.The statistical results of 26 samples show that the average root mean square error is only 1.26%higher than that of the red-green-blue sequential acquisition method.For some cases,CFFPM outperforms the sequential method because of the coherent artifacts introduced by dust particles.The reported CFFPM strategy provides a turnkey solution for digital pathology via computational optical imaging.
基金This work was supported by the National Natural Science Foundation of China(Grant No.81427802).
文摘The usage of full-color imaging in digital pathology produces significant results.Compared with a grayscale image or a pseudocolor image containing contrast information,a full-color image can identify and detect the target object better with color texture information.Fourier ptychographic microscopy(FPM)is a high-throughput computational imaging technique that breaks the tradeoff between high resolution(HR)and a large field of view.It also eliminates the artifacts of scanning and stitching in digital pathology and improves its imaging efficiency.However,the conventional full-color digital pathology based on FPM is still time-consuming because of the repeated experiments with tri-wavelengths.A color transfer FPM approach termed“CFPM”was reported.The color texture information of a low-resolution full-color pathologic image is directly transferred to the HR grayscale FPM image captured by only a single wavelength.Both of the color space of FPM based on the standard CIE-XYZ color model and the display based on the standard RGB color space were established.Different FPM colorization schemes were analyzed and compared with 30 biological samples.Three types of evaluation approaches were provided,including the root-mean-square error(RMSE),the difference maps,and the image histogram cosine similarity.The average RMSE values of the conventional method and CFPM compared with the ground truth were 5.3%and 5.7%,respectively.Therefore,the reconstruction time is significantly reduced by 2/3 with the sacrifice of precision of only 0.4%.The CFPM method is also compatible with advanced fast FPM approaches to further reduce computation time.
