The visualization of arteries and heart usually plays a crucial role in the clinical diagnosis, but researchers face the problems of region selection and mutual occlusion in clinical visualization. Therefore, the arte...The visualization of arteries and heart usually plays a crucial role in the clinical diagnosis, but researchers face the problems of region selection and mutual occlusion in clinical visualization. Therefore, the arteries and the heart cannot be easily visualized by current visualization methods. To solve the problems, we propose a new framework for arteries and cardiac visualization by combining a priori knowledge and the set operations.Firstly, a suitable region can be easily determined in the transfer function space with a priori knowledge and the visual feedback results. Secondly, the arteries and the heart can be directly extracted by the marked seed point.Finally, the arteries and the heart are separated for solving mutual occlusion through the set operations. This framework can easily solve the mutual occlusion problem in clinical visualization and greatly improve the region selection method in the transfer function space. Its effectiveness has been demonstrated on the basis of many experimental results.展开更多
Minimal invasion is an important trend in surgery.However,the endoscope,as one of the key devices for monitoring the process of minimally invasive surgery,is limited by its size and working space it operates in,which ...Minimal invasion is an important trend in surgery.However,the endoscope,as one of the key devices for monitoring the process of minimally invasive surgery,is limited by its size and working space it operates in,which result in a considerably narrow field of view.In particular,when a surgical instrument enters through the tool channel,the instrument occupies most of the area in an endoscopic image.This hampers the surgeon’s field of view and has a negative impact on the surgery.This study proposes a novel method for removing the occlusion caused by surgical instruments in endoscopic images by making foreground occlusions on endoscopic images transparent using image restoration and interframe information filling.Compared with unprocessed images,this method can provide a clearer field of view that is necessary for minimally invasive endoscopic surgeries and improve the quality of surgeries.Clinical endoscopic images are used to verify the feasibility of the proposed method,and the results show that the proposed method improves the visual effect of endoscopic images by removing surgical-instrument occlusions.This demonstrates the considerable potential of the proposed method for use in clinical applications.展开更多
In this Letter, we propose an elemental image regeneration method of three-dimensional（3D） integral imaging for occluded objects using a plenoptic camera. In conventional occlusion removal techniques, the informatio...In this Letter, we propose an elemental image regeneration method of three-dimensional（3D） integral imaging for occluded objects using a plenoptic camera. In conventional occlusion removal techniques, the information of the occlusion layers may be lost. Thus, elemental images have cracked parts, so the visual quality of the reconstructed 3D image is degraded. However, these cracked parts can be interpolated from adjacent elemental images. Therefore, in this Letter, we try to improve the visual quality of reconstructed 3D images by interpolating and regenerating virtual elemental images with adjacent elemental images after removing the occlusion layers. To prove our proposed method, we carry out optical experiments and calculate performance metrics such as the mean square error（MSE） and the peak signal-to-noise ratio（PSNR）.展开更多
基金the National Basic Research Program(973)of China(No.2013CB329401)the National Natural Science Foundation of China(No.61375020)the Cross Research Fund of Biomedical Engineering of Shanghai Jiao Tong University(No.YG2013ZD02)
文摘The visualization of arteries and heart usually plays a crucial role in the clinical diagnosis, but researchers face the problems of region selection and mutual occlusion in clinical visualization. Therefore, the arteries and the heart cannot be easily visualized by current visualization methods. To solve the problems, we propose a new framework for arteries and cardiac visualization by combining a priori knowledge and the set operations.Firstly, a suitable region can be easily determined in the transfer function space with a priori knowledge and the visual feedback results. Secondly, the arteries and the heart can be directly extracted by the marked seed point.Finally, the arteries and the heart are separated for solving mutual occlusion through the set operations. This framework can easily solve the mutual occlusion problem in clinical visualization and greatly improve the region selection method in the transfer function space. Its effectiveness has been demonstrated on the basis of many experimental results.
基金supported by the National Key Research and Development Program of China(2022YFB4703000)the National Natural Science Foundation of China-Shenzhen Robotics Research Center Project(U2013209).
文摘Minimal invasion is an important trend in surgery.However,the endoscope,as one of the key devices for monitoring the process of minimally invasive surgery,is limited by its size and working space it operates in,which result in a considerably narrow field of view.In particular,when a surgical instrument enters through the tool channel,the instrument occupies most of the area in an endoscopic image.This hampers the surgeon’s field of view and has a negative impact on the surgery.This study proposes a novel method for removing the occlusion caused by surgical instruments in endoscopic images by making foreground occlusions on endoscopic images transparent using image restoration and interframe information filling.Compared with unprocessed images,this method can provide a clearer field of view that is necessary for minimally invasive endoscopic surgeries and improve the quality of surgeries.Clinical endoscopic images are used to verify the feasibility of the proposed method,and the results show that the proposed method improves the visual effect of endoscopic images by removing surgical-instrument occlusions.This demonstrates the considerable potential of the proposed method for use in clinical applications.
基金supported by the Basic Science Research Program through the National Research Foundation of Korea(NRF)funded by the Ministry of Education(No.NRF-2015R1A2A1A16074936)
文摘In this Letter, we propose an elemental image regeneration method of three-dimensional（3D） integral imaging for occluded objects using a plenoptic camera. In conventional occlusion removal techniques, the information of the occlusion layers may be lost. Thus, elemental images have cracked parts, so the visual quality of the reconstructed 3D image is degraded. However, these cracked parts can be interpolated from adjacent elemental images. Therefore, in this Letter, we try to improve the visual quality of reconstructed 3D images by interpolating and regenerating virtual elemental images with adjacent elemental images after removing the occlusion layers. To prove our proposed method, we carry out optical experiments and calculate performance metrics such as the mean square error（MSE） and the peak signal-to-noise ratio（PSNR）.
