Current image inpainting models are primarily designed to achieve a large receptive field(RF)using refinement networks to incorporate different scales.However,these models fail to adapt the use of different RFs to the...Current image inpainting models are primarily designed to achieve a large receptive field(RF)using refinement networks to incorporate different scales.However,these models fail to adapt the use of different RFs to the specific patterns of image damage,resulting in artifacts and semantic information confusion in repaired images.To address the problems of artifacts and semantic information confusion,inspired by different sensitivities of different RFs to inpainting the same image damaged patterns,this study proposes an image inpainting method based on multiple receptive fields(MRFs)and dynamic matching of damaged patterns.First,the parallel filter banks are used to extract the MRF feature groups.Second,the features are dynamically weighted and screened,guided by the mask image,to construct a relationship that adaptively matches the most relevant RF to each specific damaged pattern.A fast Fourier convolution based decoder is used to enhance the fusion of global contextual features during the reconstruction of high dimensional features into low dimensional images.Comparative experimental results show that the proposed method achieves better subjective and objective inpainting results on three public datasets:Paris StreetView,CelebA-HQ,and Places2.展开更多
基金The National Natural Science Foundation of China(No.62261032)the Central Government Guiding Funds for Local Scienceand Technology Development Program(No.25ZYJA026).
文摘Current image inpainting models are primarily designed to achieve a large receptive field(RF)using refinement networks to incorporate different scales.However,these models fail to adapt the use of different RFs to the specific patterns of image damage,resulting in artifacts and semantic information confusion in repaired images.To address the problems of artifacts and semantic information confusion,inspired by different sensitivities of different RFs to inpainting the same image damaged patterns,this study proposes an image inpainting method based on multiple receptive fields(MRFs)and dynamic matching of damaged patterns.First,the parallel filter banks are used to extract the MRF feature groups.Second,the features are dynamically weighted and screened,guided by the mask image,to construct a relationship that adaptively matches the most relevant RF to each specific damaged pattern.A fast Fourier convolution based decoder is used to enhance the fusion of global contextual features during the reconstruction of high dimensional features into low dimensional images.Comparative experimental results show that the proposed method achieves better subjective and objective inpainting results on three public datasets:Paris StreetView,CelebA-HQ,and Places2.
