修补
计算机科学
特征(语言学)
人工智能
像素
编码器
卷积(计算机科学)
失真(音乐)
模式识别(心理学)
合并(版本控制)
过程(计算)
图像(数学)
计算机视觉
人工神经网络
操作系统
哲学
语言学
放大器
计算机网络
带宽(计算)
情报检索
作者
Guangyao Li,Liangfu Li,Yingdan Pu,Nan Wang,Xi Zhang
标识
DOI:10.1016/j.cag.2022.07.022
摘要
Most existing image inpainting methods have achieved remarkable progress in repairing small image defects. However, when the holes are large, their filling contents suffer from structural distortion and center blur due to the weak correlation between known and unknown pixels. In this paper, we propose a Progressive Feature Generation (PFG) network which is mask awareable during the process of filling irregular holes. Specifically, in order to strengthen the constraint for the hole center, we propose dynamic partial convolution which can adaptively adjust the inpainting proportion according to mask ratio in each recurrence. To synthesize high-quality features in the feature generation phase, two parallel encoders are designed which could effectively improve the capability of model to restore large holes. We argue that during feature merging, the signals generated earlier at the same location are more credible. To this end, we develop the sub-regional weighted merging(SWM) method for PFG-Net to accurately merge the feature maps generated during the whole reconstruction process. Experiments on CelebA, Places2, and Paris StreetView datasets show that our model has excellent performance especially for large holes. • Dynamic partial convolution is designed to strength the correlation between valid and invalid pixels. • We design two parallel encoders to provide semantic understanding and image structure recognition for model. • Sub-regional weighted merging method is introduced to better utilize the earlier generated signals. • Experimental results show that our PFG-Net has significantly boost the inpainting performance.
科研通智能强力驱动
Strongly Powered by AbleSci AI