Stable Linear Structures and Seam Measurements for Parallax Image Stitching

Parallax tolerance is a fundamental problem in image stitching. To solve this problem, increasing effort has been devoted to the spatially varying and seam cutting. However, there still exist some issues that need to be adequately addressed. First, the implementation of the spatially varying warping requires a restricted premise that the overlapping region can be aligned: if this premise is not met, ghosting caused by misalignment will emerge. In addition, the spatially varying warping may cause distortion due to the issue of inconsistent homographies. Second, conventional seam cutting will lead to objects being cropped and duplicated. Therefore, in this paper, we propose a stable framework for stitching images: the framework consists of a uniform linear structure model that is able to mitigate the distortion of projection and perspective, while preserving the structures of objects in the non-overlapping region; and a stable hybrid actor-critic that estimates stable seam measurements in the overlapping region to diminish the parallax. Comparison experiments show that the proposed method is superior to some conventional methods with respect to mitigating ghosting and preserving structure.