文章基本信息

标题：Generative multiview inpainting for object removal in large indoor spaces
本地全文：下载
作者：Joohyung Kim ; Janghun Hyeon ; Nakju Doh 等
期刊名称：International Journal of Advanced Robotic Systems
印刷版ISSN：1729-8806
电子版ISSN：1729-8814
出版年度：2021
卷号：18
期号：2
页码：1-13
DOI：10.1177/1729881421996544
出版社：SAGE Publications
摘要：As interest in image-based rendering increases, the need for multiview inpainting is emerging. Despite of rapid progresses in single-image inpainting based on deep learning approaches, they have no constraint in obtaining color consistency over multiple inpainted images. We target object removal in large-scale indoor spaces and propose a novel pipeline of multiview inpainting to achieve color consistency and boundary consistency in multiple images. The first step of the pipeline is to create color prior information on masks by coloring point clouds from multiple images and projecting the colored point clouds onto the image planes. Next, a generative inpainting network accepts a masked image, a color prior image, imperfect guideline, and two different masks as inputs and yields the refined guideline and inpainted image as outputs. The color prior and guideline input ensure color and boundary consistencies across multiple images. We validate our pipeline on real indoor data sets quantitatively using consistency distance and similarity distance, metrics we defined for comparing results of multiview inpainting and qualitatively.
关键词：Multiview inpainting ; object removal ; generative adversarial network ; color consistency ; boundary consistency