Litcius/Paper detail

Draw with me

Thomas Weber, Heinrich Hußmann, Zhiwei Han, Stefan Matthes, Yuanting Liu

202024 citationsDOI

Abstract

The purpose of image restoration is to recover the original state of damaged images. To overcome the disadvantages of the traditional, manual image restoration process, like the high time consumption and required domain knowledge, automatic inpainting methods have been developed. These methods, however, can have limitations for complex images and may require a lot of input data. To mitigate those, we present "interactive Deep Image Prior", a combination of manual and automated, Deep-Image-Prior-based restoration in the form of an interactive process with the human in the loop. In this process a human can iteratively embed knowledge to provide guidance and control for the automated inpainting process. For this purpose, we extended Deep Image Prior with a user interface which we subsequently analyzed in a user study. Our key question is whether the interactivity increases the restoration quality subjectively and objectively. Secondarily, we were also interested in how such a collaborative system is perceived by users.

Topics & Concepts

InpaintingComputer scienceInteractivityProcess (computing)Artificial intelligenceComputer visionImage (mathematics)Domain (mathematical analysis)Image editingKey (lock)Deep learningDomain knowledgeHuman–computer interactionMultimediaMathematical analysisMathematicsOperating systemComputer securityGenerative Adversarial Networks and Image SynthesisComputer Graphics and Visualization TechniquesImage and Video Quality Assessment