Giter Club home page Giter Club logo

high_resolution_image_inpainting's Introduction

Deep Two-Stage High-Resolution Image Inpainting

Abstract

In recent years, the field of image inpainting has developed rapidly, but most deep methods are strongly tied to the resolution of the images on which they were trained. A slight resolution increase leads to artifacts and unsatisfactory filling quality. These methods are therefore unsuitable for interactive image processing. In this article, we propose a method that solves the problem of inpainting arbitrary-size images. We also describe a way to better restore texture fragments in the filled area. Moreover, this approach can work with existing inpainting models, making them resolution independent. We also created a GIMP plugin that implements our technique. scene

Testing

Requirements

  • Python 3.7
  • Install requirements with pip install -r requirements.txt

Usage

  1. Download weights and save it in weights folder.
  2. Put your images as shown in Test/Inputs
  3. Run: python test.py

Results from our comparison

You can find all the images involved in our comparison here

GIMP plugin

Tested with

  1. GIMP 2.10
  2. Ubuntu 18.04 LTS
  3. macOS Mojave 10.14.6

Installation

  1. Open GIMP and go to Preferences -> Folders -> Plug-ins, add the folder gimp-plugins from this repo and close GIMP.
  2. Download weights and save it in gimp-plugins/Inpainting/weights folder.
  3. Open terminal and run:
    bash installGimpML.sh
  4. Open GIMP.

Usage

You can find example of usage: youtube.
Please note that the mask must be exactly binary. Otherwise the filling result will be terrible.
To do this, remove antialiasing in selection:

@article{Moskalenko_2020,
	doi = {10.51130/graphicon-2020-2-4-18},
	url = {https://doi.org/10.51130%2Fgraphicon-2020-2-4-18},
	year = 2020,
	month = {dec},
	pages = {short18--1--short18--9},
	author = {Andrey Moskalenko and Mikhail Erofeev and Dmitriy Vatolin},
	title = {Deep Two-Stage High-Resolution Image Inpainting},
	journal = {Proceedings of the 30th International Conference on Computer Graphics and Machine Vision ({GraphiCon} 2020). Part 2}
} 

References

We are largely benefiting from:
[1] https://github.com/hughplay/DFNet
[2] https://github.com/kritiksoman/GIMP-ML/

high_resolution_image_inpainting's People

Contributors

a-mos avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar

high_resolution_image_inpainting's Issues

Training code

Hi @a-mos
Are you going to release the training code? The patch extraction strategy is interesting in the training session.

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.