Giter Club home page Giter Club logo

kaledhoshme123 / multi-scale-cyclegan-night-to-day Goto Github PK

View Code? Open in Web Editor NEW
8.0 1.0 0.0 10.59 MB

Converting night into day is one of the most interesting applications in generative models, due to the great difficulty in recreating the scene during the day, especially in cases of extreme darkness, and thus the difficulty lies in imagining the scene during the day when the lighting is very weak.

License: MIT License

Jupyter Notebook 100.00%
cnn convolutional-neural-networks cycle-gan cyclegan feature-transformation gan generative-adversarial-network image-to-image-translation night-to-day u-net unet

multi-scale-cyclegan-night-to-day's Introduction

Multi-Scale CycleGAN Night to Day

  • Converting night into day is one of the most interesting applications in generative models, due to the great difficulty in recreating the scene during the day, especially in cases of extreme darkness, and thus the difficulty lies in imagining the scene during the day when the lighting is very weak.
  • The proposed system focuses on using a CycleGan architecture that helps in reconstructing the scene in the daytime.
  • The structure of the discriminator has been modified so that it can study the correctness of reshaping an object, only a part of which is visible due to extreme darkness and poor lighting. The discriminator was also designed to be able to recognize objects that are close to and far from the camera, so that it studies the correctness of the process of shaping the scene during the day.
  • Through the proposed methodology, the discriminator attempts to study the relationship of the pixel with its neighbors, and whether the pixel's current value with its neighbors is correct or not (using kernel = 5 at each output convolutional layer) which helps in evaluating whether the pixel is correctly positioned with respect to its neighbors or not.
  • Thus, in this way we try to overcome the problem of great difficulty in reconstructing the scene in extreme darkness.
  • During the process of converting night into day, as long as we are studying images that include images of the road, it is possible that some objects may sometimes be close to the camera and others far from the camera, and all we seek is for each object to be recreated in the images as if it were in the daytime. Therefore, the discerner must recognize the entire object, whether it is close to the camera or far from the camera.

Discriminator Architecture

download (19)

CycleGAN Architecture:

__results___15_0 (1)

Results:

Examples
__results___27_0
__results___28_0
__results___29_0

Note:

I have Trained CycleGan for 35000 Epochs (You can train for more Epochs and you will get more accurate results)

multi-scale-cyclegan-night-to-day's People

Contributors

kaledhoshme123 avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar

multi-scale-cyclegan-night-to-day's Issues

pretrained model

Hello, Mr.Khaled!
I am very interested in this work and hope to get your help. I hope to use your pre-trained model. If it is convenient, can you make it public? Thank you very much.

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.