Giter Club home page Giter Club logo

msspl's Introduction

Fast Monte Carlo Rendering via Multi-Resolution Sampling

Paper | Data | Youtube

The data is currently reviewed by Intel. We will make it public as soon as possible.

PyTorch implementation of fast Monte Carlo rendering via multi-resolution sampling.

Fast Monte Carlo Rendering via Multi-Resolution Sampling,
Qiqi Hou *1, Zhan Li*1, Carl S Marshall2, Selvakumar Panneer2, Feng Liu 1,
1Portland State University, 2Intel

in Graphic Interface 2021.

What is a MSSPL?

MultiScale-SamPLing (MSSPL) is a hybrid rendering method to speed up Monte Carlo rendering algorithms. It first generates two versions of a rendering: one at a low resolution with a high sample rate (LRHS) and the other at a high resolution with a low sample rate (HRLS). We develop a deep convolutional neural network to fuse these two renderings into a high-quality image as if it were rendered at a high resolution with a high sample rate. Specifically, we formulate this fusion task as a super resolution problem that generates a high resolution rendering from a low resolution input (LRHS), assisted with the HRLS rendering. LRHS is less noisy while the more noisy HRLS can potentially provide high-frequency visual details that are inherently difficult to recover from the low resolution image.

Traing a MSSPL takes between five days and one week and only requires a single GPU. Denoising one 1024*1024 image from an optimized MSSPL takes about 0.12 second for our x4 model on a Titan Xp.

Training

We will release our training code.

Inference Demo

We will release a demo code for inference.

Replicating the paper results

We will release our code, models and our results.

BCR Dataset

We collected a large scale Blender Cycles Ray-tracing (BCR) dataset, which contains 2449 high-quality images rendered from 1463 models. We render the images at a range of spp rates, including 1-8, 12, 16, 32, 64, 250, 1000, and 4000 spp. All the images are rendered at the resolution of 1080p. Each image contains not only the final rendered result but also the intermediate render layers, including albedo, normal, diffuse, glossy, and so on. We provide an example of intermediate layers at here.

We will release the whole dataset as well as the compared results on our dataset.

Citation

@inproceedings{hou2021msspl,
  title={Fast Monte Carlo Rendering via Multi-Resolution Sampling},
  author={Qiqi Hou, Zhan Li, Carl S Marshall, Selvakumar Panneer, Feng Liu},
  year={2021},
  booktitle={Graphic Interface},
}

Acknowledgments

The source models in figures are used under a Creative Commons License from kujaba, darkst0ne, cczero, LukeLiptak, Christophe Seux, nickbrunner, samytichadou, MarcoD, Jay-Artist, jgilhutton, Oldfrizt, Ndakasha, GyngaNynja, racingfoli, Kless and PepSu. This project is supported by a gift from Intel.

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.