Light

gorilla-lab-scut / tango Goto Github PK

View Code? Open in Web Editor NEW

138.0 6.0 5.0 23.78 MB

[NeurIPS 2022] Official code repository for "TANGO: Text-driven Photorealistic and Robust 3D Stylization via Lighting Decomposition"

Home Page: https://cyw-3d.github.io/tango/

Python 100.00%

text-to-3d differentiable-rendering aigc 3d computer-graphics meshes neural-style pytorch

tango's Introduction

TANGO: Text-driven Photorealistic and Robust 3D Stylization via Lighting Decomposition

Yongwei Chen, Rui Chen, Jiabao Lei, Yabin Zhang, Kui Jia

NeurIPS 2022 Spotlight

Paper | Project Page

News

🏆 [Nov 11th 2022] TANGO was selected in NeurIPS spotlight papers.

Installation

Note: You can directly pull the image we uploaded to AliCloud

docker pull registry.cn-shenzhen.aliyuncs.com/baopin/t2m:1.7

System Requirements

Python >=3.7 and <=3.9
CUDA 11
Nvidia GPU with 12 GB ram at least
Open3d >=0.14.1
the package of clip (https://github.com/openai/CLIP)

Train

Call the below shell scripts to generate example styles.

# shoe made of gold
./demo/run_shoe_gold.sh
# vase made of wicker 
./demo/run_vase_wicker.sh
# car made of wood
./demo/run_car_wood_origin.sh
# ...

The outputs will be saved to results/demo

Validate

Call the below shell scripts to generate gif.

# shoe made of gold
./demo/test_shoe_gold.sh
# vase made of wicker 
./demo/test_vase_wicker.sh
# car made of wood
./demo/test_car_wood_origin.sh
# ...

Citation

@article{chen2022tango,
  title={Tango: Text-driven photorealistic and robust 3d stylization via lighting decomposition},
  author={Chen, Yongwei and Chen, Rui and Lei, Jiabao and Zhang, Yabin and Jia, Kui},
  journal={Advances in Neural Information Processing Systems},
  volume={35},
  pages={30923--30936},
  year={2022}
}

tango's People

Contributors

Stargazers

Watchers

Forkers

psklf cv-synthesis brahimmade hologerry exception1984

tango's Issues

energy computation

Hi @YWCHEN-ZERO @Yuxin-Wen,
Thanks for sharing this work. While going through the details of your code implementation of light energy computation in here, your implementation for the denominator is different from that shown in the paper.
Just wondering is this a mistake in code or typo in the paper equation (6)? Or is there anthing that I misunderstood?

More mesh data

Thanks for your great job! I would like to know where can you download more mesh data.

Open3D issue

I was trying your amazing project out, however I got this error

Environment Configuration

Hi! I have an error when installing environment. Open3d package is unable to run successfully. Further, installation of different versions has different errors. With the Open3d version==0.9.0.0, a common error is as follow

I found that this error is because clip-by-openai is installed. When i uninstall clip package, open3d works for me. However, clip package is necessary for running your code.

Looking forward to your help and response.

colored mesh or texture result extraction

How can I extract colored mesh or texture result rather than rendering RGB?

eval.py里可以加下torch.no_grad()，不然显存撑不住

RT

Recommend Projects

React

A declarative, efficient, and flexible JavaScript library for building user interfaces.
Vue.js

🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
Typescript

TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
TensorFlow

An Open Source Machine Learning Framework for Everyone
Django

The Web framework for perfectionists with deadlines.
Laravel

A PHP framework for web artisans
D3

Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

javascript

JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
web

Some thing interesting about web. New door for the world.
server

A server is a program made to process requests and deliver data to clients.
Machine learning

Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Visualization

Some thing interesting about visualization, use data art
Game

Some thing interesting about game, make everyone happy.

Recommend Org

Facebook

We are working to build community through open source technology. NB: members must have two-factor auth.
Microsoft

Open source projects and samples from Microsoft.
Google

Google ❤️ Open Source for everyone.
Alibaba

Alibaba Open Source for everyone
D3

Data-Driven Documents codes.
Tencent

China tencent open source team.