Comments (5)
I think it would be better to look at their paper. They use SIREN, which has been demonstrated to be as effective as positional encoding. This discovery has been "officially" acknowledged by original NeRF team in their follow-up paper.
from pi-gan.
I think it would be better to look at their paper. They use SIREN, which has been demonstrated to be as effective as positional encoding. This discovery has been "officially" acknowledged by original NeRF team in their follow-up paper.
Thanks!
from pi-gan.
Hi @RaymondJiangkw ,
I think it would be better to look at their paper. They use SIREN, which has been demonstrated to be as effective as positional encoding. This discovery has been "officially" acknowledged by original NeRF team in their follow-up paper.
I guess "officially acknowledged" is a little bit too strong as a claim, since the SIREN based net is only used for 2D image regression in the paper. For novel view synthesis with NeRF, they still use ReLU MLPs with positional encoding.
from pi-gan.
Hi, @DeanChan
Hi @RaymondJiangkw ,
I think it would be better to look at their paper. They use SIREN, which has been demonstrated to be as effective as positional encoding. This discovery has been "officially" acknowledged by original NeRF team in their follow-up paper.
I guess "officially acknowledged" is a little bit too strong as a claim, since the SIREN based net is only used for 2D image regression in the paper. For novel view synthesis with NeRF, they still use ReLU MLPs with positional encoding.
Of course, it's strange, haha, and that's the reason why there's a double quote. In the paper of original NeRF team, they acknowledged the effectiveness of SIREN when dealing with the problem of Coordinate-Based Neural Representations, even though they only applied it to 2D image regression, and positional encoding is exactly targeted at solving the same issue.
I'm sorry if you feel my words are not accurate, but what I want to emphasize is that -GAN choosing SIREN as an alternative way is plausible and has its theoretical foundation.
Sorry for my informal claim. π³
from pi-gan.
Many thanks for your quick reply π It's much clearer now.
I just found a repo applying SIREN to NeRF--, which may support the effectiveness of SIREN.
In their implementation, there's no positional encoding for SIREN-based NeRF either. See frameworks.py#L28-L38
from pi-gan.
Related Issues (20)
- generator.losses can not visual using tensorboard
- Can't pickle weakref objects HOT 7
- Reproducing the shape results on the project page
- Inverse rendering script assumes strictly oriented input image
- Wrong dataset_path for CARLA and CATS
- hello,how to get the 3d presentation as you mentioned in fig.9 by projecting the depth map? thanks
- Query about Training Time HOT 19
- generated images colours HOT 1
- Intuition behind scaling frequency output of mapping network?
- How many pictures did you use to calculate the FID value of different datasets in the paperοΌ HOT 1
- the link to the datasets HOT 1
- Error when Rendering Videos HOT 4
- 3d mesh reconstruction quality
- Inverse code can't render fine detail as in demo
- Use the same z for training G and D in each iteration.
- Out of memory by training with several 1080ti
- Why I cannot load the pretrained model meeting 'no module named torch_ema'? HOT 1
- Does the pi-GAN discriminator receive the camera pose during training?
- About the lr for G and D
- Dataset cannot be found
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
π Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. πππ
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google β€οΈ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from pi-gan.