Comments (3)
I think you want to use the 360.gin config as a reference for configurations, not llff_256.gin. The LLFF scenes use NDC parameterization, and it looks like your code is using that data loader as well, which is definitely not what you want.
from multinerf.
Great,After changing the config(mainly near and far parameters)and disabling the NDC convension i get a fairly good result after only 80000 iterations:
Below is the config i am currently using, anyone with the same issue can take it as a reference:
Config.dataset_loader = 'llff'
Config.batching = 'single_image'
Config.near = 0.2
Config.far = 1e6
Config.factor = 4
Config.batch_size = 256
Config.eval_render_interval = 5
Config.render_chunk_size = 256
Config.compute_normal_metrics = False
Config.data_loss_type = 'mse'
Config.distortion_loss_mult = 0.0
Config.orientation_loss_mult = 0.1
Config.orientation_loss_target = 'normals_pred'
Config.predicted_normal_loss_mult = 3e-4
Config.orientation_coarse_loss_mult = 0.01
Config.predicted_normal_coarse_loss_mult = 3e-5
Config.interlevel_loss_mult = 0.0
Config.data_coarse_loss_mult = 0.1
Config.adam_eps = 1e-8
Model.raydist_fn = @jnp.reciprocal
Model.opaque_background = True
Model.num_levels = 2
Model.single_mlp = True
Model.num_prop_samples = 128 # This needs to be set despite single_mlp = True.
Model.num_nerf_samples = 128
Model.anneal_slope = 0.
Model.dilation_multiplier = 0.
Model.dilation_bias = 0.
Model.single_jitter = False
Model.resample_padding = 0.01
PropMLP.warp_fn = @coord.contract
PropMLP.net_depth = 4
PropMLP.net_width = 256
NerfMLP.warp_fn = @coord.contract
NerfMLP.net_depth = 8
NerfMLP.net_width = 256
NerfMLP.net_depth_viewdirs = 8
NerfMLP.basis_shape = 'octahedron'
NerfMLP.basis_subdivisions = 1
NerfMLP.disable_density_normals = False
NerfMLP.enable_pred_normals = True
NerfMLP.use_directional_enc = True
NerfMLP.use_reflections = True
NerfMLP.deg_view = 5
NerfMLP.enable_pred_roughness = True
NerfMLP.use_diffuse_color = True
NerfMLP.use_specular_tint = True
NerfMLP.use_n_dot_v = True
NerfMLP.bottleneck_width = 128
NerfMLP.density_bias = 0.5
NerfMLP.max_deg_point = 16
I am closing this issue. Thanks for the quick reply.
from multinerf.
@78ij
What command did you use to run ref-nerf??
python -m train \ --gin_configs=configs/360.gin \ --gin_bindings="Config.data_dir = '${DATA_DIR}'" \ --gin_bindings="Config.checkpoint_dir = '${DATA_DIR}/checkpoints'" \ --logtostderr
then
python -m render \ --gin_configs=configs/360.gin \ --gin_bindings="Config.data_dir = '${DATA_DIR}'" \ --gin_bindings="Config.checkpoint_dir = '${DATA_DIR}/checkpoints'" \ --gin_bindings="Config.render_dir = '${DATA_DIR}/render'" \ --gin_bindings="Config.render_path = True" \ --gin_bindings="Config.render_path_frames = 480" \ --gin_bindings="Config.render_video_fps = 60" \ --logtostderr
as written in README?
from multinerf.
Related Issues (20)
- Multinerf
- Question about evaluation metric(LPIPS) and results.
- Reproducing Results of RefNeRF for Materials scene HOT 1
- Nerfstudio Model Implementations HOT 2
- train Mip-NeRF 360 with my dataset HOT 2
- How to extract mesh HOT 1
- Render Image - Recursion Depth Limits? HOT 1
- something wrong about "bash scripts/local_colmap_and_resize.sh ${DATA_DIR}" HOT 5
- - unrecognised option '--Mapper.ba_global_function_tolerance=0.000001'. HOT 4
- why delta times the norm of direction when compute the weights of samples?
- mogrify: no decode delegate for this image format `' @ error/constitute.c/ReadImage/746. HOT 3
- Question about the additional model import
- the error coordinate transformation in the readme
- Error occurs when I want to use my dataset HOT 2
- training toaster scence with config blender_refnerf.gin HOT 2
- How to correctly run ref-nerf on TanksAndTemple dataset
- rendered image's geometry doesn't align with training image
- shiny blender dataset creation
- Results of RefNeRF for shinyblender dataset like scene is not good HOT 5
- Unit test failed HOT 2
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from multinerf.