Giter Club home page Giter Club logo

dreamgaussian4d's People

Contributors

jiawei-ren avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

dreamgaussian4d's Issues

Segmentation fault (core dumped)

python main2_4d.py --config configs/4d_svd.yaml input=data/anya_rgba.png save_path=anya
Running the preceding command causes an error to occur.
Segmentation fault (core dumped)

ninja: build stopped: subcommand failed.

When I was running command

python main_4d.py --config configs/4d.yaml input=data/anya_rgba.png save_path=anya,

an error occured:

PyMeshLab 0.2 based on MeshLab 2020.12d
Using zero-init and residual
feature_dim: 128
[INFO] load image from data/anya_rgba_000.png...
[INFO] load image from data/anya_rgba_001.png...
[INFO] load image from data/anya_rgba_002.png...
[INFO] load image from data/anya_rgba_003.png...
[INFO] load image from data/anya_rgba_004.png...
[INFO] load image from data/anya_rgba_005.png...
[INFO] load image from data/anya_rgba_006.png...
[INFO] load image from data/anya_rgba_007.png...
[INFO] load image from data/anya_rgba_008.png...
[INFO] load image from data/anya_rgba_009.png...
[INFO] load image from data/anya_rgba_010.png...
[INFO] load image from data/anya_rgba_011.png...
[INFO] load image from data/anya_rgba_012.png...
[INFO] load image from data/anya_rgba_013.png...
Seed: 888
[INFO] loading zero123...
Keyword arguments {'trust_remote_code': True} are not expected by Zero123Pipeline and will be ignored.
Loading pipeline components...: 100%|████████████████████████████████████████████████████████| 6/6 [00:00<00:00, 10.08it/s]
[INFO] loaded zero123!
100%|████████████████████████████████████████████████████████████████████████████████████| 200/200 [01:34<00:00, 2.11it/s]
[INFO] save model to logs/anya_4d_model.ply.
[INFO] mesh cleaning: (11848, 3) --> (11086, 3), (23574, 3) --> (22054, 3)
[INFO] marching cubes result: torch.Size([11086, 3]) (-0.5793360471725464-5.625131607055664), torch.Size([22054, 3])
[INFO] unwrap uv...
Traceback (most recent call last):
File "/data/anaconda3/envs/dg4d/lib/python3.9/site-packages/torch/utils/cpp_extension.py", line 1808, in _run_ninja_build
subprocess.run(
File "/data/anaconda3/envs/dg4d/lib/python3.9/subprocess.py", line 528, in run
raise CalledProcessError(retcode, process.args,
subprocess.CalledProcessError: Command '['ninja', '-v']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
File "/data/AIMH/DW/dreamgaussian4d/main_4d.py", line 635, in
gui.train(opt.iters)
File "/data/AIMH/DW/dreamgaussian4d/main_4d.py", line 612, in train
self.save_model(mode='geo+tex', t=t)
File "/data/anaconda3/envs/dg4d/lib/python3.9/site-packages/torch/autograd/grad_mode.py", line 27, in decorate_context
return func(*args, **kwargs)
File "/data/AIMH/DW/dreamgaussian4d/main_4d.py", line 390, in save_model
glctx = dr.RasterizeGLContext()
File "/data/anaconda3/envs/dg4d/lib/python3.9/site-packages/nvdiffrast/torch/ops.py", line 221, in init
self.cpp_wrapper = _get_plugin(gl=True).RasterizeGLStateWrapper(output_db, mode == 'automatic', cuda_device_idx)
File "/data/anaconda3/envs/dg4d/lib/python3.9/site-packages/nvdiffrast/torch/ops.py", line 118, in _get_plugin
torch.utils.cpp_extension.load(name=plugin_name, sources=source_paths, extra_cflags=opts, extra_cuda_cflags=opts+['-lineinfo'], extra_ldflags=ldflags, with_cuda=True, verbose=False)
File "/data/anaconda3/envs/dg4d/lib/python3.9/site-packages/torch/utils/cpp_extension.py", line 1202, in load
return _jit_compile(
File "/data/anaconda3/envs/dg4d/lib/python3.9/site-packages/torch/utils/cpp_extension.py", line 1425, in _jit_compile
_write_ninja_file_and_build_library(
File "/data/anaconda3/envs/dg4d/lib/python3.9/site-packages/torch/utils/cpp_extension.py", line 1537, in _write_ninja_file_and_build_library
_run_ninja_build(
File "/data/anaconda3/envs/dg4d/lib/python3.9/site-packages/torch/utils/cpp_extension.py", line 1824, in _run_ninja_build
raise RuntimeError(message) from e
RuntimeError: Error building extension 'nvdiffrast_plugin_gl': [1/6] c++ -MMD -MF common.o.d -DTORCH_EXTENSION_NAME=nvdiffrast_plugin_gl -DTORCH_API_INCLUDE_EXTENSION_H -DPYBIND11_COMPILER_TYPE="_gcc" -DPYBIND11_STDLIB="_libstdcpp" -DPYBIND11_BUILD_ABI="_cxxabi1011" -isystem /data/anaconda3/envs/dg4d/lib/python3.9/site-packages/torch/include -isystem /data/anaconda3/envs/dg4d/lib/python3.9/site-packages/torch/include/torch/csrc/api/include -isystem /data/anaconda3/envs/dg4d/lib/python3.9/site-packages/torch/include/TH -isystem /data/anaconda3/envs/dg4d/lib/python3.9/site-packages/torch/include/THC -isystem /usr/local/cuda-11.4/include -isystem /data/anaconda3/envs/dg4d/include/python3.9 -D_GLIBCXX_USE_CXX11_ABI=0 -fPIC -std=c++14 -DNVDR_TORCH -c /data/anaconda3/envs/dg4d/lib/python3.9/site-packages/nvdiffrast/common/common.cpp -o common.o
[2/6] c++ -MMD -MF glutil.o.d -DTORCH_EXTENSION_NAME=nvdiffrast_plugin_gl -DTORCH_API_INCLUDE_EXTENSION_H -DPYBIND11_COMPILER_TYPE="_gcc" -DPYBIND11_STDLIB="_libstdcpp" -DPYBIND11_BUILD_ABI="_cxxabi1011" -isystem /data/anaconda3/envs/dg4d/lib/python3.9/site-packages/torch/include -isystem /data/anaconda3/envs/dg4d/lib/python3.9/site-packages/torch/include/torch/csrc/api/include -isystem /data/anaconda3/envs/dg4d/lib/python3.9/site-packages/torch/include/TH -isystem /data/anaconda3/envs/dg4d/lib/python3.9/site-packages/torch/include/THC -isystem /usr/local/cuda-11.4/include -isystem /data/anaconda3/envs/dg4d/include/python3.9 -D_GLIBCXX_USE_CXX11_ABI=0 -fPIC -std=c++14 -DNVDR_TORCH -c /data/anaconda3/envs/dg4d/lib/python3.9/site-packages/nvdiffrast/common/glutil.cpp -o glutil.o
FAILED: glutil.o
c++ -MMD -MF glutil.o.d -DTORCH_EXTENSION_NAME=nvdiffrast_plugin_gl -DTORCH_API_INCLUDE_EXTENSION_H -DPYBIND11_COMPILER_TYPE="_gcc" -DPYBIND11_STDLIB="_libstdcpp" -DPYBIND11_BUILD_ABI="_cxxabi1011" -isystem /data/anaconda3/envs/dg4d/lib/python3.9/site-packages/torch/include -isystem /data/anaconda3/envs/dg4d/lib/python3.9/site-packages/torch/include/torch/csrc/api/include -isystem /data/anaconda3/envs/dg4d/lib/python3.9/site-packages/torch/include/TH -isystem /data/anaconda3/envs/dg4d/lib/python3.9/site-packages/torch/include/THC -isystem /usr/local/cuda-11.4/include -isystem /data/anaconda3/envs/dg4d/include/python3.9 -D_GLIBCXX_USE_CXX11_ABI=0 -fPIC -std=c++14 -DNVDR_TORCH -c /data/anaconda3/envs/dg4d/lib/python3.9/site-packages/nvdiffrast/common/glutil.cpp -o glutil.o
In file included from /data/anaconda3/envs/dg4d/lib/python3.9/site-packages/nvdiffrast/common/glutil.cpp:14:
/data/anaconda3/envs/dg4d/lib/python3.9/site-packages/nvdiffrast/common/glutil.h:36:10: fatal error: EGL/egl.h: 没有那个文 件或目录
36 | #include <EGL/egl.h>
| ^~~~~~~~~~~
compilation terminated.
[3/6] c++ -MMD -MF rasterize_gl.o.d -DTORCH_EXTENSION_NAME=nvdiffrast_plugin_gl -DTORCH_API_INCLUDE_EXTENSION_H -DPYBIND11_COMPILER_TYPE="_gcc" -DPYBIND11_STDLIB="_libstdcpp" -DPYBIND11_BUILD_ABI="_cxxabi1011" -isystem /data/anaconda3/envs/dg4d/lib/python3.9/site-packages/torch/include -isystem /data/anaconda3/envs/dg4d/lib/python3.9/site-packages/torch/include/torch/csrc/api/include -isystem /data/anaconda3/envs/dg4d/lib/python3.9/site-packages/torch/include/TH -isystem /data/anaconda3/envs/dg4d/lib/python3.9/site-packages/torch/include/THC -isystem /usr/local/cuda-11.4/include -isystem /data/anaconda3/envs/dg4d/include/python3.9 -D_GLIBCXX_USE_CXX11_ABI=0 -fPIC -std=c++14 -DNVDR_TORCH -c /data/anaconda3/envs/dg4d/lib/python3.9/site-packages/nvdiffrast/common/rasterize_gl.cpp -o rasterize_gl.o
FAILED: rasterize_gl.o
c++ -MMD -MF rasterize_gl.o.d -DTORCH_EXTENSION_NAME=nvdiffrast_plugin_gl -DTORCH_API_INCLUDE_EXTENSION_H -DPYBIND11_COMPILER_TYPE="_gcc" -DPYBIND11_STDLIB="_libstdcpp" -DPYBIND11_BUILD_ABI="_cxxabi1011" -isystem /data/anaconda3/envs/dg4d/lib/python3.9/site-packages/torch/include -isystem /data/anaconda3/envs/dg4d/lib/python3.9/site-packages/torch/include/torch/csrc/api/include -isystem /data/anaconda3/envs/dg4d/lib/python3.9/site-packages/torch/include/TH -isystem /data/anaconda3/envs/dg4d/lib/python3.9/site-packages/torch/include/THC -isystem /usr/local/cuda-11.4/include -isystem /data/anaconda3/envs/dg4d/include/python3.9 -D_GLIBCXX_USE_CXX11_ABI=0 -fPIC -std=c++14 -DNVDR_TORCH -c /data/anaconda3/envs/dg4d/lib/python3.9/site-packages/nvdiffrast/common/rasterize_gl.cpp -o rasterize_gl.o
In file included from /data/anaconda3/envs/dg4d/lib/python3.9/site-packages/nvdiffrast/common/rasterize_gl.h:16,
from /data/anaconda3/envs/dg4d/lib/python3.9/site-packages/nvdiffrast/common/rasterize_gl.cpp:9:
/data/anaconda3/envs/dg4d/lib/python3.9/site-packages/nvdiffrast/common/glutil.h:36:10: fatal error: EGL/egl.h: 没有那个文 件或目录
36 | #include <EGL/egl.h>
| ^~~~~~~~~~~
compilation terminated.
[4/6] c++ -MMD -MF torch_rasterize_gl.o.d -DTORCH_EXTENSION_NAME=nvdiffrast_plugin_gl -DTORCH_API_INCLUDE_EXTENSION_H -DPYBIND11_COMPILER_TYPE="_gcc" -DPYBIND11_STDLIB="_libstdcpp" -DPYBIND11_BUILD_ABI="_cxxabi1011" -isystem /data/anaconda3/envs/dg4d/lib/python3.9/site-packages/torch/include -isystem /data/anaconda3/envs/dg4d/lib/python3.9/site-packages/torch/include/torch/csrc/api/include -isystem /data/anaconda3/envs/dg4d/lib/python3.9/site-packages/torch/include/TH -isystem /data/anaconda3/envs/dg4d/lib/python3.9/site-packages/torch/include/THC -isystem /usr/local/cuda-11.4/include -isystem /data/anaconda3/envs/dg4d/include/python3.9 -D_GLIBCXX_USE_CXX11_ABI=0 -fPIC -std=c++14 -DNVDR_TORCH -c /data/anaconda3/envs/dg4d/lib/python3.9/site-packages/nvdiffrast/torch/torch_rasterize_gl.cpp -o torch_rasterize_gl.o
FAILED: torch_rasterize_gl.o
c++ -MMD -MF torch_rasterize_gl.o.d -DTORCH_EXTENSION_NAME=nvdiffrast_plugin_gl -DTORCH_API_INCLUDE_EXTENSION_H -DPYBIND11_COMPILER_TYPE="_gcc" -DPYBIND11_STDLIB="_libstdcpp" -DPYBIND11_BUILD_ABI="_cxxabi1011" -isystem /data/anaconda3/envs/dg4d/lib/python3.9/site-packages/torch/include -isystem /data/anaconda3/envs/dg4d/lib/python3.9/site-packages/torch/include/torch/csrc/api/include -isystem /data/anaconda3/envs/dg4d/lib/python3.9/site-packages/torch/include/TH -isystem /data/anaconda3/envs/dg4d/lib/python3.9/site-packages/torch/include/THC -isystem /usr/local/cuda-11.4/include -isystem /data/anaconda3/envs/dg4d/include/python3.9 -D_GLIBCXX_USE_CXX11_ABI=0 -fPIC -std=c++14 -DNVDR_TORCH -c /data/anaconda3/envs/dg4d/lib/python3.9/site-packages/nvdiffrast/torch/torch_rasterize_gl.cpp -o torch_rasterize_gl.o
In file included from /data/anaconda3/envs/dg4d/lib/python3.9/site-packages/nvdiffrast/torch/../common/rasterize_gl.h:16,
from /data/anaconda3/envs/dg4d/lib/python3.9/site-packages/nvdiffrast/torch/torch_rasterize_gl.cpp:12:
/data/anaconda3/envs/dg4d/lib/python3.9/site-packages/nvdiffrast/torch/../common/glutil.h:36:10: fatal error: EGL/egl.h: 没有那个文件或目录
36 | #include <EGL/egl.h>
| ^~~~~~~~~~~
compilation terminated.
[5/6] c++ -MMD -MF torch_bindings_gl.o.d -DTORCH_EXTENSION_NAME=nvdiffrast_plugin_gl -DTORCH_API_INCLUDE_EXTENSION_H -DPYBIND11_COMPILER_TYPE="_gcc" -DPYBIND11_STDLIB="_libstdcpp" -DPYBIND11_BUILD_ABI="_cxxabi1011" -isystem /data/anaconda3/envs/dg4d/lib/python3.9/site-packages/torch/include -isystem /data/anaconda3/envs/dg4d/lib/python3.9/site-packages/torch/include/torch/csrc/api/include -isystem /data/anaconda3/envs/dg4d/lib/python3.9/site-packages/torch/include/TH -isystem /data/anaconda3/envs/dg4d/lib/python3.9/site-packages/torch/include/THC -isystem /usr/local/cuda-11.4/include -isystem /data/anaconda3/envs/dg4d/include/python3.9 -D_GLIBCXX_USE_CXX11_ABI=0 -fPIC -std=c++14 -DNVDR_TORCH -c /data/anaconda3/envs/dg4d/lib/python3.9/site-packages/nvdiffrast/torch/torch_bindings_gl.cpp -o torch_bindings_gl.o
ninja: build stopped: subcommand failed.

environment:python3.9,torch 1.12.1+cu113
device:A100 40G
system:ubuntu20.04.6

Why not text to 4D?

Have you experimented with text to 4D since original DreamGaussian has both image and text based 3D generation. Can you discuss your results with text based 4D generation?

unexpected keyword argument 'denoise_beg' in StableVideoDiffusion pipe

when i run the command"python main2_4d.py --config configs/4d_svd.yaml input=data/anya_rgba.png save_path=anya"
an error occurred:
File "/mnt/petrelfs/yangshuai/4drender/dreamgaussian4d/main2_4d.py", line 421, in
gui.train(opt.iters_refine)
File "/mnt/petrelfs/yangshuai/4drender/dreamgaussian4d/main2_4d.py", line 367, in train
self.train_step()
File "/mnt/petrelfs/yangshuai/4drender/dreamgaussian4d/main2_4d.py", line 285, in train_step
refined_images = self.guidance_svd.refine(images, strength=strength).float()
File "/mnt/petrelfs/yangshuai/4drender/dreamgaussian4d/guidance/svd_utils.py", line 91, in refine
target = self.pipe(
File "/mnt/petrelfs/yangshuai/anaconda3/envs/threestudio/lib/python3.9/site-packages/torch/utils/_contextlib.py", line 115, in decorate_context
return func(*args, **kwargs)
TypeError: call() got an unexpected keyword argument 'denoise_beg'

I check the pipe's args of StableVideoDiffusionPipeline in diffusers and find no corresponding keyword argument 'denoise_beg', I wonder if the pre trained model is different?

(original code pipe load:
pipe = StableVideoDiffusionPipeline.from_pretrained(
"stabilityai/stable-video-diffusion-img2vid", torch_dtype=torch.float16, variant="fp16"
)
)

Why is mesh extraction done in every timestamp?

Based on your paper, mesh and texture map are extracted and optimized across each timestamp individually. However, I'm curious whether it is possible to extract mesh and texture map once with static DreamGS, and realize motion of characters by optimizing only vertices of mesh for each timestamp with the texture map intact. I think it is more natural because texture map of a character(object) should be unchanged for rigid motions.

无法运行python gen_vid.py --name anya_rgba --seed 42 --bg white

Traceback (most recent call last):
File "/home/h/anaconda3/envs/4dgaussian/lib/python3.8/site-packages/urllib3/connection.py", line 198, in _new_conn
sock = connection.create_connection(
File "/home/h/anaconda3/envs/4dgaussian/lib/python3.8/site-packages/urllib3/util/connection.py", line 85, in create_connection
raise err
File "/home/h/anaconda3/envs/4dgaussian/lib/python3.8/site-packages/urllib3/util/connection.py", line 73, in create_connection
sock.connect(sa)
OSError: [Errno 101] Network is unreachable

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
File "/home/h/anaconda3/envs/4dgaussian/lib/python3.8/site-packages/urllib3/connectionpool.py", line 793, in urlopen
response = self._make_request(
File "/home/h/anaconda3/envs/4dgaussian/lib/python3.8/site-packages/urllib3/connectionpool.py", line 491, in _make_request
raise new_e
File "/home/h/anaconda3/envs/4dgaussian/lib/python3.8/site-packages/urllib3/connectionpool.py", line 467, in _make_request
self._validate_conn(conn)
File "/home/h/anaconda3/envs/4dgaussian/lib/python3.8/site-packages/urllib3/connectionpool.py", line 1099, in _validate_conn
conn.connect()
File "/home/h/anaconda3/envs/4dgaussian/lib/python3.8/site-packages/urllib3/connection.py", line 616, in connect
self.sock = sock = self._new_conn()
File "/home/h/anaconda3/envs/4dgaussian/lib/python3.8/site-packages/urllib3/connection.py", line 213, in _new_conn
raise NewConnectionError(
urllib3.exceptions.NewConnectionError: <urllib3.connection.HTTPSConnection object at 0x7f4cad830a00>: Failed to establish a new connection: [Errno 101] Network is unreachable

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
File "/home/h/anaconda3/envs/4dgaussian/lib/python3.8/site-packages/requests/adapters.py", line 486, in send
resp = conn.urlopen(
File "/home/h/anaconda3/envs/4dgaussian/lib/python3.8/site-packages/urllib3/connectionpool.py", line 847, in urlopen
retries = retries.increment(
File "/home/h/anaconda3/envs/4dgaussian/lib/python3.8/site-packages/urllib3/util/retry.py", line 515, in increment
raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='huggingface.co', port=443): Max retries exceeded with url: /api/models/stabilityai/stable-video-diffusion-img2vid (Caused by NewConnectionError('<urllib3.connection.HTTPSConnection object at 0x7f4cad830a00>: Failed to establish a new connection: [Errno 101] Network is unreachable'))

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "gen_vid.py", line 115, in
gen_vid(args.name, args.seed, args.bg, args.is_pad)
File "gen_vid.py", line 63, in gen_vid
pipe = StableVideoDiffusionPipeline.from_pretrained(
File "/home/h/anaconda3/envs/4dgaussian/lib/python3.8/site-packages/diffusers/pipelines/pipeline_utils.py", line 1090, in from_pretrained
cached_folder = cls.download(
File "/home/h/anaconda3/envs/4dgaussian/lib/python3.8/site-packages/diffusers/pipelines/pipeline_utils.py", line 1649, in download
info = model_info(
File "/home/h/anaconda3/envs/4dgaussian/lib/python3.8/site-packages/huggingface_hub/utils/_validators.py", line 114, in _inner_fn
return fn(*args, **kwargs)
File "/home/h/anaconda3/envs/4dgaussian/lib/python3.8/site-packages/huggingface_hub/hf_api.py", line 2300, in model_info
r = get_session().get(path, headers=headers, timeout=timeout, params=params)
File "/home/h/anaconda3/envs/4dgaussian/lib/python3.8/site-packages/requests/sessions.py", line 602, in get
return self.request("GET", url, **kwargs)
File "/home/h/anaconda3/envs/4dgaussian/lib/python3.8/site-packages/requests/sessions.py", line 589, in request
resp = self.send(prep, **send_kwargs)
File "/home/h/anaconda3/envs/4dgaussian/lib/python3.8/site-packages/requests/sessions.py", line 703, in send
r = adapter.send(request, **kwargs)
File "/home/h/anaconda3/envs/4dgaussian/lib/python3.8/site-packages/huggingface_hub/utils/_http.py", line 66, in send
return super().send(request, *args, **kwargs)
File "/home/h/anaconda3/envs/4dgaussian/lib/python3.8/site-packages/requests/adapters.py", line 519, in send
raise ConnectionError(e, request=request)
requests.exceptions.ConnectionError: (MaxRetryError("HTTPSConnectionPool(host='huggingface.co', port=443): Max retries exceeded with url: /api/models/stabilityai/stable-video-diffusion-img2vid (Caused by NewConnectionError('<urllib3.connection.HTTPSConnection object at 0x7f4cad830a00>: Failed to establish a new connection: [Errno 101] Network is unreachable'))"), '(Request ID: 5119f1d6-fc7e-4c2b-89b3-620895c0449a)')

请问大佬们这种情况如何解决?

torch.cuda.OutOfMemoryError for A5000

Hi authors,

Thanks for the great work!

From the README file, it says A5000 should work for the codes.

However, I tried the codes with A5000 but encountered out-of-memory issue for A5000.

I was wondering if there are some adjustments from the code so that A5000 doesn't work anymore.

Or, is there anything wrong with my installation that could result in the difference?

Thanks a lot for your help!

stage1 extract geo+tex

Hey,
Thanks for your open source !

regarding stage1, I am trying to extract it not in ply but to glb (geo+text).
so I change in lines ~503 in ./main.py:

save

#self.save_model(mode='model')
self.save_model(mode='geo+tex')

but I got an error while extracting the field from the gaussian.
I still didn't debugged it, but before I enter to it, may you encounter this issue ?
Thanks a lot.

AttributeError: 'pymeshlab.pmeshlab.MeshSet' object has no attribute 'remove_unreferenced_vertices'. Did you mean: 'meshing_remove_unreferenced_vertices'?

When I run ' python main_4d.py --config configs/4d.yaml input=data/anya_rgba.png save_path=anya', the error is below:

[INFO] save model to logs/anya_4d_model.ply.
Traceback (most recent call last):
File "/data/users/yyy/dreamgaussian4d/main_4d.py", line 635, in
gui.train(opt.iters)
File "/data/users/yyy/dreamgaussian4d/main_4d.py", line 612, in train
self.save_model(mode='geo+tex', t=t)
File "/home/yyy/anaconda3/envs/yyy/lib/python3.10/site-packages/torch/utils/_contextlib.py", line 115, in decorate_context
return func(*args, **kwargs)
File "/data/users/yyy/dreamgaussian4d/main_4d.py", line 368, in save_model
mesh = self.renderer.gaussians.extract_mesh_t(path, self.opt.density_thresh, t=t)
File "/data/users/yyy/dreamgaussian4d/gaussian_model_4d.py", line 390, in extract_mesh_t
vertices, triangles = clean_mesh(vertices, triangles, remesh=True, remesh_size=0.015)
File "/data/users/yyy/dreamgaussian4d/mesh_utils.py", line 117, in clean_mesh
ms.remove_unreferenced_vertices()
AttributeError: 'pymeshlab.pmeshlab.MeshSet' object has no attribute 'remove_unreferenced_vertices'. Did you mean: 'meshing_remove_unreferenced_vertices'?

How to solve that?

I notice the pymeshlab version is 0.2.0 in requirments.txt. But when I install pymeshlab==0.2.0, the error occurs:
"ERROR: Could not find a version that satisfies the requirement pymeshlab==0.2.0 (from versions: 2021.10, 2022.2, 2022.2.post2, 2022.2.post3, 2022.2.post4, 2023.12)
ERROR: No matching distribution found for pymeshlab==0.2.0".
So I install the latest version. Is this an error caused by different versions?

Stage II error

Hi all, first of all, happy to say that your repo's install is one of the first painless ones. ;-) Only maybe add that python 3.8 is probably best to fit with the dependencies and add torchvision to the requirements list, as that was lacking.

Stage I runs fine, goes for 500 iterations for about 10 minutes on my RTX 3060. But then Stage II, I run:

python main_4d.py --config configs/4d.yaml input=data/anya_rgba.png save_path=anya

And I get:

PyMeshLab 0.2 based on MeshLab 2020.12d
Using zero-init and residual
feature_dim: 128
[INFO] load image from data/anya_rgba_000.png...
[ WARN:[email protected]] global loadsave.cpp:248 findDecoder imread_('data/anya_rgba_000.png'): can't open/read file: check file path/integrity
Traceback (most recent call last):
  File "main_4d.py", line 633, in <module>
    gui = GUI(opt)
  File "main_4d.py", line 79, in __init__
    self.load_input(self.opt.input) # load imgs, if has bg, then rm bg; or just load imgs
  File "main_4d.py", line 343, in load_input
    if img.shape[-1] == 3:
AttributeError: 'NoneType' object has no attribute 'shape'

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.