Giter Club home page Giter Club logo

temos's Issues

Skeleton structure and indexes

Hi,

I notice that the skeleton used in the KIT dataset has 21 joints. I would like to know what is the detailed skeleton structure and body joint indexes of KIT.

Many Thanks for your reply and help.

Evaluation with past research

Hi dear authors,
I would like to start by saying thank you for your amazing work.
Did you re-implement past research(Lin et. al./ JL2P/ Ghosh et al.)?
How can I evaluate them with your code?

How to get demo presented as pictures in the README files

Hi dear authors,

I would like to start by saying thank you for your amazing work. I managed to train the model and run the sample.py file. But the results I got were only a [.npy] file. Am I doing something wrong or are there additional steps I need to take to produce the similar results presented in the teaser figures?

About Evaluation

Hi dear author, Thanks for the amazing work.

I tried to test the model so I followed the instructions in README

  1. download the pre-trained models
  2. run sample.py to sample the motions with the pre-trained kit-mmm-xyz model
  3. run evaluate.py to calculate the metrics with motions above

However, I found that the results were not good enough. I am new to this area, and don't know where I did wrong. I will be deeply graceful if you could help me find out the mistakes. Thanks

APE_root APE_traj APE_mean_pose APE_mean_joints AVE_root AVE_traj AVE_mean_pose AVE_mean_joints
Paper 0.963 0.955 0.104 0.976 0.445 0.445 0.005 0.448
My run 1.033 1.024 0.104 1.048 0.448 0.448 0.005 0.451

how to accelerate render speed when using long sequences with blender

Hi, thanks for your great work. @Mathux

I tried to visualize amass annotations using Blender. I wonder if it is possible to render a long sequence of SMPL-X annotations parallelly to accelerate the rendering speed.

I am not very familiar with the blender. Could you give me some hints on how to rewrite some code to accelerate the process?

About non-rescaled version

Hello, I would like to use the non-scaled version suggested in your paper.

I'm reading the code and using it, but I wanna ask if it's right to do it the way below.

  1. in temos/model/metrics/compute.py,
    force_in_meter: bool = True,

    I changed the parameter force_in_meter to False
  2. in /temos/transforms/rots2joints/smplh.py,
    if jointstype == "mmm":
    from temos.info.joints import smplh_to_mmm_scaling_factor
    data *= smplh_to_mmm_scaling_factor

    I removed these codes when I use smpl data

Is this the correct way to proceed non-scaled version with smpl data?

Thanks!

auto_select_gpus is deprecated in Pytorch Lightning 2.0.2

First off, thanks for the great contribution to the community!

I am getting the following error when running the training code:

Error executing job with overrides: []
Traceback (most recent call last):
  File "D:\User\TEMOS\train.py", line 12, in _train
    return train(cfg)
  File "D:\User\TEMOS\train.py", line 66, in train
    trainer = pl.Trainer(
  File "D:\User\Anaconda37\envs\temos\lib\site-packages\pytorch_lightning\utilities\argparse.py", line 69, in insert_env_defaults
    return fn(self, **kwargs)
TypeError: __init__() got an unexpected keyword argument 'auto_select_gpus'

Set the environment variable HYDRA_FULL_ERROR=1 for a complete stack trace.

It seems like the auto_select_gpus argument is now deprecated in the latest version of Pytorch Lightning. See discussion here: Lightning-AI/pytorch-lightning#16147

Therefore it shouldn't be need on this line for the latest Pytorch Lightning:

auto_select_gpus: true

EDIT: I verified that this isn't an issue in version 1.9.5

I am happy to make a PR if need be, otherwise a frozen requirements.txt that is compatible with the state of the code as it is would be also really helpful.

Thanks for you help!

APE and AVE_pose metric calculation

Hey, Thank you so much for sharing this project.
I was trying to run the training code and saw what I think is a little bug here

dico.update({f"Metrics/{metric}": value for metric, value in metrics_dict.items()})

Should it have a .mean()?
dico.update({f"Metrics/{metric}": value.mean() for metric, value in metrics_dict.items()})
Otherwise, I get this error
image

Please let me know if I'm right or not :)

Thanks!

for visualization, the ensurepip doesn't work

I tried to use snap to install the blender 2.93lts/stable. And I've used /path/to/blender/python -m ensurepip --upgrade.
It returned as follows:

Defaulting to user installation because normal site-packages is not writeable
Looking in links: /tmp/tmp30yem5vm
Requirement already up-to-date: setuptools in /home/vatis/.local/lib/python3.9/site-packages (49.2.1)
Requirement already up-to-date: pip in /home/vatis/.local/lib/python3.9/site-packages (20.2.3)

It seems that pip was installed in the system python but not this builtin python.
Because when I used:
blender --background --python-expr "import pip"
It returned:

Blender 2.93.15 (hash 2888f351e535 built 2023-02-21 00:33:31)
Read prefs: /home/vatis/.config/blender/2.93/config/userpref.blend
Error: Python: Traceback (most recent call last):
  File "<string>", line 1, in <module>
ModuleNotFoundError: No module named 'pip'

location: <unknown location>:-1

Python: Traceback (most recent call last):
  File "<string>", line 1, in <module>
ModuleNotFoundError: No module named 'pip'

location: <unknown location>:-1

Blender quit

But all these worked for me when I followed your instruction on my mac. Did you know any solution to these? THX

Some errors related to render and blender

Firstly, I would like to thank the author for providing a very valuable project. I encountered some issues during the render and blender:

  1. Locate the python installation,/path/to/blender/pythonis:- D:\fyy\TEMOS\blender-2.93.14-windows-x64\blender-2.93.14-windows-x64\2.93\python,But when I run:

    D:\fyy\TEMOS\blender-2.93.14-windows-x64\blender-2.93.14-windows-x64\2.93\python -m ensurepip --upgrade
    

    or

    blender-2.93.14-windows-x64\blender-2.93.14-windows-x64\2.93\python -m ensurepip --upgrade
    

    cmd prompts:'blender-2.93.14-windows-x64\blender-2.93.14-windows-x64\2.93\python' is not an internal or external command, nor is it a runnable program or batch file.

  2. When I change /path/to/blender/python directly to python, I can complete the installation command:When I change /path/to/blender/Python directly to Python, I can complete the installation command:

    (temos) D:\fyy\TEMOS>python -m ensurepip --upgrade
    Looking in links: c:\Users\ADMINI~1.DES\AppData\Local\Temp\tmpcdpms3ic
    Requirement already satisfied: setuptools in c:\users\administrator.desktop-nkif354\.conda\envs\temos\lib\site-packages (65.6.3)
    Requirement already satisfied: pip in c:\users\administrator.desktop-nkif354\.conda\envs\temos\lib\site-packages (23.0.1)
    

    But there will be an error when running render. pyNo module named 'omegaconf'

    (temos) D:\fyy\TEMOS>blender-2.93.14-windows-x64\blender-2.93.14-windows-x64\blender --background --python render.py -- folder=outputs\kit-mmm-xyz\baseline\38yco6ib
    Blender 2.93.14 (hash dcf0f452818e built 2023-01-17 08:39:13)
    Read prefs: C:\Users\Administrator.DESKTOP-NKIF354\AppData\Roaming\Blender Foundation\Blender\2.93\config\userpref.blend
    Traceback (most recent call last):
      File "<string>", line 1, in <module>
      File "D:\fyy\TEMOS\render.py", line 11, in <module>
        import temos.launch.prepare  # noqa
      File "D:\fyy\TEMOS\temos\launch\prepare.py", line 4, in <module>
        from omegaconf import OmegaConf
    ModuleNotFoundError: No module named 'omegaconf'
    

How to solve these problems? Thank you in advance!

About the python in blender.

Hi, firstly, thank you very much for the tutorial on Blender's visualization. I have almost completed the steps, but I still encountered some problems.
I have installed blender 2.93, and the path of blender python is "/snap/blender/3688/2.93/python/bin/python3.9". I followed the instructions to install the needed packages, and if I use '/snap/blender/3688/2.93/python/bin/python3.9' to start the python, I can successfully import these packages. But if I use 'blender --background --python-expr "import xxx", the packages cannot be imported, causing the "No module" error. It seems that the Python interpreters launched in these two ways are not consistent. May I ask what is causing this situation and how I can resolve it.
Hope to get your help, thanks a lot.

Normalize Values Calculation

Hi,
Congrats and thanks for releasing your work!
May I double check how did you calculate the mean&std in normalization step? (e.g. the file under ${path.deps}/transforms/rots2rfeats/smplvelp/${.pose_rep}/${data.dataname}).

Thanks!

when I just set 'vae=False' in temos.yaml,I got errors below

hi authors, I want to try a situation when VAE is disabled and save its weights. but I was trapped in some problems(sorry, I just started)

  File "/Users/eanson/opt/miniconda3/envs/temos/lib/python3.9/site-packages/pytorch_lightning/strategies/strategy.py", line 370, in validation_step
    return self.model.validation_step(*args, **kwargs)
  File "/Users/eanson/Documents/dl/TEMOS/temos/model/base.py", line 33, in validation_step
    return self.allsplit_step("val", batch, batch_idx)
  File "/Users/eanson/Documents/dl/TEMOS/temos/model/temos.py", line 144, in allsplit_step
    loss = self.losses[split].update(ds_text=datastruct_from_text,
  File "/Users/eanson/Documents/dl/TEMOS/temos/model/losses/compute.py", line 83, in update
    total += self._update_loss("kl_text2motion", dis_text, dis_motion)
  File "/Users/eanson/Documents/dl/TEMOS/temos/model/losses/compute.py", line 105, in _update_loss
    val = self._losses_func[loss](outputs, inputs)
  File "/Users/eanson/Documents/dl/TEMOS/temos/model/losses/kl.py", line 9, in __call__
    div = torch.distributions.kl_divergence(q, p)
  File "/Users/eanson/opt/miniconda3/envs/temos/lib/python3.9/site-packages/torch/distributions/kl.py", line 170, in kl_divergence
    raise NotImplementedError("No KL(p || q) is implemented for p type {} and q type {}"
NotImplementedError: No KL(p || q) is implemented for p type NoneType and q type NoneType

pip list

Package                 Version
----------------------- -----------
absl-py                 1.3.0
aiohttp                 3.8.3
aiosignal               1.2.0
antlr4-python3-runtime  4.9.3
astroid                 2.12.12
async-timeout           4.0.2
attrs                   22.1.0
beautifulsoup4          4.11.1
cachetools              5.2.0
certifi                 2022.9.24
charset-normalizer      2.1.1
colorlog                6.7.0
commonmark              0.9.1
contourpy               1.0.6
cycler                  0.11.0
decorator               4.4.2
dill                    0.3.6
einops                  0.5.0
filelock                3.8.0
fonttools               4.38.0
frozenlist              1.3.1
fsspec                  2022.10.0
google-auth             2.13.0
google-auth-oauthlib    0.4.6
grpcio                  1.50.0
huggingface-hub         0.10.1
hydra-colorlog          1.2.0
hydra-core              1.2.0
idna                    3.4
imageio                 2.22.2
imageio-ffmpeg          0.4.7
importlib-metadata      5.0.0
isort                   5.10.1
kiwisolver              1.4.4
lazy-object-proxy       1.7.1
Markdown                3.4.1
MarkupSafe              2.1.1
matplotlib              3.6.1
mccabe                  0.7.0
moviepy                 1.0.3
multidict               6.0.2
numpy                   1.23.4
oauthlib                3.2.2
omegaconf               2.2.3
packaging               21.3
pandas                  1.5.1
Pillow                  9.3.0
pip                     22.2.2
platformdirs            2.5.2
proglog                 0.1.10
protobuf                3.19.6
psutil                  5.9.3
pyasn1                  0.4.8
pyasn1-modules          0.2.8
pyDeprecate             0.3.2
Pygments                2.13.0
pylint                  2.15.5
pyparsing               3.0.9
PySocks                 1.7.1
python-dateutil         2.8.2
pytorch-lightning       1.7.7
pytz                    2022.5
PyYAML                  6.0
regex                   2022.9.13
requests                2.28.1
requests-oauthlib       1.3.1
rich                    12.6.0
rsa                     4.9
setuptools              59.5.0
shortuuid               1.0.9
six                     1.16.0
soupsieve               2.3.2.post1
tensorboard             2.10.1
tensorboard-data-server 0.6.1
tensorboard-plugin-wit  1.8.1
tokenizers              0.13.1
tomli                   2.0.1
tomlkit                 0.11.5
torch                   1.13.0
torchmetrics            0.7.0
torchvision             0.14.0
tqdm                    4.64.1
transformers            4.23.1
typing_extensions       4.4.0
urllib3                 1.26.12
Werkzeug                2.2.2
wheel                   0.37.1
wrapt                   1.14.1
yarl                    1.8.1
zipp                    3.9.0

something wrong in the paper

In the code, the num_heads of the transformer encoder in config cannot be injected into the .py file because of a spelling error, so it is always 4, which is not equal to num_layer like the paper

Problem of foot skating.

Hello! First of all, thanks for your excellent work. I ran your interact code and tested it on all three of the pre-trained models provided, but found that the results had severe foot skating. It was different from the effects described in the paper.
These are the results of the text "A person takes two steps, raises his right hand, keeps walking" on the three models. Problems also arise with other text inputs.

a_person_takes_two_steps._raises_his_right_hand._keeps_walking_len_60.webm
a_person_takes_two_steps._raises_his_right_hand._keeps_walking_len_61.webm
a_person_takes_two_steps._raises_his_right_hand._keeps_walking_len_62.webm

interact.py example gives errors, import fails

Hi, I am really interested to try your method. I tried installing and following your advice to use the interact.py script, but get some errors that temos.data.kit cannot be found. Is there some special instruction how to install Temos, an install script in addition to the git clone? Or a proper way how to add to sys.path in python?

Thanks a lot for your help

 python interact.py folder=pretrained_models/kit-mmm-xyz/3l49g7hv/ saving=kick text="A person kicks with the right foot." length=60
[10/25/22 15:07:48] INFO     Interaction script. The result will be saved there: kick                   interact.py:52
                    INFO     The sentence is: A person kicks with the right foot.                       interact.py:53
[10/25/22 15:07:50] INFO     Created a temporary directory at /tmp/tmp4gjoeeh5                      instantiator.py:21
                    INFO     Writing /tmp/tmp4gjoeeh5/_remote_module_non_scriptable.py              instantiator.py:76
                    INFO     Global seed set to 1234                                                        seed.py:71
                    INFO     Loading model                                                              interact.py:71
                    INFO     Loading data module                                                        interact.py:77
Error executing job with overrides: ['folder=pretrained_models/kit-mmm-xyz/3l49g7hv/', 'saving=kick', 'text=A person kicks with the right foot.', 'length=60']
Traceback (most recent call last):
  File "/usr/local/lib/python3.7/dist-packages/hydra/_internal/utils.py", line 639, in _locate
    obj = getattr(obj, part)
AttributeError: module 'temos.data' has no attribute 'kit'

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.7/dist-packages/hydra/_internal/utils.py", line 645, in _locate
    obj = import_module(mod)
  File "/usr/lib/python3.7/importlib/__init__.py", line 127, in import_module
    return _bootstrap._gcd_import(name[level:], package, level)
  File "<frozen importlib._bootstrap>", line 1006, in _gcd_import
  File "<frozen importlib._bootstrap>", line 983, in _find_and_load
  File "<frozen importlib._bootstrap>", line 967, in _find_and_load_unlocked
  File "<frozen importlib._bootstrap>", line 677, in _load_unlocked
  File "<frozen importlib._bootstrap_external>", line 728, in exec_module
  File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
  File "/content/TEMOS/temos/data/kit.py", line 15, in <module>
    from temos.transforms import Transform
  File "/content/TEMOS/temos/transforms/__init__.py", line 2, in <module>
    from .smpl import SMPLTransform
  File "/content/TEMOS/temos/transforms/smpl.py", line 8, in <module>
    from .joints2jfeats import Joints2Jfeats
  File "/content/TEMOS/temos/transforms/joints2jfeats/__init__.py", line 2, in <module>
    from .rifke import Rifke
  File "/content/TEMOS/temos/transforms/joints2jfeats/rifke.py", line 11, in <module>
    class Rifke(Joints2Jfeats):
  File "/content/TEMOS/temos/transforms/joints2jfeats/rifke.py", line 122, in Rifke
    def extract(self, features: Tensor) -> tuple[Tensor]:
TypeError: 'type' object is not subscriptable

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.7/dist-packages/hydra/_internal/instantiate/_instantiate2.py", line 134, in _resolve_target
    target = _locate(target)
  File "/usr/local/lib/python3.7/dist-packages/hydra/_internal/utils.py", line 655, in _locate
    ) from exc_import
ImportError: Error loading 'temos.data.kit.KITDataModule':
TypeError("'type' object is not subscriptable")

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "interact.py", line 146, in <module>
    _interact()
  File "/usr/local/lib/python3.7/dist-packages/hydra/main.py", line 95, in decorated_main
    config_name=config_name,
  File "/usr/local/lib/python3.7/dist-packages/hydra/_internal/utils.py", line 396, in _run_hydra
    overrides=overrides,
  File "/usr/local/lib/python3.7/dist-packages/hydra/_internal/utils.py", line 453, in _run_app
    lambda: hydra.run(
  File "/usr/local/lib/python3.7/dist-packages/hydra/_internal/utils.py", line 216, in run_and_report
    raise ex
  File "/usr/local/lib/python3.7/dist-packages/hydra/_internal/utils.py", line 213, in run_and_report
    return func()
  File "/usr/local/lib/python3.7/dist-packages/hydra/_internal/utils.py", line 456, in <lambda>
    overrides=overrides,
  File "/usr/local/lib/python3.7/dist-packages/hydra/_internal/hydra.py", line 132, in run
    _ = ret.return_value
  File "/usr/local/lib/python3.7/dist-packages/hydra/core/utils.py", line 260, in return_value
    raise self._return_value
  File "/usr/local/lib/python3.7/dist-packages/hydra/core/utils.py", line 186, in run_job
    ret.return_value = task_function(task_cfg)
  File "interact.py", line 14, in _interact
    return interact(cfg)
  File "interact.py", line 78, in interact
    data_module = instantiate(cfg.data)
  File "/usr/local/lib/python3.7/dist-packages/hydra/_internal/instantiate/_instantiate2.py", line 223, in instantiate
    config, *args, recursive=_recursive_, convert=_convert_, partial=_partial_
  File "/usr/local/lib/python3.7/dist-packages/hydra/_internal/instantiate/_instantiate2.py", line 325, in instantiate_node
    _target_ = _resolve_target(node.get(_Keys.TARGET), full_key)
  File "/usr/local/lib/python3.7/dist-packages/hydra/_internal/instantiate/_instantiate2.py", line 139, in _resolve_target
    raise InstantiationException(msg) from e
hydra.errors.InstantiationException: Error locating target 'temos.data.kit.KITDataModule', see chained exception above.
full_key: data

Custom Prompts

Hello, thanks for releasing the code for this awesome work! Does this repo currently support custom prompts? If not, could you highlight the necessary changes?

Blender installation

Hi! Thank you for your great work.

Following your kind explanation, I was going to install the blender package.
I've tried several ways but I finally failed to install it.

  1. Install via snap: use command sudo snap install blender --channel=2.93lts/stable --classic.
    In this way, I got /snap/bin/blender and /snap/blender/3688 but when I put command blender --background --version, the system says The program 'blender' is currently not installed. You can install it by typing: sudo apt install blender.

  2. Install via binary file: download blender-2.93.18-linux-x64.tar.xz from https://www.blender.org/download/lts/2-93/ and uncompress it, and copy the binary file into /usr/bin/ directory.
    After that, blender --background --version return Blender 2.93.18 (hash cb886aba06d5 built 2023-05-22 23:33:27) correctly but blender --background --python-expr "import sys; print('\nThe version of python is '+sys.version.split(' ')[0])" occurs the following error:

Color management: using fallback mode for management
Color management: Error could not find role data role.
Blender 2.93.18 (hash cb886aba06d5 built 2023-05-22 23:33:27)
BLT_lang_init: 'locale' data path for translations not found, continuing
Color management: scene view "Filmic" not found, setting default "Standard".
blf_load_font_default: 'fonts' data path not found for 'droidsans.ttf', will not be able to display text
blf_load_font_default: 'fonts' data path not found for 'bmonofont-i18n.ttf', will not be able to display text
blf_load_font_default: 'fonts' data path not found for 'bmonofont-i18n.ttf', will not be able to display text
/run/user/1000/gvfs/ non-existent directory
bpy: couldn't find 'scripts/modules', blender probably wont start.
Freestyle: couldn't find 'scripts/freestyle/modules', Freestyle won't work properly.
ModuleNotFoundError: No module named 'bpy_types'
ModuleNotFoundError: No module named 'bpy_types'
ERROR (bpy.rna): source/blender/python/intern/bpy_rna.c:7305 pyrna_srna_ExternalType: failed to find 'bpy_types' module
ModuleNotFoundError: No module named 'bpy_types'
ModuleNotFoundError: No module named 'bpy_types'
ERROR (bpy.rna): source/blender/python/intern/bpy_rna.c:7305 pyrna_srna_ExternalType: failed to find 'bpy_types' module
ModuleNotFoundError: No module named 'bpy_types'
ERROR (bpy.rna): source/blender/python/intern/bpy_rna.c:7305 pyrna_srna_ExternalType: failed to find 'bpy_types' module
ModuleNotFoundError: No module named 'bpy_types'
ERROR (bpy.rna): source/blender/python/intern/bpy_rna.c:7305 pyrna_srna_ExternalType: failed to find 'bpy_types' module
ModuleNotFoundError: No module named 'bpy_types'
ERROR (bpy.rna): source/blender/python/intern/bpy_rna.c:7305 pyrna_srna_ExternalType: failed to find 'bpy_types' module
ModuleNotFoundError: No module named 'bpy_types'
ERROR (bpy.rna): source/blender/python/intern/bpy_rna.c:7305 pyrna_srna_ExternalType: failed to find 'bpy_types' module
ModuleNotFoundError: No module named 'bpy_types'
ERROR (bpy.rna): source/blender/python/intern/bpy_rna.c:7305 pyrna_srna_ExternalType: failed to find 'bpy_types' module
ModuleNotFoundError: No module named 'bpy'
Error: dropbox with unknown operator: WM_OT_drop_blend_file
terminate called after throwing an instance of 'std::logic_error'
  what():  basic_string::_S_construct null not valid
Aborted (core dumped)

I've been struggling with this problem for several days.... I couldn't find any solution on google.
I would so appreciate it if you (or anyone else) could help me with this issue.

Thank you.

Training on multi-GPU

Hi dear author,
I would like to train the temos on multi-GPU. As shown in Fig.1, It runs well when using one GPU as default. But, when I try to run it on multi-GPU and set the gpus: 4 in the trainer config file, I meet a Type Error shown in Fig.2. So, I would like to know how to train temos on multi-GPU well.

One GPU Training:
微信截图_20220610094505

Four GPUs Training:
微信截图_20220610094621

How to train TEMOS on other datasets?

Hello, thank you very much for providing such an excellent project.
TEMOS was trained on the KIT-ML dataset, but this dataset is too small. I would like to ask how to train TEMOS on other datasets? For example, the BABEL dataset and the HumanML3D dataset.
Looking forward to your reply, thank you!

tnteract pytho nerror

code can not be run

python .\interact.py folder='res'

FileNotFoundError: [Errno 2] No such file or directory: 'E:\codes\MOS\res\.hydra\config.yaml'

System requirements

Thanks for this great contribution. I'd love to explore its capabilities. Can you add some system requirements or state on which OS resp. hardware you have run this?

About checkpoints

Hi, thanks for your great work. I have a question about checkpoints.

I saw config files, and I can find that you used mode=max in latest_checkpoint.yaml, but I can't find it in last_checkpoint.yaml.
so if you used the same metrics for them, I think we need to remove it from latest_checkpoint.yaml. (If use error or loss for metrics)

How do you think about this?

Additionally, I want to know which one is the best model. Is the last.ckpt the best model with metrics (valid error or loss)?

thanks.

The config in rendering

When rendering all the data (folder=FOLDER setting), it seems that the infolder parameter in file configs/render.yaml should be set as true.

About rendering on a Windows system

Hi dear authors,
I would like to start by saying thank you for your amazing work.

I tried rendering in my Windows system the way you wrote it, but it didn't work.
I can not Install those packages in the python environnement of blender.

like "defaulting to user installation because normal site-packages is not writeable"

File Not Found Error

Hi,
Thank you for sharing the official codes. I followed the instructions in the README.md file. However, when I tried to run the train.py, I met a File Not Found Error and I would like to know what makes this error and how to fix it.

Many thanks for your kind help.

微信截图_20220608201221

start and end positions

thanks for this interesting work. When creating video sequences, the code ties the start and end positions tied to be the same for every prompt. Is it easy to relax this so that a prompt 'a person is sitting' has them sitting throughout all frames, rather than standing, moving to sitting, and back again ? Not sure if changing the 'canonicalize' setting would help with this. I do not need to evaluate metrics.

I am using this type of command (together with blender video creation).
python3 interact.py text="a person is sitting" folder=out saving=out length=50 jointstype=vertices

I have copied the config.yaml, hydra.yaml and overrides.yaml from pretrained model kit-amass-rot\1cp6dwpa to out/.hydra

Problems related to blender installation

Thanks for your tutorial of the blender installation.
There are some problems. The command:

blender --background --python-expr "import sys; import os; print('\nThe path to the installation of python of blender can be:'); print('\n'.join(['- '+x for x in sys.path if 'python' in (file:=os.path.split(x)[-1]) and not file.endswith('.zip')]))"

works wrongly on my MacOS.

It returns me a path /Applications/Blender.app/Contents/Resources/3.2/python/lib/python3.10. However, this is not an executable python path. I changed it into /Applications/Blender.app/Contents/Resources/3.2/python/bin/python3.10, which works well on my MacOS. Is it a bug of the provided command?

This is the problem I met with here, peers with the same problem can solve it similarly. I hope the authors can modify this command. Thanks~

"_fke.csv"

kit dataset originally had "_fke.csv" file, or was it generated by data preprocessing? If it was generated by preprocessing, could you please send me the code

About evaluation result in Table 1

Hello, thank you for such a great project. I have a question when reading Table 1 of the paper:
Are the evaluation data on APE and AVE shown in Table 1 the average of multiple evaluation results? If so I would like to ask how many experiments you did?
Because I changed the random number and trained the model multiple times, the results obtained each time were not as good as shown in the paper. Even if I averaged multiple experiments, I did not achieve the effect shown in the paper.

Rendering SMPLX motion sequence of AMASS

Hi, thanks for your excellent work. I follow your instruction and successfully visualize the SMPL motion sequence of AMASS. I try to visualize the SMPLX motion sequence and save the meshes in a format of (T, 10475, 3). And then, I render the meshes with render.py using blender. However, the rendering result is as follows:
Do you have any idea about this issue?
image

There are some errors when i tried to run sample.py to generate motion

QQ截图20230115170913
Error executing job with overrides: ['folder=D:\text-to-motion-main\TEMOS-master\TEMOS\pretrained_models\kit-amass-xyz\5xp9647f']
[01/15/23 16:45:45] INFO Global seed set to 1234 seed.py:54 INFO Loading data module sample.py:88Error executing job with overrides: ['folder=D:\text-to-motion-main\TEMOS-master\TEMOS\pretrained_models\kit-mmm-xyz\3l49g7hv']
Error in call to target 'temos.data.kit.KITDataModule':
FileNotFoundError(2, 'No such file or directory')
full_key: data

Set the environment variable HYDRA_FULL_ERROR=1 for a complete stack trace.


besides,
kit datasets have only "xxxx_mmm.xml","xxx_annotations.json"and"xxxx_meta.json",where to find "_fke.csv"? Is it the reason why I met these errors when I wanted to generate motions?

hope you can reply as soon as possible
thank you!

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.