Comments (4)
Hello @L190201301,
I will put more information in the README, in the next few weeks. (I may also distributes their motions.)
To tell you what I use for comparison with previsous works (while waiting for me to update the README):
- For Lin et al:. as the code was not released, I use the reimplementation and pretrained model of Language2Pose (JL2P)
- JL2P: code and pretrained model: https://github.com/chahuja/language2pose
- Ghosh et al.: code and pretrained model: https://github.com/anindita127/Complextext2animation (this code is heavily based on JL2P)
To get the motions as npy files, I follow each README.md
to do the installation, then I do:
python sample_wordConditioned.py
=> to get motion samples (still as rifke features)- To get proper xyz joints, I "hack" their
render.py
script, such that it saves motions in npy instead of rendering them. (I do it in this way, to make sure the conversion rifke => xyz is done correctly). I will explain it more clearly in the README.
I will also update the eval.py
script, and upload the script to create a table with all the results.
from temos.
Hello, I also have a question with evaluation.
As far as I'm concerned, previous studies have not provided the results of the variable sequence length study.
Are all the results presented in the paper conducted using a fixed length?
from temos.
Hello,
That's a very good question. Actually, I am not doing something ideal, we can discuss a bit if you think of something better.
After generating motions (from any method), for each sequence inthe test set, I load the GT motion and the generated one. Then, I calculate the maximum number of frames in common (minimum length of both), and compute the metrics (APE root joints etc) on those frames. (This is an average, so sometimes it will compute the metrics with less elements).
TEMOS always generates motions of appropriate length, as this is one of the inputs to the model (all poses are generated in one pass). Previous work are generally auto-regressive, and are trained to generate a fixed number of poses at a time (which requires several passes through the model). When I evaluate, I take what they generate.
If you are interested in the code, you can check it out:
- Compute the min length:
Line 177 in ea12cf6
- Compute the metrics:
TEMOS/temos/model/metrics/compute.py
Line 82 in ea12cf6
from temos.
Hi,
I update the README.md. You can use the command line: bash prepare/download_previous_works.sh
to download the motion generated from previous work. Then python evaluate.py folder=previous_work/ghosh
to evaluate on ghosh et al.
from temos.
Related Issues (20)
- There are some errors when i tried to run sample.py to generate motion HOT 1
- How to fit the generated motion of KIT dataset to smpl HOT 1
- Skeleton structure and indexes HOT 1
- something wrong in the paper HOT 4
- "_fke.csv" HOT 4
- How to add texture to the rendered image? HOT 1
- for visualization, the ensurepip doesn't work HOT 2
- Some errors related to render and blender
- auto_select_gpus is deprecated in Pytorch Lightning 2.0.2 HOT 1
- tnteract pytho nerror HOT 1
- How to use interact.py ? HOT 1
- start and end positions HOT 1
- How to train TEMOS on other datasets? HOT 2
- System requirements HOT 1
- About evaluation result in Table 1 HOT 2
- how to accelerate render speed when using long sequences with blender HOT 1
- Problem of foot skating. HOT 3
- About the python in blender. HOT 4
- Blender installation HOT 1
- If
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from temos.