Giter Club home page Giter Club logo

Comments (13)

GuyTevet avatar GuyTevet commented on July 17, 2024

I think it is because the units of interval are [mSec]

from motionclip.

sygyq305 avatar sygyq305 commented on July 17, 2024

Thanks.
I have a confusion about the rendering duration. In the default, the fps is 20. In the paper-model's param, 'num_frames' is 60. So all rendered sample durations are 3 seconds. What should I do if I want to render 6-second-sample.
I once tried to change 'num_frames' from 60 to 120. Although the total duration has been to 6 seconds, it only adds 3 seconds to the rendering time. The first three seconds are the same as before, and the last three seconds are stationary.

from motionclip.

GuyTevet avatar GuyTevet commented on July 17, 2024

This model was trained for motions with a fixed length of 60 frames. Please try and retrain it for 120 frames.

from motionclip.

sygyq305 avatar sygyq305 commented on July 17, 2024

Thanks.
I have another confusion about the rendering. All rendered motions used paper-model can appear the rendered frames and their text description used during training. Just like Figure 4 in the paper.
image

from motionclip.

GuyTevet avatar GuyTevet commented on July 17, 2024

Do you ask about the appearance? If so, they all have the same appearance as in Fig 4
https://drive.google.com/file/d/1F8VLY4AC2XPaV3DqKZefQJNWn4KY2z_c/view?usp=sharing

from motionclip.

sygyq305 avatar sygyq305 commented on July 17, 2024

No.
My question is that fig.4 is the training-phase frame. Does the inference phase also have such frames

from motionclip.

GuyTevet avatar GuyTevet commented on July 17, 2024

At inference, you do text-to-motion - i.e. encode text and decode notion, so the rendered frames are unnecessary.

from motionclip.

sygyq305 avatar sygyq305 commented on July 17, 2024

What can I do if I want to see more details about the inference frames.

from motionclip.

GuyTevet avatar GuyTevet commented on July 17, 2024

Do you mean that you want to render the results with a more elaborate body model such as SMPL, instead of the stick figures?

from motionclip.

sygyq305 avatar sygyq305 commented on July 17, 2024

No, my mean is that I want to know how the frame numbers are allocated for each action.
For example, the input text is ’360 degree left jump and standing and turning back‘. There are three actions. They are jump, stand and turn back. How are the frame numbers of jump, stand and turn back allocated.

from motionclip.

GuyTevet avatar GuyTevet commented on July 17, 2024

Got you. So they are not explicitly allocated by the user, but by the model. If you want to interpret the model decisions you can try and adapt transformer interoperability papers to the motion domain. Anyway, that isn't a trivial one.

from motionclip.

sygyq305 avatar sygyq305 commented on July 17, 2024

Thanks.
And which files are the transformer interoperability papers

from motionclip.

GuyTevet avatar GuyTevet commented on July 17, 2024

Sorry, I'm not enough familiar with this field.

from motionclip.

Related Issues (20)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.