AI4Animation - for javascript & three.js

Description

This project is a port of the original AI4Animation project, for use with three.js on the web. It explores the possibilities of using artifical intelligence to generate realtime character animations. This is very powerful as it allows for an unlimited number of realistic transitions between animation states.

I followed the SIGGRAPH 2018. example for this demo, using the same model weights and corresponding skeleton. After providing the inputs of trajectory points and previous bone positions, the neural network ( written using numjs ) outputs the next set of bone positions and velocities.

If you want to use a different skeleton, you will need to get motion capture data for this skeleton and train a new model, the instructions and tensorflow code for this are in the AI4Animation project here.

Todo Items:

• An example with a human skeleton.
• Trying a simpler machine learning model to help with the fps.

Live Demo

https://codercat.tk/ai-animation/

Run the demo yourself:

Run the following commands:

yarn install
yarn pull // this pulls the model weights hosted on the web
yarn start

Then open http://127.0.0.1:3000 in a web browser.