Giter Club home page Giter Club logo

generativegaitnet's Introduction

Generative GaitNet (Simple Version)

The updated version is available in https://github.com/namjohn10/BidirectionalGaitNet.

Abstract

Understanding the relation between anatomy and gait is key to successful predictive gait simulation. In this paper, we present Generative GaitNet, which is a novel network architecture based on deep reinforcement learning for controlling a comprehensive, full body, musculoskeletal model with 304 Hill-type musculotendons. The Generative GaitNet is a pre-trained, integrated system of artificial neural networks learned in a 618-dimensional continuous domain of anatomy conditions (e.g., mass distribution, body proportion, bone deformity, and muscle deficits) and gait conditions (e.g., stride and cadence). The pre-trained GaitNet takes anatomy and gait conditions as input and generates a series of gait cycles appropriate to the conditions through physics-based simulation. We will demonstrate the efficacy and expressive power of Generative GaitNet to generate a variety of healthy and pathological human gaits in real-time physics-based simulation.

Video (Youtube)

GenerativeGaitNet

Publications

https://mrl.snu.ac.kr/research/ProjectGaitNet/paper.pdf

Jungnam Park, Sehee Min, Phil Sik Chang, Jaedong Lee, Moon Seok Park, and Jehee Lee Generative GaitNet, SIGGRAPH 2022 Conference Proceedings.

Installation

We checked code works in Python 3.6, ray(rllib) 1.8.0 and Cluster Server (64 CPUs (128 threads) and 1 GPU (RTX 3090) per node)

Install Library Automatically

cd {downloaded folder}/
./install.sh

Compile

cd {downloaded folder}/
./pc_build.sh
cd build
make -j32

Rendering

To run without policy

cd {downloaded folder}/build
./imgui_render/imgui_render ../data/metadata.txt

or the trained policy.

cd {downloaded folder}/build
./imgui_render/imgui_render {network_path}

To run with trained 4 policies (to lower body),

cd {downloaded folder}/build
./imgui_render/imgui_render ../data/trained_nn/Skeleton ../data/trained_nn/Ankle ../data/trained_nn/Hip ../data/trained_nn/Merge

And check the edge connection file, ./data/cascading_map.txt (The right number is descendant policy in the graphs)

1 0
2 0
3 0
3 1
3 2

Learning

Parameter Setting

Set adjustable parameters in {downloaded folder}/data/metadata.txt. The group flag groups muscles containing the given name.

To set muscle length,

muscle_param
group(or not use) {Left Muscle1 Name} {min ratio} {max ratio}
group(or not use) {Right Muscle1 Name} {min ratio} {max ratio}
group(or not use) {Left Muscle2 Name} {min ratio} {max ratio}
group(or not use) {Right Muscle2 Name} {min ratio} {max ratio}
...
muscle_end

To set muscle force,

muscle_param
group(or not use) {Left Muscle1 Name} {min ratio} {max ratio}
group(or not use) {Right Muscle1 Name} {min ratio} {max ratio}
group(or not use) {Left Muscle2 Name} {min ratio} {max ratio}
group(or not use) {Right Muscle2 Name} {min ratio} {max ratio}
...
muscle_end

To set body proportion force,

muscle_param
global {min ratio} {max ratio}
Head {min ratio} {max ratio}
{Left Body Name} {min ratio} {max ratio}
{Right Body Name} {min ratio} {max ratio}
...
muscle_end

Training

Training is executed based on the metadata setting.

Training a single policy (Cluster setting)

cd {downloaded folder}/python
python3 ray_train.py --config=ppo_medium_node 

Cascading and Subsumption learning

cd {downloaded folder}/python
python3 ray_train.py --config=ppo_medium_node --cascading_nn={previous network paths}

generativegaitnet's People

Contributors

namjohn10 avatar

Stargazers

 avatar Yifei Yang avatar ShanningZhuang avatar  avatar Seung Min Lee avatar  avatar  avatar Junxuan Bai avatar Pierre Schumacher avatar Tommy Taylor avatar Hou Yiming avatar SportKight avatar Sainan Zhang avatar  avatar Zihao Zhang avatar  avatar Nam Jung Hyun avatar  avatar  avatar Pierre Puchaud avatar  avatar  avatar hyeonjang avatar Changmin Jeon avatar  avatar  avatar Ömer Kayan avatar  avatar Snow avatar Wentao Zhu avatar  avatar Gheorghe Lisca avatar sunny-Codes avatar sojoner avatar Phil Chang avatar Jiye Lee avatar Jehee Lee avatar Sehee Min avatar Andy avatar

Watchers

 avatar Junxuan Bai avatar  avatar

generativegaitnet's Issues

Problems on rendering

Thank you for your work. When I rendered the result, I met the problems as following:
eadb480c-2838-483b-b18e-8d81621effcb
Do you know how to deal with it?

已完成,我的python相关模块

(py36) shengyi@shengyi-System:~/demo/GenerativeGaitNet/build$ pip list
Package Version


aiosignal 1.2.0
async-timeout 4.0.2
attrs 22.2.0
backcall 0.2.0
certifi 2024.6.2
charset-normalizer 2.0.12
click 8.0.4
cloudpickle 1.2.2
cycler 0.11.0
dataclasses 0.8
decorator 4.4.2
distlib 0.3.8
dm-tree 0.1.8
filelock 3.4.1
frozenlist 1.2.0
future 1.0.0
grpcio 1.43.0
gym 0.13.1
gym-notices 0.0.8
gymnasium-notices 0.0.1
idna 3.7
imageio 2.15.0
importlib-metadata 4.8.3
importlib-resources 5.4.0
ipython 7.9.0
ipython-genutils 0.2.0
jedi 0.19.1
jsonschema 3.2.0
kiwisolver 1.3.1
lz4 3.1.10
matplotlib 3.3.4
msgpack 1.0.5
networkx 2.5.1
numpy 1.19.5
packaging 21.3
pandas 1.1.5
parso 0.8.4
pexpect 4.9.0
pickle5 0.0.12
pickleshare 0.7.5
Pillow 8.4.0
pip 21.3.1
platformdirs 2.4.0
prompt-toolkit 2.0.10
protobuf 4.21.0
ptyprocess 0.7.0
pyglet 1.3.2
Pygments 2.14.0
pyparsing 3.1.2
pyrsistent 0.18.0
python-dateutil 2.9.0.post0
pytz 2024.1
PyWavelets 1.1.1
PyYAML 6.0.1
ray[rllib] 1.8.0
redis 4.3.6
requests 2.27.1
scikit-image 0.17.2
scipy 1.5.4
setuptools 58.0.4
six 1.16.0
svgwrite 1.4.3
tabulate 0.8.10
tensorboardX 2.6.2.2
tifffile 2020.9.3
torch 1.10.1
torchaudio 0.10.1
torchvision 0.11.2
traitlets 4.3.3
typing_extensions 4.1.1
urllib3 1.26.18
virtualenv 20.17.1
wcwidth 0.2.13
wheel 0.37.1
zipp 3.6.0
(py36) shengyi@shengyi-System:~/demo/GenerativeGaitNet/build$

Pagmo not found

While running ./install.sh
I am faced with an error saying -- Looking for pagmo - NOT found, to use dart-optimizer-pagmo, please install pagmo
I installed pagmo by building it form source (https://esa.github.io/pagmo2/install.html) and seemed to be successful.
However I cannot get past this.
image

There is also an error saying -- No package 'glut' found. But I'm unsure if it is related to the above problem.

Thanks in advance for any help.

run

now,i finished the step of 'make',what should i do next? please ?

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.