kiranchhatre / amuse Goto Github PK

Kiran Chhatre · Radek Daněček · Nikos Athanasiou
Giorgio Becherini · Christopher Peters · Michael J. Black · Timo Bolkart

This is a repository for AMUSE: Emotional Speech-driven 3D Body Animation via Disentangled Latent Diffusion. AMUSE generates realistic emotional 3D body gestures directly from a speech sequence (top). It provides user control over the generated emotion by combining the driving speech with a different emotional audio (bottom).

• [2024/02/27] AMUSE has been accepted for CVPR 2024! Working on code release.
• [2023/12/08] ArXiv is available.

@misc{chhatre2023emotional,
      title={Emotional Speech-driven 3D Body Animation via Disentangled Latent Diffusion}, 
      author={Kiran Chhatre and Radek Daněček and Nikos Athanasiou and Giorgio Becherini and Christopher Peters and Michael J. Black and Timo Bolkart},
      year={2023},
      eprint={2312.04466},
      archivePrefix={arXiv},
      primaryClass={cs.CV}
}