Facial animation based on OpenFace(an open source facial behavior analysis toolkit)

OpenFace is get from https://github.com/TadasBaltrusaitis/OpenFace, a state-of-the art open source tool intended for facial landmark detection, head pose estimation, facial action unit recognition, and eye-gaze estimation. And I create a facial animation project on Windows, it can work in both real-time videos and off-line videos. Using the facial landmarks and head pose obtained from the openface tool. I created a mapping relation between the model and the facial landmarks so that the vertices of the model will deformed by the variation of landmarks.

OpenFace

The system is capable of performing a number of facial analysis tasks:

• Facial Landmark Detection

• Facial Landmark and head pose tracking (links to YouTube videos)

• Facial Feature Extraction (aligned faces and HOG features)

Facial Animation