Giter Club home page Giter Club logo

facetracker's Introduction

Description

This project is very similar to my another project multiple-object-tracking, the only difference 
is a general YOLO3 detector in that project replaced by the MTCNN model (detecting faces only). 

Face detection and tracking is one of the most widely used application of deep-learning. 
Face detection model only detects faces visible on current frame. To track obstacle faces and moving
faces, we need to solve a multiple-object-tracking problem. This could be done in two steps:

1, Detecting moving faces in each frame
2, Tracking historical faces with some tracking algorithms

An assignment problem is used to associate the faces detected by detectors and tracked by trackers.

We can found some introduction of this framework here,
https://towardsdatascience.com/computer-vision-for-tracking-8220759eee85

Another example in more detail with matlab code (detecors and trackers may different),
https://www.mathworks.com/help/vision/examples/motion-based-multiple-object-tracking.html

Here I implemented a highly efficient and scalable C++ framework to combine the state of art 
deep-learning based face detectors (MTCNN here) and correlation filters based trackers 
(KCF, Kalman Filters also implemented). The assignment problem is solved by hungarian algorithm.

Detectors: MTCNN

MTCNN is a specific model used to detect face. This model is implemted using the technology described 
in my another project 'dnnsimd' and running purely on CPU with SIMD acceleration (auto-vectorization).

Trackers: Kalman Filter and KCF

Kalman filter is fast but less accurate. KCF is accurate but much slower. 
They are implemnted with exactly same interface, so we can easily switch from one to another 
in the project.

Live Camera Capture: OpenCV

OpenCV is used to capture live video frames and used for image preprocessing.

Misc

1, Only x64/Release environment variables are properly set
2, MTCNN supporting library (conv.c) can only be compiled by gcc to enable SIMD acceleration, 
   a Visual Studio compatible conv.o is provided and compiled by gcc with '-O3 -march=native'.

facetracker's People

Contributors

huangfcn avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar

facetracker's Issues

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.