Giter Club home page Giter Club logo

normface's Introduction

NormFace

NormFace: L2 HyperSphere Embedding for Face Verification

http://www.cs.jhu.edu/~alanlab/Pubs17/wang2017normface.pdf

Baseline Model Original Accuracy Finetune Using Normalization
Light CNN(MaxOut)   98.41%*   98.78%
Center Face(ResNet) 99.03% 99.21%

* It is 98.13% on Light CNN's project page. After applying the mirror face trick, it becomes 98.41%.

Requirements

  1. My Caffe (https://github.com/happynear/caffe-windows/tree/ms). It also works on Linux. Anyway, if you want to use your own Caffe, please transplant the inner_product_layer, inner_distance_layer, normalize_layer, general_contrastive_layer, flip_layer and accuracy_layer to your Caffe. Since there are too many layers to transplant, I suggest you to use my Caffe directly:)
  2. Matlab to draw some figures.
  3. GPU with CUDA support.
  4. MTCNN face and facial landmark detector(https://github.com/kpzhang93/MTCNN_face_detection_alignment).
  5. Baseline model such as Center Face or Light CNN or your own model trained by softmax loss. I don't know whether my loss helps or not if your model is trained by other loss functions. You may have a try. I believe it will be effective if there is no normalization term in your model.

Train

  1. The dataset used in this paper is CASIA-Webface. Note that there are 3 identities overlap between CASIA-Webface and LFW. They are 0166921, 1056413 and 1193098. For fair evaluation, it is recommended to remove them from CAISA-Webface.
  2. Align all face images using MTCNN. The script can be found in my another github repository.
  3. Replace the final inner-product layer and softmax layer with layers defined in scaled_cosine_softmax.prototxt or normalized_Euclidean_contrastive.prototxt.
  4. Fine-tune the network based on the original model using a small learning rate, say 0.001 or 0.0001.

Evaluation

Evaluation codes are in my another github repository. Please refer to the second paragraph of the Update section.

A trick called mirror face is used during extracting the features. A sample code is in ./prototxt/example_of_mirror_face.prototxt.

About the mirror face: See ./MirrorFace.md

About the histogram feature for video face verification: Details are in ./YTF.

Trained Models

Light CNN B model(98.78%): Google Drive or Baidu Yun.

ps: I used to get a model of 98.8%, but I lost it....

Center Face (ResNet-27) model(99.21%): Google Drive or Baidu Yun.

License

This code is distributed under MIT LICENSE. The released models are only allowed for non-commercial use.

Citation

If you find my paper or the codes useful in your research, please cite

@inproceedings{wang2017normface,
  title={NormFace: L2 Hypersphere Embedding for Face Verification},
  author={Wang, Feng and Xiang, Xiang and Cheng, Jian and Yuille, Alan L.},
  booktitle={Proceedings of the 25th ACM international conference on Multimedia},
  year={2017},
  organization={ACM},
  doi = {https://doi.org/10.1145/3123266.3123359}
}

Contact

Feng Wang [feng.wff(at)gmail.com], please replace (at) with @.

normface's People

Contributors

happynear avatar

Watchers

James Cloos avatar paopaoyu avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.