wangwei-25 / csdm Goto Github PK

Continuous Supervised Descent Method - ACCV 2016

This is the source code used to perform the experiments on face alignment for the following paper, to be published on december 2016 to the Asian Conference in Computer Vision:

Continuous Supervised Descent Method for Facial Landmark Localisation, M. Oliu, C. Corneanu, L. Jeni, J. Cohn, T. Kanade, S. Escalera. ACCV 2016

There you will find a complete description of the method and experimental results.

This source code contains the library developed for the project, implementing the proposed approach as well as SDM and Global SDM adapted to the statis case. It DOES NOT contain, because of its weight, the datasets used for the provided main files, but does contain the code to pre-process them, which is launched automatically if required, when running one of the main files. The two considered datasets are:

300-W:
A common benchmarking dataset for facial landmark localisation. Can be downloaded from http://ibug.doc.ic.ac.uk/resources/300-W/. To use the main files associated to this dataset, unzip the dataset into any desired folder, and modify the following line in the corresponding main files to point to this directory:

path = '/home/cvc/moliu/Datasets/300w/'

BU4DFE Synthesised:
A modified version of BU4DFE, with artificial rotations for a wide range of pitch and yaw angles. The dataset is linked to the main scripts in the same way as 300-W. A script is also provided to generate the BU4DFE-S dataset from BU4DFE. It is found under the bu4dfes folder.

In order to generate the BU4DFE-S dataset a set of background images is used. The backgrounds are obtained from the Places 205 Dataset you can access at http://places.csail.mit.edu. Download only the compressed file of the resized 256*256 images in testset from the link http://places.csail.mit.edu/download_places/testSetPlaces205_resize.tar.gz. Run augmentator/buildBackgrounds and save the generated files at a location of your choice. Call bu4dfes/main.m with the appropiate arguments. path2raw_data should point to the BU4DFE dataset location, path2proc_data should point to the location where you want to save the processed data and where you have saved the backgrounds, path2synt_data should point to the location where the new syntesized dataset will be generated. The function will first read the data from BU4DFE and then will synthesize new data from it. Synthesizing the data may take a long time and parallel execution on multiple CPUs is highly recomended.