Giter Club home page Giter Club logo

Comments (7)

tsschwartz99 avatar tsschwartz99 commented on July 17, 2024 1

Perfect, thank you @brmarkus! I think that addresses my questions.

from openface.

brmarkus avatar brmarkus commented on July 17, 2024

Can you share an example (executable, command-line parameters, ideally medium/video/input, CSV output (snippet))?

from openface.

brmarkus avatar brmarkus commented on July 17, 2024

Try this:

output_file << std::setprecision(2);

from openface.

tsschwartz99 avatar tsschwartz99 commented on July 17, 2024

@brmarkus Thanks for the quick response! Your suggested edit did change the amount of significant figures in the CSV file. Very, very helpful. Thank you again.

Do you have any idea of where face_model.detection_certainty is calculated? I'm hoping that I could also potentially increase the amount of significant figures there as well.

This is the command I am using:
FeatureExtraction -f <video file> -q -pose -3Dfp -aus -pdmparams -2Dfp -out_dir <path to output dir>

from openface.

brmarkus avatar brmarkus commented on July 17, 2024

I think its retrieved here:

clnf_model.pdm.CalcParams(clnf_model.params_global, bounding_box, clnf_model.params_local, rotation_hypotheses[hypothesis]);

and
bool success = clnf_model.DetectLandmarks(grayscale_image, params);

But isn't this actually the value written into the CSV into the column confidence...?

EDIT:
The visualizer gets and remembers it:
https://github.com/TadasBaltrusaitis/OpenFace/blob/3d4b5cf8d96138be42bed229447f36cbb09a5a29/lib/local/Utilities/src/RecorderOpenFace.cpp#L470C8-L470C37

and then write into the CSV:

landmark_detection_confidence, landmarks_2D, landmarks_3D, pdm_params_local, pdm_params_global, head_pose,

from openface.

tsschwartz99 avatar tsschwartz99 commented on July 17, 2024

@brmarkus I apologize for my late response.

Yes, detection_certainty is what is written to the CSV file. But looking at these code references in the most recent reply, it is still not clear where this value is actually calculated. Despite changing the level of significance as suggested in the above reply (output_file << std::setprecision(2);), the confidence in my resulting CSV files only go to the thousandths place, despite having my significance set to 5 decimal places. Most of the non-zero results end in a .005 as well. This seems odd and I wanted to see if there is any additional rounding happening in when calculating this confidence. I know there isn't any after output_file << std::setprecision(2);.

from openface.

brmarkus avatar brmarkus commented on July 17, 2024

I think the magic happens in the multiple "neural networks".
Unfortunately I'm not familiar with the used undelying network architectures - otherwise there would be a chance to look into those with e.g. the viewer "Netron", to analyse especially the outer, last layers.

You might want to have a look intho e.g.

to get an impression what OpenFace's models might do as well. Under the hood it might use FP32, FP16, or uses INT8 quantization or something like that.

Excerpt for "facial-landmarks-35-adas-0002":

image
You will see convolutions, softmax, dropout, weight-filter, batch-norm, flatten and many more.

from openface.

Related Issues (20)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.