creativeikep / holisticbarracuda Goto Github PK

May I ask how to obtain the 'pose landmark' shown in the following figure from the output of 'pose landmark_full. onnx'? Can you explain your post processing? Thank you!

The video in camera screen is slower than actual action,could you help me that the video in camera screen synchronize with actual action？

I would like to exchange the points, for a humanoid model, to make an avatar body tracking that records the animations. How can I replace points by template?

First I want to mention that it's awesome that you are mainting a package like this 👍

Info:
I'm currently working on a mocap app and I'm trying to find alternatives to https://github.com/homuler/MediaPipeUnityPlugin

(1) Face tracking quality

The face tracking stops working when I walk backwards from the camera or when I turn my face slightly in any direction. This happenes at any resolution, I've tried multiple resolutions between 140p and 1920p.

In this image I'm looking slightly upwards and the pose tracker can identify were my face is but the refined face model froze and stoped tracking my face

Do you know what causes this or a fix for this?
Are there internal thresholds I need to update?

(2) Framerate

In my test scene I usually get around 60-70 fps when using MediaPipeUnityPlugin but with this package it went down to 20 fps.

I checked the Unity Profiler and HolisticPipeline.ProcessImage took around 50 ms per frame.
I placed the ProcessImage call inside an void Update() method

Do you know a way to increase the framerate?

Feature request

Please enable GPU mode.

hi. I want to use the code with open my pc camera, but i do not know how could i get the video resources from camera?

Look at this picture, the video in game view showing the girl so zoomed in. but look at the lower right corner. The game view seems not showing the full video.

Hi, is it possible to get a landmark screen position in C# script? Thanks