mediapipe_data to osc about mediapipe4u-plugin HOT 4 CLOSED

It comes down to me having a few questions:

1. is the build that we receive after downloading the plugin editable? Or do we need an 'unbuilded' version of it? (I am not familiari with 'builds', I know its a basic c++ thing. I'm just being honest haha.

2. Could you point me in the right direction? In which part of the plugins are you appealing to the mediapipe array of positions?

cheers!

from mediapipe4u-plugin.

Hi @jossevessies

Sorry, its a precompiled plugin, you can‘t modify any code, its like a C# library （windows dll, linux so）. The difference is that C# puts the function and class information in the dll (IL symbo), and C++ puts it in the header file .

But you can develop your logic base on this plugin ( include the C++ header file in your project ).

Due to the large size of these precompiled files, they are not suitable for the git development pipline.

If you want to handle the mediapipe raw data, please see UMediaPipeHolisticComponent.h file.

It has some "Trigger" function, Trigger means a C++ native event ( like event/delegate in C# ), you can consume mediapipe data by subscribing to these events.

You can also subscribe these events to hook the lifecycle of the mediapipe graph, but this requires you to be very familiar with google mediapipe.

It's also important to note that MediaPipe4U uses multithreading, and the native event callbacks is not in game thread, so if you need to interact with the UE, you may need to post your callback to the game thread.

//UMediaPipeHolisticComponent.h

FLandmarksOutEvent& PoseLandmarksEventTrigger() { return PoseLandmarksEvent; }
FLandmarksOutEvent& LeftHandLandmarksEventTrigger() { return LeftHandLandmarksEvent; };
FLandmarksOutEvent& RightHandLandmarksEventTrigger() { return RightHandLandmarksEvent; }
FLandmarksOutEvent& FaceLandmarksEventTrigger() { return FaceLandmarksEvent; }
FLandmarksOutEvent& PoseWorldLandmarksEventTrigger() { return PoseWorldLandmarksEvent; }
FaceGeometryOutEvent& FaceGeometryEventTrigger() { return FaceGeometryEvent; }
FClassificationsOutEvent& FaceBlendShapesEventTrigger() { return FaceBlendShapesEvent; }
FVideoTextureCreatedEvent& VideoTextureCreatedEventTrigger() { return VideoTextureCreatedEvent; }

FOnMediaPipeHolisticStateChanged& OnMediaPipeHolisticStoppedTrigger() { return OnStoppedEvent; }
FBeforeMediaPipeHolisticStart& BeforeMediaPipeHolisticStartTrigger() { return BeforeStartEvent;  }
FOnMediaPipeHolisticStateChanged& OnMediaPipeHolisticStartFailedTrigger() { return OnStartFailedEvent;  }
FOnMediaPipeHolisticStateChanged& OnMediaPipeHolisticStartedTrigger() { return OnStartedEvent; }

from mediapipe4u-plugin.

This issue is stale because it has been open for 15 days with no activity.

from mediapipe4u-plugin.

This issue was closed because it has been inactive for 14 days since being marked as stale.

from mediapipe4u-plugin.