andypotato / fingerpose Goto Github PK

Hello, I wanted to ask if it would be possible to load video file instead of webcam stream,

Hello. I've been trying (rather unsuccessfully) to get this to work on Node.JS. After a few hours, I got it working - a little. It refused to detect my hand and would give me a warning that read

============================
Hi there 👋. Looks like you are running TensorFlow.js in Node.js. To speed things up dramatically, install our node backend, which binds to TensorFlow C++, by running npm i @tensorflow/tfjs-node, or npm i @tensorflow/tfjs-node-gpu if you have CUDA. Then call require('@tensorflow/tfjs-node'); (-gpu suffix for CUDA) at the start of your program. Visit https://github.com/tensorflow/tfjs-node for more details.
============================

no matter how many times I installed both @tensorflow/tfjs-node and @tensorflow/tfjs-node-gpu, I still got the warning.

Eventually, I gave up and decided to use the demo provided inside the dist folder, which, unfortunately, did not work either. I managed to solve this by adding a backend at the start, namely https://cdn.jsdelivr.net/npm/@tensorflow/tfjs-backend-webgl"

Which leads me to now. I have yet another error, this time reading:

I am absolutely positive that this is not on my end. I've looked up everything I ever could and not a single related result pops up. I'd appreciate any help.

Problem
Recently, Tensorflow.js updated to version 2.0, which contains a few breaking changes. This affected this repository, because it loads tfjs-core and tfjs-converter scripts.

I posted an Issue on Tensorflow repository and was able to solve my problem.

Solution

Update the scripts to either version 1.7.4 (previous version) or to version 2.0 (new version). I kept my scripts with version 1.7.4:

<script src="https://cdn.jsdelivr.net/npm/@tensorflow/[email protected]/dist/tf-converter.min.js"></script>

<script src="https://cdn.jsdelivr.net/npm/@tensorflow/[email protected]/dist/tf-core.min.js"></script>

Hey,
I've added my own thumb down gesture like you've described on the page. The issue is, that the confidence is always higher than 9, f.e. when I show my thumb up. This is how I've defined the model:

        this.thumbsDownGesture = new fp.GestureDescription('thumbs_down');
        this.thumbsDownGesture.addCurl(fp.Finger.Thumb, fp.FingerCurl.NoCurl, 1.0);
        this.thumbsDownGesture.addDirection(fp.Finger.Thumb, fp.FingerDirection.VerticalDown, 1.0);
        this.thumbsDownGesture.addCurl(fp.Finger.Index, fp.FingerCurl.FullCurl, 1.0);
        this.thumbsDownGesture.addCurl(fp.Finger.Middle, fp.FingerCurl.FullCurl, 1.0);
        this.thumbsDownGesture.addCurl(fp.Finger.Ring, fp.FingerCurl.FullCurl, 1.0);
        this.thumbsDownGesture.addCurl(fp.Finger.Pinky, fp.FingerCurl.FullCurl, 1.0);

Hello thank you for this awesome project !

I've launched your basic project locally using npm and i'm trying to add a new Gesture with your tutorial
I've edited all files according to your tutorial and created a description of my gesture but i seem to have some issues with fingerpose.js. I've read 'Adding ThumbsDownGesture from README #1' and did a npm build but it doesn't work

When i'm listing the Gestures in my console, it creates a new Gesture but it's undefined and I have an error which says :

Uncaught (in promise) TypeError: d is undefined
value http://localhost:9000/fingerpose.js:1
estimateHands http://localhost:9000/:130
fingerpose.js:1:9770

I'm sorry if that's a silly question i'm new to node
Thank you

Hi, I am trying to use the version published on npm but is not working. I've seen that the code on master is newer than the tag available on npm. Thus, my application only works if I use directly the version inside your dist folder.

Any chance or updates about publishing the latest changes to npm?

I was following the readme example for adding a Thumbs Down Gesture Description, but when I execute the app, it breaks when trying to detect any gesture, presenting the following error:

fingerpose.js:562 Uncaught (in promise) TypeError: Cannot read property 'matchAgainst' of undefined at t.value (fingerpose.js:562) at estimateHands (index.html:132)

I've followed how ThumbsUp and Victory Gestures are defined and exported throughout the project and I believe it's something related to fingerpose.js file

Hi, I tried your example, but got this error.

Cross-Origin Request Blocked: The Same Origin Policy disallows reading the remote resource at https://storage.googleapis.com/tfhub-tfjs-modules/mediapipe/tfjs-model/handdetector/1/default/1/model.json. (Reason: CORS request did not succeed).

is there a type declaration for this package? having a hard time working with this in typescript