emrnitk / gesturecontrol Goto Github PK

• Detect the presence of the user's eyes in the video frame.
• Develop the logic to decide when to pause or play the video based on the above information.
• Control the media player based on the above logic.

You can try using the different available options like haarcascade, mediapipe, etc whichever you feel is accurate and convenient.
If you can add some element of DIP here to make this system better, that would just be awesome 😉

This issues explains how to raise future issues. Observe a few things:

• If your issue is a part of hand gesture recognition add a milestone tag (as added in this issue). Do not add any milestone for issues that address both parts of the project.
• Add label of hand gesture (and eye tracking if issues addresses both parts).
• Mention to whom you want to assign the issue.

This first issue will be assigned to all members in the hand gesture recognition team.

This issues explains how to raise future issues. Observe a few things:

• If your issue is a part of eye tracking add a milestone tag (as added in this issue). Similarly do this if it is part of hand gesture recognition (you can only add a single milestone). Do not add any milestone for issues that address both parts of the project.
• Add label of eye tracking (and hand gesture if issues addresses both parts).
• Mention to whom you want to assign the issue.

This first issue will be assigned to all members in the eye/face tracking team.

Execute the commands derived from the user's gesture to control the media player (pause/play, volume up/down, etc).
(It may be done using pyautogui or any similar library).

Capture the video frames from the user's desktop webcam

Write the code for trackbars in a separate python file to change the lower and upper range of the HSV that would create a binary mask corresponding to the user's hand color.

Track the motion of the centroid of the user's hand and use that information to give different commands to the media player. SOme of the commands are: -

• Forward/ back
• Volume up/down
• Play/ Pause

• Detect the presence of the user's eyes in the video frame.
• Develop the logic to decide when to pause or play the video based on the above information.
• Control the media player based on the above logic.

You can try using the different available options like haarcascade, mediapipe, etc whichever you feel is accurate and convenient.
If you can add some element of DIP here to make this system better, that would just be awesome 😉

• Draw the contours for the user's hand using the mask created based on the user's hand color.
• Also, locate the centroid of the hand.

In this issue all we have to do is to try installing the repo and running it on different platforms i.e.

• Windows 11
• Windows 10
• macOS
• Linux

If anyone encounters any issues, mention it as a comment. If someone discovers a solution do the same.