Giter Club home page Giter Club logo

graduate_design's Introduction

co-author

Chat GPT(听我说谢谢你😭)

Run Env

Ubuntu 22.04

Known problem: OS X do not support UI on non main thread. So OS X can not run demos in gaze_guy.web. gaze_guy.display is fine.

git clone

git clone 记得加 --depth 1 参数。不然会很大。

main.py

参考:main --- 最高层级代码环境

创建一个Python包时,需有一个__init__.py文件,用来标识Python包。

在命令行直接输入python -m package_name 就会执行__main__.py文件。

face detector

Dlib是一个现代化的C++工具箱,其中包含用于在C++中创建复杂软件以解决实际问题的机器学习算法和工具。

MediaPipe 是一款由 Google Research 开发并开源的多媒体机器学习模型应用框架。基于图形的跨平台框架,用于构建多模式(视频,音频和传感器)应用的机器学习管道。

对比

  • 都支持GPU加速
  • dlib只支持2d坐标,mediapipe支持3d坐标
  • mediapipe安装和使用更简单
  • (貌似)mediapipe性能更好

Kalman Filter

filterpy 有 卡尔曼滤波的支持,因此不用自己实现。

或者kits的kalman里有师兄实现的kalman filter。

@ operator

PEP 465 - A dedicated infix operator for matrix multiplication

可以理解为矩阵乘法操作符。

部署

实现了基于flask的和更底层的socket两种方案的c/s。flask的可以实现跨平台,通过浏览器访问。

TODO

  • threads seperate(client & server), 将server部署到学校的服务器。
  • 根据注视比等参数进行分心识别
  • fix & debug

Helpful Command

# rm images or containers
docker rmi `docker images | grep "<none>" | awk '{print $3}'`
docker rm $(docker ps -a -q)
# export

# run
python -m  gaze_guy.display.main --video path/a.mp4 --output-dir ~/Downloads --ext mp4

https://python.plainenglish.io/real-time-image-processing-using-websockets-and-flask-in-python-and-javascript-97fb4a0a764f

graduate_design's People

Contributors

a-fly-fly-bird avatar

Watchers

 avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.