Giter Club home page Giter Club logo

activity_detection's Introduction

This code is released as part of the Human Activity Detection project at Personal Robotics Lab at Cornell University. 

Currently two codes are available:
- Extracting features from sequence of human activity: 
    Refer to [Sung et al. ICRA 2012] below.
- Visualizing skeleton data for Cornell Activity Dataset 


===== How to run it? =====
1. Download Cornell Activity Dataset from 
        http://pr.cs.cornell.edu/humanactivities/data.php

2. Feature Extraction - Refer to README inside FeatureExtractor


===== Project Website =====

http://pr.cs.cornell.edu/humanactivities/


===== Any Questions about the code or CAD-60 dataset? =====

Contact: Jaeyong Sung - [email protected]


===== More details about this code available at =====

Unstructured Human Activity Detection from RGBD Images, 
Jaeyong Sung, Colin Ponce, Bart Selman, Ashutosh Saxena. 
International Conference on Robotics and Automation (ICRA), 2012.

(bibtex)
@inproceedings{sung_rgbdactivity_2012,
    title={Unstructured Human Activity Detection from RGBD Images},
    author={Jaeyong Sung and Colin Ponce and Bart Selman and Ashutosh Saxena},
    booktitle={International Conference on Robotics and Automation (ICRA)},
    year={2012}
}

activity_detection's People

Contributors

jysung avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar  avatar  avatar  avatar  avatar

activity_detection's Issues

fatal error: cv.h no such file or directory

I in the FeatureExtractor I am not able to pass through make command. I get the following error:

g++ main.cpp HOG.cpp HOGFeaturesOfBlock.cpp -I/usr/include/opencv -lml -lcvaux -lhighgui -lcv -lcxcore -o featureExtractor

main.cpp:1:10: fatal error: cv.h: No such file or directory

 #include **"cv.h"**

          ^~~~~~

compilation terminated.

Makefile:6: recipe for target 'all' failed

make: *** [all] Error 1

Projection formulas are (almost definitely) incorrect

I've been trying to use these projection formulas: https://github.com/jysung100/activity_detection/blob/master/FeatureExtractor/featuresRGBD.cpp#L26

  // Given (x,y,z) coordinates, converts that point into its x pixel number in the 2D image.
  int xPixelFromCoords(double x, double y, double z)
  {
    return (int) (156.8584456124928 + 0.0976862095248 * x - 0.0006444357104 * y + 0.0015715946682 * z);
  }

  // Given (x,y,z) coordinates, converts that point into its y pixel number in the 2D image.
  int yPixelFromCoords(double x, double y, double z)
  {
    return (int) (125.5357201011431 + 0.0002153447766 * x - 0.1184874093530 * y - 0.0022134485957 * z);
  }

These purport to go from the joint's 3d coordinates to 2d coordinates, but they do not seem to work. I visualized the 2d joint locations after this projection, and they are significantly off; furthermore, it seems odd that you could project from 3d to 2d with a linear dot product (since projections should be scaled by z).

The correct formula should be as per OpenNI's formula, which is discussed by a developer here: https://groups.google.com/d/msg/unitykinect/1ZFCHO9PpjA/1KdxUTdq90gJ (Note that there is a minor mistake in the algebra, as I showed here: https://groups.google.com/d/msg/unitykinect/1ZFCHO9PpjA/0B2eHjrywj4J).

I'm however not sure if this function serves a different purpose, so I am not submitting a pull request. Further, this translation from 3d to 2d is not documented in CAD120 anywhere; it would be nice to incorporate the formula from that post into the README for the skeleton format to make 2d visualizations, among other things, easier.

dataset

Can you offer me CAD-120 dataset?Official link is invalid,please leave your google drive when convenient.

visualize skeleton

I have tested the code with CAD-60 , it work but i have a problem: i can visualize only 11 frames and the first frame was visualized is the 48th frame.
(when i change the frameNum with a number from [0..10] 0 .But when i run for example:
"visualizeSkeleton('0512164333.txt','13');
I have this error: "visualizeSkeleton('0512164333.txt','13');
visualize skeleton!!
skeleton data: 0512164333.txt
frame number: 49

frame number: 51

Error using ==
Matrix dimensions must agree.

Error in readSkel (line 9)
if fnum == frameNum,

Error in visualizeSkeleton (line 14)
readSkel(dataFile,frameNum);%, figureTitle);"
Can you help me please!!

the compiling problem

I am compling the program, however, i have got the following errors:could you please fix the problem? many thanks!

                                                               ^

/usr/bin/ld: cannot find -lml
/usr/bin/ld: cannot find -lcvaux
/usr/bin/ld: cannot find -lhighgui
/usr/bin/ld: cannot find -lcv
/usr/bin/ld: cannot find -lcxcore
collect2: error: ld returned 1 exit status
make: *** [all] Error 1

demo

could you release demo of feature extraction?or one of sample your dataset?

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.