alexanderrichard / neuralnetwork-viterbi Goto Github PK
View Code? Open in Web Editor NEWLicense: MIT License
License: MIT License
Hi everyone,
I'm trying to use this decoder over MPII Cooking Dataset
This dataset is a lot way bigger than Breakfast dataset:
In order to make training work i modified the parameters in this way:
After 2 Days and 4 hours still, waiting for the training to happen.
So i've decide to abort.
Now i'm planning to:
I was wondering also if this type of Dataset fits the purpose of this Decoder, or since the action are too long, i should find another way... any ideas, suggestion or critic is really appreciated!
Hello Alex,
I have trained using the 50 salads split 1 for 3K iterations and the test accuracy is 0.386362. Does that look reasonable to you? Or do I have to optimize the parameters (assuming repo parameters are for breakfast data)? Please suggest. Thanks.
Hi
Hi,
Do you guys have a script that I can use to convert my own action dataset into the fisher vectors format to train with the nn_viterbi?
Evaluate 252 video files...
frame accuracy: 0.375708
Hello, I downloaded the dataset you provided and ran your code, but only get 0.375708 on Breakfast dataset. By the way, is it segmentation acc or alignment acc?
The link https://uni-bonn.sciebo.de/s/wOxTiWe5kfeY4Vd has been outdated. I am wondering if there're any other alternative link to download the dataset?
Hi Alex,
I have another two issues regarding the Viterbi decoding.
utils/viterbi.py
score = hyp.score + self.frame_score(frame_scores, t, label)
(2) when the frame t goes to the next label, you multiply the function with the frame score of the new label, the length model score (Poisson probability of the last segment which just ends) and also the grammar score (just to check whether the new label is a valid successor), as in line 98
score = hyp.score + self.frame_score(frame_scores, t, label) + self.length_model.score(length, label) + self.grammar.score(context, new_label)
Therefore, here the frame score should be self.frame_score(frame_scores, t, new_label)
instead of self.frame_score(frame_scores, t, label)
, right? Please forgive me if I have misunderstood the auxiiiary function.
segments[0].length += n_frames - len(labels) # append length of missing frames
labels += [hyp.traceback.label] * (n_frames - len(labels)) # append labels for missing frames
However, you add the number of missing frames to the length of the first segment and then the labels of missing frames to end of labels
. In this case, the returned labels
and segments
do not correspond to each other in the first and last segment. (This has actually no big effect as segment
was never used during the training.)
Regards
Hello,
Can you also provide the extracted features for the Hollywood Extended dataset as you did for the other two datasets?
Thank you.
Hi,
in utils/network.py
line 108, shouldn't it be output, dummy = self.gru(x)
instead of dummy, output = self.gru(x)
as the first output is output from GRU and the second output is the hidden state (doc https://pytorch.org/docs/0.4.1/nn.html#torch.nn.GRU).
Regards
thx~
A declarative, efficient, and flexible JavaScript library for building user interfaces.
๐ Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. ๐๐๐
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google โค๏ธ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.