Comments (4)
Hi @Ruthvik9,
Thank you for your interest in our work. Regarding your questions:
-
Per-frame labels may indicate that the pedestrian started to cross, i.e., stepped onto the road. But the crossing label for the entire track is set to 1 only if the pedestrian actually crossed the road in front of the vehicle (traversed its width or crossed in its path if the vehicle is turning). In other words, per-track labels for crossing reflect the final outcome of the pedestrian's actions relative to the ego-vehicle. Even if the pedestrian eventually crossed after the ego-vehicle went past them, we assign the "non-crossing" label to the track because they did not cross in front of the ego-vehicle.
-
Yes, we used the per-track labels as the ground truth for the benchmark and all samples were collected before crossing. Otherwise, if a person is mid-crossing, it is more of a detection rather than prediction problem. In that paper, we did not analyze the post-crossing activity.
from pie.
Thank you so much for the prompt response!
After going through your "Benchmark for evaluating Pedestrian Action Prediction" work, I had another doubt regarding these annotations.
In that paper, you mention the following -
i.e., "The objective is to predict whether the pedestrian will start crossing the street at some time t given the observation
of length m. We deο¬ne the event at the time the pedestrian starts to cross or the last frame the pedestrian is observable in case no crossing takes place."
i) Is it "whether the pedestrian will start crossing the street" as present in the paper or something like "whether the pedestrian will cross the street in front of the ego-vehicle, predicted t frames before the event"(with the event being defined as the time the pedestrian
starts to cross, not necessarily in front of the ego-vehicle)? Because as per your response, I believe it should be the latter.
ii) In case no crossing takes place, is it the last observable frame that's defined as the event or the last observed frame - 3 as you've defined in this work?
Many thanks!
from pie.
Yes, when predicting the crossing action, we care whether the pedestrian will eventually end up crossing in front of the car. When the pedestrian is not crossing, we consider the event as the last observed frame - 3 (in the last few frames of the track, only a tiny portion of the pedestrian may still be visible, e.g. a foot).
from pie.
Got it, thank you very much!!
from pie.
Related Issues (20)
- annotation HOT 1
- Calibration not working? HOT 5
- Mean and standard deviation of images in the dataset
- Mean and standard deviation of images in dataset HOT 2
- About Attributes : intention_prob
- Is there a detailed explanation of the vehicle annotations? HOT 2
- Some images are missing cannot run the model HOT 1
- Pie Dataset website not accessible HOT 2
- How to use the dataset to train a YOLO object detector? HOT 5
- What does the bounding box coordinates mean? HOT 5
- The Annotations cannot match images HOT 3
- Annotation 'designated' HOT 2
- Annotation 'signalized' HOT 2
- about video to images HOT 2
- Speed Annotation unit HOT 2
- There may be an error in the pedestrian boundingbox annotation of set03video0001 HOT 2
- The label does not correspond to the video picture HOT 2
- Road Boundaries HOT 2
- what does '1_1_1' represent in annotation? HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
π Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. πππ
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google β€οΈ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from pie.