something about precision-recall curve and loss about detection-2016-nipsws HOT 6 CLOSED

Hi!!

The model is just trained for planes, as the one for the paper, but this model is trained to search for more than one plane, so that when there is a trigger action, it covers the detected object and searches again for planes. The results may not be equal but there is no reason for them to be bad. For simulating the paper, the most similar approach would be to indicate that you only want to look for one object with the flag of only_first_object set to 1.

Miriam

from detection-2016-nipsws.

Hi!

For the precision recall curves I needed detections depending on some threshold, so I used the q-value of the trigger as the confidence of each detection. Once I had different detections for different thresholds, I simply calculated the precision recall (precision = tp/(tp+fp), recall = tp(tp+fn)). A detection is considered correct if the intersection over union with the ground truth is superior to 0.5. For the losses, in my experience in RL, it is better observing directly the reward at each step than the losses.

Best!
Miriam

from detection-2016-nipsws.

Hi !
Thanks for your reply. It really helps a lot.
You readme.txt says that his model is not the one in your paper. The origin model trained only for one plane detection, right? I run the image_zoom_model_testing for test multistep of finding a plane, but it shows a bad result. I want to know if i should change some codes to get a good result as your paper showed. I think maybe i did something wrong, but i didn't change your codes. That confuses me a lot.

Thanks a lot

from detection-2016-nipsws.

Hi
Thanks a lot.
I tried only_first_object before. But still don't ideal. I have already sent you my pic results for the model by email. I don't know if these results the right results since your paper said this method will miss some planes. Maybe I'm misunderstanding. Do you mind send me your test results for this model on muliti step searching or give some comments on the results i sent ? It will be a great help for me.
Thanks again for your patient.

Anida

from detection-2016-nipsws.

@miriambellver ,hi!

I'm also puzzled about the precision-recall curve. Did you use the q-value of the trigger in all the steps( even when the current actions were not trigger),or just use the ones in the steps when it triggered?

thanks!

from detection-2016-nipsws.

Hi! Even when the action was not triggered.

Regards,
Miriam

from detection-2016-nipsws.