Data interpretation logged by tensorboard_log about agile_flight HOT 8 CLOSED

hi,

1. the training reward is logged in tensorboard. you can to to saved and run

tensorboard --logdir=./

2. the plots in the first row are position [x, y, z] and the plots in the second row are velocity [x, y, z]

3. the plotting is done here

from agile_flight.

1. Which directory should I run this command (tensorboard --logdir=./), or should I run this command b/f I run python3 -m python.run_vision_ppo --render 0 --train 1?

from agile_flight.

I move to a directory of saved/PPO_(num) and I run tensorboard --logdir=./ then I can seer transition of each reward.
Thank you!

from agile_flight.

@yun-long

I have one question about interpretation of TensorBoard.
I can see rewards transition when I learns in the simulation, but I do not know how what does it means.

1. I think the reward is a sum of reward of each episode, Is it correct?
2. Is this rewards a rewards when agent trains? or rewards when agent evaluate?

from agile_flight.

Hi,

the reward you see on Tensorboard is from here.

In summary, contains the sum reward and each individual reward component. The reward is a training reward, not an evaluation reward.

from agile_flight.

@yun-long
Which code writes these rewards to TensorBoard?

from agile_flight.

hi

the code is here

from agile_flight.

Thank you!

from agile_flight.