Unable to reproduce the results of HER-TD3 about rlkit HOT 6 CLOSED

Split by exp_name or unique_id.

from rlkit.

Thanks for catching the bug. The example script is now fixed (see 9803d09) so that it runs.

I'll test it a bit more on my end and see if I get similar results. I also emailed the HER authors to see if they have suggestions, and will update accordingly.

from rlkit.

In my experience the reacher will usually end up working with the default settings in that script, but it may take many more epochs than the screenshot in the HER Readme. However, the other tasks I have not gotten to work

from rlkit.

I just ran 5 seeds of the example script and got the following results:

So while the variance across seeds might be high (one seed fails completely, the others 4 succeed), I'm going to close this issue since it seems to be working.

from rlkit.

@vitchyr Hey vitchyr how do you get the plots to separate as individual lines per seed versus accumulating as variance shading over one line?

from rlkit.

The comments at the top of the HER scripts are confusing ("This should results in an average return of ~3000 by the end of training."). I think they aren't meant for the environments in the script?

from rlkit.