[Feature Request] A Method to Modify ReplayBuffer In Place about rl HOT 4 CLOSED

@albertbou92, oh I got you wrong. I mean it's clean to use rb[:], I agree. But I don't think it's a way that anyone will naturally figure out(and it should be called with buffer._replay_lock). Also, TensorStorage.set() seems like a usable method, but it doesn't actually act as expected, which may confuse others who use it.

from rl.

It does not solve much but rb._storage._storage is the same as rb[:].
Is a bit more intuitive and clean (maybe you could call update() on rb[:][info["index"]])

from rl.

@albertbou92 yes, I use rb._storage._storage['key'][index_list] in practice.

from rl.

right, makes sense!

from rl.