[REQUEST] Benchmarking Prior Methods and Different Task Domains for Offline RL about d3rlpy HOT 2 OPEN

@Shentao-YANG Thanks for making this issue! Assuming that you're mentioning d4rl-pybullet, for the first question, d3rlpy currently does not have benchmark results. But, I believe we should have it since we can produce it easily. For the second, technically it's possible to create navigation tasks with PyBullet. If there is an existing PyBullet env, we can make a new dataset for it.

from d3rlpy.

@takuseno Thanks for your timely reply!

For the navigation tasks, I think the D4RL package defines the environments themselves, where the physical engine therein comes from the MuJoCo engine. Theoretically, I think it is possible to make a PyBullet version of it by substituting the MuJoCo part within the code with the PyBullet counterparts.

For your reference, here is the source code for creating the AntMaze task domain in the D4RL package, and the locomotion environment they defined. The latter uses MuJoCo engine, which may be changed to the PyBullet engine.

I have very little successful experience in substituting the MuJoCo engine with PyBullet. Therefore, all I said above is at you full discretion.

from d3rlpy.