How to use ObsNormEnv？ about di-engine HOT 2 CLOSED

ObsNormEnv is suitable for normal image state like that in Atari and Procgen env.

For your case, it is important to unify data range for different state vectors, which is better for getting more smooth gradient scale. You have already know the data range, so there are two basic methods you can try:

• max-min method, norm your state into 0-1 range by (x-min)/(max-min)
• discretization method, divide the whole range into several discrete bins (for example, 0-40 can be divided into 8 bins with interval 5), and if a value is located in bins 3 (i.e. 10-15), it should be transformed into a one-hot vector [0,0,1,0,0,0,0,0]. This method is effective when fine-grained state information is not necessary.

from di-engine.

Okay, thank you for your advice.

from di-engine.