Setting batch modulations to zero about functa HOT 3 CLOSED

Yes. Setting this to 0 ensures that the latent modulations that are part of the self._params are initialized to 0 inside the __init__ of experiment_meta_learning.py.
These initial values are fixed throughout the meta-learning training since the _update_func only updates the weights and keeps the modulations fixed (see here).

from functa.

Hi, this is done by setting latent_init_scale=0. in experiment_meta_learning.py. I've just made the change and pushed to the repo, so you should be able to see this change in the file. I hope that helps.

from functa.

Hi thanks so much, does this initialization also guarantee that modulations are zerod after every outer loop training?

from functa.