How to choose best checkpoints? about asl HOT 2 CLOSED

I don't think your question relates to ASL.
you can train with ASL without EMA.
on multi-label problems, we found that EMA helps a lot (for any loss function).

so my first recommendation is to try EMA +cross-entropy on your problem, and see if results are less dependent on the selected checkpoints. my strong guess - no.

i think that 'checkpoint averaging'+'no ema' will be somewhat equivalent to EMA. with EMA, i don't think you get a big benefit from 'checkpoint averaging'.

from asl.

Thank you very much!

from asl.