Adding a distributed script and try to reproduce 86.6 mAP about asl HOT 4 CLOSED

Thanks for your reply and suggestions, that help me a lot. I will do more experiments and try other hyper parameters.

from asl.

This is not the original code (i cannot release it due to commercial reasons), but a reproduction code from the community.
we didn't do any major hyper-parameter optimization for the reproduction code, and you are welcome to contribute. Try playing with the ema decay factor, learning rate schedule pct_start and number of epochs, and i predict you could easily surpass 86.0.

Two differences i am aware in the code level: In the original code we had better augmentations than randAugment and better EMA implementation. there could be other differences.

anyway, 85.5 is not far from the article score. This result is significantly higher than previous SOTA, and achieved with a faster model and significantly less training time.
Try training with ASL and compare to CE, and you will see the advantage of our proposed loss over the commonly used losses in multi-label

from asl.

@SlongLiu
(1)
i updated the hyper-parameters (just lr and epoch adjustments)
now the run fully reproduces article results, 86.52, see attached file log:
ltresnet_86.52.zip

(2) i fixed the paths following the suggestions, although I am not sure that it will work on all machines

from asl.

Thanks very much for your sharing and help!

from asl.