In DDP, pretrained model won't be loaded. about ultralytics HOT 3 CLOSED

@comlhj1114 hello! Thanks for reporting this issue with loading pretrained models in DDP mode. It looks like you're correct about the behavior you've observed.

For your Case 1 and Case 2 where the model isn't loading properly, it seems there might be a need for additional handling in our DDP setup to enable loading pretrained weights directly when initializing a model from a YAML file.

The common workaround for now, as you've found, is to load the model directly from the pretrained .pt file before calling .train(), as shown in your Case 3. That's a valid approach when deploying to a multi-GPU setting.

Meanwhile, I'll forward this issue to our development team to consider improving the handling of pretrained models in DDP configurations. If you have further insights or would like to contribute to a solution, we encourage you to follow and possibly contribute to this discussion on GitHub. Your feedback is invaluable! 😊

from ultralytics.

@comlhj1114 thanks for the PR, we have a review by @Laughing-q pending on it, and if everything looks good we should have it merged this week :)

from ultralytics.

@glenn-jocher Thank you for your rapid and valuable feedback. I will try to contribute!

from ultralytics.