How do I alter the save-interval when training? about ultralytics HOT 6 CLOSED

Thank you for the help. I appreciate the work you guys are putting into this.

from ultralytics.

@initdebugs hey, right now the local weights best.pt and last.pt are updated after every epoch and artifacts are logged to supported logging platforms only after training finishes and models are stripped. Do you want a similar logging feature to log checkpoints in order to save progress?
We are working on better online logging support through HUB using which you can resume training from anywhere, even a different system. If your use case is different, please let us know so that we can support it better. thanks!

from ultralytics.

Okay that seems odd. For me it saved a best.pt and a last.pt after the first epoch. After that it hasn't updated those files. It's currently at epoch 78 but hasn't saved it.

from ultralytics.

@initdebugs okay that is not expected. It might be a bug. Can you confirm if the ckpt have not been updated by doing this.

import torch

ckpt = torch.load("last.pt")
print(ckpt["epoch"])

Thanks!

from ultralytics.

It shows the correct epoch when doing that. Does that mean that it does save it? The 'last modified' datetime for the file hasn't changed.

from ultralytics.

@initdebugs yeah it shows the epoch it was saved on. Maybe it's something with how OS's file managers check last changed? But it should not be something to worry about

from ultralytics.