Compare bundle with latest commit to reduce backup time about soba HOT 8 CLOSED

I've just pushed a new release that's got a hidden feature (whilst testing). It works exactly as I put in the opening comment, and speeds things up a lot. If you get a chance to try it, simply add an environment variable: SOBA_DEV=true and let me know how you get on.
I'd love to get a GIT expert to call out any downsides to the approach, so will do some research and maybe put a post out on stackoverflow.
Btw, I've already noticed some spurious, but harmless, output that needs fixing.

from soba.

So far, it looks like a positive move: https://stackoverflow.com/questions/74281792/git-comparing-local-bundle-with-remote-repository-using-refs-only.
I've got some tidying up to do, and some tests to write, but will try and get a new beta out this week.

from soba.

Thanks for moving this to a separate topic - yes, this is precisely what I was referring to!

I imagine some users would still feel 'safer' with the current way of operation, so this comparison mechanic could probably be toggled with an env var?

from soba.

Seems to be working really well and yes, it has greatly sped things up (the complete run came down to 8 minutes) - also, as far as I can tell it didn't falsely skip any modified repos.

from soba.

Thanks for the feedback! I'll do some more of my own testing to check it works as hoped, and put the question out to the experts on any potential gotchas.

from soba.

Just a heads-up.
I've pushed a new beta that replaces the SOBA_DEV trigger with:

• GITHUB_COMPARE
• GITLAB_COMPARE
• BITBUCKET_COMPARE

each supporting a value of either 'refs' or 'clone' where 'clone' is the default if not specified.
refs = check latest bundle refs (if existing bundle exists) against remote refs, without cloning
clone = clone the remote, bundle it, and compare latest bundle size and checksum with local (if existing bundle exists)

The reason for defaulting to clone is that someone's pointed out that using refs alone doesn't consider the remote could be shallow (older commits removed). I doubt it's a common situation, but don't want to make any assumptions when it comes to backups.

I'm leaving my own setup running for a few days to see if there are any real world issues I've not considered. Hope to get the final release out this week.

from soba.

Awesome, looking forward to it! :)

from soba.

Now released. Thanks.

from soba.