slack rate limit exceeded (again) about slackdump HOT 8 CLOSED

@shi-bmz the release doesn't have it yet, I wanted to implement #11 and #10 before tagging the next version.

Can you try this build? I built the latest master, that has this fix.

slackdump-linux.zip
slackdump-windows.zip
slackdump-darwin.zip

from slackdump.

@rusq BTW, I tried the new build and it works! Thanks! Minor note - it's significantly slower on the initial fetch to 800 messages. Might be using the wrong tier? I wonder if the original speed would have been fine right up until the 429 retry happens. I think that going at original speed + 1 minute wait every 800 messages would probably be faster.

from slackdump.

I may have overdone it with throttling, I'll see if I can fine tune or ditch it altogether and rely just on slack rate limiting.

from slackdump.

Hey @foucist, I've added a couple of params as described in #17 , here's the build if you want to give it a go.

slackdump-windows.zip
slackdump-linux.zip
slackdump-darwin.zip

from slackdump.

@rusq Nice, it's much faster now. I didn't even notice if the 429 even got triggered so possibly could bump it up with limit-boost if needed, nice to have that option!

Quick question: do you need to cache the whole list of channels when I'm only dumping one specific channel?

It takes about 5 minutes to fetch the users & channels for the slack I'm testing with, I wonder if it would be worth saving a copy locally and assuming it hasn't changed within 2-4 hours? That could save a big chunk of time if the command is run a bunch of times in a short period of time.

from slackdump.

@foucist cool, I agree caching is questionable, I don't even remember what was the reason I did it for TBH, but removing it is on my TODO list. Great to hear that it worked!

from slackdump.

I'll close this one, created #18 to track the cache removal/optimisation

from slackdump.

@foucist thanks a bunch for this! I tried the latest (linux) release that you posted above, and got:
./slackdump: cannot execute binary file: Exec format error
I then tried the (linux) version you posted previously, and it worked nicely -- thanks again!

from slackdump.