Allow a third variable to be specified to trigger flush about transfer HOT 6 CLOSED

Hey @Tang8330 I literally fixed this a couple of days ago, still verifying if it works smoothly!
In our case we don't have a large number of rows, but rather large JSON fields in some tables, so even though the row counting was my first idea as well, I decided to check the potential query length and do the limitation that way:

sitestream@1129c62

I'm not sure if this is the nicest solution, just wanted to make a quick proof of concept, but so far it seems to be working!

from transfer.

Is it 1 MB? https://docs.snowflake.com/en/user-guide/query-size-limits

Confirm.

from transfer.

cc: @TamasNo1 - Have you run into this issue before?

Thinking about picking this up within the next few days.

from transfer.

Ah good to know!

from transfer.

I'll tag you on the PR once I get this improvement pushed up!

from transfer.

Done with PR #89

from transfer.