ValueError: Unpack failed: incomplete input about min-dalle HOT 9 CLOSED

same, macos 12.2, python 3.8

from min-dalle.

+1

from min-dalle.

I think this is a duplicate of #1

from min-dalle.

@kuprel Not the same file. This one is for dalle_bart_mini and being downloaded with wandb.

from min-dalle.

does the suggestion in #31 work?

from min-dalle.

There are 2 problems causing undetected bad downloads:

1. wandb artifact get fails silently. I did the wandb artifact get download for mini twice, each time obtaining 0 exit code (indicating success) but got different sizes for flax_model.msgpack. Probably network errors were being silently ignored.
2. The lack of set -e in setup.sh. This was added in 63a6537 but later removed, perhaps accidentally. This means if a big download fails resulting in partially-downloaded files, set -e helps failure detection if the downloading program fails as it should (not wandb in this case).

The problem went away after I manually downloaded flax_model.msgpack with a web browser.

I suspect a lot of people getting msgpack deserializing errors are getting them from silently-failed downloads caused by the above problems, so fixing the silent failure would prevent further similar issues from being reported and wasting time. I'm not familiar with wandb artifact get but this kind of silent failure is surprising.

from min-dalle.

I just added back set -e

from min-dalle.

I suppose the main issue now is the silent failure in wandb artifact get. I wonder if others can repro.

from min-dalle.

Closing this since the flax model was moved

from min-dalle.