How to check if block offsets have been calculated? about indexed_bzip2 HOT 3 CLOSED

Thanks. Incidentally, your code has sped up my workflow so that running my script (to parse Wikidata/Wikipedia files for https://www.onezoom.org) now takes under an hour with 64 processes, whereas it used to take 2 days. That's a huge difference, and makes my life so much easier. So I'm very grateful!

from indexed_bzip2.

I added a block_offsets_completed function and even a available_block_offsets method, which only returns those already calculated up to this point.

from indexed_bzip2.

:) I'm glad someone uses it and cares enough to give feedback. Initially, this project only started to keep the required C++ bz2 code base for ratarmount separate from the python-only tar mount script. That's why the indexed_bzip2 interface is still fairly limited.

I see no harm in adding such a method. Will do.

from indexed_bzip2.