is this already useable as zarr backend? about gcsfs HOT 3 CLOSED

This project is obviously very much alpha - there has not been any one to experiment with it except for myself, and there is no documentation yet except for docstrings.

However, the intent is to have gcsfs become as stable as s3fs and hdfs3, it is only a matter of time.
The GCSMapper class I believe does function as advertised, so zarr should work with it fine. In fact, I have a small side-project to save Xarrays (netCDF-like) into zarrs, and I just tested it by round-tripping real data.

If I can help accelerate your work with zarr and gcsfs, don't hesitate to raise issues as they arise.

from gcsfs.

Note that listing a bucket only promises eventual consistency in GCS, if the bucket is set as multi-region. This is a problem for writing and immediately re-reading from a GCSMapping, so you might want to ensure you are using single-region in this case.

from gcsfs.

Thanks for the info. I'll soon start some experiments, I'll let you know in case of issues. And i'll make sure we work on a single-region bucket, just to be sure. No real need for multi-region anyway in this context.

from gcsfs.