Using etils's `epath` with AWS S3 links about etils HOT 4 CLOSED

Could you try using TF directly to see if the issue is coming from TF or epath ?

import tensorflow as tf

tf.io.gfile.listdir('s3://...')

from etils.

I assume epath, because the tracebacks are same

Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
  File "/home/awesome/.local/lib/python3.7/site-packages/tensorflow/python/lib/io/file_io.py", line 769, in list_directory_v2
    message="Could not find directory {}".format(path))
tensorflow.python.framework.errors_impl.NotFoundError: Could not find directory s3://...

from etils.

If you also get the same error using only tf.io.gfile (without epath), it means the error is coming from TensorFlow, not epath, right ? Or I have misunderstood something ?

If so, you should open a bug in TF with the TF example (without epath) which reproduce the issue.

from etils.

Fair enough; I'd opened an issue with TF but they weren't helpful; ultimately resolved with downgrading.
I'm trying to use with TFDS but have been facing a barrage of errors with S3 😞 absolutely plagued by No response body, Trying for days to resolve this; kinda regretting using TF over PyTorch.

Thanks for your help though.

from etils.