AttributeError: 'NoneType' object has no attribute 'fs' at fresh install about aphrodite-engine HOT 8 CLOSED

The GPUs shouldn't be an issue really. I'll try it out on the same hardware and get back to you with results. Can you make a new conda env and try again in the meantime?

I already tried it two times as I was also setting up something else in the background the first time around, but both resulted in the same error.

I just rented 2x 3090s on runpod and received the exact same error (it works on 8x and 4x A40s so multi-GPU isn't an issue). I'll run some more tests to see what's wrong, will keep you updated if I find out what the problem is.

from aphrodite-engine.

Hi. What's your hardware? Also please describe how to reproduce the error, e.g. did you run Aphrodite through a conda env?

from aphrodite-engine.

Yes I run it through conda env, basically just like the installation instructions say.
As soon as I try to start the server, no matter which arguments, it spits out the error.

As for the hardware:
OS: Ubuntu desktop 22.04 lts
CPU: 8700k
32 GB Ram, Samsung SSD
So rather normal so far, but:
2x 3090 as the GPU

I could retry it later with just a single GPU plugged in.

from aphrodite-engine.

Yes I run it through conda env, basically just like the installation instructions say. As soon as I try to start the server, no matter which arguments, it spits out the error.

As for the hardware: OS: Ubuntu desktop 22.04 lts CPU: 8700k 32 GB Ram, Samsung SSD So rather normal so far, but: 2x 3090 as the GPU

I could retry it later with just a single GPU plugged in.

The GPUs shouldn't be an issue really. I'll try it out on the same hardware and get back to you with results. Can you make a new conda env and try again in the meantime?

from aphrodite-engine.

The GPUs shouldn't be an issue really. I'll try it out on the same hardware and get back to you with results. Can you make a new conda env and try again in the meantime?

I already tried it two times as I was also setting up something else in the background the first time around, but both resulted in the same error.

from aphrodite-engine.

Maybe this here helps:
ray-project/ray#25952

As it calls .fs of pyarrow, so maybe install it to double-check?
It might do some fancy import magic which is why it isn't thrown earlier, but I'm only guessing.
Can try it myself later in the day...

Relevant part of the code in ray

from aphrodite-engine.

Maybe this here helps: ray-project/ray#25952

As it calls .fs of pyarrow, so maybe install it to double-check? It might do some fancy import magic which is why it isn't thrown earlier, but I'm only guessing. Can try it myself later in the day...

Relevant part of the code in ray

Can confirm that pip install pyarrow solves this. Thanks for pointing that out!

from aphrodite-engine.

Latest commit 592ee204a658f82f1467d76e25d185054f1e27f0 should solve this. Marking this issue as complete.

from aphrodite-engine.