Installation with CPU with errors about vllm HOT 2 CLOSED

Just revisited the page, I saw:

Instruction set architecture (ISA) requirement: AVX512 is required.

Does it mean that I have to build with the AVX512 supported CPU and run vLLM with the AVX512 supported CPU?

Thanks.

from vllm.

Yeah exactly - that's also what cmake tells you:

[...]
CMake Error at cmake/cpu_extension.cmake:57 (message):

  vLLM CPU backend requires AVX512 ISA support.
[...]

On Linux you can check e.g. using:

lscpu | grep -i avx512 if that requirement is fulfilled

from vllm.