Any document on controlling how many CPU threads MUSE spawns? about muse HOT 4 CLOSED

Hey,

Can you try something like:
OMP_NUM_THREADS=8 MKL_NUM_THREADS=8 python ...

For 8 CPU, for instance?

from muse.

Thanks, this work.

@glample I tried using faiss.omp_set_num_threads(8), but it doesn't have the same effect (the cores are being used, but the problem is as slow as before. But It works much faster if I set those two variables

from muse.

That's probably because your FAISS was installed with MKL. This is faster than OMP, and by default FAISS should be using it whenever it's available. faiss.omp_set_num_threads(8) will be equivalent to set OMP_NUM_THREADS=8 and won't have any effect if MKL is used. In your case, MKL_NUM_THREADS=8 python ... alone should be enough (even though it never hurts to set both!).

from muse.

That makes sense, thanks a lot !

Still a bit strange that htop showed 8 cores being used at ~100% while FAISS search, when I used faiss.omp_set_num_threads(8), but anyway that's not really an issue.

from muse.