Adapted form ChunkLlama's needle in haystack evals @ https://github.com/HKUNLP/ChunkLlama/tree/main/needle_in_a_haystack to use vLLM.
sangjunni / needle-haystack Goto Github PK
View Code? Open in Web Editor NEWThis project forked from winglian/needle-haystack