[Bug]: Wrong results in LangChain integration about vllm HOT 3 CLOSED

    def process_request(question:str):
        client = OpenAI(
            base_url="http://151.106.13.150:8088/v1",
            api_key="EMPTY",
        )

        completion = client.chat.completions.create(
        model="meta-llama/Meta-Llama-3-8B-Instruct",
        messages=[
            {"role": "user", "content": question}
        ]
        )

        return (completion.choices[0].message.content)

multiple_lines_text_2 = "Hello, world!\nThis is me Mario!\nI am a bot!\nHere's my brother luigi"
print(process_request(multiple_lines_text_2))

Welcome to the world, Mario!

Ah, you're a bot, eh? That's-a cool!

And you've brought your brother Luigi along, too! The dynamic duo of the Mushroom Kingdom!