[Bug]: asyncio.exceptions.CancelledError asyncio.exceptions.TimeoutError about vllm HOT 2 CLOSED

2024-06-21T14:00:57.229006087+08:00 ERROR: Exception in ASGI application
2024-06-21T14:00:57.229015739+08:00 Traceback (most recent call last):
2024-06-21T14:00:57.229022362+08:00 File "/root/anaconda3/envs/vllm/lib/python3.10/site-packages/vllm/engine/async_llm_engine.py", line 506, in engine_step
2024-06-21T14:00:57.229028830+08:00 request_outputs = await self.engine.step_async()
2024-06-21T14:00:57.229035509+08:00 File "/root/anaconda3/envs/vllm/lib/python3.10/site-packages/vllm/engine/async_llm_engine.py", line 235, in step_async
2024-06-21T14:00:57.229041491+08:00 output = await self.model_executor.execute_model_async(
2024-06-21T14:00:57.229047778+08:00 File "/root/anaconda3/envs/vllm/lib/python3.10/site-packages/vllm/executor/distributed_gpu_executor.py", line 166, in execute_model_async
2024-06-21T14:00:57.229053895+08:00 return await self._driver_execute_model_async(execute_model_req)
2024-06-21T14:00:57.229060130+08:00 File "/root/anaconda3/envs/vllm/lib/python3.10/site-packages/vllm/executor/multiproc_gpu_executor.py", line 149, in _driver_execute_model_async
2024-06-21T14:00:57.229066146+08:00 return await self.driver_exec_model(execute_model_req)
2024-06-21T14:00:57.229072047+08:00 asyncio.exceptions.CancelledError
2024-06-21T14:00:57.229077477+08:00
2024-06-21T14:00:57.229084802+08:00 During handling of the above exception, another exception occurred:
2024-06-21T14:00:57.229090528+08:00
2024-06-21T14:00:57.229096490+08:00 Traceback (most recent call last):
2024-06-21T14:00:57.229102644+08:00 File "/root/anaconda3/envs/vllm/li
b/python3.10/asyncio/tasks.py", line 456, in wait_for
2024-06-21T14:00:57.229108631+08:00 return fut.result()
2024-06-21T14:00:57.229114492+08:00 asyncio.exceptions.CancelledError

from vllm.

I meet the same problem, can you share how to fix it

from vllm.