[BUG]Prompt Engineering request from UI to Deployments Server Connection TimeOut about mlflow HOT 5 OPEN

Thanks for reporting this @s-natsubori ! It sounds reasonable to add --timeout args in mlflow server command. We'll discuss internally and get back to you. Would you like to contribute if possible?

from mlflow.

Thanks for check.
I think, it can be solved by set timeout to requests.

 response = requests.request(request_type, f"{target_uri}/{gateway_path}", json=json_data, timeout=REQUEST_TIMEOUT)

from mlflow.

Could you raise a PR to add an environment variable and support passing it here? You already have the context to test it then 😄

from mlflow.

Sorry, I misunderstood.
request module is not the cause of the error.

I tried setting the timeout parameter to request , but the situation did not change at all.
Next, I try to control aiohttp.ClientTimeout but this also has no effect.
（I'm new to aiohttp, so my settings may be wrong.）

From Stack trace, It also appears that the fastAPI process timeout is the cause.
Any Idea?

from mlflow.

@mlflow/mlflow-team Please assign a maintainer and start triaging this issue.

from mlflow.