[BUG] [VSCode Extension] Open LLM Tool fails calling list_endpoint_names about promptflow HOT 3 OPEN

Hi @cedricvidal, both endpoint_name and deployment_name support manual input, so you can fill yourself and then can run. Here is my try:

The error you're seeing is just auto listing failure, this is because the tool 'Open Model LLM' depends tightly on azure resources, which means you need to deploy the endpoint/deployments in azure portal in advance. To use them in local, you may need to configure azure config first to enable call azure api to get back the endpoints list. Here are detailed steps:

1.Complete the prerequisites mentioned in the tool doc and make sure you deployed the model.
2.Install azure dependencies.
pip install azure-ai-ml
3.Login to azure and set ws triple as default

az login
az account set --subscription <subscription_id>
az configure --defaults group=<resource_group_name> workspace=<workspace_name>

After above setting, you may see the error disappear. For more details about how to connect azure from local, you could see the doc .

Involved the tool contributor @prakharg-msft @dans-msft, could you please add specific instructions of "how to use this tool in local" to 'Open Model LLM' tool doc?

from promptflow.

Thank you @chjinche for the clarification. Indeed, I had run the first two commands but I wasn't aware about the 3rd. Running the following as suggested solved the problem.

az configure --defaults group=<resource_group_name> workspace=<workspace_name>

In addition to adding to the doc, you might want to make it clearer in the Visual editor what the problem is and how to solve it. Or to automatically ask the user to select a default group and workspace if those are not already selected. It would make for an easier experience.

from promptflow.