Can't access other models in docker image about easynmt HOT 5 CLOSED

When you start the docker, you must set the env. variable EASYNMT_MODEL to control which model to load:
https://github.com/UKPLab/EasyNMT/tree/main/docker#environment-variables

So pass to docker that the env. variable EASYNMT_MODEL should be e.g. the M2M model and then the docker will load this specific model

from easynmt.

Hi,

ok, so it's not possible to load multiple models in the same container, right?

Best regards,
André

from easynmt.

No, that is not possible.

You can start multiple docker containers. The overhead is quite small compared to the model size.

from easynmt.

Hi, ok thanks for the quick help and response!

from easynmt.

@4quen I ran into the same issue. Instead of docker I went straight to Python and servered it all with fastapi, uvicorn and Nginx reverse proxy. I load the models in a list on startup then select the model I need depending on language pair:

all_models = [
  Model(source_lang="en", target_lang="de", model=EasyNMT(translator=models.AutoModel('Helsinki-NLP/opus-mt-en-de'),device="cpu")),
  Model(source_lang="de", target_lang="en", model=EasyNMT(translator=models.AutoModel('Helsinki-NLP/opus-mt-de-en'),device="cpu"))
]

You need enough GPU/RAM to do this but also has the bonus of giving you control over the language codes and over the Huggingface model names. For example the Portuguese opus-mt model has "tc-big" inserted in the name, or Japanese is not "jp" but "jap". Those can cause the autoloader to fail miserably!

from easynmt.