Does it support llama3? about lmflow HOT 5 OPEN

Thanks for your interest in LMFlow! We currently support single-gpu training of LLaMA-3-7b with LISA. We are working on the multi-gpu model-parallelism version, hopefully in 1-2 weeks, please stay tuned. Thanks for your understanding 😄

from lmflow.

LLaMA-3-7b

Do you support llama 2-7b? Or llama 3-8B? llama3-7b does not exist.

from lmflow.

Yes we support both models as long as the access is granted from huggingface repo for your huggingface account.

• https://huggingface.co/meta-llama/Llama-2-7b
• https://huggingface.co/meta-llama/Meta-Llama-3-8B

from lmflow.

Yes we support both models as long as the access is granted from huggingface repo for your huggingface account.

• https://huggingface.co/meta-llama/Llama-2-7b
• https://huggingface.co/meta-llama/Meta-Llama-3-8B

Which parameter is used to configure authorized account related information?

from lmflow.

Yes we support both models as long as the access is granted from huggingface repo for your huggingface account.

• huggingface.co/meta-llama/Llama-2-7b
• huggingface.co/meta-llama/Meta-Llama-3-8B

Which parameter is used to configure authorized account related information?

You may first switch to lmflow conda env using

conda activate YOUR_ENV_NAME

then use

huggingface-cli login

and follow the instructions.

from lmflow.