Initializing pipeline error about llama HOT 16 CLOSED

Does anyone know whats the problem with this??
torchrun --nproc_per_node 1 example.py --ckpt_dir ./weights/7B --tokenizer_path ./weights/tokenizer.model
I got this error only with no details: failed to create process.

from llama.

OK, i also cannot get it to run with "torchrun", i get "failed to create process".

Edit:
It does work with Linux. The workaround for Windows with python 3.9.x is to run

python -m torch.distributed.run instead of torchrun.

from llama.

I found the error to fix it you have to point the model and the tokenizer e.g
torchrun --nproc_per_node 1 example.py --ckpt_dir ./model/7B --tokenizer_path ./model/tokenizer.model

from llama.

I got same error here. Loading checkpoint for MP=0 but world size is 1.

checkpoints variable is also blank when I checked. Like []

Dunno what's happening. By the way, is MP the number of GPU's in a single node?

from llama.

Is there a file named tokenizer.model? I just got a params.json

from llama.

In the folder where you downloaded the model you have the model e.g 7B and also tokenizer.model

from llama.

Well... this is odd. I got checklist.chk, consolidate.pth and params.json there nos tokenizer.model ;/

from llama.

Found it! but yet the problem persist.

from llama.

Ok, problem solved! It was a path problem lol

from llama.

Here is how I got things working,
As per (#41 (comment)), edit download.sh
run ./download.sh
Once you have checkpoints for any model, eg:7B, run

torchrun --nproc_per_node 1 example.py --ckpt_dir ./model/7B --tokenizer_path ./model/tokenizer.model

from llama.

Ok, problem solved! It was a path problem lol

@felipehime what was the path issue? I'm getting the same error even pointing the command explicitly to the directories.

from llama.

i download the model without 7B file,why?

from llama.

Ok, problem solved! It was a path problem lol

@felipehime what was the path issue? I'm getting the same error even pointing the command explicitly to the directories.

specifically the path of tokenizer.model

from llama.

Does anyone know whats the problem with this?? torchrun --nproc_per_node 1 example.py --ckpt_dir ./weights/7B --tokenizer_path ./weights/tokenizer.model I got this error only with no details: failed to create process.

i also have the same problem, any solutions? Thank you!

from llama.

Closing as original author solved the issue. Feel free to open new issues with specific details on what you are facing for additional guidance. For future reference, check both llama and llama-recipes repos for getting started guides.

from llama.

Does anyone know whats the problem with this?? torchrun --nproc_per_node 1 example.py --ckpt_dir ./weights/7B --tokenizer_path ./weights/tokenizer.model I got this error only with no details: failed to create process.

i also have the same problem, any solutions? Thank you!

do you got any solution yet ?

from llama.