Comments (16)
Does anyone know whats the problem with this??
torchrun --nproc_per_node 1 example.py --ckpt_dir ./weights/7B --tokenizer_path ./weights/tokenizer.model
I got this error only with no details: failed to create process.
from llama.
OK, i also cannot get it to run with "torchrun", i get "failed to create process".
Edit:
It does work with Linux. The workaround for Windows with python 3.9.x is to run
python -m torch.distributed.run
instead of torchrun
.
from llama.
I found the error to fix it you have to point the model and the tokenizer e.g
torchrun --nproc_per_node 1 example.py --ckpt_dir ./model/7B --tokenizer_path ./model/tokenizer.model
from llama.
I got same error here. Loading checkpoint for MP=0 but world size is 1.
checkpoints variable is also blank when I checked. Like []
Dunno what's happening. By the way, is MP the number of GPU's in a single node?
from llama.
Is there a file named tokenizer.model? I just got a params.json
from llama.
In the folder where you downloaded the model you have the model e.g 7B and also tokenizer.model
from llama.
Well... this is odd. I got checklist.chk, consolidate.pth and params.json there nos tokenizer.model ;/
from llama.
Found it! but yet the problem persist.
from llama.
Ok, problem solved! It was a path problem lol
from llama.
Here is how I got things working,
As per (#41 (comment)), edit download.sh
run ./download.sh
Once you have checkpoints for any model, eg:7B, run
torchrun --nproc_per_node 1 example.py --ckpt_dir ./model/7B --tokenizer_path ./model/tokenizer.model
from llama.
Ok, problem solved! It was a path problem lol
@felipehime what was the path issue? I'm getting the same error even pointing the command explicitly to the directories.
from llama.
i download the model without 7B file,why?
from llama.
Ok, problem solved! It was a path problem lol
@felipehime what was the path issue? I'm getting the same error even pointing the command explicitly to the directories.
specifically the path of tokenizer.model
from llama.
Does anyone know whats the problem with this?? torchrun --nproc_per_node 1 example.py --ckpt_dir ./weights/7B --tokenizer_path ./weights/tokenizer.model I got this error only with no details: failed to create process.
i also have the same problem, any solutions? Thank you!
from llama.
Closing as original author solved the issue. Feel free to open new issues with specific details on what you are facing for additional guidance. For future reference, check both llama and llama-recipes repos for getting started guides.
from llama.
Does anyone know whats the problem with this?? torchrun --nproc_per_node 1 example.py --ckpt_dir ./weights/7B --tokenizer_path ./weights/tokenizer.model I got this error only with no details: failed to create process.
i also have the same problem, any solutions? Thank you!
do you got any solution yet ?
from llama.
Related Issues (20)
- "Link unavailable" in Meta AI response for asking Meta Website HOT 6
- Your request to access this repo has been rejected by the repo's authors.
- Research dedicated license? HOT 2
- Bug HOT 1
- "$CPU_ARCH" not found HOT 2
- Unable to download LLAMA models from https://llama.meta.com/llama-downloads HOT 1
- Download.sh does nothing HOT 2
- No special tokens added in tokenizer
- Downlaod.sh is throwing 403 Foribdeen error, when using a freshly generated URL/token HOT 2
- Getting 400 error on https://llama3-1.llamameta.net/Meta-Llama-3.1-405B-MP8/consolidated.00.pth HOT 1
- How to to run Meta-Llama-3.1-70B-Instruct on the MATH TEST HOT 1
- AnT1nG-Meta-llana
- Llama
- A problem with tokenizer.model from HuggingFace HOT 2
- LLaMA 3.1 Model with Image Input is Faster than Text-only Input
- Llama 3.1: The output text is truncated HOT 2
- Access to checkpoints
- Do you open source of your internal evaluations library ?
- Meta AI issue to append duplicated messages after the answer when questions have context
- Meta-Llama-3.1-70B-Instruct does not appear to have a file named config.json HOT 2
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from llama.