Comments (3)
Hi, this is because you CUDA extension is not built. Can you make sure your PyTorch uses the same cuda version as your cuda runtime. One way is to add the -v
flag to your pip install
command. If cuda extension is not built, the log will tell you the info about the version mismatch.
from colossalai-examples.
Hi, this is because you CUDA extension is not built. Can you make sure your PyTorch uses the same cuda version as your cuda runtime. One way is to add the
-v
flag to yourpip install
command. If cuda extension is not built, the log will tell you the info about the version mismatch.
Hi, could you be more specific? I tried few times reinstalling all the stuff, but I failed every time. The pip -v install shown everything was fine.
Thanks
from colossalai-examples.
Hi @200987299 We have updated and simplified the installation process, and the example code has been updated. You can try to reinstall, thanks.
from colossalai-examples.
Related Issues (20)
- Problem with saving model state dict HOT 2
- BERT示例运行错误,ColossalAI-Examples/language/bert/sequene_parallel/ HOT 2
- 运行GPT2案例出现RuntimeError: Could not find 'SLURM_PROCID'问题,是必须要装SLURM环境? HOT 1
- [Compatibility] Runining OPT using PyTorch 1.12 and Gemini placement_policy = 'cuda' failed HOT 3
- 当模型gradient_checkpointing时运行feature/zero/train_v2.py出错 HOT 5
- Cannot find the gradient handler example HOT 1
- BERT Data Preprocessing HOT 3
- ImportError: cannot import name 'colo_state_dict' from 'colossalai.utils.model.colo_init_context' HOT 1
- RuntimeError: CUDA out of memory with cifar10 in data_parallel example HOT 1
- The error happened when I did multi-node distributed training HOT 1
- ImportError running detr HOT 1
- question about import model_zoo.gpt.gpt as col_gpt HOT 2
- It seems the pipeline parallel document is out of date(https://www.colossalai.org/docs/features/pipeline_parallel) HOT 7
- there maybe some bug about the train_gpt.py(https://github.com/hpcaitech/ColossalAI-Examples/blob/main/language/gpt/train_gpt.py) HOT 5
- detr-debug pipelinable.py HOT 1
- Load ColossalAI GPT model as HuggingFace/Transformers Model HOT 2
- Outdated OPT example
- grad is none when run gpt2 with pipeline parallelism only
- cannot import name 'OPTForCausalLM'
- connection failure HOT 2
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from colossalai-examples.