Comments (3)
jiangliqin
commented on May 20, 2024
我也遇到了，参考这个bitsandbytes的issuehttps://github.com/TimDettmers/bitsandbytes/issues/156还没解决
from chatglm-tuning.
Starrylun
commented on May 20, 2024
我也遇到了这个问题，在官方文档上发现 ：The bitsandbytes library is currently only supported on Linux distributions. Windows is not supported at the moment. 因此 bitsandbytes 的优化方式无法在win系统上使用，至今没有解决。换成 linux 系统后应该就可以了。如果有在 win 系统上处理过的大佬，麻烦解答一下。
from chatglm-tuning.
SmileSmith
commented on May 20, 2024
我是windows11，cuda降级到11.6，参考这个issue解决了（我不会c++，只好用别人编译好的116版本dll）
TimDettmers/bitsandbytes#30 (comment)
from chatglm-tuning.
Related Issues (20)
- 训练数据一点也没拟合，预测结果跟chatglm基础模型一模一样 HOT 1
- 启用fp16, load_in_8bit设置为False, 报错： RuntimeError: Expected all tensors to be on the same device, but found at least two devices, cuda:0 and cpu! HOT 1
- model.is_parallelizable = True，model.model_parallel = True，这两句的意思是 就可以多卡load吗？ HOT 1
- 训练结果改变不大，用infer代码能知道是加载了正确答案。但是永远不是正确答案。怎么就能让他回答正确答案呢。 HOT 1
- 有没有用macos来finetune的啊
- error:raise DatasetGenerationError("An error occured while generating the dataset) HOT 1
- 请问大佬什么时候能更新支持chatglm2呢？ HOT 13
- Lora微调chatglm-6b后chekpoint里面缺乏adapter_config.json文件 HOT 1
- 怎么做evaluate，计算bleu 和rougue值之类的
- 请问大佬是否有计划可以支持下qlora？ HOT 1
- 修改max_seq_length好像并没有生效？ HOT 1
- 如何支持多卡跑
- 请教一个问题，data_collator中不需要实现attention mask么？ HOT 2
- ChatGLM LoRA微调之后，量化quantize=8显存、推理耗时都反向增加 HOT 1
- finetune数据使用data_collator时报错 KeyError：seq_len HOT 2
- 微调语料格式转换出现乱码 HOT 1
- 请问如何读取checkpoint继续训练？ HOT 1
- AttributeError: 'ChatGLMModel' object has no attribute 'lm_head' HOT 3
- 请问下如果想让模型学到某个领域的数据集，大概需要多大的数据量呢？
- 这个项目停更了吗
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from chatglm-tuning.