Comments (3)
casper-hansen
commented on July 17, 2024
I think this may be an error on the AutoTokenizer class or the repository itself. Not sure if this is easily fixable since the error is on the side of either huggingface or the person who created the repo
Ref: huggingface/transformers#22762
from autoawq.
casper-hansen
commented on July 17, 2024
After looking further into this, it seems this is not something that is fixable since it relates to a broken tokenizer.
from autoawq.
77h2l
commented on July 17, 2024
llama-7b-hf also meets the same error
from autoawq.
Related Issues (20)
- VLM quantization-aware? HOT 1
- using autoawq to quantize gemma-2b-it model and export to llama.cpp got wrong generated token
- Bug - mixtral qlora(after b&b peft train) quantization broadcast problem HOT 3
- [BUG] Load StarCoder2 AWQ using Transformers HOT 1
- Inference Parallelism Issue HOT 1
- quick question around Token indices sequence length is longer than the specified maximum sequence length for this model (77697 > 32768). Running this sequence through the model will result in indexing errors
- Compare the inference speed of quantized model and unquantized model HOT 4
- Mixtral 8x22b instruct AWQ request HOT 9
- Llama-3 support HOT 4
- LLaMA-3 issues when used with vLLM HOT 5
- CommandR、CommandR Plus AWQ request
- Issues with quantizing Cohere model HOT 6
- Support of llava-v1.5 and llava-v1.6 with transformers==4.40.0 HOT 4
- AWQ quantization of gemma results in "RuntimeError: probability tensor contains either `inf`, `nan` or element < 0" HOT 2
- Phi-3 mini support? HOT 5
- Possibly a bug when checking if awq_ext is installed HOT 2
- python 3.12 support HOT 1
- Can I use peft/lora with fuse_layers = True ? HOT 1
- torch 2.3.x support HOT 1
- Need Assistance with “pip install autoawq” Error HOT 3
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from autoawq.