Comments (4)
rosario-purple
commented on May 28, 2024
1
@fxmarty This server has 8xA100 80 GB GPU and 1 TB of main RAM
from optimum.
fxmarty
commented on May 28, 2024
Thank you @rosario-purple, will have a look into it. Maybe could you share the GPU you are using, and how much RAM you have? cc @SunMarc if you have an idea.
from optimum.
SunMarc
commented on May 28, 2024
Hi @rosario-purple , i've opened a PR that should solve this issue. This hard freeze is due to the processing taking too much time (mixtral tokenizer is not fast enough when tokenizing the whole wikitext2 dataset)
from optimum.
rosario-purple
commented on May 28, 2024
@SunMarc Thank you!
from optimum.
Related Issues (20)
- Support bitsandbytes export to ONNX HOT 7
- model.ByteSize() is negative when converting microsoft/phi2 model HOT 3
- Converted LayoutLM ONNX model - Required input `bbox` missing from input feed `['input_ids', 'attention_mask', 'token_type_ids']` HOT 3
- Xenova mbart-large-50-many-to-many-mmt conversion is not translating. HOT 2
- Clarity on the convert.py for a model to ONNX.py.. documentation issue HOT 2
- TextStreamer not supported for ORTCausalLM? HOT 1
- Whisper-v3 ValueError: Transformers now supports natively BetterTransformer optimizations
- Bitsandbytes integration in ORTModelForCausalLM.from_pretrained()
- the onnx in optimum can not accelerate the speed of batch feature extraction. HOT 3
- task text-classification to be supported in the ONNX export for bart HOT 2
- Assistant model in generate method
- GPTQQuantizer hard coded the device to 0 HOT 2
- ONNX support for Mixtral text-classification HOT 3
- export `audio-classification` model based on OpenAI whisper model to other formats HOT 1
- KeyError: 'last_hidden_state' HOT 1
- Non-pinned Transformers Version Incompatability HOT 2
- ORTStableDiffusionXLPipeline sdxl onnx fp16 unet load error
- ORTModelForCausalLM inference fails (after converting transformer to ONNX) HOT 4
- optimum-cli export neuron failed for 'meta-llama/Llama-2-13b-hf' HOT 2
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from optimum.