Comments (4)
I hope I can defer to our ONNX specialist @xenova ๐
from transformers.
Hi @pengpengtao ๐ Which model are you trying to run? In general, yes, you can infer the model separately through encoder.onnx and decoder.onnx, with outputs from the encoder being used as inputs to the decoder (usually).
from transformers.
Hi @pengpengtao ๐ Which model are you trying to run? In general, yes, you can infer the model separately through encoder.onnx and decoder.onnx, with outputs from the encoder being used as inputs to the decoder (usually).
hello๏ผThe model's address is https://huggingface.co/Xenova/nllb-200-distilled-600M/tree/main/onnxใI don't know how to load encode.onnx and decoder.onnx, and successfully translate a sentence into another language. Can you help me write an inference code to achieve the translation effect through the encoder and decoder? thank you
from transformers.
@xenova ,hello,Can you help me? The model's address is [https://huggingface.co/Xenova/nllb-200-distilled-600M/tree/main/onnx]ใI don't know how to load encode.onnx and decoder.onnx, and successfully translate a sentence into another language. Can you help me write an inference code to achieve the translation effect through the encoder and decoder? thank you
from transformers.
Related Issues (20)
- Custom pipeline in remote repo cannot load custom model from remote repo. HOT 5
- Qwen2-VL from_config broken? HOT 2
- TypeError: MistralForSequenceClassification.forward() got an unexpected keyword argument 'token_type_ids'
- transformers 4.44.2 doesn't work with torch.compile and torch.export on T5 generate() HOT 3
- 'DepthEstimationPipeline' object has no attribute 'image_size' when num_workers > 0 HOT 1
- Qwen2-VL Doesn't Execute on TPUs
- oom when using adafactor optimizer in deepspeed HOT 1
- Is it possible to make wasm support all models in huggingface?
- "Qwen2-VL FP16 inference results in errors or gibberish output." HOT 3
- Mask2FormerImageProcessor - fails to process multichannel image HOT 1
- Decoder and cross-attention shape is different when obtained by model.generate() and model() HOT 2
- Out-of-Index Error when training by `Qwen2VLFlashAttention2` HOT 1
- tokenizer `save_pretrained` can not handle non-string value in dtype HOT 1
- [Help] Correct Way to do Simple Model Constraints HOT 4
- I am sure I've made a mistake, but confused about the behavior of ``attention_mask'' of the roformer. HOT 2
- can't resume lora training due to wandb logging num params
- Phi-3's tokenizer `.convert_ids_to_tokens` returns bytes instead of a string HOT 1
- The forced adoption of low_cpu_mem_usage behavior ruins models that require absolute position embedding. HOT 2
- Phi-3 maximum recursion depth exceeded when execute AutoModelForCausalLM.from_pretrained HOT 2
- for LlaVA output of image_hidden_states not possible? HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
๐ Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. ๐๐๐
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google โค๏ธ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from transformers.