Comments (7)
You may need to edit the services.json https://github.com/Helsinki-NLP/Opus-MT/blob/master/services.json as per your models(add more languages or change the entries to point correct files)
from opus-mt.
Yes, but the pre-trained models do not have the bpe files or the decoder.yml file, only .npz file. Can you refer me to some docs which can explain how to use a pre-trained model?
Thanks for the quick response.
from opus-mt.
Please refer the entries in https://github.com/Helsinki-NLP/Opus-MT/blob/master/services.json - it has examples for both bpe and spm.
https://object.pouta.csc.fi/OPUS-MT-models/en-es/opus-2019-12-04.zip has decoder.yaml with contents like:
models:
- opus.bpe32k-bpe32k.enml.transformer.model1.npz.best-perplexity.npz
vocabs:
- opus.bpe32k-bpe32k.enml.vocab.yml
- opus.bpe32k-bpe32k.enml.vocab.yml
beam-size: 6
normalize: 1
word-penalty: 0
mini-batch: 1
maxi-batch: 1
maxi-batch-sort: src
relative-paths: true
from opus-mt.
Thanks. The confusion was that files are present in the en-es and not es-en, resolved it. Same is true for rest of the models too.
from opus-mt.
I am a bit confused - do you mean that the pre-trained es-en model package does not have the bpe model files included? They should be there and I would need to check/fix this if they are not there ...
from opus-mt.
I just downloaded the files again and it seems the files are indeed there. I had downloaded the same files a few days back and the files were not there.
from opus-mt.
Interesting. Well, good to know that this is fine. I'll close the issue again.
from opus-mt.
Related Issues (20)
- How to skip translation of some words? HOT 2
- SentencePiece normalization
- "I'm Sorry" is only response from WebSocket client on AWS Ubuntu HOT 1
- Translation model Cross Attention problem, inconsistent with paper ! HOT 1
- opus-mt-he-en unable to translate when text has latin digits HOT 1
- The connection was reset
- Can I use it as python liblary? HOT 1
- Translation results using ‘Helsinki-NLP/opus-mt-tc-big-en-ar’ model are not as expected HOT 3
- HTTPSConnectionPool(host='huggingface.co', port=443): Max retries exceeded with url: /Helsinki-NLP/opus-mt-en-sv/resolve/main/config.json
- Helsinki-NLP/opus-mt-tc-big-he-en nonsensical translation and the speed of the translation generally. HOT 3
- `Helsinki-NLP/opus-mt-fr-en` Model hallucinations HOT 2
- fill-mask ? HOT 3
- opusmt.wmflabs.org Wikimedia Cloud Services Error HOT 1
- Error with PUBKEY HOT 2
- Max Model Length Question in Pytorch Transformers Lib
- Missing information about cmake option HOT 1
- What to do with files postprocess.sh, preprocess.sh and source.tcmodel HOT 2
- Error when input text contains an empty line
- How to use the models for inference? HOT 1
- Can you support for translate between Myanmar and Chinese?
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from opus-mt.