Comments (1)
Yes, it's a standard encoder decoder architecture, the encoder-decoder attention attends to the whole sequence.
Typically, monotonic attention is used for streaming E2E. However, we use a joint CTC/AED(attention encoder decoder) model in WeNet for streaming , CTC part is for streaming, AED is for rescoring, which is more simple and has better accuracy than monotonic attention, so monotonic attention is not adopted in WeNet.
from wenet.
Related Issues (20)
- 转换后的paraformer模型可使用decoder_main进行解码吗? HOT 2
- GPU 流式 CTC Greedy 解码具有显存泄漏问题
- Converting Hugging Face's Whisper model to Wenet HOT 4
- [feats] dataset continue pretrain and repeat
- An error occurs when decoding with TLG model using JIT HOT 2
- wenet-mini容器启动阻塞在I0319 09:02:25.096329 7 params.h:155] Reading torch model /home/wenet/model/final.zip HOT 2
- context bias for each websocket request HOT 6
- After building a LM according to the document, the wer is close to 100% HOT 1
- train model with train_unified_conformer_ctl.yaml erros HOT 2
- 单机八卡2080ti上使用aishell1+少量自己数据在stage4卡住
- 请问wenet现有的标点功能的代码在哪部分 HOT 1
- 请问为什么测试模型的result是空白的 HOT 2
- run aishell4 on single gpu get stuck at stage 4 HOT 1
- RuntimeError: missing value in ASRModel forward() HOT 2
- 预训练模型下载不了 HOT 7
- Web Runtime HOT 1
- Gigaspeech的Conformer bidecoder模型 HOT 1
- I had a question regarding fine-tuning a Wenet model. Can a pre-trained model trained using U2++ conformer be loaded as a checkpoint to fine-tune a model with fixed chunk size(4,8 or 16)? HOT 1
- wenet-whisper-finetune中attention与ctc解码差异很大 HOT 4
- Support for training on single accelerator? HOT 4
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from wenet.