Comments (5)
The model is trained about 1.5 day on LibriTTS clean subset with an A800 GPU, and the batch size is 10240 tokens.
from funcodec.
on 8 A100 GPUs? The total duration is 6000 hours ?
from funcodec.
Only one A800 GPU. I think the duration of LibriTTS clean subset is about 244 hours
from funcodec.
The model is trained about 1.5 day on LibriTTS clean subset with an A800 GPU, and the batch size is 10240 tokens.
Hi @ZhihaoDU
10240 tokens?How do you calculate it?
speech_max_length / encoder_hop_length * batch_size = 40960 / 320 * 16 = 2048?
from funcodec.
@ZhihaoDU please
数据集132000个文件,如果设置batch_size=8, 两者相除等于16250,这是不是意味着如果还是保持num_iters_per_epoch=10000,这是不合适的。你可以分享一下,batch_size、num_iters_per_epoch、num_works怎么计算才比较合理?
另外你设置的input_size=1,也参与计算吗?
from funcodec.
Related Issues (20)
- Relation between bitrate and token ratio HOT 2
- LauraTTS: _pickle.UnpicklingError: invalid load key, 'v'. HOT 5
- Low-complexity FreqCodec requires a lot of VRAM HOT 3
- ERROR Generating with prompt text and prompt audio HOT 8
- Questions about training from scratch HOT 2
- TKR? HOT 5
- TypeError: 'NoneType' object is not callable HOT 4
- [bug] encoding阶段生成的codec.txt, 无法直接读取? HOT 1
- Discriminator loss? HOT 5
- 如何仅用funcodec的4层或者8层量化器进行推理 HOT 2
- zipfile.BadZipFile: File is not a zip file HOT 1
- run.sh: 34: utils/parse_options.sh: Syntax error: Bad for loop variable
- How to check progress? HOT 1
- 运行run.sh在stage 4时报错 HOT 2
- Stage 3 HOT 1
- Feature to resume training after stopping?
- NET/Plugin : dlerror=libnccl-net.so: cannot open shared object file: No such file or directory No plugin found (libnccl-net.so)
- Out of memory when train on large dataset (librilight)
- Stage 1 can only be run on one gpu card 0
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from funcodec.