Why does the 24kHz model use 32 codebooks? about descript-audio-codec HOT 3 CLOSED

Hey there, the 24khz model uses 32 codebooks so that we could directly compare to EnCodec. The configuration in terms of stride, number of codebooks, and sampling rate all match EnCodec. You're right though, that further compression should be possible!

However, quantizer dropout was used for this model as well. Here are the quantitative results at each bitrate:

from descript-audio-codec.

I see, thank you for the answer!

Are there any plans to release a 24kHz model trained with fewer codebooks as well?

I'm not sure I understand the concept of these residual vector quantized codecs yet, so this might be a stupid question, but to reduce the bitrate of the model you just use fewer codebooks, right? So if the 24kHz model uses 32 codebooks to have a 24kbps bitrate, using only 8 codebooks corresponds to 6kbps?

from descript-audio-codec.

@Flux: yes, 8 codebooks corresponds to 6kbps.

from descript-audio-codec.