Pre-training LM about rnn-transducer HOT 4 CLOSED

The prediction model is similar to a language model, its actually phone language model for TIMIT dataset.
First add <SOS> <EOS> to each transcription, here I would like to use blank label as both <SOS> and <EOS>.
The input of prediction model is a sequence of phones with blank label prepended, the output should be the corresponding phone sequence with blank appended.

In one word, the training stage is same to language model, except it has a blank label.

from rnn-transducer.

Thanks for your prompt response. Just a follow up question, if I were to train character-wise LM, for instance: for a sentence like "hello world", should I send the following as input:
h e l l o w o r l d
and the following as target:
h e l l o w o r l d

I really appreciate your answer!

from rnn-transducer.

Well, for rnn-transducer, like CTC, it introduced a blank label, so you need to send the following as input (_ means blank) :
_ h e l l o w o r l d
and the following as the target:
h e l l o w o r l d _

from rnn-transducer.

Somehow the blank tag got dropped in my post :(
Yes, I meant by your response. Thanks a lot!

from rnn-transducer.