Question about alphabet about ncrfpp HOT 4 CLOSED

Sorry,maybe I have not described this problem clearly.
For example,I have a label set {"label1":1,"label2":2},so the function size returns 3 cause of the length of instance is 2.
When use_crf=False,

# add two more label for downlayer lstm, use original label size for CRF
label_size = data.label_alphabet_size
data.label_alphabet_size += 2
# so the hidden2tag 
self.hidden2tag = nn.Linear(data.HP_hidden_dim, data.label_alphabet_size)

the output size of hidden2tag is 5,
when use _, tag_seq = torch.max(outs, 1),the result maybe 0-4,but the label alphabe only has two labels,index 1 and index 2.
Thank you.

from ncrfpp.

I think I get your point. I also had this concern during writing this framework.

The "START" and "END" is for the CRF calculation. In the CRF layer, I set some of the default transition scores to -10000 to avoid the "START" and "END" output.

To keep the code simple, the "START" and "END" are also added in the model with softmax output. Theoretically, the model may decode some invalid labels "START/END" but it is almost impossible in real data. When the model is trained with the training data, it will not decode the invalid labels as they do not exist in the training data.

from ncrfpp.

Thank you.
In other words,once after training,the _, tag_seq = torch.max(outs, 1) almost will not produce invalid output.

from ncrfpp.

Exactly!

from ncrfpp.