Pytorch Implementation of AMSoftmax with label smooting
Additive Margin Softmax for Face Verification
Feng Wang, Weiyang Liu, Haijun Liu, Jian Cheng
https://arxiv.org/pdf/1801.05599.pdf
from AM_Softmax import AM_Softmax_v1 , AM_Softmax_v2
features = Model(input)
criterion_xent = AM_Softmax_v1()
Loss = criterion_xent(features, labels)
or
criterion_xent = AM_Softmax_v2()
Loss = criterion_xent(features , labels, model.module.classifier )
[Only for V_1] Since weights are in Loss function only, add these to the model optimizer as well.
for key, value in criterion_xent.named_parameters():
params += [{"params": [value], "lr": lr, "weight_decay": weight_decay}]
optimizer = torch.optim.Adam(params)
If you don't want label smoothing : remove the line
targets = (1 - self.epsilon) * targets + self.epsilon / self.num_classes
React
Typescript
Django
Laravel
Facebook
Microsoft
Google
Alibaba
D3
Tencent