itzikmalkiel / mtadam Goto Github PK

Traceback (most recent call last):
  File "train.py", line 241, in <module>
    optimizer.step(loss_array, ranks, None)
  File "/home/fdiakogiannis/Software/torch/optim/optimizer.py", line 89, in wrapper
    return func(*args, **kwargs)
  File "/home/fdiakogiannis/Software/torch/autograd/grad_mode.py", line 27, in decorate_context
    return func(*args, **kwargs)
  File "/home/fdiakogiannis/Projects/OI-FD-dev/src/training_scripts/nbeatsxx/model_v3_quantile_to/mtadam.py", line 64, in step
    self.update_weights(loss_array, ranks)
  File "/home/fdiakogiannis/Projects/OI-FD-dev/src/training_scripts/nbeatsxx/model_v3_quantile_to/mtadam.py", line 153, in update_weights
    max_denom = p.denom[0]
AttributeError: 'Parameter' object has no attribute 'denom'
srun: error: hyades03: task 0: Exited with exit code 1

# Balanced Adam optimizer 
from mtadam import *

...
optimizer = MTAdam(net.parameters(), lr=0.001)
...
# The first loss is L1 the second BCE Loss, as given by torch.nn. 
loss_array = [criterion(ypreds, ylabel), criterion_pp(to_preds,to_label)]
ranks = [1]*len(loss_array)
optimizer.step(loss_array, ranks, None)