lifelong-ml / mendez2020compositional Goto Github PK

After running this command:

python lifelong_experiment.py -d CIFAR -T 20 -e 100 -alg fm_compositional --initial_seed 0 -l 4 -arc cnn -b 64 -i random_onehot -n 1 --init_tasks 4 -l 4 -s 50

I would say the only differences with the original setup are that I set dropout to 0.2 and batch size to 64, but this should not influence the outcome at that point. The reported results for that baseline on CIFAR is 48%. However, when I run the command above to reproduce these results, I get an average accuracy of 71%.

I also obtain similar results in my own code, while trying to reproduce the experiments.

Did I write the wrong command to reproduce these results ?