Download and extract Cifar10 dataset in multinode_test/data folder. You should have multinode_test/data/cifar-10-batches-py folder.
ssh into your account on compute canada and clone this repo
- ssh into your account on compute canada
- cd to multinode_test/accelerate
- run
sbatch submit_job.sh
- ssh into your account on compute canada
- cd to multinode_test/ddp
- run
sbatch submit_job.sh
- ssh into your account on compute canada
- cd to multinode_test/lightning
- run
sbatch submit_job.sh
To solve this run chmod u+x *.sh