Multi-GPU Launcher about domainbed HOT 4 CLOSED

I modified these lines in "sweep.py", from line 80 to line 99.

I am not sure if this would be appropriate. At least, they work well on my system.

If so, would I be able to create a PR?

        all_gpu_counts = torch.cuda.device_count()
        commands_per_gpu = {}
        for i in range(all_gpu_counts):
            commands_per_gpu[i] = []

        idx = 0
        while idx < len(commands):
            for i in range(all_gpu_counts):
                if idx < len(commands):
                    commands_per_gpu[i].append("CUDA_VISIBLE_DEVICES={} {}".format(i, commands[idx]))
                    idx += 1

        multi_gpus_processes = []
        for i in range(all_gpu_counts):
            p = Process(target=launcher_fn, args=(commands_per_gpu[i],))
            p.start()
            multi_gpus_processes.append(p)

        for p in multi_gpus_processes:
            p.join()

from domainbed.

Hi, thanks for the interest in contributing! I think this is a good idea. A cleaner way to implement this would be as a command launcher in command_launchers.py. Just write a function that runs each command in a list, and add the function to the registry at the bottom of the file. You can use your command launcher by running sweep.py with the --command_launcher flag.

from domainbed.

I've gone ahead and taken a first shot at an implementation at 56196cc . Hope this helps!

from domainbed.

Thank you @igul222. Please re-open if necessary, @Luodian.

from domainbed.