Parallel Execution of Independent Nodes about comfyui HOT 2 CLOSED

This requires an overhaul of the execution model and in-depth consideration of various corner cases.

For example, tasks that require VRAM should not operate in parallel. Otherwise, you'll encounter the nightmare of VRAM shortage. There are complex issues such as policy decisions on which tasks should run in parallel and which should not, and how to ensure that each node developer correctly applies these policies without errors.

To implement this, it is not a matter that can be addressed simply in an issue. It will need to be refined through lengthy discussions in a discussion forum.

from comfyui.

This requires an overhaul of the execution model and in-depth consideration of various corner cases.

For example, tasks that require VRAM should not operate in parallel. Otherwise, you'll encounter the nightmare of VRAM shortage. There are complex issues such as policy decisions on which tasks should run in parallel and which should not, and how to ensure that each node developer correctly applies these policies without errors.

To implement this, it is not a matter that can be addressed simply in an issue. It will need to be refined through lengthy discussions in a discussion forum.

Could we create a tool that allows users to manually specify which nodes can run in parallel for each specific workflow?

This would help calculate the VRAM load for each case and use memory more efficiently. This way, we can avoid VRAM shortages and handle complex workflows more effectively.

By letting users decide which tasks run in parallel, we solve the problems with automatic parallelization and give them control over resource use.

from comfyui.