Is it possible to make onnx-go run distributedly? about onnx-go HOT 10 CLOSED

Hello,

Thanks for your interest in onnx-go.
This is a good subject and an excellent idea!

IMHO, onnx-go by itself would not benefit from a distributed execution (it's "only" a parsing mechanism that reconstructs a graph). But, the execution backend would.

By now, the most advanced backend is Gorgonia, and Gorgonia would benefit from a distributed computation system.

brief sidenote: Gorgonia's architecture is extensible. It uses an Expression Graph that is computed by a VM. The VM is an interface.

Last week I created a distributed VM based on go-routines and channels. I think it can be a good starting point for distributed computing.
My idea is to eventually end with something similar to the pregel algo used in spark.

More info here:

https://github.com/gorgonia/gorgonia/blob/1969ec3b19e8c3f9a3ffe9a854571223d4e16054/x/vm/vm_gomachine.go#L14-L25

I am also present on the #gorgonia channel on the #gopherslack. Feel free to join and/or to send me PM there. I would be glad to help you.

from onnx-go.

from onnx-go.

Hi Olivier, what is "#gorgonia channel on the #gopherslack?"

from onnx-go.

It's a channel on gophers.slack.com. You don't need any invitation to join this.

This URL should be direct access to the channel https://app.slack.com/client/T029RQSE6/CP1GMBUP2

from onnx-go.

Thanks for the clarification. Slack prompted "Contact the workspace administrator for an invitation," though.

from onnx-go.

An invitation is now required for gophers.slack.com?

Besides, can we close this issue?

from onnx-go.

from onnx-go.

If it is possible, could you please invite me to gophers.slack.com? @owulveryck

from onnx-go.

from onnx-go.

Thanks

from onnx-go.