Copy VarStore over devices about tch-rs HOT 3 CLOSED

I imagine that you're creating one VarStore per device. In this case writing to a file certainly doesn't sound optimal to synchronise them.
You could imagine copying the tensors returned by VarStore::trainable_variables but there are no guarantees on the order so this would be a bit fragile. When I get a chance I'll add a VarStore::copy function that would make the copy in a more robust way, this should not be very difficult.

from tch-rs.

I just added a function vs.copy(&src) that should modify all the values from vs by copying the associated value in src. This returns an error if the name doesn't appear in src.

from tch-rs.

Nice. It happens that I implement my own copy in the same time. I will adopt your more cleaner code.

from tch-rs.