Provide a network-client class that provides default behaviors for failover and bootstraplist management. about arsenal HOT 3 OPEN

Is it really desirable ?

• putting s3 and bucketd on different hosts may result in increasing latency
• putting s3 and sproxyd on different hosts may result in increasing the network bandwdith

Also to do that in production

• the failover/retry needs to be pretty reliable
• load balancing wil come in the picture

from arsenal.

putting s3 and bucketd on different hosts may result in increasing latency

First, the point is to have a behavior that, by default, privileges the one on the same host (in the best case nothing changes)
Second, Sure, going from S3 D to Bucketd A only to go to Repd C includes one more useless hop, so it might not be the most interesting part of this proposal.

Now, I do not have any knowledge of any official decision about either forcing everything-on-localhost vs do-whatever-you-want; in terms of flexibility for the installation. This piece of code would enable any of those two decisions; without judgement on this.

putting s3 and sproxyd on different hosts may result in increasing the network bandwdith

Well, I do not know if there's much difference between having a local sproxyd that sends to a remote RING, versus having a remote sproxyd that sends to the RING on its own host. I feel like there should not be much differences in terms of performance; but you can prove me wrong.
Also, I'm really scared about having to manage the sproxyd configuration from federation. I do not think we should go that way.

the failover/retry needs to be pretty reliable

Sure, I agree. And that's why it should only be written once and properly tested, than written multiple times and badly tested. (and I know it won't convince you).

load balancing wil come in the picture

That's the part I have no answer for.

But you know.... This issue has been up for a while, including for discussions, and no one discussed it...........

from arsenal.

After offline discussion:

1. We need to have a real decision on the deployment design and flexibility. I'll be summoning @GiorgioRegni and @vrancurel for this :)
2. The only potentially hard-to-discuss point is the sproxyd deployment (right version) and its configuration management. Some work is currently ongoing on our side to try and improve this.
3. Load balancing is the most important worry, that shall enter in the equation for the decision related to 1.

from arsenal.