How do you Backup? about csi-driver HOT 10 CLOSED

Backups/snapshots of attached volumes would be a huge improvement. Very annoying having to use a "hacky" solution like rsycnc'ing to a storagebox or similar.

from csi-driver.

Is there something planned in the near future @LKaemmerling ? Would highly appreciate this. Something like a point in time recovery for specific volumes.

from csi-driver.

Once #200 is merged, btrfs snapshots might be a good solution.

from csi-driver.

I'm interested to know too.
I would like the backups to automatically store on WASABI (S3 compatible endpoint) which is lots cheaper, faster and solid than Amazon S3.
One simple price tier as 6$ per month for 1TB included. No cost for ingress, egress, calls, connections etc...

On the other hand, I'm looking into Rook and OpenEBS. I have just recently purchase a subscription for MayaDirector (for OpenEBS) to have CAS (container attached storage) so basically I have less to worry about the storage itself. It replicates itself around the cluster but still figuring out as much as possible and working with one of the OpenEBS engineers.

from csi-driver.

The intention of my question was to find out about some solutions to backup the created volumes with some selfwritten scripts ;)

If there was an automation for backups in this CSI driver, I'd prefer backups using borg on hetzners storage boxes for the first run. In my cluster run applications with sensitive data, so storages on servers of a non-EU company are an absolute show-stopper for backup ;)
And btw. in my opinion this driver is about utilizing Hetzner infrastructure in kubernetes clusters ;)

from csi-driver.

Oh ok, sorry for the mis-interpretation.
Well, you can also have a look at MinIO, it's a self hosted S3 bucket platform and often used in K8s.
https://min.io/

I'm currently working myself through a solution with the help from OpenEBS. I purchased their MayaOnline (Director) plan and it comes with personal support plan to help the launch on K8s.
And their engineer also came with this suggestion to use MinIO.
Happy to share my experience and insights as soon as I got further with the install today/tomorrow.

Btw, WASABI has also storage locations in Europe ;)
So in terms of GDPR, everything is good.

from csi-driver.

I've been using velero, which in turn uses restic to back up k8s volumes to S3-compatible storage e.g., wasabi. It works really well.

from csi-driver.

I will close this issue, as this is not a problem directly related to the CSI Driver (or at least a problem with the CSI Driver itself). Of course, you can discuss in this issue about your Backup Solutions.

from csi-driver.

Chiming in here, hoping that some new options to backup Hetzner volumes have arisen but I guess not. If you have any new ideas please let us know!

from csi-driver.

@kennell
I don't think they will ever put such feature in here. As far as I know, no type of CSI integration does that.
Typically the backups part are done from tools like Velero, etc...
We use a combination of MinIO, which is a self hosted S3 storage platform (and 1:1 compatible with AWS S3 API) so you handle replication easier with local nodes.

And we use Longhorn alongside with Rancher because it has native integration with S3 to store your volume backups directly to an external S3/FTP locations.
We picked Longhorn because it has a clean web GUI to make it more visual to point and click for manual backups and restores.
https://longhorn.io/docs/1.2.2/snapshots-and-backups/scheduling-backups-and-snapshots/

Other possible candidates: OpenEBS, Rook (based on CEPH), ....

from csi-driver.