Giter Club home page Giter Club logo

Comments (2)

Slach avatar Slach commented on August 16, 2024

by default, clickhouse-backup requires memory only when upload/download data usually memory fooprint is only 30-40mb without these operations

issue is not related to clickhouse-backup itself

you can specify a different podTemplate for each replica in shard

something like that

spec:
  templates:
  - name: pod-with-backup
    spec:
      containers:
      - name: clickhouse-backup
        image: altinity/clickhouse-backup:latest
      - name: clickhouse
        image: clickhouse/clickhouse-server:latest  
  - name: pod-clickouse-only
    spec:
      containers:
      - name: clickhouse
        image: clickhouse/clickhouse-server:latest  
  configuration:
    layout:
      shardsCount: 2 
      replicas:
      - templates:
          podTemplate: pod-with-backup
      - templates:
          podTemplate: pod-clickhouse-only

Moreover, it will more complex command sequence to restore data in this cluster in this case
need to add environment variable RESTORE_SCHEMA_ON_CLUSTER="{cluster}" in clickhouse-backup container spec

from clickhouse-backup.

aaron276h avatar aaron276h commented on August 16, 2024

@Slach thanks for example with with replicas that looks like exactly what we need here.

clickhouse-backup requires memory only when upload/download data usually memory fooprint is only 30-40mb without these operations

We are planning on using blob storage with relatively large tables, so our ch-backup sidecar will need non-trivial resources.

Moreover, it will more complex command sequence to restore data in this cluster in this case
need to add environment variable RESTORE_SCHEMA_ON_CLUSTER="{cluster}" in clickhouse-backup container spec

We were planning on manually recreating schema on replicas w/o the backup sidecar, but this may be a better option.

from clickhouse-backup.

Related Issues (20)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.