Comments (2)
by default, clickhouse-backup requires memory only when upload/download data usually memory fooprint is only 30-40mb without these operations
issue is not related to clickhouse-backup itself
you can specify a different podTemplate
for each replica in shard
something like that
spec:
templates:
- name: pod-with-backup
spec:
containers:
- name: clickhouse-backup
image: altinity/clickhouse-backup:latest
- name: clickhouse
image: clickhouse/clickhouse-server:latest
- name: pod-clickouse-only
spec:
containers:
- name: clickhouse
image: clickhouse/clickhouse-server:latest
configuration:
layout:
shardsCount: 2
replicas:
- templates:
podTemplate: pod-with-backup
- templates:
podTemplate: pod-clickhouse-only
Moreover, it will more complex command sequence to restore data in this cluster in this case
need to add environment variable RESTORE_SCHEMA_ON_CLUSTER="{cluster}"
in clickhouse-backup container spec
from clickhouse-backup.
@Slach thanks for example with with replicas
that looks like exactly what we need here.
clickhouse-backup requires memory only when upload/download data usually memory fooprint is only 30-40mb without these operations
We are planning on using blob storage with relatively large tables, so our ch-backup sidecar will need non-trivial resources.
Moreover, it will more complex command sequence to restore data in this cluster in this case
need to add environment variable RESTORE_SCHEMA_ON_CLUSTER="{cluster}" in clickhouse-backup container spec
We were planning on manually recreating schema on replicas w/o the backup sidecar, but this may be a better option.
from clickhouse-backup.
Related Issues (20)
- validation config failures for API server after apply --env in one command
- Replcace AsyncStatus.commands []ActionRow to combination map + slice to allow store only last XXX action items
- Add support for dynamically created disks
- `clean` command does not work with POST /backup/actions. HOT 1
- Can't restore if object_disks_path starts with "/"
- Restore RBAC on cluster HOT 1
- Not able to restore backups - can't parse metadata.cache.S3 file HOT 9
- Not able to restore backups - not found after download backup HOT 10
- Not able to restore backups - no such file or directory HOT 1
- Add backup of KeeperMap tables
- Can't change I/O priority HOT 1
- SignatureDoesNotMatch: The request signature we calculated does not match HOT 3
- add flags --configs --rbac in clickhouse-backup server --watch command HOT 2
- Unknown table expression identifier ‘system.backup_list’ HOT 13
- Restore Failure: Experimental Object Type Not Allowed HOT 5
- Restoring local backup fails due to NewBackupDestination error: storage type 'none' is not supported HOT 6
- Add --list-parts flags to tables command HOT 2
- custom TLS self-signed cert for S3 return error even when S3_DISABLE_CERT_VALIDATION=true HOT 7
- add flags --named-collections to create / restore / upload / download commands and option `named_collections_backup_always: false` to config
- Error during restore_remote operation: "can't create table test_db HOT 15
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from clickhouse-backup.