arswysocki / replibyte Goto Github PK

Replibyte is a blazingly fast tool to seed your databases with your production data while keeping sensitive data safe 🔥

• MacOSX / Linux / Windows
• Nothing more! Replibyte is stateless and does not require anything special.

Create a dump

replibyte -c conf.yaml dump create

List all dumps

replibyte -c conf.yaml dump list

type          name                  size    when                    compressed  encrypted
PostgreSQL    dump-1647706359405    154MB   Yesterday at 03:00 am   true        true
PostgreSQL    dump-1647731334517    152MB   2 days ago at 03:00 am  true        true
PostgreSQL    dump-1647734369306    149MB   3 days ago at 03:00 am  true        true

Restore the latest dump in a local container

replibyte -c conf.yaml dump restore local -v latest -i postgres -p 5432

Restore the latest dump in a remote database

replibyte -c conf.yaml dump restore remote -v latest

• Support data dump and restore for PostgreSQL, MySQL and MongoDB
• Replace sensitive data with fake data
• Works on large database (> 10GB)
• Database Subsetting: Scale down a production database to a more reasonable size 🔥
• Start a local database with the prod data in a single command 🔥
• On-the-fly data (de)compression (Zlib)
• On-the-fly data de/encryption (AES-256)
• Fully stateless (no server, no daemon) and lightweight binary 🍃
• Use custom transformers

Here are the features we plan to support

• Auto-detect and version database schema change
• Auto-detect sensitive fields
• Auto-clean backed up data

1. How Replibyte works
2. Initial setup:
   1. Install
   2. Configure
3. Step-by-step guides:
   1. Create a dump
   2. Restore a dump
   3. Subset a dump
   4. Delete a dump
   5. Deploy Replibyte
      1. Container
      2. Qovery

Check here.

Thanks to all people sharing their ideas to make Replibyte better. We do appreciate it. I would also thank AirByte, a great product and a trustworthy source of inspiration for this project.

Replibyte is initiated and maintained by Qovery