⚠️ EXPERIMENTAL: See meltano/meltano#8367. ⚠️

This is a Meltano extension that provides a RocksDB state backend using the RocksDict library.

This package needs to be installed in the same Python environment as Meltano.

pipx install meltano
pipx inject 'meltano-rocksdb-state-backend @ git+https://github.com/edgarrmondragon/meltano-rocksdb-state-backend.git'

This package is not yet available on PyPI.

state_backend:
  uri: rocksdb://${MELTANO_SYS_DIR_ROOT}/state
  rocksdb:
    write_buffer_size: 0x2000000  # 32MB

• MELTANO_STATE_BACKEND_URI: The URI of the RocksDB state backend.
• MELTANO_STATE_BACKEND_ROCKSDB_WRITE_BUFFER_SIZE: The RocksDB write buffer size in bytes.