Giter Club home page Giter Club logo

starrocks-kubernetes-operator's Introduction

StarRocks-Kubernetes-Operator

License

English | δΈ­ζ–‡

Overview

StarRocks Kubernetes Operator is a project that implements the deployment and operation of StarRocks, a next-generation sub-second MPP OLAP database, on Kubernetes. It facilitates the deployment of StarRocks' Frontend (FE), Backend (BE), and Compute Node (CN) components within your Kubernetes environment. It also includes Helm chart for easy installation and configuration. With StarRocks Kubernetes Operator, you can easily manage the lifecycle of StarRocks clusters, such as installing, scaling, upgrading etc.

Note

The StarRocks k8s operator was designed to be a level 2 operator. See https://sdk.operatorframework.io/docs/overview/operator-capabilities/ to understand more about the capabilities of a level 2 operator.

Prerequisites

  1. Kubernetes version >= 1.18
  2. Helm version >= 3.0

Features

Operator Features

  • Support deploying StarRocks FE, BE and CN components separately FE component is a must-have component, BE and CN components can be optionally deployed
  • Support multiple StarRocks clusters in one Kubernetes cluster
  • Support external clients outside the network of kubernetes to load data into StarRocks using STREAM LOAD
  • Support automatic scaling for CN nodes based on CPU and memory usage
  • Support mounting persistent volumes for StarRocks containers

Helm Chart Features

  • Support Helm Chart for easy installation and configuration
    • using kube-starrocks Helm chart to install both operator and StarRocks cluster
    • using operator Helm Chart to install operator, and using starrocks Helm Chart to install starrocks cluster
  • Support initializing the password of root in your StarRocks cluster during installation.
  • Support integration with other components in the Kubernetes ecosystem, such as Prometheus, Datadog, etc.

Installation

In order to use StarRocks in Kubernetes, you need to install:

  1. StarRocksCluster CRD
  2. StarRocks Operator
  3. StarRocksCluster CR

There are two ways to install Operator and StarRocks Cluster.

  1. Install Operator and StarRocks Cluster by yaml Manifest.
  2. Install Operator and StarRocks Cluster by Helm Chart.

Note: In every release, we will provide the latest version of the yaml Manifest and Helm Chart. You can find them in https://github.com/StarRocks/starrocks-kubernetes-operator/releases

Installation by yaml Manifest

Please see Deploy StarRocks With Operator document for more details.

1. Apply the StarRocksCluster CRD

kubectl apply -f https://raw.githubusercontent.com/StarRocks/starrocks-kubernetes-operator/main/deploy/starrocks.com_starrocksclusters.yaml

2. Apply the Operator manifest

Apply the Operator manifest. By default, the Operator is configured to install in the starrocks namespace. To use the Operator in a custom namespace, download the Operator manifest and edit all instances of namespace: starrocks to specify your custom namespace. Then apply this version of the manifest to the cluster with kubectl apply -f {local-file-path} instead of using the command below.

kubectl apply -f https://raw.githubusercontent.com/StarRocks/starrocks-kubernetes-operator/main/deploy/operator.yaml

3. Deploy the StarRocks cluster

You need to prepare a separate yaml file to deploy the StarRocks. The starrocks cluster CRD fields explains in api.md. The examples directory contains some simple example for reference.

You can use any of the template yaml file as a starting point. You can further add more configurations into the template yaml file following this deployment documentation.

For demonstration purpose, we use the starrocks-fe-and-be.yaml example template to start a 3 FE and 3 BE StarRocks cluster.

kubectl apply -f starrocks-fe-and-be.yaml

Installation by Helm Chart

Please see kube-starrocks for how to install both operator and StarRocks cluster by Helm Chart.

If you want more flexibility in managing your StarRocks clusters, you can deploy Operator using operator Helm Chart and StarRocks using starrocks Helm Chart separately.

Other Documents

  • In doc directory, you can find more documents about how to use StarRocks Operator.
  • In examples directory, you can find more examples about how to write StarRocksCluster CR.

starrocks-kubernetes-operator's People

Contributors

2585453704 avatar adamstaudt avatar alberttwong avatar danroscigno avatar dengliu avatar dujl avatar dxheming avatar imay avatar jinshuangxian avatar jzcruiser avatar kapilsingh421 avatar kevincai avatar mingmxu avatar shileifu avatar ss892714028 avatar wangruin avatar wholeworld-timothy avatar yandongxiao avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    πŸ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. πŸ“ŠπŸ“ˆπŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❀️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.