Giter Club home page Giter Club logo

ripsaw's Introduction

Benchmark Operator

The intent of this Operator is to deploy common workloads to establish a performance baseline of Kubernetes cluster on your provider.

Installation

Installing the benchmark-operator is easiest by using the helm chart and can be done with the following commands. This requires your machine to have Helm installed. Install Helm

Note: If running on openshift you'll need to run this command before installing the chart. oc adm policy -n my-ripsaw add-scc-to-user privileged -z benchmark-operator

git clone https://github.com/cloud-bulldozer/benchmark-operator
cd benchmark-operator/charts/benchmark-operator
helm install benchmark-operator . -n my-ripsaw --create-namespace

To delete this release, you can do so with the following command:

helm delete benchmark-operator -n my-ripsaw --purge

Workloads status

Workload Use ElasticSearch indexing Reconciliation usage VM support (kubevirt) Kata Containers CI Tested
UPerf Network Performance Yes Used, default : 3second Working Working Yes
Iperf3 Network Performance No Used, default : 3second Not Supported Preview Yes
fio Storage IO Yes Used, default : 3second Working Working Yes
Sysbench System Performance No Used, default : 3second Not Supported Preview Yes
YCSB Database Performance Yes Used, default : 3second Not Supported Preview Yes
Byowl User defined workload Yes Used, default : 3second Not Supported Preview Yes
Pgbench Postgres Performance Yes Used, default : 3second Not Supported Preview Yes
Smallfile Storage IO Performance Yes Used, default : 3second Not Supported Preview Yes
fs-drift Storage IO Longevity Yes Not used Not Supported Preview Yes
hammerdb Database Performance Yes Used, default : 3second Not Supported Preview Yes
Service Mesh Microservices No Used, default : 3second Not Supported Preview No
Vegeta HTTP Performance Yes Used, default : 3second Not Supported Preview Yes
Scale Openshift Scale Openshift Cluster Yes Used, default : 3second Not Supported Preview Yes
stressng Stress system resources Yes Used, default: 3second Working Preview Yes
kube-burner k8s Performance Yes Used, default : 3second Not Supported Preview Yes
cyclictest Real-Time Performance Yes Used, default : 3second Not Supported Preview No
oslat Real-Time Latency Yes Used, default : 3second Not Supported Preview No
testpmd TestPMD DPDK App No Used Not Supported Preview No
Flent Network Performance Yes Used, default : 3second Not Supported Not Supported Yes

Reconciliation

Previously the Benchmark Operator didn't properly take advantage of the reconciliation period. Going forward we will make every attempt to utilize the reconciliation period.

Why did we decide to switch to this? Our operator would implement long running tasks, due to the nature of benchmarks. However, long running tasks blocks the Operator, causing us to delete the Operator and re-create the operator to un-block it. The benchmarks mentioned above that state Used for Reconciliation, no longer have this issue.

Optional workload images

Optional locations for workload images can now be added easily without the need to rebuild the operator. To do so in the workload args section of the CR add image: [location]

NOTE: This is not a required arguement. If omitted it will default to the currently verified workload image. Additionally, this is NOT enabled for YCSB

For Example:

apiVersion: ripsaw.cloudbulldozer.io/v1alpha1
kind: Benchmark
metadata:
  name: example-benchmark
  namespace: my-ripsaw
spec:
  elasticsearch:
    url: "http://my-es.foo.bar:80"
  metadata_collection: true
  cleanup: false
  workload:
    name: "foo"
    args:
      image: my.location/foo:latest

User Provided UUID

All benchmarks in the benchmark-operator utilize a UUID for tracking and indexing purposes. This UUID is, by default, generated when the workload is first started. However, if desired, a user provided UUID can be added to the workload cr.

NOTE: The provided UUID must be in format XXXXX-XXXXX-XXXXX

For Example:

apiVersion: ripsaw.cloudbulldozer.io/v1alpha1
kind: Benchmark
metadata:
  name: example-benchmark
  namespace: my-ripsaw
spec:
  uuid: 6060004a-7515-424e-93bb-c49844600dde
  elasticsearch:
    url: "http://my-es.foo.bar:80"
  metadata_collection: true
  cleanup: false
  workload:
    name: "foo"
    args:
      image: my.location/foo:latest

Installation

Installation

Contributing

Contributing

Metadata Collection

Metadata Collection

Cerberus Integration

Cerberus Integration

Indexing to Elasticsearch

Indexing to Elasticsearch

Capturing Prometheus Data

Capturing Prometheus Data

Cache dropping

Cache dropping

Community

Key Members(slack_usernames): ravi, mohit, dry923, rsevilla or rook

ripsaw's People

Contributors

rsevilla87 avatar dry923 avatar jtaleric avatar aakarshg avatar dustinblack avatar bengland2 avatar smalleni avatar acalhounrh avatar sarahbx avatar mulbc avatar amitsagtani97 avatar mkarg75 avatar mohit-sheth avatar mukrishn avatar avilir avatar martineg avatar ekuric avatar keesturam avatar akrzos avatar chawlanikhil24 avatar netzzer avatar ebattat avatar vasukulkarni avatar shekharberry avatar robertkrawitz avatar rvansa avatar chaitanyaenr avatar mffiedler avatar mike10010100 avatar kpouget avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.