Giter Club home page Giter Club logo

opf-storage-project's Introduction

2021 Spring Co-op Project

Title: Expansion of Storage Monitoring in the Operate First Environment
Co-op: Bryan Montalvan
School: University of Massachussetts Lowell

My Project Proposal

My project for this spring period is to expand the way we currently monitor storage metrics in the Operate First Environment. This will be done by creating a grafana dashboard which will visualize storage data by cluster and its respective namespace.

Whether you are a user or administrator, having the ability to view your cluster's storage metrics and logs is a great asset to understand the health of your application's deployment. Knowing if your PV is about to max out on resources is crucial on knowing when to request more storage. Another example is finding out what is using the most resources on your namespace.

In conjuction to this project idea I also have a complimentary project idea which is to create a Predictable Consumption Model witch can predict when a PV will be full. And could forecast other storage reated metrics/occurences. This idea can potentially involve alerting, more research will be done on this idea down the line.

How will this be done?

Storage Dashboard:

First I will check the data we pull from Prometheus checking any labels/queries which are storage related and get an understanding of what type of metrics I have to my disposal. Afterwards I'll only take the metrics that users would deem useful, and the planning phase begins.

Note: When creating data visualization its always important to follow these guidelines

  • Make the metrics/data make sense
  • Each time a metric is pulled, it acquires a cost so pull only what you need
  • Understand your intended audience

Once I have a starting idea as to what should be visualized I'll use the visulization tool, Grafana, to create visulizations which drive my projects intentions. Currently I will expand our Storage Cluster Overview dashboard which is meant to have a high level view of each cluster and its storage data. I will also create a new folder which will house a user specific dashboard so users can know more about how their projects are doing in our clusters

Metrics

flowchart LR;
  OpenShift-Cluster --> Prometheus
  Prometheus --> Thanos
  Prometheus --> Grafana
  Thanos --> Grafana

Predictable Consumption Model (PCM):

(N/A)

Note:

If you are unfamilar with Operate First, please take a look at a simple introductary doc to better understand what the initative is and how the monitor infrastructure works.

opf-storage-project's People

Contributors

bryanmontalvan avatar

Watchers

 avatar

Forkers

jacobarcarola

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.