Giter Club home page Giter Club logo

flowlogger's Introduction

FlowLogger

A command line tool for retrieving and analyzing IBM Cloud flow logs, developed by the Global Cloud Acceleration Team (GCAT) Interns:

  1. Bokai Li
  2. Daroush Renoit
  3. Rebecca Rozansky
  4. Ryan Rahman
  5. Ayman Naji

Contents

  1. Overview
  2. Flow Logs
  3. Getting started
  4. Resources

Overview

When traffic is denied to a VPC by ACLs or security groups, the only way to investigate is to look at flow logs. Currently, flow logs are hard to read and manage. We are going to build a tool that runs SQL queries on the logs to generate important information in a readable format.

Please note that this is still in the EXPERIMENTAL phase and there is no official support at the moment, nor are the current command structures going to be around for very long as they are being constantly modified and tweaked for optimal results before pulling them into our CLI.

Flow Logs

Capture information about the IP traffic going to and from network interfaces in your VPC and are stored in a Cloud Object Storage(COS) bucket

With this information you are able to:

  • Troubleshoot why specific traffic isn't reaching an instance, which helps to diagnose restrictive security group rules.
  • Monitor the traffic that is reaching your instance.
  • Adhere to compliance regulations
  • Determine the overall health of network monitoring
  • Assist with root cause analysis.

Getting started

IBM Cloud Prerequisites

Creating a flow log collector

Prior to creating a flow log collector, ensure that you have met the following prerequisites:

-Make sure that at least one VPC, a subnet, and a virtual server instance exist. -Make sure that a COS instance with a bucket exists for your flow logs.

For more details, see our [Resources](#resources) section for a detailed IBM Cloud documentation on IBM Cloud VPCs and Flow Logs.


Make sure to note the region of the COS that contains your flow logs, considering that is what you are prompted for when the CLI pulls them to your local depository.

Terminal Prerequisites

  • Must have node js installed.
  • Install node js with brew install node.
  • After cloning the repo, run cd acl-logs to change your directory to the project directory.
  • Run npm install in the project directory.
  • Run sudo npm install -g . to package the program as a global command
  • In the package.json file, under scripts, set the test attribute value to jest
  • run npm test in terminal to execute tests

Commands

  • Use flowlog get to pull the newest flowlogs
  • Use flowlog parse to parse the flowlogs
  • Use flowlog scan to scan logs for errors
  • Alternatively, use flowlog to choose from any of the above

How to get your API Key

  • Log in to to cloud.ibm.com
  • Click "Manage" in the top right menu bar
  • Select "Access (IAM)"
  • Select "API keys" on the left menu
  • You can create a API key in this page, and make sure to store it securely

Resources

flowlogger's People

Contributors

rahmannoodles98 avatar bokai-li avatar dpeace8 avatar ay1man2 avatar rebeccarozansky avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.