Giter Club home page Giter Club logo

pg-scramble's Introduction

pg-scramble

Main repository, wiki, and issue tracker of PG SCrAMblE

pg-scramble's People

Contributors

ashwinprasadme avatar bhargavimohan avatar dhararkajit avatar dramesh94 avatar hadik3r avatar harshithagowda7 avatar mehraghdam avatar sanketgupta99 avatar suheelsn avatar vivekjaganath avatar

Stargazers

 avatar

Watchers

 avatar  avatar  avatar  avatar  avatar  avatar

pg-scramble's Issues

Graph Processing

Explore networkx python package. Try to create a graph from a sample SONATA NSD.

Create architecture diagram for WP1

this task includes:

  1. List out the various components of translator engine and describe them in detail
  2. create a flow diagram/chart to understand the working/flow of various components

Validating scalability criteria

  • Establish the set up to collect metrics (NFVO capacity, VNFM capacity, latency of life cycle management of NS).

  • Simulate the peak conditions and collect data.

Research on the effects of scaling

As discussed, these are the tasks

  • Collect the papers relevant to the individually assigned sections
  • Add to the bibliography and cite into the sections that are relevant
  • Establish the context for our implementation plan

Plugin code review and improvements

Some notes on current plugin implementation - Link

Line# - Comment

37,165,170 - installing and using numpy only for random selection? not the best idea
154 - random_combination function, im sure, can be much simpler.
159 - using two lists for id and names and matching based on index? not the best idea, use dict
173 - interesting way to find the other set. but does this solution scale for n-split?
177 - can instead use dict, consider when extending support for n-split
205, 230 - hardcode. find solution for service discovery
257 - generatePackage returns false if it doesnt work. use if to confirm this (error handling)
261-263, 324 - move hardcode to config.py
271 - change HOST_URL to host
296 - to get the VIM list you can use get_vims_list() function from wrappers.SONATAClient.admin.py
335 - this needs to be supported by adaptor
318 - while doing this, can maintain a dict of all items with fields like ip, name, etc

General Comments

  • Code can be a little more modular, make functions for repeated tasks (ex rest calls)
  • Error handling? currently none
  • Fix hardcodes, at the minimum make a config.py with all the hardcoded values (dirty fix!)
  • Is it better to have a python pip package instread of having docker services? atleast in the current context
  • Assumed 2-way split everywhere, nightmare for the next iteration when adding support for more.
  • Add some Log.INFO for more verbosity

Initial scalability architecture proposal

After the initial research of scalability, the architecture for scaling is to be made and we should come up with initial architecture choices for discussion. We will aggregate important topics of discussion and practical guides here.

Task List

  • Select the approaches studied as part of initial research for further investigation (@dramesh94 )
  • Come up with concrete architecture design for further investigation (@bhargavimohan )
  • Do a feasibility study and investigate implementational challenges (@iashwinprasada )

Initial setup for coding

Initial setup includes:

  1. develop an initial logic of reading any descriptor file/data and store in memory in a common format.
  2. push to github

List and identify remaining funtions to be wrapped

  • Make common interfaces of all remaining ETSI suggestions and fill excel sheet (@iashwinprasada )
  • Identify all implemented calls for OSM and update excel sheet (@bhargavimohan )
  • Identify all implemented calls for Sonata and uodate excel sheet (@dramesh94 )
  • Review, finalize and distribute implementation (@iashwinprasada )

JSON/ YAML file processing.

Study about JSON/ YAML file processing and different APIs which can be used to extract all the information from the files.

OSM and Sonata Load Experiment

@bhargavimohan Tasks:

  • VM Config and Ubuntu setup

  • Install tools

    • OSM
    • netdata
    • openstack
  • Decide NSD/VNFD

    • Have multiple options (2-3)
    • Establish baseline experiment (dummy nsd/vnfd?)
  • Decide experiment data structure

    • what to collect?
    • how much/long to collect? (time?)
    • charts?
    • Questions to be answered by the test data?
    • How to store and how to present results?
  • Start experiment

    • collect data as planned
    • document results
  • Repeat experiment with different NSD/VNFD

    • Also vary other parameters (# instances?)
    • Try inducing some load on the running VNF
  • ....


@dramesh94 Tasks:

  • VM Config and Ubuntu setup

  • Install tools

    • Pishahang
    • netdata
    • openstack
  • Decide NSD/VNFD

    • Have multiple options (2-3)
    • Establish baseline experiment (dummy nsd/vnfd?)
  • Decide experiment data structure

    • what to collect?
    • how much/long to collect? (time?)
    • charts?
    • Questions to be answered by the test data?
    • How to store and how to present results?
  • Start experiment

    • collect data as planned
    • document results
  • Repeat experiment with different NSD/VNFD

    • Also vary other parameters (# instances?)
    • Try inducing some load on the running VNF
  • ....

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.