Giter Club home page Giter Club logo

drsir-drl-routing-approach-for-sdn's Introduction

DRSIR_DRL_routing_approach_for_SDN

When the size of State and Action Spaces increases Reinforcement Learning (RL) algorithms may present limitations like the increase in the number of learning episodes that the RL-based agent needs to convergence. Such an increase in the learning process is due to the RL-based agent having to experience more state-action pairs iteratively to achieve a reliable estimation of the value for each state-action pair. Furthermore, RL algorithms could require huge storage space to maintain the experience information. In this vein, Deep Reinforcement Learning (DRL) that leverages both Deep Learning (DL) and RL techniques, arises to overcome RL limitations. DL enables RL to scale to previously intractable decision-making problems (i.e., settings with high-dimensional state and action spaces). Hence, DRL embraces the advantage of function approximators employed in DL to train the learning process and thereby to improve the learning speed and the performance of RL algorithms. Neural Networks (NN) are commonly used as function approximators for generalization of the knowledge acquired by visiting states to other states. The generalization of knowledge allows the agent to learn from a reduced number of interactions with the environment, and therefore the algorithm converges faster. Here, we present DRSIR, a DRL-based solution for routing in SDN that aims to provide intelligent routing while taking advantage of network-state information at the path-level metrics to explore, exploit and learn the best paths when making routing decisions. DRSIR leverages the global view and control of the network furnished by SDN and the interaction with the environment and intelligence provided \ac{DRL}. It computes and installs, in advance, optimal routes in the routing tables of the switches on the Data Plane. Results show that the stretch, link throughput, delay, and packet loss produced by DRSIR outperforms those given by Dijkstra's algorithms when delay, loss, and available bandwidth are individually or jointly used to compute optimal paths. DRSIR is also compared against performance produced by our RL version called RSIR, evincing an improvement regarding the performance metrics evaluated.

drsir-drl-routing-approach-for-sdn's People

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.