Giter Club home page Giter Club logo

js-spark's Introduction

What is JS-Spark

Distributed real time analytics using JavaScript. JavaScript re imagine of fabulous Apache Spark and Storm projects.

If you know underscore.js or lodash.js you may think of JS-Spark as distributed version of them.

If you know Distributed-RPC systems like storm you will feel like home.

Why

Hadoop is quite slow and requires maintaining cluster - we want to do better. Imagine that theres no need to setup expansive cluster/clud solutions. Use webrowsers! Easily scale to multiple clients. Clients do not need to install anything like Java or other plugins.

Setup in mater of minutes and you are good to go.

Possibilities are endless:

No need to setup expensive cluster. The setup takes 5 min and you are good to go. You can do it on one machine. Even on Raspberry Pi

  • Use as CDN ... Today most websites runs slower with more clients use them. But using JSpark you can totally reverse this trend. Build websites that run FASTER the more people use them

  • Use as ML tool may process in real time huge streams of data... while all clients still browse their favorite websites

  • Use as Big data analytics. Connect to Hadoop HDFS and process even terabytes of data.

  • Use to safely transfer huge ammount of data to remote computers.

  • Synchronize data between multiple smartphones.. even in Africa

  • No expensive cluster setup required!

  • Free to use.

How(Getting started)

Prerequisites, install any! server (ex: Node.js), then:

run `npm install`

Proof Of Concept(POC):

    nodemon server.js
    nodemon client.js

Start on your machine and see how the clients do all calculation.

For the Web Application:

run `node serverExpress.js`

wait for clients to do all heavy lifting

More references

This project is about to reimplemented some nice things from the world of big data, so there are of course some nice resources you can use to dive into the topic:

js-spark's People

Contributors

syzer avatar kichooo avatar pfiver avatar

Stargazers

 avatar

Watchers

James Cloos avatar  avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.