Giter Club home page Giter Club logo

data-collection's Introduction

data-collection CLI

A CLI for data-collection.

Running the CLI

$ yarn install
$ yarn start

Currently, this loads some transactions from the faucet account and writes a summary to ./transactions.csv

Publishing to NPM

To package your CLI up for NPM, do this:

$ npm login
$ npm whoami
$ npm lint
$ npm test
(if typescript, run `npm run build` here)
$ npm publish

Commands

data-collection ["dev" or "test"] maxPagesToRetrieve

This command fetches all transactions involving the faucet on either Testnet of Devnet. By default it looks at Testnet, but if you pass in the parameter "dev" as the first parameter, it will instead retrieve data from the Devnet faucet. Additionally you can specify the optional parameter of maxPagesToRetrieve if you do not want the complete recorded history from the ledger.

It then saves a shortened version of the data in testnet-transactions.csv or devnet-transactions.csv respectively. Note: Testnet and Devnet have online deletion, which means they only store about a month or two of transaction history. More on that here: https://xrpl.org/online-deletion.html

summarize-data ["dev" or "test"]

This command parses the data from data-collection into a readable format retrieving several interesting values:

  1. It creates a histogram of total transactions involving the faucet account (Grouped by day)
  2. It tries to find the most common destination address (Usually the faucet, but can be others!)
  3. If looking at Testnet data, it creates a histogram of transactions which look like they came from the Send XRP tutorial

The summary was mostly part of an exploratory effort to see what insights we could find from the data, and so may be extended or modified in the future based on what questions we are trying to answer.

License

MIT - see LICENSE

data-collection's People

Contributors

intelliot avatar jst5000 avatar

Watchers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.