Giter Club home page Giter Club logo

clouddataverse's Introduction

Cloud Dataverse

Getting Started

Following this setup guide will get you a running CloudCompute UI for development or testing.

Prerequisites

Node, NPM, MongoDB, Bower

apt-get update
apt-get install nodejs
apt-get install npm
npm install -g bower

For installing MongoDB, please refer to their official documentation: Installing Mongo on Ubuntu 16.04

Installing

Clone the CloudCompute UI repository to your instance

git clone https://github.com/BU-CS-CE-528-2017/CloudDataverse

Ensure MongoDB is running on your instance before continuing (refer to prior instructions if necessary) and you are in the CloudDataverse directory.

cd CloudDataverse/mean
npm install
node server.js

This will run CloudCompute locally on localhost port 3000 by default.

http://localhost:3000/

Dataverse

Pull the Cloud Dataverse branch of Dataverse to your repository

git pull https://github.com/Allegro-Leon-Li/dataverse.git

Use the branch 4.5-export-harvest-swift-update

For completing the Dataverse installation, please refer to swift_setup.txt in the Dataverse repository above and their official documentation: Dataverse Installation

Use and Limitations

Assuming your Dataverse instance is correctly installed, you can begin uploading datasets for testing. Files are deposited to the Swift object store in your OpenStack project. Container names in Swift will match the dataset name in Dataverse.

Datasets from Dataverse are added to your 'compute batch' when the 'Add to Compute Batch' option is selected. Please note, multiple datasets can be added to your 'compute batch.' When ready, click the 'Compute Batch' button at the top of the page, this will redirect you to CloudCompute. Login with your OpenStack credentials and begin selecting your desired datasets.

At this time, CloudCompute only successfully completes jobs with Hadoop MapReduce. Additional work on our end is required before Spark and Storm will be operational with CloudCompute.

Authors

Video Demonstrations

Final Presentation

UI/UX Demonstration

Sprint 2

Sprint 3

Sprint 4

clouddataverse's People

Contributors

allegro-leon-li avatar benpcorn avatar snehha avatar willnorman avatar

Stargazers

 avatar  avatar

Watchers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Forkers

snehha willnorman

clouddataverse's Issues

Validation for Cluster Name

OpenStack does not allow dashes, periods, or underscores for template names. UI should provide validation for this requirement. The Horizon UI does not already implement validation, rather it makes the request and then throws an error if the name is non-compliant.

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.