Giter Club home page Giter Club logo

comboami's Introduction

Summary

DataStax's Amazon Machine Image is the quickest way to get a DataStax Community or DataStax Enterprise cluster up and running on EC2.

Quickstart

Use cassandralauncher as found and documented here: https://github.com/joaquincasares/cassandralauncher

This will ensure all options are processed correctly and easily.

Options

##Basic AMI Switches:

--clustername <name>
    The name of the Cassandra cluster
    REQUIRED

--totalnodes <#>
    Cluster size
    REQUIRED

--version [ community | enterprise ]
    Installs either DataStax Enterprise or
    DataStax Community Edition
    REQUIRED

##DataStax Enterprise Specific:

--username <user>
    The username provided during DSE registration
    --password is REQUIRED in order to use this option
    REQUIRED for a DSE installation

--password <pass>
    The password provided during DSE registration
    --username is REQUIRED in order to use this option
    REQUIRED for a DSE installation

--analyticsnodes <#>
    Number of analytics nodes that run with Hadoop
    Default: 0

--searchnodes <#>
    Number of search nodes that run with Solr
    Default: 0

##Advanced:

--release <release_version>
    Allows for the installation of a previous DSE version
    Example: 1.0.2-1
    Default: Ignored

--cfsreplicationfactor <#>
    The CFS replication factor
    Note: --cfsreplicationfactor must be <= --analyticsnodes
    Default: 1

--opscenter no
    Disables the installation of OpsCenter on the cluster
    Default: yes

--reflector <url>
    Allows you to use your own reflector
    Default: http://reflector2.datastax.com/reflector2.php

Ports Needed

Public Facing:
    SSH:
        22: Default SSH port
    DataStax Enterprise Specific:
        8012: Hadoop Job Tracker client port
        8983: Portfolio Demo and Solr website port
        50030: Hadoop Job Tracker website port
        50060: Hadoop Task Tracker website port
    OpsCenter:
        8888: OpsCenter website port
Intranode:
    Cassandra:
        1024+: JMX reconnections
        7000: Cassandra intra-node port
        7199: Cassandra JMX monitoring port
        9160: Cassandra client port
    DataStax Enterprise Specific:
        9290: Hadoop thrift port
    OpsCenter:
        50031: OpsCenter job tracker proxy
        61620: OpsCenter intra-node monitoring ports
        61621: OpsCenter agent port

Step-by-step

Visit http://www.datastax.com/ami for full installation instructions.

Post-install

To stop the service, simply run

sudo service <cassandra | dse> stop

To start the service again, simply run

sudo service <cassandra | dse> start

Implementation details

See FILES.txt for a description of how the scripts here configure the AMI.

Upgrading

  1. Backup all the data on all your nodes using the snapshot utility. This provides you with the easiest way to revert any unwanted changes or incompatibilities that may arise. See the DataStax documentation for more information.
  2. On each of your Cassandra nodes, run sudo apt-get install [ cassandra | apache-cassandra1 | dse-full ], depending on which version you were currently on and want to upgrade to.
    • cassandra upgrades to the latest in 0.8.x release.
    • apache-cassandra upgrades to the latest in the 1.0.x release.
    • dse-full upgrades to the latest DataStax Enterprise release.
    • If you are trying to upgrade across major versions, make sure to read NEWS.txt on the newer packages and consult DataStax documentation for full details for upgrading packaged releases. Typically a new repository must be added followed by a sudo apt-get update.
  3. Account for New and Changed Parameters in cassandra.yaml. If the default Cassandra configuration file has changed, you will find backups of it in the conf directory. You can use that to compare the two configurations and make appropriate changes.
  4. Make sure any client drivers โ€“ such as Hector or Pycassa clients โ€“ are compatible with your current version.
  5. Run nodetool drain to flush the commit log and then restart each Cassandra node, one at a time, monitoring the log files for any issues.
  6. After upgrading and restarting all Cassandra nodes, restart client applications.
  7. [Upgrading from 0.8 to 1.0] After upgrading, run nodetool scrub against each node before running repair, moving nodes, or adding new ones.

Branching details

Feel free to fork off this project and offer any suggestions that you find along the way.

Also, if you're interested in the whole process: read up on the saving process here: http://www.datastax.com/dev/blog/personalizing-your-own-brisk-ami

comboami's People

Contributors

joaquincasares avatar rsutton avatar canausa avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.