An ansible playbook to deploy Cloudera Hadoop components to the cluster

The playbook is composed according to official cloudera guides with a primary purpose of production deployment in mind. High availability for HDFS and Yarn is implemented when a sufficient number of resources(hosts) is configured. From the other side, all of the components can be also deployed on a single host.

• hadoop hdfs
• hadoop yarn mapreduce
• zookeeper
• hive
• hbase
• impala
• solr
• spark
• oozie
• kafka
• hue
• postgresql

The configuration is very simple:

It’s only required to place hostname(s) under the appropriate groups in the hosts file, and the required services will be setup.

The playbook contain all configuration files in roles directories. If you need to add or change any parameter you can edit the required configuration file which can be found in roles/service/[files|templates] directory.

The playbook runs configuration check tasks at start, and will stop if the configuration is not supported, providing a descriptive error message.

Besides of cluster( or single host ) setup, the playbook also generates a cluster manager configuration file located at workdir/services.xml. Please visit clinit manager home page and see manual . The rpm package can be downloaded from clinit-1.0-ssv1.el6.noarch.rpm. After clinit package installed you’ll be able to stop, start and see status of services on any node.

Service configuration performed using the hosts file. The empty hosts file is supplied with playbook. You must not remove any existing group. Leave the group empty if you don't need services the group configures. The same hostname can be placed to any hosts group. As an instance if you want setup everything on one host, just put the same hostname to each hosts group.

• [namenodes] : configures namenode services, at least 1 host is required, 2 hosts are allowed. HA HDFS with automatic namenode failover will be configured in the case of 2 hosts configured.
• [datanodes] : configures datanode services, at least 1 host is required.
• [yarnresourcemanager] : configures mapreduce yarn resource manager, at least 1 host is required. HA with automatic resource manager failover will be configured in the case more than 1 host provided. job history server will be configured on the 1st host in the group. node manager services will be configured on [datanodes] hosts.
• [zookeepernodes] : confiugures zookeeper services. 3 or 5 hosts is required for HA in the case 2 [namenodes] hosts configured.
• [journalnodes] : configures journalnode services required for HA configuration, at least one host is required in the case 2 [namenodes] hosts configured.
• [postgresql] : configures postgresql server. the server provides a database storage required for other services( see below ). 1 host is allowed.
• [hivemetastore] : configures hive metastore and hiveserver2 services. 1 host is allowed. [postgresql] host is required for metadata storage.
• [impala-store-catalog]: configures impala-catalog and impala-state-store services. 1 host is allowed. impala-server will be configured on each [datanodes] host. [hivemetastore] host is required for metadata storage.
• [hbasemaster]: configures hbase-master services. 1 host is allowed. hbase-regionserver will be configured on on each [datanodes] host. at least 1 [zookeepernodes] host is required.
• [solr]: configures solr service. at least 1 [zookeepernodes] host is required.
• [spark]: configures hosts to submit spark jobs. spark history server will be configured on the first host in the group.
• [oozie]: configures oozie service. [postgresql] host is required for data storage.
• [kafka]: configures kafka-server service. at least 1 [zookeepernodes] host is required.
• [hue]: configures hue services. [oozie] host is required to submit jobs. [postgresql] is required for data storage.
• [dashboard]: places a simple static dashboard with links to all other services on mentioned hosts. See dashboard below.

Please see group_vars

To start deployment run:

ansible-playbook -i hosts site.yaml

if you have installed clinit you can also run:

clinit -S workdir/services.xml status
clinit -S workdir/services.xml tree

To deploy configuration on existing cluster:

ansible-playbook -i hosts --skip-tags=init,postgresql site.yaml

• package : install rpm packages
• init : clean up and initialize data
• config : deploy configuration files, useful if you want just change configuration on hosts.
• test : run test actions
• check : check hosts configuration

Also most hostgroups have the tag with similar name.

Playbook optionaly provides syslog-ng configuration and snmp-subagent configuration.

To use syslog-ng:

• set variable enable_syslog to true;
• set variable syslog_ng_destination to existing syslog-ng destination(default value is d_logcollector_throttled).

To use snmp set enable_snmp to true and put following packages to repository:

• net-snmp-subagent-shell
• hadoop-monitoring-utility

The dashboard consists of 5 static files and is placed into /var/html/dashboard by default. Most of services should be available in a frame on the right. But Solr and some others set X-Frame-Options header which denies embedding them into an iframe. If a service opens a white page for you - try opening it in a new tab with middle mouse button.

Ansible 1.9.4 is required. Please read official documentation to install it. Please note that Ansible 2.0 has introduced incompatible and undocumented changes which is not supported by the playbook at the time being, so please strictly follow the provided (official) documentation links.

OS version: Redhat/CentOS 6, 7

Cloudera Hadoop version: 5.4 - 5.7

The requirements for the Cloudera Hadoop repositories has to be properly configured on the target hosts. See also official documentation

Java package(s) have to be available in the repository. You can download jdk-8u65-linux-x64.rpm from official oracle site

SSH key passwordless authentication must be configured for the root account for all target hosts.

se_linux must be disabled

remote_user = root must be configured for Ansible.

MIT