Giter Club home page Giter Club logo

backup's Introduction

uc-hadoop-platform

命令行安装步骤:

  1. git clone到机器上

  2. 修改conf中的配置文件,其中几个关键的修改地方

    • conf/group_vars/all:

      • ssh配置

        ansible_ssh_port ssh端口 ansible_sudo_pass 用户sudo的密码

      • java安装包配置(如果已经安装sun的java1.6以上,可以忽略)

        #安装包位置 java_tar: /home/xxx/xx/jdk1.6.0_45.tar.gz #解压后的目录名称 java_untar_floder: jdk1.6.0_45

      • 机器目录配置

        dfs_datanode_data_dir为datanode的默认数据目录 yarn_nm_local_dirs为yarn的nodemanager的本地数据目录 yarn_nm_log_dirs为yarn的nodemanager的本地日志目录

        由于实际生产环节中,根据磁盘目录不同这3个的目录都不尽相同。 所以可以通过组变量或者机器变量实现覆盖。 详情可参考: Inventory

      • 机器角色配置

        conf/hosts:里面定义了大量的机器组的角色请按照实际情况修改 如果没有对应的角色可以留空,请不要删除该分组

  3. 运行bin/setup_ansible.sh 安装ansible。并创建软连接,将/etc/ansible连接到本项目的conf/ansible

  4. 如果要安装本地仓库,请参看下文安装本地仓库

  5. 分发仓库文件 ansible-playbook ansible/prepare/depoly_repo.yml

  6. 安装基本配置(ulimit安装 java安装) ansible-playbook ansible/prepare/prepare.yml

  7. 安装

     ansible-playbook ansible/service/setup_zookeeper.yml
     ansible-playbook ansible/service/setup_hadoop.yml
     ansible-playbook ansible/service/setup_hbase.yml
     ansible-playbook ansible/service/setup_hive.yml
     ansible-playbook ansible/service/setup_client.yml
    
  8. 配置部署

     ansible-playbook ansible/service/conf_hadoop.yml
     ansible-playbook ansible/service/conf_hbase.yml
     ansible-playbook ansible/service/conf_hive.yml
     ansible-playbook ansible/service/conf_client.yml
    
  9. 初始化脚本

     ansible-playbook ansible/service/init_hdfs.yml //初始化文件系统的目录
     ansible-playbook ansible/service/init_hive.yml //初始化hive的mysql
    
  10. 服务启动脚本

    详见各start和stop脚本
    
  11. 安装本地仓库:

    运行ansible-playbook uhp/ansible/prepare/create_local_repo.yml
    会下载RPM包,并放入到指定的http的root目录。
    

backup's People

Contributors

qus-jiawei avatar

Watchers

James Cloos avatar  avatar

Forkers

sdgdsffdsfff

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.