Giter Club home page Giter Club logo

nifi_autodeploymentscript's Introduction

Nifi

AUTODEPLOYMENTSCRIPT:

This powerShell script lets you deploy nifi data flows into various environment. It uses Nifi-Registry and Nifi-Toolkit to deploy the flows. If deployment fails for any reason, script has smtp setup to send emails. One needs to add the setup parameters for it in the script.

#DESCRIPTION :

#ScriptParameters:

#PARAMETER env:

Accepted values prod,qa,stage Environement where the flow is to be deployed

#PARAMETER tp:

Optional parameter. path to nifi toolkit

#PARAMETER flow:

Name of the data flow (same as the one in the registry) to be deployed

#PARAMETER fv:

Optional parameter. Version number to be deployed. If not provided it will deploy latest version

#PARAMETER r:

Optional parameter. Path to nifi registry instance

#PARAMETER u:

Optional parameter. Path to nifi (link to nifi instance) where the flow is to be deployed eg http://Fake-Prod-Nifi:8080

#PARAMETER fp:

Optional parameter. Path to nifi variable properties json file based on environment default path is NifiEnvironmentProperties directory

#EXAMPLE:

C:\PS> .\AutoDeployment.ps1 -env prod -flow DataTransform 

#FURTHERHELP:

Script is properly commented for better understanding.

#FLOW VARIABLES:

One needs to replicate properties file in NifiEnvironmentProperties directory for respective enviornment. The name should be in the customProperties_env.json format. (replace env with dev,prod,stage,qa etc). The sample file customProperties_dev.json contains setup variables for SMTP processor, PutSNS processor and DBCPConnectionPool controller service . Each json key should exactly match the processor variable names in nifi flow.

#SCRIPT:

The script restricts deployment to various environment from the specific environment . Example dev will always be deployed to QA, QA will be deployed to stage and stage to prod resply.

#REGISTRY BUCKET NAMES:

The from environment variable fromEnv in script should match exactly with the bucket name in registry. (Update it as per ur bucket names)

Update NifiEnvironmentProperties -fp directory path inside script to the directory it is saved in or pass it as an argument. Also update the toolkit and registry paths. (Make sure all the defaults are updated to specific values)

#ASSUMPTIONS:

This script assumes you have Nifi Registry instance running and minimally the dev environment has the nifi-registry client setup. All the higher environments , if the client is not set up the script will try to set it up while trying to deploy.

nifi_autodeploymentscript's People

Contributors

anp8729 avatar

Stargazers

Prashant Singh avatar  avatar  avatar Steven Matison avatar Monica Ruttle avatar Timothy Spann avatar Ruthraiah Thulasi avatar Dale McCrory avatar

Watchers

 avatar

nifi_autodeploymentscript's Issues

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.