Giter Club home page Giter Club logo

kerberos_and_hadoop's Introduction

Hadoop and Kerberos: The Madness beyond the Gate

The most merciful thing in the world, I think, is the inability of the human mind to correlate all its contents. We live on a placid island of ignorance in the midst of black seas of infinity, and it was not meant that we should voyage far. The sciences, each straining in its own direction, have hitherto harmed us little; but some day the piecing together of dissociated knowledge will open up such terrifying vistas of reality, and of our frightful position therein, that we shall either go mad from the revelation or flee from the light into the peace and safety of a new dark age.

The Call of Cthulhu, HP Lovecraft, 1926.

This manuscript discusses low-level issues related to Apache™ Hadoop® and Kerberos

Disclaimer

Just as the infamous Necronomicon is a collection of notes scrawled in blood as a warning to others, this book is

  1. Incomplete.
  2. Based on experience and superstition, rather than understanding and insight.
  3. Contains information that will drive the reader insane.

Reading this book implies recognition of these facts and that the reader, their estate and their heirs accept all risk and liability. The author is not responsible if anything happens to their Apache Hadoop cluster, including all the data stored in HDFS disappearing into an unknown dimension, or the YARN scheduler starting to summon pre-human deities.

You have been warned

Implementation notes.

  1. This is a work in progress book designed to built using the gitbook tool chain.

  2. It is hosted on github. Pull requests are welcome.

  3. All the content is Apache licensed.

  4. This is not a formal support channel for Hadoop + Kerberos problems. If you have a support contract with Cloudera then issues related to Kerberos may eventually reach the author. Otherwise: try

  5. The author is very much not a Kerberos expert, so (a) he can be wrong and (b) asking hard questions about it will generally get a "I have no idea whatsoever" answer.

kerberos_and_hadoop's People

Contributors

aloklal99 avatar busbey avatar chuckleberryfinn avatar darabos avatar hyukjinkwon avatar joshelser avatar steveloughran avatar vipinrathor avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

kerberos_and_hadoop's Issues

UGI chapter ends with unfinished sentence

Here the variable userFS contains a client of the Hadoop Filesystem with the home directory and access rights of the user user. If the user identity had come in via an RPC call, they'd

They'd what? That is exactly the use case I am interested in! 😃 Thanks for the book, looks like a great resource.

duplicate chapter - hdfs bootstrap

Hi Steve,

thanks for this book, it's just what I needed :)
I'm working on a pull request, but this seems more like a "issue", since this block (HDFS Boostrap)
seems identical to the one a few paragraphs above:

  1. NN reads in a keytab and initializes itself from there (i.e. no need to kinit; ticket
    renewal handed by UGI).
  2. Generates a Secret

Delegation tokens in the NN are persisted to the edit log, the operations OP_GET_DELEGATION_TOKEN
OP_RENEW_DELEGATION_TOKEN and OP_CANCEL_DELEGATION_TOKEN covering the actions. This ensures
that on failover, the tokens are still valid

Also it seems to contain a typo in the title that I've just noticed.
"Boostrap" -> "Bootstrap".

Cheers,
Camypaj

confusing/incomplete sentence

Hi again Steve,
I find this sentence confusing:

Isolate the Hadoop cluster from the rest of your network infrastructure, apart from some "edge" nodes, so that only processes running in the cluster.

I assume there are some words missing, but that depends on what you wanted to say.

Regards,
Camypaj

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.