Giter Club home page Giter Club logo

xg2xg's Introduction

A handy lookup table of similar technology and services to help ex-googlers survive the real world :) pull-requests very welcomed. Please do not list any confidential projects!

For a working example of (some) of these technologies integrated together, see: https://github.com/google/startup-os

See also: System Design Primer, The Hadoop Ecosystem Table, Map AWS services to GCP products

Technology

Core Technology

Google Internal Google External Open Source / Real-World
MapReduce Apache Hadoop, Spark
Protocol Buffer Protobuf Cap'n Proto, Thrift, Avro, Amazon Ion
Stubby gRPC Thrift, Bolt
Chubby Apache Zookeeper, etcd, HashiCorp Consul
? Apache Kafka, Apache Pulsar, Facebook LogDevice

Infrastructure

Google Internal Google External Open Source / Real-World
Borg Kubernetes, Apache Mesos, HashiCorp Nomad
GSLB (load balancer) ELB, HAProxy, Istio, F5, envoy
data center hardware open compute

Storage

Google Internal Google External Open Source / Real-World
GFS/Colossus HDFS, Ceph, GlusterFS
BigTable Cloud BigTable PrestoDB, Cassandra, HBase, Accumulo, DynamoDB
Spanner Cloud Spanner Vitess, CockroachDB, TiDB
ColumnIO / Capacitor Apache Parquet
sstable levelDB RocksDB
zippy Snappy lz4

Services

Google Internal Google External Open Source SaaS
Dremel BigQuery Apache Drill, Presto, Spark(sort-of), AWS Athena, Redshift Spectrum
Dremel UI Redash, Metabase, Apache Superset
Search (Mustang, Alexandria) Elasticsearch, Solr, Lucene algolia
pubsub pubsub NATS.io, RabbitMQ, PubNub AWS SQS/SNS, AWS AppSync
Flume (Java) Apache Beam Apache Crunch

DevOps

Google Internal Google External Real-World
Assimilator Dominator
Blaze Bazel Buck, Pants, please.build
Oncall PagerDuty, OpsGenie, VictorOps
varz/borgmon Datadog, Prometheus, librato, newrelic, skylight, scout, Scotty/tricorder, also this and this
Exception/Error Tracking (??) Sentry.io, Raygun.io, Rollbar, Honeybadger, Airbrake, OverOps
styleguides google styleguides PEP-8, HoundCI auto-style-reviewer
blaze test / build / CI Cloud Build buildkite, CircleCI, travis, jenkins, gitlabCI
continuous delivery / releasing Spinnaker, lambdaCD, screwdriver.cd, CodeShip, shipit-engine, GoCD, AWS CodeDeploy, Capistrano, Fabric, ConcourseCI
borg / borgcfg / gcl AWS Cloudformation, Puppet, Chef, Salt, Ansible, Terraform, Jsonnet, kubecfg
logging StackDriver logstash, fluentd, papertrail, cernan
CodeSearch Zoekt Sourcegraph, OpenGrok
Gerrit, Mondrian etc. Gerrit Reviewable
cider Eclipse Che, Cloud9, gitpod.io
buganizer JIRA, bugzilla, github issues
ToTT Google Test Blog

Security

Google Internal Google External Open Source
prodaccess Keymaster
prod secrets/identity management chamber, knox, SPIFFE

IT / Operations

Google Internal Real-World
software engineering at google
valentine 1Password, Lastpass, pass
OWNERS files in repo github CODEOWNERS
snippets Khan/snippets
memegen memegen
edge, people ops training LifeLabs
googlegeist Culture Amp, humu
stuff (SaaS IT management) intello, zylo
stuff (Device Management) Fleetsmith, jamf, rippling IT
go/ links golinks, go

also check out xoogler.co, which organizes events, slack channels etc

disclaimer: I'm not affiliated with any of the technologies mentioned above.

disclaimer: I left Google a number of years ago so some of the naming might be dated

xg2xg's People

Contributors

adamyi avatar appwiz avatar artemg avatar brcooley avatar brian-brazil avatar brianr avatar dadgar avatar derekcollison avatar forwidur avatar gottwald avatar gtirloni avatar hanwen avatar iandioch avatar iawia002 avatar jacktuck avatar jankeromnes avatar jhuangtw avatar jhuangtw-dev avatar mexisme avatar minhaz avatar morgante avatar nh2 avatar pbiggar avatar phasmal avatar rgooch avatar sbrother avatar sqs avatar thomas4019 avatar yuikns avatar zellyn avatar

Watchers

 avatar  avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.