This project contains a 10-tier microservices application. The application is a web-based e-commerce app called “Hipster Shop” where users can browse items, add them to the cart, and purchase them.
Google uses this application to demonstrate use of technologies like Kubernetes/GKE, Istio, and gRPC. This application works on any Kubernetes cluster (such as a local one), as well as Google Kubernetes Engine. It’s easy to deploy with little to no configuration.
If you’re using this demo, please ★Star this repository to show your interest!
Home Page | Checkout Screen |
---|---|
Hipster Shop is composed of many microservices written in different languages that talk to each other over gRPC.
Find Protocol Buffers Descriptions at the ./pb
directory.
Service | Language | Description |
---|---|---|
frontend | Go | Exposes an HTTP server to serve the website. Does not require signup/login and generates session IDs for all users automatically. |
cartservice | Go | Stores the items in the user's shopping cart in Redis and retrieves it. |
productcatalogservice | Go | Provides the list of products from a JSON file and ability to search products and get individual products. |
currencyservice | Go | Converts one money amount to another currency. Uses real values fetched from European Central Bank. It's the highest QPS service. |
paymentservice | Go | Charges the given credit card info (mock) with the given amount and returns a transaction ID. |
shippingservice | Go | Gives shipping cost estimates based on the shopping cart. Ships items to the given address (mock) |
emailservice | Go | Sends users an order confirmation email (mock). |
checkoutservice | Go | Retrieves user cart, prepares order and orchestrates the payment, shipping and the email notification. |
recommendationservice | Go | Recommends other products based on what's given in the cart. |
adservice | Java | Provides text ads based on given context words. |
loadgenerator | Python/Locust | Continuously sends requests imitating realistic user shopping flows to the frontend. |
- Kubernetes/GKE: The app is designed to run on Kubernetes (both locally on "Docker for Desktop", as well as on the cloud with GKE).
- gRPC: Microservices use a high volume of gRPC calls to communicate to each other.
- Istio: Application works on Istio service mesh.
- Skaffold: Application is deployed to Kubernetes with a single command using Skaffold.
- Synthetic Load Generation: The application demo comes with a background job that creates realistic usage patterns on the website using Locust load generator.
We offer the following installation methods:
-
Running locally (~20 minutes) You will build and deploy microservices images to a single-node Kubernetes cluster running on your development machine. There are two options to run a Kubernetes cluster locally for this demo:
- Minikube. Recommended for the Linux hosts (also supports Mac/Windows).
- Docker for Desktop. Recommended for Mac/Windows.
-
Running on Google Kubernetes Engine (GKE)” (~30 minutes) You will build, upload and deploy the container images to a Kubernetes cluster on Google Cloud.
💡 Recommended if you're planning to develop the application or giving it a try on your local cluster.
-
Install tools to run a Kubernetes cluster locally:
- kubectl (can be installed via
gcloud components install kubectl
) - Local Kubernetes cluster deployment tool:
- Minikube (recommended for Linux).
- Docker for Desktop (recommended for Mac/Windows): It provides Kubernetes support as noted here.
- skaffold (ensure version ≥v0.20)
- kubectl (can be installed via
-
Launch the local Kubernetes cluster with one of the following tools:
-
Launch Minikube (tested with Ubuntu Linux). Please, ensure that the local Kubernetes cluster has at least:
- 4 CPU's
- 4.0 GiB memory
To run a Kubernetes cluster with Minikube using the described configuration, please run:
minikube start --cpus=4 --memory 4096
- Launch “Docker for Desktop” (tested with Mac/Windows). Go to Preferences:
- choose “Enable Kubernetes”,
- set CPUs to at least 3, and Memory to at least 6.0 GiB
- on the "Disk" tab, set at least 32 GB disk space
-
-
Run
kubectl get nodes
to verify you're connected to “Kubernetes on Docker”. -
Make sure you have
istio
running in your cluster already withJaeger
add-on.- Install and run Istio. Only follow up to the 'Install Istio' step. Don't deploy their sample application.
- Install Jaeger
-
Run
deploy.sh
(first time will be slow, it can take ~20 minutes).- First, this script sets the Docker env to that of minikube.
- Second, it builds all Docker images.
- Third, it will run skaffold to deploy the built Docker images to minikube.
- It will most likely encounter an error deploying the services due to timeout exception. Don't worry about this. It takes a bit for the services to start up in Kubernetes.
-
Run
kubectl get pods
to verify the Pods are ready and running. -
To check out traces, run
istioctl dashboard jaeger
-
To check out the application frontend:
- Run
kubectl get services | grep frontend
to get the frontend node port. - Run
minikube ip
to get the ip address of your minikube cluster. - Go to http://$MINIKUBE_IP:$FRONTEND_PORT in your browser to see Hipster Shop.
- Run
-
Install tools to run a cluster on the GKE:
-
Create a new project for Google Kubernetes Engine
-
Run
gcloud init
to configure the GCloud SDK. -
Create a Google Kubernetes Engine cluster and make sure
kubectl
is pointing to the cluster.gcloud services enable container.googleapis.com
gcloud container clusters create demo --enable-autoupgrade \ --enable-autoscaling --min-nodes=3 --max-nodes=10 --num-nodes=5 --zone=us-central1-a
kubectl get nodes
-
Enable Google Container Registry (GCR) on your GCP project and configure the
docker
CLI to authenticate to GCR:gcloud services enable containerregistry.googleapis.com
gcloud auth configure-docker -q
-
Prepare the GKE cluster for
istio
.- Prepare GKE cluster for Istio. Skip the first step which sets up a new cluster. You can get the $CLUSTER_NAME, $ZONE and $PROJECT_ID from the Google Cloud CLI.
-
Make sure you have
istio
running in your cluster already withJaeger
add-on. You might have to update the Kubernetes master (from the GCloud webpage) for newer versions of Istio.- Install and run Istio. Only follow up to the 'Install Istio' step. Don't deploy their sample application.
- Install Jaeger
-
In the root of this repository, run
skaffold run --default-repo=gcr.io/[PROJECT_ID]
, where [PROJECT_ID] is your GCP project ID.This command:
- builds the container images
- pushes them to GCR
- applies the
./kubernetes-manifests
deploying the application to Kubernetes.
If this command fails, try re-running it! Also, sometimes this command fails but ends up setting up the pods and deployments.
Troubleshooting: If you get "No space left on device" error on Google Cloud Shell, you can build the images on Google Cloud Build: Enable the Cloud Build API, then run
skaffold run -p gcb --default-repo=gcr.io/[PROJECT_ID]
instead. -
Check if all the pods are running.
kubectl get pods
-
Find the IP address of your application, then visit the application on your browser to confirm installation.
kubectl get service frontend-external
-
To check out traces, run
istioctl dashboard jaeger
Note, you can view each trace as a JSON file and save it.
When making code changes to a specifc service you need to rebuild the docker image. Then you have to delete the Kubernetes pod with that is running the service so that when it rescales the deployment, it grabs the new docker image.
If you've deployed the application with skaffold run
command, you can run
skaffold delete
to clean up the deployed resources.
If you've deployed the application with kubectl apply -f [...]
, you can
run kubectl delete -f [...]
with the same argument to clean up the deployed
resources.
- Google Cloud Next'18 London – Keynote showing Stackdriver Incident Response Management
- Google Cloud Next'18 SF
- Day 1 Keynote showing GKE On-Prem
- Day 3 – Keynote showing Stackdriver APM (Tracing, Code Search, Profiler, Google Cloud Build)
- Introduction to Service Management with Istio
- KubeCon EU 2019 - Reinventing Networking: A Deep Dive into Istio's Multicluster Gateways - Steve Dake, Independent
This is not an official Google project.