Giter Club home page Giter Club logo

microservice-elk's Introduction

Creating microservice using Spring Boot, Eureka, Zuul, Sleuth, Zipkin and ELK Stack

Spring framework provides set of libraries for creating microservices in Java.

  • Zuul - gateway service that provides dynamic routing, monitoring, resiliency, security, and more
  • Eureka - service registration and discovery
  • Sleuth - distributed tracing via logs
  • Zipkin - distributed tracing system with request visualization
  • ELK Stack - We are using Logstash, Elastics Search and Kibana to index logs

About the example

  1. account :- Its a microservice, spring boot and sleuth is used to implement the same
  2. product :- its a microservice, spring boot and sleuth is used to implement the same
  3. apigateway :- its a API Gateway, spring Zuul is used to implement the same
  4. eureka-service :- its for service discovery and registration, spring Eureka is used to implement the same
  5. zipkin-service :- its for log tracking, spring zipkin is used to implement the same

Technologies/dependencies

  1. Java 8
  2. Spring boot, sleuth, zipkin, eureka
  3. ELK - Elastics search, logstash and Kibana

Why do we need ELK Stack

With use of microservices, we are able to create stable distributed applications. But it has also introduced few challenges in other areas e.g. distributed log management and ability to view logs of full transaction distributed among many services and distributed debugging in general.

As the number of microservice increases and we enable cloud deployment with automated continuous integration tools, it is very much necessary to have some provision of debugging the components when we have any problem, we have a tool called Elastics Search, Logstash and Kibana

ELK Stack

  1. Elastics Search is a distributed, JSON-based search and analytics engine designed for horizontal scalability, maximum reliability, and easy management.
  2. Logstash is a dynamic data collection pipeline with an extensible plugin ecosystem and strong Elasticsearch synergy.
  3. Kibana gives the visualization of data through a UI.

ELK Stack Architecture

alt text

ELK Configuration

We will use Docker container to run the ELK Stack

  1. Run this command on the docker terminal.

    • docker run -d -it --name es -p 9200:9200 -p 9300:9300 -e ES_JAVA_OPTS="-Xms1g -Xmx1g" -m 1500m elasticsearch

    This command will start elastics search container on 9200/9300 port

    • docker run -d -it --name kibanak --link es:elasticsearch -p 5601:5601 kibana

    This command will start Kibana on 5601 port and it will also link it with elastics search container

    • docker run -d -it --name logstash -p 5000:5000 logstash -e 'input { tcp { port => 5000 codec => "json" } } output { elasticsearch { hosts => ["192.168.99.100"] index => "micro-%{serviceName}"} }'

    This command will start Logstash container on 5000 port and it will also create an index with name micro-*

  2. Checking with docker ps command, all their container should be running alt text

  3. Default port used for docker container is 192.168.99.100

Creating Micro Service

Spring Zuul, eureka flow

alt text

These are the default ports used for the services in this example

  1. account :- 8080
  2. product :- 9090
  3. apigateway :- 8765
  4. eureka-service :- 8761
  5. zipkin-service :- 9411

Download the the services and import it to Eclipse or any Id

Run all the services one by one and make sure all the services are running, you need to run product and account microservice with multiple ports e.g. spring-boot:run -Dserver.port=8080, spring-boot:run -Dserver.port=8081

  1. Open the Eureka Service (its running on port 8761)

    • Here we observed that two microservice (Account and Product) is registered with different ports alt text
  2. Try to Access to access account service http://localhost:8765/api/account/greeting

    • We will get response from Account Service
  3. Checking the log Traces on zipkin server http://localhost:9411/

    • here we can check all the log traces, in our example account microservice calls product microservice, so we can check here that which service took how much time etc. alt text
  4. Finally check logs on Kibana

    • In Kibana we can check every log from our microserivices
    • with simple Log.info statement and logback.xml configuration we can index and view log on Kibana

logger.info(" inside getproductdetails Micro service ");

please check logback.xml (in account and product) for more details

alt text

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.