Miscellaneous projects related to DevOps

1. Create a local monitioring and alerting environment
2. Components: Prometheus(monitoring), grafana(visualization), alertmanager(alerting)
3. Test "inhibit rules" to suppress child alerts. Eg: if CPU_utilization > 90% then CPU_utilization > 70% should not fire

1. Install the following on your local system
   1. docker
   2. docker-compose

1. mkdir monitoring_project && cd monitoring_project

2. git clone https://github.com/Oartihsin/Devops.git

   Changes to be made. File: alertmanager/alertmanager.yml

   1. lines 3,4 -> add sender's email (Try using gmail.com emails)
   2. line 5 -> sender's password
   3. line 30 -> receiver's email (Try using gmail.com emails)

3. run "docker-compose up -d"

4. Important urls :

   1. prometheus : http://localhost:9000
   2. grafana : http://localhost:3000
   3. alertmanager : http://localhost:9093

1. "docker ps" -> copy the container-id for node exporter
2. "docker exec -it sh" -> to get the shell for node exporter container
3. "dd if=/dev/zero of=/dev/null" -> manual convert and copy files
4. Take a new terminal tab
5. "docker stats" -> to check CPU utilization of all containers (check node-exporter)

1. You should receive mails for 2 alerts only

   1. InstanceDownCritical
   2. HostHighCpuLoad (this is for >90%)

2. Alerts ignored

   1. HostHighCpuLoad (this is for >70%)