Giter Club home page Giter Club logo

azure_monitor_poc's Introduction

Azure Monitor Proof of Concept with 3rd Party Cloud Provider

This solution demonstrates how data and metrics collected from a third-party cloud provider can be delivered to a Log Analytics Workspace for analysis using Azure Monitor's HTTP Data Collector API.

What problem does this solve?

Organizations strive to achieve a single pane of glass for monitoring across cloud services. Many of times this data is spread across cloud services making it challenging for operations to monitor the environment. The Azure Monitor HTTP Data Collector API provides a mechanism to deliver data from 3rd party cloud services or on-premises services to an Azure Log Analytics Workspace. Rich visualizations can then be created using Azure Monitor Log Analytics to achieve a single pane of glass view of an enterprise's environment.

The solution uses an AWS Lambda to gather information about access key usage and delivers that data to a Log Analytics Workspace in an Azure subscription. The data can then be visualized using Azure Monitor's Log Analytics.

Requirements

Python Runtime and Modules

AWS Permissions Requirement

  • IAM:ListUsers
  • IAM:ListAccessKeys
  • IAM:GetAccessKeyLastUsed
  • KMS:Decrypt and KMS:Encrypt for KMS key used to secure Lambda environment variables

Setup

The can be pushed using the provided CloudFormation template. The code must be placed into a ZIP file in an S3 bucket the user creating the CloudFormation stack has permissions to. The CloudFormation template requires the Workspace ID and Workspace Key from a Log Analytics Workspace in Azure.

azure_monitor_poc's People

Contributors

mattfeltonma avatar

Stargazers

 avatar  avatar

Watchers

 avatar

azure_monitor_poc's Issues

AWS Cloudwatch Lambda logs to Log Analytics

Hi Matt, @mattfeltonma
Thank you for the article you posted, I am in the process of collecting the AWS (Lambda function logs from AWS Cloudwatch) and I followed all the steps you mentioned in your article as Microsoft Article code on Pythin had flaws but your code had a fix in it. I have managed to get the sample code working, now the main core of how to get the Lambda function logs which are in Cloudwatch and convert them into Json is something I am stuck on and I thought of checking with you if you know a way out of it. Following screenshot of the log I am trying to pull for the sample Lambda function.
image

Any help on how I can do it, I have zero background on AWS and I mainly focus on Azure so dnt knw how to get this data back in Log analytics and hence my question may sound newbie cause I am literally in kinder garden of AWS school :).

Thank you,

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.