Giter Club home page Giter Club logo

log-analytics-starter-kit's Introduction

Slack Status

Tinybird Log Analytics Starter Kit

Data can help developers build better software, but it can be hard to find data tools that are easy to integrate, scale with you as you grow, and are flexible enough to meet different demands. This Stater Kit provides an example for you can build your own logging & telemetry solution powered by Tinybird.

This is an opinionated Starter Kit that uses Web Applications as the example, but you can use this kit to bootstrap logging for any software project. Take this kit and make it your own!

Tinybird Functions Analytics Dashboard

What's in the box?

This Starter Kit includes:

  • Tinybird data project
  • Analytics Dashboard built with Next.js & Tremor
  • Example Log Capture implementations
    • TypeScript & Next.js Logger + example Vercel functions
    • Python & FastAPI Logger

Tinybird Data Project

The Tinybird data project includes all of the Tinybird resources you need to ingest, analyze and publish your logs. This includes Data Sources, Pipes, Materialized Views, and APIs.

Tinybird Functions Analytics DataFlow

Analytics Dashboard

The Analytics Dashboard is an example of how of you can build your own frontend to visualize the data from Tinybird.

The dashboard is implemented using Next.js & Tremor. All of the charts on the dashboard consume data over the HTTP API Endpoints that are publish from Tinybird.

There is no caching or frontend magic, every chart is consuming live data in real time.

Tinybird Functions Analytics Dashboard

Example Log Capture

All examples of capturing logs use the Tinybird's Events API, sending logs as JSON via a standard HTTP POST request. Because this is simply JSON over HTTP, you can use this approach to integrate any framework, language or application to send data to Tinybird.

Each logger exposes 3 methods info, warn and error that can be used to capture log messages with different log levels. Each one in turn calls the log method, which captures additional information about the incoming request.

Note that each logger expects an Environment Variable TINYBIRD_TOKEN to authenticate the request to Tinybird. You can copy this token from your Tinybird account by logging into the Tinybird UI.

TypeScript & Next.js

In logger.ts you'll find a simple reference implementation for a log capture class in TypeScript. This is built with Next.js in mind, but could be adapted to any other framework.

Vercel Functions

An example Vercel Function is included at getProductExample.ts. This function simply demonstrates how to use the logger in a function.

Python & FastAPI

In logger.py you'll find a simple reference implementation for a log capture class in Python. This is built with FastAPI in mind, but could be adapted to any other framework.

FastAPI Endpoint

An example FastAPI Endpoint is included at main.py. This endpoint simply demonstrates how to use the logger in a function.

Deploy

There are two components to this Starter Kit that you need to deploy.

1. Tinybird Data Project

Use the button below to deploy this Starter Kit to Tinybird.

Deploy to Tinybird

2. Analytics Dashboard

Use the button below to deploy this Starter Kit to Vercel.

Deploy with Vercel

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.