For exploring grants data using SQL queries in Postgres

• 🔭 Grants Data cache & ETL Pipeline
  • Table of Contents
  • 🚪 Introduction
  • 🏁 Quick start
    • PGAdmin
    • Metabase
  • 🪄 Run sample query
  • 💪🏾 Local Development
  • 😎 Contribute

This is a NodeJS/typescript ETL framework, powered by the Allo indexer data API. This ETL pipeline queries the Allo indexer data API and populates the existing Postgres db in docker (see docker-compose.yml file). Database schema is managed using Prisma (a Typescript ORM).

• Install Docker. Visit https://www.docker.com/ to install.

• After Docker installation, open Terminal to this repo location and run:

docker compose up

• Once all containers are running and healthy, open http://localhost:5555 to open PGAdmin.

• Login using default login details:

Email: [email protected]
Password: admin

• Load and configure your server:

• Once all containers are running and healthy, open http://localhost:3000 to open Metabase UI.

• Login using default login details:

Email: [email protected]
Password: password420

• Click on the Query tool (image below) and copy any sample query from ./queries 😉

You can modify the schema file (located at ./prisma/schema.prisma) as needed. To kick off indexing for a particular chain, you can run:

yarn run etl --chain [chainId]

Currently available chains are:

For more hands-on use cases like creating a custom ETL pipeline like indexing data from the blockchain via RPC using tools like chainsauce.

You can be a cool anon and send in a PR. If you have an SQL query that has helped you and you feel will be helpful to other Anons 👻 and explorers 🔭, feel free to fork this, add it to ./queries, and send in a PR.