Topic: etl-pipeline Goto Github
Some thing interesting about etl-pipeline
Some thing interesting about etl-pipeline
etl-pipeline,An end-to-end data engineering pipeline that orchestrates data ingestion, processing, and storage using Apache Airflow, Python, Apache Kafka, Apache Zookeeper, Apache Spark, and Cassandra. All components are containerized with Docker for easy deployment and scalability.
User: airscholar
Home Page: https://www.youtube.com/watch?v=GqAcTrqKcrY
etl-pipeline,Implementing best practices for PySpark ETL jobs and applications.
User: alexioannides
etl-pipeline,Make stream processing easier! Easy-to-use streaming application development framework and operation platform.
Organization: apache
Home Page: https://streampark.apache.org/
etl-pipeline,Conductor OSS SDK for Python programming language
Organization: conductor-sdk
etl-pipeline, Ethereum Analytical Database - Ethereum data access solution that can be used for analytics and application development. The solution works on a fast DB - Clickhouse.
Organization: cyber-drop
Home Page: https://cyberdrop.ai
etl-pipeline,Hamilton helps data scientists and engineers define testable, modular, self-documenting dataflows, that encode lineage and metadata. Runs and scales everywhere python does.
Organization: dagworks-inc
Home Page: https://hamilton.dagworks.io/en/latest/
etl-pipeline,Data Engineering/Scraping Project. Creating a detailed Sports Relational Database for the Top European Soccer Leagues.
User: danielsaban
etl-pipeline,ETL pipeline for the Ethereum blockchain
Organization: dappboard
Home Page: http://dappboard.com
etl-pipeline,This is a template you can use for your next data engineering portfolio project.
Organization: data-engineering-community
Home Page: https://dataengineering.wiki
etl-pipeline,Flow PHP - data processing framework
Organization: flow-php
Home Page: https://flow-php.com
etl-pipeline,A library to accelerate ML and ETL pipeline by connecting all data sources
User: hifxit
etl-pipeline,Regular practice on Data Science, Machien Learning, Deep Learning, Solving ML Project problem, Analytical Issue. Regular boost up my knowledge. The goal is to help learner with learning resource on Data Science filed.
User: imsanjoykb
Home Page: https://imsanjoykb.github.io/
etl-pipeline,Watchmen Platform is a low code data platform for data pipeline, meta data management , analysis, and quality management
Organization: indexical-metrics-measure-advisory
Home Page: https://imma-watchmen.com/
etl-pipeline,seatunnel plugin developing examples.
Organization: interestinglab
etl-pipeline,Service for bulk-loading data to databases with automatic schema management (Redshift, Snowflake, BigQuery, ClickHouse, Postgres, MySQL)
Organization: jitsucom
Home Page: https://github.com/jitsucom/bulker
etl-pipeline,Near real time ETL to populate a dashboard.
User: josephmachado
Home Page: https://www.startdataengineering.com/post/data-engineering-project-to-impress-hiring-managers/
etl-pipeline,Project for "Data pipeline design patterns" blog.
User: josephmachado
Home Page: https://www.startdataengineering.com/post/code-patterns/
etl-pipeline,Jayvee is a domain-specific language and runtime for automated processing of data pipelines
Organization: jvalue
Home Page: https://jvalue.github.io/jayvee/
etl-pipeline,This repository will help you to learn about databricks concept with the help of examples. It will include all the important topics which we need in our real life experience as a data engineer. We will be using pyspark & sparksql for the development. At the end of the course we also cover few case studies.
User: martandsingh
etl-pipeline,A framework for moving data into a data warehouse.
Organization: massstreetanalytics
Home Page: http://www.datawarehouseetlframework.com/
etl-pipeline,csvplus extends the standard Go encoding/csv package with fluent interface, lazy stream operations, indices and joins.
User: maxim2266
etl-pipeline,Azure Data Factory Hands On Lab - Step by Step - A Comprehensive Azure Data Factory and Mapping Data Flow step by step tutorial
User: mmodarre
etl-pipeline,One ETL tool to rule them all
Organization: mobiletelesystems
Home Page: https://onetl.readthedocs.io/
etl-pipeline,implementing an end-to-end tweets ETL/Analysis pipeline.
User: mohamedhmini
etl-pipeline,Move your data with ease.
Organization: mycelial
Home Page: https://mycelial.com
etl-pipeline,Build data pipelines, the easy way 🛠️
Organization: orchest
Home Page: https://orchest.readthedocs.io/en/stable/
etl-pipeline,Data pipelines from re-usable components
Organization: patterns-app
etl-pipeline,A real-time streaming ETL pipeline for streaming and performing sentiment analysis on Twitter data using Apache Kafka, Apache Spark and Delta Lake.
User: pran4ajith
etl-pipeline,Portfolio of projects and studies conducted in data engineering.
User: razevedo1994
etl-pipeline,Real-Time Event Streaming & Change Data Capture
Organization: redis-field-engineering
Home Page: https://redis-field-engineering.github.io/redis-connect-dist/
etl-pipeline,an app engine for your business. Seamlessly implement business logic with a powerful API. Out of the box CMS, blog, forum and email functionality. Developer friendly & easily extendable for your next SaaS/XaaS project. Built with Rails 6, Devise, Sidekiq & PostgreSQL
Organization: restarone
Home Page: https://violet.restarone.solutions
etl-pipeline,Prism is the easiest way to develop, orchestrate, and execute data pipelines in Python.
Organization: runprism
Home Page: https://runprism.com
etl-pipeline,An end-to-end GoodReads Data Pipeline for Building Data Lake, Data Warehouse and Analytics Platform.
User: san089
etl-pipeline,Few projects related to Data Engineering including Data Modeling, Infrastructure setup on cloud, Data Warehousing and Data Lake development.
User: san089
etl-pipeline,A simple Spark-powered ETL framework that just works 🍺
Organization: setl-framework
etl-pipeline,A lightweight helper utility which allows developers to do interactive pipeline development by having a unified source code for both DLT run and Non-DLT interactive notebook run.
User: souvik-databricks
Home Page: https://pypi.org/project/dlt-with-debug/
etl-pipeline,Stellar ETL will enable real-time analytics on the Stellar network
Organization: stellar
etl-pipeline,Airflow DAGs for the Stellar ETL project
Organization: stellar
etl-pipeline,A scalable general purpose micro-framework for defining dataflows. THIS REPOSITORY HAS BEEN MOVED TO www.github.com/dagworks-inc/hamilton
Organization: stitchfix
Home Page: https://www.github.com/dagworks-inc/hamilton
etl-pipeline,SEO dashboard from Search console Data using the Google Search API, Mysql database , NodeJS RESTAPI( ExpressJS) and reactJs Dashboard
User: sundios
Home Page: https://www.kwrds.ai
etl-pipeline,A Clojure high performance data processing system
Organization: techascent
etl-pipeline,EtlFlow is an ecosystem of functional libraries in Scala based on ZIO for running complex Auditable workflows which can interact with Google Cloud Platform, AWS, Kubernetes, Databases, SFTP servers, On-Prem Systems and more.
User: tharwaninitin
etl-pipeline,:mens: 💾 Script to import issues from a JIRA instance into a database.
User: toddbirchard
Home Page: https://hackersandslackers.com/jira-to-sql-etl/
etl-pipeline,Download DIG to run on your laptop or server.
Organization: usc-isi-i2
Home Page: http://usc-isi-i2.github.io/dig/
etl-pipeline,Simplified ETL process in Hadoop using Apache Spark. Has complete ETL pipeline for datalake. SparkSession extensions, DataFrame validation, Column extensions, SQL functions, and DataFrame transformations
User: vim89
etl-pipeline,
Organization: visiologyofficial
Home Page: https://www.vixtract.ru
etl-pipeline,Data Engineer with Python lecture notes from #datacamp.
User: wathon
etl-pipeline,The goal of this project is to track the expenses of Uber Rides and Uber Eats through data Engineering processes using technologies such as Apache Airflow, AWS Redshift and Power BI.
User: wittline
Home Page: https://wittline.github.io/uber-expenses-tracking/
etl-pipeline,A simplified, lightweight ETL Framework based on Apache Spark
Organization: yotpoltd
Home Page: https://yotpoltd.github.io/metorikku/
etl-pipeline,No-code LLM Platform to launch APIs and ETL Pipelines to structure unstructured documents
Organization: zipstack
Home Page: https://unstract.com
A declarative, efficient, and flexible JavaScript library for building user interfaces.
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google ❤️ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.