Giter Club home page Giter Club logo

What's up?! ๐Ÿ‘‹

I'm a Data Engineer at National Bank of Canada. There I work with data pipelines and data structure development.

  • ๐Ÿ”ญ Iโ€™m currently currently working on data architecture challenges and structuring a Data Mesh using Airflow, RDS, S3, Glue, Athena and some APIs to gather different data sources.
  • ๐ŸŒฑ Now, I'm learning some data science structure stuff like Data lake, Data Mesh and Big data using AWS Tools, Airflow and Pandas.
  • ๐Ÿค Iโ€™m looking to collaborate on data science and machine learning projects.

Collumbus's GitHub stats

Jorge Luiz's Projects

ann_xor icon ann_xor

This is an XOR ANN implementation with the Pybrain library and with a Tkinter GUI.

aws-cloud-data-warehouses icon aws-cloud-data-warehouses

It is a data warehouse project on AWS where has built an ETL pipeline for a database hosted on Redshift. To complete the project, we load data from S3 to staging tables on Redshift and execute SQL statements that create the analytics tables from these staging tables.

aws-data-lakes-with-spark icon aws-data-lakes-with-spark

This project builds an **ETL pipeline** for a **data lake**. The data resides in S3, in a directory of JSON logs on user activity on the app, as well as a directory with JSON metadata on the songs in the app. We loaded data from S3, process the data into analytics tables using **Spark**, and load them back into S3.

data-modeling-with-cassandra icon data-modeling-with-cassandra

It is a project where I applied concepts data modelling with Apache Cassandra and built an ETL pipeline using Python. To complete the project has been defined a data model by creating tables in Apache Cassandra to run queries. I am provided with part of the ETL pipeline that transfers data from a set of CSV files within a directory to create a streamlined CSV file to model and insert data into Apache Cassandra tables.

data-modeling-with-postgres icon data-modeling-with-postgres

This is a project, where I applied concepts of data modeling with Postgres and build an ETL pipeline using Python. To complete the project has been defined fact and dimension tables for a star schema for a particular analytic focus, and wrote an ETL pipeline that transfers data from files in two local directories into these tables in Postgres using Python and SQL.

hgc icon hgc

Human Gait Classification

intro_to_machine_learning-udacity icon intro_to_machine_learning-udacity

These are my results of the Intro to Machine Learning course offered by Udacity platform through a point of view using Jupyter to carry out the proposed activities.

libfreenect icon libfreenect

Drivers and libraries for the Xbox Kinect device on Windows, Linux, and OS X

machine_learning_uw icon machine_learning_uw

These are my results of the Machine Learning course offered by University of Washington at Coursera platform.

pandas_twitter icon pandas_twitter

Analyzing Trump's tweets using Python (Pandas + Twitter workshop)

pks_ml icon pks_ml

Machine learning techniques to classify Parkinson's disease in the first four levels of the H-Y scale.

swot icon swot

Identify email addresses or domains names that belong to colleges or universities. Help automate the process of approving or rejecting academic discounts.

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.