Gerardo David López Castillo's Projects
Process that generates random events over thousands of records from a technology e-commerce site for processing in Apache Kafka and analysis in Druid instantiated from EC2, WSL2 Ubuntu, Key .pem
Streaming data analysis using AWS tools such as Cloud9 to generate events in the cloud, using boto3 to send records to Kinesis Data Firehose to connect to the S3 bucket destination, saving files in .parquet format. With the help of Glue, a data catalog will be created to enable real-time querying of all records with Athena.
Process that extracts information about the weather forecast for Guatemala City from an API consumed in Python orchestrated by an EC2-AWS instance / WSL-Ubuntu, for SMS notification to local cell phone +502 GT about processed data
Config files for my GitHub profile.
Data streaming project with Apache Druid & Grafana: Real-time data processing, alerts, integration with AWS. It uses a combination of technologies and services, including Confluent-Kafka, Apache Druid, AWS SNS, EC2, Athena, S3, Glue and EventBridge, StepFunctions. Contribute to this powerful solution!
Process that extracts information from YouTube channels through APIs for processing through Lambda, and use of S3, Event Bridge and Athena components
Python code is shared that simulates random events in two scenarios: Technology E-commerce and Megastore in their mobile app. This is done to generate large-scale data that can be processed using Data Engineering tools.
Process that extracts information from 7 European leagues using Python's scraping method orchestrated by Airflow using ASTRO / Docker, where the output is loaded into a table/warehouse in Snowflake.
This project uses Python and the API MAPS to geolocate Guatemala's gas stations. It employs Streamlit, Folium, and Data Engineering for interactive map display and data manipulation. It creates a Docker image for efficient deployment. The system intelligently recommends the most costeffective gas station based on product type Diesel, Regular, Super
Provides the configuration necessary to create alarms in AWS CloudWatch for various resources in AWS ASG, ALB, and CIS (Center for Internet Security) alarms. Additionally, it implements a Heart Beat Monitor using AWS CloudWatch Synthetics.
This repository will guide you through creating Terraform modules locally, focused on building a reusable module to host a static website on AWS S3.
This repository provides a detailed guide on how to develop and utilize Terraform modules locally, particularly useful when access to the Terraform Public Registry is restricted from organizational private networks.
Create a DNS to DB Demo on AWS with Route53, ALB, EC2 and RDS Database with 3 Applications
In this repository, you'll discover how to effectively manage Terraform state by storing it remotely in AWS S3 and implementing state locking with DynamoDB.
Terraform Remote State Datasource Demo with two projects. This repository serves as a guide to understanding and implementing Terraform Remote State Datasource with multiple projects
Manage AWS Application Load Balancers (ALB) with Terraform. This repository provides Terraform configurations for creating and managing ALBs, including setting up EC2 instances, target groups, and listeners.
Create Host Header based routing rules for AWS Application Load Balancer using Terraform.
Create AWS Application Load Balancer Custom HTTP Header, 302 Redirects with Query String and Host Headers
Implemented context-aware routing in AWS Application Load Balancer using Terraform.
Create AWS Autoscaling with Launch Templates using Terraform, you will be able to define Launch Templates and configure Autoscaling Groups in an efficient and automated way on your AWS infrastructure.
Introduction to basic Terraform commands and how to create, verify, and destroy an EC2 instance.
Learn how to define input variables for region, instance type, and key pair, associate security groups, fetch the latest AMI ID with datasources, and create an EC2 instanced
This repo guides in creating an AWS EC2 web server using Terraform. It provides step-by-step examples and guides from initial setup to deploying a demo page, including Apache installation and userdata usage
Manage AWS Classic Load Balancers using Terraform. This repository provides Terraform configurations to create and manage Classic Load Balancers, including security groups and outputs.
Comprehensive guide on how to use loops, lists, maps, and the meta count argument in Terraform with advanced examples
Explore for_each, toset, and tomap in Terraform to effectively manage the creation of security groups in AWS.
This repository contains CodeBuild scripts to run infrastructure as code using Terraform on AWS, with configurations for the development (dev) and staging (stag) environments.
Create AWS Network Load Balancer with Terraform - Demo for both TCP and TLS Listeners. This repository contains configuration files and a step-by-step guide to creating an AWS Network Load Balancer (NLB) using Terraform.
Create AWS EC2 Instances and Security Groups with Terraform. This repository provides Terraform configurations for efficient EC2 instance and security group management.
Use this Terraform tool to check the availability of instance types in specific AWS Availability Zones.
React
Typescript
Django
Laravel
Facebook
Microsoft
Google
Alibaba
D3
Tencent