This repo contains a number of Docker images that can be incorporated into an Argo workflows based data pipelines to showcase:

• Portworx data services
• SQL Server 2022 S3 object virtualization

• The README file for each workflow contains instructions for deploying the workflow
• Each subdirectory under the docker_images folder contains the files neccessary for building the images used by each workflow

tweets_to_s3_csv Leverages the Tweepy API via Python in order to extract tweets, sentiment score the tweets and store them in csv file form in an S3 bucket.

s3_csv_to_cassandra Loads csv files containing sentiment scored tweets into a table in a Cassandra keyspace.

s3_csv_to_postgresql Loads csv files containing sentiment scored tweets into a table in a PostgreSQL database.

tweets_to_s3_csv Argo workflow manifest that loads sentiment scored tweets into Cassandra via an S3 bucket.