zbd-schema-usa's Introduction

Source database for Data Warehouse

Streaming Services - Schema USA

Creating fixtures

Build docker images and start mysql and pma:

docker login
docker-compose build --pull
docker-compose up -d mysql pma

Initialize and migrate database:

docker-compose run console doctrine:database:create
docker-compose run console doctrine:migrations:migrate

Run fixtures

docker-compose run console doctrine:fixtures:load -n

Go to http://localhost:8080

Exporting data to staging database of Date Warehouse

Login to Docker Hub and get access to Oracle EE from Docker Store: https://store.docker.com/images/oracle-database-enterprise-edition

Build docker images and start oracle database:

docker login
docker-compose build --pull
docker-compose up -d oradb

Use docker ps to check whether database is healthy

Make sure staging user exists and its schema

docker-compose exec oradb bash
sqlplus staging/staging@ORCLCDB

# you should be connected to database now

Make sure you have compatible schema in project and database

docker-compose run console doctrine:schema:validate --em=warehouse_stage

Run migrations script

docker-compose run console app:staging:sync
# and then you can in parallel
docker-compose run console app:staging:likes
docker-compose run console app:staging:streams
docker-compose run console app:staging:transactions

Fast usage

docker-compose run console doctrine:database:drop --force
docker-compose run console doctrine:database:create
docker-compose run console doctrine:migrations:migrate -n
docker-compose run console doctrine:fixtures:load -n
docker-compose run console app:staging:sync
docker-compose run console app:staging:likes
docker-compose run console app:staging:streams
docker-compose run console app:staging:transactions

Recommend Projects