This project is just me trying to learn Golang, and explore real time pipelines with some big data technologies. This is not production ready.

Service for Publishing events to Kafka.

Any Applications that may be deployed to cloud.. All programs within cmd directory are mostly wrappers around pkg services.

All Core library and packages.

Any service that is exposed to users will belong here.

Core Library. Must always contain stateless logic that can be used by any module.

This is the middle layer that helps APIs talk to the Database. Any interfacing / conversions must happen in this layer. 4

create table raw_events (
                            event_ts DateTime ,
                            client_id String ,
                            event_key String,
                            guest_id String ,
                            user_id String ,
                            session_id String,
                            event_name String,
                            data Map(String, String)
)ENGINE MergeTree()
partition by ( client_id,toYYYYMMDD(event_ts) )  order by (client_id,event_ts, user_id , guest_id);