Overview

Information was consistently gathered about the nature of data to be collected.

Architecture

Result

The whole process involved setting up softwares through the stack and the right configurations and policies on AWS. A 13-page report was created with clear guidelines to reproduce the same.

The setup involved tuning the batch timings and thresholds, isolating several data streams, logging etc.

• AWS EC2, Kinesis, Redshift, S3.
• Snowplow: schemas, collector, enricher and s3-loader