Resilient Predictive Data Pipelines

Sid Anand discusses how Agari is applying Big Data best practices to the problem of securing its customers from email-born threats. Anand presents a system that leverages the best of both the cloud (AWS’s SNS, SQS, Kinesis, Auto-scaling, S3, Lambda, API Gateway, etc…) and Big Data (Spark, Airbnb’s Airflow, etc…) in a maintainable way.