Netflix uses a data warehouse called Aegisthus built on the DataStax Enterprise (DSE) platform. Aegisthus uses DSE, Cassandra, and S3. It provides a high SLA for querying and analyzing data for tasks like data science and metadata services. Data is stored in S3 for high availability and queried using services like Chukwa, Honu, Sting, and DSE.

2. What is Netflix’s data warehouse?
a) Cassandra
b) Teradata
c) Hive
d) S3

4. DSE Platform

7. DSE Platform
Chukwa / Honu
S3

9. Aegisthus

11. DSE Platform
Chukwa / Honu
Aegisthus
S3

12. Sting

15. DSE Platform
Sting
Chukwa / Honu
Aegisthus
S3

16. What is Netflix’s data warehouse?
a) Cassandra
b) Teradata
c) Hive
d) S3

17. DSE Platform
Sting
Chukwa / Honu
Aegisthus
S3

18. S3

19. S3

20. 99.999999999%

22. S3

23. High SLA
S3
Query

24. HDFS ?

26. “Data Science as a Service”
• Execution Service / Genie
• Event Service
• Metadata Service

32. High SLA Cluster Job
High SLA
S3
Query Cluster Job
Query

33. High SLA
S3
Query Cluster Job
Query

34. High SLA Cluster Job
High SLA
S3
Query Cluster Job
Query

35. Super SLA Cluster Job
Super SLA
High SLA Cluster Job
S3
High SLA
Query Cluster Job
Query

36. Super SLA Cluster Job
High SLA Cluster Job
High SLA
S3
Query Cluster Job
Query

38. Questions?
http://jobs.netflix.com
kurtbrown@netflix.com