Data Science at Netflix with Amazon EMR (BDT306) | AWS re:Invent 2013
-
Upload
amazon-web-services -
Category
Technology
-
view
1.251 -
download
4
description
Transcript of Data Science at Netflix with Amazon EMR (BDT306) | AWS re:Invent 2013
![Page 1: Data Science at Netflix with Amazon EMR (BDT306) | AWS re:Invent 2013](https://reader033.fdocuments.us/reader033/viewer/2022051816/54531113af79590c308b535a/html5/thumbnails/1.jpg)
© 2013 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified, or distributed in whole or in part without the express consent of Amazon.com, Inc.
Data Science at Netflix with Amazon EMR
Kurt Brown, Director of Data Platform, Netflix
November 13, 2013
![Page 2: Data Science at Netflix with Amazon EMR (BDT306) | AWS re:Invent 2013](https://reader033.fdocuments.us/reader033/viewer/2022051816/54531113af79590c308b535a/html5/thumbnails/2.jpg)
![Page 3: Data Science at Netflix with Amazon EMR (BDT306) | AWS re:Invent 2013](https://reader033.fdocuments.us/reader033/viewer/2022051816/54531113af79590c308b535a/html5/thumbnails/3.jpg)
Data Platform
![Page 4: Data Science at Netflix with Amazon EMR (BDT306) | AWS re:Invent 2013](https://reader033.fdocuments.us/reader033/viewer/2022051816/54531113af79590c308b535a/html5/thumbnails/4.jpg)
![Page 5: Data Science at Netflix with Amazon EMR (BDT306) | AWS re:Invent 2013](https://reader033.fdocuments.us/reader033/viewer/2022051816/54531113af79590c308b535a/html5/thumbnails/5.jpg)
![Page 6: Data Science at Netflix with Amazon EMR (BDT306) | AWS re:Invent 2013](https://reader033.fdocuments.us/reader033/viewer/2022051816/54531113af79590c308b535a/html5/thumbnails/6.jpg)
S3
Suro
Data Platform
![Page 7: Data Science at Netflix with Amazon EMR (BDT306) | AWS re:Invent 2013](https://reader033.fdocuments.us/reader033/viewer/2022051816/54531113af79590c308b535a/html5/thumbnails/7.jpg)
![Page 8: Data Science at Netflix with Amazon EMR (BDT306) | AWS re:Invent 2013](https://reader033.fdocuments.us/reader033/viewer/2022051816/54531113af79590c308b535a/html5/thumbnails/8.jpg)
Aegisthus
![Page 9: Data Science at Netflix with Amazon EMR (BDT306) | AWS re:Invent 2013](https://reader033.fdocuments.us/reader033/viewer/2022051816/54531113af79590c308b535a/html5/thumbnails/9.jpg)
![Page 10: Data Science at Netflix with Amazon EMR (BDT306) | AWS re:Invent 2013](https://reader033.fdocuments.us/reader033/viewer/2022051816/54531113af79590c308b535a/html5/thumbnails/10.jpg)
S3
Suro
Aegisthus
Data Platform
![Page 11: Data Science at Netflix with Amazon EMR (BDT306) | AWS re:Invent 2013](https://reader033.fdocuments.us/reader033/viewer/2022051816/54531113af79590c308b535a/html5/thumbnails/11.jpg)
Sting
![Page 12: Data Science at Netflix with Amazon EMR (BDT306) | AWS re:Invent 2013](https://reader033.fdocuments.us/reader033/viewer/2022051816/54531113af79590c308b535a/html5/thumbnails/12.jpg)
![Page 13: Data Science at Netflix with Amazon EMR (BDT306) | AWS re:Invent 2013](https://reader033.fdocuments.us/reader033/viewer/2022051816/54531113af79590c308b535a/html5/thumbnails/13.jpg)
![Page 14: Data Science at Netflix with Amazon EMR (BDT306) | AWS re:Invent 2013](https://reader033.fdocuments.us/reader033/viewer/2022051816/54531113af79590c308b535a/html5/thumbnails/14.jpg)
S3
Suro
Aegisthus
Sting
Data Platform
![Page 15: Data Science at Netflix with Amazon EMR (BDT306) | AWS re:Invent 2013](https://reader033.fdocuments.us/reader033/viewer/2022051816/54531113af79590c308b535a/html5/thumbnails/15.jpg)
![Page 16: Data Science at Netflix with Amazon EMR (BDT306) | AWS re:Invent 2013](https://reader033.fdocuments.us/reader033/viewer/2022051816/54531113af79590c308b535a/html5/thumbnails/16.jpg)
![Page 17: Data Science at Netflix with Amazon EMR (BDT306) | AWS re:Invent 2013](https://reader033.fdocuments.us/reader033/viewer/2022051816/54531113af79590c308b535a/html5/thumbnails/17.jpg)
S3
Suro
Aegisthus
Sting
Data Platform
![Page 18: Data Science at Netflix with Amazon EMR (BDT306) | AWS re:Invent 2013](https://reader033.fdocuments.us/reader033/viewer/2022051816/54531113af79590c308b535a/html5/thumbnails/18.jpg)
S3
Suro
Aegisthus
Sting
Data Platform
![Page 19: Data Science at Netflix with Amazon EMR (BDT306) | AWS re:Invent 2013](https://reader033.fdocuments.us/reader033/viewer/2022051816/54531113af79590c308b535a/html5/thumbnails/19.jpg)
S3
![Page 20: Data Science at Netflix with Amazon EMR (BDT306) | AWS re:Invent 2013](https://reader033.fdocuments.us/reader033/viewer/2022051816/54531113af79590c308b535a/html5/thumbnails/20.jpg)
S3
![Page 21: Data Science at Netflix with Amazon EMR (BDT306) | AWS re:Invent 2013](https://reader033.fdocuments.us/reader033/viewer/2022051816/54531113af79590c308b535a/html5/thumbnails/21.jpg)
99.999999999%
![Page 22: Data Science at Netflix with Amazon EMR (BDT306) | AWS re:Invent 2013](https://reader033.fdocuments.us/reader033/viewer/2022051816/54531113af79590c308b535a/html5/thumbnails/22.jpg)
![Page 23: Data Science at Netflix with Amazon EMR (BDT306) | AWS re:Invent 2013](https://reader033.fdocuments.us/reader033/viewer/2022051816/54531113af79590c308b535a/html5/thumbnails/23.jpg)
S3
![Page 24: Data Science at Netflix with Amazon EMR (BDT306) | AWS re:Invent 2013](https://reader033.fdocuments.us/reader033/viewer/2022051816/54531113af79590c308b535a/html5/thumbnails/24.jpg)
S3
High SLA
Query
![Page 25: Data Science at Netflix with Amazon EMR (BDT306) | AWS re:Invent 2013](https://reader033.fdocuments.us/reader033/viewer/2022051816/54531113af79590c308b535a/html5/thumbnails/25.jpg)
![Page 26: Data Science at Netflix with Amazon EMR (BDT306) | AWS re:Invent 2013](https://reader033.fdocuments.us/reader033/viewer/2022051816/54531113af79590c308b535a/html5/thumbnails/26.jpg)
HDFS ?
![Page 27: Data Science at Netflix with Amazon EMR (BDT306) | AWS re:Invent 2013](https://reader033.fdocuments.us/reader033/viewer/2022051816/54531113af79590c308b535a/html5/thumbnails/27.jpg)
Eventual Consistency
![Page 28: Data Science at Netflix with Amazon EMR (BDT306) | AWS re:Invent 2013](https://reader033.fdocuments.us/reader033/viewer/2022051816/54531113af79590c308b535a/html5/thumbnails/28.jpg)
S3mper
![Page 29: Data Science at Netflix with Amazon EMR (BDT306) | AWS re:Invent 2013](https://reader033.fdocuments.us/reader033/viewer/2022051816/54531113af79590c308b535a/html5/thumbnails/29.jpg)
“Data as a Service” • Execution Service • Event Service • Metadata Service
![Page 30: Data Science at Netflix with Amazon EMR (BDT306) | AWS re:Invent 2013](https://reader033.fdocuments.us/reader033/viewer/2022051816/54531113af79590c308b535a/html5/thumbnails/30.jpg)
![Page 31: Data Science at Netflix with Amazon EMR (BDT306) | AWS re:Invent 2013](https://reader033.fdocuments.us/reader033/viewer/2022051816/54531113af79590c308b535a/html5/thumbnails/31.jpg)
![Page 32: Data Science at Netflix with Amazon EMR (BDT306) | AWS re:Invent 2013](https://reader033.fdocuments.us/reader033/viewer/2022051816/54531113af79590c308b535a/html5/thumbnails/32.jpg)
![Page 33: Data Science at Netflix with Amazon EMR (BDT306) | AWS re:Invent 2013](https://reader033.fdocuments.us/reader033/viewer/2022051816/54531113af79590c308b535a/html5/thumbnails/33.jpg)
![Page 34: Data Science at Netflix with Amazon EMR (BDT306) | AWS re:Invent 2013](https://reader033.fdocuments.us/reader033/viewer/2022051816/54531113af79590c308b535a/html5/thumbnails/34.jpg)
![Page 35: Data Science at Netflix with Amazon EMR (BDT306) | AWS re:Invent 2013](https://reader033.fdocuments.us/reader033/viewer/2022051816/54531113af79590c308b535a/html5/thumbnails/35.jpg)
![Page 36: Data Science at Netflix with Amazon EMR (BDT306) | AWS re:Invent 2013](https://reader033.fdocuments.us/reader033/viewer/2022051816/54531113af79590c308b535a/html5/thumbnails/36.jpg)
![Page 37: Data Science at Netflix with Amazon EMR (BDT306) | AWS re:Invent 2013](https://reader033.fdocuments.us/reader033/viewer/2022051816/54531113af79590c308b535a/html5/thumbnails/37.jpg)
![Page 38: Data Science at Netflix with Amazon EMR (BDT306) | AWS re:Invent 2013](https://reader033.fdocuments.us/reader033/viewer/2022051816/54531113af79590c308b535a/html5/thumbnails/38.jpg)
High SLA Cluster Job
High SLA S3 Query Cluster Job
Query
![Page 39: Data Science at Netflix with Amazon EMR (BDT306) | AWS re:Invent 2013](https://reader033.fdocuments.us/reader033/viewer/2022051816/54531113af79590c308b535a/html5/thumbnails/39.jpg)
High SLA S3 Query Cluster Job
Query
![Page 40: Data Science at Netflix with Amazon EMR (BDT306) | AWS re:Invent 2013](https://reader033.fdocuments.us/reader033/viewer/2022051816/54531113af79590c308b535a/html5/thumbnails/40.jpg)
High SLA Cluster Job
High SLA S3 Query Cluster Job
Query
![Page 41: Data Science at Netflix with Amazon EMR (BDT306) | AWS re:Invent 2013](https://reader033.fdocuments.us/reader033/viewer/2022051816/54531113af79590c308b535a/html5/thumbnails/41.jpg)
High SLA Cluster Job
Bonus
S3 Query Cluster Job
Bonus Cluster Job
High SLA
Query
![Page 42: Data Science at Netflix with Amazon EMR (BDT306) | AWS re:Invent 2013](https://reader033.fdocuments.us/reader033/viewer/2022051816/54531113af79590c308b535a/html5/thumbnails/42.jpg)
High SLA Cluster Job
S3 Query Cluster Job
Bonus Cluster Job
High SLA
Query
![Page 43: Data Science at Netflix with Amazon EMR (BDT306) | AWS re:Invent 2013](https://reader033.fdocuments.us/reader033/viewer/2022051816/54531113af79590c308b535a/html5/thumbnails/43.jpg)
![Page 44: Data Science at Netflix with Amazon EMR (BDT306) | AWS re:Invent 2013](https://reader033.fdocuments.us/reader033/viewer/2022051816/54531113af79590c308b535a/html5/thumbnails/44.jpg)
![Page 45: Data Science at Netflix with Amazon EMR (BDT306) | AWS re:Invent 2013](https://reader033.fdocuments.us/reader033/viewer/2022051816/54531113af79590c308b535a/html5/thumbnails/45.jpg)
![Page 46: Data Science at Netflix with Amazon EMR (BDT306) | AWS re:Invent 2013](https://reader033.fdocuments.us/reader033/viewer/2022051816/54531113af79590c308b535a/html5/thumbnails/46.jpg)
![Page 47: Data Science at Netflix with Amazon EMR (BDT306) | AWS re:Invent 2013](https://reader033.fdocuments.us/reader033/viewer/2022051816/54531113af79590c308b535a/html5/thumbnails/47.jpg)
Tez
![Page 48: Data Science at Netflix with Amazon EMR (BDT306) | AWS re:Invent 2013](https://reader033.fdocuments.us/reader033/viewer/2022051816/54531113af79590c308b535a/html5/thumbnails/48.jpg)
Suro
![Page 49: Data Science at Netflix with Amazon EMR (BDT306) | AWS re:Invent 2013](https://reader033.fdocuments.us/reader033/viewer/2022051816/54531113af79590c308b535a/html5/thumbnails/49.jpg)
Aegisthus
![Page 50: Data Science at Netflix with Amazon EMR (BDT306) | AWS re:Invent 2013](https://reader033.fdocuments.us/reader033/viewer/2022051816/54531113af79590c308b535a/html5/thumbnails/50.jpg)
![Page 51: Data Science at Netflix with Amazon EMR (BDT306) | AWS re:Invent 2013](https://reader033.fdocuments.us/reader033/viewer/2022051816/54531113af79590c308b535a/html5/thumbnails/51.jpg)
![Page 53: Data Science at Netflix with Amazon EMR (BDT306) | AWS re:Invent 2013](https://reader033.fdocuments.us/reader033/viewer/2022051816/54531113af79590c308b535a/html5/thumbnails/53.jpg)
Please give us your feedback on this presentation
As a thank you, we will select prize winners daily for completed surveys!
BDT306