C* Summit EU 2013: From CQL to Time-Series Event Tracking and Aggregation Using Cassandra and Hadoop
41
-
Upload
planet-cassandra -
Category
Technology
-
view
685 -
download
0
description
Speaker: Mick Semb Wever, Programmer at FINN.no Video: http://www.youtube.com/watch?v=0ZymZ4OFcC4&list=PLqcm6qE9lgKLoYaakl3YwIWP4hmGsHm5e&index=14 FINN.no's is a classifieds website and Norway's busiest website. This session will go through various product development where c* has shown to be the best choice, focusing on our primary c* use-case: our in-house tracking solution that's collects raw time-series data in c* and aggregates minute-by-minute it using hadoop into various new datasets from advert-centric statistics to user-centric behavioural analysis. I'll cover the final technical design chosen after a number of development iterations touching on technologies: scribe, thrift, kafka, hadoop, pig, mahout; the hurdles faced along the way, and the throughput and performance of today's systems.
Transcript of C* Summit EU 2013: From CQL to Time-Series Event Tracking and Aggregation Using Cassandra and Hadoop
![Page 1: C* Summit EU 2013: From CQL to Time-Series Event Tracking and Aggregation Using Cassandra and Hadoop](https://reader035.fdocuments.us/reader035/viewer/2022081403/556272d9d8b42a04418b4621/html5/thumbnails/1.jpg)
![Page 2: C* Summit EU 2013: From CQL to Time-Series Event Tracking and Aggregation Using Cassandra and Hadoop](https://reader035.fdocuments.us/reader035/viewer/2022081403/556272d9d8b42a04418b4621/html5/thumbnails/2.jpg)
![Page 3: C* Summit EU 2013: From CQL to Time-Series Event Tracking and Aggregation Using Cassandra and Hadoop](https://reader035.fdocuments.us/reader035/viewer/2022081403/556272d9d8b42a04418b4621/html5/thumbnails/3.jpg)
![Page 4: C* Summit EU 2013: From CQL to Time-Series Event Tracking and Aggregation Using Cassandra and Hadoop](https://reader035.fdocuments.us/reader035/viewer/2022081403/556272d9d8b42a04418b4621/html5/thumbnails/4.jpg)
![Page 5: C* Summit EU 2013: From CQL to Time-Series Event Tracking and Aggregation Using Cassandra and Hadoop](https://reader035.fdocuments.us/reader035/viewer/2022081403/556272d9d8b42a04418b4621/html5/thumbnails/5.jpg)
![Page 6: C* Summit EU 2013: From CQL to Time-Series Event Tracking and Aggregation Using Cassandra and Hadoop](https://reader035.fdocuments.us/reader035/viewer/2022081403/556272d9d8b42a04418b4621/html5/thumbnails/6.jpg)
![Page 7: C* Summit EU 2013: From CQL to Time-Series Event Tracking and Aggregation Using Cassandra and Hadoop](https://reader035.fdocuments.us/reader035/viewer/2022081403/556272d9d8b42a04418b4621/html5/thumbnails/7.jpg)
![Page 8: C* Summit EU 2013: From CQL to Time-Series Event Tracking and Aggregation Using Cassandra and Hadoop](https://reader035.fdocuments.us/reader035/viewer/2022081403/556272d9d8b42a04418b4621/html5/thumbnails/8.jpg)
![Page 9: C* Summit EU 2013: From CQL to Time-Series Event Tracking and Aggregation Using Cassandra and Hadoop](https://reader035.fdocuments.us/reader035/viewer/2022081403/556272d9d8b42a04418b4621/html5/thumbnails/9.jpg)
![Page 10: C* Summit EU 2013: From CQL to Time-Series Event Tracking and Aggregation Using Cassandra and Hadoop](https://reader035.fdocuments.us/reader035/viewer/2022081403/556272d9d8b42a04418b4621/html5/thumbnails/10.jpg)
![Page 11: C* Summit EU 2013: From CQL to Time-Series Event Tracking and Aggregation Using Cassandra and Hadoop](https://reader035.fdocuments.us/reader035/viewer/2022081403/556272d9d8b42a04418b4621/html5/thumbnails/11.jpg)
![Page 12: C* Summit EU 2013: From CQL to Time-Series Event Tracking and Aggregation Using Cassandra and Hadoop](https://reader035.fdocuments.us/reader035/viewer/2022081403/556272d9d8b42a04418b4621/html5/thumbnails/12.jpg)
![Page 13: C* Summit EU 2013: From CQL to Time-Series Event Tracking and Aggregation Using Cassandra and Hadoop](https://reader035.fdocuments.us/reader035/viewer/2022081403/556272d9d8b42a04418b4621/html5/thumbnails/13.jpg)
![Page 14: C* Summit EU 2013: From CQL to Time-Series Event Tracking and Aggregation Using Cassandra and Hadoop](https://reader035.fdocuments.us/reader035/viewer/2022081403/556272d9d8b42a04418b4621/html5/thumbnails/14.jpg)
![Page 15: C* Summit EU 2013: From CQL to Time-Series Event Tracking and Aggregation Using Cassandra and Hadoop](https://reader035.fdocuments.us/reader035/viewer/2022081403/556272d9d8b42a04418b4621/html5/thumbnails/15.jpg)
![Page 16: C* Summit EU 2013: From CQL to Time-Series Event Tracking and Aggregation Using Cassandra and Hadoop](https://reader035.fdocuments.us/reader035/viewer/2022081403/556272d9d8b42a04418b4621/html5/thumbnails/16.jpg)
![Page 17: C* Summit EU 2013: From CQL to Time-Series Event Tracking and Aggregation Using Cassandra and Hadoop](https://reader035.fdocuments.us/reader035/viewer/2022081403/556272d9d8b42a04418b4621/html5/thumbnails/17.jpg)
![Page 18: C* Summit EU 2013: From CQL to Time-Series Event Tracking and Aggregation Using Cassandra and Hadoop](https://reader035.fdocuments.us/reader035/viewer/2022081403/556272d9d8b42a04418b4621/html5/thumbnails/18.jpg)
![Page 19: C* Summit EU 2013: From CQL to Time-Series Event Tracking and Aggregation Using Cassandra and Hadoop](https://reader035.fdocuments.us/reader035/viewer/2022081403/556272d9d8b42a04418b4621/html5/thumbnails/19.jpg)
![Page 20: C* Summit EU 2013: From CQL to Time-Series Event Tracking and Aggregation Using Cassandra and Hadoop](https://reader035.fdocuments.us/reader035/viewer/2022081403/556272d9d8b42a04418b4621/html5/thumbnails/20.jpg)
![Page 21: C* Summit EU 2013: From CQL to Time-Series Event Tracking and Aggregation Using Cassandra and Hadoop](https://reader035.fdocuments.us/reader035/viewer/2022081403/556272d9d8b42a04418b4621/html5/thumbnails/21.jpg)
![Page 22: C* Summit EU 2013: From CQL to Time-Series Event Tracking and Aggregation Using Cassandra and Hadoop](https://reader035.fdocuments.us/reader035/viewer/2022081403/556272d9d8b42a04418b4621/html5/thumbnails/22.jpg)
![Page 23: C* Summit EU 2013: From CQL to Time-Series Event Tracking and Aggregation Using Cassandra and Hadoop](https://reader035.fdocuments.us/reader035/viewer/2022081403/556272d9d8b42a04418b4621/html5/thumbnails/23.jpg)
![Page 24: C* Summit EU 2013: From CQL to Time-Series Event Tracking and Aggregation Using Cassandra and Hadoop](https://reader035.fdocuments.us/reader035/viewer/2022081403/556272d9d8b42a04418b4621/html5/thumbnails/24.jpg)
![Page 25: C* Summit EU 2013: From CQL to Time-Series Event Tracking and Aggregation Using Cassandra and Hadoop](https://reader035.fdocuments.us/reader035/viewer/2022081403/556272d9d8b42a04418b4621/html5/thumbnails/25.jpg)
![Page 26: C* Summit EU 2013: From CQL to Time-Series Event Tracking and Aggregation Using Cassandra and Hadoop](https://reader035.fdocuments.us/reader035/viewer/2022081403/556272d9d8b42a04418b4621/html5/thumbnails/26.jpg)
![Page 27: C* Summit EU 2013: From CQL to Time-Series Event Tracking and Aggregation Using Cassandra and Hadoop](https://reader035.fdocuments.us/reader035/viewer/2022081403/556272d9d8b42a04418b4621/html5/thumbnails/27.jpg)
![Page 28: C* Summit EU 2013: From CQL to Time-Series Event Tracking and Aggregation Using Cassandra and Hadoop](https://reader035.fdocuments.us/reader035/viewer/2022081403/556272d9d8b42a04418b4621/html5/thumbnails/28.jpg)
![Page 29: C* Summit EU 2013: From CQL to Time-Series Event Tracking and Aggregation Using Cassandra and Hadoop](https://reader035.fdocuments.us/reader035/viewer/2022081403/556272d9d8b42a04418b4621/html5/thumbnails/29.jpg)
![Page 30: C* Summit EU 2013: From CQL to Time-Series Event Tracking and Aggregation Using Cassandra and Hadoop](https://reader035.fdocuments.us/reader035/viewer/2022081403/556272d9d8b42a04418b4621/html5/thumbnails/30.jpg)
![Page 31: C* Summit EU 2013: From CQL to Time-Series Event Tracking and Aggregation Using Cassandra and Hadoop](https://reader035.fdocuments.us/reader035/viewer/2022081403/556272d9d8b42a04418b4621/html5/thumbnails/31.jpg)
![Page 32: C* Summit EU 2013: From CQL to Time-Series Event Tracking and Aggregation Using Cassandra and Hadoop](https://reader035.fdocuments.us/reader035/viewer/2022081403/556272d9d8b42a04418b4621/html5/thumbnails/32.jpg)
![Page 33: C* Summit EU 2013: From CQL to Time-Series Event Tracking and Aggregation Using Cassandra and Hadoop](https://reader035.fdocuments.us/reader035/viewer/2022081403/556272d9d8b42a04418b4621/html5/thumbnails/33.jpg)
![Page 34: C* Summit EU 2013: From CQL to Time-Series Event Tracking and Aggregation Using Cassandra and Hadoop](https://reader035.fdocuments.us/reader035/viewer/2022081403/556272d9d8b42a04418b4621/html5/thumbnails/34.jpg)
![Page 35: C* Summit EU 2013: From CQL to Time-Series Event Tracking and Aggregation Using Cassandra and Hadoop](https://reader035.fdocuments.us/reader035/viewer/2022081403/556272d9d8b42a04418b4621/html5/thumbnails/35.jpg)
![Page 36: C* Summit EU 2013: From CQL to Time-Series Event Tracking and Aggregation Using Cassandra and Hadoop](https://reader035.fdocuments.us/reader035/viewer/2022081403/556272d9d8b42a04418b4621/html5/thumbnails/36.jpg)
![Page 37: C* Summit EU 2013: From CQL to Time-Series Event Tracking and Aggregation Using Cassandra and Hadoop](https://reader035.fdocuments.us/reader035/viewer/2022081403/556272d9d8b42a04418b4621/html5/thumbnails/37.jpg)
![Page 38: C* Summit EU 2013: From CQL to Time-Series Event Tracking and Aggregation Using Cassandra and Hadoop](https://reader035.fdocuments.us/reader035/viewer/2022081403/556272d9d8b42a04418b4621/html5/thumbnails/38.jpg)
![Page 39: C* Summit EU 2013: From CQL to Time-Series Event Tracking and Aggregation Using Cassandra and Hadoop](https://reader035.fdocuments.us/reader035/viewer/2022081403/556272d9d8b42a04418b4621/html5/thumbnails/39.jpg)
![Page 40: C* Summit EU 2013: From CQL to Time-Series Event Tracking and Aggregation Using Cassandra and Hadoop](https://reader035.fdocuments.us/reader035/viewer/2022081403/556272d9d8b42a04418b4621/html5/thumbnails/40.jpg)
![Page 41: C* Summit EU 2013: From CQL to Time-Series Event Tracking and Aggregation Using Cassandra and Hadoop](https://reader035.fdocuments.us/reader035/viewer/2022081403/556272d9d8b42a04418b4621/html5/thumbnails/41.jpg)