Technology stack of social networks [MTS]
-
Upload
philmaweb -
Category
Engineering
-
view
265 -
download
3
Transcript of Technology stack of social networks [MTS]
![Page 1: Technology stack of social networks [MTS]](https://reader034.fdocuments.us/reader034/viewer/2022042701/55a8ec3b1a28abce2b8b464e/html5/thumbnails/1.jpg)
social networksThe technology stack of
Philipp Weber HDE MTS 2015.01.23
![Page 2: Technology stack of social networks [MTS]](https://reader034.fdocuments.us/reader034/viewer/2022042701/55a8ec3b1a28abce2b8b464e/html5/thumbnails/2.jpg)
Table of Contents
● Overview
● Included networks
● The stacks
● Comments / Takeaway
![Page 3: Technology stack of social networks [MTS]](https://reader034.fdocuments.us/reader034/viewer/2022042701/55a8ec3b1a28abce2b8b464e/html5/thumbnails/3.jpg)
*Some of the displayed numbers and
technologies reach back to the year of 2011.
**Rights to the registered Names / Logos /
Trademarks featured are property of and
belong to their respective owners.
Disclaimer
![Page 4: Technology stack of social networks [MTS]](https://reader034.fdocuments.us/reader034/viewer/2022042701/55a8ec3b1a28abce2b8b464e/html5/thumbnails/4.jpg)
Facebook - 1.35 billion monthly active
users
Tumblr - 420 million users
Twitter - 284 million monthly active
users
LinkedIn - 300 million users
Google+ - 300 million monthly active
users
Included Networks
![Page 5: Technology stack of social networks [MTS]](https://reader034.fdocuments.us/reader034/viewer/2022042701/55a8ec3b1a28abce2b8b464e/html5/thumbnails/5.jpg)
Frontend Backend
The stack
Databases Cache(Hosting)
Meta
Templating /
Javascript
Intermediate-
Layer
Programming
Languages
Server
specifics
Offline
processing
![Page 6: Technology stack of social networks [MTS]](https://reader034.fdocuments.us/reader034/viewer/2022042701/55a8ec3b1a28abce2b8b464e/html5/thumbnails/6.jpg)
The stack - Facebook
● 864 million daily active
users
● 700 million mobile daily
active users
![Page 7: Technology stack of social networks [MTS]](https://reader034.fdocuments.us/reader034/viewer/2022042701/55a8ec3b1a28abce2b8b464e/html5/thumbnails/7.jpg)
Haystack
(Object-store)
Memcached
markup
Language
PhpCassandra
Hadoop +
Hive
BigPipe
→ pagelets
Thrift
JavaVarnish
HTTP-accel.
HipHopVM -
Php-compiler
Frontend Backend Meta
![Page 8: Technology stack of social networks [MTS]](https://reader034.fdocuments.us/reader034/viewer/2022042701/55a8ec3b1a28abce2b8b464e/html5/thumbnails/8.jpg)
The stack - Tumblr
● Microblog / social
networking website
● ~40k requests per second
● 15 billion page views per
month
● belongs to Yahoo
![Page 9: Technology stack of social networks [MTS]](https://reader034.fdocuments.us/reader034/viewer/2022042701/55a8ec3b1a28abce2b8b464e/html5/thumbnails/9.jpg)
The stack - Tumblr
HBase
Redis
(Hosting)
Gearman and
Kestrel
PHP
HA-Proxy
Scala
Ruby
MySQL
Apache Kafka
Finagle
Frontend Backend Meta
![Page 10: Technology stack of social networks [MTS]](https://reader034.fdocuments.us/reader034/viewer/2022042701/55a8ec3b1a28abce2b8b464e/html5/thumbnails/10.jpg)
The stack - Twitter
● 80% of Twitter active users
are on mobile
● Average of ~5750 Tweets/s
● Record 143.199 Tweets/s
![Page 11: Technology stack of social networks [MTS]](https://reader034.fdocuments.us/reader034/viewer/2022042701/55a8ec3b1a28abce2b8b464e/html5/thumbnails/11.jpg)
Flock Memcached(Hosting)Bootstrap
JVM
Finagle
Java
Netty
JavaScriptRedis
Hadoop+
Scalding
Scala
Frontend Backend Meta
User-Store
![Page 12: Technology stack of social networks [MTS]](https://reader034.fdocuments.us/reader034/viewer/2022042701/55a8ec3b1a28abce2b8b464e/html5/thumbnails/12.jpg)
The stack - LinkedIn
● Leader in Professional
networking
● Opened their Network data
to busines-research in 2008
![Page 13: Technology stack of social networks [MTS]](https://reader034.fdocuments.us/reader034/viewer/2022042701/55a8ec3b1a28abce2b8b464e/html5/thumbnails/13.jpg)
The stack - LinkedIn
Oracle Voldemort
Node.js
Java
GRails =
Java-Rails
Hadoop
Espresso Scala
JRuby
JavaScript
MySQLJQuery
Backbone.js
Frontend Backend Meta
![Page 14: Technology stack of social networks [MTS]](https://reader034.fdocuments.us/reader034/viewer/2022042701/55a8ec3b1a28abce2b8b464e/html5/thumbnails/14.jpg)
The stack - Google+
● Build on Circle API
● Usually use special Google
technology and libraries
● Close interaction with
android planned
![Page 15: Technology stack of social networks [MTS]](https://reader034.fdocuments.us/reader034/viewer/2022042701/55a8ec3b1a28abce2b8b464e/html5/thumbnails/15.jpg)
The stack - Google+
BigTable
Closure
Java
Custom JVM
GoogleFile
System
Closure C++
PythonJQuery
Frontend Backend Meta
![Page 16: Technology stack of social networks [MTS]](https://reader034.fdocuments.us/reader034/viewer/2022042701/55a8ec3b1a28abce2b8b464e/html5/thumbnails/16.jpg)
Takeaway
So what can we learn from these examples?
![Page 17: Technology stack of social networks [MTS]](https://reader034.fdocuments.us/reader034/viewer/2022042701/55a8ec3b1a28abce2b8b464e/html5/thumbnails/17.jpg)
Takeaways
#1 Embrace Open Source
Open Source systems benefit from university
research and a big community. Facebook
and Twitter release or found many of their
software in OpenSource projects.
![Page 18: Technology stack of social networks [MTS]](https://reader034.fdocuments.us/reader034/viewer/2022042701/55a8ec3b1a28abce2b8b464e/html5/thumbnails/18.jpg)
Takeaways
#2 Scalability:
Prepare for scalability starting at the
foundation. Monolithic systems make rapid
growth impossible or error-proned.
![Page 19: Technology stack of social networks [MTS]](https://reader034.fdocuments.us/reader034/viewer/2022042701/55a8ec3b1a28abce2b8b464e/html5/thumbnails/19.jpg)
Takeaways
#3 Discover new solutions:
Highscalability.com writes a very in-depth
technology-blog with interviews from tech-
giants and their experiences. Definitely worth
a read.
![Page 20: Technology stack of social networks [MTS]](https://reader034.fdocuments.us/reader034/viewer/2022042701/55a8ec3b1a28abce2b8b464e/html5/thumbnails/20.jpg)
Thank you for
your Attention
![Page 21: Technology stack of social networks [MTS]](https://reader034.fdocuments.us/reader034/viewer/2022042701/55a8ec3b1a28abce2b8b464e/html5/thumbnails/21.jpg)
Sources
https://github.com/facebook
http://www.slideshare.net/meet.hak/facebook-technology-stack
http://newsroom.fb.com/company-info/
www.infoq.com/presentations/Scale-at-Facebook
https://about.twitter.com/company
https://blog.twitter.com/2013/new-tweets-per-second-record-and-how
http://www.slideshare.net/caniszczyk/twitter-opensourcestacklinuxcon2013
Tumblr
http://www.theguardian.com/technology/2014/oct/23/tumblr-yahoo-revenues-2015-ads-nsfw
http://highscalability.com/blog/2012/2/13/tumblr-architecture-15-billion-page-views-a-month-and-harder.html
https://press.linkedin.com/news-releases
https://engineering.linkedin.com/technology
https://www.youtube.com/watch?x-yt-ts=1421914688&x-yt-cl=84503534&v=OXN3wuHUBP0
Google+
http://www.usatoday.com/story/tech/2013/10/29/google-plus/3296017/
http://highscalability.com/blog/2011/7/12/google-is-built-using-tools-you-can-use-too-closure-java-ser.html