Scaling

Scaling to 100 M

Agenda

• About ShareThis• What is SocialAB• Scaling Meteor at ShareThis

Problems facedRedesigned Meteor architectureLoad Test Results

• Q&A

Introduction

▪ Growth Engineering @ ShareThis

Vijay

WHOShareThis was founded in 2007 – with a lofty goal – to make social sharing a part of every day consumer behavior. And today it is.WE ARE

© 2016 ShareThis. All rights reserved.

sharethis reachTRUSTED BY 4.7 MILLION WEBSITES/APPS

8

3 Easy Steps to Install

Sharing Tools

ShareThis is building out a social platform to

address publishers needs.

SOCIALOPTIMIZATIO

N PLATFORM


social A/BTHE WORLD’S TOP CONTENT CREATORS USE A/B TESTING ON SOCIAL

10

Social A/B brings the power of this share graph optimization technology to ShareThis publisher partners by testing your headlines on Facebook. This allows you to tap into social networks to draw new readers to your site.

ARTICLE HEADLINE #1

ARTICLE HEADLINE #2


social A/BPROPRIETARY ALGORITHM

11

Our algorithm learns as the experiments run, so you can see the best results as quickly as

possible, detecting the best performing headline.

Why do we need to Scale?

Big Publishers want this tool!

100 Million events/ month

Know before our publishers

ShareThis Infrastructure

Initial Meteor Architecture

Slow Img

Things We TriedBetter Indexing Mongo

Made Meteor to tail Mongo Oplogs instead of default polling

Paginated the UI

Scale out Meteor to multiple instances

Load Test Data

Meteor Pub/Sub Failed !

Decoupled UI From Meteor

SocialAB Architecture

Lessons LearntMeteor SockJs can’t handle sticky sessions in current

Infrastructure.

Meteor Publisher/Subscriber doesn’t handle heavy load in real time

We are Hiring!sharethis.com/join

stackshare.io/sharethis

Docker Kubernetes Kafka Google Cloud Meteor JS

Light Bulb, an idea

history hack a thon productivity locked in a room 2 teams 2 differnet ideas pretty difficult 2 days intense focus

Questions?

Scaling

Engineering

Transcript of Scaling