CS80A Foothill College Open Source Talk

11
Netflix & Open Source Foothill College C S 80A, January 2016 Andrew Spyker Cloud Platform Engineer

Transcript of CS80A Foothill College Open Source Talk

Page 1: CS80A Foothill College Open Source Talk

Netflix & Open SourceFoothill College C S 80A, January 2016

Andrew SpykerCloud Platform Engineer

Page 2: CS80A Foothill College Open Source Talk

About Netflix

● 75M+ members● #NetflixEverywhere (Worldwide)● 42.5B hours watched 2015● > ⅓ NA internet download traffic● 1000’s Microservices● Many 10’s of thousands VM’s● 3 regions across the world● 2000+ employees

2

Page 3: CS80A Foothill College Open Source Talk

About me● Cloud platform technologies

○ Distributed configuration, service discovery, RPC, application frameworks, non-Java sidecar

● Container cloud○ Resource management and scheduling, making Docker containers

operational in Amazon EC2/ECS

● Open Source○ Organize @NetflixOSS meetups & internal group

● Performance○ Assist across Netflix, but focused mainly on cloud platform perf

With Netflix for ~ 1 year. Previously at IBM.

@aspyker

ispyker.blogspot.

com

3

Page 4: CS80A Foothill College Open Source Talk

Why does Netflix open source?● Allows engineers to gather feedback

○ Openly talk, through code, on our approach○ Collaboration on key projects with the world○ Happily use proven outside open source

■ And improve it for Netflix scale and availability

● Netflix culture of freedom and responsibility○ Want to open source?○ Go for it, be responsible!

● Recruiting and Retention○ Candidates know exactly what they can work on○ NetflixOSS engineers choose to stay at Netflix

Page 5: CS80A Foothill College Open Source Talk

NetflixOSS is widely used● The architecture has shaped public cloud usage

○ Immutability, Red/Black Deploys, Chaos,Regional and worldwide high availability

● Offerings○ Pivotal Spring Cloud

● Large usage○ IBM Watson as a Service (on IBM Cloud)○ Nike Digital is hiring NetflixOSS experts

● Interesting usage○ “To help locate new troves of data claiming to be the files stolen from

AshleyMadison, the company’s forensics team has been using a tool that Netflix released last year called Scumblr”

Page 6: CS80A Foothill College Open Source Talk

Techblog - techblog.netflix.com

● Technical blog across Netflix

● Written by engineers

● Find projects and overviews of future directions

Page 7: CS80A Foothill College Open Source Talk

Net

flix

OSS

n

etfl

ix.g

ith

ub

.io

Page 8: CS80A Foothill College Open Source Talk

Net

flix

OSS

n

etfl

ix.g

ith

ub

.io

Page 9: CS80A Foothill College Open Source Talk

Tools I use every day

Open Sourcesource control, issues,

pull requests

Internalsource control, issues,

pull requests (git)

Dockercontainers

Jenkins Open SourceContinuous Integration

Open SourceContinuous Deployment

Gradle Java build systems

Page 10: CS80A Foothill College Open Source Talk

Why work on open source?

● Open source brought me to Netflix○ Ported Netflix cloud platform, delivery tools, and

insight to IBM cloud, middleware○ Was able to work closely with the team I eventually

joined, knew code I would be working on● Open source key aspects of Facebook,

Twitter, Box, Google, IBM, Microsoft● When interviewing

○ Github projects clear view of talent and approach

Page 11: CS80A Foothill College Open Source Talk

Questions