2016 SUMMER INTERNSHIP - UC Davis: Networks...
Transcript of 2016 SUMMER INTERNSHIP - UC Davis: Networks...
![Page 1: 2016 SUMMER INTERNSHIP - UC Davis: Networks Labnetworks.cs.ucdavis.edu/presentation2016/Rafael-10-07-2016.pdf · 10/7/2016 · 2016 SUMMER INTERNSHIP @ Rafael Lourenço October 7th,](https://reader033.fdocuments.us/reader033/viewer/2022060409/5f101f617e708231d4478ed3/html5/thumbnails/1.jpg)
2016 SUMMER INTERNSHIP @ Rafael LourençoOctober 7th, 2016NetLab Friday Group Meeting(all info in this presentation is publicly available)
10/7/161
![Page 2: 2016 SUMMER INTERNSHIP - UC Davis: Networks Labnetworks.cs.ucdavis.edu/presentation2016/Rafael-10-07-2016.pdf · 10/7/2016 · 2016 SUMMER INTERNSHIP @ Rafael Lourenço October 7th,](https://reader033.fdocuments.us/reader033/viewer/2022060409/5f101f617e708231d4478ed3/html5/thumbnails/2.jpg)
10/7/162
(...)
• Some products are handled by the same organizational structure (aka team)
• Each team mighthave its own developers, managers, commercial people, etc...
![Page 3: 2016 SUMMER INTERNSHIP - UC Davis: Networks Labnetworks.cs.ucdavis.edu/presentation2016/Rafael-10-07-2016.pdf · 10/7/2016 · 2016 SUMMER INTERNSHIP @ Rafael Lourenço October 7th,](https://reader033.fdocuments.us/reader033/viewer/2022060409/5f101f617e708231d4478ed3/html5/thumbnails/3.jpg)
Google Platforms• Most teams within the Platforms group exist to serve other product
teams in Google, e.g.:• Infrastructure software: Borg, MapReduce, GFS, FlumeJava,
BigTable, etc...• Infrastructure hardware: Servers, Racks, Cooling systems,
Chips (TCUs), etc...• Networking hardware and software• Operations
10/7/163
![Page 4: 2016 SUMMER INTERNSHIP - UC Davis: Networks Labnetworks.cs.ucdavis.edu/presentation2016/Rafael-10-07-2016.pdf · 10/7/2016 · 2016 SUMMER INTERNSHIP @ Rafael Lourenço October 7th,](https://reader033.fdocuments.us/reader033/viewer/2022060409/5f101f617e708231d4478ed3/html5/thumbnails/4.jpg)
Google Platforms and other TeamsEx: Google Search Autocomplete
10/7/164
ToimplementAutocomplete
functionality,GoogleSearchTeamneeds
lowlatency
DelegatesconstructionofnewDatacenters
GooglePlatformsdeploysnew
Datacenters:design(”manufacture”)servers,networkconfiguration,operation,etc.
![Page 5: 2016 SUMMER INTERNSHIP - UC Davis: Networks Labnetworks.cs.ucdavis.edu/presentation2016/Rafael-10-07-2016.pdf · 10/7/2016 · 2016 SUMMER INTERNSHIP @ Rafael Lourenço October 7th,](https://reader033.fdocuments.us/reader033/viewer/2022060409/5f101f617e708231d4478ed3/html5/thumbnails/5.jpg)
The Datacenter as a Computer
10/7/165
B4
B2
DC
DC
DC
ISP1
ISP2
EventuallytoB4andB2
Jupiter
SuperBlock
SpineBlocks
SuperBlock
![Page 6: 2016 SUMMER INTERNSHIP - UC Davis: Networks Labnetworks.cs.ucdavis.edu/presentation2016/Rafael-10-07-2016.pdf · 10/7/2016 · 2016 SUMMER INTERNSHIP @ Rafael Lourenço October 7th,](https://reader033.fdocuments.us/reader033/viewer/2022060409/5f101f617e708231d4478ed3/html5/thumbnails/6.jpg)
SDN @Google• SDN implementation started several years ago: already a well
established technology• B4 and Jupiter: fully SDN• Each domain has its control plane, each control plane has several
pieces of specialized software
10/7/166
![Page 7: 2016 SUMMER INTERNSHIP - UC Davis: Networks Labnetworks.cs.ucdavis.edu/presentation2016/Rafael-10-07-2016.pdf · 10/7/2016 · 2016 SUMMER INTERNSHIP @ Rafael Lourenço October 7th,](https://reader033.fdocuments.us/reader033/viewer/2022060409/5f101f617e708231d4478ed3/html5/thumbnails/7.jpg)
My Internship ProjectDeveloped a tool to perform a time-continuous assessment ofGoogle's Software Defined Networks. This tool checked how differentnetwork properties evolved in a timeline. This computational-intensivetask was distributed across several machines using Flume, a Google library that creates highly efficient parallel data-processing pipelines.
10/7/167
![Page 8: 2016 SUMMER INTERNSHIP - UC Davis: Networks Labnetworks.cs.ucdavis.edu/presentation2016/Rafael-10-07-2016.pdf · 10/7/2016 · 2016 SUMMER INTERNSHIP @ Rafael Lourenço October 7th,](https://reader033.fdocuments.us/reader033/viewer/2022060409/5f101f617e708231d4478ed3/html5/thumbnails/8.jpg)
Next Challenges• General:
Ø Run the networks as hot as possibleØ Make latency as small as possible
• Specific – Colorless, Directionless, Contention-less ROADMs:Ø How to coordinate L2 and L3 restoration? (Should repair be
made on L3 or L2?)Ø What is the availability improvement of CDC? Capacity
utilization improvement? How much cheaper?Ø Demand forecast unpredictable: what is a good buffer
strategy for capacity allocation?10/7/168