SelfAProgramming&Networks · D? 2B5H9D @EC8 75D 1 >5G
Transcript of SelfAProgramming&Networks · D? 2B5H9D @EC8 75D 1 >5G
Balaji&Prabhakar&and&Mendel&RosenblumDepartments&of&Electrical&Engineering&and&Computer&Science
Stanford&University
SelfAProgramming&Networks:Review&+&Next&Steps&(Smart&NICs)
A"quest"to"make"networks"autonomous:"network"should"sense"and"monitor"itself;"program"and"control"itselfinteractive: network"should"be"simple"and"fun"to"use,"especially"for"3rd party"users
Self=Programming"Networks
SPN""""""""="""""""""Engineering"""+""""Design"Autonomy• Systems• Programs• ML/AI"Algorithms
Interactivity• Visual• Transparent• “Friendly"and"chatty”
Plain&Old&Volkswagen&Tuareg
StanleyThe&Self8Driving&Car
Sense%+%Control
Self-Driving%Cars
Plain&Old&Data&CenterWorkload
Sense Control
App App
Interactive4
Dashboard4&
Query4Engine
Self0Programming&Network&(SPN)
SPN
App
SPN
App
App
Sense,4Infer,4Learn4and4Control4(SILC)
New&FunctionalityTimestamping4As4A4Service
FineHgrained4Network4Telemetry
AppHNetwork4Perf4Monitoring
Operator
Policies
SPN
App
SPN
App
Plain&Old&Data&CenterWorkload
Sense Control
App App
Interactive4Dashboard4&Query4Engine
Self0Programming&Network&(SPN)
App
Sense,4Infer,4Learn4and4Control4(SILC)
New&FunctionalityTimestamping4As4A4Service
FineFgrained4Network4TelemetryAppFNetwork4Perf4Monitoring
Intuitive&DB&and&QE• Simple4+4visual4+4chatty4• App+network perf4views
Data&and&ML&Intensive• Use4data4and4NNs4to4
accelerate4learning4and4for4realFtime4processing
NIC0centric&Architecture• Sensing4and4control4at4NICs4
Smart4NICs:4big4industry4trend
SPNApp
SPNApp
SPNApp
SPNApp
Milestones
Yilong Geng:*Dec*2018
Self%Programming.Networks:.Architecture.and.Algorithms
Zi Yin:*Dec*2018
Understanding.the.Functionality,.Dimensionality.and.Domain.Adaptation.of.Word.Embeddings:Towards a.Better.Chatbot.for.Networking.Applications
Graduations
Y.#Geng,#S.#Liu,#Z.#Yin,#A.#Naik,#B.#Prabhakar#and#M.#Rosenblum:“Self&Programming/Networks:/Architecture/and/Algorithms,”/Allerton/2017Y.#Geng,#S.#Liu,#Z.#Yin,#A.#Naik,#B.#Prabhakar,#M.#Rosenblum#and#A.#Vahdat:
“Exploiting/a/Natural/Network/Effect/for/Scalable,/Accurate/Clock/Synchronization,”/USENIX/NSDI/2018Z.#Yin,#V.#Sachidananda and#B.#Prabhakar:
“The/Global/Anchor/Method/for/Quantifying/Linguistic/Shifts/and/Domain/Adaptation,”/NeurIPS 2018Y.#Geng,#S.#Liu,#Z.#Yin,#A.#Naik,#B.#Prabhakar,#M.#Rosenblum#and#A.#Vahdat:
“SIMON:/A/Simple,/Scalable/Method/for/Sensing,/Inference/and/Measurement/in/Data/Center/Networks,”/USENIX/NSDI/2019,/to/appear
Shiyu Liu:#ClockchainFeiran Wang:#Multi&Raft,/Distributed/TracingVig and#Vin#Sachidananda:#Chatbots/for/Networking/ApplicationsSean#Choi,#Shiyu Liu#and#Muhammad#Shahbaz:#Smart/NICs
Papers#and#Projects
Applications+to+FinTech
VOL. CLXVII . . . No. 58,009 © 2018 The New York Times Company NEW YORK, SATURDAY, JUNE 30, 2018
U(D54G1D)y+?!.!]!#!:
Years ago, Joe Kieta was out todinner at a nice restaurant withhis wife, celebrating their secondanniversary.
Mr. Kieta, then the editor of TheMerced Sun-Star in Merced, Calif.,had just published a series of arti-cles that led to the ouster of the lo-cal district attorney. As he waseating, a friend of the district at-torney showed up and asked Mr.Kieta to go outside.
The man “challenged me to afight right in the middle of thisfancy restaurant,” Mr. Kieta, nowthe editor of The Fresno Bee inCalifornia, said on Friday.
The fatal shooting a day earlierat The Capital Gazette in Annapo-lis, Md., reverberated throughoutnewsrooms across the country,not only for its tragedy but also for
the familiarity of conflicts like thesuspected gunman’s long-runningfeud with the paper. Many report-ers and editors, especially at thelocal level, have stories of beingconfronted or harassed by a resi-dent upset by something in thenewspaper. Unlike Thursday’sshooting, in which five peoplewere killed, few of these situationsend in violence.
The suspect, Jarrod W. Ramos,38, had hounded the paper foryears, after the publication of anarticle about his conviction in acriminal harassment case involv-ing online threats against a for-mer classmate. He filed lawsuits,posted highly personal commentsabout reporters online and rou-tinely intimated violence on social
In Gunman’s Rage, SomethingEerily Familiar for Newsrooms
By TIM ARANGO and JOHN HERRMAN
Continued on Page A14
SAN FRANCISCO — Computerscientists at Stanford Universityand Google have created technol-ogy that can track time down to100 billionths of a second. It couldbe just what Wall Street is lookingfor.
System engineers at Nasdaq,the New York-based stock ex-change, recently began testing analgorithm and software that theyhope can synchronize a giant net-work of computers with that nano-second precision. They say theyhave built a prototype, and are inthe process of deploying a biggerversion.
For an exchange like Nasdaq,such refinement is essential to ac-curately order the millions ofstock trades that are placed ontheir computer systems every
second.Ultimately, this is about money.
With stock trading now domi-nated by computers that makebuying and selling decisions andexecute them with blazing speed,keeping that order also meansprotecting profits. So-called high-frequency trading firms placetrades in a fraction of a second,sometimes in a bet that they canmove faster than bigger competi-tors.
The pressure to manage thesehigh-speed trades grows when thestock market becomes more vola-tile, as it has been in recentmonths, in part to prevent thefastest traders from taking unfairadvantage of slower firms. High-frequency traders typically ac-
Whittling a New York MinuteTo 100 Billionths of a Second
By JOHN MARKOFF
Continued on Page A17
WASHINGTON — In the daysafter the F.B.I. director James B.Comey was fired last year, thedeputy attorney general, Rod J.Rosenstein, repeatedly expressedanger about how the White Houseused him to rationalize the firing,saying the experience damagedhis reputation, according to fourpeople familiar with his outbursts.
In public, Mr. Rosenstein hasshown no hint that he had secondthoughts about his role — writinga memo about Mr. Comey’s per-formance that the White Houseused to justify firing him. “I wroteit. I believe it. I stand by it,” Mr.Rosenstein said to Congress lastyear.
But in meetings with law en-forcement officials in the chaoticdays immediately after Mr.
Comey’s dismissal, and in subse-quent conversations with col-leagues and friends, Mr. Rosen-stein appeared conflicted, accord-ing to the four people.
He alternately defended his in-volvement, expressed remorse atthe tumult it unleashed, said theWhite House had manipulatedhim, fumed how the news mediahad portrayed the events and saidthe full story would vindicate him,said the people, who in recentweeks described the previouslyundisclosed episodes.
According to one person withwhom he spoke shortly after Mr.Comey’s firing, Mr. Rosensteinwas “shaken,” “unsteady” and“overwhelmed.”
Another person in touch with
Firing of Comey Left RosensteinFeeling ‘Shaken’ and Exploited
By MICHAEL S. SCHMIDT and ADAM GOLDMAN
Continued on Page A16
General Motors warned Fridaythat if President Trump pushedahead with another wave of tar-iffs, the move could backfire, lead-ing to “less investment, fewer jobsand lower wages” for its employ-ees.
The automaker said that thepresident’s threat to impose tar-iffs on imports of cars and carparts — along with an earlierspate of penalties — could drivevehicle prices up by thousands ofdollars. The “hardest hit” cars,General Motors said in commentssubmitted to the Commerce De-partment, are likely to be the onesbought by consumers who canleast afford an increase. Demandwould suffer and productionwould slow, all of which “couldlead to a smaller G.M.”
The president has promotedtariffs as a way to protect Ameri-can businesses and workers, aim-ing at dozens of nations with metaltariffs, as well as bringing broaderlevies against Chinese goods. Butcompanies, which rely on othermarkets for sales, production andmaterials, have been increasinglyvocal about the potential damagefrom his policies.
The warning by G.M., echoed incomments by trade groups andother automakers, could test thepresident’s aggressive approachto trade and his commitment tobusiness. In the past, Mr. Trumphas lauded General Motors for itsjob creation and vowed to defendthe auto industry.
A G.M. spokeswoman, DaynaHart, said that the company hadno contingency plans calling forjob cuts, but that such a move was“something that could happen.”
“We are still assessing the im-pact,” she added.
The White House did not re-spond to a request for comment.
G.M. and other industry leadersare caught in the middle of an es-calating trade war that hasprompted retaliation from the Eu-ropean Union, Mexico, Canadaand China.
Last month, Mr. Trump orderedan investigation into whether im-ported cars and automotive com-ponents pose a national securityrisk, calling for penalties expectedto be as high as 25 percent. The ad-ministration has already put lev-ies on imported steel and alu-minum, and is about place tariffs
G.M. TELLS TRUMPTARIFF PLAN PUTS
U.S. JOBS AT RISK
CAUGHT IN TRADE WAR
Warns Auto Prices CouldRise by Thousands,
Sapping Demand
By TIFFANY HSU
LONDON — Arron Banks, aBritish financier who bankrolledthe campaign for Britain to leavethe European Union, has longbragged about his “boozy six-hour lunch” with the Russian am-bassador eight months before thevote.
Some also wondered about Mr.Banks’s Russian-born wife andtheir custom license plate, X MI5SPY, after the British intelligenceagency, MI5. But Mr. Banks al-ways laughed off questions abouthis ties to the Kremlin.
Now, a leaked record of some ofMr. Banks’s emails suggest thathe and his closest adviser had amore engaged relationship withRussian diplomats than he hasdisclosed.
While Mr. Banks was spendingmore than eight million Britishpounds to promote a break withthe European Union — an out-come the Russians eagerly hopedfor — his contacts at the RussianEmbassy in London were openingthe door to at least three poten-tially lucrative investment oppor-tunities in Russian-owned gold ordiamond mines.
One of Mr. Banks’s businesspartners, and a fellow backer ofBritain’s exit from the EuropeanUnion, or Brexit, took the Rus-sians up on at least one of thedeals.
The extent of these businessdiscussions, which have not beenpreviously reported, raises newquestions about whether theKremlin sought to reward criticalfigures in the Brexit campaign.Much as in Washington, where in-vestigations are underway intothe possibility that Donald J.Trump’s campaign may have co-operated with the Russians, Brit-ain is now grappling with whetherMoscow tried to use its close tieswith any British citizens to pro-mote Brexit.
In Washington, the investiga-tors for the special prosecutor,Robert S. Mueller III, and Demo-crats on the House IntelligenceCommittee have also obtainedrecords of Mr. Banks’s communi-cations, including some with Rus-sian diplomats and about Russianbusiness deals.
And they have taken a specialinterest in close ties Mr. Banksand other Brexit leaders built to
KREMLIN’S LINKSTO BREXIT PUSH
GET A NEW LOOK
COURTING BANKROLLERS
Parallels to U.S. Inquiryas Investigators Focus
on 2016 Meeting
By DAVID D. KIRKPATRICKand MATTHEW ROSENBERG
Continued on Page A9
LAETITIA VANCON FOR THE NEW YORK TIMES
American soldiers in Eastern Europe holding training exercises to combat Russia’s military might and manipulation tactics. Page A7.Battling Tanks, Troops and Twisted Truths
GUADALAJARA, Mexico —Andrés Manuel López Obradornodded at the sea of red T-shirtsand flag-waving devoteesjammed into a plaza in Guadalaja-ra.
Never before had such a crowdwelcomed him here. In his previ-ous campaigns for the president’soffice, residents of Guadalajara,the wealthy capital of the state ofJalisco, shunned him, considering
his leftist platform too radical.But this time, only days before
one of Mexico’s most importantelections in decades, the cheersreflected a nationwide shift — andthe ability of Mr. López Obrador toride it.
“We have had three transfor-mations in the history of our coun-try: our independence, the reformand the revolution,” he told thecrowd. “We are going to pull offthe fourth.”
As corruption and violencegnaw at Mexico’s patience, voters
have turned to a familiar face inMr. López Obrador, a three-timecandidate for president who onceshut down Mexico City for monthsafter a narrow loss, refusing to ac-cept defeat.
Brandishing a deep connectionwith the poor, built over more thana decade of visits to every cornerof this country of 120 million, hehas managed a staggering leadahead of Sunday’s vote.
If the poll numbers bear out onElection Day, Mr. López Obrador— who has promised to sell the
presidential plane and convert theopulent presidential palace into apublic park — could win by a land-slide, putting a leftist leader incharge of Latin America’s second-largest country for the first time indecades.
He is currently 20 to 30 percent-age points ahead of his closest ri-val, a stunning reversal for a poli-tician whose future was far fromclear just a few years ago. But abroad disgust with Mexico’s poli-tical establishment has brought
Once Deemed Too Radical for Mexico, He Now May Be PresidentBy AZAM AHMED
The presidential candidate Andrés Manuel López Obrador during the closing rally of his campaign on Wednesday in Mexico City.ALFREDO ESTRELLA/AGENCE FRANCE-PRESSE — GETTY IMAGES
Continued on Page A8
Months after accusing powerful men ofabuse, 20 people, including AshleyJudd, above, share how saying #MeToochanged their lives.
THIS WEEKEND
Special Section
Continued on Page A17
Chief Ronald R. Spadafora, who keptrescue workers safe at ground zero,died of blood cancer at 63. PAGE A19
NEW YORK A18-20
9/11 Safety Chief Laid to Rest
Despite making no commitments, theagreement seemed to be enough to saveChancellor Angela Merkel of Germanywhile appeasing Italy. PAGE A7
INTERNATIONAL A4-9
E.U. Reaches Migration Deal
As delivery services ramp up, one giantcompany’s goal is to keep your friessucculent for up to 60 minutes. PAGE B1
BUSINESS DAY B1-8
Mission: Crispy for an Hour
LeBron James might join a new team,instantly boosting the fortunes of a cityand its N.B.A. franchise. Or he mightstay in Cleveland. PAGE D1
SPORTSSATURDAY D1-6
The N.B.A.’s Decider
The mayor’s proposal to drop the testfor the city’s elite high schools couldupend its elite middle schools. PAGE A18
Tough Math in School PlanA bold plan to gain greater global influ-ence by funding big projects is laggingas China grows cautious. PAGE B1
China Curtails Lending Spree
A ruling in a Kentucky case may affectother states’ efforts to require the poorto work to get health care. PAGE A16
NATIONAL A10-17
Medicaid Work Rule Blocked
Midterm votes brought a wave of pro-gressive female candidates powered bystrong personal narratives. PAGE A11
Riding an Outsider Wave
“Bao,” running with “Incredibles 2,” isabout a Chinese dumpling and a moth-er’s love. The director says, “Part of mewanted to shock audiences.” PAGE C1
ARTS C1-7
In a Pixar Short, a Dark Twist
Dave Eggers PAGE A23
EDITORIAL, OP-ED A22-23
Late EditionToday, sunny to partly cloudy, hot,humid, high 94. Tonight, clear, verywarm, humid, low 78. Tomorrow,hazy sunshine, very hot, humid,high 98. Weather map, Page A20.
$3.00
dinner at a nice restaurant withhis wife, celebrating their secondanniversary.
Merced Sun-Star in Merced, Calif.,had just published a series of arti-cles that led to the ouster of the lo-cal district attorney. As he waseating, a friend of the district at-torney showed up and asked Mr.Kieta to go outside.
fight right in the middle of thisfancy restaurant,” Mr. Kieta, nowthe editor of The Fresno Bee inCalifornia, said on Friday.
at The Capital Gazette in Annapo-lis, Md., reverberated throughoutnewsrooms across the country,not only for its tragedy but also for
In Gunman’s Rage, Something
SAN FRANCISCO — Computerscientists at Stanford Universityand Google have created technol-ogy that can track time down to100 billionths of a second. It couldbe just what Wall Street is lookingfor.
System engineers at Nasdaq,the New York-based stock ex-change, recently began testing analgorithm and software that theyhope can synchronize a giant net-work of computers with that nano-second precision. They say theyhave built a prototype, and are inthe process of deploying a biggerversion.
For an exchange like Nasdaq,such refinement is essential to ac-curately order the millions ofstock trades that are placed ontheir computer systems every
second.Ultimately, this is about money.
With stock trading now domi-nated by computers that makebuying and selling decisions andexecute them with blazing speed,keeping that order also meansprotecting profits. So-called high-frequency trading firms placetrades in a fraction of a second,sometimes in a bet that they canmove faster than bigger competi-tors.
The pressure to manage thesehigh-speed trades grows when thestock market becomes more vola-tile, as it has been in recentmonths, in part to prevent thefastest traders from taking unfairadvantage of slower firms. High-frequency traders typically ac-
Whittling a New York MinuteTo 100 Billionths of a Second
By JOHN MARKOFF
Continued on Page A17
Comey’s dismissal, and in subse-quent conversations with col-leagues and friends, Mr. Rosen-stein appeared conflicted, accord-
He alternately defended his in-volvement, expressed remorse atthe tumult it unleashed, said theWhite House had manipulatedhim, fumed how the news mediahad portrayed the events and saidthe full story would vindicate him,said the people, who in recentweeks described the previously
According to one person withwhom he spoke shortly after Mr.Comey’s firing, Mr. Rosensteinwas “shaken,” “unsteady” and
Another person in touch with
Feeling ‘Shaken’ and Exploited
Today, sunny to partly cloudy, hot,humid, high 94. Tonight, clear, verywarm, humid, low 78. Tomorrow,hazy sunshine, very hot, humid,high 98. Weather map, Page A20.
$3.00
dinner at a nice restaurant withhis wife, celebrating their secondanniversary.
Merced Sun-Star in Merced, Calif.,had just published a series of arti-cles that led to the ouster of the lo-cal district attorney. As he waseating, a friend of the district at-torney showed up and asked Mr.Kieta to go outside.
fight right in the middle of thisfancy restaurant,” Mr. Kieta, nowthe editor of The Fresno Bee inCalifornia, said on Friday.
at The Capital Gazette in Annapo-lis, Md., reverberated throughoutnewsrooms across the country,not only for its tragedy but also for
In Gunman’s Rage, Something
SAN FRANCISCO — Computerscientists at Stanford Universityand Google have created technol-ogy that can track time down to100 billionths of a second. It couldbe just what Wall Street is lookingfor.
System engineers at Nasdaq,the New York-based stock ex-change, recently began testing analgorithm and software that theyhope can synchronize a giant net-work of computers with that nano-second precision. They say theyhave built a prototype, and are inthe process of deploying a biggerversion.
For an exchange like Nasdaq,such refinement is essential to ac-curately order the millions ofstock trades that are placed ontheir computer systems every
second.Ultimately, this is about money.
With stock trading now domi-nated by computers that makebuying and selling decisions andexecute them with blazing speed,keeping that order also meansprotecting profits. So-called high-frequency trading firms placetrades in a fraction of a second,sometimes in a bet that they canmove faster than bigger competi-tors.
The pressure to manage thesehigh-speed trades grows when thestock market becomes more vola-tile, as it has been in recentmonths, in part to prevent thefastest traders from taking unfairadvantage of slower firms. High-frequency traders typically ac-
Whittling a New York MinuteTo 100 Billionths of a Second
By JOHN MARKOFF
Continued on Page A17
Comey’s dismissal, and in subse-quent conversations with col-leagues and friends, Mr. Rosen-stein appeared conflicted, accord-
He alternately defended his in-volvement, expressed remorse atthe tumult it unleashed, said theWhite House had manipulatedhim, fumed how the news mediahad portrayed the events and saidthe full story would vindicate him,said the people, who in recentweeks described the previously
According to one person withwhom he spoke shortly after Mr.Comey’s firing, Mr. Rosensteinwas “shaken,” “unsteady” and
Another person in touch with
Feeling ‘Shaken’ and Exploited
Today, sunny to partly cloudy, hot,humid, high 94. Tonight, clear, verywarm, humid, low 78. Tomorrow,hazy sunshine, very hot, humid,high 98. Weather map, Page A20.
$3.00
Focus&so&far:&Sense&and&Infer
Future&focus:&Learn&and&Control&using&Smart&NICs
Applications
DC-Interconnect-Fabric
NIC4centric-Architecture:-Sense,-Infer,-Learn-and-Control
App-1
App-2
App-3
Sense,Infer
Learn,Control
Deliberate)Control• Acts)on)a)collection(or(group(of)NICs)• To)achieve)a)common(global(objective• Involves)computation)or)decision4making(with(global(knowledge• Generally)applied)over)longer(timescales• Networking(analogy:((Management)plane• Financial(trading(analogy:((Market)data)! trading)strategy)
(performed)in)large)compute)clusters)Reflex)Control
• Applied)at)a)single)NIC• To)perform)local)tasks)derived)from/consistent)with)global)objective• Relies)on)local)information)at)the)given)NIC• Generally)applied)on)every)packet)or)roundFtrip)time)or)…)• Networking(analogy:((Data)plane• Financial(trading(analogy:((trading)strategy)! buy/sell)bids
(performed)in)FPGAs)in)coFlo)facilities)
Two$tier)Control)Architecture
Instantaneous Episodic
Local,Single3NIC
Global,Group3of3NICs
Space
Time
ReflexControl
DeliberateControl
First,'use'NICs'to'sense'and'infer'network'state• Synchronize'clocks'on'NICs'(Huygens)• Use'synced'clocks'and'edge?based'measurements'to'infer'network'state'(SIMON)• Note: both'Huygens'and'SIMON'are'amenable'to'the'two?tier'architecture'
! Implement'them'in'Smart'NICs'as'co?ordinated distributed'systems
Then,'devise'and'apply'control;'working'on• Controlling'RDMA'flows• Congestion'control'with'source'routing
Roadmap
Shiyu Liu:((Smart(NICs(I• Deliberate(control:(Implementation(of(the(Huygens(algorithm
using(Mellanox(and(Broadcom(NICs(
Sean(Choi:(Smart(NICs(II• Reflex(control:(Profiling(serverless(compute(workloads((
with(P4(on(Netronome NICs
Shiyu Liu:((SIMON(with(CPU(time(stamps(vs(NIC(time(stamps• A(comparative(study(of(accuracy(of(network(state(reconstruction(on(CloudLab
Remaining(Talks