Machine learning, social learning and self-driving...

74
@JackS’lgoe Machine learning, social learning and self-driving cars

Transcript of Machine learning, social learning and self-driving...

Page 1: Machine learning, social learning and self-driving carssciencepolicy.colorado.edu/news/presentations/stilgoe2.pdfself-driving cars Outline ... future through the stewardship of innovaon

@JackS'lgoe

Machinelearning,sociallearningandself-drivingcars

Page 2: Machine learning, social learning and self-driving carssciencepolicy.colorado.edu/news/presentations/stilgoe2.pdfself-driving cars Outline ... future through the stewardship of innovaon

Outline

•  Responsibleinnova'onassociallearning•  Socialisingmachinelearning•  Self-drivingasa‘solvableproblem’•  Self-drivingasmisnomer•  Limitstoresponsiveness

Page 3: Machine learning, social learning and self-driving carssciencepolicy.colorado.edu/news/presentations/stilgoe2.pdfself-driving cars Outline ... future through the stewardship of innovaon
Page 4: Machine learning, social learning and self-driving carssciencepolicy.colorado.edu/news/presentations/stilgoe2.pdfself-driving cars Outline ... future through the stewardship of innovaon
Page 5: Machine learning, social learning and self-driving carssciencepolicy.colorado.edu/news/presentations/stilgoe2.pdfself-driving cars Outline ... future through the stewardship of innovaon
Page 6: Machine learning, social learning and self-driving carssciencepolicy.colorado.edu/news/presentations/stilgoe2.pdfself-driving cars Outline ... future through the stewardship of innovaon

Source:electrek.com

Page 7: Machine learning, social learning and self-driving carssciencepolicy.colorado.edu/news/presentations/stilgoe2.pdfself-driving cars Outline ... future through the stewardship of innovaon

“Perfectsafetyisreallyanimpossiblegoal.”ElonMusk,Sept2016

Page 8: Machine learning, social learning and self-driving carssciencepolicy.colorado.edu/news/presentations/stilgoe2.pdfself-driving cars Outline ... future through the stewardship of innovaon
Page 9: Machine learning, social learning and self-driving carssciencepolicy.colorado.edu/news/presentations/stilgoe2.pdfself-driving cars Outline ... future through the stewardship of innovaon

Being“inBeta”“Becausetheprobabilityissosmall,thereisnoprac'calpossibilityofdeterminingthisfailureratedirectly-i.e.,bybuilding,letussay,1,000reactors,opera'ngthemfor10,000yearsandtabula'ngtheiropera'nghistories”.

(AlvinWeinberg,1972)“Eachnuclearpowerplantisitsowntestcase.Itmaybecategorizedasanimplicitexperiment,anditsmostrevealingcaseistheaccident”.

(KrohnandWeingart,1987)

“Emergingprac'cesdefine‘rules’,ratherthanrulescontrollingprac'ces.“

(Wynne1988)

Page 10: Machine learning, social learning and self-driving carssciencepolicy.colorado.edu/news/presentations/stilgoe2.pdfself-driving cars Outline ... future through the stewardship of innovaon
Page 11: Machine learning, social learning and self-driving carssciencepolicy.colorado.edu/news/presentations/stilgoe2.pdfself-driving cars Outline ... future through the stewardship of innovaon

Thewhat,thehowandthewhyofinnova'on

Products•  Whatarethelikelyrisks

andbenefits?•  Howwilltherisksand

benefitsbedistributed?•  Whatotherimpactscan

wepredict?•  Howmightthese

changeinthefuture?•  Whatdon’tweknow

about?•  Whatmightwenever

knowabout?

Processes•  Howshouldresearch

andinnova'ontakeplace?

•  Howshouldstandardsbedrawnupandapplied?

•  Howshouldrisksandbenefitsbedefinedandmeasured?

•  Whoisincontrol?•  Whowilltake

responsibilityifthingsgowrong?

•  Whatifwearewrong?

Purposes•  Whyshouldthis

researchbeundertaken?

•  Whowillbenefit?•  Whatarethe

alterna'ves?

Page 12: Machine learning, social learning and self-driving carssciencepolicy.colorado.edu/news/presentations/stilgoe2.pdfself-driving cars Outline ... future through the stewardship of innovaon

Responsibleinnova'onis‘collec'vecareforthefuturethroughthestewardshipofinnova'oninthepresent’

(S'lgoe,OwenandMacnaghten2013)(alsoS'lgoeandGuston2016)

Page 13: Machine learning, social learning and self-driving carssciencepolicy.colorado.edu/news/presentations/stilgoe2.pdfself-driving cars Outline ... future through the stewardship of innovaon

An'cipa'on Inclusion

Reflexivity Responsiveness

Responsibleinnova'on

Page 14: Machine learning, social learning and self-driving carssciencepolicy.colorado.edu/news/presentations/stilgoe2.pdfself-driving cars Outline ... future through the stewardship of innovaon

Limitstoresponsiveness

•  Inflexibility,irreversibility,commitmentandotherformsoflock-in

•  Lackofreflexivity•  ‘Ins'tu'onalvoid’(Hajer)•  Presump'onsofnoveltyactagainstlearning(Rayner)

Page 15: Machine learning, social learning and self-driving carssciencepolicy.colorado.edu/news/presentations/stilgoe2.pdfself-driving cars Outline ... future through the stewardship of innovaon

Approachestosociallearning

1.  Engineering–machineslearnaboutsociety2.  Educa'onal–learninghappenssocially3.  Ins'tu'onal– socialsystemsneedtolearn– AircrabvsNuclearpower(Perrow)

4.  Poli'cal– learningtakesplaceinpublic–  ‘Experimentalgovernment’(Deweyetal)

Page 16: Machine learning, social learning and self-driving carssciencepolicy.colorado.edu/news/presentations/stilgoe2.pdfself-driving cars Outline ... future through the stewardship of innovaon

Socialisingmachinelearning

Page 17: Machine learning, social learning and self-driving carssciencepolicy.colorado.edu/news/presentations/stilgoe2.pdfself-driving cars Outline ... future through the stewardship of innovaon

What’snew?

Page 18: Machine learning, social learning and self-driving carssciencepolicy.colorado.edu/news/presentations/stilgoe2.pdfself-driving cars Outline ... future through the stewardship of innovaon

2015

Page 19: Machine learning, social learning and self-driving carssciencepolicy.colorado.edu/news/presentations/stilgoe2.pdfself-driving cars Outline ... future through the stewardship of innovaon

GartnerHypeCycle2015

Page 20: Machine learning, social learning and self-driving carssciencepolicy.colorado.edu/news/presentations/stilgoe2.pdfself-driving cars Outline ... future through the stewardship of innovaon

Levelsofautoma'on

Page 21: Machine learning, social learning and self-driving carssciencepolicy.colorado.edu/news/presentations/stilgoe2.pdfself-driving cars Outline ... future through the stewardship of innovaon

“Howquicklycanwegetthisintopeople’shands?Ifyoureadthepapers,youseemaybeit’sthreeyears,maybeit’sthirtyyears.AndIamheretotellyouthathonestly,it’sabitofboth,”

ChrisUrmson(ex-Google),March2016

Page 22: Machine learning, social learning and self-driving carssciencepolicy.colorado.edu/news/presentations/stilgoe2.pdfself-driving cars Outline ... future through the stewardship of innovaon

‘Solving’self-driving

Page 23: Machine learning, social learning and self-driving carssciencepolicy.colorado.edu/news/presentations/stilgoe2.pdfself-driving cars Outline ... future through the stewardship of innovaon

Source:TheEconomist,2016

Ifsafetyistheques'on,areself-drivingcarstheanswer?

Page 24: Machine learning, social learning and self-driving carssciencepolicy.colorado.edu/news/presentations/stilgoe2.pdfself-driving cars Outline ... future through the stewardship of innovaon

SeeinglikeaTesla

Page 25: Machine learning, social learning and self-driving carssciencepolicy.colorado.edu/news/presentations/stilgoe2.pdfself-driving cars Outline ... future through the stewardship of innovaon

MobileyeandTeslapartcompany“Weneedtobethereonallaspectsofhowthetechnologyisbeingused,andnotsimplyprovidingtechnology”“Thisincidentinvolvedalaterallycrossingvehicle,whichcurrent-genera'onAEB[automa'cemergencybraking]systemsarenotdesignedtoactuateupon”

Mobileye

“AutonomousvehiclesisanAIcompu'ngproblem.It’snotadetec'onproblem”

Nvidia

Page 26: Machine learning, social learning and self-driving carssciencepolicy.colorado.edu/news/presentations/stilgoe2.pdfself-driving cars Outline ... future through the stewardship of innovaon

Modesofautomo'velearningRule-following Rule-making

‘Autonomousvehicles’? Technicalandpoli'calentanglement

Technicalandpoli'cal‘autonomy’

Modesofmachinelearning

Formallogic End-to-endlearning

RelevantExperDse Domainexper'se,ergonomicsetc

Drivingasagame

Pedagogy Tradi'onal Autodidac'c

SocialconsDtuDon Favoursincumbents Upstartsandstart-ups

Strategy Incrementalinnova'on Disrup've,permissionlessinnova'on

Historicaltouchpoints Automatedhighways DARPAGrandChallenges

Page 27: Machine learning, social learning and self-driving carssciencepolicy.colorado.edu/news/presentations/stilgoe2.pdfself-driving cars Outline ... future through the stewardship of innovaon

Escapingtheriskframe

Page 28: Machine learning, social learning and self-driving carssciencepolicy.colorado.edu/news/presentations/stilgoe2.pdfself-driving cars Outline ... future through the stewardship of innovaon

Machinecontrolandsocialcontrol

Page 29: Machine learning, social learning and self-driving carssciencepolicy.colorado.edu/news/presentations/stilgoe2.pdfself-driving cars Outline ... future through the stewardship of innovaon

Alterna'velearning

Page 30: Machine learning, social learning and self-driving carssciencepolicy.colorado.edu/news/presentations/stilgoe2.pdfself-driving cars Outline ... future through the stewardship of innovaon
Page 31: Machine learning, social learning and self-driving carssciencepolicy.colorado.edu/news/presentations/stilgoe2.pdfself-driving cars Outline ... future through the stewardship of innovaon
Page 32: Machine learning, social learning and self-driving carssciencepolicy.colorado.edu/news/presentations/stilgoe2.pdfself-driving cars Outline ... future through the stewardship of innovaon
Page 33: Machine learning, social learning and self-driving carssciencepolicy.colorado.edu/news/presentations/stilgoe2.pdfself-driving cars Outline ... future through the stewardship of innovaon

‘It'samazingtechnology…ButTeslashouldn'tmaketheircustomerstest

pilots… [Autopilot]allowsyoutothinkit'sworking.Andatahigherspeed,youcan'treact.It'salreadyhardenoughtoreact

whenyouarefocused,thatwhenyouarenot,anditerrs,it'sover.’

MarkMolthan,crashedAugust2016

Page 34: Machine learning, social learning and self-driving carssciencepolicy.colorado.edu/news/presentations/stilgoe2.pdfself-driving cars Outline ... future through the stewardship of innovaon
Page 35: Machine learning, social learning and self-driving carssciencepolicy.colorado.edu/news/presentations/stilgoe2.pdfself-driving cars Outline ... future through the stewardship of innovaon

Imagineddeficits

Page 36: Machine learning, social learning and self-driving carssciencepolicy.colorado.edu/news/presentations/stilgoe2.pdfself-driving cars Outline ... future through the stewardship of innovaon
Page 37: Machine learning, social learning and self-driving carssciencepolicy.colorado.edu/news/presentations/stilgoe2.pdfself-driving cars Outline ... future through the stewardship of innovaon

Thetyrannyofurgency

We“cannotwaitforperfect…Weshouldbedesperateforanythingwecanfindtosavepeople'slives,"

NHTSAAdministratorMarkRosekind

“Ifanybodylegislatesagainstit,theyshouldprobablygotojail”

EngineerAlainKornhauser

“Speedisoftheessencehere…We’reinaveryimportantraceagainstAsianandEuropeancountriesthataremovingforwardwiththistechnology”

SenatorGaryPeters

Page 38: Machine learning, social learning and self-driving carssciencepolicy.colorado.edu/news/presentations/stilgoe2.pdfself-driving cars Outline ... future through the stewardship of innovaon

‘Dothemath’‘Ifanyonebotheredtodothemath(obviously,youdidnot)theywouldrealizethatoftheover1Mautodeathsperyearworldwide,approximatelyhalfamillionpeoplewouldhavebeensavediftheTeslaautopilotwasuniversallyavailable.Please,take5minsanddothebloodymathbeforeyouwriteanar'clethatmisleadsthepublic.’

ElonMusk,July2016‘If,inwri'ngsomear'clethat'snega've,you...dissuadepeoplefromusinganautonomousvehicle,you'rekillingpeople’

ElonMusk,October2016

Page 39: Machine learning, social learning and self-driving carssciencepolicy.colorado.edu/news/presentations/stilgoe2.pdfself-driving cars Outline ... future through the stewardship of innovaon

Boundingtheexperiment?Broaderenvironment,economyandsociety

Landscape

Infrastructure

Otherroadusers

Otherdrivers

Self-drivingcaranduser

Page 40: Machine learning, social learning and self-driving carssciencepolicy.colorado.edu/news/presentations/stilgoe2.pdfself-driving cars Outline ... future through the stewardship of innovaon

Ques'onsforsociallearning:aresearchagenda

•  Transi'ons•  An'cipa'ngtransportsystemsandcarusage– Whatmightbethepressuresonmachinereadableinfrastructure?

•  Scale•  Thegovernanceofwhat?– Sobware,hardware,system?

Page 41: Machine learning, social learning and self-driving carssciencepolicy.colorado.edu/news/presentations/stilgoe2.pdfself-driving cars Outline ... future through the stewardship of innovaon

An'cipatorygovernance

Page 42: Machine learning, social learning and self-driving carssciencepolicy.colorado.edu/news/presentations/stilgoe2.pdfself-driving cars Outline ... future through the stewardship of innovaon
Page 43: Machine learning, social learning and self-driving carssciencepolicy.colorado.edu/news/presentations/stilgoe2.pdfself-driving cars Outline ... future through the stewardship of innovaon

Histories •  Pre-history(Wetmore2003;Vinsel,forthcoming)

–  Integra'ngvehiclesandinfrastructure•  Automa'onofcarsystems

–  Airbags–  ABS/Trac'oncontrol–  Cruisecontrol–  ADAS

•  2004,2005,2007:Darpagrandchallenges•  2008àMachinelearning

–  Neuralnetworksandimagerecogni'on–  GPUs–  Data

Page 44: Machine learning, social learning and self-driving carssciencepolicy.colorado.edu/news/presentations/stilgoe2.pdfself-driving cars Outline ... future through the stewardship of innovaon

Thecomplexityoftransi'ons

•  Closed,homogenoussystemsareeasytoimagine;Mixed,opensystemsarealmostimpossible

•  Thehand-offproblem•  Smarttechcanmakepeopledumb

Page 45: Machine learning, social learning and self-driving carssciencepolicy.colorado.edu/news/presentations/stilgoe2.pdfself-driving cars Outline ... future through the stewardship of innovaon

outline•  Teslaphoto

–  Hardwareandsobware–poli'csofnovelty–  Itisaworkinprogress-learninginpublic–andinnova'ng

•  Crash•  Emergingsociotechnicalsystem•  Responsivenessandsociallearning•  ImaginariesofAVs•  Governance

–  Stateasexperimenter,notjustlaboratory–  Safety–limitstoresponsiveness?–  Data-sharing

•  DataisthecurrencyofAVinnova'on–  Condi'onsforexperimenta'on–  Sobwarevshardware–productliability–  Democra'singimagina'on–  Whobenefits?Whatarelikelytobethetransfersofpowerandmoney?Socialcons'tu'on?

Techaslegisla'on?

Page 46: Machine learning, social learning and self-driving carssciencepolicy.colorado.edu/news/presentations/stilgoe2.pdfself-driving cars Outline ... future through the stewardship of innovaon

PerrowontheNTSB

•  Whydoaeroplanesgetsaferwhilenuclearpowerdoesn’t?– Accidentsarenormal–notout-of-the-blue

•  Learningascrucial– “pastaccidentsalsofailaswarningsifthewarningisavailabletoonlyonepartofthesystem”–andthatwasaproblemwithTMI

Page 47: Machine learning, social learning and self-driving carssciencepolicy.colorado.edu/news/presentations/stilgoe2.pdfself-driving cars Outline ... future through the stewardship of innovaon

Star'ngwithtransport

•  Infrastructure?•  Condi'onsforacceptability?

Page 48: Machine learning, social learning and self-driving carssciencepolicy.colorado.edu/news/presentations/stilgoe2.pdfself-driving cars Outline ... future through the stewardship of innovaon

U.S.AirCarrierSafetyIndices,1920-1975

Page 49: Machine learning, social learning and self-driving carssciencepolicy.colorado.edu/news/presentations/stilgoe2.pdfself-driving cars Outline ... future through the stewardship of innovaon

‘NeverNeutral’

Page 50: Machine learning, social learning and self-driving carssciencepolicy.colorado.edu/news/presentations/stilgoe2.pdfself-driving cars Outline ... future through the stewardship of innovaon
Page 51: Machine learning, social learning and self-driving carssciencepolicy.colorado.edu/news/presentations/stilgoe2.pdfself-driving cars Outline ... future through the stewardship of innovaon
Page 52: Machine learning, social learning and self-driving carssciencepolicy.colorado.edu/news/presentations/stilgoe2.pdfself-driving cars Outline ... future through the stewardship of innovaon
Page 53: Machine learning, social learning and self-driving carssciencepolicy.colorado.edu/news/presentations/stilgoe2.pdfself-driving cars Outline ... future through the stewardship of innovaon

Ethicsandtrolleyproblems

Page 54: Machine learning, social learning and self-driving carssciencepolicy.colorado.edu/news/presentations/stilgoe2.pdfself-driving cars Outline ... future through the stewardship of innovaon

An'cipa'on•  Par'cipatory,notpredic've•  Understandingexpecta'ons,promises

Inclusion•  Publicengagement•  User-driveninnova'on•  Value-centreddesign

Reflexivity• 1stand2ndorder

Responsiveness•  Answeringandreac'ng•  Understandingthepoli'caleconomyofinnova'on

Responsible(researchand)Innova'on

Page 55: Machine learning, social learning and self-driving carssciencepolicy.colorado.edu/news/presentations/stilgoe2.pdfself-driving cars Outline ... future through the stewardship of innovaon
Page 56: Machine learning, social learning and self-driving carssciencepolicy.colorado.edu/news/presentations/stilgoe2.pdfself-driving cars Outline ... future through the stewardship of innovaon
Page 57: Machine learning, social learning and self-driving carssciencepolicy.colorado.edu/news/presentations/stilgoe2.pdfself-driving cars Outline ... future through the stewardship of innovaon
Page 58: Machine learning, social learning and self-driving carssciencepolicy.colorado.edu/news/presentations/stilgoe2.pdfself-driving cars Outline ... future through the stewardship of innovaon
Page 59: Machine learning, social learning and self-driving carssciencepolicy.colorado.edu/news/presentations/stilgoe2.pdfself-driving cars Outline ... future through the stewardship of innovaon

Therulesoftheroad

Page 60: Machine learning, social learning and self-driving carssciencepolicy.colorado.edu/news/presentations/stilgoe2.pdfself-driving cars Outline ... future through the stewardship of innovaon

Newlaboratoryrulesforself-drivingcars?

•  Sobwarevshardware–  Productliabilityrules

•  Ethicalrules–  GermanEthicsCommission

1.  propertydamagebeforepersonalinjury.

2.  noclassifica'onofpeoplebysize,ageetc.

3.  “Ifsomethinghappens,themanufacturerisliable”

•  AIredflags•  Black-boxes

Page 61: Machine learning, social learning and self-driving carssciencepolicy.colorado.edu/news/presentations/stilgoe2.pdfself-driving cars Outline ... future through the stewardship of innovaon

•  Ini'alUSrules.NHTSA:“Theagencydoesnotbelievethatself-drivingvehiclesarecurrentlyreadytobedrivenonpublicroadsforpurposesotherthantes'ng.”…un'lTuesday

•  Responsibilitymovingfromstatetofederallevel– 15-pointvoluntarychecklistformanufacturers

Page 62: Machine learning, social learning and self-driving carssciencepolicy.colorado.edu/news/presentations/stilgoe2.pdfself-driving cars Outline ... future through the stewardship of innovaon
Page 63: Machine learning, social learning and self-driving carssciencepolicy.colorado.edu/news/presentations/stilgoe2.pdfself-driving cars Outline ... future through the stewardship of innovaon
Page 64: Machine learning, social learning and self-driving carssciencepolicy.colorado.edu/news/presentations/stilgoe2.pdfself-driving cars Outline ... future through the stewardship of innovaon

SeeinglikeaTesla

Page 65: Machine learning, social learning and self-driving carssciencepolicy.colorado.edu/news/presentations/stilgoe2.pdfself-driving cars Outline ... future through the stewardship of innovaon

“Ifanything,Uber’sdriversaretheR&DforUber’sdriverlessfuture.Theyarespendingtheirlaborandcapitalinvestments(cars)ontheirownfutureunemployment.”–DouglasRushkoff

Page 66: Machine learning, social learning and self-driving carssciencepolicy.colorado.edu/news/presentations/stilgoe2.pdfself-driving cars Outline ... future through the stewardship of innovaon
Page 67: Machine learning, social learning and self-driving carssciencepolicy.colorado.edu/news/presentations/stilgoe2.pdfself-driving cars Outline ... future through the stewardship of innovaon
Page 68: Machine learning, social learning and self-driving carssciencepolicy.colorado.edu/news/presentations/stilgoe2.pdfself-driving cars Outline ... future through the stewardship of innovaon

•  NewCaliforniarules–talkinBerkeleyabouthowmisguidedthismoveis…•  Thiscouldevenbeaseparatepaper–withHarrySurden?•  Fornow,thepointisthatthingsareframedintermsofsafetyonly

–  Goodtostartwiththis–butaswithTeslastory,askwhatwecanlearnabouttechgoingwrongforthegovernanceoftechgoingright.–  Safetyframeisahugebarriertosociallearning–  WerefusetodemocraDsethediscussionofbenefits

•  •  •  TheCaliforniaDMVoriginallydrabedregula'onsthatdemandedsubstan'alcollabora'onbetweencompaniesandthestateonthetermsand

conductofthesocialexperiment.•  The‘lawlag’isobenactuallyaperformance–‘gexngbehind’thetechnology,beforeitisdefined•  A'ghteningofthesafetyframe•  Makingdeploymentdefinedasusebymembersofthepublic)easier•  AccidentsandDisengagements

–  (Theserequirementsares'llintheregula'ons–don’tunderstandtherepor'ng)•  Mademorepermissive–innova'onmorePermissionless

–  ‘Embracing’thetechnologyactuallymeansdistancingoneselffromit–disengaging•  Presumestechnologiesaredefinedascurrentlyimagined–level4and5,ratherthanawork-in-progress.Presumestechnologicalcompleteness

–  Interes'ngdefini'onof“opera'onaldesigndomain”,asopposedtoreal-worldcondi'ons–  Interes'ngthattrainingisrequiredforAVdrivers–  Languageof‘accidents’hasbeenreplacedbythatof‘collisions’–  Datarecorderincluded

•  •  CaliforniaannouncedinMarch2017theirinten'ontorelaxthesecontrols.Instead,theywouldputtheonusonmanufacturerstodeclarethattheir

carsweresafeandfully-insuredandtrustthatthelegalsystemwouldworkoutques'onsofliabilityandunintendedconsequences.Thethreatofbeingsuedisimaginedtobethestrongestlever.

Page 69: Machine learning, social learning and self-driving carssciencepolicy.colorado.edu/news/presentations/stilgoe2.pdfself-driving cars Outline ... future through the stewardship of innovaon

Socialconstruc'onasperformance

Page 70: Machine learning, social learning and self-driving carssciencepolicy.colorado.edu/news/presentations/stilgoe2.pdfself-driving cars Outline ... future through the stewardship of innovaon
Page 71: Machine learning, social learning and self-driving carssciencepolicy.colorado.edu/news/presentations/stilgoe2.pdfself-driving cars Outline ... future through the stewardship of innovaon
Page 72: Machine learning, social learning and self-driving carssciencepolicy.colorado.edu/news/presentations/stilgoe2.pdfself-driving cars Outline ... future through the stewardship of innovaon

Escapingtheriskframe

Page 73: Machine learning, social learning and self-driving carssciencepolicy.colorado.edu/news/presentations/stilgoe2.pdfself-driving cars Outline ... future through the stewardship of innovaon
Page 74: Machine learning, social learning and self-driving carssciencepolicy.colorado.edu/news/presentations/stilgoe2.pdfself-driving cars Outline ... future through the stewardship of innovaon