Provide input and learn more about the study at ...
Transcript of Provide input and learn more about the study at ...
Provideinputandlearnmoreaboutthestudyatwww.nas.edu/EnvisioningDS
9/12/17–BuildingDataAcumen9/19/17–Incorpora4ngReal-WorldApplica4ons
9/26/17–FacultyTrainingandCurriculumDevelopment
10/3/17–Communica4onSkillsandTeamwork
10/10/17–Inter-DepartmentalCollabora4onandIns4tu4onalOrganiza4on
10/17/17–Ethics10/24/17–AssessmentandEvalua4onforDataSciencePrograms
11/7/17–Diversity,Inclusion,andIncreasingPar4cipa4on
11/14/17–Two-YearCollegesandIns4tu4onalPartnerships
(recordingposted)
(recordingposted)
(recordingposted)
Provideinput,downloadtheinterimreport,andlearnmoreaboutthe
studyatwww.nas.edu/EnvisioningDS
(recordingposted)
(recordingposted)
Provideinputandlearnmoreaboutthestudyatwww.nas.edu/EnvisioningDSProvideinputandlearnmoreaboutthestudyatwww.nas.edu/EnvisioningDS
Ethics
SorinAdamMatei,PurdueUniversityProfessorandDirectorofPurdueData
StorytellingNetwork
BriHanyFiore-Gartland,UniversityofWashington
DirectorofDataScienceEthnographyeScienceInsBtute
3
Provideinputandlearnmoreaboutthestudyatwww.nas.edu/EnvisioningDSProvideinputandlearnmoreaboutthestudyatwww.nas.edu/EnvisioningDS
Ethics
SorinAdamMatei,PurdueUniversityProfessorandDirectorofPurdueData
StorytellingNetworkandKredible.netProject
4
Anethicalreasoning
frameworkfordatascienceeduca4on
Provideinputandlearnmoreaboutthestudyatwww.nas.edu/EnvisioningDS
Goalsofpresenta4on
• Defineethicsandbigdata(therealmofdatascience)
• Defineprinciplesforethicalreasoning• Discusstheprinciplesinadatasciencecontext• Presenttheethicalreasoningprocessincontext,usinganexample
• Discusstheimplica4ons/answerques4ons
5
Provideinputandlearnmoreaboutthestudyatwww.nas.edu/EnvisioningDS
Aprincipledapproachtoethics
• Ethicsisamethodology.Dependsonmorality,whichisrootedinhumanvalues.– Dealswith“rightconduct.”
• Necessitatesvalues:Whatvaluesshoulddirectethicalconduct?
• Usedincontext:Whattypesoftrade-offsarepossibleandwhen?
6
Provideinputandlearnmoreaboutthestudyatwww.nas.edu/EnvisioningDS
Ethicalconductinthecontextofdatascience
• Whatarethemainethicalchallengesinvolvedindatascience?
• Whatmoralprinciplesareaffectedbythesechallenges?
• Howdocontextsofdatascienceuseorpoten4alabuseaggravateormi4gatetheurgencyofethicaldecisionmaking?
7
Provideinputandlearnmoreaboutthestudyatwww.nas.edu/EnvisioningDS
DataScienceanditschallenges
• Challengesderivedfromtheautoma4ccollec4onofbigdata– Reuse
• Genomicdatacollectedforonepurpose(diseasepreven4on)usedfordrugdiscovery
– Recombina4on• Joiningmul4pledatasetstoobtainfullerprofilesofusers(Google,Facebook)
– Repurposing• Datacollectedforbillingpurposesisusedforan4-terrorismsurveillance(theNSAmeta-datascandal)
– Reanalysis• Rawdatacanbeanonymous,analyzeddatacanbecomepersonallyiden4fiable(behaviorforensics:loginpa`erns,Wikipediaedi4ngpa`erns,etc.)
8
Provideinputandlearnmoreaboutthestudyatwww.nas.edu/EnvisioningDS
Challenge1:Privacy
• The4Rs(recombining,repurposing,reuse,reanalysis)implicitindatasciencemayaffectindividuallyprofoundlyanddirectly
• Iden4ty,anonymitymaybecompromised->Privacymainconcern
• Butisthisall?
9
Provideinputandlearnmoreaboutthestudyatwww.nas.edu/EnvisioningDS
Privacyisnotsufficient
Concernforprivacyisaseriousissuebutdoesnotsuggestapathtoac4onStrategicques4on:whatdoeslossofprivacydotous?
10
Provideinputandlearnmoreaboutthestudyatwww.nas.edu/EnvisioningDS
Lossofprivacyandcorehumanvalues
• Privacylossisinfactpartofafamilyofmuchgeneralconcerns.– Limitsordenieshumanautonomy– Mayleadtotrea4ngpeopleunfairly– Breaksthebondsoftrustinsociety– Makessomepeopleworseofforexposesthemtorisk
11
Provideinputandlearnmoreaboutthestudyatwww.nas.edu/EnvisioningDS
Corevaluesindatascienceethicalreasoning
• Autonomy• Jus4ce• Trust• Non-maleficence/beneficence
• Howdowemakeprac4caluseofthem?
12
Provideinputandlearnmoreaboutthestudyatwww.nas.edu/EnvisioningDS
Ethicalreasoningprocess
Doesthisprocedure,beitofanyform(collec4on,analysis,repurposing,recombina4on,etc.)leadto:• Lossofautonomy?• Lossoftrustbetweenindividualsorbetweenindividualsandtheresearcher?
• Createunjustalloca4onofrewards(recogni4on,accesstoresources,socialadvancement)ordeleteriouseffects(s4gma,lossofface,materialloss,etc)?
• Harmand/createsanetbenefitfortheusers?
13
Provideinputandlearnmoreaboutthestudyatwww.nas.edu/EnvisioningDS
Sowhat?
• Askingques4onsiseasy….
• Answeringthemishard.
• Howdowegoaboutansweringthem?
• Inacontextualmanner….
14
Provideinputandlearnmoreaboutthestudyatwww.nas.edu/EnvisioningDS
Contextualuseofvalues
• Humanvaluesare(shouldbe)absolutes• Valuejudgementsinthemselvesarenon-nego4able(jus4ce,trust,non-maleficencearepreferableunderallcircumstances.)
• Whenconsideringtheeffectofvaluesonourac4onsweshouldestablishaminimumthresholdunderwhichweshouldandwecannotgo
• Yet,forcertainsitua4onsandaboveacertainlevelofmoralcertainty,ethicalac4onsshouldbepragma4callydirectedbytrade-offanalysis
15
Provideinputandlearnmoreaboutthestudyatwww.nas.edu/EnvisioningDS
Projectexample
• Largescaleharves4ngofvideo-streamsfrompublicallyavailableweb-camsinna4onalparksbynon-governmentalactors(universityresearchers)
• Declaredgoals:– Reduc4onofhuman-wildlifeinterac4on–lesshumanandanimallimbandlifelossincidents
– Openupthedatatotheresearchcommunitytopredictincidentsandtargetpoten4alvic4msviasocialmediatoreducehuman-animalencounters
– Datacontainstensofthousandsofhoursoffootage,includingfaces,acts,andpersonallyiden4fiableinforma4onaboutparkvisitors
16
Provideinputandlearnmoreaboutthestudyatwww.nas.edu/EnvisioningDS
Projectoutcomes
• Findings– Reanalysis–revealswhoismorelikelytointeractwithanimals(gender,race,age)
– Recombiningwithsocialmediadata–iden4fiesrecentvisitorsataloca4onofgivengender,race,orage
– Repurposing–iden4fiedvisitorsaretargetedwithcustomizedmessagesviaTwi`ertoavoidfutureencounters
17
Provideinputandlearnmoreaboutthestudyatwww.nas.edu/EnvisioningDS
Ethicalreasoningprocess
• Yes,if:– Thegoalisnon-maleficentorevenbeneficent
• Inthiscasetolimitlossofhumanandanimallifeorlimb– Autonomyisnotlimited
• Inthiscase,individualsarenotdeniedaccesstothepark,theyaresimplyinformed– Jus4ce
• Acasecanbemadethatsomeindividualsmaybetargetedbyrace,gender,ageaffilia4onregardlessiftheydidnotinteractwithanimalsinanunsafeway
– Trade-offanalysis–isthesocietalbenefitgreaterthanthemildannoyanceoftheindividualsofreceivinginforma4vetweets?weresomefundamentalrightsdeniedtotheseindividualsorsomeprivilegesbestowedtosomeandnottothem?
– Trust• Doesthiscampaigninspireorerodetrust?
– Tradeoffanalysis–whilesomemightfindthecampaignintrusive,ifrightlypreparedbypos4ngnotesnexttocamerasthatinformabouttheiruse,itmayleadtoanincreaseoftrustinthosethataretryingtolimithumanoranimallifeandlimbloss
18
Provideinputandlearnmoreaboutthestudyatwww.nas.edu/EnvisioningDS
Whatdidwejustdo?
• Weengagedinethicalreasoning• Valuebased,withaminimumthresholdofvalueconcernandcontext-basedtrade-offanalysis
• TheprocessisdescribedinEthicalReasoninginBigData,co-editedwithJeffCollmann
• TheethicalprocessdescribedwasshapedinamajorwaybyMichaelSteinmannfromStevensIns4tuteofTechnology
19
h`p://amzn.to/2kOwTDz
Provideinputandlearnmoreaboutthestudyatwww.nas.edu/EnvisioningDS
Ques4ons?
• Moreinforma4on– h`p://kredible.net– h`p://matei.org/ithink
20
Provideinputandlearnmoreaboutthestudyatwww.nas.edu/EnvisioningDSProvideinputandlearnmoreaboutthestudyatwww.nas.edu/EnvisioningDS
Ethics
BriHanyFiore-Gartland,UniversityofWashington
DirectorofDataScienceEthnographyeScienceInsBtute
21
EthicalThinkingforDataScience
Educa4on
Provideinputandlearnmoreaboutthestudyatwww.nas.edu/EnvisioningDS
Datajus4ceandresponsibility
22
• Democra4za4onofdatasciencetoolsandtechniques
• Computa4onalresearchers
workinginunfamiliarfieldsorcontexts
• Secondaryusesofdata;Datacollectedforonepurposeandusedforanother
• Shincultureofethicalcompliancetocultureofethicalthinking
Provideinputandlearnmoreaboutthestudyatwww.nas.edu/EnvisioningDS 23
Course developed by Jevin West and Carl Bergstrom, University of Washington
Provideinputandlearnmoreaboutthestudyatwww.nas.edu/EnvisioningDS
Human-DataPipeline
25
Inspired by Dr. Seuss
Provideinputandlearnmoreaboutthestudyatwww.nas.edu/EnvisioningDS 26
Spurious correla-ons (Tyler Vigen)
Provideinputandlearnmoreaboutthestudyatwww.nas.edu/EnvisioningDS 27
BigDataTruthiness Implicit assumption and expectation that big
data has the quality of seeming or being felt to be true, even if not necessarily true.
(Adapted from Stephen Colbert’s “Truthiness”)
Provideinputandlearnmoreaboutthestudyatwww.nas.edu/EnvisioningDS
DataSciencechallenges
currentethicalframeworks
Theperils!
CaseStudy:Uber“RidesofGlory”
analysis
Provideinputandlearnmoreaboutthestudyatwww.nas.edu/EnvisioningDS
Uber’s“RidesofGlory”Analysis
• Ridesfrom10pm-4amonFri/Sat,followedbyridefromsameloca4on4-6hrslater
• Impliespeople“foundlovethatyoumightimmediatelyregretuponwakingupthemorninganer”
• Callsthese“RidesofGlory”
Provideinputandlearnmoreaboutthestudyatwww.nas.edu/EnvisioningDS
Uber’s“RidesofGlory”Analysis
• Consent• Privacy• Interpreta4on
Provideinputandlearnmoreaboutthestudyatwww.nas.edu/EnvisioningDS
DataScienceasEthical
Interven4onThepromise!
CaseStudy:Amazonsame-daydeliveryservice:Canalgorithmsberacist?
Provideinputandlearnmoreaboutthestudyatwww.nas.edu/EnvisioningDS
Thankyou!
35
Contact:[email protected]
Resources:
• CallingBullshitsyllabusandreadings,tools,editedvideosoflecturesandcasestudiesareallavailableatwww.callingbullshit.org
• [email protected]• Linktodatascienceethicscasestudiesandfurtherreading,
h`ps://4nyurl.com/y9meel3s
Provideinputandlearnmoreaboutthestudyatwww.nas.edu/EnvisioningDSProvideinputandlearnmoreaboutthestudyatwww.nas.edu/EnvisioningDS
Ethics–Q&A
SorinAdamMatei,PurdueUniversityProfessorandDirectorofPurdueData
StorytellingNetwork
BriHanyFiore-Gartland,UniversityofWashington
DirectorofDataScienceEthnographyeScienceInsBtute
36
9/12/17–BuildingDataAcumen9/19/17–Incorpora4ngReal-WorldApplica4ons
9/26/17–FacultyTrainingandCurriculumDevelopment
10/3/17–Communica4onSkillsandTeamwork
10/10/17–Inter-DepartmentalCollabora4onandIns4tu4onalOrganiza4on
10/17/17–Ethics10/24/17–AssessmentandEvalua4onforDataSciencePrograms
11/7/17–Diversity,Inclusion,andIncreasingPar4cipa4on
11/14/17–Two-YearCollegesandIns4tu4onalPartnerships
(recordingposted)
(recordingposted)
(recordingposted)
Provideinput,downloadtheinterimreport,andlearnmoreaboutthe
studyatwww.nas.edu/EnvisioningDS
(recordingposted)
(recordingposted)