Ethics andAI:Stateoftheartandperspectives

NadiaAbchiche-Mimouni

nadia.abchichemimouni@univ-evry.fr

1 May05,2019- Venice,ItalyADAPTIVE2019

IBISCLab.Univ.Evry,Université Paris-Saclay

Plan

Generalethics anddefinitionsWhy is Artificial Intelligenceconcerned with ethical issues?Ethics inArtificial Intelligence

Institutionnal initiativesResearch works

Perspectivesandopendiscussion

2

Generalethics (1/6)

• Ethics• Setofvalueswhose purpose generates thegood,is looking fortheGood(Aristote)

• Relativize thenotionofgood/bad action• Reflection argued forthewell-act /be beautiful

• Moral• Good/bad action• Setofstandardsspecific toanindividual,asocialgrouporapeople• Conceptofrights,duties andprohibitions

• Deontology• SetofRules andDutiesGoverning aProfession

3

Definitions andvisionsfrommoralphilosophy

1. Normativeethics (substantial ethics)à allow todetermine,between twoactions,which is morally better

2. Metaethicsà philosophical analysis ofethical discourse andits epistemologicalandmetaphysical presuppositions

3. Appliedethicsà analysis ofconcrete situationsraising ethical issuesfordecision-making

4

Generalethics (2/6)Definitions andvisionsfrommoralphilosophy

GeneraldefinitionEthics proposes toquestionmoralvaluesandmoralprinciples that should guideour actions,indifferent situations,inorder toact inaccordancewith them.([Mill,JohnStuart 1998],Kant)

5

Generalethics (3/6)Definitions andvisionsfrommoralphilosophy

1.Normativeethics:

a) Ethical ormoralnihilism:asserts that there is nothingmorally rightorwrong.Itarguesthat:1. Ajudgments such as"Thekillingofinnocentpeopleis always morally wrong"

can notbe true orfalsetotheextent that moraljudgments havenologicalvalue.

2. Astatement like "Thisstoneweighs 30kg"hasalogical valuetotheextent thatthis can be true orfalse.

b) Ethical relativism:ethical constructivism,ethical subjectivismc) Ethical realism:ethical naturalism,ethical non-naturalism

6

• Ethical ormoralnihilism:asserts that there is nothingmorally rightorwrong.Itarguesthat judgments such as"Thekillingofinnocentpeopleis always morally wrong"can notbe true orfalsetotheextent that moraljudgments havenological value.Astatementlike "Thisstoneweighs 30kg"hasalogical valuetotheextent that this can be true orfalse.

• Ethical relativism:ethical constructivism,ethical subjectivism• Ethical realism:ethical naturalism,ethical non-naturalism

Generalethics (4/6)Definitions andvisionsfrommoralphilosophy

2.Metaethics:

7

• Bioethics• human procreation (assisted procreation,abortion,gamete donation,prenataldiagnosis,cloning ...);• endoflife(palliativecare,therapeutic relentlessness,euthanasia...);• genomics;• publichealth;• neuroscienceandneuropsychiatry;

• Theethics oftheenvironment• sustainable development/responsibility towards futuregenerations;• managementofnatural resources (water,forests,subsoils ...);• wastemanagement;• industrial andagriculturalpollution;• animalrights;• geneticallymodified organisms (GMOs);• biodiversity /ecosystemconservation;• etc.

Generalethics (5/6)3.Applied ethics

Generalethics (6/6)

8

ExampleInBookIofPlato’s Republic,Cephalus defines ‘justice’as"speaking thetruth"and"payingone’sdebts".Socrates quickly refutes this bysuggesting that it would be wrong torepay certaindebts—forexample,toreturnaborrowedweapon toafriend who is notinhis rightmind.Conflict between two moralnorms:

1. Repayingone’s debts2. Protectingothers from harm

Definition• Situationsinwhich any available choice leadstotransgressing someaccepted ethical principle

andyet adecision hastobe made,[Kirkpatrick,2015].• Anethical principle is unable togive adifferent valuation (apreference)between two options:

each optionis supported byethical reasons,given that theexecution ofboth is notpossible[McConnell2014].

Ethical dilemmas

Why andhowis AIconcernedwith ethical issues?

9

• Selfdrivingcars• Algorithmicdiscrimination• Dataownership• …

chombosan/Alamy StockPhotohttps://twitter.com/technicolorr/status/747823696811745281

Jobsreplacement…

10

Industry 5.0

Why andhowis AIconcernedwith ethical issues?

Ethical questions• Algorithmstransparency

• Ethicsofpersonalizationtechnologies

• Encodinglegislationintomachine• Responsibility

• Valuealignment• SustainableAIsystems

• …

11

Openletter for:• Research Priorities forRobust andBeneficial Artificial Intelligence ([StuartRussell&al.,2015])

Why andhowis AIconcernedwith ethical issues?

SocietalrecommendationsDeclarationofMontrealforaresponsibledevelopmentofAI

12

Yoshua Bengio,andYannLeCunawardedtheTuringprize,27thmars2019

Why andhowis AIconcernedwith ethical issues?

13

TheDeclaration sparked publicdebate andencouraged aprogressiveandinclusiveorientationtothedevelopmentofAI.

Why andhowis AIconcernedwith ethical issues?SocietalrecommendationsDeclarationofMontrealforaresponsibledevelopmentofAI

https://www.montrealdeclaration-responsibleai.com/

Ethics inArtificial Intelligence

• Hybrid research effortandphilanthropic fund that seeks toensure thattechnologiesofautomationandmachinelearning areresearched,developed,anddeployed inaway which vindicate socialvaluesoffairness,human autonomy,andjustice.

• Ajointproject oftheMITMediaLab andtheHarvardBerkman-KleinCenterforInternetandSociety.

• Projects onthree domains:1. AIandJustice2. InformationQuality3. AutonomyandInteraction

14

Institutional initiatives(1/5)

Ethics andGovernance ofAIInitiative(Launched in2017)

Moving “FromPrinciples toPractice”with standardsprojects,certificationprograms,andglobalconsensusbuilding toinspiretheEthically Aligned Design ofautonomous andintelligenttechnologies

Ethically Aligned Design, https://standards.ieee.org/industry-connections/ec/autonomous-systems.html

1.HumanRights2.Well-being3.DataAgency4.Effectiveness5.Transparency6.Accountability7.Awareness8.Competence 15

Institutional initiatives(2/5)Ethics inArtificial Intelligence

TheIEEEGlobalInitiativeonEthics ofAutonomous andIntelligentSystems,https://standards.ieee.org/industry-connections/ec/autonomous-systems.html

Worldeconomic forumhttps://www.weforum.org/agenda/2016/10/top-10-ethical-issues-in-artificial-intelligence/

Top9ethical issuesinartificial intelligence1. Unemployment.What happens after theendofjobs?2. Inequality.Howdowe distribute thewealth created bymachines?3. Humanity.Howdomachinesaffectour behaviour andinteraction?4. Artificial stupidity.Howcan we guard against mistakes?5. Racist robots.Howdowe eliminate AIbias?6. Security.Howdowe keep AIsafe from adversaries?7. Evil genies.Howdowe protect against unintended consequences?8. Singularity.Howdowe stay incontrolofacomplex intelligentsystem?9. Robotrights.Howdowe define thehumanetreatment ofAI?

16

Institutional initiatives(3/5)Ethics inArtificial Intelligence

Futureoflifeinstitute,https://futureoflife.org/

17

Institutional initiatives(4/5)Ethics inArtificial Intelligence

What we really need todois make surethat lifecontinuesinto thefuture.[…]It’s besttotry toprevent anegativecircumstance from occurring than towait forit tooccur andthen be reactive.”

-Elon Musk onkeeping AIsafe andbeneficial

(*)InstituteforEthics inArtificial Intelligence(FacebookandTechnical University ofMunich)(*)https://newsroom.fb.com/news/2019/01/tum-institute-for-ethics-in-ai/(*)DateScienceCentral(*)https://www.datasciencecentral.com/profiles/blogs/ethics-in-artificial-intelligence(*)https://www.information-age.com/ethics-artificial-intelligence-123475134/(*)https://www.information-age.com/ethics-artificial-intelligence-123475134/(*)http://www.ethicsandai.com/(*)European AIAlliancehttps://ec.europa.eu/futurium/en/ai-alliance-consultation/guidelines#Top(*)TheEthics OfAlgorithms,ethicsofalgorithms.com,Drexel university,Philadelphia,Pennsylvania,USA(*)CIFARPan-Canadian Artificial IntelligenceStrategyhttps://www.cifar.ca/ai/pan-canadian-artificial-intelligence-strategy(*)Onlineethicscenterforengineeringandscience,https://www.onlineethics.org/

18

Institutional initiatives(5/5)Ethics inArtificial Intelligence

AtaxonomyofintegrationAIandEthics([Yu&al.,2018],IJCAI)4axes:

1. ExploringEthicalDilemmas2. IndividualEthicalDecisionFrameworks3. CollectiveEthicalDecisionFrameworks4. EthicsinHuman-AIInteractions

19

Current research works (1/)

• Twoexamples:1. GenEth ethicaldilemmaanalyzer([AndersonandAnderson,2014],AAAI)

• Throughadialogwithethicists,helpscodifyethicalprinciplesinanygivendomainbyproposingasetofrepresentationschemasforframingthediscussionsonAIethicswhichincludes:Features,duties,actions,casesandprinciples.

2. MoralMachineproject (http://moralmachine.mit.edu/)• AllowsparticipantstojudgevariousethicaldilemmasfacingAutonomousVehiculeswhichhavemalfunctioned,andselectwhichoutcomestheyprefer.

• Thedecisionsareanalyzedaccordingtodifferentconsiderationsincluding:1)savingmorelives,2)protectingpassengers,3)upholdingthelaw,4)avoidingintervention,5)genderpreference,6)speciespreference,7)agepreference,and8)socialvaluepreference.

• Theprojectprovidesauserinterfaceforparticipantstodesigntheirownethicaldilemmastoelicitopinionsfromothers.

20

Current research worksExploringethicaldilemmas

• Formal verification ofmoralvaluesinMAS([BONNET&al.2017])• Considerwhether moralrules shared bymany ofusarefollowedbytheagents.

• Hardproblembecause most ofthemoralrules areoften notcompatible.Insuch cases,humans usually follow ethical rules topromote onemoralrule oranother.

• Using formal verification toensure that anagentfollowsagiven ethical rulecould helpinincreasing theconfidence inartificial agents.

• Asetofformal properties through anethical rule ordering conflictingmoralrules with respecttoavaluesystem.

• Ifthebehaviourofanagentverifies these properties (which can be provenusing anexisting proofframework),it means that this agentfollows thisethical rule.

21

Current research worksIndividualEthicalDecisionFrameworks

• MoralDM:MoralDecisionMaking,([BlassandForbus,2015])• Moraldecision-makingbyhumansnotonlyinvolvesutilitarianconsiderations,butalsomoralrules

• Rulesareacquiredfrompastexamplecasesandareoftenculturallysensitive• Agentsresolveethicaldilemmasbyleveragingontwomechanisms:

1. First-principlesreasoning2. Analogicalreasoning

22

Current research worksIndividualEthicalDecisionFrameworks

• Ethical Judgment ofAgents’Behaviors inMulti-AgentSystems:([Cointe&al.2016])

• Explicit representationofethics• Explicitprocessofethicaljudgment• Considerbothindividualandcollectivereasoningonvarioustheoriesofgoodandright

• Ethicsconsistsinconciliatingdesires,moralsandabilities• GenericEthicalJudgmentProcess(EJP)useevaluation,moralandethicalknowledge.ItisstructuredalongAwareness,Evaluation,GoodnessandRightnessprocesses

• ContextofaBDImodel,usingmentalstatessuchasbeliefsanddesires• Thejudgmentprocessisusefulforanagenttojudgeit’sownbehaviorandtojudgethebehaviorsofotheragents

23

Current research worksIndividualEthicalDecisionFrameworks

• Combining2waysofmoraldecisionmakingframeworksforartificialintelligence,([Conitzer etal.,2017])

• Machinelearningbasedethicaldecision-making,thekeyapproachistoclassifywhetheragivenactionunderagivenscenarioismorallyrightorwrong.

• Well-labeledtrainingdata,possiblyfromhumanjudgementsisacquired.• Gametheoryiscombinedwithmachinelearning:gametheoreticanalysisofethicsisusedasafeaturetotrainmachinelearningapproaches,

• Whilemachinelearninghelpsgametheoryidentifyethicalaspectswhichareoverlooked.

24

Current research worksIndividualEthicalDecisionFrameworks

• Event-BasedandScenario-BasedCausalityforComputationalEthics([Fiona & al., 2018])

• Causalmodelbasedapproach• Moralresponsibility• Modellingactionsandomissions• Matrixofcausalrelations(supportingandopposingrelations)

• Scenario-basedtrace(contextandthecauseofthecause)

25

Current research worksCollectiveEthicalDecisionFrameworks

• Nooptimalsolutiontosolveethicaldilemma• EnsurethatAIisdevelopedresponsiblyincorporatingsocialandethicalvalues

• SocietalconcernsabouttheethicsofAImustbereflectedindesign• Threeprinciples(ART):

1. Accountability:answerability,blameworthinessandliability;2. Responsibility:beingincharge,orbeingthecausebehindwhether

somethingsucceedsorfails;3. Transparency:opennessofdata,processesandresultsforinspectionand

monitoring.

26

Current research works

Responsible Autonomy ([Dignum,2017])

CollectiveEthicalDecisionFrameworks

Responsible Autonomy ([Dignum,2017])

• Whoisresponsibletothedecision:fourpossiblelevelsofautonomyandregulation:1. Humancontrol:apersonorgroupofpersonsareresponsible forthedecision;

2. Regulation:thedecisionisincorporated inthesystemicinfrastructureof theenvironment;

3. ArtificialMoralAgents(AMA):systemsincorporatemoralreasoningintheirdeliberationandtoexplaintheirbehaviorintermsofmoralconcepts;

4. Random:theautonomous systemrandomlychoosesitsactionwhenfacedwitha(moral)decision

• Howdecisionsaredependentondifferentmoralandsocietalvalues:• Determinewhichmoralvaluestoaimforandwhichethicalprinciples toadheretoinagivencircumstance;

• Basicvaluesrefertodesirablegoalsthatmotivateactionandtranscendspecificactionsandsituations.

• Valuesarequiteconsistentacrosscultures.Classifiedinto4dimensions: (i)Openness tochange,(ii) Self-enhancement, (iii)Conservation, (iv)Self-transcendence.

• Prioritizedifferentmoralandsocietalvalues,depending onindividual andsocio-culturalenvironment;

• Valuesserveascriteriatoguide theselectionorevaluationofactions,takingintoaccounttherelativepriorityofvalues. 27

Current research worksCollectiveEthicalDecisionFrameworks

28

Current research works

Computational and ART consequences of ethical deliberation mechanisms

CollectiveEthicalDecisionFrameworksResponsible Autonomy ([Dignum,2017])

29

Perspectivesandopendiscussion

• EthicsinAIraisemanyscientificchallenges• Alldomainsofcomputersciencewillbeconcerned(softwareengineering,modelling,optimization,formalmethods,security,machinelearning…)

• Thisisnolessarevolutioninthescienceofautomation• Wearemovingtowardsnewperspectivestore-enchantourresearchprofession

30

THANKYOUFORYOURATTENTION!

Bibliography

• [Cointe&al.,2016]NicolasCointe,GrégoryBonnetandOlivierBoissier,Ethical JudgmentofAgents’Behaviors inMulti-AgentSystems,Proceedings ofthe15thInternationalConferenceonAutonomousAgentsandMultiagent Systems (AAMAS2016),J.Thangarajah,K.Tuyls,C.Jonker,S.Marsella (eds.),May9–13,2016,Singapore.

• [Conitzer etal.,2017]VincentConitzer,WalterSinnott-Armstrong,JanaSchaich Borg,YuanDeng,andMaxKramer.Moraldecisionmakingframeworksforartificialintelligence.InAAAI,pages4831–4835,2017.

• EmmanuelKant(1724-1804)KönigsbergAllemagne.• [Fiona & al., 2018] Fiona Berreby, Gauvain Bourgne, Jean-Gabriel Ganascia:

Event-Based and Scenario-Based Causality for Computational Ethics. AAMAS 2018: 147-155

• [Mill,JohnStuart 1998]Mill,JohnStuart (1998)Utilitarianism [archive]OxfordUniversityPress(ISBN 0-19-875163-X)

• [McConnell,2014]T.McConnell.Moraldilemmas.InEdwardN.Zalta,editor,TheStanfordEncyclopedia ofPhilosophy.Fall edition,2014.,https://plato.stanford.edu/entries/moral-dilemmas/#ConMorDil

31

•

Bibliography

1. [AndersonandAnderson,2014]MichaelAndersonandSusanLeighAnderson.GenEth:Ageneralethicaldilemmaanalyzer.InAAAI,pages253–261,2014.

2. [Berreby &al.2018]FionaBerreby,Gauvain Bourgne,andJean-GabrielGanascia.2018.Event-BasedandScenario-BasedCausalityforComputationalEthics.InProc.ofthe17thInternationalConferenceonAutonomousAgentsandMultiagentSystems(AAMAS2018),Stockholm,Sweden,July10–15,2018,IFAAMAS,9pages.

3. [Dignum,2017]VirginiaDignum,Responsible Autonomy.InIJCAI, pp.4698-4704,2017.4. [StuartRussell &al.,2015]StuartRussell,DanielDewey.AndMaxTegmark,Research Priorities

forRobust andBeneficial Artificial Intelligence,Copyright©2015,AssociationfortheAdvancement ofArtificial Intelligence.Allrights reserved.ISSN0738-4602.https://futureoflife.org/data/documents/research_priorities.pdf?x60419

5. [BONNET&al.,2017]GaëlBONNET,BrunoMERMETandGaëlleSIMONFormal verification ofmoralvaluesinMAS,ARTICLEVOL31/4- 2017 - pp.449-470- doi:10.3166/ria.31.449-470

6. [BlassandForbus,2015]JosephA.BlassandKennethD.Forbus.Moraldecision-makingbyanalogy:Generalizationsversusexemplars.InAAAI,pp.501–507,2015.

7. [Yu&al.,2018]HanYu,Zhiqi Shen,ChunyanMiao,CyrilLeung,VictorR.LesserandQiang Yang,BuildingEthicsintoArtificialIntelligence,InProceedingsoftheTwenty-SeventhInternationalJointConferenceonArtificialIntelligence(IJCAI-18)pp.5527-5533,2018.

32