Trust & Explainability for Artificial Intelligence · Trust • Google autonomous car crash. •...
Transcript of Trust & Explainability for Artificial Intelligence · Trust • Google autonomous car crash. •...
![Page 1: Trust & Explainability for Artificial Intelligence · Trust • Google autonomous car crash. • Tesla autopilot FATAL car crash. • Risk assessment for committing crime racially](https://reader030.fdocuments.us/reader030/viewer/2022033123/5ec7fd535465de787522c2f6/html5/thumbnails/1.jpg)
Trust & Explainability for Artificial
Intelligence - Lt Col Ashutosh Verma
![Page 2: Trust & Explainability for Artificial Intelligence · Trust • Google autonomous car crash. • Tesla autopilot FATAL car crash. • Risk assessment for committing crime racially](https://reader030.fdocuments.us/reader030/viewer/2022033123/5ec7fd535465de787522c2f6/html5/thumbnails/2.jpg)
Scope
Trust deficit with AI Applications
What is Trust
What if we can Trust
Way Ahead
![Page 3: Trust & Explainability for Artificial Intelligence · Trust • Google autonomous car crash. • Tesla autopilot FATAL car crash. • Risk assessment for committing crime racially](https://reader030.fdocuments.us/reader030/viewer/2022033123/5ec7fd535465de787522c2f6/html5/thumbnails/3.jpg)
Trust
• Google autonomous car crash.
• Tesla autopilot FATAL car crash.
• Risk assessment for committing crime racially discriminates subjects - COMPASS.
• Predictive policing – racially profiles the area.
Our fear and mistrust is based on such failures.
![Page 4: Trust & Explainability for Artificial Intelligence · Trust • Google autonomous car crash. • Tesla autopilot FATAL car crash. • Risk assessment for committing crime racially](https://reader030.fdocuments.us/reader030/viewer/2022033123/5ec7fd535465de787522c2f6/html5/thumbnails/4.jpg)
Trust in Military Applications
Signatories:-
Stephen Hawkings, Steve Wozniak, Stuart
Russell, Nils Nilsson and 20,000+
![Page 5: Trust & Explainability for Artificial Intelligence · Trust • Google autonomous car crash. • Tesla autopilot FATAL car crash. • Risk assessment for committing crime racially](https://reader030.fdocuments.us/reader030/viewer/2022033123/5ec7fd535465de787522c2f6/html5/thumbnails/5.jpg)
Necessity of Explanation
Observation
Explanation
Human Understanding
Why Why not
When Success When Failure
TRUST
Fast & Optimal Decision Making
![Page 6: Trust & Explainability for Artificial Intelligence · Trust • Google autonomous car crash. • Tesla autopilot FATAL car crash. • Risk assessment for committing crime racially](https://reader030.fdocuments.us/reader030/viewer/2022033123/5ec7fd535465de787522c2f6/html5/thumbnails/6.jpg)
Trust in AI Algorithms
Explainability
Auditability
Accuracy Responsibility
Fairness Trust
![Page 7: Trust & Explainability for Artificial Intelligence · Trust • Google autonomous car crash. • Tesla autopilot FATAL car crash. • Risk assessment for committing crime racially](https://reader030.fdocuments.us/reader030/viewer/2022033123/5ec7fd535465de787522c2f6/html5/thumbnails/7.jpg)
Military Decision Making The OODA Loop
Observe
Orient
Decide
Act
Analytics Reasoning Knowledge Base
Intelligence Target Recognition Sensor N/W
Autonomous Agents weapon platforms
AI Planning Simulate? DSS
Person-in-the-loop
Person-on-the-loop
![Page 8: Trust & Explainability for Artificial Intelligence · Trust • Google autonomous car crash. • Tesla autopilot FATAL car crash. • Risk assessment for committing crime racially](https://reader030.fdocuments.us/reader030/viewer/2022033123/5ec7fd535465de787522c2f6/html5/thumbnails/8.jpg)
China embracing AI
Ref:- http://thediplomat.com/2016/09/is-china-really-building-missiles-with-artificial-intelligence/ http://www.planettechnews.com/software/software/baidu-welcomes-china-s-military-to-join-china-brain-project-on-ai-systems http://www.nytimes.com/2015/09/03/world/asia/beijing-turns-into-ghost-town-as-it-gears-up-for-military-parade.html?_r=0
Imagenet Challenge 2016 • All category winners were
teams from China. • 33 of the 82 teams from
China.
![Page 9: Trust & Explainability for Artificial Intelligence · Trust • Google autonomous car crash. • Tesla autopilot FATAL car crash. • Risk assessment for committing crime racially](https://reader030.fdocuments.us/reader030/viewer/2022033123/5ec7fd535465de787522c2f6/html5/thumbnails/9.jpg)
‘Strength’ of Chinese Academia National University of Defence Technology Naval University of Engineering Armoured Engineering Academy Harbin Institute of Technology Chinese Association for Artificial Intelligence
863 Programme - National High Tech R&D Programme Project 985 to promote and develop the Chinese higher education system
![Page 10: Trust & Explainability for Artificial Intelligence · Trust • Google autonomous car crash. • Tesla autopilot FATAL car crash. • Risk assessment for committing crime racially](https://reader030.fdocuments.us/reader030/viewer/2022033123/5ec7fd535465de787522c2f6/html5/thumbnails/10.jpg)
USA
“Autonomous software working synergistically with the innovation
of empowered airmen.”
“Authority and responsibility for warfare in the hands of airmen while creating tools that enhance their situation awareness and decision-making, speed effective
actions, and bring needed extensions to their capabilities.”
Ref: http://www.af.mil/Portals/1/documents/SECAF/AutonomousHorizons.pdf?timestamp=1435068339702
![Page 11: Trust & Explainability for Artificial Intelligence · Trust • Google autonomous car crash. • Tesla autopilot FATAL car crash. • Risk assessment for committing crime racially](https://reader030.fdocuments.us/reader030/viewer/2022033123/5ec7fd535465de787522c2f6/html5/thumbnails/11.jpg)
USA: DARPA
• DARPA Grand Challenges:-
– Autonomous Driving.
– Autonomous Cyber Defence.
– Autonomous Spectrum Collaboration.
• Fast Lightweight autonomy.
• BOLT – Broad operational language
translator.
• XAI – Explainable AI.
![Page 12: Trust & Explainability for Artificial Intelligence · Trust • Google autonomous car crash. • Tesla autopilot FATAL car crash. • Risk assessment for committing crime racially](https://reader030.fdocuments.us/reader030/viewer/2022033123/5ec7fd535465de787522c2f6/html5/thumbnails/12.jpg)
Challenges
• Complexity of
algorithms.
• Input data quality.
• Human introduced
bias, e.g. racial
profiling.
Ref: DARPA-BAA-16-53; Aug 2016
![Page 13: Trust & Explainability for Artificial Intelligence · Trust • Google autonomous car crash. • Tesla autopilot FATAL car crash. • Risk assessment for committing crime racially](https://reader030.fdocuments.us/reader030/viewer/2022033123/5ec7fd535465de787522c2f6/html5/thumbnails/13.jpg)
Road Ahead
• XAI Research - DARPA-BAA-16-53
• Possible approaches:-
– AI reasoning, planning and learning.
– IoT to improve data gathering to remove human induced bias.
Trust and explainability necessary ab initio for military
application.
![Page 14: Trust & Explainability for Artificial Intelligence · Trust • Google autonomous car crash. • Tesla autopilot FATAL car crash. • Risk assessment for committing crime racially](https://reader030.fdocuments.us/reader030/viewer/2022033123/5ec7fd535465de787522c2f6/html5/thumbnails/14.jpg)
Thank You
“Trust is the glue that holds an organisation together & the lubricant that moves it forward.”
– Gen Colin Powell
![Page 15: Trust & Explainability for Artificial Intelligence · Trust • Google autonomous car crash. • Tesla autopilot FATAL car crash. • Risk assessment for committing crime racially](https://reader030.fdocuments.us/reader030/viewer/2022033123/5ec7fd535465de787522c2f6/html5/thumbnails/15.jpg)
Thank You
“Trust is the glue that holds an organisation together & the lubricant that moves it forward.”
– Gen Colin Powell
![Page 16: Trust & Explainability for Artificial Intelligence · Trust • Google autonomous car crash. • Tesla autopilot FATAL car crash. • Risk assessment for committing crime racially](https://reader030.fdocuments.us/reader030/viewer/2022033123/5ec7fd535465de787522c2f6/html5/thumbnails/16.jpg)