PSH Mobile Voice 2016 Personal Virtual Assistants Are Not Enough?

38
Personal Virtual Assistants Are Not Enough? Let’s have a conversation Mobile Voice 2016, San Jose, CA April 12, 2016 Paul S. Heirendt, Co-Founder & CEO, TradeHarbor, inc. [email protected] Twitter: @pheirendt

Transcript of PSH Mobile Voice 2016 Personal Virtual Assistants Are Not Enough?

Page 1: PSH Mobile Voice 2016 Personal Virtual Assistants Are Not Enough?

Personal Virtual AssistantsAre Not Enough?Let’s have a conversation

Mobile Voice 2016, San Jose, CA April 12, 2016Paul S. Heirendt, Co-Founder & CEO, TradeHarbor, inc.

[email protected] Twitter: @pheirendt

Page 2: PSH Mobile Voice 2016 Personal Virtual Assistants Are Not Enough?

“Keiserens nye Klæder”The Emperor's New Clothes

This talk is an effort toStart a Dialogue

inspiration through agitation

What?

Page 3: PSH Mobile Voice 2016 Personal Virtual Assistants Are Not Enough?

Only Hears One Side of the StoryDoesn't Know the

ResultsAttempts to Characterize the User’s Behavior Without the Context or the Results

Issues with Personal Virtual assistants

No Feedback Loop

Page 4: PSH Mobile Voice 2016 Personal Virtual Assistants Are Not Enough?

Personal Virtual assistantsConflict Will

Happen

Page 5: PSH Mobile Voice 2016 Personal Virtual Assistants Are Not Enough?

“The story of technology has been a long one of automating things that humans do; technology tends to be

about picking a task where we understand what the objective is

because humans are already doing it, and then we make it possible to do that in an automatic way using

technology.”

Stephen WolframCEO, Wolfram Research• Mathematica• Wolfram|Alpha• Wolfram

Language

Page 6: PSH Mobile Voice 2016 Personal Virtual Assistants Are Not Enough?

Machine Learning is a scientific field

addressing the question:"How can we program systems to

automatically learn and to improve with experience?"

Tom Mitchell the first Chair of Department of the first Machine Learning Department in the World, based at Carnegie Mellon.

Page 7: PSH Mobile Voice 2016 Personal Virtual Assistants Are Not Enough?

Consumer Expectation Is Very High

Page 8: PSH Mobile Voice 2016 Personal Virtual Assistants Are Not Enough?

Current technology doesn't meet Expectations

Page 9: PSH Mobile Voice 2016 Personal Virtual Assistants Are Not Enough?

Current technology doesn't meet Expectations

Page 10: PSH Mobile Voice 2016 Personal Virtual Assistants Are Not Enough?

Is It a Smart Car if You have to tell it everything you want done?

Page 11: PSH Mobile Voice 2016 Personal Virtual Assistants Are Not Enough?

Nobody isasking for

more interfacesand independent

applications

Page 12: PSH Mobile Voice 2016 Personal Virtual Assistants Are Not Enough?

Current technology doesn't meet the Expectation

Userfrustration

is the result

Page 13: PSH Mobile Voice 2016 Personal Virtual Assistants Are Not Enough?

though it also wants to be expensive”

“Information wants to be free…

Stewart Brand, Founder ofthe WELL

1984

Page 14: PSH Mobile Voice 2016 Personal Virtual Assistants Are Not Enough?

IAContent

Context

User

Rosenfield and Morville - Information Architecture for the World Wide Web 1998

IA = Information Architecture

Page 15: PSH Mobile Voice 2016 Personal Virtual Assistants Are Not Enough?

AI = Artificial Intelligence

AIUser Content

Context

Page 16: PSH Mobile Voice 2016 Personal Virtual Assistants Are Not Enough?

Amount of data

Perfo

rman

ce

Large NN

Medium NN

Small NNTraditionallearning also

Andrew Ng Associate Professor at StanfordChief Scientist of BaiduChairman and Co-Founder of Coursera.

https://youtu.be/LcfLo7YP8O4

Scale Is Enabling Deep Learning

Page 17: PSH Mobile Voice 2016 Personal Virtual Assistants Are Not Enough?

?

Only Hearing One Side of the Story

Access to All Sides of the Story is Required

Page 18: PSH Mobile Voice 2016 Personal Virtual Assistants Are Not Enough?

Only Hearing One Side of the Story

Access to All Sides of the Story

Page 19: PSH Mobile Voice 2016 Personal Virtual Assistants Are Not Enough?

Old Friends?Business Partners?

Cell Mates!

Even Hearing Both SidesOf The Conversation

- Context is Key

Page 20: PSH Mobile Voice 2016 Personal Virtual Assistants Are Not Enough?

Context

Data

Experience

Information Knowledge Wisdom

Understanding

Feedback Loop

Page 21: PSH Mobile Voice 2016 Personal Virtual Assistants Are Not Enough?

Intent

Content Context

Insights Purpose

+

MeaningfulExperience

Feedback Loop

Page 22: PSH Mobile Voice 2016 Personal Virtual Assistants Are Not Enough?

Knowledge is Organized informationWisdom is the understanding and application

Insight is the underlying truth

Page 23: PSH Mobile Voice 2016 Personal Virtual Assistants Are Not Enough?

Knowledge:a tomato is a fruit

Wisdom: Don't put it in fruit

salad.

Knowledge Alone - is Not Enough

Page 24: PSH Mobile Voice 2016 Personal Virtual Assistants Are Not Enough?

Who is Right?No Way to Know

Without Perspective

Perspectiveis also Critical

Page 25: PSH Mobile Voice 2016 Personal Virtual Assistants Are Not Enough?

“Depending on their organization, groups must have cognitive properties that are not predictable from a knowledge of the properties of the individuals in the group.”

a Group Is More Than The Sum Of The IndividualsObservations of a group of Navy navigators and how they thought and processed as a group…

Edwin Hutchins - Dept of Cognitive Science, UCSD

Page 26: PSH Mobile Voice 2016 Personal Virtual Assistants Are Not Enough?

Distributed Cognition (DCoG)

“Thinking does not just inhabit the mind of one person, but exists across a group.”

Social Artificial Intelligence | Justine Cassell

Page 27: PSH Mobile Voice 2016 Personal Virtual Assistants Are Not Enough?

TradeHarbor Continuous Speaker Modeling

Page 28: PSH Mobile Voice 2016 Personal Virtual Assistants Are Not Enough?

TradeHarborContinuous

SpeakerModeling

ROW ModelSpeaker

Model

Page 29: PSH Mobile Voice 2016 Personal Virtual Assistants Are Not Enough?

Blind Guessing Doesn't Work

Page 30: PSH Mobile Voice 2016 Personal Virtual Assistants Are Not Enough?

Do You Need A Meeting Just To Set A Meeting

Page 31: PSH Mobile Voice 2016 Personal Virtual Assistants Are Not Enough?

Bigger The Meetings - More Complex

Page 32: PSH Mobile Voice 2016 Personal Virtual Assistants Are Not Enough?

The More People Involved…

Page 33: PSH Mobile Voice 2016 Personal Virtual Assistants Are Not Enough?

…The More Complicated The Communication

Page 34: PSH Mobile Voice 2016 Personal Virtual Assistants Are Not Enough?

Social AI - Learning From All Conversations & Contexts

Page 35: PSH Mobile Voice 2016 Personal Virtual Assistants Are Not Enough?

Social Artificial Intelligence Engine

© 2016 Skejul

Individual’s ModelPeoplePlaces

PreferencesPrioritiesPotential

Ad Hoc Group Best Fit Solutions

Solution Set

Learnings From User BehaviorUSPTO 14/941,142

Systems and Methods for Private Scheduling Coordination and

Event Planning

Page 36: PSH Mobile Voice 2016 Personal Virtual Assistants Are Not Enough?

SO, Personal Virtual Assistants

Are Not Enough!

Mobile Voice 2016, San Jose, CA April 12, 2016Paul S. Heirendt, Co-Founder & CEO, TradeHarbor, inc.

[email protected] Twitter: @pheirendt

Inter-Personal Virtual Assistance“Social AI”

Page 37: PSH Mobile Voice 2016 Personal Virtual Assistants Are Not Enough?

Dig DeeperJustine Cassell - Social Artificial IntelligenceHuman-Computer Interaction Institute (HCII)Carnegie Mellon Universityhttps://youtu.be/WGtVR0XSzPA

Edwin HutchinsStudying Cognition in the WildProfessor, Department of Cognitive ScienceUniversity of California San Diego

Nils J. NilssonDepartment of Computer ScienceArtificial Intelligence LaboratoryStanford University

Stephen WolframCEO, Wolfram Research• Mathematica• Wolfram|Alpha• Wolfram Languagehttps://youtu.be/DszFKW4d2Rw

Tom MitchellThe first Chair of Department of the first Machine Learning Department in the World, based at Carnegie Mellon.

Andrew Ng Associate Professor at StanfordChief Scientist of BaiduChairman and Co-Founder of Coursera.https://youtu.be/LcfLo7YP8O4

Page 38: PSH Mobile Voice 2016 Personal Virtual Assistants Are Not Enough?

Personal Virtual AssistantsAre Not Enough?

Mobile Voice 2016, San Jose, CA April 12, 2016Paul S. Heirendt, Co-Founder & CEO, TradeHarbor, inc.

[email protected] Twitter: @pheirendt