MACHINE LEARNINGMICHAEL SHILMAN

michael@shilman.net

1

How to detect porn and decide where to live using

SCI-FI INSPIRES, TECHNOLOGY DELIVERS...

2001: A Space Odyssey (1968) Infinity Blade for iPhone (2011)

Sci-Fi Technology

TECHNOLOGY DELIVERS... most of the time

Teleportation

Time Travel

Telekinesis

Artificial Intelligence (AI)

Hardware

Software

AI is the last big software problem left

...and has been largely a failure so far.

1960-70’s: CONCEPTS

Basic Theory Demos

Viterbi Decoding (1967) Sutherland’s Sketchpad (1968)

1980’s: MODELING THE BRAINNeuron

Neural Network

Expert

Expert System

ENTER MACHINE LEARNING

Machine Learning is the study of

computer algorithms that improve

automatically through experience.

Tom Mitchell, Machine Learning (1997)

BASIC MACHINE LEARNING

Observations

Labels

X

Yf(x) = yLearn

Male

X = height

Female

Y = gender

REAL-WORLD MACHINE LEARNING

Y - 100’s of labels

X - 1000’s of features

N - Millions of examples

? - Not all data is labeled

? - Some data is mis-labeled

Model spatial context

Model temporal context

Observations

Labels

X

Y

f(x) = y

1990’s: MACHINE LEARNING BASICS

Speech Handwriting OCR

2000’s: BIG DATA

Web Search Collaborative Filtering Porn Detection

2011: PUTTING IT ALL TOGETHER

Apple’s Siri (2011)

=

Modeling the Brain (1980’s)

+

Machine Learning Basics (1990’s)

+

Big Data (2000’s)

SIRI TEARDOWN

SIRI TEARDOWN

Waveform Input Broken into Little Chunks

X(t)

Each Chunk is a phoneme Y

(t)

Find the most likely paths through the

phonemes that match a words from the

dictionary

a

e

i

o

u

f u u d

“food”

SIRI TEARDOWN

Find the most likely paths through the words that make

grammatical sense

Find the most likely sentences that match the

context

Execute a query based on the most

likely sentence

Speak the result to the user

“bet me food” “get me food”dialog

“what would

you like to eat?”

SCI-FI INSPIRES, TECHNOLOGY DELIVERS?

2001: A Space Odyssey (1968) Apple’s Siri (2011)

Sci-Fi Technology

TECHNOLOGY DELIVERS? TIME WILL TELL

Good Bad Ugly

http://siriouslyweird.tumblr.com/

WHAT’S NEXT?

Modeling the Brain (1980’s)

+

Machine Learning Basics (1990’s)

+

Big Data (2000’s)

?????? ???

??? ??????

WHAT’S NEXT ... BIG DECISIONS

What to Buy? Where to Live? Who to Marry?

WHAT’S NEXT ... HUMAN STEERING

WHAT’S NEXT? NEED MORE SCI-FI!

Sci-Fi Technology

?????? ???

??? ??????