AI & Deep Learning At Amazon

Guy Ernest

Principal Business Development Manager

gernest@amazon.com

Artificial Intelligence

At Amazon

Artificial Intelligence At AmazonThousands Of Employees Across The Company Focused on AI

Discovery &

Search

Fulfillment &

Logistics

Enhance

Existing Products

Define New

Categories Of

Products

Bring Machine

Learning To All

“deep learning” trend in the past 10

years

image understanding speech recognition natural language

processing

Deep Learning is Growing

autonomy

The Advent Of

Deep Learning

Algorithms

The Advent Of

Deep LearningData

Algorithms

The Advent Of

Deep LearningData

GPUs

& Acceleration

Algorithms

The Advent Of

Deep LearningData

GPUs

& Acceleration

Programming

models

Algorithms

The Advent Of

Deep LearningData

GPUs

& Acceleration

Programming

models

Algorithms

AWS

Amazon AIIntelligent Services Powered By Deep Learning

Introducing Amazon AI

Apache MXNetDeep learning engine

Introducing Amazon AI

PollyText-to-Speech

Apache MXNetDeep learning engine

Introducing Amazon AI

PollyText-to-Speech

Apache MXNetDeep learning engine

RekognitionImage Analysis

Introducing Amazon AI

PollyText-to-Speech

Apache MXNetDeep learning engine

Rekognition LexImage Analysis ASR & NLU

Introducing Amazon AI

PollyText-to-Speech

Apache MXNetDeep learning engine

Rekognition LexImage Analysis ASR & NLU

Apache MXNet

Programmable Portable High Performance

Near linear scaling

across hundreds of GPUs

Highly efficient

models for mobile

and IoT

Simple syntax,

multiple languages

Why Apache MXNet?

Most Open Best On AWS

Optimized for

deep learning on AWS

Accepted into the

Apache Incubator

(Integration with AWS)

Apache MXNet is the deep learning framework

of choice for Amazon

P2 INSTANCES DEEP TEMPLATEDEEP AMI

One-Click

Deep Learning

AWS Deep Learning AMI

(Amazon Linux, Ubuntu)

Up to~40k CUDA cores

Apache MXNet

TensorFlow

Theano

Caffe

Torch

Pre-configured CUDA drivers

Anaconda, Python3

+ CloudFormation template

+ Container Image

Introducing Amazon AI

PollyText-to-Speech

Apache MXNetDeep learning engine

Rekognition LexImage Analysis ASR & NLU

Amazon Polly: Life-like Speech Service

Converts text

to life-like speech

47 voices 24 languages Low latency,

real time

Fully managed

Let’s take a listen…

“Today in Seattle, WA, it’s 11°F”

‘"We live for the music" live from the Madison Square Garden.’

1. Automatic, Accurate Text Processing

Polly: A Focus On Voice Quality & Pronunciation

Polly: A Focus On Voice Quality & Pronunciation

2. Intelligible and Easy to Understand

1. Automatic, Accurate Text Processing

2. Intelligible and Easy to Understand

3. Add Semantic Meaning to Text

“Richard’s number is 2122341237“

“Richard’s number is 2122341237“

Telephone Number

Polly: A Focus On Voice Quality & Pronunciation

1. Automatic, Accurate Text Processing

2. Intelligible and Easy to Understand

3. Add Semantic Meaning to Text

4. Customized Pronunciation

“My daughter’s name is Kaja.”

“My daughter’s name is Kaja.”

Polly: A Focus On Voice Quality & Pronunciation

1. Automatic, Accurate Text Processing

Polly: Life-like Speech Service

High quality,

through

best-in-class

deep learning

Deep

functionality

Easy to use

& thoughtfully integrated

Built for

production

Low

cost

Introducing Amazon AI

PollyText-to-Speech

Apache MXNetDeep learning engine

Rekognition LexImage Analysis ASR & NLU

Rekognition: Search & Understand Visual Content

Real-time &

batch image

analysis

Object & Scene

DetectionFacial Detection Face SearchFacial Analysis

Rekognition: Object & Scene Detection

Bay

Beach

Coast

Outdoors

Sea

Water

Palm_tree

Plant

Tree

Summer

Landscape

Nature

Hotel

99.18%

99.18%

99.18%

99.18%

99.18%

99.18%

99.21%

99.21%

99.21%

58.3%

51.84%

51.84%

51.24%

Category Confidence

Rekognition: Facial Detection

Rekognition: Facial Analysis

Emotion: calm: 73%

Sunglasses: false (value: 0)

Mouth open wide: 0% (value: 0)

Eye closed: open (value: 0)

Glasses: no glass (value: 0)

Mustache: false (value: 0)

Beard: no (value: 0)

Rekognition: Facial Search

Facial

verification

Face

Search

Visual Similarity

Search

(compare two faces) (compare many faces) (find similar faces)

DEMO

High quality,

through

best-in-class

deep learning

Deep

functionality

Easy to use

& thoughtfully integrated

Built for

production

Low

cost

Rekognition: Search & Understand Visual Content

Introducing Amazon AI

PollyText-to-Speech

Apache MXNetDeep learning engine

Rekognition LexImage Analysis ASR & NLU

The Advent Of Conversational Interactions

1st Gen: Machine-oriented

interactions

The Advent Of Conversational Interactions

1st Gen: Machine-oriented

interactions

2nd Gen: Control-oriented

& translated

The Advent Of Conversational Interactions

1st Gen: Machine-oriented

interactions

2nd Gen: Control-oriented

& translated

3rd Gen:

Intent-oriented

Lex: Build Natural, Conversational Interactions In Voice & Text

Voice & Text

“Chatbots”

Powers

Alexa

Voice interactions

on mobile, web

& devices

Text interaction

with Slack & Messenger

Enterprise

Connectors

(with more coming) Salesforce

Microsoft Dynamics

Marketo

Zendesk

Quickbooks

Hubspot

DEMO

High quality,

through

best-in-class

deep learning

Deep

functionality

Easy to use

& thoughtfully integrated

Built for

production

Low

cost

Lex: Build Natural, Conversational Interactions In Voice & Text

PollyText-to-Speech

Apache MXNetDeep learning engine

Rekognition LexImage Analysis ASR & NLU

Amazon AI: What’s Next?

Amazon AI: What’s Next?

Polly

Text-to-Speech

Apache MXNet

Deep learning engine

Rekognition Lex

Image Analysis ASR & NLU

New APIs

and tools

https://aws.amazon.com/amazon-ai/

Amazon AI: Getting Started

Thank you!

gernest@amazon.com