Enabling voice-based interactions · Automated Speech Recognition (ASR) Natural Language...

33
© 2016, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Sébastien Stormacq, Senior Solution Architect June 30 th 2016 Enabling voice-based interactions with Amazon Alexa and AWS Lambda

Transcript of Enabling voice-based interactions · Automated Speech Recognition (ASR) Natural Language...

Page 1: Enabling voice-based interactions · Automated Speech Recognition (ASR) Natural Language Understanding (NLU) Always Learning ALEXA SKILLS KIT . UNDER THE HOOD OF ASK A closer look

© 2016, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

Sébastien Stormacq, Senior Solution Architect

June 30th 2016

Enabling voice-based interactions with Amazon Alexa and AWS Lambda

Page 2: Enabling voice-based interactions · Automated Speech Recognition (ASR) Natural Language Understanding (NLU) Always Learning ALEXA SKILLS KIT . UNDER THE HOOD OF ASK A closer look
Page 3: Enabling voice-based interactions · Automated Speech Recognition (ASR) Natural Language Understanding (NLU) Always Learning ALEXA SKILLS KIT . UNDER THE HOOD OF ASK A closer look
Page 4: Enabling voice-based interactions · Automated Speech Recognition (ASR) Natural Language Understanding (NLU) Always Learning ALEXA SKILLS KIT . UNDER THE HOOD OF ASK A closer look

When  you  have  a  ques-on  or  want  to  do  something,  all  you  have  to  do  is  ask.

Page 5: Enabling voice-based interactions · Automated Speech Recognition (ASR) Natural Language Understanding (NLU) Always Learning ALEXA SKILLS KIT . UNDER THE HOOD OF ASK A closer look
Page 6: Enabling voice-based interactions · Automated Speech Recognition (ASR) Natural Language Understanding (NLU) Always Learning ALEXA SKILLS KIT . UNDER THE HOOD OF ASK A closer look
Page 7: Enabling voice-based interactions · Automated Speech Recognition (ASR) Natural Language Understanding (NLU) Always Learning ALEXA SKILLS KIT . UNDER THE HOOD OF ASK A closer look
Page 8: Enabling voice-based interactions · Automated Speech Recognition (ASR) Natural Language Understanding (NLU) Always Learning ALEXA SKILLS KIT . UNDER THE HOOD OF ASK A closer look
Page 9: Enabling voice-based interactions · Automated Speech Recognition (ASR) Natural Language Understanding (NLU) Always Learning ALEXA SKILLS KIT . UNDER THE HOOD OF ASK A closer look
Page 10: Enabling voice-based interactions · Automated Speech Recognition (ASR) Natural Language Understanding (NLU) Always Learning ALEXA SKILLS KIT . UNDER THE HOOD OF ASK A closer look

Customer  feedback

10  

Page 11: Enabling voice-based interactions · Automated Speech Recognition (ASR) Natural Language Understanding (NLU) Always Learning ALEXA SKILLS KIT . UNDER THE HOOD OF ASK A closer look
Page 12: Enabling voice-based interactions · Automated Speech Recognition (ASR) Natural Language Understanding (NLU) Always Learning ALEXA SKILLS KIT . UNDER THE HOOD OF ASK A closer look

B U I L D I N G A N E C O S Y S T E M F O R A L E X A

Page 13: Enabling voice-based interactions · Automated Speech Recognition (ASR) Natural Language Understanding (NLU) Always Learning ALEXA SKILLS KIT . UNDER THE HOOD OF ASK A closer look

Create Great Content: ASK is how you connect to your consumer

THE ALEXA ECOSYSTEM Supported by two powerful frameworks

A L E X A V O I C E S E R V I C E

Unparalleled Distribution: AVS allows your content to be everywhere

Lives In The Cloud

Automated Speech Recognition (ASR)

Natural Language Understanding (NLU)

Always Learning

A L E X A S K I L L S K I T

Page 14: Enabling voice-based interactions · Automated Speech Recognition (ASR) Natural Language Understanding (NLU) Always Learning ALEXA SKILLS KIT . UNDER THE HOOD OF ASK A closer look

UNDER THE HOOD OF ASK A closer look at how the Alexa Skills Kit process a request and returns an appropriate response

You Pass Back a Textual or Audio Response

You Pass Back a Graphical Response

Alexa Converts Text-to-Speech (TTS) & Renders Graphical Component

Respond to Intent through Text & Visual

Alexa sends Customer Intent to Your Service User Makes a

Request Alexa Identifies Skill & Recognizes Intent Through ASR & NLU

Your Service processes Request

Audio Stream is sent up to Alexa

Page 15: Enabling voice-based interactions · Automated Speech Recognition (ASR) Natural Language Understanding (NLU) Always Learning ALEXA SKILLS KIT . UNDER THE HOOD OF ASK A closer look

B U I L D I N G Y O U R V O I C E E X P E R I E N C E

Page 16: Enabling voice-based interactions · Automated Speech Recognition (ASR) Natural Language Understanding (NLU) Always Learning ALEXA SKILLS KIT . UNDER THE HOOD OF ASK A closer look

WHERE DO WE START? The Evolution of a Skill

Traffic Skill Example Give  an  estimated  time  of  arrival  from  home  to  work.  

Traffic Skill Example Include  accidents,  construction  and  closures  on  route.  

Traffic Skill Example Proactively  alert  user  to  delays  and  provide  alternate  routes.  

R U N Evolve Over Time

C R A W L What’s Your Core Functionality?

ANALYZE USER FEEDBACK & OPTIMIZE SKILL

W A L K Expand Capabilities & Features

INNOVATE FOR CUSTOMERS

Page 17: Enabling voice-based interactions · Automated Speech Recognition (ASR) Natural Language Understanding (NLU) Always Learning ALEXA SKILLS KIT . UNDER THE HOOD OF ASK A closer look

THE PLAN High-Level Framework to help get you started

We’ve  put  together  a  plan  to  take  your  projects  from  inception  to  launch  through  a  honed  process  that  includes  multiple  touch-­‐points  with  the  Alexa  team.  

V O I C E E X P E R I E N C E D E S I G N

1

Establish  Strategic  &  Creative  Direction    What’s  Your  MVP?  

Develop  User  Flows  &  Scripts  Prepare  Utterances  &  Responses  

2

D E V E L O P M E N T

Bring  the  Skill  to  Life  Initial  Skill  Submission  

Deliver  Skill  to  Amazon  For  Review  

3 T E S T I N G & C E R T I F I C AT I O N

Amazon  &  Developer  Testing  &  Adjustments    CertiSication  &  Deployment  

START

END

Page 18: Enabling voice-based interactions · Automated Speech Recognition (ASR) Natural Language Understanding (NLU) Always Learning ALEXA SKILLS KIT . UNDER THE HOOD OF ASK A closer look

L E T ’ S B U I L D A N E W S K I L L F O R A L E X A

Page 19: Enabling voice-based interactions · Automated Speech Recognition (ASR) Natural Language Understanding (NLU) Always Learning ALEXA SKILLS KIT . UNDER THE HOOD OF ASK A closer look

ALEXA SKILL K IT High Level Overview

Your Code

Page 20: Enabling voice-based interactions · Automated Speech Recognition (ASR) Natural Language Understanding (NLU) Always Learning ALEXA SKILLS KIT . UNDER THE HOOD OF ASK A closer look

ALEXA SKILL K IT High Level Overview

Amazon EC2

Page 21: Enabling voice-based interactions · Automated Speech Recognition (ASR) Natural Language Understanding (NLU) Always Learning ALEXA SKILLS KIT . UNDER THE HOOD OF ASK A closer look

ALEXA SKILL K IT High Level Overview

Availability Zone 1

Web tier

App tier

RDS (Master) Availability

Zone 2 RDS

(Standby)

Page 22: Enabling voice-based interactions · Automated Speech Recognition (ASR) Natural Language Understanding (NLU) Always Learning ALEXA SKILLS KIT . UNDER THE HOOD OF ASK A closer look

ALEXA SKILL K IT High Level Overview

Elastic Beanstalk environment

Auto Scaling group

Elastic Beanstalk container

Auto Scaling group

Elastic Beanstalk container

Prod 1

Prod 2

Route 53

Page 23: Enabling voice-based interactions · Automated Speech Recognition (ASR) Natural Language Understanding (NLU) Always Learning ALEXA SKILLS KIT . UNDER THE HOOD OF ASK A closer look

ALEXA SKILL K IT High Level Overview

AWS  Lambda  

Page 24: Enabling voice-based interactions · Automated Speech Recognition (ASR) Natural Language Understanding (NLU) Always Learning ALEXA SKILLS KIT . UNDER THE HOOD OF ASK A closer look

ALEXA SKILL K IT Voice Model

Intents

Utterances

Slots

Page 25: Enabling voice-based interactions · Automated Speech Recognition (ASR) Natural Language Understanding (NLU) Always Learning ALEXA SKILLS KIT . UNDER THE HOOD OF ASK A closer look

ALEXA SKILL K IT Voice Model

Intents

Utterances

Slots

Page 26: Enabling voice-based interactions · Automated Speech Recognition (ASR) Natural Language Understanding (NLU) Always Learning ALEXA SKILLS KIT . UNDER THE HOOD OF ASK A closer look

ALEXA SKILL K IT Voice Model

Intents

Utterances

Slots

Page 27: Enabling voice-based interactions · Automated Speech Recognition (ASR) Natural Language Understanding (NLU) Always Learning ALEXA SKILLS KIT . UNDER THE HOOD OF ASK A closer look

ALEXA SKILL K IT Voice Model

Intents

Utterances

Slots

Page 28: Enabling voice-based interactions · Automated Speech Recognition (ASR) Natural Language Understanding (NLU) Always Learning ALEXA SKILLS KIT . UNDER THE HOOD OF ASK A closer look

ALEXA SKILL K IT NodeJS Code

Page 29: Enabling voice-based interactions · Automated Speech Recognition (ASR) Natural Language Understanding (NLU) Always Learning ALEXA SKILLS KIT . UNDER THE HOOD OF ASK A closer look

ALEXA SKILL K IT Developer Console

Page 30: Enabling voice-based interactions · Automated Speech Recognition (ASR) Natural Language Understanding (NLU) Always Learning ALEXA SKILLS KIT . UNDER THE HOOD OF ASK A closer look

ALEXA SKILL K IT Developer Console

Page 31: Enabling voice-based interactions · Automated Speech Recognition (ASR) Natural Language Understanding (NLU) Always Learning ALEXA SKILLS KIT . UNDER THE HOOD OF ASK A closer look

ALEXA SKILL K IT Developer Console

Page 32: Enabling voice-based interactions · Automated Speech Recognition (ASR) Natural Language Understanding (NLU) Always Learning ALEXA SKILLS KIT . UNDER THE HOOD OF ASK A closer look

ALEXA SKILL K IT Developer Console

Page 33: Enabling voice-based interactions · Automated Speech Recognition (ASR) Natural Language Understanding (NLU) Always Learning ALEXA SKILLS KIT . UNDER THE HOOD OF ASK A closer look

Thank you Sébastien Stormacq [email protected]