Building Smart Applications with Conversational Interfaces and …... · 2019-03-01 · Building...
Transcript of Building Smart Applications with Conversational Interfaces and …... · 2019-03-01 · Building...
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Building Smart Applications with Conversational Interfaces and Language ServicesAlex Casalboni
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
About me
• Software Engineer & Web Developer• Startupper for 4.5 years• Serverless Lover & AI Enthusiast• ServerlessDays Organizer• AWS Customer since 2013
S U M M I T © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Put machine learning in the hands of every developer
Our mission
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Our Approach
Customer-focusedroadmap (90%+)
Most popular frameworks (Tensorflow, MXNET)
200+ new launchesduring 2018
Wide range of services in production
Security and analytics capabiities
Embedded Research & Development
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
M L F R A M E W O R K S &
I N F R A S T R U C T U R E
Amazon ML Stack
A I S E R V I C E SR E K O G N I T I O N
I M A G EP O L L Y T R A N S C R I B E T R A N S L A T E C O M P R E H E N D L E XR E K O G N I T I O N
V I D E O
Vis ion Speech Chatbots
A M A Z O N S A G E M A K E R
B U I L D T R A I N
F O R E C A S TT E X T R A C T P E R S O N A L I Z E
D E P L O YM L S E R V I C E S
F r a m e w o r k s I n t e r f a c e s I n f r a s t r u c t u r e
E C 2 P 3 & P 3 d n
E C 2 C 5 F P G A s G R E E N G R A S S E L A S T I CI N F E R E N C E
Language Forecast ing Recommendat ions
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
AI capabilitiesVision
Speech-to-Text (STT)
Text-to-Speech (TTS)
Natural Language Understanding
Language Translation
Uniform programming interfacefor text and voice apps
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
AI capabilities on AWS *Vision
Speech-to-Text (STT)
Text-to-Speech (TTS)
Natural Language Understanding
Language Translation
Chatbot Interface
Amazon Rekognition
Amazon Transcribe
Amazon Polly
Amazon Comprehend
Amazon Translate
Amazon Lex
* and more!
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Audio Input
End-to-end workloads (media)
trigger
store
in cascade
call aggregate analyze
S U M M I T © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Add intelligent image and videoanalysis to your applications
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Deep Learning-Based Image and Video Analysis
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Optical Character Recognition (OCR)
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Object & Scene Detection
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Facial Analysis
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Face Search/Comparison
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Marinus Analytics uses facial recognition to stop human trafficking
“Now with Traffic Jam’s FaceSearch, powered by
Amazon Rekognition, investigators are able to take effective action by
searching through millions of records in seconds to find
victims.”
S U M M I T © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Discover insights and relationships in text
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
NLU Functionalit ies
Sentiment Entities LanguagesKeyphrases Topic
modeling
Syntax
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
EnglishItalianFrench
GermanPortuguese
Suppor ted Languages
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Syntax detection$ aws comprehend detect-syntax
--language-code 'en' --text 'I love cloud!’{
"SyntaxTokens": [
{
"TokenId": 1,
"Text": "I",
"BeginOffset": 0,
"EndOffset": 1,
"PartOfSpeech": {
"Tag": "PRON",
"Score": 0.9999802112579346
}
},
...
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Sentiment Analysis$ aws comprehend detect-sentiment
--language-code 'en' --text 'I love cloud!’
{
"Sentiment": "POSITIVE”,
"SentimentScore": {
"Mixed": 0.012617903761565685,
"Positive": 0.9599817991256714,
"Neutral": 0.021758323535323143,
"Negative": 0.005641999188810587
}
}
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
« Amazon Comprehend helps us analyzethe key sentiments, objects, and geos in our30 million plus reviews & testimonies. Nowwe are able to discover new insights into theunique experiences available at eachproperty, so our customers can make thebest decision possible for their travel.”
Matt Fryer, VP and Chief Data Science Officer, Hotels.com
S U M M I T © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Extract health information from patient notes, clinical trial reports, and other electronic health records
S U M M I T © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Turn text into lifelike speech using deep learning
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Amazon Polly
• Content creation• Mobile & desktop
applications• Internet of Things (IoT)• Education & e-learning• Telephony• Game development
Use cases
• 58 voices across 28 languages
• Lip-syncing & text highlighting
• Fine-grained voice control• Custom vocabularies• Available in 17 AWS Regions
Key features
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
“With Amazon Polly our users benefit from the most lifelike Text-to-Speech voices
available on the market.”
Severin HackerCTO, Duolingo
S U M M I T © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Yes, natural language translation
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Supported languages *
ArabicSimplified Chinese
FrenchGermanSpanish
Portuguese
JapaneseTraditional Chinese
ItalianRussianTurkishCzech
* 417 translation combinations
DanishDutchFinnishSwedishPolish
Hebrew
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
«We operate 90 localized websites in 41 languages. (…) Having evaluated Amazon Translate and several other solutions, we believethat Amazon Translate presents a quick, efficient and most importantly, accuratesolution. »
Matt Fryer, VP and Chief Data Science Officer, Hotels.com
S U M M I T © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Turn speech into text
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
EnglishItalianFrenchSpanish
Portuguese
Suppor ted Languages
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Use cases
Call centers
Subtitles for VOD
Broadcast closed captions
Transcribe meetings
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
ringDNA• End-to-end communications platform for
sales teams. • Hundreds of enterprise organizations
use RingDNA to dramatically increase productivity, engage in smarter sales conversations, gain predictive sales insights and improve their win rate.
Speech to Text"A critical component of RingDNA’s Conversation AIrequires best of breed speech-to-text to delivertranscriptions of every phone call. RingDNA isexcited about Amazon Transcribe since itprovides high-quality speech recognition at scale,helping us to better transcribe every call to text "
Howard Brown, CEO & Founder, RingDNA
https://www.youtube.com/watch?v=1ZJ_f1bDdog
S U M M I T © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Conversational interfaces for your applications powered by the same deep learning technologies as Alexa
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Amazon Lex
End to End
Speech to Intent
ASR+NLU integrated into one
API
Dialog Management
Native support &maintains context
Text to Speech
Amazon Polly integrated into API
Business Logic
Native integration with AWS Lambda
Deployment
One click deployment
Security
Encrypted data in transit & at rest
Scale
Completely managed service
Analytics
Monitor and improve
End to End
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
S U M M I T © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
OCR++ service to extract data from virtually any document(No ML experience required)
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Amazon Textract: How it works
S U M M I T © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Accurate time-series forecasting service(No ML experience required)
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
The perils of poor predictions in forecasting
TIME
SALES
FORECAST
SALES
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Historical dataSupply chain, inventory, etc.
Customized forecasting API
Inspect data
Identify features
Selectfrom 8
algorithms
SelectHyperparameters
Host models
Loaddata
Trainmodels
Optimizemodels
Related “causal” dataWeather, special offers, product
details
Amazon Forecast
Amazon Forecast: How it works
S U M M I T © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Real-time personalization and recommendation service(No ML experience required)
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Activity stream from app
Views, signups, conversion, etc.
InventoryArticles, products,
videos, etc.
Demographics (optional)
LOAD DATA(EMR Cluster)
INSPECT DATA
IDENTIFY FEATURES
SELECTALGORITHMS
SELECTHYPERPARAMETERS
TRAINMODELS
OPTIMIZEMODELS
HOST MODELS
BUILD FEATURESTORE
CREATEREAL-TIME
CACHES
Customizedpersonalization &recommendation
API
F u l l y m a n a g e d b y A m a z o n P e r s o n a l i z e
Amazon Personalize
Age, location, etc.
Amazon Personalize: How it works
S U M M I T © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.