SUMMIT - Amazon Web Services... · Kinesis Data. Streams. Kinesis. Data. Analytics. Kinesis Data...
Transcript of SUMMIT - Amazon Web Services... · Kinesis Data. Streams. Kinesis. Data. Analytics. Kinesis Data...
S U M M I TB E R L I N
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Using Machine Learning for Serverless AnalyticsDanilo PocciaPrincipal Evangelist, ServerlessAWS
@danilop
S e s s i o n I D
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
What is serverless?
No infrastructure provisioning, no management
Automatic scaling
Pay for value Highly available and secure
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
More machine learning happens on AWS than anywhere else
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
M L F R A M E W O R K S &
I N F R A S T R U C T U R E
The Amazon ML stack: Broadest & deepest set of capabilities
A I S E R V I C E SR E K O G N I T I O N
I M A G EP O L L Y T R A N S C R I B E T R A N S L A T E C O M P R E H E N D
& C O M P R E H E N D M E D I C A L
L E XR E K O G N I T I O NV I D E O
Vis ion Speech Chatbots
A M A Z O N S A G E M A K E R
B U I L D T R A I N
F O R E C A S TT E X T R A C T P E R S O N A L I Z E
D E P L O Y
Pre-bui l t a lgor i thms & notebooks
Data label ing (G R O U N D T R U T H )
One-c l ick model t ra in ing & tuning
Opt imizat ion (N E O )
One-c l ick deployment & host ingM L S E R V I C E S
F r a m e w o r k s I n t e r f a c e s I n f r a s t r u c t u r e
E C 2 P 3 & P 3 d n
E C 2 C 5 F P G A s G R E E N G R A S S E L A S T I CI N F E R E N C E
Reinforcement learn ingAlgor i thms & models ( A W S M A R K E T P L A C E F O R M A C H I N E L E A R N I N G )
Language Forecast ing Recommendat ions
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Put AI to work for your business
Pre-trained AI services that require no ML skills or training
Easily add intelligence to your existing apps and workflows
Quality and accuracy from continuously-learning APIs
A I S E R V I C E SR E K O G N I T I O N
I M A G EP O L L Y T R A N S C R I B E T R A N S L A T E C O M P R E H E N D
& C O M P R E H E N D M E D I C A L
L E XR E K O G N I T I O NV I D E O
Vis ion Speech Chatbots
F O R E C A S TT E X T R A C T P E R S O N A L I Z E
Language Forecast ing Recommendat ions
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Can I build a completely serverless data analytics platform?
Can I process both batch and streaming data?
Can I use Machine Learning to get insights from data?
What about text, audio, images, and videos?
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Serverless Machine Learning + Analytics
Files S3 Bucket
AWS IoT Core
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Serverless Machine Learning + Analytics
Files S3 Bucket
AWS IoT Core
S3 Bucket
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Serverless Machine Learning + Analytics
Files S3 Bucket
AWS IoT Core
S3 Bucket
• Validate syntax• Enrich data• External lookups
• DynamoDB Table• RDS Database
• Anything, it’s your code!
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Serverless Machine Learning + Analytics
Files S3 Bucket
AWS Glue(Crawlers, Jobs
&Data Catalog)
AWS IoT Core
S3 Bucket
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Serverless Machine Learning + Analytics
Files S3 Bucket
AWS Glue(Crawlers, Jobs
&Data Catalog)
AWS IoT Core
S3 Bucket
• Integrated Data Catalog• Automatic schema discovery• Code generation• Developer endpoints• Flexible job scheduler
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Serverless Machine Learning + Analytics
Files S3 Bucket
AmazonAthena
AWS Glue(Crawlers, Jobs
&Data Catalog)
AWS IoT Core
S3 Bucket
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Serverless Machine Learning + Analytics
Files S3 Bucket
AmazonAthena
AmazonQuickSight
AWS Glue(Crawlers, Jobs
&Data Catalog)
AWS IoT Core
S3 Bucket
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Serverless Machine Learning + Analytics
Files
Data Stream
S3 Bucket
AmazonAthena
AmazonQuickSight
AWS Glue(Crawlers, Jobs
&Data Catalog)
AWS IoT Core
KinesisData
Firehose
S3 Bucket
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Serverless Machine Learning + Analytics
Files
Data Stream
S3 Bucket
AmazonAthena
AmazonQuickSight
AWS Glue(Crawlers, Jobs
&Data Catalog)
AWS IoT Core
KinesisData
Streams
KinesisData
Analytics
KinesisData
Firehose
S3 Bucket
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Serverless Machine Learning + Analytics
Files
Data Stream
S3 Bucket
AWS IoT Core
KinesisData
Streams
KinesisData
Analytics
KinesisData
Firehose
• Capture• Transform• Load data streams
• Process data streams in real time with SQL
• Sliding windows• Tumbling windows
• Use built-in functions that are optimized for stream processing
• Anomaly detection• Top-K analysis
• Process or analyze streaming data
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Serverless Machine Learning + Analytics
Files
Data Stream
Video Stream
S3 Bucket
KinesisVideo
StreamAmazonAthena
AmazonQuickSight
AWS Glue(Crawlers, Jobs
&Data Catalog)
AWS IoT Core
KinesisData
Streams
KinesisData
Analytics
KinesisData
FirehoseOutside of AWS
S3 Bucket
CustomProcessing
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Serverless Machine Learning + Analytics
Video Stream KinesisVideo
Stream
AWS IoT Core
CustomProcessing
Securely stream video from connected devices to AWS for analytics, machine learning (ML), and other processing
Kinesis Video Producer SDK• Gstreamer-plugin,• Docker images for Ubuntu,
MacOS, and Raspberry Pi • Kinesis Video Streams applications get data, such as fragments and frames, from a Kinesis video stream to view, process, or analyze it
• Get media with low-latency using the Kinesis Video Stream Parser Library
Serverless
But you may need it :)
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Serverless Machine Learning + Analytics
Files
Data Stream
Video Stream
S3 Bucket
KinesisVideo
StreamAmazonAthena
AmazonQuickSight
AWS Glue(Crawlers, Jobs
&Data Catalog)
IoTDevice AWS IoT Core
KinesisData
Streams
KinesisData
Analytics
KinesisData
FirehoseOutside of AWS
S3 Bucket
CustomProcessing
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Serverless Machine Learning + Analytics
Files
Data Stream
Video Stream
S3 Bucket
KinesisVideo
StreamAmazonAthena
AmazonQuickSight
AWS Glue(Crawlers, Jobs
&Data Catalog)
AWS IoTAnalytics
IoTDevice AWS IoT Core
KinesisData
Streams
KinesisData
Analytics
KinesisData
FirehoseOutside of AWS
S3 Bucket
CustomProcessing
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Serverless Machine Learning + Analytics
AWS IoTAnalytics
IoTDevice AWS IoT Core
• Standard SQL queries• Run time-series analyses• Cleans false readings• Fill gaps in the data• Perform mathematical
transformations of message data
• Use Lambda functions to enrich your device data from external sources
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Serverless Machine Learning + Analytics
Files
Data Stream
Video Stream
S3 Bucket
KinesisVideo
Stream
CustomProcessing
AmazonAthena
AmazonQuickSight
AWS Glue(Crawlers, Jobs
&Data Catalog)
AWS IoTAnalytics
IoTDevice AWS IoT Core
KinesisData
Streams
KinesisData
Analytics
KinesisData
Firehose
AWSGreengrass
Outside of AWS
S3 Bucket
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Serverless Machine Learning + Analytics
Video Stream
IoTDevice AWS IoT Core
AWSGreengrass
Outside of AWS
• Local compute (Lambda functions)• Messaging• Data caching• Synchronize data• ML inference
Connected devices
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Serverless Machine Learning + Analytics
Files
Data Stream
Video Stream
S3 Bucket
KinesisVideo
Stream
MachineLearning
Text
Audio
ImageVideo
AmazonAthena
AmazonQuickSight
AWS Glue(Crawlers, Jobs
&Data Catalog)
AWS IoTAnalytics
IoTDevice AWS IoT Core
KinesisData
Streams
KinesisData
Analytics
KinesisData
Firehose
AWSGreengrass
Outside of AWS
Text
ScannedDocumen
t
S3 Bucket
Custom Models
MachineLearning
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Serverless Machine Learning + Analytics
Files
Data Stream
Video Stream
S3 Bucket
KinesisVideo
Stream
AmazonRekognition
AmazonRekognition
AmazonComprehend
AmazonTranscribe
Text
Audio
ImageVideo
AmazonAthena
AmazonQuickSight
AWS Glue(Crawlers, Jobs
&Data Catalog)
AmazonSageMaker
AWS IoTAnalytics
IoTDevice AWS IoT Core
KinesisData
Streams
KinesisData
Analytics
KinesisData
Firehose
AWSGreengrass
AmazonTranslate
AmazonTextract
Outside of AWS
Text
ScannedDocumen
t
S3 Bucket
Custom Models
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Serverless Machine Learning + Analytics
Files
Video Stream
S3 Bucket
KinesisVideo
Stream
AmazonRekognition
AmazonRekognition
AmazonComprehend
AmazonTranscribe
Text
Audio
ImageVideo
AmazonSageMaker
AmazonTranslate
AmazonTextract
Text
ScannedDocumen
t
Custom Models
• Dominant language• Entities• Key Phrases• Sentiment• Topic Modeling
• Transcribe to text
• Labels• Faces• Celebrities• Moderation• Text• Tracking
• Extracts text and data
• Built-in algorithms• Your own algorithms
Same Lambda function for all formats, or different Lambda functions using object key name filtering (e.g. by suffix)
• Translate to common language
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Serverless Machine Learning + Analytics
Files
Video Stream
S3 Bucket
KinesisVideo
Stream
AmazonRekognition
AmazonRekognition
AmazonComprehend
AmazonTranscribe
Text
Audio
ImageVideo
AmazonSageMaker
AmazonTranslate
AmazonTextract
Text
ScannedDocumen
t
Custom Models
Built-in algorithms
• Linear Learner• Factorization Machines• XGBoost Algorithm• Image Classification Algorithm• Sequence to Sequence (seq2seq)• K-Means Algorithm• Principal Component Analysis (PCA)• Latent Dirichlet Allocation (LDA)• Neural Topic Model (NTM)• DeepAR Forecasting• BlazingText• Random Cut Forest• …
Your own algorithms
• TensorFlow• Apache MXNet• Chainer• PyTorch• Apache Spark• …
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Serverless Machine Learning + Analytics
Files
Data Stream
Video Stream
S3 Bucket
KinesisVideo
Stream
AmazonRekognition
AmazonRekognition
AmazonComprehend
AmazonTranscribe
Text
Audio
ImageVideo
AmazonAthena
AmazonQuickSight
AWS Glue(Crawlers, Jobs
&Data Catalog)
AmazonSageMaker
AWS IoTAnalytics
IoTDevice AWS IoT Core
KinesisData
Streams
KinesisData
Analytics
KinesisData
Firehose
AWSGreengrass
AmazonTranslate
AmazonTextract
Outside of AWS
Text
ScannedDocumen
t
S3 Bucket
Custom Models
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Serverless Machine Learning + Analytics
Files
Data Stream
Video Stream
S3 Bucket
KinesisVideo
Stream
AmazonRekognition
AmazonRekognition
AmazonComprehend
AmazonTranscribe
Text
Audio
ImageVideo
AmazonAthena
AmazonQuickSight
AWS Glue(Crawlers, Jobs
&Data Catalog)
AmazonSageMaker
AWS IoTAnalytics
IoTDevice AWS IoT Core
KinesisData
Streams
KinesisData
Analytics
KinesisData
Firehose
AWSGreengrass
AmazonForecast
AmazonPersonalize
AmazonTranslate
AmazonTextract
Outside of AWS
Text
ScannedDocumen
t
S3 Bucket
Custom Models
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Serverless Machine Learning + Analytics
AmazonForecast
AmazonPersonalize
S3 Bucket
Time-series forecasting
Real-time personalization and recommendation
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Serverless Machine Learning + Analytics
Files
Data Stream
Video Stream
S3 Bucket
KinesisVideo
Stream
AmazonRekognition
AmazonRekognition
AmazonComprehend
AmazonTranscribe
Text
Audio
ImageVideo
AmazonAthena
AmazonQuickSight
AWS Glue(Crawlers, Jobs
&Data Catalog)
AmazonSageMaker
AWS IoTAnalytics
IoTDevice AWS IoT Core
KinesisData
Streams
KinesisData
Analytics
KinesisData
Firehose
AWSGreengrass
AmazonForecast
AmazonPersonalize
AmazonTranslate
AmazonTextract
Outside of AWS
Text
ScannedDocumen
t
S3 Bucket
Custom Models
Notebook
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Data Format Optimization
Partitioning
Compression
Columnar Formats (Parquet, ORC)
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
I t ’s not just Serverless
Amazon Redshift & Redshift Spectrum
Amazon Elastic MapReduce (EMR) & Apache Spark
Amazon SageMaker & Jupiter Notebooks
S U M M I T © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Thank you!
S U M M I T © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Danilo Poccia@danilop
S U M M I T © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.