Ingest Options on AWS
-
Upload
amazon-web-services -
Category
Technology
-
view
544 -
download
0
Transcript of Ingest Options on AWS
![Page 1: Ingest Options on AWS](https://reader033.fdocuments.us/reader033/viewer/2022042607/55a700de1a28abed5e8b47be/html5/thumbnails/1.jpg)
Ingestion Options on AWS
©2015, Amazon Web Services, Inc. or its affiliates. All rights reserved.
![Page 2: Ingest Options on AWS](https://reader033.fdocuments.us/reader033/viewer/2022042607/55a700de1a28abed5e8b47be/html5/thumbnails/2.jpg)
Managed IT
Services
Secure
High AvailabilityGlobal
Scale
![Page 3: Ingest Options on AWS](https://reader033.fdocuments.us/reader033/viewer/2022042607/55a700de1a28abed5e8b47be/html5/thumbnails/3.jpg)
AWS Global Infrastructure
11 Regions
28+ Availability Zones
50+ Edge locations
![Page 4: Ingest Options on AWS](https://reader033.fdocuments.us/reader033/viewer/2022042607/55a700de1a28abed5e8b47be/html5/thumbnails/4.jpg)
AWS Regions and Availability Zones
Customer decides where applications and data reside
Asia Pacific (Tokyo) US West (Oregon)EU (Ireland) US East (N. Virginia)
US West (N. Cal)(Asia Pacific) Singapore
AWS GovCloud (US) South America (Sao Paulo) Asia Pacific (Sydney)
Availability
Zone
Availability
Zone
Availability
Zone
Availability
Zone Availability
Zone
Availability
Zone
Availability
ZoneAvailability
Zone
Availability
Zone
Availability
Zone
Availability
Zone
Availability
Zone
Availability
Zone
Availability
Zone
Availability
Zone
Availability
ZoneAvailability
Zone
Availability
Zone
Availability
Zone
Availability
Zone
Availability
Zone
Availability
Zone
Availability
Zone
China (Beijing - BETA)
Availability
Zone
Availability
Zone
![Page 5: Ingest Options on AWS](https://reader033.fdocuments.us/reader033/viewer/2022042607/55a700de1a28abed5e8b47be/html5/thumbnails/5.jpg)
Data Ingestion Options
AWS Direct ConnectDedicated bandwidth between
your site and AWS
InternetTransfer data in a secure SSL tunnel over
the public Internet
AWS Import/ExportPhysical transfer of media into and
out of AWS
![Page 6: Ingest Options on AWS](https://reader033.fdocuments.us/reader033/viewer/2022042607/55a700de1a28abed5e8b47be/html5/thumbnails/6.jpg)
AWS Ingest OptionsInternet / One Common Theme: Parallel Uploads
1. Multipart upload
2. Request rate optimization
3. TCP window scaling
4. TCP selective
acknowledgement
AWS has customers that ingest roughly 1 PB per day
![Page 7: Ingest Options on AWS](https://reader033.fdocuments.us/reader033/viewer/2022042607/55a700de1a28abed5e8b47be/html5/thumbnails/7.jpg)
Reducing Object Storage Costs
Amazon Simple
Storage Service
(S3)
Amazon Glacier
Single API access
(regardless of the
storage class)
> Durability
>> Scale
>>> Cost Amazon S3 (RRS)
<$0.03/GB
<$0.024/GB
<$0.01/GB
![Page 8: Ingest Options on AWS](https://reader033.fdocuments.us/reader033/viewer/2022042607/55a700de1a28abed5e8b47be/html5/thumbnails/8.jpg)
S3 & Working with Large Files
S3 Bucket
S3 SDK
AWS S3
S3 multi-part Upload
Files
corporate data center S3 Object <= 5TB
![Page 9: Ingest Options on AWS](https://reader033.fdocuments.us/reader033/viewer/2022042607/55a700de1a28abed5e8b47be/html5/thumbnails/9.jpg)
Amazon S3 Encryption Options
1. Sever-Side Encryption (SSE)– Provides an integrated solution where Amazon handles key
management
2. SSE-Customer (SSE-C)– Perform the encryption and decryption of your objects while retaining
control of the keys used to encrypt objects.
3. Client library (e.g. Amazon S3 Encryption Client)– Objects encrypted before they are sent to Amazon S3 for storage.
![Page 10: Ingest Options on AWS](https://reader033.fdocuments.us/reader033/viewer/2022042607/55a700de1a28abed5e8b47be/html5/thumbnails/10.jpg)
AWS Ingest OptionsAWS Direct Connect
• Private connectivity to AWS– Physical connection – 1 Gbps or 10 Gbps
port
• Consistent network performance• Consider burst models on ingest• Reduces costs for bandwidth-
heavy outbound workloads
Locations• CoreSite 32 Avenue of the Americas, NY
• CoreSite One Wilshire & 900 North Alameda, LA
• Equinix DC1 – DC6 & DC10 - DC11, Ashburn, VA
• Equinix SV1 & SV5, San Jose, CA
• Equinix SE2 & SE3, Seattle, WA
• Equinix SG2, Singapore
• Equinix SY3, Sydney
• Equinix TY2, Tokyo
• Eircom, Clonshaugh
• TelecityGroup Docklands, London
• Terremark NAP do Brasil, Sao Paulo
![Page 11: Ingest Options on AWS](https://reader033.fdocuments.us/reader033/viewer/2022042607/55a700de1a28abed5e8b47be/html5/thumbnails/11.jpg)
AWS Ingest OptionsAWS Import/Export
• Rapidly move data into and
out of AWS
• Portable storage device
shipment to AWS
• Supports– Amazon EBS
– Amazon S3
– Amazon Glacier
• Use cases– Initial data migration
– Content distribution via portable
devices
– Disaster recovery
![Page 12: Ingest Options on AWS](https://reader033.fdocuments.us/reader033/viewer/2022042607/55a700de1a28abed5e8b47be/html5/thumbnails/12.jpg)
AWS Storage Gateway
• On-premises, virtual iSCSI
storage appliance
• $125 / Month
• Local cache enables low
latency access to data
• Server Side Encryption (SSE)
• 5 TB of throughput per day
• Recover to Amazon EBS
![Page 13: Ingest Options on AWS](https://reader033.fdocuments.us/reader033/viewer/2022042607/55a700de1a28abed5e8b47be/html5/thumbnails/13.jpg)
Media Ingest for AWS
AWS Import/
Export
Amazon S3
(multi-part Upload)
AWS Storage Gateway
Service
AWS Direct
Connect
![Page 14: Ingest Options on AWS](https://reader033.fdocuments.us/reader033/viewer/2022042607/55a700de1a28abed5e8b47be/html5/thumbnails/14.jpg)
Media S/W in the AWS Marketplace
AWS Marketplace: Online Software Store
• Find, research, try & buy software
• 1-Click launch – application running minutes
• S/W Billing fully integrated into AWS account
• 1700 products across 25 categories
Developer Tool Categories Include
• Media Servers
• Transcoding
• Media Publishing
• Digital Asset Management
• Image Resizing
![Page 15: Ingest Options on AWS](https://reader033.fdocuments.us/reader033/viewer/2022042607/55a700de1a28abed5e8b47be/html5/thumbnails/15.jpg)
M&E Partner Eco-System Highlights
4/29/2015 –
INGEST STORE MANAGE SECUREPROCESS
CREATEMONETIZE
INTEGRATEDELIVER
![Page 16: Ingest Options on AWS](https://reader033.fdocuments.us/reader033/viewer/2022042607/55a700de1a28abed5e8b47be/html5/thumbnails/16.jpg)
Thank you!
©2015, Amazon Web Services, Inc. or its affiliates. All rights reserved.
![Page 17: Ingest Options on AWS](https://reader033.fdocuments.us/reader033/viewer/2022042607/55a700de1a28abed5e8b47be/html5/thumbnails/17.jpg)
AWS SDKs
Java Python (boto) PHP .NET Ruby Node.js
iOS Android AWS Toolkit for
Visual Studio
AWS Toolkit
for Eclipse
AWS Tools for
Windows
PowerShell
AWS CLI
JavaScript
©2015, Amazon Web Services, Inc. or its affiliates. All rights reserved.