AWS Data Stores… · 2020. 8. 21. · AWS DATA STORES Amazon Simple Storage Service (S3) Unlimited...
Transcript of AWS Data Stores… · 2020. 8. 21. · AWS DATA STORES Amazon Simple Storage Service (S3) Unlimited...
![Page 1: AWS Data Stores… · 2020. 8. 21. · AWS DATA STORES Amazon Simple Storage Service (S3) Unlimited data storage that provides object based storage for any type of data. Go to place](https://reader035.fdocuments.us/reader035/viewer/2022081621/612ef58f1ecc5158694323de/html5/thumbnails/1.jpg)
AWS Data Stores
Brock TubreINSTRUCTOR
![Page 2: AWS Data Stores… · 2020. 8. 21. · AWS DATA STORES Amazon Simple Storage Service (S3) Unlimited data storage that provides object based storage for any type of data. Go to place](https://reader035.fdocuments.us/reader035/viewer/2022081621/612ef58f1ecc5158694323de/html5/thumbnails/2.jpg)
AWS Data StoresAWS DATA STORES
![Page 3: AWS Data Stores… · 2020. 8. 21. · AWS DATA STORES Amazon Simple Storage Service (S3) Unlimited data storage that provides object based storage for any type of data. Go to place](https://reader035.fdocuments.us/reader035/viewer/2022081621/612ef58f1ecc5158694323de/html5/thumbnails/3.jpg)
S3
AWS Data StoresAWS DATA STORES
![Page 4: AWS Data Stores… · 2020. 8. 21. · AWS DATA STORES Amazon Simple Storage Service (S3) Unlimited data storage that provides object based storage for any type of data. Go to place](https://reader035.fdocuments.us/reader035/viewer/2022081621/612ef58f1ecc5158694323de/html5/thumbnails/4.jpg)
AWS DATA STORES
Amazon Simple Storage Service (S3)Unlimited data storage that provides object based storage for any type of data.
Go to place for storing Machine Learning data. S3
What is S3?
![Page 5: AWS Data Stores… · 2020. 8. 21. · AWS DATA STORES Amazon Simple Storage Service (S3) Unlimited data storage that provides object based storage for any type of data. Go to place](https://reader035.fdocuments.us/reader035/viewer/2022081621/612ef58f1ecc5158694323de/html5/thumbnails/5.jpg)
• Files can be from 0 bytes to 5 TB.
• There is unlimited storage.
• Files are stored into buckets (similar to folders).
• S3 is a universal namespace. That is, names must be unique globally.
• https://s3-us-east-1.amazonaws.com/machinelearningdata
• https://machinelearning.s3.amazonaws.com/
AWS DATA STORES
What is S3?
S3
![Page 6: AWS Data Stores… · 2020. 8. 21. · AWS DATA STORES Amazon Simple Storage Service (S3) Unlimited data storage that provides object based storage for any type of data. Go to place](https://reader035.fdocuments.us/reader035/viewer/2022081621/612ef58f1ecc5158694323de/html5/thumbnails/6.jpg)
• Files can be from 0 bytes to 5 TB.
• There is unlimited storage.
• Files are stored into buckets (similar to folders).
• S3 is a universal namespace. That is, names must be unique globally.
• https://s3-us-east-1.amazonaws.com/machinelearningdata
• https://machinelearning.s3.amazonaws.com/
AWS DATA STORES
What is S3?
S3
![Page 7: AWS Data Stores… · 2020. 8. 21. · AWS DATA STORES Amazon Simple Storage Service (S3) Unlimited data storage that provides object based storage for any type of data. Go to place](https://reader035.fdocuments.us/reader035/viewer/2022081621/612ef58f1ecc5158694323de/html5/thumbnails/7.jpg)
Get Data into S3
S3
AWS DATA STORES
![Page 8: AWS Data Stores… · 2020. 8. 21. · AWS DATA STORES Amazon Simple Storage Service (S3) Unlimited data storage that provides object based storage for any type of data. Go to place](https://reader035.fdocuments.us/reader035/viewer/2022081621/612ef58f1ecc5158694323de/html5/thumbnails/8.jpg)
Get Data into S3AWS DATA STORES
![Page 9: AWS Data Stores… · 2020. 8. 21. · AWS DATA STORES Amazon Simple Storage Service (S3) Unlimited data storage that provides object based storage for any type of data. Go to place](https://reader035.fdocuments.us/reader035/viewer/2022081621/612ef58f1ecc5158694323de/html5/thumbnails/9.jpg)
Relational Database Service
Data Stores
S3 RDS Dynamo DB Document DBRed Shift Timestream
AWS DATA STORES
![Page 10: AWS Data Stores… · 2020. 8. 21. · AWS DATA STORES Amazon Simple Storage Service (S3) Unlimited data storage that provides object based storage for any type of data. Go to place](https://reader035.fdocuments.us/reader035/viewer/2022081621/612ef58f1ecc5158694323de/html5/thumbnails/10.jpg)
Relational Database ServiceAWS DATA STORES
![Page 11: AWS Data Stores… · 2020. 8. 21. · AWS DATA STORES Amazon Simple Storage Service (S3) Unlimited data storage that provides object based storage for any type of data. Go to place](https://reader035.fdocuments.us/reader035/viewer/2022081621/612ef58f1ecc5158694323de/html5/thumbnails/11.jpg)
Relational Database ServiceAWS DATA STORES
![Page 12: AWS Data Stores… · 2020. 8. 21. · AWS DATA STORES Amazon Simple Storage Service (S3) Unlimited data storage that provides object based storage for any type of data. Go to place](https://reader035.fdocuments.us/reader035/viewer/2022081621/612ef58f1ecc5158694323de/html5/thumbnails/12.jpg)
Dynamo DBAWS DATA STORES
Data Stores
S3 RDS Dynamo DB Document DBRed Shift Timestream
![Page 13: AWS Data Stores… · 2020. 8. 21. · AWS DATA STORES Amazon Simple Storage Service (S3) Unlimited data storage that provides object based storage for any type of data. Go to place](https://reader035.fdocuments.us/reader035/viewer/2022081621/612ef58f1ecc5158694323de/html5/thumbnails/13.jpg)
Dynamo DBAWS DATA STORES
{ "Characters" : [
{ "ID": 1, "Name": “Luke”, "Evil": 0, “Affiliation": “Rebel”, "Weapon": “lightsaber”
}, {
"ID": 2, "Name": “Jabba the Hutt”, "Evil": 1, “Affiliation": null
} ] }
![Page 14: AWS Data Stores… · 2020. 8. 21. · AWS DATA STORES Amazon Simple Storage Service (S3) Unlimited data storage that provides object based storage for any type of data. Go to place](https://reader035.fdocuments.us/reader035/viewer/2022081621/612ef58f1ecc5158694323de/html5/thumbnails/14.jpg)
table
Dynamo DBAWS DATA STORES
{ "Characters" : [
{ "ID": 1, "Name": “Luke”, "Evil": 0, “Affiliation": “Rebel”, "Weapon": “lightsaber”
}, {
"ID": 2, "Name": “Jabba the Hutt”, "Evil": 1, “Affiliation": null
} ] }
![Page 15: AWS Data Stores… · 2020. 8. 21. · AWS DATA STORES Amazon Simple Storage Service (S3) Unlimited data storage that provides object based storage for any type of data. Go to place](https://reader035.fdocuments.us/reader035/viewer/2022081621/612ef58f1ecc5158694323de/html5/thumbnails/15.jpg)
{ "Characters" : [
{ "ID": 1, "Name": “Luke”, "Evil": 0, “Affiliation": “Rebel”, "Weapon": “lightsaber”
}, {
"ID": 2, "Name": “Jabba the Hutt”, "Evil": 1, “Affiliation": null
} ] }
table
table name
Dynamo DBAWS DATA STORES
![Page 16: AWS Data Stores… · 2020. 8. 21. · AWS DATA STORES Amazon Simple Storage Service (S3) Unlimited data storage that provides object based storage for any type of data. Go to place](https://reader035.fdocuments.us/reader035/viewer/2022081621/612ef58f1ecc5158694323de/html5/thumbnails/16.jpg)
{ "Characters" : [
{ "ID": 1, "Name": “Luke”, "Evil": 0, “Affiliation": “Rebel”, "Weapon": “lightsaber”
}, {
"ID": 2, "Name": “Jabba the Hutt”, "Evil": 1, “Affiliation": null
} ] }
item
Dynamo DBAWS DATA STORES
![Page 17: AWS Data Stores… · 2020. 8. 21. · AWS DATA STORES Amazon Simple Storage Service (S3) Unlimited data storage that provides object based storage for any type of data. Go to place](https://reader035.fdocuments.us/reader035/viewer/2022081621/612ef58f1ecc5158694323de/html5/thumbnails/17.jpg)
{ "Characters" : [
{ "ID": 1, "Name": “Luke”, "Evil": 0, “Affiliation": “Rebel”, "Weapon": “lightsaber”
}, {
"ID": 2, "Name": “Jabba the Hutt”, "Evil": 1, “Affiliation": null
} ] }
key value
Dynamo DBAWS DATA STORES
![Page 18: AWS Data Stores… · 2020. 8. 21. · AWS DATA STORES Amazon Simple Storage Service (S3) Unlimited data storage that provides object based storage for any type of data. Go to place](https://reader035.fdocuments.us/reader035/viewer/2022081621/612ef58f1ecc5158694323de/html5/thumbnails/18.jpg)
{ "Characters" : [
{ "ID": 1, "Name": “Luke”, "Evil": 0, “Affiliation": “Rebel”, "Weapon": “lightsaber”
}, {
"ID": 2, "Name": “Jabba the Hutt”, "Evil": 1, “Affiliation": null
} ] }
attribute
Dynamo DBAWS DATA STORES
![Page 19: AWS Data Stores… · 2020. 8. 21. · AWS DATA STORES Amazon Simple Storage Service (S3) Unlimited data storage that provides object based storage for any type of data. Go to place](https://reader035.fdocuments.us/reader035/viewer/2022081621/612ef58f1ecc5158694323de/html5/thumbnails/19.jpg)
Dynamo DBAWS DATA STORES
![Page 20: AWS Data Stores… · 2020. 8. 21. · AWS DATA STORES Amazon Simple Storage Service (S3) Unlimited data storage that provides object based storage for any type of data. Go to place](https://reader035.fdocuments.us/reader035/viewer/2022081621/612ef58f1ecc5158694323de/html5/thumbnails/20.jpg)
Data Stores
S3 RDS Dynamo DB Document DBRedshift Timestream
RedshiftAWS DATA STORES
![Page 21: AWS Data Stores… · 2020. 8. 21. · AWS DATA STORES Amazon Simple Storage Service (S3) Unlimited data storage that provides object based storage for any type of data. Go to place](https://reader035.fdocuments.us/reader035/viewer/2022081621/612ef58f1ecc5158694323de/html5/thumbnails/21.jpg)
SQL Client / BI / Analytics Tools
Source 1
Source 2
Source 3 Redshift
RedshiftAWS DATA STORES
![Page 22: AWS Data Stores… · 2020. 8. 21. · AWS DATA STORES Amazon Simple Storage Service (S3) Unlimited data storage that provides object based storage for any type of data. Go to place](https://reader035.fdocuments.us/reader035/viewer/2022081621/612ef58f1ecc5158694323de/html5/thumbnails/22.jpg)
RedshiftAWS DATA STORES
![Page 23: AWS Data Stores… · 2020. 8. 21. · AWS DATA STORES Amazon Simple Storage Service (S3) Unlimited data storage that provides object based storage for any type of data. Go to place](https://reader035.fdocuments.us/reader035/viewer/2022081621/612ef58f1ecc5158694323de/html5/thumbnails/23.jpg)
S3 QuickSightRedshiftSpectrum
Redshift SpectrumAWS DATA STORES
![Page 24: AWS Data Stores… · 2020. 8. 21. · AWS DATA STORES Amazon Simple Storage Service (S3) Unlimited data storage that provides object based storage for any type of data. Go to place](https://reader035.fdocuments.us/reader035/viewer/2022081621/612ef58f1ecc5158694323de/html5/thumbnails/24.jpg)
Data Stores
S3 RDS Dynamo DB Document DBRed Shift Timestream
Amazon TimestreamAWS DATA STORES
![Page 25: AWS Data Stores… · 2020. 8. 21. · AWS DATA STORES Amazon Simple Storage Service (S3) Unlimited data storage that provides object based storage for any type of data. Go to place](https://reader035.fdocuments.us/reader035/viewer/2022081621/612ef58f1ecc5158694323de/html5/thumbnails/25.jpg)
Time series data SQL Client / BI / Analytics ToolsTimestream
Amazon TimestreamAWS DATA STORES
![Page 26: AWS Data Stores… · 2020. 8. 21. · AWS DATA STORES Amazon Simple Storage Service (S3) Unlimited data storage that provides object based storage for any type of data. Go to place](https://reader035.fdocuments.us/reader035/viewer/2022081621/612ef58f1ecc5158694323de/html5/thumbnails/26.jpg)
Document DBAWS DATA STORES
Data Stores
S3 RDS Dynamo DB Document DBRed Shift Timestream
![Page 27: AWS Data Stores… · 2020. 8. 21. · AWS DATA STORES Amazon Simple Storage Service (S3) Unlimited data storage that provides object based storage for any type of data. Go to place](https://reader035.fdocuments.us/reader035/viewer/2022081621/612ef58f1ecc5158694323de/html5/thumbnails/27.jpg)
Document DBAWS DATA STORES
![Page 28: AWS Data Stores… · 2020. 8. 21. · AWS DATA STORES Amazon Simple Storage Service (S3) Unlimited data storage that provides object based storage for any type of data. Go to place](https://reader035.fdocuments.us/reader035/viewer/2022081621/612ef58f1ecc5158694323de/html5/thumbnails/28.jpg)
S3
AWS Data StoresAWS DATA STORES