Matt Wood, Chief Data Scientist, Amazon Web Services
Transcript of Matt Wood, Chief Data Scientist, Amazon Web Services
![Page 1: Matt Wood, Chief Data Scientist, Amazon Web Services](https://reader033.fdocuments.us/reader033/viewer/2022052515/58a30ceb1a28abd8728c7afb/html5/thumbnails/1.jpg)
a presentation at the UNITED NATIONS STATISTICAL COMMISSION
by
DR. MATT WOOD
introducing
BIG DATA ANALYTICS
![Page 2: Matt Wood, Chief Data Scientist, Amazon Web Services](https://reader033.fdocuments.us/reader033/viewer/2022052515/58a30ceb1a28abd8728c7afb/html5/thumbnails/2.jpg)
Hello.
![Page 3: Matt Wood, Chief Data Scientist, Amazon Web Services](https://reader033.fdocuments.us/reader033/viewer/2022052515/58a30ceb1a28abd8728c7afb/html5/thumbnails/3.jpg)
Thank you.
![Page 4: Matt Wood, Chief Data Scientist, Amazon Web Services](https://reader033.fdocuments.us/reader033/viewer/2022052515/58a30ceb1a28abd8728c7afb/html5/thumbnails/4.jpg)
IData, data everywhere
![Page 5: Matt Wood, Chief Data Scientist, Amazon Web Services](https://reader033.fdocuments.us/reader033/viewer/2022052515/58a30ceb1a28abd8728c7afb/html5/thumbnails/5.jpg)
I IIData, data everywhere
Data timeline
![Page 6: Matt Wood, Chief Data Scientist, Amazon Web Services](https://reader033.fdocuments.us/reader033/viewer/2022052515/58a30ceb1a28abd8728c7afb/html5/thumbnails/6.jpg)
I II IIIData
securityData, data everywhere
Data timeline
![Page 7: Matt Wood, Chief Data Scientist, Amazon Web Services](https://reader033.fdocuments.us/reader033/viewer/2022052515/58a30ceb1a28abd8728c7afb/html5/thumbnails/7.jpg)
I II III IVData
movementData, data everywhere
Data security
Data timeline
![Page 8: Matt Wood, Chief Data Scientist, Amazon Web Services](https://reader033.fdocuments.us/reader033/viewer/2022052515/58a30ceb1a28abd8728c7afb/html5/thumbnails/8.jpg)
I II III IVData
movementData, data everywhere
Data security
Data timeline
0.Amazon web
Services
![Page 9: Matt Wood, Chief Data Scientist, Amazon Web Services](https://reader033.fdocuments.us/reader033/viewer/2022052515/58a30ceb1a28abd8728c7afb/html5/thumbnails/9.jpg)
Compute, storage & databases.
![Page 10: Matt Wood, Chief Data Scientist, Amazon Web Services](https://reader033.fdocuments.us/reader033/viewer/2022052515/58a30ceb1a28abd8728c7afb/html5/thumbnails/10.jpg)
Retail Merchantservices
Web services
![Page 11: Matt Wood, Chief Data Scientist, Amazon Web Services](https://reader033.fdocuments.us/reader033/viewer/2022052515/58a30ceb1a28abd8728c7afb/html5/thumbnails/11.jpg)
Blinding flash of the obvious.
![Page 12: Matt Wood, Chief Data Scientist, Amazon Web Services](https://reader033.fdocuments.us/reader033/viewer/2022052515/58a30ceb1a28abd8728c7afb/html5/thumbnails/12.jpg)
Available.
![Page 13: Matt Wood, Chief Data Scientist, Amazon Web Services](https://reader033.fdocuments.us/reader033/viewer/2022052515/58a30ceb1a28abd8728c7afb/html5/thumbnails/13.jpg)
Low cost.
![Page 14: Matt Wood, Chief Data Scientist, Amazon Web Services](https://reader033.fdocuments.us/reader033/viewer/2022052515/58a30ceb1a28abd8728c7afb/html5/thumbnails/14.jpg)
Flexible.
![Page 15: Matt Wood, Chief Data Scientist, Amazon Web Services](https://reader033.fdocuments.us/reader033/viewer/2022052515/58a30ceb1a28abd8728c7afb/html5/thumbnails/15.jpg)
1.3 trillion objects835k peak requests/second
![Page 16: Matt Wood, Chief Data Scientist, Amazon Web Services](https://reader033.fdocuments.us/reader033/viewer/2022052515/58a30ceb1a28abd8728c7afb/html5/thumbnails/16.jpg)
300 government agencies.1,500 educational institutions.
![Page 17: Matt Wood, Chief Data Scientist, Amazon Web Services](https://reader033.fdocuments.us/reader033/viewer/2022052515/58a30ceb1a28abd8728c7afb/html5/thumbnails/17.jpg)
Data, data everywhereI
![Page 18: Matt Wood, Chief Data Scientist, Amazon Web Services](https://reader033.fdocuments.us/reader033/viewer/2022052515/58a30ceb1a28abd8728c7afb/html5/thumbnails/18.jpg)
Generation
Collection & storage
Analytics & computation
Collaboration & sharing
![Page 19: Matt Wood, Chief Data Scientist, Amazon Web Services](https://reader033.fdocuments.us/reader033/viewer/2022052515/58a30ceb1a28abd8728c7afb/html5/thumbnails/19.jpg)
Cost of data generation is falling.
![Page 20: Matt Wood, Chief Data Scientist, Amazon Web Services](https://reader033.fdocuments.us/reader033/viewer/2022052515/58a30ceb1a28abd8728c7afb/html5/thumbnails/20.jpg)
Generation
Collection & storage
Analytics & computation
Collaboration & sharing
lower cost,increased throughput
![Page 21: Matt Wood, Chief Data Scientist, Amazon Web Services](https://reader033.fdocuments.us/reader033/viewer/2022052515/58a30ceb1a28abd8728c7afb/html5/thumbnails/21.jpg)
Generation
Collection & storage
Analytics & computation
Collaboration & sharing
highly constrained
![Page 22: Matt Wood, Chief Data Scientist, Amazon Web Services](https://reader033.fdocuments.us/reader033/viewer/2022052515/58a30ceb1a28abd8728c7afb/html5/thumbnails/22.jpg)
Gap.
![Page 23: Matt Wood, Chief Data Scientist, Amazon Web Services](https://reader033.fdocuments.us/reader033/viewer/2022052515/58a30ceb1a28abd8728c7afb/html5/thumbnails/23.jpg)
1990 2000 2010 2020
The Data Analysis Gap
Enterprise Data Data in Warehouse
Gartner: User Survey Analysis: Key Trends Shaping the Future of Data Center Infrastructure Through 2011 IDC: Worldwide Business Analytics Software 2012–2016 Forecast and 2011 Vendor Shares
Generated data
Available for analysis
Data volume
![Page 24: Matt Wood, Chief Data Scientist, Amazon Web Services](https://reader033.fdocuments.us/reader033/viewer/2022052515/58a30ceb1a28abd8728c7afb/html5/thumbnails/24.jpg)
Utility.
![Page 25: Matt Wood, Chief Data Scientist, Amazon Web Services](https://reader033.fdocuments.us/reader033/viewer/2022052515/58a30ceb1a28abd8728c7afb/html5/thumbnails/25.jpg)
Remove constraints.
![Page 26: Matt Wood, Chief Data Scientist, Amazon Web Services](https://reader033.fdocuments.us/reader033/viewer/2022052515/58a30ceb1a28abd8728c7afb/html5/thumbnails/26.jpg)
Generation
Collection & storage
Analytics & computation
Collaboration & sharing
highly constrained
![Page 27: Matt Wood, Chief Data Scientist, Amazon Web Services](https://reader033.fdocuments.us/reader033/viewer/2022052515/58a30ceb1a28abd8728c7afb/html5/thumbnails/27.jpg)
Generation
Collection & storage
Analytics & computation
Collaboration & sharing
![Page 28: Matt Wood, Chief Data Scientist, Amazon Web Services](https://reader033.fdocuments.us/reader033/viewer/2022052515/58a30ceb1a28abd8728c7afb/html5/thumbnails/28.jpg)
Close the gap.
![Page 29: Matt Wood, Chief Data Scientist, Amazon Web Services](https://reader033.fdocuments.us/reader033/viewer/2022052515/58a30ceb1a28abd8728c7afb/html5/thumbnails/29.jpg)
Technologies and techniques for working productively with data, at any scale.
![Page 30: Matt Wood, Chief Data Scientist, Amazon Web Services](https://reader033.fdocuments.us/reader033/viewer/2022052515/58a30ceb1a28abd8728c7afb/html5/thumbnails/30.jpg)
Data timelineII
![Page 31: Matt Wood, Chief Data Scientist, Amazon Web Services](https://reader033.fdocuments.us/reader033/viewer/2022052515/58a30ceb1a28abd8728c7afb/html5/thumbnails/31.jpg)
Lots of data.Lots of users.Lots of uses.
Lots of locations.
![Page 32: Matt Wood, Chief Data Scientist, Amazon Web Services](https://reader033.fdocuments.us/reader033/viewer/2022052515/58a30ceb1a28abd8728c7afb/html5/thumbnails/32.jpg)
Cost.
![Page 33: Matt Wood, Chief Data Scientist, Amazon Web Services](https://reader033.fdocuments.us/reader033/viewer/2022052515/58a30ceb1a28abd8728c7afb/html5/thumbnails/33.jpg)
Multipliers.
![Page 34: Matt Wood, Chief Data Scientist, Amazon Web Services](https://reader033.fdocuments.us/reader033/viewer/2022052515/58a30ceb1a28abd8728c7afb/html5/thumbnails/34.jpg)
Generation challenge.
![Page 35: Matt Wood, Chief Data Scientist, Amazon Web Services](https://reader033.fdocuments.us/reader033/viewer/2022052515/58a30ceb1a28abd8728c7afb/html5/thumbnails/35.jpg)
Analytics challenge.
![Page 36: Matt Wood, Chief Data Scientist, Amazon Web Services](https://reader033.fdocuments.us/reader033/viewer/2022052515/58a30ceb1a28abd8728c7afb/html5/thumbnails/36.jpg)
Co-evolution.
![Page 37: Matt Wood, Chief Data Scientist, Amazon Web Services](https://reader033.fdocuments.us/reader033/viewer/2022052515/58a30ceb1a28abd8728c7afb/html5/thumbnails/37.jpg)
Co-evolution.
software
![Page 38: Matt Wood, Chief Data Scientist, Amazon Web Services](https://reader033.fdocuments.us/reader033/viewer/2022052515/58a30ceb1a28abd8728c7afb/html5/thumbnails/38.jpg)
Co-evolution.
software
utility computing
![Page 39: Matt Wood, Chief Data Scientist, Amazon Web Services](https://reader033.fdocuments.us/reader033/viewer/2022052515/58a30ceb1a28abd8728c7afb/html5/thumbnails/39.jpg)
Hadoop.
![Page 40: Matt Wood, Chief Data Scientist, Amazon Web Services](https://reader033.fdocuments.us/reader033/viewer/2022052515/58a30ceb1a28abd8728c7afb/html5/thumbnails/40.jpg)
Availability challenge.
![Page 41: Matt Wood, Chief Data Scientist, Amazon Web Services](https://reader033.fdocuments.us/reader033/viewer/2022052515/58a30ceb1a28abd8728c7afb/html5/thumbnails/41.jpg)
Beautiful and unique.
![Page 42: Matt Wood, Chief Data Scientist, Amazon Web Services](https://reader033.fdocuments.us/reader033/viewer/2022052515/58a30ceb1a28abd8728c7afb/html5/thumbnails/42.jpg)
Snowflake Statistics
![Page 43: Matt Wood, Chief Data Scientist, Amazon Web Services](https://reader033.fdocuments.us/reader033/viewer/2022052515/58a30ceb1a28abd8728c7afb/html5/thumbnails/43.jpg)
Data has gravity.
![Page 44: Matt Wood, Chief Data Scientist, Amazon Web Services](https://reader033.fdocuments.us/reader033/viewer/2022052515/58a30ceb1a28abd8728c7afb/html5/thumbnails/44.jpg)
Move data to users.
![Page 45: Matt Wood, Chief Data Scientist, Amazon Web Services](https://reader033.fdocuments.us/reader033/viewer/2022052515/58a30ceb1a28abd8728c7afb/html5/thumbnails/45.jpg)
Move data to users.X
![Page 46: Matt Wood, Chief Data Scientist, Amazon Web Services](https://reader033.fdocuments.us/reader033/viewer/2022052515/58a30ceb1a28abd8728c7afb/html5/thumbnails/46.jpg)
Move tools to data.
![Page 47: Matt Wood, Chief Data Scientist, Amazon Web Services](https://reader033.fdocuments.us/reader033/viewer/2022052515/58a30ceb1a28abd8728c7afb/html5/thumbnails/47.jpg)
Place data where it can be easily consumed.
![Page 48: Matt Wood, Chief Data Scientist, Amazon Web Services](https://reader033.fdocuments.us/reader033/viewer/2022052515/58a30ceb1a28abd8728c7afb/html5/thumbnails/48.jpg)
![Page 49: Matt Wood, Chief Data Scientist, Amazon Web Services](https://reader033.fdocuments.us/reader033/viewer/2022052515/58a30ceb1a28abd8728c7afb/html5/thumbnails/49.jpg)
![Page 50: Matt Wood, Chief Data Scientist, Amazon Web Services](https://reader033.fdocuments.us/reader033/viewer/2022052515/58a30ceb1a28abd8728c7afb/html5/thumbnails/50.jpg)
![Page 51: Matt Wood, Chief Data Scientist, Amazon Web Services](https://reader033.fdocuments.us/reader033/viewer/2022052515/58a30ceb1a28abd8728c7afb/html5/thumbnails/51.jpg)
![Page 52: Matt Wood, Chief Data Scientist, Amazon Web Services](https://reader033.fdocuments.us/reader033/viewer/2022052515/58a30ceb1a28abd8728c7afb/html5/thumbnails/52.jpg)
![Page 53: Matt Wood, Chief Data Scientist, Amazon Web Services](https://reader033.fdocuments.us/reader033/viewer/2022052515/58a30ceb1a28abd8728c7afb/html5/thumbnails/53.jpg)
Reusable environment.
![Page 54: Matt Wood, Chief Data Scientist, Amazon Web Services](https://reader033.fdocuments.us/reader033/viewer/2022052515/58a30ceb1a28abd8728c7afb/html5/thumbnails/54.jpg)
Always more people outside your team, than within it.
![Page 55: Matt Wood, Chief Data Scientist, Amazon Web Services](https://reader033.fdocuments.us/reader033/viewer/2022052515/58a30ceb1a28abd8728c7afb/html5/thumbnails/55.jpg)
Technologies and techniques for working productively with data, at any scale.
![Page 56: Matt Wood, Chief Data Scientist, Amazon Web Services](https://reader033.fdocuments.us/reader033/viewer/2022052515/58a30ceb1a28abd8728c7afb/html5/thumbnails/56.jpg)
Data security.III
![Page 57: Matt Wood, Chief Data Scientist, Amazon Web Services](https://reader033.fdocuments.us/reader033/viewer/2022052515/58a30ceb1a28abd8728c7afb/html5/thumbnails/57.jpg)
Security is our number one priority.
![Page 58: Matt Wood, Chief Data Scientist, Amazon Web Services](https://reader033.fdocuments.us/reader033/viewer/2022052515/58a30ceb1a28abd8728c7afb/html5/thumbnails/58.jpg)
Shared responsibility.
![Page 59: Matt Wood, Chief Data Scientist, Amazon Web Services](https://reader033.fdocuments.us/reader033/viewer/2022052515/58a30ceb1a28abd8728c7afb/html5/thumbnails/59.jpg)
![Page 60: Matt Wood, Chief Data Scientist, Amazon Web Services](https://reader033.fdocuments.us/reader033/viewer/2022052515/58a30ceb1a28abd8728c7afb/html5/thumbnails/60.jpg)
Choose your region.
![Page 61: Matt Wood, Chief Data Scientist, Amazon Web Services](https://reader033.fdocuments.us/reader033/viewer/2022052515/58a30ceb1a28abd8728c7afb/html5/thumbnails/61.jpg)
Availability zones.
![Page 62: Matt Wood, Chief Data Scientist, Amazon Web Services](https://reader033.fdocuments.us/reader033/viewer/2022052515/58a30ceb1a28abd8728c7afb/html5/thumbnails/62.jpg)
ITAR
FIPS 140-2
MPAAISO 27001
SOC 2 ISAE 3402 PCI DSS
HIPAA
FISMA Moderate
![Page 63: Matt Wood, Chief Data Scientist, Amazon Web Services](https://reader033.fdocuments.us/reader033/viewer/2022052515/58a30ceb1a28abd8728c7afb/html5/thumbnails/63.jpg)
![Page 64: Matt Wood, Chief Data Scientist, Amazon Web Services](https://reader033.fdocuments.us/reader033/viewer/2022052515/58a30ceb1a28abd8728c7afb/html5/thumbnails/64.jpg)
Virtual Private Cloud.
![Page 65: Matt Wood, Chief Data Scientist, Amazon Web Services](https://reader033.fdocuments.us/reader033/viewer/2022052515/58a30ceb1a28abd8728c7afb/html5/thumbnails/65.jpg)
Network isolated environment.
![Page 66: Matt Wood, Chief Data Scientist, Amazon Web Services](https://reader033.fdocuments.us/reader033/viewer/2022052515/58a30ceb1a28abd8728c7afb/html5/thumbnails/66.jpg)
Data movement.IV
![Page 67: Matt Wood, Chief Data Scientist, Amazon Web Services](https://reader033.fdocuments.us/reader033/viewer/2022052515/58a30ceb1a28abd8728c7afb/html5/thumbnails/67.jpg)
“How do I get my data into the cloud?”
![Page 68: Matt Wood, Chief Data Scientist, Amazon Web Services](https://reader033.fdocuments.us/reader033/viewer/2022052515/58a30ceb1a28abd8728c7afb/html5/thumbnails/68.jpg)
Generated and stored in the AWS cloud.
![Page 69: Matt Wood, Chief Data Scientist, Amazon Web Services](https://reader033.fdocuments.us/reader033/viewer/2022052515/58a30ceb1a28abd8728c7afb/html5/thumbnails/69.jpg)
Inbound transfer if free.
![Page 70: Matt Wood, Chief Data Scientist, Amazon Web Services](https://reader033.fdocuments.us/reader033/viewer/2022052515/58a30ceb1a28abd8728c7afb/html5/thumbnails/70.jpg)
Multipart upload.
![Page 71: Matt Wood, Chief Data Scientist, Amazon Web Services](https://reader033.fdocuments.us/reader033/viewer/2022052515/58a30ceb1a28abd8728c7afb/html5/thumbnails/71.jpg)
Physical media.
![Page 72: Matt Wood, Chief Data Scientist, Amazon Web Services](https://reader033.fdocuments.us/reader033/viewer/2022052515/58a30ceb1a28abd8728c7afb/html5/thumbnails/72.jpg)
AWS Direct Connect.
![Page 73: Matt Wood, Chief Data Scientist, Amazon Web Services](https://reader033.fdocuments.us/reader033/viewer/2022052515/58a30ceb1a28abd8728c7afb/html5/thumbnails/73.jpg)
1Gbps or 10Gbps
![Page 74: Matt Wood, Chief Data Scientist, Amazon Web Services](https://reader033.fdocuments.us/reader033/viewer/2022052515/58a30ceb1a28abd8728c7afb/html5/thumbnails/74.jpg)
Built in AZ replication.
![Page 75: Matt Wood, Chief Data Scientist, Amazon Web Services](https://reader033.fdocuments.us/reader033/viewer/2022052515/58a30ceb1a28abd8728c7afb/html5/thumbnails/75.jpg)
Regional replication.
![Page 76: Matt Wood, Chief Data Scientist, Amazon Web Services](https://reader033.fdocuments.us/reader033/viewer/2022052515/58a30ceb1a28abd8728c7afb/html5/thumbnails/76.jpg)
aws.amazon.com
![Page 77: Matt Wood, Chief Data Scientist, Amazon Web Services](https://reader033.fdocuments.us/reader033/viewer/2022052515/58a30ceb1a28abd8728c7afb/html5/thumbnails/77.jpg)
IData, data everywhere
![Page 78: Matt Wood, Chief Data Scientist, Amazon Web Services](https://reader033.fdocuments.us/reader033/viewer/2022052515/58a30ceb1a28abd8728c7afb/html5/thumbnails/78.jpg)
I IIData, data everywhere
Data timeline
![Page 79: Matt Wood, Chief Data Scientist, Amazon Web Services](https://reader033.fdocuments.us/reader033/viewer/2022052515/58a30ceb1a28abd8728c7afb/html5/thumbnails/79.jpg)
I II IIIData
securityData, data everywhere
Data timeline
![Page 80: Matt Wood, Chief Data Scientist, Amazon Web Services](https://reader033.fdocuments.us/reader033/viewer/2022052515/58a30ceb1a28abd8728c7afb/html5/thumbnails/80.jpg)
I II III IVData
movementData, data everywhere
Data security
Data timeline
![Page 81: Matt Wood, Chief Data Scientist, Amazon Web Services](https://reader033.fdocuments.us/reader033/viewer/2022052515/58a30ceb1a28abd8728c7afb/html5/thumbnails/81.jpg)
Thank you.
![Page 82: Matt Wood, Chief Data Scientist, Amazon Web Services](https://reader033.fdocuments.us/reader033/viewer/2022052515/58a30ceb1a28abd8728c7afb/html5/thumbnails/82.jpg)
get in touch
@MZA
aws.amazon.com