Asia pacopenstack joe-draft 2012-08-08
44
August 11, 2012 OpenStack APAC Conference Building Applications with OpenStack Swift Joe Arnold, CEO SwiftStack Inc @joearnold
-
Upload
hui-cheng -
Category
Technology
-
view
347 -
download
1
description
Transcript of Asia pacopenstack joe-draft 2012-08-08
August 11, 2012
OpenStackAPAC ConferenceOpenStackAPAC Conference
Building Applications with OpenStack Swift
Joe Arnold, CEOSwiftStack IncJoe Arnold, CEOSwiftStack Inc
@joearnold@joearnold
August 11, 2012
24
Compute | Storage |
Networking“Nova” “Swift” “Quantum” Global community of cloud software developers & users
Apache 2 Open Source License
+180 Participating Companies - 1,000’s of developers
August 11, 2012
3
2009 2010 2011
Developed in large-scale production environments
Currently +70 developers - has doubled every 6 month
OpenStack Swift - Born in Production
August 11, 2012
4Sw
ift D
eplo
ymen
t
Swift
Dep
loym
ent
Exam
ple:
Exam
ple:
Racks
pace
Racks
pace
USAUSA
August 11, 2012
5Sw
ift D
eplo
ymen
t
Swift
Dep
loym
ent
Exam
ple:
Exam
ple:
HP Clo
ud
HP Clo
ud
USAUSA
August 11, 2012
6Sw
ift D
eplo
ymen
t
Swift
Dep
loym
ent
Exam
ple:
Exam
ple:
Inte
rnap
Inte
rnap
USAUSA
August 11, 2012
7Sw
ift D
eplo
ymen
t
Swift
Dep
loym
ent
Exam
ple:
Exam
ple:
KT Ucl
oud
KT Ucl
oud
Korea
Korea
August 11, 2012
8Sw
ift D
eplo
ymen
t
Swift
Dep
loym
ent
Exam
ple:
Exam
ple:
Softla
yer
Softla
yer
USAUSA
August 11, 2012
9Sw
ift D
eplo
ymen
t
Swift
Dep
loym
ent
Exam
ple:
Exam
ple:
Haylix
Haylix
Austr
alia
Austr
alia
August 11, 2012
10Sw
ift D
eplo
ymen
t
Swift
Dep
loym
ent
Exam
ple:
Exam
ple:
eNov
ance
eNov
ance
Fran
ce
Fran
ce
August 11, 2012
11
About SwiftStack
Cloud Storage System based on OpenStack Swift
Cloud storage technical leadershipSwift Core teamProject lead
ExperienceBuilding large-scale cloud storage at
Rackspace, Engine Yard, Internap, Korea Telecom
August 11, 2012
12
Field Observations
August 11, 2012
13
Infrastructure as a Service
Web/Mobile Applications
Massive Number of Users
Field Observations
August 11, 2012
14
Field Observation: Web/Mobile Applications
August 11, 2012
15
Shrinking Storage on Mobile Devices
Field Observation: Web/Mobile Applications
August 11, 2012
1630
Speaks: HTTP
Storage
Standards-Based OpenStack API
HTTP API
OpenStack Swift enables Web/Mobile applications
August 11, 2012
1730
Upload direct from device
Storage
HTTP Form Post Mechanism
OpenStack Swift enables Web/Mobile applications
HTTP API
August 11, 2012
1830
Cache with HTTP
StorageCache
HTTP API
OpenStack Swift enables Web/Mobile applications
August 11, 2012
1930
Native Content-Delivery Integration
OpenStack Swift enables Web/Mobile applications
August 11, 2012
20
OpenStack Swift enables Web/Mobile applications
August 11, 2012
21
Infrastructure as a Service
Web/Mobile Applications
Massive Number of Users
Field Observations
August 11, 2012
22
Field Observation: Massive # of users
Enterprise Application
August 11, 2012
23
Field Observation: Massive # of users
August 11, 2012
24
Multi-Tenant Application
Field Observation: Massive # of users
August 11, 2012
25
$/GB
FREQ
UEN
CY
$/IO
Long-Tail Data
Field Observation: Massive # of users
August 11, 2012
26
Field Observation: Massive # of users
August 11, 2012
27
Field Observation: Massive # of users
August 11, 2012
28
Access NodeAccess Node Access NodeAccess Node Access NodeAccess Node Access NodeAccess Node
Add Storage Nodes capacity can be added by growing existing availability zones, or adding new availability zones.
Add Proxy Nodes A hash ring is shared amongst each node in the cluster.
Swift Scales to Massive # of users
August 11, 2012
29
1. account data2. object data3. All data distributed via hash ring
Swift uses shared-nothing architecture
Simple mechanisms proven at scale1. Whole files on disk2. Routed networking (Layer 3 networks)3. Proven techniques with HTTP for transport4. Proven techniques with rsync for replication
Swift Scales to Massive # of users
August 11, 2012
30
ShardingSharding
Swift Scales to Massive # of users
August 11, 2012
31
HTTP + Proven Cloud Architecture
Swift Scales to Massive # of users
August 11, 2012
32
Infrastructure as a Service
Web/Mobile Applications
Massive Number of Users
Field Observations
August 11, 2012
33
Improve agility
Improve Efficiencies
Sell Services
Field Observation: Infrastructure as a service
Our Our CustomeCustomer Wantsr Wants
August 11, 2012
34
Storage deployments becoming larger
Multi-tenancy important
Field Observation: Infrastructure as a service
August 11, 2012
35
Swift enables Infrastructure as a Service
Scales to large capacity
High concurrency
Multi-tenancy from ground-up
August 11, 2012
36
Swift enables Infrastructure as a Service
OperationalOperationalEfficienciesEfficienciesOperationalOperationalEfficienciesEfficiencies
August 11, 2012
37
SwiftStack Nodes
August 11, 2012
38
SwiftStack Controller
August 11, 2012
39
Capaci
ty
time
Text
August 11, 2012
40
Time-Series BackendGanglia / Graphite
Time-Series BackendGanglia / Graphite
StatsDStatsD
LightweightUDP StatsDSwift ProcessSwift ProcessSwift ProcessSwift ProcessSwift ProcessSwift ProcessSwift ProcessSwift ProcessSwift ProcessSwift ProcessSwift ProcessSwift Process
Watch Everything
August 11, 2012
4160
Be NotifiedSee Everything
August 11, 2012
42
SwiftStack Plug-Ins
User Dashboard
Active Directory/LDAPIntegration
Utilization API for Billing
On-disk Encryption
Metadata Search
Make each look like a mini-product. Box around each.
Make each look like a mini-product. Box around each.
August 11, 2012
43
Infrastructure as a Service
Web/Mobile Applications
Massive Number of Users
Field Observations
August 11, 2012
OpenStackAPAC ConferenceOpenStackAPAC Conference
Thank you!Thank you!
Joe ArnoldCEO, [email protected]@joearnold
