OpenStack & NetAppStorage+for+OpenStac… · A Legacy of Open Source Collaboration Push & Pull 3...
Transcript of OpenStack & NetAppStorage+for+OpenStac… · A Legacy of Open Source Collaboration Push & Pull 3...
‹#›
OpenStack & NetApp
Seamlessly Connect Clouds with NetApp
2
Seamlessly Connect Clouds with NetApp
2
Seamlessly Connect Clouds with NetApp
2
Seamlessly Connect Clouds with NetApp
2
Seamlessly Connect Clouds with NetApp
2
A Legacy of Open Source CollaborationPush & Pull
3
A Legacy of Open Source CollaborationPush & Pull
3
Linux
FreeBSD
iSCSI
NFS
RDMA
SnapCreator
NDMP
OpenStack
oVirt
▪ OpenStack Foundation
▪ Charter member (Gold)
▪ OpenStack Summit sponsors
NetApp OpenStack Involvement
4
▪ 1st Major Storage Provider
▪ Upstream Contributions
▪ Production Deployments
▪ Deployer
▪ OpenStack Foundation
▪ Charter member (Gold)
▪ OpenStack Summit sponsors
NetApp OpenStack Involvement
4
NetApp Joins ! Integration Announced
Folsom Summit Sponsor !
7-mode driver in Essex
Havana Summit Sponsor !
Direct Drivers in Grizzly
“K” Release Summit Sponsor !
Manila Incubation
Essex Summit Sponsor !
7-mode driver previewed
Grizzly Summit Sponsor !Clustered
ONTAP driver in Folsom
Icehouse Summit Sponsor !RHEL-OSP on
FlexPod !Swift on E-series
2012.4 2013.4 2014.102011.3 2011.10 2012.10 2013.10 2014.4
Juno Summit Sponsor !
E/EF-series drivers in Icehouse
▪ 1st Major Storage Provider
▪ Upstream Contributions
▪ Production Deployments
▪ Deployer
Core Competencies
5
E-SeriesFAS
Core Competencies
5
Service AutomationQuality of Service
Unified Architecture
Storage EfficiencySeamless Scaling
Secure Multi-Tenancy
Continuous Operations
Data Mobility Data Protection
Simplicity
Vast BandwidthDensity
ConsistencyHorizontal Scaling
Broad Connectivity
Versatility
Data Mobility All-Flash
▪ Avail core competencies through OpenStack service abstractions
Development Theme
6
▪ Avail core competencies through OpenStack service abstractions
Development Theme
6
Software Defined Storage, Today
7
VM VM VM VM VM VM VM
Clustered Data ONTAP®
SVM SVM SVM SVM
Clustered Data ONTAP
8
SVM SVM SVM
Continuous Uptime
▪ Virtualized Everything
▪ Network
▪ Storage Controller
▪ Storage Containers
▪ Live Migration
▪ Continuous Availability
▪ Horizontal / Vertical Scaling
▪ Secure Multi-tenancy, Data Protection, Storage Efficiency, Performance Assurance, Encryption, et cetera, et cetera
FlexVol FlexVol FlexVol FlexVol
LIF LIF LIF LIF LIF LIF
Clustered Data ONTAP
8
SVMSVM SVM
Continuous Uptime
▪ Virtualized Everything
▪ Network
▪ Storage Controller
▪ Storage Containers
▪ Live Migration
▪ Continuous Availability
▪ Horizontal / Vertical Scaling
▪ Secure Multi-tenancy, Data Protection, Storage Efficiency, Performance Assurance, Encryption, et cetera, et cetera
FlexVolFlexVolFlexVol FlexVol
LIF LIF LIFLIFLIF LIF
CoreOpenStack Logical Architecture
9
CoreOpenStack Logical Architecture
9
ImageBlock
StorageCompute
Orchestration
Dashboard
Networking
Identity
Object Storage
Telemetry
Shared Files
Compute
Image Object Storage
Block Storage
Clustered Data ONTAP
Networking
Shared Services
E/EF-Series FlashRay StorageGRID WebScale
Integration Overview
10
Glance
Shared Files
Compute
Image Object Storage
Block Storage
Clustered Data ONTAP
Image
Networking
Shared Services
E/EF-Series FlashRay StorageGRID WebScale
Integration Overview
10
Image
Glance
Clustered Data ONTAP
▪ File or Swift Backends ▪ Simplicity advantage to File
▪ rapid instance creation advantage to File
!▪ 90+% Deduplication not uncommon
Glance on Data ONTAP
Glance on NetApp
VM
VM
11
Deduplication
RHEL SUSEUbuntu
Ubuntu SUSE UbuntuUbuntu UbuntuSUSE
RHEL RHEL SUSERHELRHEL SUSE
Clustered Data ONTAP
▪ File or Swift Backends ▪ Simplicity advantage to File
▪ rapid instance creation advantage to File
!▪ 90+% Deduplication not uncommon
Glance on Data ONTAP
Glance on NetApp
VM
VM
11
Deduplication
RHEL SUSEUbuntu
Ubuntu SUSE UbuntuUbuntu UbuntuSUSE
RHEL RHEL SUSESUSE
Clustered Data ONTAP
▪ File or Swift Backends ▪ Simplicity advantage to File
▪ rapid instance creation advantage to File
!▪ 90+% Deduplication not uncommon
Glance on Data ONTAP
Glance on NetApp
VM
VM
11
Deduplication
RHEL SUSEUbuntu
Ubuntu SUSE UbuntuUbuntu Ubuntu
RHEL RHEL SUSE
Clustered Data ONTAP
▪ File or Swift Backends ▪ Simplicity advantage to File
▪ rapid instance creation advantage to File
!▪ 90+% Deduplication not uncommon
Glance on Data ONTAP
Glance on NetApp
VM
VM
11
Deduplication
RHEL SUSEUbuntu
Ubuntu SUSE Ubuntu
RHEL RHEL SUSE
Shared Files
Compute
Image Object Storage
Block Storage
Clustered Data ONTAP
Image
Networking
Shared Services
E/EF-Series FlashRay StorageGRID WebScale
Integration Overview
12
Image
Swift
Shared Files
Compute
Image Object Storage
Block Storage
Clustered Data ONTAP
Image
Networking
Shared Services
E/EF-Series FlashRay StorageGRID WebScale
Integration Overview
12
Image
Object Storage
Object Storage
Swift
Swift Deployment
3 Copies... Commonly MoreSwift on JBOD
13
Storage Node
Storage Node
Storage NodeAny single
object stored 3 or
more times
Swift Deployment
3 Copies... Commonly MoreSwift on JBOD
13
Storage Node
Storage Node
Storage NodeAny single
object stored 3 or
more times
Swift & Dynamic Disk PoolsEfficient Storage & Scaling
14
▪ Dynamic distribution / re-distribution of data“De-clustered” RAID
▪ An evolved CRUSH… node level Erasure Coding
▪ Space and scaling efficiency
Swift & Dynamic Disk PoolsEfficient Storage & Scaling
14
▪ Dynamic distribution / re-distribution of data“De-clustered” RAID
▪ An evolved CRUSH… node level Erasure Coding
▪ Space and scaling efficiency
Swift Deployment
1.3 Copies within a SiteSwift on E-series Dynamic Disk Pools
15
Storage Node
Pari
ty
Swift Deployment
1.3 Copies within a SiteSwift on E-series Dynamic Disk Pools
15
1.3X capacity
consumed with DDP
Storage Node
Pari
ty
▪ Significant improvement in cost of operations
▪ Swift becomes immediately consistent within a site
▪ Deploy E-series across sites for even greater savings
▪ Efficient, reduced replication▪ eliminates a scaling inhibitor
Shared Files
Compute
Image Object Storage
Block Storage
Clustered Data ONTAP
Image
Networking
Shared Services
E/EF-Series FlashRay StorageGRID WebScale
Integration Overview
16
Image
Object Storage
Object Storage
Cinder
Shared Files
Compute
Image Object Storage
Block Storage
Clustered Data ONTAP
Image
Networking
Shared Services
E/EF-Series FlashRay StorageGRID WebScale
Integration Overview
16
Image
Object Storage
Object Storage
Block Storage
Block Storage
Cinder
▪ A control plane, not the data path
!▪ Abstraction to implementation
!▪ No fan-in or data path impedance
Block Storage Control Plane
17
Instance
HypervisorStorage
Controller
Compute Block
Storage
Cinder as Orchestrator
FAS
Clustered ONTAP
7-mode
Cinder deployment with NetAppDiverse Options for Diverse Use Cases
18
E-Series
E-Series
EF-Series
FAS
Clustered ONTAP
7-mode
Cinder deployment with NetAppDiverse Options for Diverse Use Cases
18
E-Series
E-Series
EF-Series
pNFS
NFSiSCSI
NFS
iSCSI
iSCSI
iSCSI
▪ Cinder “Volumes” are block devices
▪ Cinder “Drivers” are providers
▪ File Cloning
▪ Snapshots = immutable file clones
Clustered ONTAP Tenant Atomicity
19
FlexVol
▪ Cinder “Volumes” are block devices
▪ Cinder “Drivers” are providers
▪ File Cloning
▪ Snapshots = immutable file clones
Clustered ONTAP Tenant Atomicity
19
FlexVol
Cinder Volume Types
Archival
Deliver a Storage Marketplace
20
▪ Craft a catalog
▪ based upon tenant requirements
▪ Compose volume types with
▪ Efficiency
▪ Performance
▪ Availability
▪ Protection
netapp:raid_type!
netapp:disk_type!
netapp:qos_policy_group!
netapp_mirrored!
netapp_dedup!
netapp_nodedup!
netapp_compression!
netapp_thin_provisioned
netapp:raid_type!
netapp:disk_type!
netapp:qos_policy_group!
netapp_mirrored!
netapp_dedup!
netapp_nodedup!
netapp_compression!
netapp_thin_provisioned
netapp:raid_type!
netapp:disk_type!
netapp:qos_policy_group!
netapp_mirrored!
netapp_dedup!
netapp_nodedup!
netapp_compression!
netapp_thin_provisioned
netapp:raid_type!
netapp:disk_type!
netapp:qos_policy_group!
netapp_mirrored!
netapp_dedup!
netapp_nodedup!
netapp_compression!
netapp_thin_provisioned
netapp:raid_type!
netapp:disk_type!
netapp:qos_policy_group!
netapp_mirrored!
netapp_dedup!
netapp_nodedup!
netapp_compression!
netapp_thin_provisioned
Analytics Streaming Temporal Database
Cinder Volume Types
Archival
Deliver a Storage Marketplace
20
▪ Craft a catalog
▪ based upon tenant requirements
▪ Compose volume types with
▪ Efficiency
▪ Performance
▪ Availability
▪ Protection
netapp:raid_type!
netapp:disk_type!
netapp:qos_policy_group!
netapp_mirrored!
netapp_dedup!
netapp_nodedup!
netapp_compression!
netapp_thin_provisioned
netapp:raid_type!
netapp:disk_type!
netapp:qos_policy_group!
netapp_mirrored!
netapp_dedup!
netapp_nodedup!
netapp_compression!
netapp_thin_provisioned
netapp:raid_type!
netapp:disk_type!
netapp:qos_policy_group!
netapp_mirrored!
netapp_dedup!
netapp_nodedup!
netapp_compression!
netapp_thin_provisioned
netapp:raid_type!
netapp:disk_type!
netapp:qos_policy_group!
netapp_mirrored!
netapp_dedup!
netapp_nodedup!
netapp_compression!
netapp_thin_provisioned
netapp:raid_type!
netapp:disk_type!
netapp:qos_policy_group!
netapp_mirrored!
netapp_dedup!
netapp_nodedup!
netapp_compression!
netapp_thin_provisioned
Analytics Streaming Temporal Database
21
21
Cinder
Cinder E/EF-Series driver
22
SYMbol Proxy
Volume Types
E-series
HPC Database Analytics
Cinder
Cinder E/EF-Series driver
22
SYMbol Proxy
Volume Types
E-series
6 Accumulo instances with 2TB of type
“Analytics”
HPC Database AnalyticsAnalytics
Cinder
Cinder E/EF-Series driver
22
SYMbol Proxy
Volume Types
E-series
6 Accumulo instances with 2TB of type
“Analytics”
HPC Database AnalyticsAnalytics
Cinder
Policy-Based Block Storage Service
23
Silver
RemoteClustered ONTAP
Volume Types
Gold BronzeSilver
Cinder
Policy-Based Block Storage Service
23
Silver
RemoteClustered ONTAP
Boot 8 CentOS LAMP instances with 2TB of Silver please
Volume Types
Gold BronzeSilver
Cinder
SnapMirror
Policy-Based Block Storage Service
23
Silver
RemoteClustered ONTAP
Boot 8 CentOS LAMP instances with 2TB of Silver please
Volume Types
Gold BronzeSilverSilver
Shared Files
Compute
Image Object Storage
Block Storage
Clustered Data ONTAP
Image
Networking
Shared Services
E/EF-Series FlashRay StorageGRID WebScale
Integration Overview
24
Image
Object Storage
Object Storage
Block Storage
Block Storage
Nova
Shared Files
Compute
Image Object Storage
Block Storage
Clustered Data ONTAP
Image
Networking
Shared Services
E/EF-Series FlashRay StorageGRID WebScale
Integration Overview
24
Image
Object Storage
Object Storage
Block Storage
Block Storage
Compute
Persistent, rapid, space-efficient instances
Nova
Clustered Data ONTAP
Enhanced Instance Creation
25
Boot 8 persistent RHEL instances… Glance on NetApp
Cinder on NetApp
Hypervisor
RHEL SUSEUbuntu CentOS
Clustered Data ONTAP
Enhanced Instance Creation
25
Boot 8 persistent RHEL instances… Glance on NetApp
Cinder on NetApp
Hypervisor
RHEL RHEL RHEL RHEL
RHEL RHEL RHEL RHEL
RHEL SUSEUbuntu CentOS
RHEL RHEL RHEL
RHEL RHEL RHEL RHEL
RHEL
▪ Cloned, not copied
▪ Instances, instantly
Shared Files
Compute
Image Object Storage
Block Storage
Clustered Data ONTAP
Image
Networking
Shared Services
E/EF-Series FlashRay StorageGRID WebScale
Integration Overview
26
Image
Object Storage
Object Storage
Block Storage
Block Storage
Compute
Persistent, rapid, space-efficient instances
Manila
Shared Files
Compute
Image Object Storage
Block Storage
Clustered Data ONTAP
Image
Networking
Shared Services
E/EF-Series FlashRay StorageGRID WebScale
Integration Overview
26
Image
Object Storage
Object Storage
Block Storage
Block Storage
Compute
Persistent, rapid, space-efficient instances
Shared Files
Shared File Systems
Manila
© 2014 NetApp, Inc. All rights reserved. NetApp Confidential - Limited Use Only
storage sold in 2012for Shared File Systems*65%
Manila
Clustered Data ONTAP
28
Finance R&D
Nova
Hypervisor
VM VM VM VM VM VM
Manila
Clustered Data ONTAP
28
Finance R&D Marketing
Share “R&D” with Instances 1 & 3
Create a “Marketing” share for 2 & 4
Nova
Hypervisor
VM VM VM VM VM VM
Adding Manila…OpenStack Logical Architecture
29
Adding Manila…OpenStack Logical Architecture
29
Orchestration
Dashboard
Networking
Identity
ImageBlock
StorageCompute (Virtual)
Object Storage
Telemetry
SharedFile Systems
30
30
Stackforge, Tempest, & Devstack integratedManila – Incubation
31
Stackforge, Tempest, & Devstack integratedManila – Incubation
31
Shared Files
Compute
Image Object Storage
Block Storage
Clustered Data ONTAP
Image
Networking
Shared Services
E/EF-Series FlashRay StorageGRID WebScale
Integration Overview
32
Image
Object Storage
Object Storage
Block Storage
Block Storage
Compute
Persistent, rapid, space-efficient instances
Shared Files
Shared File Systems
NetApp Icehouse Summary
33
▪ E-series & EF-series Cinder
▪ Manila progress ▪ Incubation
▪ pNFS ▪ by default, where available
▪ Enhanced Instance Creation ▪ copyoffload optimization
▪ Reference Architectures ▪ Puppet manifests for simplified deployment
NetApp Icehouse Summary
33
© 2014 NetApp, Inc. All rights reserved. NetApp Confidential - Limited Use Only
Development FocusJuno
▪ Manila
▪ Cinder Currency & New Features
▪ Reference Architectures
▪ Configuration Management Tooling
▪ Deployment Automation
▪ Horizon, Heat, Ceilometer
▪ Fibre Channel Support
▪ Puppet ▪ Clustered Data ONTAP
▪ E/EF-series
!▪ Chef ▪ Clustered Data ONTAP
▪ E/EF-series
Programmable Infra
35
Configurations Management Coming with Juno
▪ Agile Data Infrastructure ▪ Build private and public clouds delivering high-
performing, efficient and scalable services
▪ Proven Storage & Data Management ▪ Lower risk and enable a broad spectrum of cloud
SLAs by combining the power and ingenuity of open-source cloud management with proven data solutions
▪ Community Leadership & Commitment ▪ Provide choice in cloud management by actively
collaborating and taking a leadership role in the development of open-source initiatives
Why NetApp for OpenStack?
36
▪ Continuous Availability for Continuous Deployment ▪ Focus on Dev, not on Ops
!▪ Unified Storage ▪ Cloud Native & POSIX Living together in harmony on
a single efficient architecture
!▪ Common Data Fabric, Hybrid Cloud now ▪ Single most prevalent storage operating system
▪ thin, efficient replication
▪ repatriation & bursting
Why NetApp for OpenStack?
37
▪ Slice for POC, roll to production ▪ Focus on Dev, not on Ops
!▪ Graduate your no-SLA to high-SLA on
the same infra ▪ Livestock & Pets, living together in harmony
!▪ Holistic, sustainable Cloud Deployment ▪ power, cooling, efficiency…
Why NetApp for OpenStack?
38
▪ Announced at the Hong Kong Design Summit
▪ Technical Report April 2014 ▪ Reference Architecture: Deploying RHEL-OSP 4
on NetApp Clustered Data ONTAP
▪ Cinder drivers RHEL-OSP certified
OpenStack & Converged Infrastructure
39
FlexPod with Red Hat OpenStack Platform
News ▪ http://netapp.com/openstack
▪ @openstacknetapp
▪ #openstack-netapp on freenode
!Resources ▪ NetApp OpenStack Deployment and Operations Guide
▪ RHEL-OSP Reference Architecture
▪ Rackspace Private Cloud Certifications
▪ Nebula Integration
▪ NetApp OpenStack Communities
Getting Started
40
© 2014 NetApp, Inc. All rights reserved. NetApp Confidential - Limited Use Only
SessionsRelated Topics
© 2014 NetApp, Inc. All rights reserved. NetApp Confidential - Limited Use Only
SessionsRelated Topics
▪ Ask the Experts: Storage Considerations for OpenStack ▪ Monday 11:15am - 11:55am
▪ Demo Theater: Optimize Cloud Storage with NetApp ▪ Monday 2:00pm - 2:15pm
▪ Creating Differentiated Storage Offerings Using Cinder Volume Types ▪ Monday 2:00pm - 2:40pm
▪ Introducing Nebula. Experience Turn-key Private Cloud ▪ Monday 2:50pm - 3:30pm
▪ NetApp Storage for OpenStack ▪ Wednesday 9:00am - 10:00am
▪ Manila: An OpenStack File Share Service ▪ Wednesday 10:15am - 11:15am
▪ Extending TripleO for OpenStack Infrastructure Management ▪ Wednesday 11:00am - 11:40am
▪ Considerations and Lessons Learned Deploying OpenStack ▪ Wednesday 11:30am - 12:30pm
OpenStack SummitNovember 2014
42
▪ First OpenStack Summit in EMEA
▪ See you there!▪ Paris, France
▪ “K” Design Summit
Thanks!@openstacknetapp
43