DIVIDE AND CONQUER: RESOURCE SEGREGATION IN THE … · 2019. 2. 26. · Segregation in an elastic...
Transcript of DIVIDE AND CONQUER: RESOURCE SEGREGATION IN THE … · 2019. 2. 26. · Segregation in an elastic...
![Page 1: DIVIDE AND CONQUER: RESOURCE SEGREGATION IN THE … · 2019. 2. 26. · Segregation in an elastic cloud Amazon EC2: –Infrastructure segregation: Regions – Separate geographic](https://reader036.fdocuments.us/reader036/viewer/2022063011/5fc639a33821403e177e82f6/html5/thumbnails/1.jpg)
DIVIDE AND CONQUER:
RESOURCE SEGREGATION IN THE OPENSTACK
CLOUD
Steve Gordon (@xsgordon)Technical Product Manager, Red Hat
![Page 2: DIVIDE AND CONQUER: RESOURCE SEGREGATION IN THE … · 2019. 2. 26. · Segregation in an elastic cloud Amazon EC2: –Infrastructure segregation: Regions – Separate geographic](https://reader036.fdocuments.us/reader036/viewer/2022063011/5fc639a33821403e177e82f6/html5/thumbnails/2.jpg)
Why segregate resources?
●Infrastructure–Expose logical groupings of infrastructure based on physical characteristics
–Expose logical groupings of infrastructure based on some abstract functionality/capability
–“More-massive” horizontal scalability
![Page 3: DIVIDE AND CONQUER: RESOURCE SEGREGATION IN THE … · 2019. 2. 26. · Segregation in an elastic cloud Amazon EC2: –Infrastructure segregation: Regions – Separate geographic](https://reader036.fdocuments.us/reader036/viewer/2022063011/5fc639a33821403e177e82f6/html5/thumbnails/3.jpg)
Why segregate resources?
●Infrastructure–Expose logical groupings of infrastructure based on physical characteristics
–Expose logical groupings of infrastructure based on some abstract functionality/capability
–“More-massive” horizontal scalability
●Workloads–Ensure an even spread of a single workload
–Ensure close placement of related workloads
![Page 4: DIVIDE AND CONQUER: RESOURCE SEGREGATION IN THE … · 2019. 2. 26. · Segregation in an elastic cloud Amazon EC2: –Infrastructure segregation: Regions – Separate geographic](https://reader036.fdocuments.us/reader036/viewer/2022063011/5fc639a33821403e177e82f6/html5/thumbnails/4.jpg)
Segregation in datacenter virtualization
●Infrastructure segregation:–Logical data center constructs
● Contain some number of logical clusters● Clusters typically:
–Are relatively small (0's to 00's of nodes per cluster)–Are tightly coupled to physical storage and network layout
●Workload segregation:–Host-level affinity/anti-affinity
–CPU-level affinity/anti-affinity (pinning)
![Page 5: DIVIDE AND CONQUER: RESOURCE SEGREGATION IN THE … · 2019. 2. 26. · Segregation in an elastic cloud Amazon EC2: –Infrastructure segregation: Regions – Separate geographic](https://reader036.fdocuments.us/reader036/viewer/2022063011/5fc639a33821403e177e82f6/html5/thumbnails/5.jpg)
Segregation in an elastic cloud
●Amazon EC2:– Infrastructure segregation:
● Regions – Separate geographic areas (e.g. us-east-1)● Availability Zones – Isolated locations within a region (e.g. us-east-1a)
–Workload segregation:● Placement Groups – Workload affinity within an availability zone
![Page 6: DIVIDE AND CONQUER: RESOURCE SEGREGATION IN THE … · 2019. 2. 26. · Segregation in an elastic cloud Amazon EC2: –Infrastructure segregation: Regions – Separate geographic](https://reader036.fdocuments.us/reader036/viewer/2022063011/5fc639a33821403e177e82f6/html5/thumbnails/6.jpg)
Segregation in an elastic cloud
●Amazon EC2:– Infrastructure segregation:
● Regions – Separate geographic areas (e.g. us-east-1)● Availability Zones – Isolated locations within a region (e.g. us-east-1a)
–Workload segregation:● Placement Groups – Workload affinity within an availability zone
●OpenStack:–Overloads some of these terms (and more!)
–Application is more flexible for deployers and operators
![Page 7: DIVIDE AND CONQUER: RESOURCE SEGREGATION IN THE … · 2019. 2. 26. · Segregation in an elastic cloud Amazon EC2: –Infrastructure segregation: Regions – Separate geographic](https://reader036.fdocuments.us/reader036/viewer/2022063011/5fc639a33821403e177e82f6/html5/thumbnails/7.jpg)
Segregation in an elastic cloud
● Wait a second...weren't we moving to the cloud to hide all this infrastructure stuff from the user?
![Page 8: DIVIDE AND CONQUER: RESOURCE SEGREGATION IN THE … · 2019. 2. 26. · Segregation in an elastic cloud Amazon EC2: –Infrastructure segregation: Regions – Separate geographic](https://reader036.fdocuments.us/reader036/viewer/2022063011/5fc639a33821403e177e82f6/html5/thumbnails/8.jpg)
Segregation in an elastic cloud
●Wait a second...weren't we moving to the cloud to hide all this stuff from the user?–Yes!
●Users and applications demand some visibility of:–Failure domains
–Premium features
●Deployers and operators determine the level of granularity exposed.
![Page 9: DIVIDE AND CONQUER: RESOURCE SEGREGATION IN THE … · 2019. 2. 26. · Segregation in an elastic cloud Amazon EC2: –Infrastructure segregation: Regions – Separate geographic](https://reader036.fdocuments.us/reader036/viewer/2022063011/5fc639a33821403e177e82f6/html5/thumbnails/9.jpg)
Segregation in OpenStack
●Infrastructure segregation:–Regions
–Cells
–Host aggregates
–Availability zones
![Page 10: DIVIDE AND CONQUER: RESOURCE SEGREGATION IN THE … · 2019. 2. 26. · Segregation in an elastic cloud Amazon EC2: –Infrastructure segregation: Regions – Separate geographic](https://reader036.fdocuments.us/reader036/viewer/2022063011/5fc639a33821403e177e82f6/html5/thumbnails/10.jpg)
Segregation in OpenStack
●Infrastructure segregation:–Regions
–Cells
–Host aggregates
–Availability zones
●Workload segregation:–Server groups
![Page 11: DIVIDE AND CONQUER: RESOURCE SEGREGATION IN THE … · 2019. 2. 26. · Segregation in an elastic cloud Amazon EC2: –Infrastructure segregation: Regions – Separate geographic](https://reader036.fdocuments.us/reader036/viewer/2022063011/5fc639a33821403e177e82f6/html5/thumbnails/11.jpg)
REGIONS AND CELLS
![Page 12: DIVIDE AND CONQUER: RESOURCE SEGREGATION IN THE … · 2019. 2. 26. · Segregation in an elastic cloud Amazon EC2: –Infrastructure segregation: Regions – Separate geographic](https://reader036.fdocuments.us/reader036/viewer/2022063011/5fc639a33821403e177e82f6/html5/thumbnails/12.jpg)
Regions
●Complete OpenStack deployments–Share at least a Keystone and Horizon installation
– Implement their own targetable API endpoints
●In default deployment all services in one region – 'RegionOne'.●New regions are created using Keystone:
–$ keystone endpointcreate region “RegionTwo”
![Page 13: DIVIDE AND CONQUER: RESOURCE SEGREGATION IN THE … · 2019. 2. 26. · Segregation in an elastic cloud Amazon EC2: –Infrastructure segregation: Regions – Separate geographic](https://reader036.fdocuments.us/reader036/viewer/2022063011/5fc639a33821403e177e82f6/html5/thumbnails/13.jpg)
Regions
●Target actions at a region's endpoint (mandatory):–CLI:
● $ nova --os-region-name “RegionTwo” boot …
–Horizon:
![Page 14: DIVIDE AND CONQUER: RESOURCE SEGREGATION IN THE … · 2019. 2. 26. · Segregation in an elastic cloud Amazon EC2: –Infrastructure segregation: Regions – Separate geographic](https://reader036.fdocuments.us/reader036/viewer/2022063011/5fc639a33821403e177e82f6/html5/thumbnails/14.jpg)
Regions
![Page 15: DIVIDE AND CONQUER: RESOURCE SEGREGATION IN THE … · 2019. 2. 26. · Segregation in an elastic cloud Amazon EC2: –Infrastructure segregation: Regions – Separate geographic](https://reader036.fdocuments.us/reader036/viewer/2022063011/5fc639a33821403e177e82f6/html5/thumbnails/15.jpg)
Regions
![Page 16: DIVIDE AND CONQUER: RESOURCE SEGREGATION IN THE … · 2019. 2. 26. · Segregation in an elastic cloud Amazon EC2: –Infrastructure segregation: Regions – Separate geographic](https://reader036.fdocuments.us/reader036/viewer/2022063011/5fc639a33821403e177e82f6/html5/thumbnails/16.jpg)
Cells
●Standard (simplified) compute deployment without Cells:
LOAD BALANCER
MESSAGE QUEUE
SCHEDULER
API
DATABASE
COMPUTE
HYPERVISOR KVMCONDUCTOR
AMQP
OPST0007
![Page 17: DIVIDE AND CONQUER: RESOURCE SEGREGATION IN THE … · 2019. 2. 26. · Segregation in an elastic cloud Amazon EC2: –Infrastructure segregation: Regions – Separate geographic](https://reader036.fdocuments.us/reader036/viewer/2022063011/5fc639a33821403e177e82f6/html5/thumbnails/17.jpg)
Cells
●Maintains a single compute endpoint●Relieve pressure on queues database at scale (000's of nodes)
●Introduces the cells schedulerMESSAGE
QUEUE
API CELL
COMPUTE CELL
COMPUTE CELL
...
OPST0008
![Page 18: DIVIDE AND CONQUER: RESOURCE SEGREGATION IN THE … · 2019. 2. 26. · Segregation in an elastic cloud Amazon EC2: –Infrastructure segregation: Regions – Separate geographic](https://reader036.fdocuments.us/reader036/viewer/2022063011/5fc639a33821403e177e82f6/html5/thumbnails/18.jpg)
API (parent) cell
●Adds a load balancer in front of multiple instances of the API service
●Has its own message queue●Includes a new service, nova-cells
–Handles cell scheduling
–Packaged as openstack-nova-cells
–Required in every cell
MESSAGE QUEUE
API
CELLS nova-cells
LOAD BALANCER
nova-api
OPST0009
![Page 19: DIVIDE AND CONQUER: RESOURCE SEGREGATION IN THE … · 2019. 2. 26. · Segregation in an elastic cloud Amazon EC2: –Infrastructure segregation: Regions – Separate geographic](https://reader036.fdocuments.us/reader036/viewer/2022063011/5fc639a33821403e177e82f6/html5/thumbnails/19.jpg)
Compute (child) cell
●Each compute cell contains:– Its own message queue and database
– Its own scheduler, conductor, compute nodes
![Page 20: DIVIDE AND CONQUER: RESOURCE SEGREGATION IN THE … · 2019. 2. 26. · Segregation in an elastic cloud Amazon EC2: –Infrastructure segregation: Regions – Separate geographic](https://reader036.fdocuments.us/reader036/viewer/2022063011/5fc639a33821403e177e82f6/html5/thumbnails/20.jpg)
Common cell configuration
●Setup database and message broker for each cell●Initialize cell database using nova-manage●Optionally:
–Modify scheduling filter/weight configuration for cells scheduler
–Create cells JSON file to avoid need to avoid reloading from database
![Page 21: DIVIDE AND CONQUER: RESOURCE SEGREGATION IN THE … · 2019. 2. 26. · Segregation in an elastic cloud Amazon EC2: –Infrastructure segregation: Regions – Separate geographic](https://reader036.fdocuments.us/reader036/viewer/2022063011/5fc639a33821403e177e82f6/html5/thumbnails/21.jpg)
API (parent) cell configuration
●Nova.conf:–Change compute_api_class
–Enable cells
–Name the cell
–Enable and start nova-cells
![Page 22: DIVIDE AND CONQUER: RESOURCE SEGREGATION IN THE … · 2019. 2. 26. · Segregation in an elastic cloud Amazon EC2: –Infrastructure segregation: Regions – Separate geographic](https://reader036.fdocuments.us/reader036/viewer/2022063011/5fc639a33821403e177e82f6/html5/thumbnails/22.jpg)
Compute (child) cell configuration
●nova.conf–Disable quota driver
–Enable cells
–Name the cell
–Enable and start nova-cells
![Page 23: DIVIDE AND CONQUER: RESOURCE SEGREGATION IN THE … · 2019. 2. 26. · Segregation in an elastic cloud Amazon EC2: –Infrastructure segregation: Regions – Separate geographic](https://reader036.fdocuments.us/reader036/viewer/2022063011/5fc639a33821403e177e82f6/html5/thumbnails/23.jpg)
Cells pitfalls
●That all sounds pretty good – sign me up!●Lack of “cell awareness” in other projects●Minimal test coverage in the gate●Some standard functionality currently broken with cells:
–Host aggregates
–Security groups
![Page 24: DIVIDE AND CONQUER: RESOURCE SEGREGATION IN THE … · 2019. 2. 26. · Segregation in an elastic cloud Amazon EC2: –Infrastructure segregation: Regions – Separate geographic](https://reader036.fdocuments.us/reader036/viewer/2022063011/5fc639a33821403e177e82f6/html5/thumbnails/24.jpg)
So how do they stack up?
Regions●Supported by all services●Separate endpoints●Exist above scheduling●Linked via REST APIs
Cells●Supported by compute●Common endpoint●Additional scheduling layer●Linked via RPC
![Page 25: DIVIDE AND CONQUER: RESOURCE SEGREGATION IN THE … · 2019. 2. 26. · Segregation in an elastic cloud Amazon EC2: –Infrastructure segregation: Regions – Separate geographic](https://reader036.fdocuments.us/reader036/viewer/2022063011/5fc639a33821403e177e82f6/html5/thumbnails/25.jpg)
HOST AGGREGATES ANDAVAILABILITY ZONES
![Page 26: DIVIDE AND CONQUER: RESOURCE SEGREGATION IN THE … · 2019. 2. 26. · Segregation in an elastic cloud Amazon EC2: –Infrastructure segregation: Regions – Separate geographic](https://reader036.fdocuments.us/reader036/viewer/2022063011/5fc639a33821403e177e82f6/html5/thumbnails/26.jpg)
Host aggregates
●Logical groupings of hosts based on metadata●Typically metadata describes special capabilities hosts share:
–Fast disks for ephemeral data storage
–Fast network interfaces
–Etc.
●Hosts can be in multiple host aggregates:–“Hosts that have SSD storage and GPUs”
![Page 27: DIVIDE AND CONQUER: RESOURCE SEGREGATION IN THE … · 2019. 2. 26. · Segregation in an elastic cloud Amazon EC2: –Infrastructure segregation: Regions – Separate geographic](https://reader036.fdocuments.us/reader036/viewer/2022063011/5fc639a33821403e177e82f6/html5/thumbnails/27.jpg)
Host aggregates
●Implicitly user targetable:–Admin defines host aggregate with metadata, and a flavor that matches it
–User selects flavor with extra specifications when requesting instance
–Scheduler places instance on a host in a host aggregate that matches (extra specifications to metadata)
–User explicitly targets a capability, not an aggregate
![Page 28: DIVIDE AND CONQUER: RESOURCE SEGREGATION IN THE … · 2019. 2. 26. · Segregation in an elastic cloud Amazon EC2: –Infrastructure segregation: Regions – Separate geographic](https://reader036.fdocuments.us/reader036/viewer/2022063011/5fc639a33821403e177e82f6/html5/thumbnails/28.jpg)
Host aggregates (example)
Region A Region BKeystone
Horizon
Glance
Cinder
Nova
Neutron
Swift
Glance
Cinder
Nova
Neutron
Swift
![Page 29: DIVIDE AND CONQUER: RESOURCE SEGREGATION IN THE … · 2019. 2. 26. · Segregation in an elastic cloud Amazon EC2: –Infrastructure segregation: Regions – Separate geographic](https://reader036.fdocuments.us/reader036/viewer/2022063011/5fc639a33821403e177e82f6/html5/thumbnails/29.jpg)
Host aggregates (example)
●Create host aggregates:–$ nova aggregatecreate storageoptimized
–$ nova aggregatecreate networkoptimized
–$ nova aggregatecreate computeoptimized
![Page 30: DIVIDE AND CONQUER: RESOURCE SEGREGATION IN THE … · 2019. 2. 26. · Segregation in an elastic cloud Amazon EC2: –Infrastructure segregation: Regions – Separate geographic](https://reader036.fdocuments.us/reader036/viewer/2022063011/5fc639a33821403e177e82f6/html5/thumbnails/30.jpg)
Host aggregates (example)
–$ nova aggregatesetmetadata 1 faststorage=true
–$ nova aggregatesetmetadata 2 fastnetwork=true
–$ nova aggregatesetmetadata 3 highfreqcpu=true
![Page 31: DIVIDE AND CONQUER: RESOURCE SEGREGATION IN THE … · 2019. 2. 26. · Segregation in an elastic cloud Amazon EC2: –Infrastructure segregation: Regions – Separate geographic](https://reader036.fdocuments.us/reader036/viewer/2022063011/5fc639a33821403e177e82f6/html5/thumbnails/31.jpg)
Host aggregates (example)
●Populate the aggregates:–$ nova aggregateaddhost 1 host1
–$ nova aggregateaddhost 1 host2
–...
![Page 32: DIVIDE AND CONQUER: RESOURCE SEGREGATION IN THE … · 2019. 2. 26. · Segregation in an elastic cloud Amazon EC2: –Infrastructure segregation: Regions – Separate geographic](https://reader036.fdocuments.us/reader036/viewer/2022063011/5fc639a33821403e177e82f6/html5/thumbnails/32.jpg)
Host aggregates (example)
![Page 33: DIVIDE AND CONQUER: RESOURCE SEGREGATION IN THE … · 2019. 2. 26. · Segregation in an elastic cloud Amazon EC2: –Infrastructure segregation: Regions – Separate geographic](https://reader036.fdocuments.us/reader036/viewer/2022063011/5fc639a33821403e177e82f6/html5/thumbnails/33.jpg)
Host aggregates (example)
![Page 34: DIVIDE AND CONQUER: RESOURCE SEGREGATION IN THE … · 2019. 2. 26. · Segregation in an elastic cloud Amazon EC2: –Infrastructure segregation: Regions – Separate geographic](https://reader036.fdocuments.us/reader036/viewer/2022063011/5fc639a33821403e177e82f6/html5/thumbnails/34.jpg)
Host aggregates (example)
Region A Region BKeystone
Horizon
Glance
Cinder
Nova
Neutron
Swift
Glance
Cinder
Nova
Neutron
Swift
storage-optimized
![Page 35: DIVIDE AND CONQUER: RESOURCE SEGREGATION IN THE … · 2019. 2. 26. · Segregation in an elastic cloud Amazon EC2: –Infrastructure segregation: Regions – Separate geographic](https://reader036.fdocuments.us/reader036/viewer/2022063011/5fc639a33821403e177e82f6/html5/thumbnails/35.jpg)
Host aggregates (example)
Region A Region BKeystone
Horizon
Glance
Cinder
Nova
Neutron
Swift
Glance
Cinder
Nova
Neutron
Swift
storage-optimizednetwork-optimized
![Page 36: DIVIDE AND CONQUER: RESOURCE SEGREGATION IN THE … · 2019. 2. 26. · Segregation in an elastic cloud Amazon EC2: –Infrastructure segregation: Regions – Separate geographic](https://reader036.fdocuments.us/reader036/viewer/2022063011/5fc639a33821403e177e82f6/html5/thumbnails/36.jpg)
Host aggregates (example)
Region A Region BKeystone
Horizon
Glance
Cinder
Nova
Neutron
Swift
Glance
Cinder
Nova
Neutron
Swift
storage-optimizednetwork-optimizedhigh-freq-cpu
![Page 37: DIVIDE AND CONQUER: RESOURCE SEGREGATION IN THE … · 2019. 2. 26. · Segregation in an elastic cloud Amazon EC2: –Infrastructure segregation: Regions – Separate geographic](https://reader036.fdocuments.us/reader036/viewer/2022063011/5fc639a33821403e177e82f6/html5/thumbnails/37.jpg)
Host aggregates (example)
Region A Region BKeystone
Horizon
Glance
Cinder
Nova
Neutron
Swift
Glance
Cinder
Nova
Neutron
Swift
storage-optimizednetwork-optimizedhigh-freq-cpu
![Page 38: DIVIDE AND CONQUER: RESOURCE SEGREGATION IN THE … · 2019. 2. 26. · Segregation in an elastic cloud Amazon EC2: –Infrastructure segregation: Regions – Separate geographic](https://reader036.fdocuments.us/reader036/viewer/2022063011/5fc639a33821403e177e82f6/html5/thumbnails/38.jpg)
Host aggregates (example)
●Set flavor extra specifications:–$ nova flavorkey 1 set faststorage=true
–...
![Page 39: DIVIDE AND CONQUER: RESOURCE SEGREGATION IN THE … · 2019. 2. 26. · Segregation in an elastic cloud Amazon EC2: –Infrastructure segregation: Regions – Separate geographic](https://reader036.fdocuments.us/reader036/viewer/2022063011/5fc639a33821403e177e82f6/html5/thumbnails/39.jpg)
Host aggregates (example)
●Filter scheduler matches extra specifications of flavor to metadata of aggregate.
Host 1
Host 2
Host 3
F I L T E R S
W E I G H T S Host 1
Host 3
![Page 40: DIVIDE AND CONQUER: RESOURCE SEGREGATION IN THE … · 2019. 2. 26. · Segregation in an elastic cloud Amazon EC2: –Infrastructure segregation: Regions – Separate geographic](https://reader036.fdocuments.us/reader036/viewer/2022063011/5fc639a33821403e177e82f6/html5/thumbnails/40.jpg)
Availability zones
●Logical groupings of hosts based on arbitrary factors like:–Location (country, data center, rack, etc.)
–Network layout
–Power source
●Explicitly user targetable:–$ nova boot availabilityzone “rack1”
●OpenStack Block Storage (Cinder) also has availability zones
![Page 41: DIVIDE AND CONQUER: RESOURCE SEGREGATION IN THE … · 2019. 2. 26. · Segregation in an elastic cloud Amazon EC2: –Infrastructure segregation: Regions – Separate geographic](https://reader036.fdocuments.us/reader036/viewer/2022063011/5fc639a33821403e177e82f6/html5/thumbnails/41.jpg)
Availability zones
●Host aggregates are made explicitly user targetable by creating them as an AZ:–$ nova aggregatecreate tier1 useasttier1
–tier1 is the aggregate name, useasttier1 is the AZ name
●Host aggregate is the availability zone in this case–Hosts can not be in multiple availability zones
● Well...sort of.
–Hosts can be in multiple host aggregates
![Page 42: DIVIDE AND CONQUER: RESOURCE SEGREGATION IN THE … · 2019. 2. 26. · Segregation in an elastic cloud Amazon EC2: –Infrastructure segregation: Regions – Separate geographic](https://reader036.fdocuments.us/reader036/viewer/2022063011/5fc639a33821403e177e82f6/html5/thumbnails/42.jpg)
Availability zones (example)
Region A Region BKeystone
Horizon
Glance
Cinder
Nova
Neutron
Swift
Glance
Cinder
Nova
Neutron
Swift
storage-optimizednetwork-optimizedhigh-freq-cpu
![Page 43: DIVIDE AND CONQUER: RESOURCE SEGREGATION IN THE … · 2019. 2. 26. · Segregation in an elastic cloud Amazon EC2: –Infrastructure segregation: Regions – Separate geographic](https://reader036.fdocuments.us/reader036/viewer/2022063011/5fc639a33821403e177e82f6/html5/thumbnails/43.jpg)
Availability zones (example)
Region A Region BKeystone
Horizon
AZ 1 AZ 2
Glance
Cinder
Nova
Neutron
Swift
Glance
Cinder
Nova
Neutron
Swift
AZ 3 AZ 4
storage-optimizednetwork-optimizedhigh-freq-cpu
![Page 44: DIVIDE AND CONQUER: RESOURCE SEGREGATION IN THE … · 2019. 2. 26. · Segregation in an elastic cloud Amazon EC2: –Infrastructure segregation: Regions – Separate geographic](https://reader036.fdocuments.us/reader036/viewer/2022063011/5fc639a33821403e177e82f6/html5/thumbnails/44.jpg)
So how do they stack up?
Host Aggregates●Implicitly user targetable●Hosts can be in multiple aggregates
●Grouping based on common capabilities
Availability Zones●Explicitly user targetable●Hosts can not be in multiple zones (see previous disclaimer)
●Grouping based on arbitrary factors such as location, power, network
![Page 45: DIVIDE AND CONQUER: RESOURCE SEGREGATION IN THE … · 2019. 2. 26. · Segregation in an elastic cloud Amazon EC2: –Infrastructure segregation: Regions – Separate geographic](https://reader036.fdocuments.us/reader036/viewer/2022063011/5fc639a33821403e177e82f6/html5/thumbnails/45.jpg)
WORKLOAD SEGREGATION
![Page 46: DIVIDE AND CONQUER: RESOURCE SEGREGATION IN THE … · 2019. 2. 26. · Segregation in an elastic cloud Amazon EC2: –Infrastructure segregation: Regions – Separate geographic](https://reader036.fdocuments.us/reader036/viewer/2022063011/5fc639a33821403e177e82f6/html5/thumbnails/46.jpg)
Server groups
●Policies for defining workload placement rules for a group–Anti-affinity filter – Grizzly
–Affinity filter – Havana
–API – Icehouse
●Implemented via scheduler filters:–ServerGroupAffinityFilter
–ServerGroupAntiAffinityFilter
![Page 47: DIVIDE AND CONQUER: RESOURCE SEGREGATION IN THE … · 2019. 2. 26. · Segregation in an elastic cloud Amazon EC2: –Infrastructure segregation: Regions – Separate geographic](https://reader036.fdocuments.us/reader036/viewer/2022063011/5fc639a33821403e177e82f6/html5/thumbnails/47.jpg)
Server groups
●Affinity:–Places instances within the group on the same host
●Anti-affinity:–Places instances within the group on different hosts
●Not equivalent to AWS placement groups (host placement versus availability zone placement)
![Page 48: DIVIDE AND CONQUER: RESOURCE SEGREGATION IN THE … · 2019. 2. 26. · Segregation in an elastic cloud Amazon EC2: –Infrastructure segregation: Regions – Separate geographic](https://reader036.fdocuments.us/reader036/viewer/2022063011/5fc639a33821403e177e82f6/html5/thumbnails/48.jpg)
Server groups
●Create the server group:–$ nova servergroupcreate policy=antiaffinity my_group
–Really defining a policy rather than a group.
●Specify the group UUID or name when launching instances:–$ nova boot image ... flavor … hint group=group_id
![Page 49: DIVIDE AND CONQUER: RESOURCE SEGREGATION IN THE … · 2019. 2. 26. · Segregation in an elastic cloud Amazon EC2: –Infrastructure segregation: Regions – Separate geographic](https://reader036.fdocuments.us/reader036/viewer/2022063011/5fc639a33821403e177e82f6/html5/thumbnails/49.jpg)
Server groups (affinity)
Region A Region BKeystone
Horizon
AZ 1 AZ 2
Glance
Cinder
Nova
Neutron
Swift
Glance
Cinder
Nova
Neutron
Swift
AZ 3 AZ 4
storage-optimizednetwork-optimizedhigh-freq-cpu
![Page 50: DIVIDE AND CONQUER: RESOURCE SEGREGATION IN THE … · 2019. 2. 26. · Segregation in an elastic cloud Amazon EC2: –Infrastructure segregation: Regions – Separate geographic](https://reader036.fdocuments.us/reader036/viewer/2022063011/5fc639a33821403e177e82f6/html5/thumbnails/50.jpg)
Server groups (anti-affinity)
Region A Region BKeystone
Horizon
AZ 1 AZ 2
Glance
Cinder
Nova
Neutron
Swift
Glance
Cinder
Nova
Neutron
Swift
AZ 3 AZ 4
storage-optimizednetwork-optimizedhigh-freq-cpu
![Page 51: DIVIDE AND CONQUER: RESOURCE SEGREGATION IN THE … · 2019. 2. 26. · Segregation in an elastic cloud Amazon EC2: –Infrastructure segregation: Regions – Separate geographic](https://reader036.fdocuments.us/reader036/viewer/2022063011/5fc639a33821403e177e82f6/html5/thumbnails/51.jpg)
What next?
●Relevant design sessions:–Simultaneous Scheduling for Server Groups
● Friday, May 16 • 1:20pm – 2:00pm
–Scheduler hints for VM life cycle ● Friday, May 16 • 2:10pm – 2:50pm
–Nova Dev/Ops Session● Friday, May 16 • 3:00pm - 3:40pm
![Page 52: DIVIDE AND CONQUER: RESOURCE SEGREGATION IN THE … · 2019. 2. 26. · Segregation in an elastic cloud Amazon EC2: –Infrastructure segregation: Regions – Separate geographic](https://reader036.fdocuments.us/reader036/viewer/2022063011/5fc639a33821403e177e82f6/html5/thumbnails/52.jpg)
Resources
●Operations Guide – Chapter 5 “Scaling”–http://docs.openstack.org/trunk/openstack-ops/content/scaling.html
●Configuration Reference Guide – Chapter 2 “Compute”–http://docs.openstack.org/trunk/config-reference/content/section_compute-cells.html
●OpenStack in Production Blog–http://openstack-in-production.blogspot.fr/
![Page 53: DIVIDE AND CONQUER: RESOURCE SEGREGATION IN THE … · 2019. 2. 26. · Segregation in an elastic cloud Amazon EC2: –Infrastructure segregation: Regions – Separate geographic](https://reader036.fdocuments.us/reader036/viewer/2022063011/5fc639a33821403e177e82f6/html5/thumbnails/53.jpg)