CERN IT Department CH-1211 Genève 23 Switzerland PES 1 Ermis service for DNS Load Balancer...

16
CERN IT Department CH-1211 Genève 23 Switzerland www.cern.ch/it PES 1 Ermis service for DNS Load Balancer configuration HEPiX Fall 2014 Aris Angelogiannopoulos, CERN IT-PES/PS Ignacio Reguero, CERN IT-PES/PS

Transcript of CERN IT Department CH-1211 Genève 23 Switzerland PES 1 Ermis service for DNS Load Balancer...

Page 1: CERN IT Department CH-1211 Genève 23 Switzerland  PES 1 Ermis service for DNS Load Balancer configuration HEPiX Fall 2014 Aris Angelogiannopoulos,

CERN IT DepartmentCH-1211 Genève 23

Switzerlandwww.cern.ch/it

PES

1

Ermis service for DNS Load Balancer configuration

HEPiX Fall 2014

Aris Angelogiannopoulos, CERN IT-PES/PSIgnacio Reguero, CERN IT-PES/PS

Page 2: CERN IT Department CH-1211 Genève 23 Switzerland  PES 1 Ermis service for DNS Load Balancer configuration HEPiX Fall 2014 Aris Angelogiannopoulos,

CERN IT DepartmentCH-1211 Genève 23

Switzerlandwww.cern.ch/it

PES

2

Outline

• Core concepts

• DNS Load Balancing at CERN

• Motivation and Purpose

• Ermis Gateway

• Ermis Gateway Architecture

• Miscellaneous

Page 3: CERN IT Department CH-1211 Genève 23 Switzerland  PES 1 Ermis service for DNS Load Balancer configuration HEPiX Fall 2014 Aris Angelogiannopoulos,

CERN IT DepartmentCH-1211 Genève 23

Switzerlandwww.cern.ch/it

PES

3

Core Concepts (Just in case)

Load Balancing● Scale a single service by spreading it to multiple back-end nodes

High Availability● The end user must always “see” the service as functional

● Service should be up even if some front or back-end nodes fail

Page 4: CERN IT Department CH-1211 Genève 23 Switzerland  PES 1 Ermis service for DNS Load Balancer configuration HEPiX Fall 2014 Aris Angelogiannopoulos,

CERN IT DepartmentCH-1211 Genève 23

Switzerlandwww.cern.ch/it

PES

4

Core Concepts (2/2)

Service Manager's concerns:

● Implement High Availability at the application Layer No single point of failure

Replicate physical nodes among independent subnets

Replicate VM s among different availability zones

● Service components are expected to fail Hardware failures ( HDD, Switches, NIC's, Electricity etc )

Software failures ( Bugs )

Human Errors

Page 5: CERN IT Department CH-1211 Genève 23 Switzerland  PES 1 Ermis service for DNS Load Balancer configuration HEPiX Fall 2014 Aris Angelogiannopoulos,

CERN IT DepartmentCH-1211 Genève 23

Switzerlandwww.cern.ch/it

PES

5

DNS Load Balancing at CERN (1/4)

Page 6: CERN IT Department CH-1211 Genève 23 Switzerland  PES 1 Ermis service for DNS Load Balancer configuration HEPiX Fall 2014 Aris Angelogiannopoulos,

CERN IT DepartmentCH-1211 Genève 23

Switzerlandwww.cern.ch/it

PES

6

DNS Load Balancing at CERN (2/4)

We use a client server architecture: LBD Master: Server reports to DNS service

LB Client: Runs in the hosts, triggered by SNMP request

Page 7: CERN IT Department CH-1211 Genève 23 Switzerland  PES 1 Ermis service for DNS Load Balancer configuration HEPiX Fall 2014 Aris Angelogiannopoulos,

CERN IT DepartmentCH-1211 Genève 23

Switzerlandwww.cern.ch/it

PES

7

DNS Load Balancing at CERN (3/4)

1. LB Clients in the host provide LBD Master(through SNMP) with:

• load metrics

• availability checks

2. The LBD Master decides which IP should be pointed by an LB Alias

3. The LBD Master sends dynamic DNS requests to update the IP

address pointed by the LB Alias

● The LBD Master uses a fail-over slave server for high availability

Page 8: CERN IT Department CH-1211 Genève 23 Switzerland  PES 1 Ermis service for DNS Load Balancer configuration HEPiX Fall 2014 Aris Angelogiannopoulos,

CERN IT DepartmentCH-1211 Genève 23

Switzerlandwww.cern.ch/it

PES

8

DNS Load Balancing at CERN (4/4)

• Service is provided for 258 (and rising) different aliases

Page 9: CERN IT Department CH-1211 Genève 23 Switzerland  PES 1 Ermis service for DNS Load Balancer configuration HEPiX Fall 2014 Aris Angelogiannopoulos,

CERN IT DepartmentCH-1211 Genève 23

Switzerlandwww.cern.ch/it

PES

9

Motivation and Purpose

Motivation Creating new DNS Aliases in the cloud is time-consuming

Ticket to Config team -> Ticket to Network Ops

Lots of verbal and time-consuming communication

Waiting time for both can be high

Purpose Goal is to provide LBaaS to the end users of the cloud

Fast CRUD of LB Aliases in the CERN cloud No more tickets to the Network Group Simplifies the procedure of creating LB Aliases

Page 10: CERN IT Department CH-1211 Genève 23 Switzerland  PES 1 Ermis service for DNS Load Balancer configuration HEPiX Fall 2014 Aris Angelogiannopoulos,

CERN IT DepartmentCH-1211 Genève 23

Switzerlandwww.cern.ch/it

PES

10

Ermis Gateway

What is it?

RESTful service that manages the configuration of DNS LB

● Django-Tastypie● SOAP interface to Network Group● CRUD of LB Aliases● Aim is to provide LBaaS to the cloud end users● Developed and tested using Agile techniques

Page 11: CERN IT Department CH-1211 Genève 23 Switzerland  PES 1 Ermis service for DNS Load Balancer configuration HEPiX Fall 2014 Aris Angelogiannopoulos,

CERN IT DepartmentCH-1211 Genève 23

Switzerlandwww.cern.ch/it

PES

11

Ermis Gateway Architecture (1/2)

● Design● Model includes information about an Alias● Alias associated with a hostgroup or tenant● CRUD on model data

● Authentication● Kerberos ticket

Page 12: CERN IT Department CH-1211 Genève 23 Switzerland  PES 1 Ermis service for DNS Load Balancer configuration HEPiX Fall 2014 Aris Angelogiannopoulos,

CERN IT DepartmentCH-1211 Genève 23

Switzerlandwww.cern.ch/it

PES

12

Ermis Gateway Architecture (1/2)

● Authorization Egroups (CERN interface for managing groups of people) Openstack

Use of the Openstack identity service (keystone)

Foreman (under development) Alias creation for machines on the same hostgroup

Page 13: CERN IT Department CH-1211 Genève 23 Switzerland  PES 1 Ermis service for DNS Load Balancer configuration HEPiX Fall 2014 Aris Angelogiannopoulos,

CERN IT DepartmentCH-1211 Genève 23

Switzerlandwww.cern.ch/it

PES

13

Ermis Gateway Architecture (2/2)

Page 14: CERN IT Department CH-1211 Genève 23 Switzerland  PES 1 Ermis service for DNS Load Balancer configuration HEPiX Fall 2014 Aris Angelogiannopoulos,

CERN IT DepartmentCH-1211 Genève 23

Switzerlandwww.cern.ch/it

PES

14

LBD configuration

● LBD configuration Config file is created via the Ermis data

Page 15: CERN IT Department CH-1211 Genève 23 Switzerland  PES 1 Ermis service for DNS Load Balancer configuration HEPiX Fall 2014 Aris Angelogiannopoulos,

CERN IT DepartmentCH-1211 Genève 23

Switzerlandwww.cern.ch/it

PES

15

Miscellaneous

● Miscellaneous API endpoint

● REST calls to the service available

CLI available

Web Front available● https://aiermis.cern.ch (Internal only)

Page 16: CERN IT Department CH-1211 Genève 23 Switzerland  PES 1 Ermis service for DNS Load Balancer configuration HEPiX Fall 2014 Aris Angelogiannopoulos,

CERN IT DepartmentCH-1211 Genève 23

Switzerlandwww.cern.ch/it

PES

16

Thank you!

Questions?