AMS-IX provision system

24
AMS-IX provision system Maksym Tulyuk, [email protected] More-IP event, Amsterdam, 22nd May 2014

description

The general overview of AMS-IX provision system

Transcript of AMS-IX provision system

Page 1: AMS-IX provision system

AMS-IX provision system

Maksym Tulyuk, [email protected] event, Amsterdam, 22nd May 2014

Page 2: AMS-IX provision system

Agenda

1. Definition of the provision system

2. Evolution of the provision system

3. Achievements and plans

Page 3: AMS-IX provision system

Definition of provision system

Maksym Tulyuk, [email protected] event, Amsterdam, 22nd May 2014

Page 4: AMS-IX provision system

Provision system as Black Box

Customerrequests a link

AMS-IX provides access to a

VLAN

AMS-IXprovisio

nsystem

• link is a physical port(s) or rate-limit on a partner’s port• in 95% cases VLAN is Internet Peering VLAN

Page 5: AMS-IX provision system

Inside The Black Box

reservation

assignment

testing

enabling

customer’s request

signed documents

link is up

router is ready

Page 6: AMS-IX provision system

Deeply inside The Black Box

Complexity inside each step!

Page 7: AMS-IX provision system

Evolution of provision system

Maksym Tulyuk, [email protected] event, Amsterdam, 22nd May 2014

Page 8: AMS-IX provision system

Provision 4 years ago• customer: sends email to MR team

• MR: copy&paste information into my.ams-ix and RT, and sends email to NOC

• NOC: copy&paste to browser to find free port

• NOC: copy&paste to XML (internal database)

• NOC: copy&paste to console to configure port

• NOC: copy&paste to email to send reserved port to MR team

• MR: copy&paste into ...

Page 9: AMS-IX provision system

“Issues” with old systems

• each engineer did it in his/her own way

• a NOC engineer made a lot of errors

• it took a lot of time and energy

• it required a lot of the engineers

Page 10: AMS-IX provision system

Improvements

• Internal procedures

• Scripts

• Email templates in my.ams-ix.net

Page 11: AMS-IX provision system

Procedures

• Procedure = best practice

• Write down existing processes

• Constantly check and improve them

Page 12: AMS-IX provision system

Scripts

• “One step" scripts: change configuration, find free resources (port, IP address), etc

• “Do-it-all” scripts: replacement of procedures

• Require careful thinking

• Have a lot of checks

Page 13: AMS-IX provision system

Email templates

• Replacement of copy&paste operations

• Integration with my.ams-ix and our database

• Flexibility via simple programming language

Page 14: AMS-IX provision system

Historical perspective

• Write down best practices as procedures

• Replace the procedures with scripts

• Generate emails via templates

Page 15: AMS-IX provision system

Achievements and plans

Maksym Tulyuk, [email protected] event, Amsterdam, 22nd May 2014

Page 16: AMS-IX provision system

Fixing the “issues”

• his/her own way

• a lot of errors

• a lot of time and energy

• a lot of the engineers

• standardisation

• no errors

• minimum and predictive time

• no engineers involved

Page 17: AMS-IX provision system

Scalability

• Four new sites in Amsterdam: Equinix 3, EvoSwitch, Telecity 5, Terremark

• Four new exchanges: CW, EA, HK, NY

Page 18: AMS-IX provision system

Some numbers

Page 19: AMS-IX provision system

Achievements

• Free up engineers

• Speed up provision

• Scale up for new sites and exchanges

Page 20: AMS-IX provision system

Plans

• customer can add, remove and change mac addresses

• customer can configure BGP sessions with route-servers and our router

• partners can modify virtual links

Page 21: AMS-IX provision system

Even more ideas

• automatic testing and enabling

• automatic addition of mac addresses, BGP sessions, IPv6 addresses, etc

• automatic operations (show logs, port status, etc)

Page 22: AMS-IX provision system

Summary

• Simple concept of provision: request from customer -> link from AMS-IX

• From procedures to scripts

• Automatic emails and processes

• Scalability and growth

Page 23: AMS-IX provision system

Big thanks!

• m6_provision: Martin Pels

• my.ams-ix: Martin Lyden, Petros and Peter provision scripts: Gloria

• XML: Steven

• NOC and MR teams: feedback

Page 24: AMS-IX provision system

Questions? Feedback?

Maksym [email protected]