Between GRIDs and Networks: Grid-enabled network control planes Bartosz Belter TERENA Networking Conference 2008 Bruges (BE), May 19 th 22 nd 2008 TERENA Networking Conference 2008, Bruges (BE), May 19 th 22 nd, 2008 AGENDA 1 PHOSPHORUS overview Introduction to G 2 MPLS Grid extensions to GMPLS High level software architecture Proposal for G 2 MPLS deployment in the NRENs TERENA Networking Conference 2008, Bruges (BE), May 19 th 22 nd, 2008 PHOSPHORUS OVERVIEW 2 TERENA Networking Conference 2008, Bruges (BE), May 19 th 22 nd, 2008 PHOSPHORUS PROJECT European and Global alliance of partners to develop advanced solution of applicationlevel middleware and underlying management and control plane technologies Project Vision and Mission The project will address some of the key technical challenges in enabling ondemand endtoend network services across multiple heterogenous domains In the Phosphorus' implementation the underlying network will be treated as first class Grid resource Phosphorus will demonstrate solutions and functionalities across a testbed involving European NRENs, GANT2, Cross Border Dark Fibre and GLIF TERENA Networking Conference 2008, Bruges (BE), May 19 th 22 nd, 2008 MEMBERS OF THE CONSORTIUM Universities and Research Institutions: Communications Research Centre Canada (CRC) Fraunhofer-Gesellschaft Fundaci I2CAT Forschungszentrum Jlich Interdisciplinair instituut voor BreedBand Technologie Research Academic Computer Technology Institute Research and Education Society in Information Technology SARA Computing and Networking Services University of Bonn University of Amsterdam University of Essex University of Leeds Manufacturers: ADVA Optical Networking Hitachi Europe Ltd. NORTEL NRENs & RON: CESNET Poznan Supercomputing and Networking Center SURFnet MCNC SMEs: Nextworks TERENA Networking Conference 2008, Bruges (BE), May 19 th 22 nd, 2008 PHOSPHORUS ARCHITECTURE The different domains of the Phosphorus' testbed will have: Two flavours of GMPLS standard (Ph. 1) Gridenabled (Ph. 2) Three types of NRPS: UCLP DRAC ARGON Grid middleware UNICORE as a reference point AAA policies TERENA Networking Conference 2008, Bruges (BE), May 19 th 22 nd, 2008 MULTIDOMAIN TESTBED TERENA Networking Conference 2008, Bruges (BE), May 19 th 22 nd, 2008 INTRODUCTION TO G 2 MPLS 7 TERENA Networking Conference 2008, Bruges (BE), May 19 th 22 nd, 2008 WHY G 2 MPLS ? uniform interface for the Grid-user to trigger Grid & network resource actions single-step provisioning of Grid and network resources (w.r.t. the dual approach Grid brokers + NRPS-es) adoption of well-established procedures for traffic engineering, resiliency and crankback possible integration of Grids in operational/commercial networks, by overcoming the limitation of Grids operating on dedicated, stand-alone network infrastructures G2G2 G2G2 G2G2 G2G2 G.I-NNI G.E-NNI G.O-UNI G 2 MPLS NRPS Vsite A Vsite B Vsite C G.O-UNI Grid nodes can be modelled as network nodes with node-level grid resources to be advertised and configured (this is a native task for GMPLS CP) TERENA Networking Conference 2008, Bruges (BE), May 19 th 22 nd, 2008 WHAT IS G 2 MPLS ? G2MPLS is a Network Control Plane architecture that implements the concept of Grid Network Services GNS is a service that allows the provisioning of network and Grid resources in a single-step, through a set of seamlessly integrated procedures. expected to expose interfaces specific for Grid services made of a set of extensions to the standard GMPLS provide enhanced network and Grid services for power users / apps (the Grids) basically, a superset of GMPLS TERENA Networking Conference 2008, Bruges (BE), May 19 th 22 nd, 2008 G 2 MPLS CONTROL PLANE MODELS Two models for the layering between Grid and Network resources G 2 MPLS overlay model different scope with respect to the IETF GMPLS Overlay & Peer G 2 MPLS integrated model TERENA Networking Conference 2008, Bruges (BE), May 19 th 22 nd, 2008 G 2 MPLS REFERENCE POINTS G.OUNI, G.E-NNI East-West interfaces NBI North Interface SBI South Interface NMI Network Mgmt Interface TERENA Networking Conference 2008, Bruges (BE), May 19 th 22 nd, 2008 INTERFACING G 2 MPLS THROUGH ITS NETWORK REFERENCE POINTS Grid Middleware G 2 gateway G 2 MPLS CP G.OUNI-N G 2 MPLS CP Centralized Advanced Reservation Service (e.g. PCE based) G.OUNI-C Grid WS G.OUNI G.I-NNI G.eNNI-U/D G 2 MPLS CP G.I-NNI G 2 MPLS CP G.eNNI-D/U G.I-NNI G.OUNI-N G 2 MPLS CP Grid Application G.OUNI-C Grid WS G.OUNI G.E-NNI G 2 gateway NBI SBI G.xNI = Grid-enabled NI TERENA Networking Conference 2008, Bruges (BE), May 19 th 22 nd, 2008 EXAMPLE OF DIRECT INVOCATION [1] G 2 MPLS NCP Grid user Grid MW Grid Resources Grid site A Grid site B G.OUNI GW Grid Resources G2G2 G2G2 G2G2 G2G2 G2G2 G2G2 G2G2 Grid MW G.OUNI GW TERENA Networking Conference 2008, Bruges (BE), May 19 th 22 nd, 2008 WS-AG: Initial AR req. G.OUNI: GNS req. Grid App. request Grid user Grid scheduler Index service Grid site A LRMS site B Location req. Location resp. G.UNI-N site A G 2 MPLS LER G.I-NNI/ G.E-NNI req. G.OUNI: GNS req. WS-AG: Initial AR resp. WS-AG: Initial AR req. G.OUNI: GNS resp. WS-AG: Initial AR resp. G.OUNI: GNS resp. G.I-NNI/ G.E-NNI resp. WS-AG: Initial AR resp. WS-AG: Initial AR req. WS-AG: Commit AR req. G.OUNI: GNS conf. G.I-NNI/ G.E-NNI conf. G.OUNI: GNS conf. WS-AG: Commit AR req. WS-AG: Commit AR resp. WS-AG: Commit AR req. WS-AG: Commit AR resp. negotiation & reservation WS-AG: Commit AR req. EXAMPLE OF DIRECT INVOCATION [2] G.UNI-N site B G.I-NNI/ G.E-NNI notify G.OUNI: GNS notify G.I-NNI/ G.E-NNI req. G.I-NNI/ G.E-NNI resp. G.I-NNI/ G.E-NNI conf. G.OUNI GW+C site A G.OUNI GW+C site B TERENA Networking Conference 2008, Bruges (BE), May 19 th 22 nd, 2008 EXAMPLE OF DIRECT INVOCATION [3] Grid user Grid scheduler Index service Grid site A LRMS site B G.OUNI GW+C site A G.OUNI GW+C site B G.OUNI: GNS Activate req. G.I-NNI/ G.E-NNI GNS Activate req. WS-AG: Activate AR WS-AG: Activate AR activation G.OUNI: GNS Activate req. G.UNI-N site A G 2 MPLS LER G.UNI-N site B G.I-NNI/ G.E-NNI GNS Activate req. TERENA Networking Conference 2008, Bruges (BE), May 19 th 22 nd, 2008 GRID EXTENSIONS TO GMPLS 16 TERENA Networking Conference 2008, Bruges (BE), May 19 th 22 nd, 2008 GRID JOB MODELLING IN G 2 MPLS SIGNALLING Mapping from JSDL schema v1.3 TERENA Networking Conference 2008, Bruges (BE), May 19 th 22 nd, 2008 G 2 EXTENSIONS TO G.I-NNI, G.UNI, G.E-NNI ::= [ ] [ [ | ]... ] [ ] [ ] [ ] [... ] [ ] [... ] | Length |Class-Num (248)| C-Type (1) | | parent GNS transaction identifier | |... | | Start time | | Duration | | Job name | | Job project | (in Resv, PathTear, PathErr, Notify, as well) various sub- objects from the JSDL info elements TERENA Networking Conference 2008, Bruges (BE), May 19 th 22 nd, 2008 GRID RESOURCE MODELLING IN G 2 MPLS ROUTING Mapping from GLUE schema v1.3 TERENA Networking Conference 2008, Bruges (BE), May 19 th 22 nd, 2008 G 2 EXTENSIONS TO G.I-NNI & G.UNI Network-related extensions new sub-TLVs for optical constraints in Link TLV in the TE LSA TE LSA Router address TNA address Link GMPLS sub- TLVs DPMD Span length List of amplifiers List of available wavelengths TE-link calendar Grid LSA Grid Site Sub-TLVs Grid Service Sub-TLVs Grid Computing Element Sub-TLVs Grid Sub- Cluster Sub-TLVs Grid Storage Element Sub-TLVs Grid-related extensions new opaque LSA: Grid LSA + top-level TLVs in it + sub-TLVs in each of them TERENA Networking Conference 2008, Bruges (BE), May 19 th 22 nd, 2008 HIGH LEVEL SOFTWARE ARCHITECTURE 21 TERENA Networking Conference 2008, Bruges (BE), May 19 th 22 nd, 2008 STARTING POINT OF WORK Architecture and specs Architecture and functional decomposition: ASON/GMPLS Recs by ITU-T SG15 Protocols and procedures: IETF CCAMPs RFCs and I-Ds Inter-vendor interfaces: OIF IAs on UNI, E-NNI (then applied to inter- domain) Definition of Grid-GMPLS extensions and interwork with grid middleware: std. activities in Open Grid Forum, in particular Open Grid Services Architecture WG (ogsa-wg) Job Submission Description Language WG (jsdl-wg) Glue Schema Working Group (glue-wg) Grid High-Performance Networking RG (ghpn-rg) Software developments QUAGGA routing suite v (http://www.quagga.net/)http://www.quagga.net/ Released under GPL OSPFv2 with MPLS-TE extensions Common stack modules (e.g. VTY, zebra client/server, etc.) TERENA Networking Conference 2008, Bruges (BE), May 19 th 22 nd, G 2 MPLS HIGH LEVEL SOFTWARE ARCHITECTURE G 2.Call Controller G 2 Recovery Controller G 2.RSVP-TE G 2.PCE-RA G 2.OSPF-TE Link Resource Manager Transp. Net. Resource Controller SCN gateway Path computation requests Rec. bundle actions Call actions Topology updates LSP actions Send/receive protocol messages Device configuration Resource allocation Get TE-Links properties TL1, SNMP Bug-fixing & integration under development TERENA Networking Conference 2008, Bruges (BE), May 19 th 22 nd, 2008 A PROPOSAL FOR G (2) MPLS DEPLOYMENT IN THE NRENS 24 TERENA Networking Conference 2008, Bruges (BE), May 19 th 22 nd, 2008 DEPLOYMENT OF G 2 MPLS IN NRENS Some add-ons to the required GMPLS feature list Advance reservations Co-existence with adjacent NRPS Clear resource partitioning and virtualization Path computation for lambda networks (optical impairments) + management of advance reservation Grid+network specific desiderata Integration of Grids with NRENs infrastructures (a.k.a. add a CP to Grids) No more a ships-in-the-night style but reciprocal awareness and seamless one- step configuration Identification of the reference points and CP models Integration and escalation of recovery procedures Integration with existing AAA AuthZ mechanisms for Grids Integration with existing NMS TERENA Networking Conference 2008, Bruges (BE), May 19 th 22 nd, 2008 COEXISTENCE OF GMPLS AND G 2 MPLS [1] Mainly an inter-domain problem G 2 MPLS nodes dispersed in GMPLS domains act as std-GMPLS nodes (routing, signalling) GMPLS nodes merged in G 2 MPLS domains cannot act as G 2 MPLS nodes The most convincing future scenario for intra-domain coexistence seems to be a multi-region domain Phosphorus G 2 MPLS used to provide CP capabilities to equipments currently lacking in it (e.g. carrier Ethernet switches or similar) Off-the-shelf GMPLS used to control SDH or WDM technologies TERENA Networking Conference 2008, Bruges (BE), May 19 th 22 nd, 2008 COEXISTENCE OF GMPLS AND G 2 MPLS [2] but in the inter-domain context G 2 MPLS domains handle both Grid and network resources ASON/GMPLS domains control only network resources This implies a reduction of the information set carried out through the G.E-NNI, both for routing purposes and, above all, for signalling TERENA Networking Conference 2008, Bruges (BE), May 19 th 22 nd, 2008 GMPLS/G 2 MPLS: 2-PARTIES SCENARIO TERENA Networking Conference 2008, Bruges (BE), May 19 th 22 nd, 2008 GMPLS/G 2 MPLS: 3-parties scenario TERENA Networking Conference 2008, Bruges (BE), May 19 th 22 nd, 2008 SUPPORT TO THIS ANALYSIS [1] public questionnaires to NRENs and HPCs Goals To collect requirements, To stimulate interest towards our solutions, To identify trends and plans for GMPLS/G 2 MPLS deployment and/or Grid &network integration Questionnaire for NRENs Answers (CESNET2, PIONIER, FCCN, DFN, GARR, HEAnet) Questionnaire for HPCs Answers (Barcelona Supercomp. Center, CINECA) TERENA Networking Conference 2008, Bruges (BE), May 19 th 22 nd, 2008 SUPPORT TO THIS ANALYSIS [2] Positive positioning mainly by NRENs who are currently missing an automatic control/management system for network and Grid resources or just have test-beds for that Internal to the project (PIONIER, CESNET2) External (GARR, DFN) Further steps: Software integration & testing Analysis of capabilities of Phosphorus GMPLS/G 2 MPLS to control efficiently the optical infrastructures integrated with the switched Ethernet smooth integration of Phosphorus GMPLS/G 2 MPLS with the GN2 BoD Support and maintenance of the produced software Bartosz Belter TERENA Networking Conference 2008 Bruges (BE), May 19 th 22 nd 2008 Thank you. Questions?