Circuit Services

Christian Todorov

Internet2 Fall Member Meeting

October 9, 2007

Christian Todorov2

Internet2, Circuits & You

• Where we have been

• Changing needs

• Why circuits are different

• How Internet2 provides circuits

• Internet2 Circuit offerings

• Who to contact

Christian Todorov

Abilene Network

• Internet2’s previous network (Abilene) was IP only and based on unprotected 10G (OC-192) waves on the Qwest infrastructure

• Utilized IS-IS• Natively supported IPv4/v6 and multicast • IP is great… for most people… most of

the time…

3

Christian Todorov

Changing Needs

• As the capabilities available to the research community changed, the demands on the network also changed

• e-science applications and facilities grew and exerted greater performance pressures on the network where TCP and shared environments were no longer acceptable

• Dedicated infrastructure was becoming a requirement

4

Christian Todorov

Demands on the Network

• Entering the age of large scientific facilities• Large Hadron Collider at CERN• Very Long Baseline Arrays (radio astronomy)• Large Synoptic Survey Telescope (2010-13) – 30TB/night

• An increasingly diverse set of demanding applications are utilizing network resources• Telemedicine: BIRN project, proteomics, tele-surgery, remote

ICU, radiology: high-resolution 3D color fMRI brain scan = 4.5PB • Telepresence: master classes, virtual classrooms, tele-psychiatry• High performance video delivery: Uncompressed HD, Cinegrid• Disaster Recovery and distributed storage

5

Christian Todorov

The New Requirements

• High performance applications are dependent on high performance networks

• Networks must be fast, reliable, scalable, have flexible architectures, be cost effective, capable of delivering multiple services across multiple network layers, easy to operate and maintain, and have a view towards the future

• Enable the user – the network as a service

6

Christian Todorov

The Internet2 Network Overview

• Layer 1: Managed wavelengths from Level(3) Communications • Level(3) owns and manages Infinera optical gear: responsible for

software upgrades, equipment maintenance, remote hands, sparing, NOC services

• Internet2 NOC has total provisioning control• Layer 2: Internet2 owned and managed Ciena CoreDirectors

• Using DRAGON GMPLS control plane • Layer 3: Internet2 owned and managed Juniper T640s • Expanded Observatory

• Platform for layer 1/3 network performance data collection, collocation, experimentation

• perfSONAR integration for intra- & inter-network performance analysis• International connectivity

• Layer 1 network extended to international exchange points in Seattle, Chicago and New York City

• Peering points in Seattle, PAIX, Equinix Chicago

7

Christian Todorov

Title of slide

• Level 1• Level 2

• Level 3• Level 4

• Level 5

Christian Todorov

Circuits: Why They are Different

• IP networks switch packets of information across shared networks to multiple locations and operate at Layer 3• Shared packet networks are well suited to applications where data transfers are

intermittent, multi-point, or have smaller file size transfer requirements• A “best-effort” service • Represents the largest number of uses of the current network

• Circuits connect two discreet endpoints with dedicated connections and operate at Layer 2 or below• Circuit based networks are well suited to long duration, point to point connections

that support large data transfers or transfers that require very predictable network performance

• Is a dedicate resource• Connection oriented service• Represents a small number users who have high demands of the network:

bandwidth, performance, desire to run alternative protocols

9

Christian Todorov

Wavelength & Circuit Services

• Connection oriented services provide for:• Guaranteed bandwidth and predictable jitter and latency

(repeatable, dependable performance between collaborating sites)

• Traffic segregation (support specific policy or traffic engineering requirements)

• Router bypass: Express links created for high-bandwidth, limited duration long-haul traffic reducing the need for mid-path L3 interfaces

• Cost efficiency: L3 router blades cost > L2 ports > L1 or L0 interfaces

• Capability tradeoff but could possibly improve performance

10

Christian Todorov

Internet2 Circuit Services

• Internet2 offers two types of Circuits• Static circuits

• Exist on the Circuit Infrastructure supported by both the Infinera and Ciena devices

• Manually provisioned by the NOC• 50Mbps to 10Gbps• Fee for service• Longer duration: months to years• Can have dedicated protection• A contracted, assured service

• Dynamic Circuits • Exist within the Dynamic Circuit Network (DCN) supported by the Ciena

CoreDirectors• Provisioned automatically• Requires participation in the DCN protocols• 50Mbps to 10Gbps• Have no fee for use• Short duration ~2 weeks• Best effort service

11

Christian Todorov

Connecting to the Internet2 Circuit Infrastructure

• Accessing the Circuit Infrastructure• One must have a connection to the Internet2 circuit infrastructure in

order to access the Internet2 circuit services. • The circuit connection is separate from the IP connection • The standard connection to the circuit infrastructure is either 1GE or

10GE – other interface types are supported at an additional fee• ONE physical connection to the circuit infrastructure on the Ciena

CoreDirectors will support BOTH the static circuit service AND the Dynamic Circuit Network

• For the first year, the connection to the Cienas are available to IP connectors at no additional fee for a standard connection (1GE or 10GE) that is equal in bandwidth to the contracted IP connection, e.g. 10G IP connectors receive the use of a 10G circuit connection. (Non-connectors may be subject to additional port fees)

• Circuit connections are available to Connectors, members and peers

12

Christian Todorov13

•Example of Optical only Node for connected RON or Peer Network

Internet2 NetworkNode Architecture

Christian Todorov14

•Infinera DWDM Gear - Static at the start•Grooming capabilities in ADM to provide sub channels and HOPI types of activities at the start•Simplified and standardized interface to connectors, exchange points, and other global research and education networks - 2 x 10 Gbps interfaces•Measurement and control servers will support the node

Internet2 NetworkNode Architecture

Christian Todorov

Dynamic Circuit Network

• The Dynamic Circuit Network (DCN) is considered a network due to its characteristics and behavior: it is protocol driven, has the capability to determine paths, can exchange network information with neighbors and it is aware of its own resources

• The DCN concept expands the notion of networking where a network facility is able to provide the most appropriate resource for a given demand

• Dynamic Circuit Network (DCN) is developmental until 1-1-08 and persistent thereafter

• Invitations are currently being sent out by Internet2 to the connectors for participation in DCN

• A DCN connection does not imply a connection to the IP network• DCN participation is critical to its success as its value grows with

the number of participants

15

Christian Todorov

Static Circuits

• Static circuits are manually provisioned by the NOC and are intended for longer durations: the typical concept of a circuit

• A contracted, fee for service offering based on bandwidth, duration and distance

• Can exist both on and off of the Internet2 network footprint • Intended to provide dependable, dedicated and

deterministic service to connectors• A static circuit does not imply a connection to the DCN or

the IP network• Includes full 10G waves• Available now

16

Christian Todorov

Who to Contact

• DCN connection requests or information:• Network@internet2.edu• Rick Summerhill is lead

• Static circuit requests, fees and information:• waveco@internet2.edu• Christian Todorov is lead

• Member and Partner Relations assistance:• univengage@internet2.edu• Marianne Smith is lead

17

Christian Todorov

Questions?

18

Christian Todorov19