Building Multi Services IP Network - cisco.com · System Engineers Anyone who ... Video on Demand...

© 2006 Cisco Systems, Inc. All rights reserved. Cisco ConfidentialPresentation_ID 1

Building Multi ServicesIP Network

Mohamad Ali Fahmi ([email protected])System Engineer


Level of Contents

Introduction level


Targeted Audience

Technical managers

Network Engineers and Planning

System Engineers

Anyone who interested to this session ;-)


Agenda

What is Multi-Services IP Backbone ?

Considerations in Design

Typical Deployment of Multi Services Network

Monitoring of Multi Services

Case Study

Summary


What is Multi Services IP Network ?

“Is an IP network that can deliver various services with different traffics type to customers with different

treatment “


Managed IPT/Video/Desktop

Managed LAN

Managed CPE

Growing scope of SP PortfolioComplementing Connectivity with Value Added Services

ManagedConnectivityNetwork based

SharedServices


Implication…

Many Services means….More Complex … more investments…but..

Many Services means more revenue ;-)


SP Services Offering Today

Internet – surfE-commerceHard Disk StorageVideoconferenceVoice flat fee

Surveillance

Centralization of ServersStorage, Video TransferDisaster RecoveryMega Internet, Web hosting, EmailBranch office VPNsIP telephony, SANs, CDNs

Intranet: lectures, materialsInternet - surf, research, EmailIP video, telephonyE-learning

Large Business and Business Parks

Small Business, Shops and SOHO

Schools, Hospital Libraries, Public

ResidentialBuildings Owners Buildings Managers

Universities, Research Institutes

Basic Package: Internet, mailboxes, voice +Captive Portal +Video on Demand DVD player+Video BroadcastGaming

Reduced Local Loop CostMega InternetWeb hosting, EmailHD Images - TelemedicineIP Phone on each teacher’s or doctor’s deskSurveillance real time

Raise the value of the buildingsSurveillance real timeDigital recording


What SP needs… ?

Growing trend: MPLS as selected choice for next gen multiservice network

MPLS QoS architecture must fit mutiservice strategy

Architecture must be flexible and scalable

Ethernet

ATMIP

VPN

Frame RelayPPP

Internet

VoIP

IPv6

PSTN

One networks for All Services


The Evolutions : Circuit to PacketPast: Circuit

LeasedLine

PSTN

Mobile

Dial-UpInternet

Present: Hybrid

Broadband Services

PSTN

Mobile

Optical

FR/ATM

High-Speed Internet

Future: Packet

Consolidated Packet

Architecture

Mobile

Broadband

10© 2003, Cisco Systems, Inc. All rights reserved.7632_03_2003_c4

PSTN


The Evolutions : Multi to Single

F/R

IP

Video

Voice

IP/MPLS Core

Site 1

Site 3 Site 5

Site 5

Site 2Site 4

Site 1

Site 2 Site 4

Site 6

Site 3 Site 5


Benefit for SP

Reduce CAPEX and OPEXReduce ComplexityIncrease FlexibilityIncrease ScalabilityIncrease Capability to deliver new servicesTime to deploy new serviceIncrease Revenue


Consideration in Building Multi Service Network

Services type and attributes (data, video, voice, etc)

Services Requirements– Protocol Requirements (IP,non IP, FR,ATM,etc)– Security requirements (total separation, authentication, etc)– High Availability requirements (4 9, 5 9 ?)

Charging


Service Network AttributesBandwidth PER Jitter/Delay

Internet Access NC NC NC

Business VPN 1~10 Mbps <0.540ms

between nodes

VoIP <64kbps <10E -2<200ms

RTD

IPTV/Video2~4 Mbps

(per channel)<10E -6 Depends on

STB buffer

VoD2~4 Mbps

(per subscriber))<10E -6 Depends on

STB buffer

PER: Packet loss ratioNC: non-critical

STB: Set Top BoxRTD: Round trip delay


How to meet Service Network AttributesReliability/PER attributes :

– Related with Transmission Type– VSAT PER < MWAVE < DSL < FO

Bandwidth attributes :– Related with transmission capacity – VSAT ~ kbps to 2 Mbps– Mwave ~ 54 Mbps – DSL ~ 2 to 10 Mbps– Fiber Optic ~ 40 Gbps

Delay Attributes :– Related with transmission type, distance and bandwidth availability, processing and queueing– VSAT ~ 500ms– MWAVE ~ 10 ms– FO ~ < 1ms


How to Calculate Delay ?

P1 Q1 P2 Q2P3

Q3P4

Total Delay : P1+Q1+P2+Q2+P3+Q3+P4

Q : processing and Queuing delay is around uS in cisco routersP : Propagation/Serialization is the most parts, depends on

transmission and bandwidth availability


Propagation Delay (example)

Media : MicrowaveTransmission delay : 10ms Bandwidth : 2 MbpsPackets size : 10 Mega bitNumber of Hop : 4 hopsPropagation delay: 10/2 x 10ms x 5 hops : 250ms

Not meet VoIP requirements….


Service Requirements (typical)

IP Based Service , such as business application, VoIP, IPTV, HSI, etc

Non IP Based Service, such as mobile backhoul, ATM based service or FR based Service

L3 based service, such as business application, HSI, VoIP, etc

L2 based service, LAN trunking , flat network, IPX, etc

5 9 HA requirements , such as mobile backhoul

User authenticated based service , such as H S I


Typical Multi-Services Deployment

IP MPLS

Carrier Ethernet / Metro Ethernet


MPLS at a Glance

MPLSIP-VPN

PSTNISDNBranch

Home

Travel

ADSL/Cable

Branch Home

INTERNET

SharedServices

Regional Site

LL

Frame-RelayATM

Remote Sites

INTERNETBranch

Home

TravelIPSec Central

Site

TDMMUX

IPTV

BusinessHosting

VoIP

Internet


What is Carrier Ethernet?

Delivers an Ethernet UNI to Enterprises/SMB for MAN/WAN connectivity

SP has multiple transport options

100 Mbps

Ethernet

RemoteOffice 3

Ethernet-ConnectedBranch

RemoteOffice 1

RemoteOffice 2

RegionalHeadquarters

SPMetro Ethernet

Network

Ethernet-ConnectedBranch10 Mbps

Ethernet

10 MbpsEthernet

SONET/SDHRPRDWDM/CWDMEthernetMPLS/IP


What Does Ethernet as a LAN/MAN/WAN Transport Offer?

Ethernet becomes the ubiquitous interface: single technology for LAN, MAN and WAN

Efficient packet-based infrastructure: IP friendly

Cost effective interface with flexible bandwidth offerings: 10/100/1000/10000 Mbps

Geographical independence: Ethernet over Optical, IP or MPLS


Enterprise Applications Drive Metro Ethernet

LAN interconnect

Service aggregation

Interconnect data centers

Backup and disaster recovery

Connect to hosting services

Value-added services

High Bandwidth

Low Latency

TransparentServices

High Availability

Cost Effective

Manageable and Secure

How SPs Deliver This Is Largely Irrelevant…Carrier Ethernet Is Simply a Tool in the Tool Box


IP MPLS and Carrier Ethernet Positioning

VoD

Content Network

TV SIP

Aggregation NetworkMPLS/IP

Carrier Ethernet Aggregation

DSL Access Node

Optional L3 VPN PE

Access L3 VPN Edge

Distribution Node

Distribution Node

Integrated Edge Node

Ethernet Access Node

Business

Corporate

Residential

STB

Residential

STB

Business

Corporate

Business

Corporate

Residential

STB


WiMAX

Optional L3 VPN PE

VoD

Content Network

TV SIP




Core NetworkIP / MPLS

PONAccess Node


MPLS and carrier Ethernet Integration

Core

Metro Ethernet

Network

Metro Ethernet

NetworkMetro Ethernet

NetworkHFC

IPDSLAM

Metro Ethernet

Network

• Ethernet Access

• DSL Access

• Cable AccessInternet

Access

Ethernet Connectivity

L2 M2P

Services

Ethernet Access Services

Eth

DSL

CMTS

EthernetSW

Ethernet Connectivity

L2 P2P

Intra / Inter-Metro


Common Services offered by SP MPLS and Carrier Ethernet

Market Services SLA Type SLA Example

Residential Internet Access TransportDynamic access bandwidth, session/idle timeout, advertisements, post paid/prepaid (time and volume)

VoIP Telephony ApplicationThe number of VoIP appliances, SIP URLs/PST Phone numbers, active calls, VoIP call quality

VoD Application The number of STBs, stream quality, content flavours, charging models

TV Application The number of STBs, type of TV packages, SD vs HD content and delivery quality

BusinessL3 VPN MPLS/Multicast Transport

Access bandwidth, differentiated services support, L3 VPN topology, managed services (MPLS/Multicast VPN)

E-Line Transport Access bandwidth, differentiated services support, transparency

E-LAN Transport Access bandwidth, differentiated services support, multipoint transport, transparency

Wholesale L3 (P2P, MP) TransportAggregated bandwidth on ISP level, differentiated services support, with subscriber management at ISP

L2 (P2P, MP) TransportAggregated bandwidth on ISP level, differentiated services support, transparent Ethernet transport P2P and MP (multicast optimized)

Mobile Operator Mobile Backhoul Transport Accress Bandwidth , TDM emulation , transparency


Edge/AggregationAccess

Aggregation

Residential

STB

Mobile

Business

Corporate

Residential

STB

QinQ/MPLS/IPIPTV routed

HSI/Business MPLS PW

DSL

ETTx

PON

WIMAX

VOD TV

CORE

BSC RNC

Converged Residential and Business

ISG

Distribution

PSTN

IP

N-PE

E1/STM-1 E1/STM-1

P/PE

P/PE

U-PE

N-PE

BRAS

SIP/SS


What is E-LINE and E-LANE ?

• MEF Service Types:

• E-LINE: associated to an Point-to-Point EVC

• E-LAN: associated to an Multipoint EVC

Multipoint-to-Multipoint EVC(E-LAN)

Point-to-Point EVC (E-Line)

EVC A

EVC BEVC C


ME Service Portfolio

MEN

Ethernet Wire Service / Ethernet Private Line

MEN

Ethernet Relay Service

MEN

Ethernet Multipoint Service

MEN

Ethernet Relay Multipoint Service


MPLS/IP/TDM

N-PE

N-PE

N-PEP P

PP

GE Ring

Metro A U-PEPE-AGG

Metro C

U-PE

DWDM/CDWM

U-PE

User Facing Provider Edge (U-PE)

Network Facing Provider Edge (N-PE)

Metro Ethernet Architecture and Terminology

U-PE

RPRSONET/SDH

Metro D

Full ServiceCustomer Equipment


Large ScaleAggregation

IntelligentEdge

MultiserviceCore

Efficient Access

Integrated SystemIntelligent

EdgeEfficientAccess

Metro B

10/100/1000 Mbps

10/100/1000 Mbps

10/100/1000 Mbps

10/100/1000 Mbps

Hub andSpoke

Aggregator (PE-AGG)


Metro Ethernet Architecture and Functional Roles




IntelligentEdge

MultiserviceCore

Efficient Access

Integrated SystemIntelligent

EdgeEfficientAccess

EdgeN-PE

AggregationPE-AGG P

Fast Packet Forwarding (IP/MPLS),Sophisticated Traffic Engineering and Congestion management

Traffic aggregation,Congestion management,L2 wholesale handoff, Service insertion

AccessU-PE

Admission control, Security Policy Enforcement, Classification, Policing and Marking,Queuing and scheduling

MPLS, L2TPv3, VPWS, VPLS, L3VPN, Internet Access,Service Gateway,Value Added Services(Security, Voice,…)


Access / Aggregation Network Control Plane Options

Layer 3 - IP, MPLS

„Distributed L3 Service Edge“

Layer 2 – MPLSEoMPLS/ H-VPLS

„Centralised L3 Service Edge“„Transparent Ethernet Services „

EoMPLS

DSL Access Node

Distribution Node

BRAS

MPLS PE

SCE

Business

Corporate

Residential

STB

Aggregation Node

Aggregation Node

Core NetworkIP / MPLS

VoD

Content Network

TV SIP

Business

Corporate

Business

Corporate

Aggregation Node


Aggregation NetworkMPLS, Ethernet, IP

Distribution Node

Access L2/3 Edge

VoD

Content Network

TV SIP

Layer 2 – Bridged EthernetIEEE 802.1q / 802.1ad

802.1q

„Centralised L3 Service Edge“„Transparent Ethernet Services „


Ethernet Layer 2 Aggregation Network

IGMP snooping

DR

Querier Router

PIM

L2 L2

L2L2

L2 L2

IGMP/PIM snooping

IEEE 802.1qRSTP

Multicast

Advantage :• Cheap , since using layer 2 switch• Simple , only use VLAN and trunking• Looping prevention use STP• suitable for internet/data traffics

Disadvantage• Only pure layer 2 service • Not Scalable • Difficult to troubleshoot,since based on Mac-address• not scalable• not suitable for multicast traffics


MPLS Layer 2/3 Aggregation Network

IGMP snooping

Designated Router

Querier Router

PIM

PW PW

PWPW

PW PW

IGMP/PIM snooping

MPLSOverlay Topology: VPLS, EoMPLS PW

VSI

VSI

VSI

VSI

VSI

VSI

Multicast

Advantage :• more expensive , since using router with l2 vpn only• Looping prevention use routing protocol and label• suitable for internet/data traffics• suitable for TDM over IP and Multicast• more scalable• easy to troubleshoot

Disadvantage• more expensive • more complex


System Functional Considerations

353535


• Topology• High Availability• QOS• OAM

System Functional Considerations


IntelligentEdge

MultiserviceCore

Efficient Access

Integrated Edge NodeMSE

PPP, IP, MPLS MPLSMPLS / IPDSL, Ethernet

BNG

Distribution Node


IntelligentEdge

MultiserviceCore

Efficient Access

Integrated Edge Node Distribution Node

MPLS/ IP MPLSMPLS / IP

Optional L3 VPNPE

Optional L3 VPN PE

Access Node

DSL, PON, WiMAX, Ethernet


Topology

373737


Physical TopologiesAggregation and Access Networks


n x 10GEn x 1GE

Distribution Node

Distribution NodeETTX Access

DSL, PON Access

ETTX Access


IntelligentEdge

MultiserviceCore

Efficient Access

Integrated Edge NodeAccess Node Distribution Node

MPLS/ IP MPLSMPLS / IPDSL,PONWiMAX, Ethernet

Optional L3 VPNPE

Optional L3 VPN PE



PON Access

WIMAX Access


MPLS/IP based TV TopologiesAggregation Network MPLS/IP Topologies

Access Trunks

MPLS data plane domainLDP (Integrated Edge Node resindetial and loopback prefixes)

and RSVP-TE control plane

May be different ASIGP and LDP adjacencies

MPLS data plane domainL3VPN PE loopback prefixesIGP control plane domain

IP multicast routed over MPLS TE protected EoMPLS pseudowire data planeIP Multicast control plane: 2nd IGP and PIM


IntelligentEdge

MultiserviceCore

Efficient Access

Integrated Edge Node Distribution Node

MPLS/ IP MPLSMPLS / IPDSL, PON, WiMAX, Ethernet

Optional L3 VPNPE

Optional L3 VPN PE


High Availability

404040


Baseline HA MechanismEthernet Layer 2

• Resilient Ethernet Protocol (REP)IP Services:

• Fast IGP/BFD convergence• Multicast Fast Convergence

MPLS Services:• Pseudowire redundancy • MPLS TE-FRR Link and Node protection with IP services, PW/VPLS PW tunnel selection

MPLS/IP Services use a combination of MPLS TE-FRR and fast IGP/PIM convergence


IP/MPLS Core

Voice

Video

Data

Remote C.O. orEnvironmentally

Controlled CabinetPE-AGG

C.O.N-PE

FFTB/FTTHU-PEEPL, EVPL, E-LAN

ME 3400G-12CSCatalyst 6500

ME6524Cisco 7600

Catalyst 4500ME4924-10GE 7600

3750 MetroME 3400-24TSME 3400-2CSME-3400-24FS

ME6524ME4924-10GE

Resilient Ethernet Protocol Spanning Tree

Cisco REP SolutionDeployment Example at Ethernet L2 Accesstt

Fast Convergence from the access to the N-PE

REP

REP

CORE


REP Test result


Link Protection

TE Tunnel A B D E

Router DRouter B

Router C

Router ERouter A


Link Protection

B has a pre-provisioned backup tunnel to the other end of the protected link (Router D) B C D

FRR relies on the fact that D is using globallabel space

Router D

Router C

Router A Router B Router EProtected Link

Fast ReRouteBackup Tunnel


Node Protection

What if Router D failed?

Link protection would not help as the backup tunnel terminates on Router D (which is the NHop of the protected link)

Router D

Router C

Router A Router B Router E


NHop

Protected Link


Node Protection

SOLUTION: NODE PROTECTION (If network topology allows)

Protect tunnel to the next hop PAST the protected link (NNhop)

Router D

Router C

Router A Router B Router E


NNHop

Protected Node


QoS

484848


The Dangerous of Un-manage Multi Service network

All Services performance will be degradated..


Classification and Marking DesignQoS Baseline Marking Recommendations

ApplicationL3 Classification

DSCPPHBIPP CoS

Transactional Data 18AF212 2

Call Signaling 24CS3*3 3

Streaming Video 32CS44 4

Video Conferencing 34AF414 4

Voice 46EF5 5

Network Management 16CS22 2

L2

Bulk Data 10AF111 1

Scavenger 8CS11 1

Routing 48CS66 6

Mission-Critical Data 26AF31*3 3

Best Effort 000 0


Hierarchical QoS

Instance identified by:UNIEVC orEVC and user_priority (L2

CoS/L3 DSCP)

A Class of Service is defined by Performance ObjectivesFrame DelayFrame Delay VariationFrame Loss Ratio

UNI

EVC1

Ethernet Frame

Ingress BWProfile per EVC1

SPCE



EVC2

EVC3

UNI EVC1

DSCP 46,24

DSCP 18Ethernet Frame

Ingress BW Profile per Class of Service ID

SPCE

Ingress BW Profile per Class of Service ID

UNIEthernet Frame

SPCE

Ingress BWProfile per UNI

EVC1


OAM

525252


Problem Scope A few possible scenarios

U-PE A

U-PE B U-PE C

N-PE 3

N-PE 4N-PE 2

N-PE 1

CustomerEquipment

CE

CE CE

Ethernet UNI

SP Network

PW

Access Core

CE

U-PE D

Ethernet UNI

MPLS

MPLSSONET/SDH

NativeEthernet

Physicallink failure

UNIport

failureU-PE

device failure

Physicallink failure

VFIfailure

Physicallink failureP-Router

failure

PW failureVLAN to VFI

xconnect failure

Duplex mismatch

Speed mismatch

D-LDP session failure

VC failure

ACfailure

Uni-directional

Link

Excessive Encoding

Errors

Excessive FCS

ErrorsCross-

connected Service

Unexpected Endpoint LSP

Failure

C-VLAN to EVC

mismatch


Fault detection with E-OAM

Problem StatementFault Verification and Fault Isolation of ethernet connectivity issues

Problem SolutionIEEE 802.1ag (CFM) Ping and Traceroute utilities for reactive troubleshooting of service connectivity issues

Ethernet Access

MPLS CoreEthernetAccess

Customer Service Provider

Customer Domain

Service Provider Domain

Operator Domain

CE 11 CE 31uPE 31nPE 31nPE 11uPE 11 PE-Agg


E-OAM (example)

Problem StatementFault Verification and Fault Isolation of ethernet connectivity issues

Problem SolutionIEEE 802.1ag (CFM) Ping and Traceroute utilities for reactive troubleshooting of service connectivity issues

Ethernet Access

MPLS CoreEthernetAccess

Customer Service Provider

Customer Domain

Service Provider Domain

Operator Domain

CE 11 CE 31uPE 31nPE 31nPE 11uPE 11 PE-Agg

Jan 26 03:14:10.608: %ETHER_SERVICE-6-EVC_STATUS_CHANGED: status of EVC_P2P_100changed to InActive

uPE11#traceroute ethernet 0012.017c.3d00 level 4 vlan 100Type escape sequence to abort. TTL 255. Per-Hop Timeout is 10 secondsTracing the route to 0012.017c.3d00 on Domain PROVIDER_DOMAIN, Level 4, vlan 100Traceroute sent via GigabitEthernet0/16

--------------------------------------------------------------------------------MAC Ingress Ingress Action Relay Action

Hops Host Forwarded Egress Egress Action Next Hop --------------------------------------------------------------------------------B 1 nPE11 0013.5f21.cec5 Gi3/1 IngOk RlyCCDB

Forwarded B 2 nPE31 0007.8508.3485 RlyCCDB

Not Forwarded Gi3/1 EgrDown

nPE31(config)#int gig3/1nPE31(config-if)#shutdown

X

ProactiveFault Notification

ReactiveFault Isolation


IEEE 802.1ag: Fault Management per Service/VLANIEEE 802.3ah Link Protection and MonitoringMEF 16 E-LMI for Customer Premise Equipment

End-to-end Service ManageabilityFirst Mile Physical Connectivity VerificationPro-active Service Status and Availability

1800, 2800, 3800 ISR

ME 3400,3750 Metro

7600

Cisco Carrier Ethernet Capabilities Benefits

ISR

ISR

ISR

802.1ag

E-LMI802.3ah802.3ah 802.3ah802.3ah802.3ah 802.3ah

ServiceLink

Service

ME 34003750 Metro

ISRME 3400

7600

Core

7600 7600 7600

E-LMI

E-OAM Supported ProductCisco’s Carrier Ethernet OAM: Industry’s Only Solution with End-to-End Manageability and Customer Loyalty: Service Level Assurance


Platforms

575757


Cisco Platform Positioning

CoreEdgeAggregationAccess

3550 *3750-ME4500 Supervisor V

15454

6500 Sup720 PFC3B/3BXL (CatOS)

120006500/7600 Sup720 PFC3B/3BXL (IOS)

AccessU-PE PE-AGG

Aggregation Transport

Access Transport

N-PE Core Transport

(*) Catalyst 3550 EOS already publicly announced

6500 Sup32 (CatOS)

15310


Cisco XR 12000 Series

Cisco ASR 1000 Series

Cisco 7600 Series

Cisco Platform for Multi Service Core Edge

Cisco CRS-1 MCCisco 10000

Series

59

Shared Port Adapters (SPA)FE/GE/10GE, POS, TDM, Circuit Emulation, ATM

Cisco CRS-14, 8, 16 Slot

Same Interfaces Edge to Core


Summary

606060


Summary

Service Characteristics and Requirements must be known before building Multi service networkBuilding Multi Services Network must be well designed and well managed to accommodate every service characteristics and requirementsMulti Service network with right architecture will give advantage Multi Service network has proofed at HKBN in increasing Revenue

Building Multi Services IP Network - cisco.com · System Engineers Anyone who ... Video on Demand...

Documents

Transcript of Building Multi Services IP Network - cisco.com · System Engineers Anyone who ... Video on Demand...