National Internet Backbone II

ENGINEERING INSTRUCTION

INTRODUCTION TO NATIONAL INTERNET BACKBONE-II (NIB-II)

No. NIB-II/I-002

No of Pages. 13

Issue No. 01

Issued By: T&D, Circle

Approved By: CGM T&D Circle

Date of Issue 28-03-2005

Amendment No (If Any) NIL

No of Pages

Issued by:

Approved By:

Date of Issue

Restricted use by BSNL Employees only

All efforts have been made to incorporate all relevant up to date information available, any discrepancies or need for addition or deletion is felt necessary may please be intimated to this office for further improvement, on E-Mail Id [email protected].

BHARAT SANCHAR NIGAM LIMITED (A Govt. of India Enterprise)

TECHNICAL & DEVELOPMENT CIRCLE, SANCHAR VIKAS BHAWAN, RESIDENCY ROAD,

JABALPUR, MP-482001

1

New Technology ENGINEERING INSTRUCTIONS NIB-II/I-002

BHARAT SANCHAR NIGAM LIMITED A Govt of India Enterprises

of 13 Issue

INTRODUCTION TO NATIONAL INTERNET BACKBONE-II (NIB-II)

1. SCOPE

This Engineering Instruction presents an introduction to National Internet Backbone-II (NIB-II) conceived by BSNL to provide infrastructure for providing number of value added services to broadband customers countywide with guaranteed quality of service (QoS).

2. GENERAL

BSNL has planned to setup NIB-II to provide world class infrastructure to offer various value added services to a broader customer base county-wide that will help to accelerate the Internet revolution in India. Moreover the NIB-II will create a platform, which enables e-governance, e-banking, e-learning, etc. with the key point of Service Level Agreements & Guarantee in tune with Global standards and customer expectations.

NIB-II has been grouped into following three major projects. • Project 1: - MPLS based IP Network infrastructure covering 71 cities along with associated

NMS, PMS, Firewall and Caching platforms. • Project 2.1: Access Gateway platform using Dialup comprising of Narrow Band RAS. • Project 2.2: Access Gateway platform comprising of Broadband RAS and DSL equipment. • Project 3: Messaging and Storage platform and Provisioning, Billing and Customer care

and Enterprise management system. The network shall seamlessly integrate with the already existing network infrastructure comprising

of the TCP/IP based NIB-I and MPLS VPN network. The NIB-II project comprises of Technology solutions from different product manufacturers with the provision for future expansion.

2.1 SERVICES PLANNED IN NIB-II

2.1.1 Internet Access i. Dialup access services/ Leased Access Services. ii. Digital Subscriber Line (DSL) Access Services: Broadband “always-on-internet”

access over copper cables. iii. Direct Ethernet Access Services: Broadband “always-on-internet” access using

Fiber-to-the-building.

2.1.2 Virtual Private Network (VPN) Services i. Layer 2 MPLS VPN Services: Point-to-point connectivity between corporate LAN

sites. ii. Layer 3 MPLS VPN Intranet and Extranet Services: LAN interconnectivity

between multiple Corporate LAN sites. iii. Managed Customer Premises Equipment (CPE) Services.

2.1.3 Value Added Services i. Encryption Services: One of the end-to-end data security features. ii. Firewall Services: One of the security features provided to customer. iii. Network Address Translation (NAT) Services: Service that will enable private

users to access public networks.

2.1.4 Messaging Services 2.1.5 Data Centre Services at Bangalore, Delhi and Mumbai

Restricted to Telecom Staff

Date



of 13 Issue

2.1.6 Broadband Services through DSL & Direct Ethernet i. Fast Internet Access Services ii. Terminating Dialup and DSL/Direct Ethernet Customers on MPLS VPNs iii. Multicast Video Streaming Services. iv. Video on Demand Services

3.0 Network Architecture: 3.1 Core Network:

The NIB-II shall constitute an integrated 2-layer IP and MPLS network. The Layer 1 network will constitute the high speed (STM-16) Backbone comprising of Core routers with built in redundancies supporting both TCP/IP and MPLS protocols with link capacities in accordance with the traffic justification. Its function will primarily be limited to high-speed packet forwarding between the core nodes. The A1 nodes (5 locations), A2 nodes (3 locations) and A3 nodes (6 locations) in the NIB-II shall form the Core layer. The five major nodes under A1 category at Mumbai, Bangalore, Delhi, Kolkata and Chennai are configured in the full mesh with link bandwidth of STM-16. The remaining 9 nodes under A2 and A3 category at Pune, Hyderabad, Ahemdabad, Luchnow, Jullundhar, Jaipur, Indore, Ernakulam and Patna are configured in dual mesh with link bandwidths of STM-16, (Refer Figure 1).

Route reflectors are also provided at 4 A1 locations as shown in figure 1, which are fully meshed in the core network of NIB-II. The Route Reflector (RR) provides a mechanism for both minimizing the number of update message transmitted within the Autonomous System (AS), and reducing the amount of data that is propagated in each message. The deployment of Route Reflectors leads too much higher levels of network scalability.

Fig. 1: Core Network Architecture for NIB-II

4.0 Project 1

(MPLS based IP Network infrastructure covering 71 cities along with associated NMS, PMS, Firewall and Caching platforms.)


Date



of 13 Issue

MPLS based network provides a cost effective way to enhance customer networking quality rather than setting up and managing individual point-to-point circuits between each office, customers need to provide only one connection from their office router to a service-provider edge router. The service-provider edge router either forwards the IP packets in the IP network or in the case of MPLS configured access labels the packets and routes them through its MPLS core to the edge closest to destination. IP/TCP connectivity shall be provided through Provider (P) routers and Provider Edge (PE) routers. The city-wise categorization of nodes under NIB-II Proect 1 is given in Table 1. Table 1: City-wise categorization of nodes under NIB-II Project 1 Node type No of Cities Name of cities Devices

A1 5 Chennai, Mumbai, Bangalore, Delhi and Kolkata

Core router - Cisco 12416 Edge Router Cisco 7613

A2 3 Hyderabad, Pune and Ahemdabad


A3 6 Lucknow, Jullundhar, Jaipur, Indore, Ernakulam and Patna


A4 10 Coimbtore, Chadigarh, Allahabad, Guwahati, Ranchi, Bhuvneshwar, Raipur, Manglore, Nagpur, and Vijaivwda

Core router - Juniper M40 Edge Router Cisco 7613

B1 21 -- Edge Router Cisco 7613 B2 26 -- Edge Router Cisco 7613

MPLS based network shall be a 2-layer centrally managed IP backbone network designed to provide reliable routes to cover all possible designations within and outside the country. 4.1 Network Architecture of Project 1:

The Layer - 1 Core network (A1, A2, and A3 cities) shall constitute the high speed Backbone (STM-16) as shown in Figure 1. The Layer - 1 nodes shall consist of high end fully redundant Core routers, and shall be interfaced to Edge routers through Gigabit Ethernet interfaces.

The Layer - 2 Edge network shall be second layer of the IP backbone network and shall primarily support MPLS edge functionality. The function of this layer shall enforce QoS and other administrative policies. This layer shall provide customer access through following three mechanisms,

i. Dialup ii. Dedicated Access iii. Broadband access.

This layer provides connectivity to secure VPNs as well as to Internet Data Centers. Out of total 71Edge routers, 14 are connected to the Core layer locally through the Gigbit Ethernet interfaces at the locations under A1, A2, and A3 category where core routers are provided. Remaining 57 Edge routers at locations A4, B1 and B2 locations are connected to the Core layer remotely through dual homed STM-1 links.

The network is envisaged to provide QoS features associated with MPLS technology with all traffic shaping and traffic engineering features. It shall provide peering interfaces to other domains and shall serve as an Internet Exchange to ISPs. It shall support IP networking and Border Gateway Protocol (BGP)/ Multi Protocol Label Switching (MPLS) technology. The network shall support data, voice and video applications over Layer 2 and Layer 3 MPLS VPNs.

The network architecture of NIB-II provides for integration of other networks such as NIB-I and MPLS VPN of BSNL. It shall provide for a common Network Management System (NMS) and VPN /


Date



of 13 Issue

Bandwidth Provisioning System for the entire integrated IP network infrastructure. The network infrastructure for NIB-II is intended to provide IP network access both on retail as well as wholesale basis to dialup DSL and leased access customers. The network shall provide a common IP infrastructure that shall support all smaller open networks and sub-networks.

4.2 The Primary objectives in setting up the MPLS based IP network • Building a common IP infrastructure that shall support all smaller networks and subnetworks. The

platform is intended to be used for convergent services, integrating data, voice and video and shall be the primary source of Internet bandwidth for ISPs, Corporate, Institutions, Government bodies and retail users.

• Making the service very simple for customers to use even if they lack experience in IP routing, alongwith Service Level Agreement (SLA) offerings.

• Make a service very scalable and flexible to facilitate large-scale deployment. • Capable of meeting a wide range of customer requirements, including security, quality of service

(QoS), and any-to-any connectivity. • Capable of offering fully managed services to customers. 4.3 Caching Platform:

The Caching platform makes the contents (HTTP, MMS, RTSP, FTP etc.) available at the POP/ Core locations and saves upstream International bandwidth. The Caching platform enables faster responses from web.

The web caching solution needs to be deployed at 8 cities with International Gateways. The web caching solution should meet the bandwidth requirements and shall be scalable to future expansions of bandwidth at these locations.

4.4 Services planned to be offered under Project 1:

The following services shall be offered to customers using the MPLS based IP networks.

i.) Layer 3 MPLS VPN Services • Intranet-Managed & Unmanaged • Extranet Managed & Unmanaged • Internet Access services

ii.) Layer 2 MPLS VPN Services • Ethernet over MPLS • Frame relay over MPLS • PPP over MPLS • Cisco HDLC over MPLS (Optional) • VPLS (Virtual Private LAN service) • Layer 2 Any-to-Any Interworking (Except ATM)

iii.) Encryption Services iv.) Multicast Services v.) Firewall Services vi.) Network Address Translation (NAT) Services 5. Project 2

(Access Gateway Platform) The NIB-II Access Gateway platform shall provide Internet Access at any time of the day, from

any place, using any device such as PC, analog phone, wireless or mobile phone or Personal Digital Assistant (PDA). The Access Gateway Platform (AGP) is built around two distinct platforms, one supporting a unified dialing network architecture that delivers voice, data and fax services through an open programmable gateway and the other supporting a unified always-on Internet Access platform on


Date



of 13 Issue

Ethernet-IP. The open programmable dialing gateway is dimensioned to provide 80% plain data RAS and 20% Universal RAS ports. The always-on Internet Access platform is built around the DSL technology using ADSL, SHDSL and VDSL that delivers voice, data and video services over increasingly larger bandwidths directly on Ethernet-IP local networks to residential and corporate users, enabling applications like Broadcast TV, Video on Demand, Pay per View, Content Delivery, Interactive gaming, Music Services, Video-Conferencing, IP-Multicasting Services, Education on Demand, Interactive distant learning, Remote Medical Treatment, GIS based applications, IP PBX, IP Centrex, VoIP, VoDSL, High speed Internet, MPLS VPN etc.

NIB-II Universal Access Gateway infrastructure is conceived as an open infrastructure for carrying various services. The services shall be provided to a representative sample of customers as specified in this document, while using the existing infrastructure for 6.5 lakhs subscribers. All components required for the same shall be part of the supply. The following services are proposed to be provided as part of the scope of work.

(i) Dial VPN/Internet Access service (ii) ADSL, SHDSL & VDSL IP-Ethernet High speed services (0.5 to 50 Mbps over existing

Copper cables) (iii) Wholesale Dial or port retailing service (iv) Internet Call Waiting service (v) IP based Unified Messaging Service (vi) Teleconferencing Service (vii) Internet Telephony Service (viii) Hosted voice services / IP Centrex.

The implementation of the Project 2 shall be deployed in two phases.

• Project 2.1 is for narrow band access • Project 2.2 is for broadband access

Project 2.1: - This project is for the deployment of narrow band services in 71 Cities. Including validation nodes Kolkata (A1), Mumbai (A3), Agra (B1) and Shimla (B2). City-wise classification of Nodes under Project 2.1 of NIB-II is given in Tables 2 and 3. Table 2: City-wise classification of Nodes under Project 2.1 of NIB-II for L2 Bidder

(M/s. UTStarcom Inc.)

Type of

Node

Number of Cities

Name of City

A1 1 Kolkata A2 0 --

A3 5 Jallandhar, Mumbai, New Delhi, Lucknow, Patna, A4 3 Chandigarh, Guwahati,

Ranchi B1 6 Agra, Noida, Jammu, Amritsar, Ludhiyana, Shilong B2 8

Jamshedpur, Durgapur, Siliguri, Dehradun, Ferozpur, Shimla, Ghaziabad, Meerut

Table 3: City-wise classification of Nodes under Project 2.1 of NIB-II for L1 Bidder (M/s. ITI LTD.)


Date



of 13 Issue

Type of

Node

Number of Cities

Name of City

A1 2 Chennai, Bangalore A2 3 Hyderabad, Ahemedabad, Pune

A3 3 Ernakulam, Indore, Jaipur A4 7 Coimbatore, Maangalore, Vijaywada (Krishana),

Bhuvneswar, Raipur, Allahabad, Nagpur B1 15 Madurai, Trivendram, Mysore, Vizag, Bhopal,

Gwalior, Rajkot, Surat, Vadodara, Faridabad, Gurgoan, Kanpur, Varanasi, Jodhpur, Nasik

B2 18 Trichy, Pondicherry, Cannanore, Paldgat, Trichure, Balgaum, Hubli, Kakinada, Cuddapah, Dimapur, Jabalpur, Mehsana, Ambala, Ajmer, Kalyan, Aurangabad, Panjim, Kolhapur

5.1.1 Components of Narrow Band Access Network

• Narrow Band Remote Access Server • LAN Switch • eMS Server

5.2 Project 2.2: (Reference BSNL Let321ter No. 64-28/03-Internet dated 10.08.04) This Project is for the deployment of broadband services in 198 cities with 69 important cities where Digital Subscriber Line Access Multiplexer (DSLAM) shall be deployed. The cities are categorized under A1 (3 cites), A2 (3 cites), A3 (6 cites), A4 (10 cites), B1 (21 cites), B2 (26 cites), and others (129 cities). Delhi and Mumbai will not have any broadband equipment under Project 2.2 of NIB-II.

5.2.1 Services planned through Project 2.2 • Primary source of Internet bandwidth for retail users for application such as Web

brousing, e-commerce etc • Multicast video services, video on demad etc through Broadband Remote Access Server

(BRAS). • Allow wholesale BRAS ports to be assigned to smaller ISPs through the franchises model

wherein the later has a separate network of DSLAMs, AAA, LDAP through a revenue scheme of BSNL.

• Dialup VPN (VPDN) user connects to NIB-II through the Narrow band RAS and is connected to its private network through a secure L2TP tunnel established between Narrowband RAS and Broadband RAS.

• Support for both prepaid and postpaid Broadband services.

5.2.2 Components of Broad Band Access Network • Broad Band Remote Access Server (BBRAS) • Gigabit and Fast Ethernet Aggregation Switches (LAN Switches) • Digital Subscriber Line Access Multiplexers (DSLAMs) • SSSS/SSSC (Subscriber Service Selection System/ Centre) • Servers for AAA, LDAP at Pune • Provisioning and configuration management at NOC

The city-wise deployment of DSLAM is given in Table 4.


Date



of 13 Issue

Table 4: DSLAM deployment plan in 198 cities

DSLAM capacity requirement city wise City Type

No of Cities 480 240 120 64 48 24

Total DSLAM per city

Total DSLAMs

A1 3 70 60 50 20 0 0 200 600 A2 3 35 30 25 10 0 0 100 300 A3 6 21 25 18 6 0 0 70 420 A4 10 12 14 8 6 0 0 40 400 B1 21 2 3 6 4 0 0 15 315 B2 26 0 2 3 3 0 0 8 208

Others 129 0 0 0 0 1 2 3 387 198 2630

5.2.3 Network Architecture of Project 2.2

All 198 cities will have DSLAMs and Tier2 LAN switches (for aggregation of DSLAM). All A cities and Noida (Total 23 cities) will have one BRAS, one SSSS and one Tier 1 LAN switch. There will be no BRAS, SSSS and Tier 1 LAN switch in any other cities. All DSLAM are initially aggregated using Tier 2 LAN switch, through one pair of dark fibre. The broadband connectivity in A cities and B cities is shown in Figure 2 and Figure 3 respectively. The 240 port DSLAM will have two numbers of FE interfaces. The FX or GBIC module in DSLAM and LAN switch should be capable of driving up to 10kms on a single mode fibre. The SX or GBIC module in LAN switch used for connecting Tier2 to Tier1 will support 40kms distance. In bigger cities like A1, A2, A3 and A4, one BRAS per city will be deployed initially. There will be no BBRAS at B1 and B2 cities. The DSLAMs in B1, B2 and other lower hierarchical cities will be aggregated through Layer 2 switches, and will be connected to the nearest BRAS of A cities on Ethernet over SDH. The BRAS shall terminate the PPP sessions initiated by the customer and extend the connection further to MPLS VPN/Internet as desired by the customer. The DSLAM will in general be colocated with existing PSTN exchange, which provides last mile access to customers over copper wire up to average span lengths of 3 kms. All DSLAM will be aggregated through Fast Ethernet (FE) interface except 480 port DSLAM, which will be aggregated through Gigabit Ethernet (GigE) interface.


Date



of 13 Issue

Fig. 2: Broadband connectivity Diagram in A cities

Fig. 3: Broadband connectivity Diagram in B cities

5. Project 3:


Date



of 13 Issue

[Messaging and Storage Service Platform, Provisioning, Billing & Customer care, Enterprise Management System (EMS) and Security System.]

The Core messaging system shall be the heart of NIB-II that will enable BSNL to add users across varied value added services. This shall envisage design and up-gradation of the current messaging system to grow from the existing infrastructure in NIB-I supporting 650,000 users to support increasing user base. The messaging systems and associated Storage will be implemented in phases, in accordance with phased induction of Access equipment. The system shall be an integrated provisioning, billing, customer care and accounting platform and shall support billing for the complete range of IP based services mentioned and meet next-generation requirements as well. The salient aspects of the projects are summarized as follows: (i) Setting up proven, robust, scalable Messaging Solution with best in class security

components. (ii) Roll out across the country supported by 5 Messaging & associated storage systems at Delhi,

Mumbai, Bangalore, Chennai and Kolkata. (iii) Designed with High Availability architecture with no single point of failure.

6.1 Components of the Solution:

The proposed solution shall consist of the following components with the items of functionality listed below:

(i) Messaging a) DNS, AAA b) MMP c) LDAP (Consumer, Replicator Hub, Primary and Secondary) d) SMTP IN & OUT e) Messaging Servers f) Address Book Servers, etc.

(ii) Storage a) SAN Switch & SAN Storage b) Tape Library c) Staging Servers, etc.

6.2 Storage platform

i. Various Applications servers placed at the 5 Messaging Storage locations like LDAP, AAA, EMS, Messaging, UMS & Billing etc. would require Data storage capacities for storing User’s mailboxes, Billing data etc. Such huge storage requirements need to be met with the Fast, Reliable & Scalable storage devices that would be deployed as “End to End High Performance Switched Architecture Fiber Channel SAN (Storage Area Networks) providing No Single Point of Failure”.

ii. Such storage device should be compatible with all the Servers of major companies such as HP, IBM, SUN, Dell etc. so that choice of Application Servers Platform remains independent of the storage device.

6.2 System Dimensioning:

The user base will be serviced through 5 Messaging and associated Storage systems that will be set up in the 5 cities. Each of the cities will be connected through the IP Backbone. Since the proposed user base is envisaged to increase in a phased manner the associated messaging system is also proposed to be upgraded in phases correspondingly.


Date



of 13 Issue

6.3.1 The system should be designed to support: (i) On-line services such as Internet, pay-per-view TV and video on demand or a combination of

all or some of the above. (ii) Periodic charges, such as telephone line and cable TV rental. (iii) One-time costs, such as connection fees. (iv) Events, such as telephone calls, data service usage, pay-per-view TV selections, home

shopping purchases, utility metered usage – such as electricity supply (live site example) (v) Financial services ASP services. (vi) Telephony services. (vii) Enterprise Backup Systems. 6.3.2 The billing system shall be capable of

i. Providing electronic versions of bills to customers over the Internet. ii. Creation/modification of service.

iii. Processing Service requests in real time and non-real time and accounting in real time. iv. Producing flexible billing depending upon the use of service.

6.3.3 Security Systems These include the following. i. Load Balancers ii. Firewall Appliances iii. Intrusion Detection System iv. Antivirus system, etc.

7.0 Network Operation Center (NOC)

The NOC shall provide facility for centralized Network Management and end-to-end Provisioning of multiple services, giving a single view of the entire network services being delivered countywide. The servers for the NOC shall be connected through a Gigabit Ethernet link from Core router with three zones of firewall within the Centre.

The network shall be centrally managed from Network Operation Centre NOC located at two sites, one of them being master and the other the disaster recovery site. The main NOC is at Bangalore with Disaster Recovery is at Pune. Interface to the NMS back-office facility shall be provided along with Firewall security in the Data Centre. All customer databases shall reside centrally at NOC.

The NMS of NIB-II project 1 is the comprehensive NMS for entire NIB-II including NIB-I, MPLS VPN, Project 2.1, Project 2.2, which will support entire F (Fault), C (Configuration), A (Accounting including Access/Inventory), P (Performance) and S (Security functionality). The conceptual view of eMS, NMS OSS/BSS for NIB-II is given in figure 4 and the connectivity Architecture of NOC at Bangalore is shown in figure 5.


Date



of 13 Issue

Fig. 4: Conceptual view of eMS, NMS, EMS OSS/BSS for NIB-II

Fig. 5: Bangalore NOC Connectivity Architecture.

7.1 Service Level Agreement (SLA): It shall be possible to support SLA i.e. the level of service that the customer can expect together

with any penalties to be levied by the service provider for failure to deliver. It should be possible to


Date



of 13 Issue

provide at least 4 classes of services. The SLA parameters shall include measurements of service delivery, availabilty, latency, throughput and restoration time etc. it should be possible to generate management reports providing information on customer node configuration and charges, faults and achievement against the SLAs. It shall be possible to deliver network management reports via a secure Website.

8.0 CONCLUSION: The installation and commissioning of project 1, project 2 under NIB-II is under progress and the centralized billing and provisioning management is planned in project 3.


Date

National Internet Backbone II

Documents

Transcript of National Internet Backbone II