Towards a N ation-wide F ibre F ootprint in R esearch and E ducation N etworking

Research Department www.ces.net

Towards a Nation-wide Fibre Footprint in Research and Education Networking

Lada Altmannova

Stanislav Sima

Rhodes June 9th, 2004


Towards a Nation-wide Fibre Footprint in RENs 2

Research Department TERENA Networking Conference www.ces.net

Situation in REN design Network design is on the top of design levels hierarchy:

ICs, cards/units, computers, networks, and is relatively new. WAN/MAN design is still less developed (mainly in consequence of previous long-term monopolies).

Traditional building elements (procured) are data transmission services, routers, terminals, etc.

Traditional network function is to provide best effort IP connectivity

New building elements: dark fibres, optical transmission equipment, switches

New network function: provide E2E circuits




Multi-vendor network design Multi-vendor networking is necessary for

feasibility in multiple domain Multi-vendor networking is necessary in general

case for cost effectiveness also in single domain Standards, Multi-Source Agreements (MSA),

interoperability, etc. gives you independence on one vendor (in design, reparation, upgrade, etc.) and allows you to buy best equipment in each category




Fibre is strategic asset Fibre infrastructure has been recognised as

strategic asset for research and education networking– In some countries, states or regions in Canada,

Europe and USA since 2000 – In USA (national scale) since 2003– in EU (union scale) since 2004 (GN2)

Customer Empowered Fibre (CEF) networks are emerging technology, that gradually changes network topology, architecture and services from bottom of hierarchy to top




Lengths of dark fibres in RENs More than 20 000 km in Europe

(plus some fibres for GN2 and GN2 testbed) About 33 920 km in USA

(including National LambdaRail) About 6 700 km in Canada NFF contracted in Australia ….




CEF Networks and industry support

Government support of network research should prepare investment opportunity and should support national/federal/union industry development

Traditionally this means support of carriers and router vendors

For CEF Networks this means rather support of fibre cable vendors, companies laying fibre cables with maintenance, transmission equipment vendors etc.

Optronics vendors now are becoming aware of the non-carrier (enterprise, RENs) market for their gear

= CEF Networks brings new relation between network research and vendors




Economics decides Dark fibres brings progress to REN design and subsequently to

WAN design generally (and than in competition winner takes nearly all)

Strategic importance of getting fibres has been recognised Comparison of temporary dark fibre and lambdas prices is usable

for very partial view only and cannot solve problem in general. Economics decides, but not naïve economics.

Some reasons: uncertain number of lambdas, period of using, future upgrade of the transmission rate, topology changes, uncertain future economical conditions, unexpected new possibilities, …

Actual result: some managers build CEF Networks and others study the problem…




Why dark fibre for RENs ? Freedom in REN design Getting fibre means controlling the network Independence on carriers and on router vendors Fixed costs of long-term use Transmission capacity up to Tbps Cost-effective ways of fibre sharing (WDM, TDM, …) Expensive dark fibres can be shared by non-profit partners Multiple wavelengths possible (e.g. 1 – 256) Multiple fibres in cable, multiple ducts in way… Equipment selection, moving, design, …..




How to go from telco services to dark fibres Procure dark fibre independently and before lambdas

procurement Prefer agreements on long term lease with discounts instead of

IRU (disadvantages of IRU are prepayment, taxes and risk of bankruptcy)

Do not relay on one provider only, maintain concurrency (for price and for first mile acquiring)

If price is not excellent, use annual contracts and re-procurement If dark fibre line is not offered but exists, use annual contract for

lambda(s) and re-procure dark fibre




Dark fibre deployment in RENs Increasing and world-wide deployment of dark fibre

(acquisition of dark fibres instead of SDH or lambda services) – without moving back

Increasing number of customer premises connected by fibre: to achieve this is more difficult problem than intercity fibre acquisition

Lease of fibres: good prices are 0.4 Euro/m/pair/year for G.652 or 0.5 Euro/m/pair/year for G.655 , including maintenance

Building first mile 12 fibre lines: about 30 Euro/m in ground (6 month for delivery), and about 10 Euro/m in air (3 month for delivery)




CEF network architecture will be new Prefer network architecture with NIL (single span) lines

and without overlaying (concurrent) fibres KIS rule for fibres: Keep It Short, including

connections crossing state borders Realization of lambdas by own equipment and fibres

for long distance data transmission Search actively for new fibre providers (railways, roads

and highways, electric power, fuel, gas and heat distribution companies, cable TV companies, etc.)

Search actively for regional authorities and local boards cooperation on laying first mile fibre cables




Photonic Air Links (PAL) Gigabit transmission rates are possible in free space Customer Empowered Photonic (CEP) Networks are

expected: fibre+PAL PAL is used usually between buildings (fan-out of

photonic transmission to end users in some area) Transmission rate: from 10 Mbps up to 2.5 Gbps,

distance 100 m – 4000 m, costs 1500 – 30 000 Euro DIY solution of PAL 10 Mbps (for example for

students to home – costs 150 Euro) Microwave backup (probably up to 622 Mbps) of PAL

(on L1 level) is possible – e. g. for foggy weather




Dark fibre lighting register: see before new line design

Country A B kmAttenuation (dB at 1550nm) Fibre/Pair Planed

Experi- mental Operational Transmission Equipment

CZ Praha Brno 285,8 66,7 Pair X2x Keopsys 27 dBm + Raman laser +optical filter, CGBIC

CZ Praha Plzeň 159,4 36,7 Pair X EDFA 2in1 booster 17 dBm + preamplifier -10dBm + optical filter, 2x GBIC ZX

CZ Praha Brno 326,7 81 Pair 10.1.2000 3x ONS15104CZ Praha Liberec 200 Pair XCZ Praha Pardubice 188,6 46,03 Pair 17.5.2002 Keopsys 2x 21 dBm , 2x GBIC ZXCZ Praha Plzeň 123 33,72 Pair 3.9.2003 Keopsys 2x 10dBm, POS LR 2,5GCZ Praha Ústí n.L. 155,3 36,8 Pair 6.12.2003 Catalyst switch in line, 2x CGBICCZ Brno Olomouc 107 27,5 Pair 25.11.2003 2x CGBIC

CZ Brno Ostrava 235,4 50,55 Pair 6.6.2003 Keopsys 2x 27dBm+2x 10dBm+2x CGBIC

CZ Č.B. Brno 307,9 69,76 Pair 15.9.2003Keopsys 2x 27dBm+2x 10dBm in line, POS LR 2,5G

CZ Č.B. Plzeň 178,3 40,78 Pair 25.7.2003 Keopsys 2x 24dBm, POS LR 2,5GCZ Olomouc Hradec K. 197,4 42,96 Pair 1.2.2004 Keopsys 2x 27dBm, POS LR 2,5GCZ Olomouc Ostrava 189,8 43,51 Pair 1.2.2004 Keopsys 2x 27 dBm, 2x CGBICCZ Olomouc Zlín 71,5 22,46 Pair 19.2.2003 2x CGBICCZ Pardubice Hradec K. 30 7,5 Pair 15.1.2002 2x GBIC ZXCZ Ústí n L. Liberec 123 26,23 Pair 30.6.2003 2x CGBIC

CZ Č.B. J. Hradec 70,7 18,41 Fibre 17.8.2003MRV 2x EM 316WFC/S4 & WFT/S4, 40-100km

CZ Ostrava Karviná 76,7 20,27 Fibre 24.7.2003MRV 2x EM 316WFC/S4 & WFT/S4, 40-100km

CZ Ostrava Opava 49,9 18,22 Fibre 26.3.2003MRV 2x EM 316WFC/S4 & WFT/S4, 40-100km

CZ Plzeň Cheb 126,5 35,65 Fibre 16.7.2003MRV 2x EM 316WFC/S5 & WFT/S5, 40-125km

CZ Ústí n L. Děčín 34 8,6 Fibre 1.7.2003MRV 2x EM 316WFC/S3 & WFT/S3, 20-50km




NFF in European NRENs Switzerland

– SWITCH: NFF operational, 1150 km, transmission system with own development (NIL on single fibre)

The Czech Republic– CESNET2: NFF operational, 2800 km, transmission

system with own development (long distance NIL)

– CzechLight: 445 km DF with experimental traffic

Poland– PIONIER: NFF 2648 km plus 1426 km own and leased

fibres operational, plus 2300 km in negotiation

– 10GE DWDM transmission system operational




NFF in European NRENs II. Ireland

– HEAnet : 1300 km fibres available, operational part, support of optical networking abroad

The Netherlands– SURFnet6: 4000 km fibres available, operational part with

DWDM transmission system, new approach on NREN architecture (central routers only)

Slovakia– SANET: NFF operational, 1660 km own and leased fibres, GE

transmission system, partially CWDM 4 x GE Serbia

– RCUB: 115 km operational, contracted 1400 km with telco operator (with government support), GE transmission system, CWDM testing




NFF in European NRENs III. Portugal

– FCCN : Tender for 400 km dark fibre Denmark

– UNI-C : 525 km dark fiber for testing, 10 GE Norway

– using or sharing of nation-wide dark fibre available (by agreement with telco operator)

See reference to CEF Networks workshop for more details Metropolitan dark fibre RENs in Netherlands, Poland,

Czech Rep., Greece, Hungary, Ireland, …..




Cheaper International Fibre Footprint (IFF) KIS: Connect dark fibres used by NREN by a

short cross-border fibre lines (called also Near over Border - NoB)

Use WDM equipment on national and cross-border fibres for implementation of international lambdas between end users

This KIS approach avoids some double payments of fibres or lambdas (parallel lines are paid by NREN and DANTE), in the biggest item of budgets

Such change of networking strategy is difficult, needs research and testbeds




KIS for cheaper architecture Connection of NRENs by short dark fibre (Keep It Short)

between NREN PoPs or Users Near over Border (NoB) NoB dark fibres (lenght, status):

– Bratislava (Slovakia)–Vienna (Austria): 104 km, operational– Bratislava (Slovakia)–Brno (Czech Rep.): 182 km,

operational– Ostrava (Czech Rep.)-Bialsko-Biela (Poland): 136 km,

available– Subotica (Serbia)-Szeged (Hungary): 40 km, available– Kista in Stockholm (Sweden)-Ventspils (Latvia): 405 km,

experimental university connection, undersea part Other lines are prepared




Examples (see GÉANT topology) Short dark fibres Brno – Bratislava – Vienna and

Ostrava –Bialsko-Biala gives possibility to realize lambdas Prague – Bratislava, Prague – Vienna, Poznan – Vienna, Prague – Poznan etc.

Lambda services London – Stockholm and Poznan – Stockholm could be realized by means of connections London – Brussels – Amsterdam – Copenhagen – Stockholm and Poznan - Copenhagen




PC Light Design Kit for wide area fibre networks, based on

racked PCs with build-in optical amplifier modules Multi-vendor (multi-source) building elements Preliminary comparison of OA (EDFA) costs:

– OA from „ISP vendor“: 40 000 USD– OA from „optical vendor“: 18 000 USD– OA from „module vendor“: 2 500 USD (two OA in module)– OA from Integrated Circuit vendor: ??? (forthcoming)

OA costs are the biggest item in long distance transmission systems costs (e.g. 60%)

=> PC Light helps to radically change WAN/MAN costs




EDFA 2in1: PC Light equipment example PC with build-in OA EDFA booster and preamp Successfully used for NIL GE connection from Plzen

to CzechLight in Prague by dark fibre pair (159.4 km, 36.7 dB) since May 2004

One Side Amplification (OSA NIL approach): this equipment is placed in Prague only. No OA equipment is placed in Plzen, so we expect lower service costs and higher availability (we have 24/7 staff in Prague only)

Advantages: low cost, low size (1U), low power consumption, Linux, SNMP, reach up to 225 km, possibility of development, ….




EDFA 2in1: EDFA Module in Standard 1U PC with Linux

Alarm LEDs

BO IN

IDE +5V DCRS 232

PA OUT

BO OUT

FERS232C

USB * Network boot is also possible

PA IN

MicroATX MainBoard with

fanless CPU

Power Supply

Flash disc*

Low NF preamplifier

Booster




PC Light forthcoming EDFA 2in1 works on 10 GE (tested in

laboratory) GE interface card on 1550 nm GE interface card for bidirectional

transmission on single fibre etc.




Lighting of dark fibre: NIL approach Production lines G.652, 1550 nm, EDFA

189 km Praha – Pardubice GE since May 2002

235 km Brno – Ostrava GE since June 2003 Experimental lines G.652, 1550 nm, EDFA

235 km Brno – Ostrava OC-48 June 2003

286 km Praha – Brno GE May 2004 (+Raman) More wavelengths possible




NIL tests in laboratory G.652 fibre spools, EDFA + Raman:

325 km GE

250 km OC-48

252 km 2x 10 GE

290 km 10 G DWDM

G.655 fibre spools (recently delivered): testing lower cost of dispersion compensation on 10 Gbps




Prepared CzechLight PoP in Brno Fibre Praha - Brno 298.3 km,

including 257.3 km of G.655 fibre. DWDM 10 Gbps cards for Cisco

15454 NIL transmission, if possible June – July 2004




Global Lambda Integrated Facility (GLIF)

• Environment for co-operation:networking, infrastructure, network engineering, system integration, middleware, applications

• GLIF was established by invited participants at the 3rd Global Lambda Grid Workshop, held August 27, 2003 in Reykjavik, Island, www.glif.is

• Dark fibres are often used for Gigabit or 10 Gigabit access to cities and university premises




CzechLight May 2004




Prepared CzechLight connections




References Presentations from CEF Networks Workshop, Prague,

May 2004 http://www.ces.net/project/optsit/CEFNetworks/

Dark fibre Sweden-Latvia www.balticopen.net




Example from BalticOpen

Ventspils

Ventspils NaftaFårösund

Utö

Stockholm




Acknowledgement Jan Gruntorad for support and GLIF entry Miroslav Karasek and Jan Radil for lighting of

CESNET2 and CzechLight fibres Josef Vojtech for EDFA 2in1 development

Comment: presented ideas and opinions are result of our ongoing R&D activities and are opened to improvement

Towards a N ation-wide F ibre F ootprint in R esearch and E ducation N etworking

Documents

Transcript of Towards a N ation-wide F ibre F ootprint in R esearch and E ducation N etworking