“VERNE”: New Packet-Optical Network for Optically ...€¦ · 1 © 2017 Nokia “VERNE”: New...
Transcript of “VERNE”: New Packet-Optical Network for Optically ...€¦ · 1 © 2017 Nokia “VERNE”: New...
![Page 1: “VERNE”: New Packet-Optical Network for Optically ...€¦ · 1 © 2017 Nokia “VERNE”: New Packet-Optical Network for Optically Transparent and Lossless Data Centers ONDM](https://reader030.fdocuments.us/reader030/viewer/2022041212/5dd13a19d6be591ccb64d46c/html5/thumbnails/1.jpg)
© 2017 Nokia1
“VERNE”: New Packet-Optical Network for Optically Transparent and Lossless Data CentersONDM 2017• Bogdan USCUMLIC, Dominique CHIARONI• Nokia Bell Labs, Paris Saclay, France• 17-05-2017
![Page 2: “VERNE”: New Packet-Optical Network for Optically ...€¦ · 1 © 2017 Nokia “VERNE”: New Packet-Optical Network for Optically Transparent and Lossless Data Centers ONDM](https://reader030.fdocuments.us/reader030/viewer/2022041212/5dd13a19d6be591ccb64d46c/html5/thumbnails/2.jpg)
© 2017 Nokia2
• Ethernet is the key technology inside of Data Centers
• Can an OPS network provide a costefficient and a performant alternative?
![Page 3: “VERNE”: New Packet-Optical Network for Optically ...€¦ · 1 © 2017 Nokia “VERNE”: New Packet-Optical Network for Optically Transparent and Lossless Data Centers ONDM](https://reader030.fdocuments.us/reader030/viewer/2022041212/5dd13a19d6be591ccb64d46c/html5/thumbnails/3.jpg)
© 2017 Nokia3
• Data Centers requirements:– Cost– Scalability– Latency
• Optical Packet Switching benefits:– Traffic grooming & statistical
multiplexing in the optical domain– Optical transparency of transit traffic
• Question: What are the challenges for OPS networks in data centers???
Key requirements for data centers
![Page 4: “VERNE”: New Packet-Optical Network for Optically ...€¦ · 1 © 2017 Nokia “VERNE”: New Packet-Optical Network for Optically Transparent and Lossless Data Centers ONDM](https://reader030.fdocuments.us/reader030/viewer/2022041212/5dd13a19d6be591ccb64d46c/html5/thumbnails/4.jpg)
© 2017 Nokia4
Problem of OEO conversion
• 2D torus optical packetswitching network
• OEO conversion not completely removed!
![Page 5: “VERNE”: New Packet-Optical Network for Optically ...€¦ · 1 © 2017 Nokia “VERNE”: New Packet-Optical Network for Optically Transparent and Lossless Data Centers ONDM](https://reader030.fdocuments.us/reader030/viewer/2022041212/5dd13a19d6be591ccb64d46c/html5/thumbnails/5.jpg)
© 2017 Nokia5
OPS 2D torus: OEO conversion bottleneck!
O-E-O conversion!
TRX
TRX
TRX
λ 1
λ 2
Alice
Bob
• It would be good to avoidthe OEO conversion!
TRX
![Page 6: “VERNE”: New Packet-Optical Network for Optically ...€¦ · 1 © 2017 Nokia “VERNE”: New Packet-Optical Network for Optically Transparent and Lossless Data Centers ONDM](https://reader030.fdocuments.us/reader030/viewer/2022041212/5dd13a19d6be591ccb64d46c/html5/thumbnails/6.jpg)
© 2017 Nokia6
Problem of contention
• E.g. when sharing the wavelength between severalflows
• Contention problem leads to:- Packet rerouting- Packet delay- Packet loss!
![Page 7: “VERNE”: New Packet-Optical Network for Optically ...€¦ · 1 © 2017 Nokia “VERNE”: New Packet-Optical Network for Optically Transparent and Lossless Data Centers ONDM](https://reader030.fdocuments.us/reader030/viewer/2022041212/5dd13a19d6be591ccb64d46c/html5/thumbnails/7.jpg)
© 2017 Nokia7
• TWIN network: Time-Domain WavelengthInterleavedNetwork
• The scalabilityissue due to wavelengthaddressing
Problem of scalability
![Page 8: “VERNE”: New Packet-Optical Network for Optically ...€¦ · 1 © 2017 Nokia “VERNE”: New Packet-Optical Network for Optically Transparent and Lossless Data Centers ONDM](https://reader030.fdocuments.us/reader030/viewer/2022041212/5dd13a19d6be591ccb64d46c/html5/thumbnails/8.jpg)
© 2017 Nokia8
• Build an OPS network that is:– Optically transparent– Lossless (contention free)– Scalable
• Is this possible?– YES!
Technical challenge
![Page 9: “VERNE”: New Packet-Optical Network for Optically ...€¦ · 1 © 2017 Nokia “VERNE”: New Packet-Optical Network for Optically Transparent and Lossless Data Centers ONDM](https://reader030.fdocuments.us/reader030/viewer/2022041212/5dd13a19d6be591ccb64d46c/html5/thumbnails/9.jpg)
© 2017 Nokia9
• VERNE = "Virtual, fully transparent, costand enERgy efficient NEtwork"
• VERNE network analogy in real life:System of metro lines, without the intermediate stop
VERNE network
Jules VERNE
![Page 10: “VERNE”: New Packet-Optical Network for Optically ...€¦ · 1 © 2017 Nokia “VERNE”: New Packet-Optical Network for Optically Transparent and Lossless Data Centers ONDM](https://reader030.fdocuments.us/reader030/viewer/2022041212/5dd13a19d6be591ccb64d46c/html5/thumbnails/10.jpg)
© 2017 Nokia10 Confidential
VERNE network architecture
• VERNE, a network that reachesthe lower bound on TRX
• Network is covered by a number of "optical buses/rings", that are disjoint sets of wavelengths /fibers
• Any destination can be reached via a single optical hop!
• Time slotted, control channelattributed to each optical bus/ring
• No O-E-O conversion on the intermediate nodes!
• No intermediate queueing => lowerlatency!
![Page 11: “VERNE”: New Packet-Optical Network for Optically ...€¦ · 1 © 2017 Nokia “VERNE”: New Packet-Optical Network for Optically Transparent and Lossless Data Centers ONDM](https://reader030.fdocuments.us/reader030/viewer/2022041212/5dd13a19d6be591ccb64d46c/html5/thumbnails/11.jpg)
© 2017 Nokia11
VERNE network exampleInterconnecting the network with the virtual optical buses
A B C
D E F
A is connected to everybody
B, C are connected to everybody
D, F are connected to everybody
E is connected to everybody
![Page 12: “VERNE”: New Packet-Optical Network for Optically ...€¦ · 1 © 2017 Nokia “VERNE”: New Packet-Optical Network for Optically Transparent and Lossless Data Centers ONDM](https://reader030.fdocuments.us/reader030/viewer/2022041212/5dd13a19d6be591ccb64d46c/html5/thumbnails/12.jpg)
© 2017 Nokia12
• From point of view of the synchronization:
– VERNE I or "synchronous"– VERNE II or "fully synchronous«– VERNE III or "asynchronous«
• From the point of view of the scheduling:– VERNE I: Scheduling per bus – VERNE II: Centralized or opportunistic
scheduling– VERNE III: Centralized scheduling with
central routing point
Different variants of VERNE network
destination
VERNE I
Central pointrouting
VERNE III
individuallysynchronized
individuallysynchronized
networksynchronized
networksynchronized
networksynchronized
VERNE II
individuallysynchronized
![Page 13: “VERNE”: New Packet-Optical Network for Optically ...€¦ · 1 © 2017 Nokia “VERNE”: New Packet-Optical Network for Optically Transparent and Lossless Data Centers ONDM](https://reader030.fdocuments.us/reader030/viewer/2022041212/5dd13a19d6be591ccb64d46c/html5/thumbnails/13.jpg)
© 2017 Nokia13
Comparison of different VERNE variants
Synchronization complexityhighlow
VERNE IIIasychronous
VERNE IPer bus
VERNE IIEntire network
Scheduling complexityhighlow
VERNE IPer bus
VERNE IIcentralized or opportunistic
VERNE IIICentralized with central routing point
![Page 14: “VERNE”: New Packet-Optical Network for Optically ...€¦ · 1 © 2017 Nokia “VERNE”: New Packet-Optical Network for Optically Transparent and Lossless Data Centers ONDM](https://reader030.fdocuments.us/reader030/viewer/2022041212/5dd13a19d6be591ccb64d46c/html5/thumbnails/14.jpg)
© 2017 Nokia14 Confidential
Architecture of the VERNE node
• Node composed of:– Photonic layer– Electrical layer
• Basic blocks:– Demultiplexing & Dropping– Blocking– Switching– Adding & Multiplexing– Optical packet deasembly– Synchronization and control– Optical packet assembly and scheduling– Client adaptation layer
![Page 15: “VERNE”: New Packet-Optical Network for Optically ...€¦ · 1 © 2017 Nokia “VERNE”: New Packet-Optical Network for Optically Transparent and Lossless Data Centers ONDM](https://reader030.fdocuments.us/reader030/viewer/2022041212/5dd13a19d6be591ccb64d46c/html5/thumbnails/15.jpg)
© 2017 Nokia15
Photonic layer realization of the VERNE node
• Dropping by optical splitters• Demultiplexing, packet blocking
and multiplexing by packetblockers
• Switching by Photonic Switch• Adding by couplers
• Different configurations in termof Photonic Switch position
• Control channel for carrying the OAM, synchronization and scheduling related information
![Page 16: “VERNE”: New Packet-Optical Network for Optically ...€¦ · 1 © 2017 Nokia “VERNE”: New Packet-Optical Network for Optically Transparent and Lossless Data Centers ONDM](https://reader030.fdocuments.us/reader030/viewer/2022041212/5dd13a19d6be591ccb64d46c/html5/thumbnails/16.jpg)
© 2017 Nokia16
• Evalute savings in: #TRX, TRX cost, latency, scalability
• Benchmark for the study:– Ethernet Fat Tree– Ethernet 2D torus
• Simple dimensioningalgorithms
• TRX: 100 Gbit/s
Numerical results
![Page 17: “VERNE”: New Packet-Optical Network for Optically ...€¦ · 1 © 2017 Nokia “VERNE”: New Packet-Optical Network for Optically Transparent and Lossless Data Centers ONDM](https://reader030.fdocuments.us/reader030/viewer/2022041212/5dd13a19d6be591ccb64d46c/html5/thumbnails/17.jpg)
© 2017 Nokia17
• Scenario 1:– VERNE vs Ethernet Fat-Tree
data center– No oversubscription– In VERNE, TRXs allocated per
optical buses (no impact of scheduling or synchronization)
• VERNE saves TRX cost up to x4 times
VERNE vs Ethernet Fat-TreeTRX cost comparison
4x costreduction
Ethernet
VERNE
![Page 18: “VERNE”: New Packet-Optical Network for Optically ...€¦ · 1 © 2017 Nokia “VERNE”: New Packet-Optical Network for Optically Transparent and Lossless Data Centers ONDM](https://reader030.fdocuments.us/reader030/viewer/2022041212/5dd13a19d6be591ccb64d46c/html5/thumbnails/18.jpg)
© 2017 Nokia18
VERNE vs Ethernet 2D torusTRX cost comparison
• Scenario 2:- VERNE vs Ethernet 2D torus data
center- Symmetric torus (of dimension N)- Shortest path routing for Ethernet
- In VERNE, TRXs allocated per opticalbuses (no impact of scheduling or synchronization)
• VERNE achieves significantsavings in TRX cost (up to 20 times)
20x costreduction
Ethernet
VERNE
![Page 19: “VERNE”: New Packet-Optical Network for Optically ...€¦ · 1 © 2017 Nokia “VERNE”: New Packet-Optical Network for Optically Transparent and Lossless Data Centers ONDM](https://reader030.fdocuments.us/reader030/viewer/2022041212/5dd13a19d6be591ccb64d46c/html5/thumbnails/19.jpg)
© 2017 Nokia19
• VERNE designed for network virtualization and reconfigurability
• Optical Packet Switching => natural support for the network virtualization
Ease of the network virtualization
Shared TRX
Shared TRX….
….
….….
….
….
TRX
TRX
TRX
TRX
TRX
VERNEnode
![Page 20: “VERNE”: New Packet-Optical Network for Optically ...€¦ · 1 © 2017 Nokia “VERNE”: New Packet-Optical Network for Optically Transparent and Lossless Data Centers ONDM](https://reader030.fdocuments.us/reader030/viewer/2022041212/5dd13a19d6be591ccb64d46c/html5/thumbnails/20.jpg)
© 2017 Nokia20
• Insertion process latency in VERNE can be efficiently reduced by propernetwork dimensioning
Latency in VERNE
Ethernet VERNETraffic insertion YES YESTraffic extraction YES YESTraffic transit (Eth.) YES n.a.
Traffic transit over the same bus/ring
n.a. NO
Traffic transit whenchanging the bus/ring
n.a. NO
Sources of latency and jitter
![Page 21: “VERNE”: New Packet-Optical Network for Optically ...€¦ · 1 © 2017 Nokia “VERNE”: New Packet-Optical Network for Optically Transparent and Lossless Data Centers ONDM](https://reader030.fdocuments.us/reader030/viewer/2022041212/5dd13a19d6be591ccb64d46c/html5/thumbnails/21.jpg)
© 2017 Nokia21
An example of VERNE network with simple scheduling
• A ring VERNE network• TRXs share the same wavelengths
at the reception => Simple FIFO scheduling
• Geo/Geo/1 queueing model => average insertion latency in function of traffic intensity
• Latency limited to few time slots
![Page 22: “VERNE”: New Packet-Optical Network for Optically ...€¦ · 1 © 2017 Nokia “VERNE”: New Packet-Optical Network for Optically Transparent and Lossless Data Centers ONDM](https://reader030.fdocuments.us/reader030/viewer/2022041212/5dd13a19d6be591ccb64d46c/html5/thumbnails/22.jpg)
© 2017 Nokia22
• A scalable solution:– Can be mapped/installed over any physical topology– Node size is reduced, and number of TRX is at minimum– Packet blockers optional or not needed
• E.g. VERNE is more scalable than TWIN network– The optical bus in VERNE can be mapped to a wavelength, but also to a waveband, a fiber or a
fiber core
VERNE: a scalable solution
VERNE I
VERNEII
VERNE III
YESNO XOPTIONAL X X
Use of PacketBlockers
![Page 23: “VERNE”: New Packet-Optical Network for Optically ...€¦ · 1 © 2017 Nokia “VERNE”: New Packet-Optical Network for Optically Transparent and Lossless Data Centers ONDM](https://reader030.fdocuments.us/reader030/viewer/2022041212/5dd13a19d6be591ccb64d46c/html5/thumbnails/23.jpg)
© 2017 Nokia23
• We have shown that VERNE is a good alternative to the Ethernet Fat-Tree and 2D torus data centers
• VERNE network is focused on:– Reducing the TRX number to its minimum– Reducing the network cost– Improving the network latency– Improving the network scalability
Conclusions
![Page 24: “VERNE”: New Packet-Optical Network for Optically ...€¦ · 1 © 2017 Nokia “VERNE”: New Packet-Optical Network for Optically Transparent and Lossless Data Centers ONDM](https://reader030.fdocuments.us/reader030/viewer/2022041212/5dd13a19d6be591ccb64d46c/html5/thumbnails/24.jpg)
THANK YOU !
![Page 25: “VERNE”: New Packet-Optical Network for Optically ...€¦ · 1 © 2017 Nokia “VERNE”: New Packet-Optical Network for Optically Transparent and Lossless Data Centers ONDM](https://reader030.fdocuments.us/reader030/viewer/2022041212/5dd13a19d6be591ccb64d46c/html5/thumbnails/25.jpg)
© 2017 Nokia25
• Definition of cost savingratio 𝛼:
𝛼 =#𝑇𝑅𝑋(𝐸𝑇𝐻)#𝑇𝑅𝑋(𝑉𝐸𝑅𝑁𝐸)
• TRX @ 100 Gbit/sec usedboth for VERNE and Ethernet
• Cost savings for torus: x20 times
• Cost savings for Fat-Tree: x4 times
TRX cost savings of VERNE network
![Page 26: “VERNE”: New Packet-Optical Network for Optically ...€¦ · 1 © 2017 Nokia “VERNE”: New Packet-Optical Network for Optically Transparent and Lossless Data Centers ONDM](https://reader030.fdocuments.us/reader030/viewer/2022041212/5dd13a19d6be591ccb64d46c/html5/thumbnails/26.jpg)
© 2017 Nokia26
Key idea: remove the OEO conversion from the network
OEO conversion removed
No waste of TRX resources for OEO conversion
TRX numberminimized
Size of nodeminimized
We get:1) Cost efficiency2) Energy efficiency3) Scalability4) Latency savings
![Page 27: “VERNE”: New Packet-Optical Network for Optically ...€¦ · 1 © 2017 Nokia “VERNE”: New Packet-Optical Network for Optically Transparent and Lossless Data Centers ONDM](https://reader030.fdocuments.us/reader030/viewer/2022041212/5dd13a19d6be591ccb64d46c/html5/thumbnails/27.jpg)
© 2017 Nokia27
• VERNE can be installed over a pre-existing physical fibertopology
• A key property of VERNE isthe reconfigurability
Reconfigurability of the VERNE network
![Page 28: “VERNE”: New Packet-Optical Network for Optically ...€¦ · 1 © 2017 Nokia “VERNE”: New Packet-Optical Network for Optically Transparent and Lossless Data Centers ONDM](https://reader030.fdocuments.us/reader030/viewer/2022041212/5dd13a19d6be591ccb64d46c/html5/thumbnails/28.jpg)
© 2017 Nokia28
• The SDN controller is responsible for the scheduling of the traffic on any "optical bus"
• The scheduling is based on the dynamic control plane exchange between the SDN controllerand the source nodes
• To reach 100% throughput, it is essential to be in the case of a separable graph (containing a central point or a ring)
VERNE III: the principle of centralized scheduling
![Page 29: “VERNE”: New Packet-Optical Network for Optically ...€¦ · 1 © 2017 Nokia “VERNE”: New Packet-Optical Network for Optically Transparent and Lossless Data Centers ONDM](https://reader030.fdocuments.us/reader030/viewer/2022041212/5dd13a19d6be591ccb64d46c/html5/thumbnails/29.jpg)
© 2017 Nokia29
• Imagine the entire OPS network as a cross bar electronic switch, with N inputs and N outputs• For the separable and F-separable network topologies, 100% throughput scheduling is possible *• Separability means that the delay from any source i to any destination j can be expressed as a
sum of two delays u(i) + v(j), where u(i) is propagation delay to a central hub, and v(j) the propagation delay from it
On the separability of the graphs and its impact on the network operation
Central point graph (star)
Ring graph (F-separability, whereF=RTT)
*Keslassy, I.; Kodialam,M.; Lakshman, T.V.; Stiliadis, D.,"Scheduling schemes for delay graphs with applications to opticalpacket networks," HPSR 2004