Lawrence G. Roberts

CEO Anagran

lroberts@anagran.com

September 2005

Enabling Data-Intensive iGrid Applications with Advanced

Network Technology

Copyright Anagran 2005

Switching Alternatives

Packet Routing Route Every Packet Individually, Queue by Priority – High Cost per bit Single route per destination, 40% utilization, Best Effort QoS

Flow Routing Lookup Flow State, Route if start of flow, Switch rest of flow – Lower cost Multiple routes per destination, 80% utilization, Full QoS

Optical Switching Switch without transceivers. Route by session, No queuing – lowest cost Low utilization for normal traffic, Full QoS

Optical Switched Core Fill Lambda with Flow Router, Select best route per flowFlow Routed Edges High Utilization for all traffic, Full QoS, Lowest Overall cost

Copyright Anagran 2005

Packet, Flow, & Communication Cost Trends

0.001

0.01

0.1

1

10

100

1000

10000

100000

1000000

1965 1970 1975 1980 1985 1990 1995 2000 2005 2010 2015

$/T

era

bit

Cost Trends for Network Components

Flow Routing

Packet RoutingC

omm

unications

DWDM changed the slope of

communications cost

1969 Crossover

when Packet Routing

became cost effective

ARPANET NSFNET COMMERICAL

CSNET

2010 Crossover where Lambdas

become less expensive than

two packet router ports

Uncertainty

INTERNET HISTORY

Copyright Anagran 2005

Router Price with 8 High Speed Ports

0

100

200

300

400

500

600

700

800

1970 1975 1980 1985 1990 1995 2000 2005 2010

$K

.5 Mbps

Economics of Flow Routing vs Packet

8 Ports are of Highest Speed Available in that Year

Flow RoutingPacket Routing

Flow Too Costly Flow Less Expensive

17 Mbps .5 Gbps 15 Gbps 440 Gbps.Router

Capacity

Flow Memory Too Expensive

Flow Lookup Reduces Expense

Copyright Anagran 2005

Flow Routing Improves Trunk Utilization

Total utilization averages 83% with FSA vs. a US Internet average of 27% utilization

• Variance of IP Traffic Very High• Variance is reduced as the Square Root of the rate controlled flows

•IP Packet Router- 16 Queues: Variance reduced 4:1•IP Flow Router- 1 M Flows rate controlled per 10 Gbps: Variance reduced 1000:1

Delay vs Utilization

1

10

100

1,000

10,000

100,000

0 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1

Utilization

De

lay

- M

icro

se

co

nd

s

Flo

w R

outi

ng

Packet Routing

Queuing Formula Results

Copyright Anagran 2005

Flow Routing Allows Multiple Path Load Balancing

This network has 4 equal-cost (3 hop) paths from A to B• A Packet Router must send all A-B traffic on the “best” route (red) to keep packets in order

•The “best” route may change from time to time as the load changes, hurting voice•A Flow Router can send each flow over a different near-equal-cost route (flow in order)

• It can then load balance the network, sending each flow over the best available route• It keeps track of 16 near-equal-cost routes, their load, capacity and jitter• Thus instead of overloading any link, the network can be used to the maximum capacity• If the “best” path changes, but a flow is on a functional path, it need not be move

•This avoids gaps in Voice and Video

A B

Assuming the main load is from

A to B a FSA Router would have twice the capacity

from A-B compared to a packet router

Copyright Anagran 2005

Total Cost of Service - One Hop Lambda, Flow, and Packet Switching

Utilization - Lambda 15%, Packet 40%, Flow 80%, Lambda/Flow 80%

0.01

0.1

1

10

2005 2007 2009 2011 2013 2015

$/Te

rab

it

Total Cost for Switched Communications Service

• Network cost above includes Lambda cost and the router or switch ports at both ends• Lambda (Optical) Switching is considered as zero cost• Utilization varies with each switching method – estimates• Optimal Strategy is to use Optical Switch Core and Flow Routed Edges to raise utilization

Uncertainty

Flow Routing

Packet Routing

Lambda SwitchingIf Lambda

switching achieves 35% utilization, crossover with

packet is in 2005

2011 Crossover where Lambda

Switching becomes less

expensive then Packet Switching

Lambda Core, Flow Edge

Copyright Anagran 2005

Flow Routed Edge Supports Grid into Lambda-NetDWDM

Flow Router

Server

Flow Routers can interconnect at low cost to support >1000 ServersThey support all Level 3 features for security and routingThey provide Guaranteed Rate paths on demand for high throughputThey can route flows on every available near-equal-cost pathPath selection avoids flows interrupting other flowsServer Utilization is typically twice that of packet routingTrunk Utilization is optimized at 80% by routing flows, not sessions or packets

Optical Switched Network