EE384M Switch Design

32
EE384M Switch Design Tom Edsall

description

EE384M Switch Design. Tom Edsall. Bus Architecture. FWD. MAC. MAC. MAC. MAC. MAC. MAC. Bus Architecture. FWD. MAC. MAC. MAC. MAC. MAC. MAC. MAC. MAC. MAC. MAC. MAC. MAC. MAC. MAC. MAC. MAC. MAC. MAC. Bus Architecture. MAC. MAC. MAC. MAC. MAC. MAC. MAC. MAC. - PowerPoint PPT Presentation

Transcript of EE384M Switch Design

Page 1: EE384M Switch Design

EE384M Switch Design

Tom Edsall

Page 2: EE384M Switch Design

Bus Architecture

MAC MAC MAC MAC MAC MAC

FWD

Page 3: EE384M Switch Design

MACMACMAC

Bus Architecture

MAC MACMACMACMACMACMAC MACMAC

MACMACMACMAC MACMAC

FWD

Page 4: EE384M Switch Design

Bus ArchitectureMACMACMAC

MACMACMAC

MACMACMAC

MACMACMAC

MACMACMAC

MACMACMAC

FWD

Page 5: EE384M Switch Design

Cross-bar ArchitectureMACMACMAC

MACMACMAC

MACMACMAC

MACMACMAC

MACMACMAC

MACMACMAC

FWD

Page 6: EE384M Switch Design

Cross-Bar Model

FWD

FWD

FWD

MACMACMAC

MACMACMAC

MACMACMAC

MACMACMAC

MACMACMAC

MACMACMAC

Page 7: EE384M Switch Design

Performance Issue with Cross-Bars

Source: M. J. Karol, M.G. Hluchyj, S. P. Morgan, “Input Versus Output Queueing [sic] on a Space-Division Packet Switch”, IEEE Transactions on Communications, Vol COM-35, No 12, December 1987, page 1353

58.6%

Page 8: EE384M Switch Design

3X Speed-up in cross-bar

ClassicCross-Bar2.16Tbps

FIFO 1

FIFO 2

FIFO 3

FIFO 18

20 GbpsEach

60 GbpsEach

FIFO 1

FIFO 2

FIFO 3

FIFO 18

60 GbpsEach

20 GbpsEach

Page 9: EE384M Switch Design

Cross-Bar Model

FWD

FWD

FWD

MACMACMAC

MACMACMAC

MACMACMAC

MACMACMAC

MACMACMAC

MACMACMAC

Page 10: EE384M Switch Design

Data Path

Page 11: EE384M Switch Design

Head of Line Blocking

Stadium

Beer/Soda/Chips

Kwiky Mart

Page 12: EE384M Switch Design

Stadium

Output Queuing

Beer/Soda/Chips

Kwiky Mart

Page 13: EE384M Switch Design

Head of Line Blocking

BCACB

A

B

C

Page 14: EE384M Switch Design

Head of Line Blocking

BCACBCAB

A

B

C

Page 15: EE384M Switch Design

Head of Line Blocking

CB CBCABCB A

A

B

C

Page 16: EE384M Switch Design

A

B

C

VOQ—Virtual Output Queues

BCACB

ARB

Page 17: EE384M Switch Design

VOQ—Virtual Output Queues

BC

AA

A

B

C

ARB

CBCAB

Page 18: EE384M Switch Design

VOQ—Virtual Output Queues

BC

ABACCB

AAA

A

B

C

ARB

Page 19: EE384M Switch Design

Model—Was This

Page 20: EE384M Switch Design

Becomes This

ARB

Page 21: EE384M Switch Design

Completing the Swtich

FWD

FWD

FWD

ARB

Page 22: EE384M Switch Design

Completing the Swtich

ARBFWDMAC

FWDMAC

FWDMAC

MAC

MAC

MAC

Page 23: EE384M Switch Design

Completing the Swtich

Port

ARBFWDMAC

FWDMAC

FWDMAC

MAC

MAC

MAC

Page 24: EE384M Switch Design

Re-Draw

MAC MAC MAC

ARB

FWD FWD FWD

Page 25: EE384M Switch Design

MDS 9500 ImplementationEthFlash

Card Console

Cross-Bar

Supervisor/Fabric

Back Plane

Arb

I/F uP

M M M

F

Q

F

Q

F

Q

I/F uP

M M M

F

Q

F

Q

F

Q

I/F uP

M M M

F

Q

F

Q

F

Q

I/F uP

M M M

F

Q

F

Q

F

Q

uP

Page 26: EE384M Switch Design

ARBFWDMAC

FWDMAC

FWDMAC

MAC

MAC

MAC

Page 27: EE384M Switch Design

ARBREQ

GNT

Credit

Packet

Page 28: EE384M Switch Design

Failures

• Arbitration– Arbiter logic• duplicate arbiters

– Message failure• Cross-bar– duplicate x-bars– load-balance

Page 29: EE384M Switch Design

Scaling further

Linecard Linecard Linecard Linecard Linecard

ARB ARB

Page 30: EE384M Switch Design

Scaling further

Linecard Linecard Linecard Linecard Linecard

ARB ARB

Page 31: EE384M Switch Design

ARBREQ

GNT

Credit

Packet

Packet Spraying

Page 32: EE384M Switch Design

Other Algorithms

• Table lookups• Forwarding• Output Interface (OIF) Lists• Packet Buffering/Queuing• Arbitration between queues• Load balancing• Parsing• Link aggregation