1 Interconnection Networks Charles E. Leiserson 6.896 Theory of Parallel Systems March 29, 2004.

1

Interconnection Networks

Charles E. Leiserson

6.896 Theory of Parallel SystemsMarch 29, 2004

2

“Ideal” Parallel Computer

P+MP+M P+MP+M

P+MP+M P+MP+M

P+MP+M

P+MP+M

P+MP+M

P+MP+M

3


…

PP

PP

PP

PP

MM

MM

MM

MM…

4


5


6


7

Mesh of Trees

8

Mesh of Trees

9

Hypercube

d = 0N = 1

d = 1N = 2

d = 2N = 4

d = 3N = 8

d = 4N = 16

10

Hypercube

010010 011011

000000 001001

110110 111111

100100 101101

11

Cube-Connected Cycles

12

Butterfly (FFT) Network0 1 2 0

000001010011100101110111

000001010011100101110111

13

Butterflies

14

Decomposing a Butterfly

15


16


17


18

Decomposing a Butterfly II

19


20


21


22


23


24


25

Routing on a Butterfly0 1 2 0

000001010011100101110111

000001010011100101110111

26

Tree in Butterfly0 1 2 0

000001010011100101110111

000001010011100101110111

27

Tree in Butterfly0 1 2 0

000001010011100101110111

000001010011100101110111

28

Beneš Network

29

n/2Benešn/2

Beneš

n/2Benešn/2

Beneš

Decomposing a Beneš Network

30

Routing on a Beneš Network

01234567

50746231

31


01234567

50746231

32


01234567

50746231

33


01234567

50746231

34


01234567

50746231

35


01234567

50746231

36


01234567

50746231

37


01234567

50746231

38


01234567

50746231

39


50746231

01234567

40

Bitonic Sorting Network

Hypercube connections!

41

Bitonic Sort on Butterfly

42


43


44


45


46


47


48


49


50


51


52


53


1 Interconnection Networks Charles E. Leiserson 6.896 Theory of Parallel Systems March 29, 2004.

Documents

Transcript of 1 Interconnection Networks Charles E. Leiserson 6.896 Theory of Parallel Systems March 29, 2004.