ne24.24M 24 Bit Digital Multiple Channel Matrix Processor ...
Multiple processor (ppt 2010)
-
Upload
arth-ramada -
Category
Education
-
view
4.279 -
download
2
description
Transcript of Multiple processor (ppt 2010)
![Page 1: Multiple processor (ppt 2010)](https://reader033.fdocuments.us/reader033/viewer/2022051610/548dbae1b47959e20c8b66dd/html5/thumbnails/1.jpg)
Free Powerpoint TemplatesPage 1
Free Powerpoint Templates
Multiple Processor System
Prepared by:Arth B. RamadaCristy R. Peralta
![Page 2: Multiple processor (ppt 2010)](https://reader033.fdocuments.us/reader033/viewer/2022051610/548dbae1b47959e20c8b66dd/html5/thumbnails/2.jpg)
Free Powerpoint TemplatesPage 2
Introduction
• The computer industry has been driven by an endless quest for more and more computing power.
• Making computer this small may be possible, but then we hit another fundamental problem: HEAT DISSIPATION• The faster the computer runs, the more heat it
generates• The smaller the computer, the harder it is to
get rid of this heat.
![Page 3: Multiple processor (ppt 2010)](https://reader033.fdocuments.us/reader033/viewer/2022051610/548dbae1b47959e20c8b66dd/html5/thumbnails/3.jpg)
Free Powerpoint TemplatesPage 3
Introduction
• One approach to greater speed is through massively parallel computers.
• A system consisting of 1000 computers spread all over the world is no different than one consisting of 1000 computers in a single room. Although the delay and other technical characteristics are different.
![Page 4: Multiple processor (ppt 2010)](https://reader033.fdocuments.us/reader033/viewer/2022051610/548dbae1b47959e20c8b66dd/html5/thumbnails/4.jpg)
Free Powerpoint TemplatesPage 4
Multiprocessor Systems
( a ) Shared-memory multiprocessor ( b ) Message-passing multicomputer ( c ) Wide area distributed system
![Page 5: Multiple processor (ppt 2010)](https://reader033.fdocuments.us/reader033/viewer/2022051610/548dbae1b47959e20c8b66dd/html5/thumbnails/5.jpg)
Free Powerpoint TemplatesPage 5
MULTIPROCESSOR
Definition:
• A computer system in which two or more CPUs share full access to a common RAM
• The CPU can write some value into the memory and then read the word back and get a different value.
![Page 6: Multiple processor (ppt 2010)](https://reader033.fdocuments.us/reader033/viewer/2022051610/548dbae1b47959e20c8b66dd/html5/thumbnails/6.jpg)
Free Powerpoint TemplatesPage 6
• UMA (Uniform Memory Access) Multiprocessors
• UMA Bus-Based SMP Architecture
• UMA Multiprocessors using Crossbar Switches
• UMA Multiprocessors using Multistage Switching Networks
• NUMA (NonUniform Memory Access) Multiprocessor
MULTIPROCESSORS:
MULTIPROCESSOR HARDWARE
![Page 7: Multiple processor (ppt 2010)](https://reader033.fdocuments.us/reader033/viewer/2022051610/548dbae1b47959e20c8b66dd/html5/thumbnails/7.jpg)
Free Powerpoint TemplatesPage 7
MULTIPROCESSORS:
UMA Bus-Based SMP Architectures
( a ) without caching( b ) with caching( c ) with caching and private memories
![Page 8: Multiple processor (ppt 2010)](https://reader033.fdocuments.us/reader033/viewer/2022051610/548dbae1b47959e20c8b66dd/html5/thumbnails/8.jpg)
Free Powerpoint TemplatesPage 8
• Two or more CPUs and one or more memory modules all use the same BUS communication.
• If the bus is busy when a CPU wants to read or write on memory, the CPU just waits until the bus becomes idle.
MULTIPROCESSORS:
UMA Bus-Based SMP Architectures
![Page 9: Multiple processor (ppt 2010)](https://reader033.fdocuments.us/reader033/viewer/2022051610/548dbae1b47959e20c8b66dd/html5/thumbnails/9.jpg)
Free Powerpoint TemplatesPage 9
• There will be much less bus traffic, and the system can support more CPUs.
• If the CPU attempts to write a word that is in one or more remote caches, the BUS hardware detects the write and puts a signal on the informing all other caches of the write
MULTIPROCESSORS:
UMA Bus-Based SMP Architectures
![Page 10: Multiple processor (ppt 2010)](https://reader033.fdocuments.us/reader033/viewer/2022051610/548dbae1b47959e20c8b66dd/html5/thumbnails/10.jpg)
Free Powerpoint TemplatesPage 10
• The compiler should place all the program text, strings, constants and other read-only data & local variables in the private memories
• The shared memory is then only used for writable shared variables.
MULTIPROCESSORS:
UMA Bus-Based SMP Architectures
![Page 11: Multiple processor (ppt 2010)](https://reader033.fdocuments.us/reader033/viewer/2022051610/548dbae1b47959e20c8b66dd/html5/thumbnails/11.jpg)
Free Powerpoint TemplatesPage 11
MULTIPROCESSORS:
UMA Multiprocessors using Crossbar Switches
• CROSSPOINT – is a small switch that can be electrically opened or closed.
![Page 12: Multiple processor (ppt 2010)](https://reader033.fdocuments.us/reader033/viewer/2022051610/548dbae1b47959e20c8b66dd/html5/thumbnails/12.jpg)
Free Powerpoint TemplatesPage 12
• The nicest properties of the crossbar switch is that it is a NONBLOCKING NETWORK.
“No CPU is ever denied the connections its needs”
• The worst properties of the crossbar switch is the fact that the number of crosspoints grows (n2).
MULTIPROCESSORS:
UMA Multiprocessors using Crossbar Switches
![Page 13: Multiple processor (ppt 2010)](https://reader033.fdocuments.us/reader033/viewer/2022051610/548dbae1b47959e20c8b66dd/html5/thumbnails/13.jpg)
Free Powerpoint TemplatesPage 13
MULTIPROCESSORS:
UMA Multiprocessors using Multistage Switching Network
2x2 switch Message format
• Message Format• Module It tell which memory to use.• Address It specifies an address within a module• Opcode Gives the operation, READ or WRITE• Value Contain an operand.
![Page 14: Multiple processor (ppt 2010)](https://reader033.fdocuments.us/reader033/viewer/2022051610/548dbae1b47959e20c8b66dd/html5/thumbnails/14.jpg)
Free Powerpoint TemplatesPage 14
Number of Stages = (Log2n)Number of Switches per Stage = (n/2),Total Switches = (n/2)Log2n
Omega Switching Network
MULTIPROCESSORS:
UMA Multiprocessors using Multistage Switching Network
![Page 15: Multiple processor (ppt 2010)](https://reader033.fdocuments.us/reader033/viewer/2022051610/548dbae1b47959e20c8b66dd/html5/thumbnails/15.jpg)
Free Powerpoint TemplatesPage 15
• NUMA Machines 3 Key Characteristics:– There is a single address visible to all CPUs– Access to remote memory is via LOAD and STORE instructions– Access to REMOTE MEMORY is slower than access to LOCAL
MEMORY
• NC-NUMA (No Caching) - access time to remote memory is not hidden
• CC-NUMA (Cache-Coherent) – caches are present.
MULTIPROCESSORS:
NUMA Multiprocessors
![Page 16: Multiple processor (ppt 2010)](https://reader033.fdocuments.us/reader033/viewer/2022051610/548dbae1b47959e20c8b66dd/html5/thumbnails/16.jpg)
Free Powerpoint TemplatesPage 16
• Directory-Based Multiprocessor - It Maintain a database telling where each cache is and what its status is.
MULTIPROCESSORS:
NUMA Multiprocessors
![Page 17: Multiple processor (ppt 2010)](https://reader033.fdocuments.us/reader033/viewer/2022051610/548dbae1b47959e20c8b66dd/html5/thumbnails/17.jpg)
Free Powerpoint TemplatesPage 17
Each CPU Has Its Own Operation System • The memory divide into as many partition as there are
CPUs and give each CPU its own private memory and its own private copy of Operating System
MULTIPROCESSORS:
Multiprocessor Operating SystemTypes
![Page 18: Multiple processor (ppt 2010)](https://reader033.fdocuments.us/reader033/viewer/2022051610/548dbae1b47959e20c8b66dd/html5/thumbnails/18.jpg)
Free Powerpoint TemplatesPage 18
Master-Slave Multiprocessors• There is one copy of the operating system and its
table are present to CPU1.• All system calls are redirected to CPU1
MULTIPROCESSORS:
Multiprocessor Operating SystemTypes
![Page 19: Multiple processor (ppt 2010)](https://reader033.fdocuments.us/reader033/viewer/2022051610/548dbae1b47959e20c8b66dd/html5/thumbnails/19.jpg)
Free Powerpoint TemplatesPage 19
Symmetric Multiprocessors (SMP)• There is one copy of the OS in memory but any CPU can
run it.• If the two CPU simultaneously picking the same process to
run the same memory page. It associate a MUTEX(Lock) with OS.
MULTIPROCESSORS:
Multiprocessor Operating SystemTypes
![Page 20: Multiple processor (ppt 2010)](https://reader033.fdocuments.us/reader033/viewer/2022051610/548dbae1b47959e20c8b66dd/html5/thumbnails/20.jpg)
Free Powerpoint TemplatesPage 20
MULTIPROCESSORS:
Multiprocessor Synchronization
• TSL (Test and Set Lock) Instruction – TSL instruction must first lock the bus, preventing other CPUs from accessing, then both memory accesses, then unlock the bus
![Page 21: Multiple processor (ppt 2010)](https://reader033.fdocuments.us/reader033/viewer/2022051610/548dbae1b47959e20c8b66dd/html5/thumbnails/21.jpg)
Free Powerpoint TemplatesPage 21
MULTIPROCESSORS:
Multiprocessor Synchronization
• Use of Multiple Locks to avoid cache trashing
![Page 22: Multiple processor (ppt 2010)](https://reader033.fdocuments.us/reader033/viewer/2022051610/548dbae1b47959e20c8b66dd/html5/thumbnails/22.jpg)
Free Powerpoint TemplatesPage 22
MULTIPROCESSORS:
Multiprocessor Scheduling
TIME SHARING
The simplest scheduling algorithm for dealing unrelated process is to have a single system wide data structure for ready process
![Page 23: Multiple processor (ppt 2010)](https://reader033.fdocuments.us/reader033/viewer/2022051610/548dbae1b47959e20c8b66dd/html5/thumbnails/23.jpg)
Free Powerpoint TemplatesPage 23
MULTIPROCESSORS:
Multiprocessor Scheduling
Space Sharing• This approach used when the processes are related to one
another. • Scheduling multiple threads at the same time across
multiple CPUs
![Page 24: Multiple processor (ppt 2010)](https://reader033.fdocuments.us/reader033/viewer/2022051610/548dbae1b47959e20c8b66dd/html5/thumbnails/24.jpg)
Free Powerpoint TemplatesPage 24
MULTIPROCESSORS:
Multiprocessor Scheduling
Communication between two threads belonging to
Process A that are running out of phase.
![Page 25: Multiple processor (ppt 2010)](https://reader033.fdocuments.us/reader033/viewer/2022051610/548dbae1b47959e20c8b66dd/html5/thumbnails/25.jpg)
Free Powerpoint TemplatesPage 25
MULTIPROCESSORS:
Multiprocessor Scheduling
Gang Scheduling• Group of related threads are scheduled as a unit (gang)• All member of a gang run simultaneously on different time
shared CPU• All gang members start and end their time slices together.
![Page 26: Multiple processor (ppt 2010)](https://reader033.fdocuments.us/reader033/viewer/2022051610/548dbae1b47959e20c8b66dd/html5/thumbnails/26.jpg)
Free Powerpoint TemplatesPage 26
MULTICOMPUTERS
Definition:
• Are tightly-coupled CPUs that do not share memory (each one has its Memory)
• These systems are also known by a variety of other names, cluster computers and COWS (Cluster of Workstations).
![Page 27: Multiple processor (ppt 2010)](https://reader033.fdocuments.us/reader033/viewer/2022051610/548dbae1b47959e20c8b66dd/html5/thumbnails/27.jpg)
Free Powerpoint TemplatesPage 27
MULTICOMPUTERS:
MULTICOMPUTER HARDWARE
Interconnection Topologies
Single Switch RING GRID
Double Torus CUBE 4D Hypercube
![Page 28: Multiple processor (ppt 2010)](https://reader033.fdocuments.us/reader033/viewer/2022051610/548dbae1b47959e20c8b66dd/html5/thumbnails/28.jpg)
Free Powerpoint TemplatesPage 28
MULTICOMPUTERS:
MULTICOMPUTER HARDWARE
Packet – a message that is broken up (either by a user software or a network face.
Store-and-forward packet switching
![Page 29: Multiple processor (ppt 2010)](https://reader033.fdocuments.us/reader033/viewer/2022051610/548dbae1b47959e20c8b66dd/html5/thumbnails/29.jpg)
Free Powerpoint TemplatesPage 29
MULTICOMPUTERS:
MULTICOMPUTER HARDWARE
Network Interface Board in a multicomputer
![Page 30: Multiple processor (ppt 2010)](https://reader033.fdocuments.us/reader033/viewer/2022051610/548dbae1b47959e20c8b66dd/html5/thumbnails/30.jpg)
Free Powerpoint TemplatesPage 30
MULTICOMPUTERS:
Low-Level Communication Software
Node to Network Communication
• Use send & receive rings to coordinates main CPU with on-board CPU
• When a sender has new packet to send, it first checks to see if there is an available slot in the send ring. If not, it must wait, to prevent overrun.
![Page 31: Multiple processor (ppt 2010)](https://reader033.fdocuments.us/reader033/viewer/2022051610/548dbae1b47959e20c8b66dd/html5/thumbnails/31.jpg)
Free Powerpoint TemplatesPage 31
MULTICOMPUTERS:
Blocking versus Nonblocking Calls
(a) Blocking Calls – when a process call sends, it specifies a destination and a buffer to send that destination. While the message has been completely, the sending process is blocked.
(b) NonBlocking Calls – If send is nonblocking, it returns control immediately, before the message is sent.
![Page 32: Multiple processor (ppt 2010)](https://reader033.fdocuments.us/reader033/viewer/2022051610/548dbae1b47959e20c8b66dd/html5/thumbnails/32.jpg)
Free Powerpoint TemplatesPage 32
MULTICOMPUTERS:
Remote Procedure Call
• The program must be bound with a small library procedure called the CLIENT STUB (represent the client procedure)
• The server is bound with a procedure called SERVER STUB.
![Page 33: Multiple processor (ppt 2010)](https://reader033.fdocuments.us/reader033/viewer/2022051610/548dbae1b47959e20c8b66dd/html5/thumbnails/33.jpg)
Free Powerpoint TemplatesPage 33
MULTICOMPUTERS:
Distributed Shared Memory
Various layers where shared memory:
(a) – The Hardware
(b) – The Operating System
(c) – User-level Software
![Page 34: Multiple processor (ppt 2010)](https://reader033.fdocuments.us/reader033/viewer/2022051610/548dbae1b47959e20c8b66dd/html5/thumbnails/34.jpg)
Free Powerpoint TemplatesPage 34
MULTICOMPUTERS:
Distributed Shared Memory
Replication(a) Pages distributed
on 4 machines
(b) CPU 0 reads page 10
(c) CPU 1 reads page 10
![Page 35: Multiple processor (ppt 2010)](https://reader033.fdocuments.us/reader033/viewer/2022051610/548dbae1b47959e20c8b66dd/html5/thumbnails/35.jpg)
Free Powerpoint TemplatesPage 35
False Sharing • Too large an effective page size introduces a new
problem. • The problem here is that although the variable are
unrelated, they appear by accident on the same page, so when a process uses one of them, it also gets the other.
MULTICOMPUTERS:
Distributed Shared Memory