Memory Organization, Cache and C programming

35
Carnegie Mellon 1 Memory Organization, Cache and C programming 15-213: Introduction to Computer Systems Recitation 7: Thursday, June19, 2014 Vinay Venkatesh ([email protected]) Shiva ([email protected]) Aditya Gupta ([email protected])

Transcript of Memory Organization, Cache and C programming

Page 1: Memory Organization, Cache and C programming

Carnegie Mellon

1

Memory Organization, Cache and C programming

15-213: Introduction to Computer Systems Recitation 7: Thursday, June19, 2014

Vinay Venkatesh ([email protected])

Shiva ([email protected])

Aditya Gupta ([email protected])

Page 2: Memory Organization, Cache and C programming

Carnegie Mellon

2

Memory organization

Caching

Different types of locality

Cache organization

Programming in C and Unix kickstart

Cachelab

Part (a) Building Cache Simulator

Part (b) Efficient Matrix Transpose

Cache Lab demo

Agenda

Page 3: Memory Organization, Cache and C programming
Page 4: Memory Organization, Cache and C programming
Page 5: Memory Organization, Cache and C programming
Page 6: Memory Organization, Cache and C programming
Page 7: Memory Organization, Cache and C programming
Page 8: Memory Organization, Cache and C programming
Page 9: Memory Organization, Cache and C programming
Page 10: Memory Organization, Cache and C programming
Page 11: Memory Organization, Cache and C programming
Page 12: Memory Organization, Cache and C programming
Page 13: Memory Organization, Cache and C programming
Page 14: Memory Organization, Cache and C programming
Page 15: Memory Organization, Cache and C programming
Page 16: Memory Organization, Cache and C programming

Carnegie Mellon

16

Programming in C and Unix Kick-Start

Page 17: Memory Organization, Cache and C programming

Note: Remember to use man

Page 18: Memory Organization, Cache and C programming
Page 19: Memory Organization, Cache and C programming
Page 20: Memory Organization, Cache and C programming
Page 21: Memory Organization, Cache and C programming
Page 22: Memory Organization, Cache and C programming
Page 23: Memory Organization, Cache and C programming
Page 24: Memory Organization, Cache and C programming
Page 25: Memory Organization, Cache and C programming
Page 26: Memory Organization, Cache and C programming
Page 27: Memory Organization, Cache and C programming
Page 28: Memory Organization, Cache and C programming
Page 29: Memory Organization, Cache and C programming
Page 30: Memory Organization, Cache and C programming
Page 31: Memory Organization, Cache and C programming
Page 32: Memory Organization, Cache and C programming
Page 33: Memory Organization, Cache and C programming
Page 34: Memory Organization, Cache and C programming
Page 35: Memory Organization, Cache and C programming

Carnegie Mellon

35

Cache Lab Demo


Cache memory and cache

Cache memory and cache

Memory Hierarchy Design Memory Hierarchy Design. 2 Outline Introduction Cache Basics Cache Performance Reducing Cache Miss Penalty Reducing Cache Miss.

Memory Hierarchy Design Memory Hierarchy Design. 2 Outline Introduction Cache Basics Cache Performance Reducing Cache Miss Penalty Reducing Cache Miss.

Memory and cache CPU Memory I/O. CEG 320/52010: Memory and cache2 The Memory Hierarchy Registers Primary cache Secondary cache Main memory Magnetic disk.

Memory and cache CPU Memory I/O. CEG 320/52010: Memory and cache2 The Memory Hierarchy Registers Primary cache Secondary cache Main memory Magnetic disk.

INF3380: Parallel Programming for Natural Sciences · Cache Cache Core Core Core Core Cache Cache Bus Compute Node Memory Core Core Core Core Cache Cache Core Core Core Core ... Compute

INF3380: Parallel Programming for Natural Sciences · Cache Cache Core Core Core Core Cache Cache Bus Compute Node Memory Core Core Core Core Cache Cache Core Core Core Core ... Compute

Cache Memory

Cache Memory

CACHE MEMORY

CACHE MEMORY

Memory Hierarchy. Hierarchy List Registers L1 Cache L2 Cache Main memory Disk cache Disk Optical Tape.

Memory Hierarchy. Hierarchy List Registers L1 Cache L2 Cache Main memory Disk cache Disk Optical Tape.

04 Cache Memory

04 Cache Memory

04 Cache Memory

04 Cache Memory

Winter 2002CSE 141 - Cache Improving memory with caches CPU On-chip cache Off-chip cache DRAM memory Disk memory.

Winter 2002CSE 141 - Cache Improving memory with caches CPU On-chip cache Off-chip cache DRAM memory Disk memory.

Parallel Numerical Simulation€¦ · 7 Cache Memory cache memory: aim: reduce memory access time / latency (CPU performance increased faster than memory access speed) cache memory:

Parallel Numerical Simulation€¦ · 7 Cache Memory cache memory: aim: reduce memory access time / latency (CPU performance increased faster than memory access speed) cache memory:

NUMA machines and directory cache mechanismsCOMA(Cache Only Memory Machine) No home memory and every memory behaves like cache (Not actual cache) Cache line gathers to required clusters.

NUMA machines and directory cache mechanismsCOMA(Cache Only Memory Machine) No home memory and every memory behaves like cache (Not actual cache) Cache line gathers to required clusters.

Cache memory ...

Cache memory ...

GPU Programming with CUDA and the PGI Accelerator ... · PDF filehost memory, device memory (hardware cache), constant memory, (configurable) shared memory, register ... Large scale

GPU Programming with CUDA and the PGI Accelerator ... · PDF filehost memory, device memory (hardware cache), constant memory, (configurable) shared memory, register ... Large scale