Outline Memory characteristics SRAM Content-addressable memory details DRAM © Derek Chiou & Mattan...

26
Outline Memory characteristics SRAM Content-addressable memory details DRAM © Derek Chiou & Mattan Erez 1

Transcript of Outline Memory characteristics SRAM Content-addressable memory details DRAM © Derek Chiou & Mattan...

Page 1: Outline Memory characteristics SRAM Content-addressable memory details DRAM © Derek Chiou & Mattan Erez 1.

1

Outline Memory characteristics SRAM Content-addressable memory details DRAM

© Derek Chiou & Mattan Erez

Page 2: Outline Memory characteristics SRAM Content-addressable memory details DRAM © Derek Chiou & Mattan Erez 1.

© Derek Chiou & Mattan Erez 3

What Memory Should I Use? Depends on access characteristics

How often is it written? How often is it accessed in general? How fast should the accesses be?

Latency? Bandwidth? What should the capacity be?

Bytes? Kilobytes? Megabytes? Gigabytes? Terbytes? How long should the data last?

Microseconds? Seconds? Years? Decades? Granularity of access Cost

Dollars, watts or joules, … Different memories optimized for different access types

Page 3: Outline Memory characteristics SRAM Content-addressable memory details DRAM © Derek Chiou & Mattan Erez 1.

© Derek Chiou & Mattan Erez 4

Memory Types ROM (non-volatile Read Only Memory) RAM (volatile, Random Access Memory) “Disk” Non-mainstream

Really misnomers today RAM is often not truly random access ROM is writable, just more slowly than RAM

Page 4: Outline Memory characteristics SRAM Content-addressable memory details DRAM © Derek Chiou & Mattan Erez 1.

© Derek Chiou & Mattan Erez 6

Random Access Memory (RAM) Static RAM (SRAM)

“Static” indicates that as long as you apply power, the value will be maintained

6 transistors/bit

Dynamic RAM (DRAM) What does dynamic mean? Capacitor stores data (1 cap + 1 transistor/bit)

Interfaces DDR – double data rate Burst mode – most DRAMs have a burst of at least 4 (now 8)

Page 5: Outline Memory characteristics SRAM Content-addressable memory details DRAM © Derek Chiou & Mattan Erez 1.

7

SRAM

© Derek Chiou & Mattan Erez

Page 6: Outline Memory characteristics SRAM Content-addressable memory details DRAM © Derek Chiou & Mattan Erez 1.

© Derek Chiou & Mattan Erez 8

SRAM Cell (6T)

word line

=

Page 7: Outline Memory characteristics SRAM Content-addressable memory details DRAM © Derek Chiou & Mattan Erez 1.

© Derek Chiou & Mattan Erez 9

SRAM Array

word line 0

word line 1

b0 b0 b1 b1 b2 b2 b3 b3

word line 2

word line 3

Page 8: Outline Memory characteristics SRAM Content-addressable memory details DRAM © Derek Chiou & Mattan Erez 1.

© Derek Chiou & Mattan Erez 10

Accessing SRAM Can read/write (modulo bus turnaround) every cycle Generally 1 cycle latency (could be longer based on

pipelining) Large SRAMs are slower than smaller SRAMs

Page 9: Outline Memory characteristics SRAM Content-addressable memory details DRAM © Derek Chiou & Mattan Erez 1.

15

DRAM

© Derek Chiou & Mattan Erez

Page 10: Outline Memory characteristics SRAM Content-addressable memory details DRAM © Derek Chiou & Mattan Erez 1.

16© Derek Chiou & Mattan Erez 16

DRAM Cell

What happens when you read?

Page 11: Outline Memory characteristics SRAM Content-addressable memory details DRAM © Derek Chiou & Mattan Erez 1.

17© Derek Chiou & Mattan Erez 17

DRAM Cell

What happens when you read?

Infineon 80nm

Page 12: Outline Memory characteristics SRAM Content-addressable memory details DRAM © Derek Chiou & Mattan Erez 1.

18© Derek Chiou & Mattan Erez 18

DRAM Refresh Capacitor holding value leaks, eventually you will lose

information (everything turns to 0)

How do you maintain the values in DRAM?

Page 13: Outline Memory characteristics SRAM Content-addressable memory details DRAM © Derek Chiou & Mattan Erez 1.

19© Derek Chiou & Mattan Erez 19

Simplified DRAM Internal Structure

Row

Column

RAS

CASAddr

Page 14: Outline Memory characteristics SRAM Content-addressable memory details DRAM © Derek Chiou & Mattan Erez 1.

20© Derek Chiou & Mattan Erez 20

Simplified DRAM Internal Structure

Row

Column

RAS

CAS

Addr

Page 15: Outline Memory characteristics SRAM Content-addressable memory details DRAM © Derek Chiou & Mattan Erez 1.

22© Derek Chiou & Mattan Erez

DRAM Array

Page 16: Outline Memory characteristics SRAM Content-addressable memory details DRAM © Derek Chiou & Mattan Erez 1.

23© Derek Chiou & Mattan Erez

Accessing DRAM (RAS)

Operation Resource Utilization

Cycle

Activate Row

Request

Data

request

data

Simplified Bank State Diagram

act

pre wr

rd

Row

dec

oder

Sense amplifier

Column decoder

DRAM

Memory array

bank 0

Page 17: Outline Memory characteristics SRAM Content-addressable memory details DRAM © Derek Chiou & Mattan Erez 1.

24© Derek Chiou & Mattan Erez

Accessing DRAM (CAS)

Operation Resource Utilization

Row

dec

oder

Sense amplifier

Column decoder

DRAM

Memory array

bank 0

request

data

Simplified Bank State Diagram

act

pre wr

rd

Read Row

Request

Data

Cycle

Page 18: Outline Memory characteristics SRAM Content-addressable memory details DRAM © Derek Chiou & Mattan Erez 1.

25© Derek Chiou & Mattan Erez

Accessing DRAM (re-writing “lost” data)

Operation Resource Utilization

Precharge Row

Request

Data

request

data

Simplified Bank State Diagram

act

pre wr

rd

Row

dec

oder

Sense amplifier

Column decoder

DRAM

Memory array

bank 0

Cycle

Page 19: Outline Memory characteristics SRAM Content-addressable memory details DRAM © Derek Chiou & Mattan Erez 1.

26© Derek Chiou & Mattan Erez 26

DRAM RAS/CAS Summary Assert RAS to specify row address Assert CAS to specify column address Why separate RAS/CAS?

Can pulse CAS to read more from the same row Faster Implications?

Called Fast Page Mode

Page 20: Outline Memory characteristics SRAM Content-addressable memory details DRAM © Derek Chiou & Mattan Erez 1.

What to do while waiting for Act/Pre/…?

© Derek Chiou & Mattan Erez 27

request

data

bank n-1bank 1

Row

dec

oder

Sense amplifier

Column decoder

DRAM

Memory array

bank 0

Page 21: Outline Memory characteristics SRAM Content-addressable memory details DRAM © Derek Chiou & Mattan Erez 1.

© Derek Chiou & Mattan Erez 28

DRAM Hierarchy/Banks

Row

Column

RAS

CAS

Bank[1:0]

Why have banks?

Cannot access banks back-to-back. Why?

Page 22: Outline Memory characteristics SRAM Content-addressable memory details DRAM © Derek Chiou & Mattan Erez 1.

© Derek Chiou & Mattan Erez 29

Memory Interfaces How much data per column command?

Interface width (x4, x8, …) How much data per bus transfer Note: each column DRAM address refers to width bits

Burst length (4, 8, …) How many bus transfers per CAS

SDRAM Synchronous DRAM – more when we discuss buses

DDRx Double-data rate – multiple data transfers per clock (rising and

falling edge, or even faster) DDR, then DDR2, then DDR3 – just different standards for

defining sizing, timing, and electrical parameters

Page 23: Outline Memory characteristics SRAM Content-addressable memory details DRAM © Derek Chiou & Mattan Erez 1.

30© Derek Chiou & Mattan Erez 30

Tradeoffs: SRAM vs DRAM

Criteria SRAM DRAM

Speed Low Latency High Bandwidth

Static Yes No

Access Easy Harder

Process Logic DRAM

Refresh No Yes

Density Low High

Page 24: Outline Memory characteristics SRAM Content-addressable memory details DRAM © Derek Chiou & Mattan Erez 1.

© Derek Chiou & Mattan Erez 32

“Experimental” Memory Technology Not yet mainstream, but making headway Embedded DRAM

DRAM in logic process, integrated with the processor In between SRAM and DRAM in terms of properties

STT-RAM – Spin torque transfer RAM Based on Spintronics – manipulation of electron spins Works like 60’s “core memory”, but nano-sized “best of all worlds”, but still low density and experimental

PC-RAM – Phase-change RAM Based on heat-related changes to physical structure of cell FLASH replacement May replace DRAM

Page 25: Outline Memory characteristics SRAM Content-addressable memory details DRAM © Derek Chiou & Mattan Erez 1.

© Derek Chiou & Mattan Erez 38

Memory Modules (DIMMs) Dual In-line Memory Module (DIMM)

Standard memory interface today Multiple chips on independent module

Easy to build and maintain systems DIMMs have one or more “ranks” Rank is multiple chips that share same CE

Page 26: Outline Memory characteristics SRAM Content-addressable memory details DRAM © Derek Chiou & Mattan Erez 1.

© Derek Chiou & Mattan Erez 39

Memory Modules (DIMMs) Dual In-line Memory Module (DIMM)

Standard memory interface today Multiple chips on independent module

Easy to build and maintain systems DIMMs have one or more “ranks” Rank is multiple chips that share same CE

x8

8

x8

8

addr

MAR

CE CE WEWE

0

logic

x8

8

x8

8

CE CE WEWE

1

Width?Ranks?Chips/rank?