U NIVERSITY OF M ASSACHUSETTS A MHERST Department of Computer Science Garbage Collection Without...

UUNIVERSITY OF NIVERSITY OF MMASSACHUSETTSASSACHUSETTS A AMHERST • MHERST • Department of Computer Science Department of Computer Science

Garbage CollectionWithout Paging

Matthew Hertz, Yi Feng,Emery Berger

University of Massachusetts Amherst


Garbage Collection Performance

Garbage collection now performs reasonably well High throughput Low pause times Given large heap and sufficient

memory

But: what happens when there’s not enough RAM?


GC Performance While Paging

RAM

Hard Disk

Heap: most pages in RAM, one on diskGC begins



Collector touches an evicted page...

RAM

Hard Disk



... bringing the page into memory ...

RAM

Hard Disk



RAM

Hard Disk

... but triggers another page eviction.



Collector touches newly-evicted page...

RAM

Hard Disk



RAM

Hard Disk

Collector touches newly-evicted page...



... leading to the eviction of yet another page…

RAM

Hard Disk



… which eventually triggers more paging.

RAM

Hard Disk


Program Throughput

Paging causes a 40 to 62-fold increase in runtime

Execution Time of pseudoJBB w/ 77MB Heap

0

100

200

300

400

500

600

212 163 153 143 133 123 113 103 93Available Memory

Exec

uti

on T

ime

(in s

)

GenCopy

GenMS


Outline

Motivation GC without paging

Cooperative garbage collection Bookmarking

Results


The problem

Garbage collector: VM-oblivious Examines all reachable objects Lacks knowledge of page residency

Treats evicted and resident pages identically

Virtual memory: GC-oblivious GC & application have different access

patterns Likely to evict pages needed by GC


Cooperative Garbage Collection

Bookmarkingcollector

Extended virtual memory manager

Select victim(s)Update

residency

page eviction

notificationvictim

page(s)

Page replacement

In response to notifications, BC:Adjusts heap size to fit in main memoryPrevents eviction of important pagesAvoids touching non-resident pages


Avoiding Page Evictions

When notified, avoid a pending eviction…

0 000

RAM

Hard Disk

0



…find a page BC knows to be empty…

0 000

RAM

Hard Disk

0



… and discard it…

0 000

RAM

Hard Disk

0



… eliminating the need to evict a page.

0 000

RAM

Hard Disk


Limit of Heap Sizing

Could collect, compact, compress, etc.

Eventually: Will run out of pages to discard Going to have to evict non-empty

pages Result: Paging

Can we avoid this?


Bookmarks

We introduce bookmarks: Summaries of connectivity info on

evicted pages References from objects on the page

These summaries enable GC w/o paging


0 000

Bookmarking

RAM

Hard Disk

Process page before eviction…


0 000

Bookmarking

B

B

... by following pointers & bookmark-ing targets...

RAM

Hard Disk


0 000

Bookmarking

B

B

... increment the referring page count...

RAM

Hard Disk

1


1 000

Bookmarking

B B

B B

B

B

B

... conservatively bookmark objects on the page...

RAM

Hard Disk


0 00

Bookmarking

... then tell extended VM to evict the page.

RAM

Hard Disk

0B B

B B

B

B

B

1


Bookmarking Details

Cheap summary of connectivity One bit per object: free One word per page: referring page

count Bookmarks cleared when count = zero

Use bookmarks as secondary roots during garbage collection


0B B

B B

B

1 00

RAM

Hard Disk

Collection with Bookmarks

Process objects as usual, but...

B

B

roots


0B B

B B

B

1 00

RAM

Hard Disk


... ignore any references to evicted pages.

B

B

roots


0B B

B B

B

1 00

RAM

Hard Disk


Use bookmarks to recreate evicted references...

B

B

roots


0B B

B B

B

1 00

RAM

Hard Disk


... and continue collection.

roots

B

B


0B B

B B

B

1 00

RAM

Hard Disk


B

B

roots

Result: Garbage collection without paging!


0B B

B B

B

1 00

RAM

Hard Disk


B

B

roots

Note: can waste space on evicted pages.


Bookmarking Incompleteness

Space waste not just on evicted pages

Collection with bookmarks is necessarily incomplete Not guaranteed to reclaim all memory


0B B

B B

B

1 00

RAM

Hard Disk


B

B

When a reference to an evicted object changes…


1 0

0

0

RAM

Hard Disk


B B

B B

B

B

B

…it can make evicted objects unreachable.


0B B

B B

B

1 00

RAM

Hard Disk


B

B

But bookmarks cannot be removed…


0B B

B B

B

1 00

RAM

Hard Disk


B

B

…retaining unreachable heap objects.


Bookmarking Completeness

Worst-case: completeness requires duplicating evicted pages See paper for more info

How can we preserve completeness?


0B B

B B

B

1 00

RAM

Hard Disk


B

B

If the heap becomes full…


0

0 00

RAM

Hard Disk


…BC removes all bookmarks…


0

0 00

???

???


…and performs a VM-oblivious collection...


0

0 00

???

???


…reclaiming all unreachable objects.


0 0

0

0

???

???


…reclaiming all unreachable objects.

BC’s worst case is other collectors’ common case


BC Performance Optimizations

Uses generational design similar to GenMS Yields good performance when not

paging

Compacts heap to reduce pressure Prevents single object from tying

down a page


Outline

Motivation GC without paging

Cooperative garbage collection Bookmarking

Results


Experimental Methodology

Extended Linux kernel 2.4.20 Eviction notification vm_relinquish() Added only 600 LOC

Jikes RVM 2.3.2 & MMTk Compare BC to MarkSweep,

SemiSpace, CopyMS, GenCopy, GenMS


Throughput w/o Memory Pressure

BC runtime comparable to GenMS

Geo. Mean for Execution Time Relative to BC

0.95

1.00

1.05

1.10

1.15

1.00 1.25 1.50 1.75 2.00 2.25 2.50 2.75 3.00 3.25 3.50 3.75 4.00Relative Heap Size

Rel

ativ

e Ex

ecuti

on T

ime

BCGenCopyGenMS


Throughput while Paging

BC throughput closely follows ideal curve

Execution Time for pseudoJBB w/ 77MB Heap

0

100

200

300

400

500

600

212 163 153 143 133 123 113 103 93

Available Memory

Exec

utio

n Ti

me

(in s

)

IdealBCGenCopyGenMS


BMU Curve w/ Memory Pressure

Bookmarking crucial for good performance

0.0%1566 ms

71.9%12231 ms

0.0%81591 ms

39.1%467944 ms


Summary of Results

When not paging: BC as fast as GenMS

When paging: vs. GenMS (fastest when not paging)

41x faster, avg pause up to 218x smaller vs. CopyMS (next fastest when

paging) 5x faster, avg pause up to 45x smaller


Conclusion

Bookmarking collector available at: http://www.cs.umass.edu/~hertz


Thank you


Other Pointer Summarizations

Pointer Compression Save space by compressing pointers Tracing pointers becomes expensive

Remembered Sets Add evicted pointers to buffers Requires space upon pages eviction

Per Object Referring Page Counts Increases BC overheads


Related Work

VM-Sensitive Garbage Collection Linearizing LISP lists [Bobrow/Murphy]

Does not know or use which heap pages are memory resident

Independent heap regions [Bishop] Cannot avoid page faults when region

contains evicted pages Ephemeral garbage collection [Moon]

Must access evicted pages when they contain pointers into generations being collected


Related Work

VM-Cooperative Garbage Collection Discarding empty pages [Cooper, et al.]

No mechanism for evicting non-empty pages Shrinking heap size [Alonso/Appel]

Responds to memory pressure changes only after a collection

Automatic heap sizing [Yang, et al.] Orthogonal approach that determines proper

heap size


Throughput w/ Memory Pressure

BC outperforms fixed nursery collectors

212 163 153 143 133 123 113 103 930

50000

100000

150000

200000

250000

300000

350000

400000

450000

500000Execution Time for pseudoJBB w/ 77MB

HeapBCBC w/ Fixed NurseryBC w/ Fixed Nursery and Resizing OnlyGenCopy w/ Fixed NurseryGenMS w/ Fixed Nursery

Available Memory

Exe

cutio

n T

ime (

ms)


Multiprogramming Performance

491 292 282 272 262 252 242 232 222 212 202 192 182 172 1620

100000

200000

300000

400000

500000

Elapsed Time for 2 runs of pseudoJBB, 77MB HeapBC

GenCopyGenMSCopyMSSemiSpace

Available Memory (MB)

Tota

l Wall

Clo

ck T

ime (

ms)

BC performs well in many environments


Experimental Methodology

Benchmarks:SPECjvm98, ipsixql, jython, and pseudoJBB

“Opt-and-reset” methodology First iteration optimizes all code Record results from second run

U NIVERSITY OF M ASSACHUSETTS A MHERST Department of Computer Science Garbage Collection Without...

Documents

Transcript of U NIVERSITY OF M ASSACHUSETTS A MHERST Department of Computer Science Garbage Collection Without...