TBBT-Trace Based file system Benchmarking Tool Ningning Zhu, Jiawu Chen, Tzi-cker Chiueh Stony Brook...
-
Upload
ruth-drusilla-bates -
Category
Documents
-
view
217 -
download
0
Transcript of TBBT-Trace Based file system Benchmarking Tool Ningning Zhu, Jiawu Chen, Tzi-cker Chiueh Stony Brook...
![Page 1: TBBT-Trace Based file system Benchmarking Tool Ningning Zhu, Jiawu Chen, Tzi-cker Chiueh Stony Brook University Daniel Ellard Harvard University Fast’04.](https://reader035.fdocuments.us/reader035/viewer/2022062407/56649e115503460f94afd9be/html5/thumbnails/1.jpg)
TBBT-Trace Based file system Benchmarking Tool
Ningning Zhu, Jiawu Chen, Tzi-cker Chiueh
Stony Brook University
Daniel Ellard
Harvard University
Fast’04 Work In Progress
![Page 2: TBBT-Trace Based file system Benchmarking Tool Ningning Zhu, Jiawu Chen, Tzi-cker Chiueh Stony Brook University Daniel Ellard Harvard University Fast’04.](https://reader035.fdocuments.us/reader035/viewer/2022062407/56649e115503460f94afd9be/html5/thumbnails/2.jpg)
Synthetic FS benchmarks & Drawbacks
Synthetic Macro-benchmarks SPECsfs (NFS) SDET Postmark SSH-Build TPCC Andrew Benchmark
Synthetic Micro-benchmarks Hybrid Benchmarks
hBench
Outdated
Unrealistic
Misleading
![Page 3: TBBT-Trace Based file system Benchmarking Tool Ningning Zhu, Jiawu Chen, Tzi-cker Chiueh Stony Brook University Daniel Ellard Harvard University Fast’04.](https://reader035.fdocuments.us/reader035/viewer/2022062407/56649e115503460f94afd9be/html5/thumbnails/3.jpg)
FS traces, contributions, and trends
1985 Ousterhout’s trace 1991 Sprite trace analysis 1999 Vogels, FS Usage in Windows NT 2000 Roselli et al, A Comparison of FS workloads 2003 Ellard et al, NFS trace study
Workload characterization to guide file system design
Larger, passive, realistic
![Page 4: TBBT-Trace Based file system Benchmarking Tool Ningning Zhu, Jiawu Chen, Tzi-cker Chiueh Stony Brook University Daniel Ellard Harvard University Fast’04.](https://reader035.fdocuments.us/reader035/viewer/2022062407/56649e115503460f94afd9be/html5/thumbnails/4.jpg)
Goal of TBBT toolkit Challenges
Realistic Up to date
Easy to use Scalable Light-weight
Initial image
Inactive files,
Aging
Concurrency
Error handling
Disk/CPU usage
![Page 5: TBBT-Trace Based file system Benchmarking Tool Ningning Zhu, Jiawu Chen, Tzi-cker Chiueh Stony Brook University Daniel Ellard Harvard University Fast’04.](https://reader035.fdocuments.us/reader035/viewer/2022062407/56649e115503460f94afd9be/html5/thumbnails/5.jpg)
File System Initialization
Actual image
![Page 6: TBBT-Trace Based file system Benchmarking Tool Ningning Zhu, Jiawu Chen, Tzi-cker Chiueh Stony Brook University Daniel Ellard Harvard University Fast’04.](https://reader035.fdocuments.us/reader035/viewer/2022062407/56649e115503460f94afd9be/html5/thumbnails/6.jpg)
File System Initialization
Actual image Extracted image
![Page 7: TBBT-Trace Based file system Benchmarking Tool Ningning Zhu, Jiawu Chen, Tzi-cker Chiueh Stony Brook University Daniel Ellard Harvard University Fast’04.](https://reader035.fdocuments.us/reader035/viewer/2022062407/56649e115503460f94afd9be/html5/thumbnails/7.jpg)
File System Initialization
Actual image Extracted image Initial image
![Page 8: TBBT-Trace Based file system Benchmarking Tool Ningning Zhu, Jiawu Chen, Tzi-cker Chiueh Stony Brook University Daniel Ellard Harvard University Fast’04.](https://reader035.fdocuments.us/reader035/viewer/2022062407/56649e115503460f94afd9be/html5/thumbnails/8.jpg)
File System Initialization
Actual image Extracted image Initial image
![Page 9: TBBT-Trace Based file system Benchmarking Tool Ningning Zhu, Jiawu Chen, Tzi-cker Chiueh Stony Brook University Daniel Ellard Harvard University Fast’04.](https://reader035.fdocuments.us/reader035/viewer/2022062407/56649e115503460f94afd9be/html5/thumbnails/9.jpg)
File System Initialization
Actual image Extracted image Initial image
![Page 10: TBBT-Trace Based file system Benchmarking Tool Ningning Zhu, Jiawu Chen, Tzi-cker Chiueh Stony Brook University Daniel Ellard Harvard University Fast’04.](https://reader035.fdocuments.us/reader035/viewer/2022062407/56649e115503460f94afd9be/html5/thumbnails/10.jpg)
File System Initialization
Actual image Extracted image Initial image
![Page 11: TBBT-Trace Based file system Benchmarking Tool Ningning Zhu, Jiawu Chen, Tzi-cker Chiueh Stony Brook University Daniel Ellard Harvard University Fast’04.](https://reader035.fdocuments.us/reader035/viewer/2022062407/56649e115503460f94afd9be/html5/thumbnails/11.jpg)
File System Initialization
Actual image Extracted image Initial image
![Page 12: TBBT-Trace Based file system Benchmarking Tool Ningning Zhu, Jiawu Chen, Tzi-cker Chiueh Stony Brook University Daniel Ellard Harvard University Fast’04.](https://reader035.fdocuments.us/reader035/viewer/2022062407/56649e115503460f94afd9be/html5/thumbnails/12.jpg)
File System Initialization
Actual image Extracted image Initial image
![Page 13: TBBT-Trace Based file system Benchmarking Tool Ningning Zhu, Jiawu Chen, Tzi-cker Chiueh Stony Brook University Daniel Ellard Harvard University Fast’04.](https://reader035.fdocuments.us/reader035/viewer/2022062407/56649e115503460f94afd9be/html5/thumbnails/13.jpg)
File System Initialization
Actual image Extracted image Initial image
![Page 14: TBBT-Trace Based file system Benchmarking Tool Ningning Zhu, Jiawu Chen, Tzi-cker Chiueh Stony Brook University Daniel Ellard Harvard University Fast’04.](https://reader035.fdocuments.us/reader035/viewer/2022062407/56649e115503460f94afd9be/html5/thumbnails/14.jpg)
File System Initialization
Actual image Extracted image Initial image
![Page 15: TBBT-Trace Based file system Benchmarking Tool Ningning Zhu, Jiawu Chen, Tzi-cker Chiueh Stony Brook University Daniel Ellard Harvard University Fast’04.](https://reader035.fdocuments.us/reader035/viewer/2022062407/56649e115503460f94afd9be/html5/thumbnails/15.jpg)
File System Initialization
Actual image Extracted image Initial image
![Page 16: TBBT-Trace Based file system Benchmarking Tool Ningning Zhu, Jiawu Chen, Tzi-cker Chiueh Stony Brook University Daniel Ellard Harvard University Fast’04.](https://reader035.fdocuments.us/reader035/viewer/2022062407/56649e115503460f94afd9be/html5/thumbnails/16.jpg)
File System Initialization
Actual image Extracted image Initial image
![Page 17: TBBT-Trace Based file system Benchmarking Tool Ningning Zhu, Jiawu Chen, Tzi-cker Chiueh Stony Brook University Daniel Ellard Harvard University Fast’04.](https://reader035.fdocuments.us/reader035/viewer/2022062407/56649e115503460f94afd9be/html5/thumbnails/17.jpg)
File System Initialization
Actual image Extracted image Initial image
![Page 18: TBBT-Trace Based file system Benchmarking Tool Ningning Zhu, Jiawu Chen, Tzi-cker Chiueh Stony Brook University Daniel Ellard Harvard University Fast’04.](https://reader035.fdocuments.us/reader035/viewer/2022062407/56649e115503460f94afd9be/html5/thumbnails/18.jpg)
File System Initialization
Actual image Extracted image Initial image
![Page 19: TBBT-Trace Based file system Benchmarking Tool Ningning Zhu, Jiawu Chen, Tzi-cker Chiueh Stony Brook University Daniel Ellard Harvard University Fast’04.](https://reader035.fdocuments.us/reader035/viewer/2022062407/56649e115503460f94afd9be/html5/thumbnails/19.jpg)
File System Initialization
Actual image Extracted image Initial image aging
![Page 20: TBBT-Trace Based file system Benchmarking Tool Ningning Zhu, Jiawu Chen, Tzi-cker Chiueh Stony Brook University Daniel Ellard Harvard University Fast’04.](https://reader035.fdocuments.us/reader035/viewer/2022062407/56649e115503460f94afd9be/html5/thumbnails/20.jpg)
File System Initialization
Actual image Extracted image Initial image aging
![Page 21: TBBT-Trace Based file system Benchmarking Tool Ningning Zhu, Jiawu Chen, Tzi-cker Chiueh Stony Brook University Daniel Ellard Harvard University Fast’04.](https://reader035.fdocuments.us/reader035/viewer/2022062407/56649e115503460f94afd9be/html5/thumbnails/21.jpg)
File System Initialization
Actual image Extracted image Initial image aging
![Page 22: TBBT-Trace Based file system Benchmarking Tool Ningning Zhu, Jiawu Chen, Tzi-cker Chiueh Stony Brook University Daniel Ellard Harvard University Fast’04.](https://reader035.fdocuments.us/reader035/viewer/2022062407/56649e115503460f94afd9be/html5/thumbnails/22.jpg)
File System Initialization
Actual image Extracted image Initial image aging
![Page 23: TBBT-Trace Based file system Benchmarking Tool Ningning Zhu, Jiawu Chen, Tzi-cker Chiueh Stony Brook University Daniel Ellard Harvard University Fast’04.](https://reader035.fdocuments.us/reader035/viewer/2022062407/56649e115503460f94afd9be/html5/thumbnails/23.jpg)
Dependency Analysis
Operation modify access
Read/getattr obj
Write/setattr obj
Lookup dir name([obj])
Create/mkdir dir name(obj)
Remove/rmdir dir, name([obj])
Obj
Dir,obj
Dir,[obj]
Obj
Obj
Dir,[obj]
Dir,obj
Dir,[obj]
![Page 24: TBBT-Trace Based file system Benchmarking Tool Ningning Zhu, Jiawu Chen, Tzi-cker Chiueh Stony Brook University Daniel Ellard Harvard University Fast’04.](https://reader035.fdocuments.us/reader035/viewer/2022062407/56649e115503460f94afd9be/html5/thumbnails/24.jpg)
TBBT load generator
![Page 25: TBBT-Trace Based file system Benchmarking Tool Ningning Zhu, Jiawu Chen, Tzi-cker Chiueh Stony Brook University Daniel Ellard Harvard University Fast’04.](https://reader035.fdocuments.us/reader035/viewer/2022062407/56649e115503460f94afd9be/html5/thumbnails/25.jpg)
Trace Concurrency
![Page 26: TBBT-Trace Based file system Benchmarking Tool Ningning Zhu, Jiawu Chen, Tzi-cker Chiueh Stony Brook University Daniel Ellard Harvard University Fast’04.](https://reader035.fdocuments.us/reader035/viewer/2022062407/56649e115503460f94afd9be/html5/thumbnails/26.jpg)
NFS/RFS evaluation by TBBT and SPECsfs
![Page 27: TBBT-Trace Based file system Benchmarking Tool Ningning Zhu, Jiawu Chen, Tzi-cker Chiueh Stony Brook University Daniel Ellard Harvard University Fast’04.](https://reader035.fdocuments.us/reader035/viewer/2022062407/56649e115503460f94afd9be/html5/thumbnails/27.jpg)
Conclusion
TBBT is a scalable, flexible, and efficient toolkit for file system evaluation.
The trace-driven nature makes it capable of capturing the diverse workload features and their fast evolvement.
![Page 28: TBBT-Trace Based file system Benchmarking Tool Ningning Zhu, Jiawu Chen, Tzi-cker Chiueh Stony Brook University Daniel Ellard Harvard University Fast’04.](https://reader035.fdocuments.us/reader035/viewer/2022062407/56649e115503460f94afd9be/html5/thumbnails/28.jpg)
File System Hierarchy Discovery
![Page 29: TBBT-Trace Based file system Benchmarking Tool Ningning Zhu, Jiawu Chen, Tzi-cker Chiueh Stony Brook University Daniel Ellard Harvard University Fast’04.](https://reader035.fdocuments.us/reader035/viewer/2022062407/56649e115503460f94afd9be/html5/thumbnails/29.jpg)
Synthetic Workload Generator