The Next Evolution of PVFS
description
Transcript of The Next Evolution of PVFS
![Page 1: The Next Evolution of PVFS](https://reader035.fdocuments.us/reader035/viewer/2022062218/56815b95550346895dc99a2f/html5/thumbnails/1.jpg)
The Next Evolution of PVFS
OrangeFS
![Page 2: The Next Evolution of PVFS](https://reader035.fdocuments.us/reader035/viewer/2022062218/56815b95550346895dc99a2f/html5/thumbnails/2.jpg)
PVFS2Brought Us….• Modular Architecture• Support for Standard out of the box
kernels • Distributed Meta-data• Scalability• Direct MPI Support• Hardware Independence• Stateless Operations
![Page 3: The Next Evolution of PVFS](https://reader035.fdocuments.us/reader035/viewer/2022062218/56815b95550346895dc99a2f/html5/thumbnails/3.jpg)
OrangeFS … (Current 2.8.4)Added…
• Commercial Grade support (from Omnibond)• Dedicated Professional Development Team• Improved stability• improved meta-data performance
for better small file throughput• replicated data for immutable files• Supports SSD for MetadataStill…• Empower Research• Community Driven• 100% Open Source
Faster InnovationTo Production Ready
Systems
Professional Dev Team &
Practices
Community
Research
![Page 4: The Next Evolution of PVFS](https://reader035.fdocuments.us/reader035/viewer/2022062218/56815b95550346895dc99a2f/html5/thumbnails/4.jpg)
OrangeFS… (This Year 2.8.5 & 2.8.6)Will Bring…
• Distributed Directories• Based on / Derived from Giga+
• Capability Based Security• Enhanced Client Libraries• Can preload for applications that use standard
POSIX calls• Client Side Caching (Single System Coherence)
• Windows Client (with Certificate based Authentication)
• WebDav Library (mod_dav_orangefs)• Enhanced performance Counters and
Debugging Tools
![Page 5: The Next Evolution of PVFS](https://reader035.fdocuments.us/reader035/viewer/2022062218/56815b95550346895dc99a2f/html5/thumbnails/5.jpg)
Where is OrangeFS Going Ex
a
Tera-Peta
Enterprise Computing
Workstations
![Page 6: The Next Evolution of PVFS](https://reader035.fdocuments.us/reader035/viewer/2022062218/56815b95550346895dc99a2f/html5/thumbnails/6.jpg)
Similar Requirements Differing Reasons
Exascale• Data / IO
growth
• Resilience
• Security
• Management
• Decade old problem on an exponential path
• Something is always down
• Distributed User-base
• Mass System Management
Enterprise / otherResearch Areas• Glimpse of the
HEC Space
• Up-Time
• Shared File Systems
• Ease of Administration
![Page 7: The Next Evolution of PVFS](https://reader035.fdocuments.us/reader035/viewer/2022062218/56815b95550346895dc99a2f/html5/thumbnails/7.jpg)
OrangeFS-Next…• 128bit UUID Handles• Data Replication• Lazy, On Commit, Continuous• Data Tiering• Hardware Life-Cycle activities (keep the data
online)• Self Connecting Storage Nodes• Ultimately Storage nodes will not need to
know about all other nodes (~only ones it shares data with)• Nodes will need to understand locality,
classes of server, replica info• Background self healing processes
![Page 8: The Next Evolution of PVFS](https://reader035.fdocuments.us/reader035/viewer/2022062218/56815b95550346895dc99a2f/html5/thumbnails/8.jpg)
PXFS Sterling, Ligon
• ParalleX FS• Similar to PGAS (Partitioned Global
Address Space)• Active Messages (Sending Message
Invokes Thread)• Futures Synchronization
• Integrate the file system• Blur the line between memory and File
System• Highly Object Oriented (C++)• Exascale
Think of Bucky-Compute-Balls that can be flung to the data it needs