Bringing The Grid Home for Grid2008
-
Upload
awesomesos -
Category
Technology
-
view
707 -
download
0
description
Transcript of Bringing The Grid Home for Grid2008
![Page 1: Bringing The Grid Home for Grid2008](https://reader034.fdocuments.us/reader034/viewer/2022051513/546d0b19af7959ea368b6def/html5/thumbnails/1.jpg)
1
Bringing the Grid Home
Chris Sosa, Andrew GrimshawUniversity of VirginiaOctober 1, 2008
![Page 2: Bringing The Grid Home for Grid2008](https://reader034.fdocuments.us/reader034/viewer/2022051513/546d0b19af7959ea368b6def/html5/thumbnails/2.jpg)
2
Introduction
c Grid
Explosion of Information
SystemsCyclone of Integration
![Page 3: Bringing The Grid Home for Grid2008](https://reader034.fdocuments.us/reader034/viewer/2022051513/546d0b19af7959ea368b6def/html5/thumbnails/3.jpg)
3
The Big Problem
Grid has little uptake
Hard to Use
Inflexible Security
Doesn’t play well with others
![Page 4: Bringing The Grid Home for Grid2008](https://reader034.fdocuments.us/reader034/viewer/2022051513/546d0b19af7959ea368b6def/html5/thumbnails/4.jpg)
4
Solution Criteria
Simple and
Familiar
Flexible Security
Standards-Based
Not Slow
![Page 5: Bringing The Grid Home for Grid2008](https://reader034.fdocuments.us/reader034/viewer/2022051513/546d0b19af7959ea368b6def/html5/thumbnails/5.jpg)
5
Bring in G-ICING
Users and applications are familiar with the filesystem
Grid-backend will appear as a network drive to users
![Page 6: Bringing The Grid Home for Grid2008](https://reader034.fdocuments.us/reader034/viewer/2022051513/546d0b19af7959ea368b6def/html5/thumbnails/6.jpg)
6
Talking to a Grid-Backend Resource Naming Service (RNS)
Basic directory services Entries may be added, deleted and listed
ByteIO Provides POSIX-like interface to resources Resources can be anything (database, a file, a host)
Who else uses it? ByteIO interoperability fiesta – UVa, Fujitsu, EPCC,
UNICORE CERN has a working RNS with LFC and is working on a
ByteIO implementation
![Page 7: Bringing The Grid Home for Grid2008](https://reader034.fdocuments.us/reader034/viewer/2022051513/546d0b19af7959ea368b6def/html5/thumbnails/7.jpg)
7
User to Kernel CommunicationDESIGN ALTERNATIVES
Local Procedure Calls Deprecated by MS Calls are synchronous
Inverted Call Model Takes advantage of the I/O mechanisms in WinNT User level program makes special I/O Request:
“Hello, I’m waiting for an operation” and Kernel mode stores it
Kernel forwards actual I/O requests, to the user mode by responding to the above I/O with the forwarded I/O call
![Page 8: Bringing The Grid Home for Grid2008](https://reader034.fdocuments.us/reader034/viewer/2022051513/546d0b19af7959ea368b6def/html5/thumbnails/8.jpg)
8
IFS Development in Windows
RDBSSI/O Sub SystemI/O RequestProgram
or OSI/O Request
IFSDriver
![Page 9: Bringing The Grid Home for Grid2008](https://reader034.fdocuments.us/reader034/viewer/2022051513/546d0b19af7959ea368b6def/html5/thumbnails/9.jpg)
9
G-ICING Design
UFSKMS Inverted Calls
Grid-backend
J ava VM
GIS
RN
S /
Byt
eIO
I/O Request JNI
![Page 10: Bringing The Grid Home for Grid2008](https://reader034.fdocuments.us/reader034/viewer/2022051513/546d0b19af7959ea368b6def/html5/thumbnails/10.jpg)
10
Kernel Management Service (KMS)
Installable File System Driver Network Redirector Kernel driver that interacts with other
Kernel components Communicates to User-mode UFS
with Inverted Call Model
![Page 11: Bringing The Grid Home for Grid2008](https://reader034.fdocuments.us/reader034/viewer/2022051513/546d0b19af7959ea368b6def/html5/thumbnails/11.jpg)
11
User Forwarding Service (UFS) Uses JNI to
communicate and forwards requests to GIS
Prompts user for credentials and obtains a delegated credential for use Flexible Security
through Delegation
![Page 12: Bringing The Grid Home for Grid2008](https://reader034.fdocuments.us/reader034/viewer/2022051513/546d0b19af7959ea368b6def/html5/thumbnails/12.jpg)
12
Grid Interface Service (GIS) Converts FS
requests into ByteIO/RNS calls
Caches meta-information from ByteIO/RNS
Only interface to Grid-backend
Meta-data Caching
![Page 13: Bringing The Grid Home for Grid2008](https://reader034.fdocuments.us/reader034/viewer/2022051513/546d0b19af7959ea368b6def/html5/thumbnails/13.jpg)
13
Prototype in Action
![Page 14: Bringing The Grid Home for Grid2008](https://reader034.fdocuments.us/reader034/viewer/2022051513/546d0b19af7959ea368b6def/html5/thumbnails/14.jpg)
14
Prototype in Action (Continued)
![Page 15: Bringing The Grid Home for Grid2008](https://reader034.fdocuments.us/reader034/viewer/2022051513/546d0b19af7959ea368b6def/html5/thumbnails/15.jpg)
15
Evaluation Usability (compared to the alternatives)
Shell Extension (not app transparent) Posix-like libraries (neither user or app
transparent) Special libraries – application transparent only if
recompiled (can't with COTS or Legacy) Security
Depends on the Grid-backend but prototype is compatible with a flexible delegation model
Standards – RNS, ByteIO Performance – Coming up …
![Page 16: Bringing The Grid Home for Grid2008](https://reader034.fdocuments.us/reader034/viewer/2022051513/546d0b19af7959ea368b6def/html5/thumbnails/16.jpg)
16
Performance Evaluation Setup Client
Single-core 2.34 GHz desktop machine with 1GB memory running WinXP
100 Mbps connection Grid-Backend
Genesis II running on seven 8-core Xeon processors running at 2.33 GHz with 16 GB memory
1 Gbps connection
![Page 17: Bringing The Grid Home for Grid2008](https://reader034.fdocuments.us/reader034/viewer/2022051513/546d0b19af7959ea368b6def/html5/thumbnails/17.jpg)
17
Performance Evaluation
G-ICING R/W with Varying Record Size
1
10
100
1000
10000
100000
4 8 16 32 64 128 256
Record Size in KB
KB
/S
CIFS Write CIFS Read IFS Write IFS Read
![Page 18: Bringing The Grid Home for Grid2008](https://reader034.fdocuments.us/reader034/viewer/2022051513/546d0b19af7959ea368b6def/html5/thumbnails/18.jpg)
18
Future Work
1. Improve performance On-disk caching of data of both ByteIO and RNS data Research in location-aware caching
2. Implementation and Comparison to different FS mechanisms in other OSs
3. Stretching RNS / ByteIO interfaces to perform more Grid services
![Page 19: Bringing The Grid Home for Grid2008](https://reader034.fdocuments.us/reader034/viewer/2022051513/546d0b19af7959ea368b6def/html5/thumbnails/19.jpg)
19
Conclusions
Grids are still too difficult to use for both users and applications
Can extend the filesystem paradigm in Windows to bring the Grid to users
![Page 20: Bringing The Grid Home for Grid2008](https://reader034.fdocuments.us/reader034/viewer/2022051513/546d0b19af7959ea368b6def/html5/thumbnails/20.jpg)
20
Related Work LUFS and FUSE are filesystem in user-space
technologies for UNIX / Mac Lack support for Windows Tied to UNIX security semantics
Open AFS creates a modified Samba server but stuck to Samba/CIFS security model
Gfarm uses FUSE + syscall hook library Same problems with just FUSE Overly complex for Windows, requires set up of a
separate Linux box to forward messages through Glite provides POSIX-like interface that is neither user
or application transparent
![Page 21: Bringing The Grid Home for Grid2008](https://reader034.fdocuments.us/reader034/viewer/2022051513/546d0b19af7959ea368b6def/html5/thumbnails/21.jpg)
21
Questions
?