Grid Computing

UITS IT Seminar SeriesJune 2001

Beyond the Net, lies the Grid.

The Net allows users everywhere to share information.

The Grid will allow users to share raw computing power.

– It’s under construction.

What is a Grid?

persistent networked environments integrating geographically distributed supercomputers, large databases, and high end instruments

coordinated resource sharing and problem solving in dynamic virtual organizations

Grid computing is related to but not identical with

Parallel computing

Distributed computing

Pervasive computing

Who is building them?Demonstration – SC98TransPac link from Internet2 to APAN

NASA, DOE, DOD, NSF

It’s for real.Used to construct:

• collaborative engineering systems • real-time instrument control systems • problem solving environments • to perform record-setting scientific

simulations.

You don’t have to be a computer scientist…

The bandwagon

Student Technology CentersNearly 1000 new computers Fast ethernet connections

SETI@Home screensaver accumulated CPU-hours at the rate of 552 processors on a 24x7 basis

Challenges: resource management, security, migration

Testbed project – Condor

The goal is to create …

A scalable, seamless extension of your access point – through pervasive networks

to a set of resources– tied together by a set of ubiquitous

common distributed services.

A scalable, seamless extension of your access point through

pervasive networks ...

A scalable, seamless extension of your access point through pervasive networks to

a set of resources …

Parallel computing is harder•There’s more to think about.

•The technology is less mature.

It need not even help• Moving bits is slower than crunching them.• Formula for success: communication/computation

<< 1

A scalable, seamless extension of your access point through pervasive networks to a set of resources

tied together by common services.

To Do:Building the middleware, protocols, interoperable communications libraries

Building resource management

Building social infrastructure

•Economic exchange mechanisms

Building on the Internet, the WWW

Uniform naming

A seamless, scalable information service

A powerful new meta-data language: XML

SOAP - simple object access protocol - • Uses XML for message encoding, HTTP for protocol.• XML-RPC may become standard mechanism for Grid Services.

Why bother? Because you have to.

Big calculations – more processors, more memory

Other reasons: Share resources Share ideas

Who is building the Grid at IU?

Computer Science and Engineering departments

Other departments

UITS

IUB CS Department Extreme Computing Group

Current Projects • Science Portals • Common Component Architecture Toolkit • SoapRMI • The CoGBox

Current Collaborations • Globus Project, Argonne National Lab • GRADS, the Grid Application Development Software

Project • GriPhyN, the Grid Physics Network

IUPUI CS Department

Software development for large-scale decentralized heterogeneous distributed systems

SIFTR – adaptive information agents

Workshop at Indiana University June 14-15, 2000 Developing a GriPhyN testbed for ATLAS

Data Grids – Linking Instruments, Storage, and Analysis

IUB Chemistry –Crystallography

Reciprocal Net

XPort - A Grid-based Collaboratory for Real-time Data Acquisition, Reduction and Visualization for Macromolecular X-Ray Crystallography Using the LBL Advanced Light Source

IUPUI Mechanical Engineering - CFD Lab

Dynamic Load Balancing

StarLab ProjectSpecialized instruments, Data Grids

• GRAPE computers – Tokyo• AMNH Planetarium – New York• HPSS – Indianapolis (NOCs!)

Throughput testing with Three Classes

0

5

10

15

20

25

30

35

Time

Me

ga

bit

s p

er

se

c

QBSS

BE

Pri

What is The Grid?The Grid : Blueprint for a New Computing

Infrastructure, ed. Ian Foster, Carl Kesselman, Morgan Kaufmann 1999.

If you really want to know …

B649 Topics in Systems: Distributed Computing

EE 563 Programming Parallel Machines

CSCI 537 Introduction to Distributed Computing

Useful links:High Performance Computing Support

• http://www.indiana.edu/~rac/hpc/Class Web Pages

• http://dpis.engr.iupui.edu/Courses/ee595.htm• http://www.cs.indiana.edu/classes/b649/

Laboratories• http://www.iumsc.indiana.edu/• http://www.engr.iupui.edu/cfdlab/• http://www.indiana.edu/~uits/hpnap/

Indiana Pervasive Computing Research (IPCRES) Initiative• http://www.indiana.edu/~ovpit/ipcres/

Grid Computing Info Centre (GRID Infoware)• http://www.gridcomputing.com/

EnterTheGrid• http://www.hoise.com/enterthegrid/

NASA’s Information Power Grid• http://www.nas.nasa,gov/About/IPG/ipg.html

GriPhyN / ATLAS in NY Times• http://www.nytimes.com/2000/09/28/technology/28NEXT.html