ITCS 4/5010 GPU Programming, UNC-Charlotte, B. Wilkinson, Jan 14, 2013 CUDAProgModel
1 Grid Computing Barry Wilkinson Department of Computer Science University of North Carolina at...
-
Upload
scot-turner -
Category
Documents
-
view
221 -
download
2
Transcript of 1 Grid Computing Barry Wilkinson Department of Computer Science University of North Carolina at...
![Page 1: 1 Grid Computing Barry Wilkinson Department of Computer Science University of North Carolina at Charlotte.](https://reader036.fdocuments.us/reader036/viewer/2022062408/56649e5d5503460f94b56c47/html5/thumbnails/1.jpg)
1
Grid Computing
Barry WilkinsonDepartment of Computer Science
University of North Carolina at Charlotte
![Page 2: 1 Grid Computing Barry Wilkinson Department of Computer Science University of North Carolina at Charlotte.](https://reader036.fdocuments.us/reader036/viewer/2022062408/56649e5d5503460f94b56c47/html5/thumbnails/2.jpg)
2
Grid Computing
• Using geographically distributed and interconnected computers together for computing and for resource sharing.
![Page 3: 1 Grid Computing Barry Wilkinson Department of Computer Science University of North Carolina at Charlotte.](https://reader036.fdocuments.us/reader036/viewer/2022062408/56649e5d5503460f94b56c47/html5/thumbnails/3.jpg)
3
“The grid virtualizes heterogeneous geographically disperse resources” from "Introduction to Grid Computing with Globus," IBM Redbooks
![Page 4: 1 Grid Computing Barry Wilkinson Department of Computer Science University of North Carolina at Charlotte.](https://reader036.fdocuments.us/reader036/viewer/2022062408/56649e5d5503460f94b56c47/html5/thumbnails/4.jpg)
4
Need to harness computers
Original driving force behind grid computing the same as behind the early development of networks that became the Internet:
– Connecting computers at distributed sites for high performance computing.
![Page 5: 1 Grid Computing Barry Wilkinson Department of Computer Science University of North Carolina at Charlotte.](https://reader036.fdocuments.us/reader036/viewer/2022062408/56649e5d5503460f94b56c47/html5/thumbnails/5.jpg)
5
Virtual Organization
Usually, grid computing involves teams working together on a common goal, sharing computing resources and possibly experimental equipment.
Geographically distributed grid computing team called a virtual organization.
The resources shared include software and experimental data. Crosses multiple administrative domains.
![Page 6: 1 Grid Computing Barry Wilkinson Department of Computer Science University of North Carolina at Charlotte.](https://reader036.fdocuments.us/reader036/viewer/2022062408/56649e5d5503460f94b56c47/html5/thumbnails/6.jpg)
6
Resource sharing and collaborative computing
• Grid computing is about collaborating and resource sharing as much as it is about high performance computing.
• Can share much more than just computers:– Storage– Sensors for experiments at particular sites– Application Software– Databases– Network capacity, …
![Page 7: 1 Grid Computing Barry Wilkinson Department of Computer Science University of North Carolina at Charlotte.](https://reader036.fdocuments.us/reader036/viewer/2022062408/56649e5d5503460f94b56c47/html5/thumbnails/7.jpg)
7
Applications
• Originally e-Science applications– Computational intensive
• Not necessarily one big problem but a problem that has to be solved repeatedly with different parameters.
– Data intensive.– Experimental collaborative projects
• Now also e-Business applications to improve business models and practices.
![Page 8: 1 Grid Computing Barry Wilkinson Department of Computer Science University of North Carolina at Charlotte.](https://reader036.fdocuments.us/reader036/viewer/2022062408/56649e5d5503460f94b56c47/html5/thumbnails/8.jpg)
8
Interconnections and ProtocolsUsually grid computing employs the Internet to interconnect the computers.Standard Internet protocols are used.
Focus now on using standard Internet protocols and technology, i.e. HTTP, SOAP, web services, etc.
![Page 9: 1 Grid Computing Barry Wilkinson Department of Computer Science University of North Carolina at Charlotte.](https://reader036.fdocuments.us/reader036/viewer/2022062408/56649e5d5503460f94b56c47/html5/thumbnails/9.jpg)
9
Web Services-Based Grid Computing
• Grid Computing now strongly based upon web services.
• Large number of newly proposed grid computing standards:– WS-Resource Framework (WSRF)– WS-Addressing– etc., etc. …. .
![Page 10: 1 Grid Computing Barry Wilkinson Department of Computer Science University of North Carolina at Charlotte.](https://reader036.fdocuments.us/reader036/viewer/2022062408/56649e5d5503460f94b56c47/html5/thumbnails/10.jpg)
10
History
• Began in mid 1990’s with experiments using computers at geographically dispersed sites.
• Seminal experiment – “I-way” experiment at 1995 Supercomputing conference (SC’95), using 17 sites across the US running:– 60+ applications.– Existing networks (10 networks).
![Page 11: 1 Grid Computing Barry Wilkinson Department of Computer Science University of North Carolina at Charlotte.](https://reader036.fdocuments.us/reader036/viewer/2022062408/56649e5d5503460f94b56c47/html5/thumbnails/11.jpg)
11
1995 2000 200519901985
Distributed computing
Remote Procedure calls (RPC)Concept of service registry
Beginnings of service oriented architecture
Object oriented approachesJava Remote Method Invocation (RMI)
CORBA (Common Request Broker Architecture)
Cluster computing
Software Techniques:
Computing platforms:
Parallel computers
Geographically distributed computers (Grid computing in the broadest sense)
Web services
SC’95 experiment
![Page 12: 1 Grid Computing Barry Wilkinson Department of Computer Science University of North Carolina at Charlotte.](https://reader036.fdocuments.us/reader036/viewer/2022062408/56649e5d5503460f94b56c47/html5/thumbnails/12.jpg)
12
Computational Grid Applications
• Biomedical research
• Industrial research
• Engineering research
• Studies in Physics and Chemistry
![Page 13: 1 Grid Computing Barry Wilkinson Department of Computer Science University of North Carolina at Charlotte.](https://reader036.fdocuments.us/reader036/viewer/2022062408/56649e5d5503460f94b56c47/html5/thumbnails/13.jpg)
NSF Network for Earthquake Engineering Simulation (NEES)
Transform our ability to carry out research vital to reducing vulnerability to catastrophic earthquakes
I. Foster
![Page 14: 1 Grid Computing Barry Wilkinson Department of Computer Science University of North Carolina at Charlotte.](https://reader036.fdocuments.us/reader036/viewer/2022062408/56649e5d5503460f94b56c47/html5/thumbnails/14.jpg)
14
Earth System Grid I. Foster
![Page 15: 1 Grid Computing Barry Wilkinson Department of Computer Science University of North Carolina at Charlotte.](https://reader036.fdocuments.us/reader036/viewer/2022062408/56649e5d5503460f94b56c47/html5/thumbnails/15.jpg)
15
Grid networks for collaborative grid computing projects
Grids have been set up at the local level, national level, and international level throughout the world, to promote grid computing
![Page 16: 1 Grid Computing Barry Wilkinson Department of Computer Science University of North Carolina at Charlotte.](https://reader036.fdocuments.us/reader036/viewer/2022062408/56649e5d5503460f94b56c47/html5/thumbnails/16.jpg)
16
CiscoEPA
North Carolina’s Foundation for Grid: NCREN
4-7 MCNC-owned Clusters distributed throughout the stateLocations still under evaluation
Internet Internet 2
NLR
Internet Internet 2
NLR
InternetInternet
Existing: Blend of owned and leased fiber and circuits moving toward resilient rings powered by Cisco routers
Planned: Strong focus on owned and leased fiber, Lambda, and few circuits, in resilient rings powered by Cisco routers and Wave Division Multiplexers
Close to home:
From “Grid Computing in the Industry” by Wolfgang Gentzsch, presentation to Fall 2004 grid computing course. Full set of slides on course home page.
![Page 17: 1 Grid Computing Barry Wilkinson Department of Computer Science University of North Carolina at Charlotte.](https://reader036.fdocuments.us/reader036/viewer/2022062408/56649e5d5503460f94b56c47/html5/thumbnails/17.jpg)
17
TeraGridFunded by NSF in 2002 to link 5 supercomputer sites
with 40 Gb/s links
![Page 18: 1 Grid Computing Barry Wilkinson Department of Computer Science University of North Carolina at Charlotte.](https://reader036.fdocuments.us/reader036/viewer/2022062408/56649e5d5503460f94b56c47/html5/thumbnails/18.jpg)
18
National GridsMany countries have embraced grid computing and set-up grid computing infrastructure:
• UK e-Science grid• Grid-Ireland• NorduGrid• DutchGrid• POINIER grid (Poland)• ACI grid (France)• Japanese grid• etc, etc., …
![Page 19: 1 Grid Computing Barry Wilkinson Department of Computer Science University of North Carolina at Charlotte.](https://reader036.fdocuments.us/reader036/viewer/2022062408/56649e5d5503460f94b56c47/html5/thumbnails/19.jpg)
19
UK e-Science Grid
![Page 20: 1 Grid Computing Barry Wilkinson Department of Computer Science University of North Carolina at Charlotte.](https://reader036.fdocuments.us/reader036/viewer/2022062408/56649e5d5503460f94b56c47/html5/thumbnails/20.jpg)
20
Globus Project
• Open source software toolkit developed for grid computing.
• Roots in I-way experiment.• Work started in 1996. • Four versions developed to present time.• Reference implementations of grid computing
standards.• Defacto standard for grid computing.
![Page 21: 1 Grid Computing Barry Wilkinson Department of Computer Science University of North Carolina at Charlotte.](https://reader036.fdocuments.us/reader036/viewer/2022062408/56649e5d5503460f94b56c47/html5/thumbnails/21.jpg)
21
• GSI (Grid Security Infrastructure)– Grid security.
• MDS (Monitoring and discovery Service)– Interface to system and service information.
• GRAM (Grid Resource Allocation Manager) – Remote job submission and control.
• GridFTP– Secure data transfer.
GlobusKey Components
![Page 22: 1 Grid Computing Barry Wilkinson Department of Computer Science University of North Carolina at Charlotte.](https://reader036.fdocuments.us/reader036/viewer/2022062408/56649e5d5503460f94b56c47/html5/thumbnails/22.jpg)
22
Globus Toolkit: Recent History
• GT2 (2.4 released in 2002)– GRAM, MDS, GridFTP, GSI.
• GT3 (3.2 released mid-2004): redesign– OGSA (Open Grid Service Architecture)/OGSI (Open
Grid Services Infrastructure) based.– Introduced “Grid services” as an extension of web
services.– OGSI now abandoned.
• GT4 (released April 2005): major redesign– WSRF (Web service Resource Framework) based.– Grid standards merged with Web services.
![Page 23: 1 Grid Computing Barry Wilkinson Department of Computer Science University of North Carolina at Charlotte.](https://reader036.fdocuments.us/reader036/viewer/2022062408/56649e5d5503460f94b56c47/html5/thumbnails/23.jpg)
23
Grid Computing Course• Instructors: Barry Wilkinson and Clayton Ferner• Several faculty and students significantly helped at
various sites – “virtual organization”• In Fall 2004, 43 students took course at 8 institutions
Fall 2004 Participating Sites
(Fall 2005)
![Page 24: 1 Grid Computing Barry Wilkinson Department of Computer Science University of North Carolina at Charlotte.](https://reader036.fdocuments.us/reader036/viewer/2022062408/56649e5d5503460f94b56c47/html5/thumbnails/24.jpg)
24
Fall 2004 Guest Speakers• Professor Daniel A. Reed, Chancellor's Eminent Professor,
Vice Chancellor for IT and CIO, UNC-Chapel Hill:
– “Grid computing: 21st Century Challenges.” • Dr. Wolfgang Gentzsch, Managing Director, MCNC Grid
Computing and Networking Services:
– “Grid Computing in the Industry”• Chuck Kesler, Director, Grid Deployment and Data Center
Services, MCNC:
– “Security Policy, Legal, and Regulatory Challenges in Grid Computing Environments”
• Professor Ian Foster: Ian Foster, Argonne National Laboratory and University of Chicago:
– “The Grid: Beyond the Hype”Taped presentation (originally given at Duke University, Sept. 14, 2004).
![Page 25: 1 Grid Computing Barry Wilkinson Department of Computer Science University of North Carolina at Charlotte.](https://reader036.fdocuments.us/reader036/viewer/2022062408/56649e5d5503460f94b56c47/html5/thumbnails/25.jpg)
25
Fall 2005 Grid Computing Course
Currently being taught with 12 institutions participating.
About 40 students.
![Page 26: 1 Grid Computing Barry Wilkinson Department of Computer Science University of North Carolina at Charlotte.](https://reader036.fdocuments.us/reader036/viewer/2022062408/56649e5d5503460f94b56c47/html5/thumbnails/26.jpg)
26
Course virtual organizationCurrent list of sites receiving course:
• Appalachian State University• Elon University• Lenoir Rhyne College • NC State University• University of North Carolina at Asheville• University of North Carolina at Charlotte• University of North Carolina, Chapel Hill (grad student, not for credit)
• University of North Carolina at Pembroke• University of North Carolina at Wilmington• Wake Technical Community College (Faculty in attendance)
• Western Carolina University• Winston-Salem State University
![Page 27: 1 Grid Computing Barry Wilkinson Department of Computer Science University of North Carolina at Charlotte.](https://reader036.fdocuments.us/reader036/viewer/2022062408/56649e5d5503460f94b56c47/html5/thumbnails/27.jpg)
27
Fall 2005 Guest speakers
• Lavanya Ramakrishnan, The Renaissance Computing Institute (RENCI), University of North Carolina at Chapel Hill, North Carolina State University, and Duke University.
• Team from SURAGrid, a working grid with more than 19 institutions across the country. Details of presentation being worked out.
![Page 28: 1 Grid Computing Barry Wilkinson Department of Computer Science University of North Carolina at Charlotte.](https://reader036.fdocuments.us/reader036/viewer/2022062408/56649e5d5503460f94b56c47/html5/thumbnails/28.jpg)
28
Fall 2005 Course grid structurewith Certificate Authorities
WCU
UNC-C
UNC-A
NCSU
ASU
MCNC
CA
CA
CA
CACA
CA
![Page 29: 1 Grid Computing Barry Wilkinson Department of Computer Science University of North Carolina at Charlotte.](https://reader036.fdocuments.us/reader036/viewer/2022062408/56649e5d5503460f94b56c47/html5/thumbnails/29.jpg)
29
Users certified by a local CA
UNC-C
CA
![Page 30: 1 Grid Computing Barry Wilkinson Department of Computer Science University of North Carolina at Charlotte.](https://reader036.fdocuments.us/reader036/viewer/2022062408/56649e5d5503460f94b56c47/html5/thumbnails/30.jpg)
30
CA’s with Mutual Trust
UNC-C
CA
NCSU
CA
![Page 31: 1 Grid Computing Barry Wilkinson Department of Computer Science University of North Carolina at Charlotte.](https://reader036.fdocuments.us/reader036/viewer/2022062408/56649e5d5503460f94b56c47/html5/thumbnails/31.jpg)
31
More information on course
Course home page
http://www.cs.uncc.edu/~abw/ITCS4010F05
![Page 32: 1 Grid Computing Barry Wilkinson Department of Computer Science University of North Carolina at Charlotte.](https://reader036.fdocuments.us/reader036/viewer/2022062408/56649e5d5503460f94b56c47/html5/thumbnails/32.jpg)
32
Acknowledgements
Partial support for this work was provided by the National Science Foundation’s Course, Curriculum, and Laboratory Improvement program under grants 0410667 and 0533334 (with supplementary funding)
and
by two grants from University of North Carolina, Office of the President. One of these grants provided computing equipment at 9 sites, including UNC-C