outline.1

Grid Computing

Fall 2011

Tuesday/Thursday 9:30 am - 10:45 pm

Instructors

© 2011 B. Wilkinson/Clayton Ferner. Modification date: Aug 22, 2011

Dr. Clayton FernerUniversity of North Carolina

Wilmington

Dr. Barry WilkinsonUniversity of North Carolina

Charlotte

outline.2

Grid ComputingUsing geographically distributed and interconnected computers together for computing and for resource sharing.

“The grid virtualizes heterogeneous geographically disperse resources” from "Introduction to Grid Computing with Globus," IBM Redbooks

outline.3

Virtual OrganizationUsually, grid computing involves teams working together on a common goal, sharing computing resources and possibly experimental equipment.

The geographically distributed grid computing team and their resources is called a virtual organization.

The resources shared include software and experimental data.

outline.4

Interconnections

Usually grid computing employs the Internet to interconnect the computers.

Standard Internet protocols are used.

Grid Course

• Rather unique - combine distance learning techniques with distributed computer systems creating both a virtual organization of students and a distributed Grid computing platform.

• Provides hands-on experiences of Grid computing software and the underlying techniques

outline.5

Student Learning Outcomes(What you will know or be able to do at the end

of the semester)

1. Students gain knowledge of the concepts of Grid computing including: job management, security, certificates and digital signatures, scheduling, web and grid services, index services, notification, and workflow management and portal tools.

2. Students gain knowledge of the infrastructure and mechanics of the software that implements a Grid.

3. Students implement algorithms in grid services.

4. Students implement a solution to a problem that requires the use of multiply Grid resources at multiply sites.

outline.7

Course creditThis course can be taken by students at any university connected to the NCREN, for credit at their institution.

Course number assigned by the institution.

Listed as an undergraduate course but can be taken for graduate credit with approval of your institution.

More expected from graduate students.

outline.8

Course virtual organizationSix sites:•Appalachian State University•East Carolina University•University of North Carolina, Ashville•University of North Carolina, Charlotte•University of North Carolina, Wilmington•Winston-Salem State University

outline.9

Course grid structure - primary sites

UNC-W

UNC-C

Course portal(on coit-grid02.uncc.edu)

torvalds.cis.uncw.edu

coit-grid01.uncc.educoit-grid02.uncc.educoit-grid03.uncc.educoit-grid04.uncc.educoit-grid05.uncc.educoit-grid06.uncc.educoit-grid07.uncc.edu

Certificate Authority on both UNCC cluster and UNCW cluster (see later)

coit-grid01-4: Each two Xeon processors(3.4Ghz) 8GB main memory

coit-grid05: Dell R900, four quad-core Xeon processors (2.93Ghz)64GB main memory1.2 TB disk

coit-grid01

switch

coit-grid05

coit-grid03

coit-grid02

coit-grid04

All user’s home directories on coit-grid05 (NFS)

UNCC clustercoit-grid01.uncc.edu – coit-grid7.uncc.edu

coit-grid06

NVIDIA Tesla GPU

(448 core Fermi)

Login from within the

campus onlyLogin from on-campus or off-campus

Use coit-grid01.uncc.edu

coit-grid07

NVIDIA Tesla GPU

(448 core Fermi)

coit-grid07: GPU server, X5560 2.8GHz quad-core Xeon processor with NVIDIA 2050 GPU, 12GB main memory

• Six Dell PowerEdge 1850 Servers 2.8 Ghz quad-core processors

• Nine Sunfire X4100 servers 2.6 Ghz quad-core processors

UNCW clustertorvalds.cis.uncw.edu

outline.12

Class scheduleEach university has its own class schedule, see:

http://www.cs.uncc.edu/~abw/ITCS4146F11/academiccalender.html

Classes will start on Tuesday August 23, 2011 and will end on Tuesday Dec 6, 2011.to accommodate different schedules. 

 

outline.13

outline.14

Prerequisites• Programming skills as acquired by typical junior/ senior undergraduate Computer Science student.

• Programs either (simple) C programs or (simple) Java programs depending upon context.

It is expected that you have a computer (PC or mac)!

Some work best done on your own computer.

Grid computing platform is a Linux system.

You will need to be able to perform (simple) Linux system commands. We provide documentation.

outline.15

Course Home Page

http://www.csc.uncw.edu/~cferner/ITCS4146F11/index.html

or

http://www.cs.uncc.edu/~abw/ITCS4146F11

for announcements, slides, assignments, reading materials, tests dates, etc.

Visit regularly.

outline.16http://www.cs.uncc.edu/~abw/ITCS4146F11

outline.17

Course TextGrid Computing: Techniques and Applications

Barry WilkinsonUniversity of North Carolina, Charlotte

Chapman & Hall/CRCTaylor and Francis Group LLC, 2009

ISBN: 978-1-4200-6953-2

http://coitweb.uncc.edu/~abw/GridComputingBook/index.html

outline.18

Outline of Topics

• Introduction to distributed/Grid computing• Job management, schedulers• Workflow• Grid computing system infrastructure design• Grid computing security• Portal software design• Grid-enabling applications• Grid computing using pattern-programming (new for 2011)

• HPC cloud computing (new for 2011)

More details of course home page

outline.19

Assignments and Grading• 7-8 assignments covering:

– Job submission, thro portal, command line– Job scheduling– Workflow editor– Grid services– Portlet design– Possibly assignment on new 2011 materials

Each assignment 1-2 weeks. Detailed assignment write-ups, see course home page.

• Class tests/on-line quizzes (2)• Final test/on-line quiz• Small print: Subject to change. The instructor reserves the right to change the assignments and the grading to make it easier or harder.

60%

25%15%

Small print

outline.20

Prewritten Programming Assignments

• Detailed instructions provided on achieving a task (creating a grid/web service, running a GT 4 job, etc.)

• Simply follow instructions.

• At end, typically asked to extend the work – e.g. add functionality to a service.

• Write a report of what you did and submit through Moodle, see later for details.

outline.21

Systems and SoftwareTwo types of systems used:

• Grid computing servers

- Will be used for some assignments, most notably to schedule and run jobs.

- Access:• Through a web-based portal, or • Though an ssh connection.

depending upon assignment

outline.22

• Lab or personal PCs

• Will be used for some assignments. • Require specific open-source software packages

installed. • Packages can easily be downloaded and

installed on your own PC, so that you can do the work at home.

• Ideally students should install these software packages on their own system as directed in assignments to do assignments. You will learn so much!

outline.23

Instructors details

UNC-CharlotteBarry Wilkinson

Department of Computer ScienceUniversity of North Carolina, Charlotte

Home page: http://www.cs.uncc.edu/~abwEmail: abw@uncc.edu

Office HoursTuesday/Thursday: 11:00 am to 12:30 pm 

outline.24

Instructors details

UNC-WilmingtonClayton Ferner

Department of Computer ScienceUniversity of North Carolina Wilmington

Home page: http://people.uncw.edu/cferner Email: cferner@uncw.edu

Office HoursMW: 8:30 am to11:00 am

outline.25

ExpectationsRead all materials provided.

Read slides before class. Take additional notes during class

Ask questions during class and participate in class discussion.

outline.26

NCREN facility(North Carolina Research and

Education Network)

Site interaction

Each site will be using their NCREN facility, which provides microphones for individuals to speak.

Please feel fee to speak at suitable times but remember that NCREN needs to be able to recognize the site and speaker, so first announce your institution and name.

outline.27

NCREN facilitycontinued

• Since most microphones are turned on all the time, any sound will be heard across all sites unless a site turns their microphones off, so try to avoid unnecessary sounds.

• Fans from a laptop can be especially disturbing, so move laptop away from a microphone.

• Turn cell phones off.

outline.28

NCREN Video Class Recording

The lectures are available after 24 hours.

 

Details to be provided.

outline.29

Acknowledgements

Partial support for this work was provided by the National Science Foundation’s Course, Curriculum, and Laboratory Improvement program under grants #0410667/0533334 and #0737318/0737269/0737208 and by University of North Carolina, Office of the President.

Their support is gratefully acknowledged.

Any opinions, findings, and conclusions or recommendations expressed in this material are those of the authors and do not necessarily reflect the views of the National Science Foundation.

Questions

outline.30

Questions

What is Grid Computing?

a)Using geographically distributed and interconnected computers together for computing and for resource sharing

b)Using the Internet

c)Using distance computers

d)Using computers geographically distributed

outline.31

outline.32

QuestionsWhat is a virtual organization?

a)A grid computing team and their resources

b)A geographically distributed team

c)The geographically distributed grid computing team and their resources

d)A geographically distributed set of resources

outline.33

Questions

What should you do if you miss a class?

a)Drop the course

b)Forget about it

c)Ask a classmate what you missed

d)View the video of the lecture