Introduction to Parallel Processing

35
Introduction to Parallel Processing Dr. Guy Tel-Zur Lecture 6

description

Introduction to Parallel Processing. Dr. Guy Tel- Zur Lecture 6. The Course Roadmap. Introduction. Message Passing. HPC. HTC. Today. Condor. Shared Memory. Next week. Exe #3. The Grid (EGEE). MPI. OpenMP. Cloud Computing. Agenda. A remark about Collective commands in MPI - PowerPoint PPT Presentation

Transcript of Introduction to Parallel Processing

Page 1: Introduction to Parallel Processing

Introduction to Parallel Processing

Dr. Guy Tel-ZurLecture 6

Page 2: Introduction to Parallel Processing

Exe #3

The Course RoadmapIntroduction

Message Passing

HTCHPC

Shared MemoryCondor

The Grid (EGEE)

Cloud Computing

MPI OpenMP

Next week

Today

Page 3: Introduction to Parallel Processing

Agenda• A remark about Collective commands in MPI• More MPI Demonstrations• Introduction to Condor (next week - lab)

– Users perspective– Admin. Perspective– Demo:

• How to install a Personal Condor• A test program

• Discussion about the Final presentations• Home assignment #2

Page 4: Introduction to Parallel Processing

http://eesgi2.ee.bgu.ac.il/

Page 5: Introduction to Parallel Processing

MPI• More MPI examples

– Dead lock example with collective commands.

Page 6: Introduction to Parallel Processing

פקודות קולקטיביות חייבות להינתן באותו הסדר לכל התהליכים בקומוניקטור

// Process A:MPI_Bcast(buf1, count, type, 0, comm);MPI_Bcast(buf2, count, type, 1, comm);break;// Process B (reverse broadcast):MPI_Bcast(buf2, count, type, 1, comm);MPI_Bcast(buf1, count, type, 0, comm);

From: “Grid Computing for Developers” book, by VLADIMIR SILVA

Page 7: Introduction to Parallel Processing

Makefile tutorial• http://www.eng.hawaii.edu/Tutor/Make/

Page 8: Introduction to Parallel Processing

Condor• Online manual:

http://www.cs.wisc.edu/condor/manual/v7.4• Next presentation:

– 2010 Condor Week– Nick LeRoy presentation: Condor User Tutorial– URL:

http://www.cs.wisc.edu/condor/CondorWeek2010/condor_presentations.html

Page 9: Introduction to Parallel Processing

Installing Condor (7.4.2 – current)“Personal” Condor on Windows (Vista)

Version 7.4.2. Released on April 6, 2010

Page 10: Introduction to Parallel Processing

Cont’

Page 11: Introduction to Parallel Processing

Cont’

Page 12: Introduction to Parallel Processing

Cont’

Page 13: Introduction to Parallel Processing

Cont’

Page 14: Introduction to Parallel Processing

Cont’

Click on Install

Page 15: Introduction to Parallel Processing

Cont’

Give Administrator rights to the installer

Page 16: Introduction to Parallel Processing

Cont’

restart

Page 17: Introduction to Parallel Processing

The Condor service should be startedIf needed restart the service here

Page 18: Introduction to Parallel Processing

At least the five Condor daemons should be running

Page 19: Introduction to Parallel Processing

Condor config

Page 20: Introduction to Parallel Processing

Condor config_local

You will find both configuration files under the install dir c:\condor

Page 21: Introduction to Parallel Processing

condor_status

Good! So now we have a Personal Condor running on my laptop

Page 22: Introduction to Parallel Processing

Demo: cpu_burn.c#include <math.h>#include <stdio.h>

int main() { int iMAX = 60000; int i,j; float fNORM, fMAX; float x,y; fMAX = iMAX; // convert to float fNORM = fMAX * fMAX; for (j=0;j<iMAX;j++) for (i=0;i<iMAX;i++) { y = i; // convert to float x = y*y/fNORM; } return 0;}

Page 23: Introduction to Parallel Processing

Submit file:universe = vanilla

executable = cpu_burn.exeError = err.$(Cluster).$(Process) Output = out.$(Cluster).$(Process) Log = log.$(Cluster).$(Process)

Queue 5

Page 24: Introduction to Parallel Processing

Watch the Task Manager

Page 25: Introduction to Parallel Processing

Check the logfile000 (088.001.000) 04/26 10:23:10 Job submitted from host: <127.0.0.1:50486>...001 (088.001.000) 04/26 10:23:19 Job executing on host: <127.0.0.1:50487>...005 (088.001.000) 04/26 10:24:20 Job terminated.

(1) Normal termination (return value 0)Usr 0 00:00:27, Sys 0 00:00:00 - Run Remote UsageUsr 0 00:00:00, Sys 0 00:00:00 - Run Local UsageUsr 0 00:00:27, Sys 0 00:00:00 - Total Remote

UsageUsr 0 00:00:00, Sys 0 00:00:00 - Total Local Usage

0 - Run Bytes Sent By Job15686 - Run Bytes Received By Job0 - Total Bytes Sent By Job15686 - Total Bytes Received By Job

...

Page 26: Introduction to Parallel Processing
Page 27: Introduction to Parallel Processing

Condor daemons while executing cpu_burn

Page 28: Introduction to Parallel Processing
Page 29: Introduction to Parallel Processing

Same job at the vdwarf

Show demo under: /users/agnon/misc/tel-zur/condor/cpuburn

Page 30: Introduction to Parallel Processing

Condor and Matlab/Octave demo

Page 31: Introduction to Parallel Processing

The submit file

Page 32: Introduction to Parallel Processing

The wrapper file

Page 33: Introduction to Parallel Processing
Page 34: Introduction to Parallel Processing

Final Presentationsעבור למצגת הרצאות גמר•

כל קבוצת תלמידים מתבקשת לבחור נושא להרצאת •גמר ואז לפעול כדלקמן:

את הדברים הבאים:[email protected]לשלוח אלי ל- –נושא ההרצאה )כותרת(•(PP-xxמספר הקבוצה )•שמות חברי הקבוצה•

אני אשיב לקבוצה באם הנושא אושר או לא! בטרם תקבלו –אישור ממני, אין להתחיל לעבוד על ההצעה שהגשתם!

Page 35: Introduction to Parallel Processing

זהו להפעם, תירגול 21.8שבוע הבא,

CONDOR34 בבניין 310במעבדה

18:00-21:00נוכחות חובה