CSF4 Meta-Scheduler PRAGMA13 Zhaohui Ding [email protected]@email.jlu.edu.cn...

11
CSF4 Meta-Scheduler PRAGMA13 Zhaohui Ding [email protected] or [email protected] College of Computer Science & Technology Jilin University

TAGS:

Transcript of CSF4 Meta-Scheduler PRAGMA13 Zhaohui Ding [email protected]@email.jlu.edu.cn...

Page 1: CSF4 Meta-Scheduler PRAGMA13 Zhaohui Ding zhaohui.ding@email.jlu.edu.cnzhaohui.ding@email.jlu.edu.cn or zhding@ucsd.eduzhding@ucsd.edu College of Computer.

CSF4 Meta-Scheduler

PRAGMA13

Zhaohui Ding

[email protected] or [email protected] of Computer Science & Technology

Jilin University

Page 2: CSF4 Meta-Scheduler PRAGMA13 Zhaohui Ding zhaohui.ding@email.jlu.edu.cnzhaohui.ding@email.jlu.edu.cn or zhding@ucsd.eduzhding@ucsd.edu College of Computer.

2

Agenda

CSF4 IntroductionCSF4 FunctionalitiesCurrent DeploymentDemo

Page 3: CSF4 Meta-Scheduler PRAGMA13 Zhaohui Ding zhaohui.ding@email.jlu.edu.cnzhaohui.ding@email.jlu.edu.cn or zhding@ucsd.eduzhding@ucsd.edu College of Computer.

3

CSF4

What is CSF Meta-Scheduler Full Name: Community Scheduler Framework CSF4 contains a group of grid services host in GT4 CSF4 is a full WSRF compliant meta-scheduler. Open Source project and can be accessed at

http://sourceforge.net/projects/gcsf Developed by Jilin University, China CSF4 has been added to Globus Toolkit 4 as an Executi

on Component

Page 4: CSF4 Meta-Scheduler PRAGMA13 Zhaohui Ding zhaohui.ding@email.jlu.edu.cnzhaohui.ding@email.jlu.edu.cn or zhding@ucsd.eduzhding@ucsd.edu College of Computer.

4

CSF4 in Globus Toolkit 4

Page 5: CSF4 Meta-Scheduler PRAGMA13 Zhaohui Ding zhaohui.ding@email.jlu.edu.cnzhaohui.ding@email.jlu.edu.cn or zhding@ucsd.eduzhding@ucsd.edu College of Computer.

5

What CSF4 Can Do?

Basic Functionalities Submit jobs to Grid without Specifying Cluster Monitor and Control Jobs Provide Queuing Service Schedule jobs and resource by custom-built poli

ces CSF4 Portlet (A Web browser based User Interf

ace)

Page 6: CSF4 Meta-Scheduler PRAGMA13 Zhaohui Ding zhaohui.ding@email.jlu.edu.cnzhaohui.ding@email.jlu.edu.cn or zhding@ucsd.eduzhding@ucsd.edu College of Computer.

6

What CSF4 Can Do? (cont.)

Advanced Functionalities Multiple Domains Resource Information Sharing Multiple scale resource scheduling policies Automatic user credentials delegation Automatic data-staging Extensible scheduling framework Supporting grid parallel jobs (MPI&MPICH-G2)

Page 7: CSF4 Meta-Scheduler PRAGMA13 Zhaohui Ding zhaohui.ding@email.jlu.edu.cnzhaohui.ding@email.jlu.edu.cn or zhding@ucsd.eduzhding@ucsd.edu College of Computer.

7

CSF4 User Interface

CSF4 Portal

Page 8: CSF4 Meta-Scheduler PRAGMA13 Zhaohui Ding zhaohui.ding@email.jlu.edu.cnzhaohui.ding@email.jlu.edu.cn or zhding@ucsd.eduzhding@ucsd.edu College of Computer.

8

CSF4 User Interface

CSF4 Command Line

Page 9: CSF4 Meta-Scheduler PRAGMA13 Zhaohui Ding zhaohui.ding@email.jlu.edu.cnzhaohui.ding@email.jlu.edu.cn or zhding@ucsd.eduzhding@ucsd.edu College of Computer.

9

Current Deployment

PRAGMA CSF Server and CSF Portalon : portal.pragma-grid.net (rocks-144.sdsc.edu)4 available clusters (SDSC, NBCR and AIST)

From command lineInstall CSF4 client on your cluster front-node

From Portalhttps://portal.pragma-grid.net:9443/worksphere/start

Page 10: CSF4 Meta-Scheduler PRAGMA13 Zhaohui Ding zhaohui.ding@email.jlu.edu.cnzhaohui.ding@email.jlu.edu.cn or zhding@ucsd.eduzhding@ucsd.edu College of Computer.

10

Demo

Query Available Cluster, Application and Submitted Job Status

1. Simplest Job2. Array Job (virtual screening) 3. Mpi job (linpack xhpl benchmark)

Page 11: CSF4 Meta-Scheduler PRAGMA13 Zhaohui Ding zhaohui.ding@email.jlu.edu.cnzhaohui.ding@email.jlu.edu.cn or zhding@ucsd.eduzhding@ucsd.edu College of Computer.

11

Thank you


UCSD Chancellor’s Scholars Program UCSD Emeriti Mentor ...Suzan Cioffi, Director, RRC ∞ Vania Bailon, CSP/EMP Coordinator (858) 534-4724 Emeri+@ucsd.edu, Emeri+Mentor@ucsd.edu,

UCSD Chancellor’s Scholars Program UCSD Emeriti Mentor ...Suzan Cioffi, Director, RRC ∞ Vania Bailon, CSP/EMP Coordinator (858) 534-4724 [email protected], [email protected],

The Application of Relative Clauses Shanghai Songjiang No.1 High School Gu Zhaohui.

The Application of Relative Clauses Shanghai Songjiang No.1 High School Gu Zhaohui.

CSF4, SGE and Gfarm Integration Zhaohui Ding zhaohui.ding@email.jlu.edu.cn zding@sdsc.edu Jilin University.

CSF4, SGE and Gfarm Integration Zhaohui Ding [email protected] [email protected] Jilin University.

NEDA ALIPANAH, MARIA ADELA GRANDO DBMI nalipanah@ucsd.edu mgrando@ucsd.edu 11/19/2012.

NEDA ALIPANAH, MARIA ADELA GRANDO DBMI [email protected] [email protected] 11/19/2012.

BIMM-143: INTRODUCTION TO BIOINFORMATICS...Email your PDF document as an attachment named BIMM143_S19_[yourUCSDname].pdf to both IAs (yal069@ucsd.edu and n7nguyen@ucsd.edu). For example,

BIMM-143: INTRODUCTION TO BIOINFORMATICS...Email your PDF document as an attachment named BIMM143_S19_[yourUCSDname].pdf to both IAs ([email protected] and [email protected]). For example,

Optimally Combining Classifiers Using Unlabeled … Combining Classifiers Using Unlabeled Data Akshay Balsubramani ABALSUBR@UCSD.EDU Yoav Freund YFREUND@UCSD.EDU Dept. of CSE, University

Optimally Combining Classifiers Using Unlabeled … Combining Classifiers Using Unlabeled Data Akshay Balsubramani [email protected] Yoav Freund [email protected] Dept. of CSE, University

ESP 209: Fall ‘07 Mitigation and Adaptation in a High CO2 World Led by: Lisa Shaffer (lshaffer@ucsd.edu) Student Coordinators: Danny Richter (drichter@ucsd.edu)

ESP 209: Fall ‘07 Mitigation and Adaptation in a High CO2 World Led by: Lisa Shaffer ([email protected]) Student Coordinators: Danny Richter ([email protected])

PEER 2G02 – Code Usage Exercise: OpenSees Zhaohui Yang UCSD 2/15/2005.

PEER 2G02 – Code Usage Exercise: OpenSees Zhaohui Yang UCSD 2/15/2005.

O-Glycans Chapter 8 April 6, 2004 Jeff Esko jesko@ucsd.edu.

O-Glycans Chapter 8 April 6, 2004 Jeff Esko [email protected].

1 Be Ware the Dirty Seas Geoffrey Lean Luo Zhaohui Unit two.

1 Be Ware the Dirty Seas Geoffrey Lean Luo Zhaohui Unit two.

Presented at the 2009 AK EPSCoR All-Hands Meeting, Anchorage, Alaska Zhaohui (Joey) Yang, Ph.D.

Presented at the 2009 AK EPSCoR All-Hands Meeting, Anchorage, Alaska Zhaohui (Joey) Yang, Ph.D.

The Uniform Resource Layer Anita Bandrowski abandrowski@ucsd.edu Neuroscience Information Framework.

The Uniform Resource Layer Anita Bandrowski [email protected] Neuroscience Information Framework.

Hotel Recommendation System - arXiv · 2019-08-22 · Hotel Recommendation System Aditi A. Mavalankar A53200443 amavalan@ucsd.edu Ajitesh Gupta A53220177 ajgupta@ucsd.edu Chetan Gandotra

Hotel Recommendation System - arXiv · 2019-08-22 · Hotel Recommendation System Aditi A. Mavalankar A53200443 [email protected] Ajitesh Gupta A53220177 [email protected] Chetan Gandotra

WIISARD Core Architecture Steven Brown swbrown@ucsd.edu 7/27/2005.

WIISARD Core Architecture Steven Brown [email protected] 7/27/2005.

Emergency Evacuation Procedures Reggie Long r3long@ucsd.edu 2015.

Emergency Evacuation Procedures Reggie Long [email protected] 2015.

Newsletter - August 2018.pdfTerri Ann Miller—Catering Sales Mgr tam009@ucsd.edu Michele Arrowsmith-Rowe—Catering Sales Mgr marrowsmithrowe@ucsd.edu Kathie Landis—Membership &

Newsletter - August 2018.pdfTerri Ann Miller—Catering Sales Mgr [email protected] Michele Arrowsmith-Rowe—Catering Sales Mgr [email protected] Kathie Landis—Membership &

Intrinsic Shortest Path Length: A New, Accurate A Priori Wirelength Estimator Andrew B. KahngSherief Reda abk@ucsd.edu sreda@ucsd.edu VLSI CAD Laboratory.

Intrinsic Shortest Path Length: A New, Accurate A Priori Wirelength Estimator Andrew B. KahngSherief Reda [email protected] [email protected] VLSI CAD Laboratory.

Beyond a Food Pantry: Development of Basic Needs Student ...Alicia Magallanes, Basic Needs Coordinator a1magallanes@ucsd.edu Lori Weiner, Student Affairs Case Manager lweiner@ucsd.edu

Beyond a Food Pantry: Development of Basic Needs Student ...Alicia Magallanes, Basic Needs Coordinator [email protected] Lori Weiner, Student Affairs Case Manager [email protected]

Jun Liu (liukeen@mail.xjtu) Lu Jiang, Zhaohui Wu Qinghua Zheng, Yanan Qian

Jun Liu ([email protected]) Lu Jiang, Zhaohui Wu Qinghua Zheng, Yanan Qian

Walt Savitch University of California, San Diego wsavitch@ucsd.edu.

Walt Savitch University of California, San Diego [email protected].