Using GUI's to Open Up Your HPC Environment
-
Upload
insidehpc -
Category
Technology
-
view
818 -
download
1
description
Transcript of Using GUI's to Open Up Your HPC Environment
![Page 1: Using GUI's to Open Up Your HPC Environment](https://reader033.fdocuments.us/reader033/viewer/2022060123/5597514c1a28abaa4f8b45f1/html5/thumbnails/1.jpg)
© 2013 ADAPTIVE COMPUTING, INC. MoabCon 2013
1
Using GUI's to Open Up Your HPC Environment
Wil Wellington Professional Services (EMEA)
MoabCon 2013
![Page 2: Using GUI's to Open Up Your HPC Environment](https://reader033.fdocuments.us/reader033/viewer/2022060123/5597514c1a28abaa4f8b45f1/html5/thumbnails/2.jpg)
© 2013 ADAPTIVE COMPUTING, INC. MoabCon 2013
2
Agenda
▪ Comparison (GUI vs CLI) ▪ Moab Web Services (MWS) ▪ What is MWS ▪ RESTful Web Services ▪ Integration with Moab
▪ Build simple GUI with MWS ▪ Viewpoint ▪ HP Insight CMU Integration ▪ Questions
![Page 3: Using GUI's to Open Up Your HPC Environment](https://reader033.fdocuments.us/reader033/viewer/2022060123/5597514c1a28abaa4f8b45f1/html5/thumbnails/3.jpg)
© 2013 ADAPTIVE COMPUTING, INC. MoabCon 2013
3
Comparison - CLI
▪ Ease of use ▪ Difficult to successfully navigate CLI.
▪ Control ▪ More control of O/S using CLI
▪ Multitasking ▪ No ability to view multiple things at once
▪ Appearance ▪ Rarely change in appearance
![Page 4: Using GUI's to Open Up Your HPC Environment](https://reader033.fdocuments.us/reader033/viewer/2022060123/5597514c1a28abaa4f8b45f1/html5/thumbnails/4.jpg)
© 2013 ADAPTIVE COMPUTING, INC. MoabCon 2013
4
Comparison - CLI
▪ Speed ▪ Few keystrokes to perform advance actions &
smaller textual information
▪ Resources ▪ Less computing resources
▪ Scripting ▪ Easy to compile a sequence of commands
![Page 5: Using GUI's to Open Up Your HPC Environment](https://reader033.fdocuments.us/reader033/viewer/2022060123/5597514c1a28abaa4f8b45f1/html5/thumbnails/5.jpg)
© 2013 ADAPTIVE COMPUTING, INC. MoabCon 2013
5
Comparison - GUI
▪ Ease of use ▪ users pick up interface much easier when
compared to CLI.
▪ Control ▪ Plenty of control, but advance users resort to CLI
▪ Multitasking ▪ Easy to view, control and manipulate multiple
things
▪ Appearance ▪ Aesthetically pleasing to the eye
![Page 6: Using GUI's to Open Up Your HPC Environment](https://reader033.fdocuments.us/reader033/viewer/2022060123/5597514c1a28abaa4f8b45f1/html5/thumbnails/6.jpg)
© 2013 ADAPTIVE COMPUTING, INC. MoabCon 2013
6
Comparison - GUI
▪ Speed ▪ Easier and faster to perform certain actions
with just one click
▪ Resources ▪ More system resources (ie, icons, fonts etc..)
▪ Scripting ▪ No comparison to CLI
![Page 7: Using GUI's to Open Up Your HPC Environment](https://reader033.fdocuments.us/reader033/viewer/2022060123/5597514c1a28abaa4f8b45f1/html5/thumbnails/7.jpg)
© 2013 ADAPTIVE COMPUTING, INC. MoabCon 2013
7
Conclusion - GUI
ü Beautiful
ü Easy to use
ü In-built multitasking capability
ü Fun
![Page 8: Using GUI's to Open Up Your HPC Environment](https://reader033.fdocuments.us/reader033/viewer/2022060123/5597514c1a28abaa4f8b45f1/html5/thumbnails/8.jpg)
© 2013 ADAPTIVE COMPUTING, INC. MoabCon 2013
8
What is Moab Web Services
▪ Moab Web Services (MWS) is part of Moab Workload Manager that allows programmatic access to (at least) all services offered by Moab Workload Manager through the command line. ▪ MWS is simply a
protocol through which 3rd parties may communicate with Moab
8
![Page 9: Using GUI's to Open Up Your HPC Environment](https://reader033.fdocuments.us/reader033/viewer/2022060123/5597514c1a28abaa4f8b45f1/html5/thumbnails/9.jpg)
© 2013 ADAPTIVE COMPUTING, INC. MoabCon 2013
9
RESTful Web Services
▪ RESTful Web Service Advantages ▪ Simple and uses standard methods
▪ Reduces client/server coupling
▪ Access resources with multiple representations
▪ Give every “thing” an ID
▪ Enables access to HTTP cache and proxy server
▪ Allows organisation of very complex applications into simple resource
▪ Communicate statelessly
▪ Easy for existing and new applications to interface
▪ Easy to evolve a REST interface without breaking existing clients
▪ Etc…
9
![Page 10: Using GUI's to Open Up Your HPC Environment](https://reader033.fdocuments.us/reader033/viewer/2022060123/5597514c1a28abaa4f8b45f1/html5/thumbnails/10.jpg)
© 2013 ADAPTIVE COMPUTING, INC. MoabCon 2013
10 © 2012 ADAPTIVE COMPUTING, INC. 10
RESTful Web Services
Moab
Jobs Server Nodes
Reservations
Etc.
Resources
![Page 11: Using GUI's to Open Up Your HPC Environment](https://reader033.fdocuments.us/reader033/viewer/2022060123/5597514c1a28abaa4f8b45f1/html5/thumbnails/11.jpg)
© 2013 ADAPTIVE COMPUTING, INC. MoabCon 2013
11 © 2012 ADAPTIVE COMPUTING, INC. 11
RESTful Web Services
Moab
Nodes
Reservations
Etc.
Jobs
POST Create/Submit
PUT Modify/Update
GET Read
DELETE Delete
![Page 12: Using GUI's to Open Up Your HPC Environment](https://reader033.fdocuments.us/reader033/viewer/2022060123/5597514c1a28abaa4f8b45f1/html5/thumbnails/12.jpg)
© 2013 ADAPTIVE COMPUTING, INC. MoabCon 2013
12 © 2012 ADAPTIVE COMPUTING, INC. 12
RESTful Web Services
Moab
Nodes
Reservations
Etc.
HPC Portal
MWS API
User Input
Job Converter
Run a Monte Carlo
Simulation with this Input!
Jobs
POST
![Page 13: Using GUI's to Open Up Your HPC Environment](https://reader033.fdocuments.us/reader033/viewer/2022060123/5597514c1a28abaa4f8b45f1/html5/thumbnails/13.jpg)
© 2013 ADAPTIVE COMPUTING, INC. MoabCon 2013
13 © 2012 ADAPTIVE COMPUTING, INC. 13
MWS Integrated with Moab
Client Interface
Moa
b S
erve
r Resource Managers
Triggers
Statistics
Allocation Mgr
Moab Database
Events Files
Client Commands
Moab Services Manager
Gold (Moab Accounting Mgr)
Moab Viewpoint
Integration Scripts
![Page 14: Using GUI's to Open Up Your HPC Environment](https://reader033.fdocuments.us/reader033/viewer/2022060123/5597514c1a28abaa4f8b45f1/html5/thumbnails/14.jpg)
© 2013 ADAPTIVE COMPUTING, INC. MoabCon 2013
14 © 2012 ADAPTIVE COMPUTING, INC.
Moab Web Services Layer Moab Web Services and flexible interfaces, Operations DB
14
The Big Picture
Showback & Chargeback
Intelligence Engine
Decisions, policies, resource scheduling, allocation, workflow & automation orchestration
Admin Dashboard API Calls User Service Portal CLI
Resources
Storage Manager
Provisioning Manager
Network Manager
Health Monitor
Non-traditional Resource Managers
Other Resources: • Licenses • Chillers • NFS Servers • Database
Servers • Equipment • Etc.
Workload Job
Queue
Multi-vendor Resource Manager
Heterogeneous Resources
Job Manager
![Page 15: Using GUI's to Open Up Your HPC Environment](https://reader033.fdocuments.us/reader033/viewer/2022060123/5597514c1a28abaa4f8b45f1/html5/thumbnails/15.jpg)
© 2013 ADAPTIVE COMPUTING, INC. MoabCon 2013
15
MWS Configuration (post install)
15
![Page 16: Using GUI's to Open Up Your HPC Environment](https://reader033.fdocuments.us/reader033/viewer/2022060123/5597514c1a28abaa4f8b45f1/html5/thumbnails/16.jpg)
© 2013 ADAPTIVE COMPUTING, INC. MoabCon 2013
16
MWS Configuration
16
![Page 17: Using GUI's to Open Up Your HPC Environment](https://reader033.fdocuments.us/reader033/viewer/2022060123/5597514c1a28abaa4f8b45f1/html5/thumbnails/17.jpg)
© 2013 ADAPTIVE COMPUTING, INC. MoabCon 2013
17
MWS Configuration
17
![Page 18: Using GUI's to Open Up Your HPC Environment](https://reader033.fdocuments.us/reader033/viewer/2022060123/5597514c1a28abaa4f8b45f1/html5/thumbnails/18.jpg)
© 2013 ADAPTIVE COMPUTING, INC. MoabCon 2013
18
Moab Web Services Configuration
18
![Page 19: Using GUI's to Open Up Your HPC Environment](https://reader033.fdocuments.us/reader033/viewer/2022060123/5597514c1a28abaa4f8b45f1/html5/thumbnails/19.jpg)
© 2013 ADAPTIVE COMPUTING, INC. MoabCon 2013
19
Lets build a simple GUI with MWS
![Page 20: Using GUI's to Open Up Your HPC Environment](https://reader033.fdocuments.us/reader033/viewer/2022060123/5597514c1a28abaa4f8b45f1/html5/thumbnails/20.jpg)
© 2013 ADAPTIVE COMPUTING, INC. MoabCon 2013
20
Viewpoint
Accelerate user and admin productivity ▪ Simplified job submission and
management
▪ Option: Application Portal Edition
How do I make submitting and managing jobs faster and easier for users?
![Page 21: Using GUI's to Open Up Your HPC Environment](https://reader033.fdocuments.us/reader033/viewer/2022060123/5597514c1a28abaa4f8b45f1/html5/thumbnails/21.jpg)
© 2013 ADAPTIVE COMPUTING, INC. MoabCon 2013
21
Simple Job Submit & Management
Moab Viewpoint HPC Portal
▪ Users can easily submit jobs anytime, anywhere
▪ Reduces end-user training
▪ Simplifies and speeds job submission
▪ Simplifies job tracking and self-management
▪ Application Portal Edition for integrated specific application access and templates for guided submission
Easily track job status
![Page 22: Using GUI's to Open Up Your HPC Environment](https://reader033.fdocuments.us/reader033/viewer/2022060123/5597514c1a28abaa4f8b45f1/html5/thumbnails/22.jpg)
© 2013 ADAPTIVE COMPUTING, INC. MoabCon 2013
22
Easy Job Submission for Users
Simplified, guided submission
![Page 23: Using GUI's to Open Up Your HPC Environment](https://reader033.fdocuments.us/reader033/viewer/2022060123/5597514c1a28abaa4f8b45f1/html5/thumbnails/23.jpg)
© 2013 ADAPTIVE COMPUTING, INC. MoabCon 2013
23
Easy Job Tracking/Self-Management for Users
Quick easy filters
Quick easy actions
![Page 24: Using GUI's to Open Up Your HPC Environment](https://reader033.fdocuments.us/reader033/viewer/2022060123/5597514c1a28abaa4f8b45f1/html5/thumbnails/24.jpg)
© 2013 ADAPTIVE COMPUTING, INC. MoabCon 2013
24
Easy Click Drill-down for Specific Node Details
![Page 25: Using GUI's to Open Up Your HPC Environment](https://reader033.fdocuments.us/reader033/viewer/2022060123/5597514c1a28abaa4f8b45f1/html5/thumbnails/25.jpg)
© 2013 ADAPTIVE COMPUTING, INC. MoabCon 2013
25
Admins Can Easily Manage User Access
Easily add or modify users and access privileges Synchronize with existing LDAP users and groups Assign user or admin role privileges to control data view, actions and management access
![Page 26: Using GUI's to Open Up Your HPC Environment](https://reader033.fdocuments.us/reader033/viewer/2022060123/5597514c1a28abaa4f8b45f1/html5/thumbnails/26.jpg)
© 2013 ADAPTIVE COMPUTING, INC. MoabCon 2013
26
Admins Can Easily Create Reservations for User Access to Resources
Easily create user or admin maintenance reservations Control reservation workload settings Assign reservation access Schedule specific time and resources
![Page 27: Using GUI's to Open Up Your HPC Environment](https://reader033.fdocuments.us/reader033/viewer/2022060123/5597514c1a28abaa4f8b45f1/html5/thumbnails/27.jpg)
© 2013 ADAPTIVE COMPUTING, INC. MoabCon 2013
27
Admins Can Easily Manage Reservations for User Access to Resources
Quick click drill downs for details
![Page 28: Using GUI's to Open Up Your HPC Environment](https://reader033.fdocuments.us/reader033/viewer/2022060123/5597514c1a28abaa4f8b45f1/html5/thumbnails/28.jpg)
© 2013 ADAPTIVE COMPUTING, INC. MoabCon 2013
28
Easy, Visual Configuration of the Portal
![Page 29: Using GUI's to Open Up Your HPC Environment](https://reader033.fdocuments.us/reader033/viewer/2022060123/5597514c1a28abaa4f8b45f1/html5/thumbnails/29.jpg)
© 2013 ADAPTIVE COMPUTING, INC. MoabCon 2013
29
Easy, Visual Node Management for Admins
Quick easy filters
Quick click drill downs for details easy actions
![Page 30: Using GUI's to Open Up Your HPC Environment](https://reader033.fdocuments.us/reader033/viewer/2022060123/5597514c1a28abaa4f8b45f1/html5/thumbnails/30.jpg)
© 2013 ADAPTIVE COMPUTING, INC. MoabCon 2013
30
Seamless HP Insight CMU Integration
Streamlined management between workload management and cluster administration ▪ CMU management capabilities automated via policies
▪ Rich monitoring data in CMU powers Moab policies
▪ Single point administration for key workload data and management actions in CMU console
Workload Management
Cluster Administration
![Page 31: Using GUI's to Open Up Your HPC Environment](https://reader033.fdocuments.us/reader033/viewer/2022060123/5597514c1a28abaa4f8b45f1/html5/thumbnails/31.jpg)
© 2013 ADAPTIVE COMPUTING, INC. MoabCon 2013
31
View Moab Jobs and Metrics in HP Insight CMU
Select job(s) or their nodes and initiate actions with simple right click menu
![Page 32: Using GUI's to Open Up Your HPC Environment](https://reader033.fdocuments.us/reader033/viewer/2022060123/5597514c1a28abaa4f8b45f1/html5/thumbnails/32.jpg)
© 2013 ADAPTIVE COMPUTING, INC. MoabCon 2013
32
View Workload CPUload and Memory Use in Timeline View
![Page 33: Using GUI's to Open Up Your HPC Environment](https://reader033.fdocuments.us/reader033/viewer/2022060123/5597514c1a28abaa4f8b45f1/html5/thumbnails/33.jpg)
© 2013 ADAPTIVE COMPUTING, INC. MoabCon 2013
33
Questions?