Program Update
description
Transcript of Program Update
Program Update
Presented by
Larry Davis, Deputy Director
September 2009
Department of DefenseHigh Performance Computing Modernization Program
HPC Forum Briefing – l. Davis
Outline
Introduction
Program Structure
0 HPC Centers
0 Networking
0 Software Applications Support
0 Resource Management
Solving the hard problems . . .5/4/2009-2.1
HPC Forum Briefing – l. Davis
HPC Modernization Program
Solving the hard problems . . .5/4/2009-3.1
HPC Forum Briefing – l. Davis
Solving the hard problems . . .
HPC Modernization Program Goals
5/4/2009-4.1
HPC Forum Briefing – l. Davis
Solving the hard problems . . .
A Quick History Program initiation — 1992–1993
0 HPC Modernization Plan0 Initial program structure established,
S&T0 Initial HPC capabilities provided0 HPCMP established as an ACAT1
Program formalization — 1994–19950 Program office established0 DoD oversight process implemented0 Program structure and customer base
expanded, include T&E
Major acquisitions — 1995–19960 Four major shared resource centers0 Defense Research and Engineering
Network (DREN)0 Programming Environment and
Training (PET) contract established
Operations focus — 1997–20000 Continuous upgrades at HPC centers0 Selection of new distributed centers
(DCs)0 DoD Challenge Projects established
Major contract awards — 2001–20030 DREN contract awarded0 HPC Centers contract awards0 New PET contract awarded
Operations focus — 2003–20060 New DHPIs, Institutes and Portfolios
selected0 Capability Applications Project (CAPs)
established0 Minority Undergraduate Education and
Research Initiative established0 Value to the DoD study–Return on
Investment (ROI) project
Major contracts & expansion — 2007–20090 Next Generation Technical Services
(NGTS) contract awarded0 New DHPIs, Institutes and Portfolios
selected0 Computational Research and Engineering
Acquisition Tools and Environments (CREATE) program initiated
0 New PET3 contract awarded0 New archival storage contract awarded
5/4/2009-5.1
HPC Forum Briefing – l. Davis
Solving the hard problems . . .
DoD HPC Modernization Program
6/492009-6.3
Army HPCMP Participation
ARL & ERDC DSRCs1,309 Users/22 Organizations/102 Projects56 DREN Sites14 Challenge Projects/2 DHPIs5 Institutes
Navy HPCMP ParticipationNAVY DSRC1,031 Users/16 Organizations/198 Projects38 DREN Sites12 Challenge Projects/3 DHPIs1 Institute
Air Force HPCMP ParticipationAFRL & MHPCC DSRCs1,361 Users/24 Organizations/175 Projects24 DREN Sites12 Challenge Projects/5 DHPIs3 Institutes
Defense Agencies ParticipationDARPA, DTRA, JFCOM,MDA, PA&E & OTE644 Users/4 Organizations/21 Projects35 DREN Sites3 Challenge Projects
Other
ARSC ADC68 DREN Sites1 DHPI
HPC Forum Briefing – l. Davis
DoD Supercomputing Resource Centers (DSRCs)
Six Large HPC Centers
Solving the hard problems . . .5/7/2009-7.2
HPC Forum Briefing – l. Davis
Solving the hard problems . . .Solving the hard problems . . .
DoD Supercomputing Resource Centers (DSRCs)
FY09 Capability
As of: July 2009
Location SystemProcessors
(Cores)Memory
(GB)Capacity
(Habus)
AFRL HP Opteron ClusterSGI Altix ClusterSGI Altix 4700
2,0482,0489,216
4,0963,584
20,480
201884
ARL Linux Networx ClusterLinux Networx Cluster (Classified)Cray XT5 (Classified)SGI Altix ICE 8200SGI Altix ICE 8200 (Classified)
4,5283,464
10,54011,3847,088
8,976 6,736
40,128 34,152
21,264
5526
138254161
ARSC SUN x4600Cray XT5
2,3203,504
9,280 14,784
1855
ERDC Cray XT3Cray XT4SGI Altix ICE 8200
8,3208,760
16,160
16,640 17,696 48,480
95100360
MHPCC Dell PowerEdge 1955 5,120 10,240 61
NAVY IBM 1600 Power5 ClusterIBM 1600 Power5 Cluster (Classified)Cray XT5IBM Power 6
3,0721,920
12,8725,312
6,144 3,840
26,592 8,448
3317
202125
Total 117,676 301,560 1,822
FY09 HPC Systems shown in GREENFY08 HPC Systems shown in REDFY07 HPC Systems shown in BLUEOlder HPC Systems shown in BLACK
7/13/2009-8.4
HPC Forum Briefing – l. Davis
TI-09 Installation Status Rackable’s recent purchase of SGI’s assets included all HPCMP
contracts
– TI-09 systems on track for delivery as scheduled New SGI remains committed to delivering the new system and
maintaining existing system
Solving the hard problems . . .
ARL – Classified SGI Altix ICE 8200
0 6,656 core (169 HABUs)
0 Final acceptance September 18, 2009 ARL – Unclassified SGI Altix ICE 8200
0 10,752 core (271 HABUs)
0 Final acceptance late September 2009 ERDC – Unclassified SGI Altix ICE 8200
0 15,360 core (385 HABUs)
0 Final acceptance October 2, 2009
8/3/2009-9.3
HPC Forum Briefing – l. Davis
Solving the hard problems . . .
TI-01 TI-02 TI-03 TI-04 TI-05 TI-06 TI-07 TI-08 TI-090
200
400
600
800
1,000
1,200
1,400Habus Procured for Each TI-XX
Percent Procured from Pevious Year
To
tal
Nu
mb
er
of
Ha
bu
sHPC Installations (TI-01 through 09)Added HPC Capability Trend (DSRCs Only)
+ 3
0%
1.1 2.14.6
1.6
2.2
1.8
1.7
1.5
2.1
8/3/2009-10.2
HPC Forum Briefing – l. Davis
Solving the hard problems . . .
TI-01 TI-02 TI-03 TI-04 TI-05 TI-06 TI-07 TI-08 TI-090
2
4
6
8
10
12
14
16
18Increase in Habus per processor for each TI-XXIncrease in Number of processors for each TI-XX
Fa
cto
r In
cre
as
ePerformance Increases Come from Both Processor Improvement and Processor Count
8/3/2009-11.2
Implication: Need Software Applications that Scale to 1,000s of Processors
HPC Forum Briefing – l. Davis
Next Generation Technical Services Support (NGTS) Contract
HPC Center’s Technical Services Support contract provides 30–50 FTEs per Center
0 Technical Expertise Customer Support System and Network Administration Application/System Performance Analysis Expansion Analysis and Integration Services Operators and Operations Support Outreach
0 Acquisition Vehicle for Small Purchases (ODCs)
Solving the hard problems . . .5/4/2009-12.1
HPC Forum Briefing – l. Davis
NGTS (Continued)
Attributes of Contract
0 One five year contract for four DSRCs Facilitates leveraging innovations and
efficiencies across multiple DSRCs Does not include ARSC and MHPCC with the
exception of support for the Consolidated Customer Assistance Center
0 Cost plus type contract with a fixed award fee pool and no base fee
0 Awarded to Lockheed Martin Information Systems (LMIS) in March 2008
0 $344M contract ceiling
Solving the hard problems . . .5/4/2009-13.1
HPC Forum Briefing – l. Davis
Solving the hard problems . . .Solving the hard problems . . .
HPCMP Storage Initiative
Computing power grows annually—so do stored files Archived data is hard for users to use and manage Costs: User time, labor, hardware, software and media Storage Initiative
0 Objective: Refresh to manage data for next 10 years
0 Goals: 10-year architecture Leverage advances in technology Improve user productivity Improve reliability & adaptability Sustain within current storage budget
0 Funding: Reserved 1/3 of FY09 investment dollars
0 Challenge: User awareness and behavior changes
5/4/2009-14.1
HPC Forum Briefing – l. Davis
HPCMP Data Storage GrowthSingle Copy Data Storage
Solving the hard problems . . .
2001 2002 2003 2004 2005 2006 2007 20080
1,000
2,000
3,000
4,000
5,000
6,000
7,000
8,000
Year
Sin
gle
Co
py
of
HP
CM
P S
tora
ge
in T
era
by
tes
5/4/2009-15.1
HPC Forum Briefing – l. Davis
Solving the hard problems . . .
Storage Lifecycle Management (SLM)
Three Key Features0 Utility Server to provide longer term near-line storage to store
data for up to 30 days prior to archiving
0 Information Lifecycle Management (ILM) system to help user and system to associate important information with data
0 Establishment of a 10-year contract to facilitate predictable costs (possibly fixed) for data management software
Acquisition0 Software
ILM software, archive software and development services Full and open competition RFP release in March 2009, award made in August 2009
0 Hardware Execute via NGTS
5/4/2009-16.1
HPC Forum Briefing – l. Davis
Solving the hard problems . . .
10 years
StorageHardware
Generation 1
Storage SoftwareLong-term
Government Partnership with Industry
Hardware Refresh Cycle
HPCMP Storage Initiative Overall Acquisition Strategy
StorageHardware
Generation 2
StorageHardware
Generation 3
StorageHardware
Generation 4
5/4/2009-17.1
HPC Forum Briefing – l. Davis
Solving the hard problems . . .
Storage Target Architecture
Short-Term Storage
SLM
Medium-Term Storage
ILM-Driven Long-Term
Storage
Tape
ILM-managed
File System Utility
Server
ArchiveServer
Data Sharing withOther Centers
Center Archive Cache
DRCache
HPCSYSTEM
A
HPC File System
A
HPC File
SystemB
Remote Disaster
Recovery Facility
HPCSYSTEM
B
5/4/2009-18.1
HPC Forum Briefing – l. Davis
User Interface Toolkit – API
Solving the hard problems . . .
Single Desktop Interface to Multiple HPC Systems
• Supports Novice to Expert Users• Central Access to HPC Resources• Custom Productivity Clients• Complete Job Stream Management• Fast Large File Transfers• Secure Authentication
UITMaking High Performance Computing Easy
UITAPI
7/9/2009-19.2
HPC Forum Briefing – l. Davis
Solving the hard problems . . .
Defense Research & Engineering Network (DREN) (pronounced: 'dē-ren)
5/11/2009-20.2
HPC Forum Briefing – l. Davis
Solving the hard problems . . .
DREN – Two WorldsHPCMP - Buy-In Customers
68 HPCMP sites
111 Subscriber sites
6/9/2009-21.2
HPC Forum Briefing – l. Davis
Solving the hard problems . . .
Software Applications Support
5/4/2009-22.1
HPC Forum Briefing – l. Davis
Solving the hard problems . . .
HPC Software Applications Institutes
8/27/2009-23.1
HPC Forum Briefing – l. Davis
Solving the hard problems . . .
HPC Software Applications Institutes
8/27/2009-24.1
HPC Forum Briefing – l. Davis
User Productivity Enhancement, Technology Transfer and Training (PET3)
Solving the hard problems . . .5/4/2009-25.1
HPC Forum Briefing – l. Davis
Solving the hard problems . . .
PET3 Contract Award Update
PET3 was awarded to High Performance Technologies Inc. (HPTi) on July 31, 2009 to start September 1, 2009
Award amount ~$147 million over ten years
The HPTi team is made up of major HPC groups around the country, including Texas Advanced Computing Center, Pittsburgh Supercomputing Center, San Diego Supercomputer Center, and 18 other partners
One major feature is the combination of Computational Environment (CE) and Enabling Technologies (ET) into Advanced Computational Environments (ACE)
8/27/2009-26.1
HPC Forum Briefing – l. Davis
Computational Research and Engineering Acquisition Tools and Environments
Solving the hard problems . . .5/11/2009-27.2
HPC Forum Briefing – l. Davis
Resource Management
Solving the hard problems . . .5/4/2009-28.1
HPC Forum Briefing – l. Davis
Solving the hard problems . . .
Customer Needs, Priorities, and Usage History Drive HPCMP Investments
Detailed requirements information collected annually through web-based requirements survey (includes all projects)
Requirements information refined through in-person interviews and quality checks
Requirements validated by senior S&T and T&E executives in each Service and Agency
2007 2008 2009 2010 2011 2012 2013 20140
5,000
10,000
15,000
20,000
25,000
30,000Capacity
Aggregated Requirements
Max Projected Requirements
Fiscal Year
Ha
bu
-yrs
Historical Projection of Requirements
7/9/2009-29.6
HPC Forum Briefing – l. Davis
Solving the hard problems . . .
DoD Challenge Projects
7/24/2009-30.2
HPC Forum Briefing – l. Davis
Dedicated HPC Project Investments
Solving the hard problems . . .8/27/2009-31.3
HPC Forum Briefing – l. Davis
Solving the hard problems . . .
Summary
World-class corporate computing capability established for DoD HPC community
High Performance Computing capabilities being employed to provide substantial contributions to DoD mission capabilities
Successful transition to scalable, parallel computing
Leveraging national, academic and federal activities
7/24/2009-32.1