UGC 2006

1
DoD High Performance Computing Modernization
Program (HPCMP) Overview and Perspectives on the
Role of DoD Computational Science Engineering
in the Community April 7, 2009 Mr. Phil
Casey
2
DoD High Performance Computing Modernization
Program

• Mr. Cray Henry
• Director
• High Performance Computing Modernization
  Program
• Dr. Douglass Post
• Chief Scientist
• High Performance Computing Modernization
  Program

3
HPCMP Program Overview
Department of DefenseHigh Performance Computing
Modernization Program

• Presented by
• Cray J. Henry
• 7 April 2009

4
Agenda

• Introduction
• Customer Focus
• Program Structure
• HPC Centers
• Networking and Security
• Software Applications Support
• Resource Management

5
HPC Modernization Program
6
HPC Modernization Program Goals
7
Customers Why there is an HPCMP?
8
HPCMP Serves a Large, Diverse DoD User Community
Computational Electromagnetics Acoustics 322
Users
Computational Fluid Dynamics 1,537 Users

• Requirements for FY09
• 529 projects with 4,152 users at approximately
  125 sites
• 1,662 Habus non-real-time requirements
• FY08 Statistics (as of 9/30/2008)
• 382 active projects with 2,254 active users at
  284 locations
• Total utilization 427 Habus

Electronics, Networking, and Systems/C4I 164
Users
Computational Structural Mechanics 423 Users
Environmental Quality Modeling Simulation 169
Users
Forces Modeling Simulation 78 Users
Computational Chemistry, Biology Materials
Science 501 Users
Climate/Weather/Ocean Modeling Simulation 259
Users
Signal/Image Processing 393 Users
Integrated Modeling Test Environments 147
Users
Source Portal to the Information Environment
September 2009
159 users are self characterized as Other
9
HPC Modernization Program User Base
10
Armor/Anti-Armor, CWO, and Air Vehicles ROI
CWO numbers updated since Feb 2008 briefing
based on Air Force data
Equals 30 of Total HPCMP Budget 19982008
11
DoD HPC Modernization Program
12
DoD Supercomputing Resource Centers (DSRCs)Six
Large HPC Centers
13
Defense Research Engineering Network (DREN)
13
10/30/2009
14
HPCMP Information Assurance

• HPC-CNDSP Certified by USSTRATCOM
• Provides Information Assurance support to HPC
  community
• HPC-CERT
• Level 2 CERT reports to directly to STRATCOM and
  JTF-GNO
• Comprehensive Security Assessment Teams (CSAs)
• Provides periodic and systematic validation of
  DIACAP
• Public Key Infrastructure Cryptography for
  Authentication in Kerberos (PKINIT)
• Provides PKI, two-factor, secure, authentication,
  to protect the use of critical DoD HPC RD assets

15
Software Applications Support
16
HPC Software Applications Institutes
17
User Productivity Enhancement, Technology
Transfer and Training (PET3)
18
Computational Research and Engineering
Acquisition Tools and Environments
19
FY09 Shadow-Ops Projects
20
Resource Management
21
Flexible Business Model Promotes Innovation
Software Applications Support

• Performance Benchmarking
• Application run-time measurement on supercomputers

• Requirements Collection Process
• Bottom-up survey
• Includes only approved funded ST/TE projects
• Reviewed and validated by ST/TE executives

Technology Insertion Process
DHPI Selection and Deployment
Better Operations Decisions Acquisition Decisions
Challenge Allocation Process
Capability Allocation Process

• Capacity Allocation Process
• 70 Service/Agency, 30 (U) DoD Challenge
  Projects
• Services/Agencies decide allocation resources for
  each project
• Reconcile capacity with requirements (first-order
  prioritization)

Requirements data Initial request for allocation

• Performance Tracking
• Utilization by project
• Expansion Factors
• Network Availability
• Security Effectiveness
• Training Effectiveness
• Institute Effectiveness

Feedback to help quantify requirements
Utilization feedback for management oversight and
further allocation
Flexible Business Processes
Focus on Customer Needs
Complete Management Information Systems
22
HPCMP Resource Allocation PolicyCapacity
Allocations

• Allocate 100 of all resources at DoD
  Supercomputing Resource Centers
• 2530 allocated to Challenge Projects
• 7075 allocated to Services/Agencies
• 30/30/30/10 split
• Service/Agency representatives allocate resources
  at the subproject level
• Approximately 1 of total allocations is set
  aside for high-priority projects

Focus on Capacity ? Capacity Allocations
23
Service/Agency Allocation Process
Service/Agency Principals validate Service/Agency
requirements
User requests new project
Yes
No
No
Yes

• 70 of program computing resources assigned to
  Military Services Agencies
• Each Service/Agency makes their own allocation
  decisions with their own processes

Hours allocated to Services by HPCMPO (30/30/30/10
split)
24
HPCMP Supercomputers Can Support Your RDTE
Project!
Visit our web site at www.HPCMO.HPC.MIL for
more information on how to apply for access
25
HPC Modernization Program
26
DoD High Performance Computing Applications

• Dr. Douglass E. Post
• Chief Scientist
• DoD High Performance Computing Modernization
  Program
• DTIC Conference, April 7, 2009

Solving the hard problems
27
Computational Tools Are Becoming Tools of the
Trade In Science And Engineering
27
28
Next Generation Computers Offer Society
Unparalleled Power to Address Important Problems

• Next generation computers (2020) will enable us
  to develop and deploy codes that are much more
  powerful than present tools
• Utilize accurate solution methods
• Include all the effects we know to be important
• Model a complete system
• Complete parameter surveys in hours rather than
  days to weeks to months
• In 10 years, workstations will be as powerful
  as todays supercomputers
• Greatest opportunities for 2020 (and 2010)
  include large-scale codes that integrate many
  multi-scale effects to model a complete system

3
29
Emphasis on Prediction and Analysis of Physical
Systems

• Utilize computers to solve the equations that
  govern the behavior of complex physical systems

P-3C
Close up of weapon in bay surface and flowfield
discretization
4
30
Computational Science And Engineering Is Becoming
an Essential Tool for Theoretical Science And
Engineering

• Accelerator Design
• Aircraft Design
• Archaeology
• Armor Design
• Astrophysics
• Atomic And Molecular Physics
• Automobile Design
• Bioengineering And Biophysics
• Bioinfomatics
• Chemistry
• Civil Engineering
• Climate Prediction
• Computational Biology
• Computational Fluid Dynamics
• Cosmology
• Cryptography
• Data Mining
• Drug discovery
• Earthquakes

Groundwater And Contaminant Flow High Energy
Physics Research Hydrology Image
Processing Inertial Confinement Fusion Integrated
Circuit Chip Design Magnetic Fusion
Energy Manufacturing Materials Science Medicine Mi
crotomography Nanotechnology And
Nanoscience Nuclear Reactor Design And
Safety Nuclear Weapons Ocean Systems Petroleum
Field Analysis And Prediction Optics and Optical
Design Political Science Protein Folding Radar
signature and antenna analysis Radiation
Damage Satellite Image Processing Scientific
Databases Search Engines Shock Hydrodynamics Signa
l Processing Space Weather Volcanoes Weather
Prediction Wild Fire Analysis
10/30/2009
30
5
31
10 DoD ST and TE Computational Technology Areas
4,152 users at approximately 125 sites
Computational Fluid Dynamics 1,537 Users
Computational Electromagnetics Acoustics 322
Users
Electronics, Networking, and Systems/C4I SR 164
Users
Forces Modeling Simulation 78 Users
Computational Structural Mechanics 423 Users
Environmental Quality Modeling Simulation 169
Users
Computational Chemistry, Biology Materials
Science 501 Users
Integrated Modeling Test Environments 147
Users
Climate/Weather/Ocean Modeling Simulation 259
Users
Signal/Image Processing 393 Users
31
32
Computational Structural Mechanics (CSM)

• High resolution multi-dimensional modeling of
  materials and structures
• Broad range of loading conditions including
  quasi-static, dynamic, electro-magnetic, shock,
  penetration, and blast.
• Includes the highly inter-disciplinary research
  area of materials design
• Emphasizes multi-scale modeling of different
  scales from atomistic to macroscopic

7
33
Assess explosive effects on structures
Breach 24 long x 14 wide Top spall 36 long x
26 wide Bottom spall 41 long x 34 wide Top
center rebar deflection 3.125 Bottom rebar
deflection 1.563
Time 10 ms
ERDC
33
34
Computational Fluid Dynamics (CFD)

• Accurate prediction of fluid and gas motion and
  fluid-dynamics research.
• Basic studies of fluid dynamics for engineering
  design of complex flow configurations
• Prediction of the interactions of chemistry with
  fluid flow for combustion and propulsion

9
35
HPC Investigation of Helicopter Brownout
Helicopter brownout in desert conditions

• Helicopter brownout
• Occurs when operating in unimproved landing
  areas, such as Middle East war zones.
• Improved prediction for mitigation through
  aerodynamic design.

UH-60 hover in ground effect CFD actuator disk
modeling
Ground flow pattern flight test and CFD
10
36
Analyze Airwake Effects on Aircraft Landing and
Take-off on Ships

• Flow Field Mapping
• Helicopter alone
• Ship alone
• Ship/helicopter with wind
• Ship/helicopter without wind
• Employ Results to Understand Fundamental Physics
• Model differences

Dr. Susan Polsky-NAVAIR
36
37
BIW SWATH

• Hydrodynamic Analysis
• Efficient and effective way to generate, assess,
  evaluate and optimize new design concepts

37
38
Maneuvering Simulations

• PID (Proportional, Integral, Derivative)
  Controllers introduced for rudder motion and
  propeller RPM
• Demonstrations for various cases course
  keeping, direction change, way point control,
  planar motion mechanism (PMM)

13
39
Computational Chemistry, Biology, and Materials
Science (CCM)

• Predict the basic properties of chemicals and
  materials, including nano- and biomaterials.

• Molecular geometries and energies, spectroscopic
  parameters, intermolecular forces, reaction
  potential energy surfaces, and mechanical
  properties

14
40
Computational Electromagnetics and Acoustics
(CEA)

• High-resolution multidimensional solutions of
  electromagnetic and acoustic wave equations in
  solids, fluids, and gases
• Sensing and Signatures

15
41
Climate/Weather/Ocean Modeling and Simulation
(CWO)

• Accurate numerical simulation of the earth's
  atmosphere and oceans
• Space and time scales important for both
  scientific understanding and DoD operational use.

16
42
NOGAPS Global Ensemble Prediction Stochastic
Convection and Hurricanes
5-day Katrina track forecast from 25 August 2005
ET stochastic convection ensemble mean track
forecast (blue) closer to observed track (black)
than the multi-model consensus (red) or the NCEP
ensemble (pink)
GOES-12 valid 2345 UTC 28 Aug
Accurate global forecasts are important for
boundary forcing needed by mesoscale models
17
43
Environmental Quality Modeling and Simulation
(EQM)

• DoD impacts on the environment and the impacts of
  environmental issues on DoD activities
• High-resolution modeling of hydrodynamics,
  geophysics, and multi-constituent fate/transport
  through the coupled atmospheric/land
  surface/subsurface environment, and their
  interconnections with numerous biological species
  and anthropogenic activities.

Models of fish behavior through and around
dams-ERDC
18
44
Current Software Development InstitutesEstablish
Computational Capability in DoD
44
45
Institute for Space Situational AwarenessSearch
and Determine Provides New Space Control
Capability

• Search And Determine (SAD) is a multiple
  hypothesis tracking application to resolve
  UnCorrelated Tracks (UCTs) from Space
  Surveillance Network (SSN) radar data
• Current JSpOC approach is manpower intensive and
  less complete
• Days of processing reduced to minutes
• SAD demonstrations occurring at JSpOC and ASCC in
  FY09Q2
• SAD helps rapidly link new detections into
  trackable objects

New object detections resulting from Chinese ASAT
experiment
45
46
A Paradigm Shift in Engineering

• Past to now
• Numerous repeated Design-Build-Test cycles
• Future
• Repeated CAD-Mesh-Analyze cycles followed by a
  few Design-Build-Test cycles

21
47
Design-Build-Test Describes Many Product Cycles

• Requires many lengthy and expensive
  design/build/test iteration loops
• Process converges slowly, if at all
• Design flaws discovered late in process
• ? Long time to market

47
48
Replace Physical Design-Build-Test with
Computational Design-Mesh-Analyze
G949 RSA Regional HwyCity
Analyze and Test Virtual Product
Design and mesh Virtual Product
Build and Test Physical Product
Requirements
Market

• Reduced time to market from 3 years to 9 months
• Increased new products delivery from 1 every 3
  years to 5 per year
• Saved the company

• Boeing-New 747, 20 improvement lift/drag, 787
  better
• Whirlpool designs washers, stoves,
  refrigerators,.
• Proctor and Gamble uses CE extensively
• Ping Golf
• Auto industry..

G971 Off Road Drive
Design iterations
48
49
Computational Research and Engineering
Acquisition Tools and Environments (CREATE)

• CREATE goal is to enable major improvements in
  the DoD acquisition process
• Replace design paradigm based on historical data
  and experimental testing with physics-based
  computational design validated with experimental
  testing
• Detect and fix design flaws early in the design
  process before major schedule and budget
  commitments are made
• Begin system integration earlier in the
  acquisition process
• Increase acquisition program flexibility and
  agility to respond to rapidly changing
  requirements
• Enhance the productivity of the DoD engineering
  workforce

49
50
Computational Research and Engineering
Acquisition Tools and Environments
CREATE

• 360M 12-year program to develop deploy 3
  computational engineering tool sets for
  acquisition engineers
• Air Vehicle design tools Aerodynamics, air
  frame, propulsion, control, early rapid design
• Ship design tools Early-stage design, shock
  damage and hydrodynamics performance
• RF Antenna design tools RF Antenna performance
  and integration with platforms
• Geometry and Mesh Generation

50
51
DoD utilizes High Performance Computing to
Improve Military Capability

• Over 4000 users in DoD ST and TE communities
  use HPCMP computers
• Through Institutes and CREATE, DoD HPCMP enables
  DoD community to learn how to develop and deploy
  Computational tools

26
52
Point of Contact
Mr. Phil Casey Director Information Science
Technology DTIC 703-767-9184 pcasey_at_dtic.mil
Dr. Douglass Post Chief Scientist High
Performance Computing Modernization Program
Mr. Cray Henry Director High Performance
Computing Modernization Program
53
Disclaimer of Endorsement

• Reference herein to any specific commercial
  products, process, or service by trade name,
  trademark, manufacturer, or otherwise, does not
  necessarily constitute or imply its endorsement,
  recommendation, or favoring by the United States
  Government. The views and opinions of authors
  expressed herein do not necessarily state or
  reflect those of the United States Government,
  and shall not be used for advertising or product
  endorsement purposes.