Using the SCEC Computational Platforms for Seismic Hazard Analysis Research

1
Using the SCEC Computational Platforms for
Seismic Hazard Analysis Research
Philip Maechling SCEC IT Architect www.scec.org/cm
e NCSA Multi-core Workshop 25 July 2007
2
Strategy Statements
3
Strategy Statements
4
Strategy Statements
5
SHA Computational Pathways
Standard seismic hazard analysis
1
Empirical models
Intensity Measures
Earthquake Rupture Forecast
Attenuation Relationship
1
6
SCEC Computational Platform Concept

• Definition of Computational Platform
• A vertically integrated collection of hardware,
  software, and people that provides a broadly
  useful research capability
• Implied capabilities
• Validated simulation software and geophysical
  models
• Re-usable simulation capabilities
• Imports parameters from other systems. Exports
  results to other systems
• IT/geoscience collaboration involved in operation
• Access to High-performance hardware and large
  scale data and metadata management.
• May use Workflow management tools

7
(No Transcript)
8
CyberShake Platform Workflow
9
CyberShake Platform
10
CyberShake Map
11
CyberShake Processing

• Velocity Mesh Creation 2 Stages (run and
  merge)
• Create - 100 processors for 2 hours with 15GB
  output (temporary)
• Merge - 4 processors for 1 hour with 15GB output
  (permanent)
• Est SU 200
• SGT Calculation
• Preprocessing steps using 300GB data
• 400 processors for 30 hours with 15GB output
  (permanent)
• Est SU 12K
• Post Processing
• 200k jobs using 300 processors for 8 hours with
  50GB each
• Est SU 3000 SU
• Site Totals
• Estimated 15K SU/Site
• Rupture Variations - 300GB (permanent) (1 copy)
• Unmerged VM - 15GB (temporary)
• Merged Velocity Mesh - 15GB (temporary)
• Unmerged SGT - 15GB (temporary)
• Merged SGT - 15GB (permanent)

12
CyberShake Map

• CyberShake Map Result
• Region 100km x 200km
• 10km spacing requires 200 sites 3M SU and
  1.2TB
• 5km spacing requires 800 sites 12M SU and
  32TB
• 2km spacing requires 5000 sites 75M SU and
  200TB

13
Full 3-D Tomography Model (Preliminary)
Po Chen Inversion-based updates to SCEC CVM3.0
Velocity Model.
14
3-D Fréchet Kernels in 3-D Basin Model
15
The SCEC TeraShake Platform
SCEC TeraShake Platform enables large scale, high
resolution AWM simulations.
16
F3DT Inversion For TeraShake Box

• 160 stations x 3 480 300 780
• 300 events
• 780 x 3.14 TB 2,449.2 TB
• 480 x 3.14 TB 1507.2 TB spinning
• Runtime
• 140 Minutes on 256 processors
• 140/4 35 minutes on 1000 processors
• Round up to 40 minutes and find total time for
  all calculations
• 780 40 31,200
• Find time in days to do this
• 60 24 1440
• Days to run all simulations
• 31200/1440 22 days

17
DynaShake Rupture Variations
18
DynaShake Rupture Variations
19
End
20
End