Title: COLLABORATIVE DESIGN AND DEVELOPMENT OF THE COMMUNITY CLIMATE SYSTEM MODEL FOR TERASCALE COMPUTING (CDDCCSMTC)
1COLLABORATIVE DESIGN AND DEVELOPMENT OF THE
COMMUNITY CLIMATE
SYSTEM MODEL FOR TERASCALE
COMPUTING (CDDCCSMTC)
- Hereinafter referred to as the CCSM Consortium
- Phil Jones (LANL)
- On behalf of all the consorts
2- The SciDAC CCSM Consortium consists of PI R.
Malone4, J. Drake5 , Site-Contacts C. Ding2, S.
Ghan6, D. Rotman3, J. Taylor1, J. Kiehl7, W.
Washington7, S.-J. Lin8, Co-Is J. Baumgardner4,
T. Bettge7, L. Buja7, S. Chu4, T. Craig7, P.
Duffy3, J. Dukowicz4, S. Elliot4, D. Erickson5,
M. Ham5, Y. He2, F. Hoffman5, E. Hunke4, R.
Jacob1, P. Jones4, J. Larson1, J. Lamarque7, W.
Lipscomb4, M. Maltrud4, D. McKenna7, A. Mirin3,
W. Putman8, W. Sawyer8, J. Schramm7, T.
Shippert6, R. Smith4, P. Worley5, W. Yang2 -
- 1Argonne National Lab, 2Lawrence Berkeley
National Lab, 3Lawrence Livermore National Lab,
4Los Alamos National Lab, 5Oak Ridge National
Lab, 6Pacific Northwest National Lab, 7National
Center for Atmospheric Research, 8NASA-Goddard
Space Flight Center
3Climate System
4Climate Change
5Science Goals
- Assessment and prediction
- IPCC, national assessments (alarmist
fearmongering) - Energy policy (Dick Cheneys private sessions)
- Regional climate prediction
- High resolution, downscaling, water!
- Atmospheric chemistry/ocean biogeochemistry
- Carbon cycle
- Aerosols
6Project Goals
- Software
- Performance portability
- Software engineering (repositories, standardized
testing No Code Left Behind initiative) - Model Development
- Better algorithms
- New physical processes (esp. chemistry,
biogeochemistry)
7Community Climate System Model
Land LSM/CLM
Atmosphere CAM
NSF/DOE 270 Participants
7 States 10 Fluxes
6 States 6 Fluxes
Once
hour
per
per
Flux Coupler
Once
hour
6 States 6 Fluxes
7 States 9 Fluxes
4 States 3 Fluxes
6 States 13 Fluxes
day
Once
per
per
Once
hour
6 Fluxes
11 States 10 Fluxes
Ocean POP
Ice CICE/CSIM
8Coupler Architecture
- Issues
- sequencing
- frequency
- distribution
- parallelism
- single or multiple
- executables
- stand alone execution
- MPH3 (multi-processor handshaking) library for
coupling component models - CPL6 -- Implemented, Tested, Deployed
- ESMF/CCA
Version 1.0 Released November 2002
9Prediction and Assessment
Many century-scale simulations (gt2500yrs)
_at_5yrs/day Cycle vampires Many dedicated cycles
at computer centers
10Performance Portability
- Vectorization
- POP easy (forefront of retro fashion)
- CAM, CICE, CLM
- Blocked/chunked decomposition
- Sized for vector/cache
- Load balanced distribution of blocks/chunks
- Hybrid MPI/OpenMP
- Land elimination
- Performance modeling w/PERC
11Performance
12Rapid Climate Change
13THC Crisis Center
14Polar and THC
15HYPOP
- Arbitrary Lagrangian-Eulerian vertical coordinate
- Keep Lagrangian in deep ocean
- Remap to z-coordinate in mixed layer
- CSU SciDAC
- New time stepping/mode splitting
- Progress
- Model currently working in z-coord mode
- Examining vertical grid generators
- Testing
16CICE
- Incremental Remapping for Sea Ice and Ocean
Transport - Incremental remapping scheme that proved to be
three times faster than MPDATA, total model
speedup of about 30 --added to CCSM/CSIM - CICE3.0 restructered for vector Community Sea
Ice Model - Sensitivity analysis and parameter tuning test of
the CICE code - Automatic Differentiation (AD)-generated
derivative code
17Regional Prediction
Mississipi State
Kentucky
Oklahoma State
Stanford
18Atmosphere/Land
19Resolution and Precipitation
(DJF) precipitation in the California region in 5
simulations, plus observations. The 5 simulations
are CCM3 at T42 (300 km), CCM3 at T85 (150 km) ,
CCM3 at T170 (75 km), CCM3 at T239 (50 km), and
CAM2 with FV dycore at 0.4 x 0.5 deg.
CCM3 extreme precipitation events depend on model
resolution. Here we are using as a measure of
extreme precipitation events the 99th percentile
daily precipitation amount. Increasing
resolution helps the CCM3 reproduce this measure
of extreme daily precipitation events.
20Subgrid Orography Scheme
- Reproduces orographic signature without
increasing dynamic resolution - Realisitic precipitation, snowcover, runoff
- Month of March simulated with CCSM
21Eddy-Resolving Ocean
Obs
2 deg
0.1 deg
0.28 deg
22Greenhouse Gases
- Energy production
- Bovine flatulence
- Presidential campaigning
- Source-based scenarios
23Aerosol Uncertainty
24Atmospheric Chemistry
- Gas-phase chemistry with emissions, deposition,
transport and photo-chemical reactions for 89
species. - Experiments performed with 4x5 degree Fvcore
ozone concentration at 800hPa for selected
stations (ppmv) - Mechanism development with IMPACT
- A) Small mechanism (TS4), using the ozone
field it generates for photolysis rates. - B) Small mechanism (TS4), using an ozone
climatology for photolysis rates. - C) Full mechanism (TS2), using the ozone field
it generates for photolysis rates.
Zonal mean Ozone, Ratio A/C
Zonal mean Ozone, Ratio B/C
25Ocean Biogeochemistry
- LANL Ecosystem Model
- nutrients (nitrate, ammonium, iron, silicate)
- phytoplankton (small, diatom, coccolithophores)
- zooplankton
- bacteria, dissolved organic material, detritus
- dissolved inorganic carbon (DIC), alkalinity
- trace gases (dimethyl sulfide, carbonyl sulfide,
methyl halides and nonmethane hydrocarbons) - elemental cyclings (C,N,Fe,Si,S)
26Ocean Biogeochemistry
- Iron Enrichment in the Parallel Ocean Program
- Surface chlorophyll distributions in POP
- for 1996 La Niña and 1997 El Niño
27Global DMS Flux from the Ocean using POP
The global flux of DMS from the ocean to the
atmosphere is shown as an annual mean. The
globally integrated flux of DMS from the ocean to
the atmosphere is 23.8 Tg S yr-1 .
28Things not mentioned
- Software engineering
- Other model improvements
- fvcore work
- land model (river transport, biogeochem, etc.)
- Ocean grid/topography generator
- Parallel I/O work
- ESG
- Now how much would you pay? You also get