COLLABORATIVE DESIGN AND DEVELOPMENT OF THE COMMUNITY CLIMATE SYSTEM MODEL FOR TERASCALE COMPUTING C

1
COLLABORATIVE DESIGN AND DEVELOPMENT OF THE
COMMUNITY CLIMATE
SYSTEM MODEL FOR TERASCALE
COMPUTING (CDDCCSMTC)

• Hereinafter referred to as the CCSM Consortium
• Phil Jones (LANL)
• On behalf of all the consorts

2

• The SciDAC CCSM Consortium consists of PI R.
  Malone4, J. Drake5 , Site-Contacts C. Ding2, S.
  Ghan6, D. Rotman3, J. Taylor1, J. Kiehl7, W.
  Washington7, S.-J. Lin8, Co-Is J. Baumgardner4,
  T. Bettge7, L. Buja7, S. Chu4, T. Craig7, P.
  Duffy3, J. Dukowicz4, S. Elliot4, D. Erickson5,
  M. Ham5, Y. He2, F. Hoffman5, E. Hunke4, R.
  Jacob1, P. Jones4, J. Larson1, J. Lamarque7, W.
  Lipscomb4, M. Maltrud4, D. McKenna7, A. Mirin3,
  W. Putman8, W. Sawyer8, J. Schramm7, T.
  Shippert6, R. Smith4, P. Worley5, W. Yang2
•  
• 1Argonne National Lab, 2Lawrence Berkeley
  National Lab, 3Lawrence Livermore National Lab,
  4Los Alamos National Lab, 5Oak Ridge National
  Lab, 6Pacific Northwest National Lab, 7National
  Center for Atmospheric Research, 8NASA-Goddard
  Space Flight Center

3
Science Goals

• Assessment and prediction
• IPCC, national assessments (alarmist
  fearmongering)
• Energy policy (Dick Cheneys private sessions)
• Regional climate prediction
• High resolution, downscaling, water!
• Atmospheric chemistry/ocean biogeochemistry
• Carbon cycle
• Aerosols

4
Project Goals

• Software
• Performance portability
• Software engineering (repositories, standardized
  testing No Code Left Behind initiative)
• Model Development
• Better algorithms
• New physical processes (esp. chemistry,
  biogeochemistry)

5
Coupler Architecture

• Issues
• sequencing
• frequency
• distribution
• parallelism
• single or multiple
• executables
• stand alone execution

• MPH3 (multi-processor handshaking) library for
  coupling component models
• CPL6 -- Implemented, Tested, Deployed
• ESMF/CCA

Version 1.0 Released November 2002
6
Performance Portability

• Vectorization
• POP easy (forefront of retro fashion)
• CAM, CICE, CLM
• Blocked/chunked decomposition
• Sized for vector/cache
• Load balanced distribution of blocks/chunks
• Hybrid MPI/OpenMP
• Land elimination
• Performance modeling w/PERC

7
Performance
8
Regional Prediction
Mississipi State
Kentucky
Oklahoma State
Stanford
9
Atmosphere/Land
10
Subgrid Orography Scheme

• Reproduces orographic signature without
  increasing dynamic resolution
• Realisitic precipitation, snowcover, runoff
• Month of March simulated with CCSM

11
Eddy-Resolving Ocean
Obs
2 deg
0.1 deg
0.28 deg
12
Greenhouse Gases

• Energy production
• Bovine flatulence
• Presidential campaigning
• Source-based scenarios

13
Aerosol Uncertainty
14
Atmospheric Chemistry

• Gas-phase chemistry with emissions, deposition,
  transport and photo-chemical reactions for 89
  species.
• Experiments performed with 4x5 degree Fvcore
  ozone concentration at 800hPa for selected
  stations (ppmv)
• Mechanism development with IMPACT
• A)    Small mechanism (TS4), using the ozone
  field it generates for photolysis rates.
• B)     Small mechanism (TS4), using an ozone
  climatology for photolysis rates.
• C)    Full mechanism (TS2), using the ozone field
  it generates for photolysis rates.

Zonal mean Ozone, Ratio A/C
Zonal mean Ozone, Ratio B/C
15
Ocean Biogeochemistry

• LANL Ecosystem Model
• nutrients (nitrate, ammonium, iron, silicate)
• phytoplankton (small, diatom, coccolithophores)
• zooplankton
• bacteria, dissolved organic material, detritus
• dissolved inorganic carbon (DIC), alkalinity
• trace gases (dimethyl sulfide, carbonyl sulfide,
  methyl halides and nonmethane hydrocarbons)
• elemental cyclings (C,N,Fe,Si,S)

16
Ocean Biogeochemistry

• Iron Enrichment in the Parallel Ocean Program
• Surface chlorophyll distributions in POP
• for 1996 La Niña and 1997 El Niño

17
Global DMS Flux from the Ocean using POP
The global flux of DMS from the ocean to the
atmosphere is shown as an annual mean. The
globally integrated flux of DMS from the ocean to
the atmosphere is 23.8 Tg S yr-1 .
18
Potential U.S. Participants

• Runs completed
• Starley Thompson LLNL, David Erickson ORNL
  (PCM-IBIS)
• C-cycle code completed, tested coupled to
  relevant GCM
• Inez Fung, Scott Doney UC Berkeley
  (CCSM1-OCMIP2-CASA derivative)
• Fung, Hoffman, Doney, Lindsay (CCSM3-CLM3-CASA
  )?
• C-cycle code completed, run off-line completed
• Gordan Bonan NCAR (CCSM2-LPJ derivative - see
  Bonan et al. 2003. GBC 111543-1566)
• Joerg Kaduk Stanford (CCM? Or UCLA-SiB2)
• Robert Dickinson Georgia Tech (CCSM?-CLM
  enhanced)
• C-cycle code under development
• Peter Thornton NCAR (CCSM3-Biome-BGC derivative)
• Erickson, Post, King, Gu ORNL (PCM-IBIS-GTEC
  loose coupling) acclimation, moisture profile,
  diffuse radiation effects on veg
• Ocean POP - OBGCM LANL (CCSM3-POP)
• DOE Deliverables aerosol chemistry-carbon
  coupled model (CCSM3-IBIS)

19
Extensions for Carbon Cycle
Where we would like to be
Accurate regional modeling of carbon sources and
sinks Coupling of biogeochemical processes for
climate variability on decadal to century time
scales