High Performance Collaboration The Jump to Light Speed"

1
High Performance Collaboration The Jump to
Light Speed"

• Talk to
• A Visiting Team from Intel
• Calit2_at_UCSD
• June 25, 2006

Dr. Larry Smarr Director, California Institute
for Telecommunications and Information
Technology Harry E. Gruber Professor, Dept. of
Computer Science and Engineering Jacobs School of
Engineering, UCSD
2
From SupercomputerCentric to
Supernetwork-Centric Cyberinfrastructure
Terabit/s
32x10Gb Lambdas
Computing Speed (GFLOPS)
Bandwidth of NYSERNet Research Network Backbones
Gigabit/s
60 TFLOP Altix
1 GFLOP Cray2
Optical WAN Research Bandwidth Has Grown Much
Faster Than Supercomputer Speed!
Megabit/s
T1
Network Data Source Timothy Lance, President,
NYSERNet
3
National Lambda Rail (NLR) and TeraGrid Provides
Cyberinfrastructure Backbone for U.S. Researchers
NSFs TeraGrid Has 4 x 10Gb Lambda Backbone
International Collaborators
Seattle
Portland
Boise
UC-TeraGrid UIC/NW-Starlight
Ogden/ Salt Lake City
Cleveland
Chicago
New York City
Denver
Pittsburgh
San Francisco
Washington, DC
Kansas City
Raleigh
Albuquerque
Tulsa
Los Angeles
Atlanta
San Diego
Phoenix
Dallas
Baton Rouge
Las Cruces / El Paso
Links Two Dozen State and Regional Optical
Networks
Jacksonville
Pensacola
DOE, NSF, NASA Using NLR
Houston
San Antonio
NLR 4 x 10Gb Lambdas Initially Capable of 40 x
10Gb wavelengths at Buildout
4
The OptIPuter Project Creating High Resolution
Portals Over Dedicated Optical Channels to
Global Science Data

• NSF Large Information Technology Research
  Proposal
• Calit2 (UCSD, UCI) and UIC Lead CampusesLarry
  Smarr PI
• Partnering Campuses SDSC, USC, SDSU, NCSA, NW,
  TAM, UvA, SARA, NASA Goddard, KISTI, AIST,
  CRC(Canada), CICESE (Mexico)
• Industrial Partners
• IBM, Sun, Telcordia, Chiaro, Calient,
  Glimmerglass, Lucent
• 13.5 Million Over Five YearsNow In the Fourth
  Year

NIH Biomedical Informatics
Research Network
NSF EarthScope and ORION
5
OptIPuter Software Architecture--a
Service-Oriented Architecture Integrating Lambdas
Into the Grid
Source Andrew Chien, UCSD
Globus
XIO
GSI
GRAM
GTP
XCP
UDT
LambdaStream
CEP
RBUDP
6
OptIPuter Scalable Adaptive Graphics Environment
(SAGE) Allows Integration of HD Streams
OptIPortal Termination Device for the
OptIPuter Global Backplane
Photo David Lee, NCMIR, UCSD
7
OptIPortal Termination Device for the OptIPuter
Global Backplane

• 20 Dual CPU Nodes, 20 24 Monitors, 50,000
• 1/4 Teraflop, 5 Terabyte Storage, 45 Mega
  Pixels--Nice PC!
• Scalable Adaptive Graphics Environment ( SAGE)
  Jason Leigh, EVL-UIC

Source Phil Papadopoulos SDSC, Calit2
8
The New Optical Core of the UCSD Campus-Scale
TestbedEvaluating Packet Routing versus Lambda
Switching

• Goals by 2007
• gt 50 endpoints at 10 GigE
• gt 32 Packet switched
• gt 32 Switched wavelengths
• gt 300 Connected endpoints

Funded by NSF MRI Grant
Lucent
Glimmerglass
Approximately 0.5 TBit/s Arrive at the Optical
Center of Campus Switching will be a Hybrid
Combination of Packet, Lambda, Circuit -- OOO
and Packet Switches Already in Place
Force10
9
Calit2/SDSC Proposal to Create a UC
Cyberinfrastructure of OptIPuter On-Ramps to
TeraGrid Resources
OptIPuter CalREN-XD TeraGrid OptiGrid
UC Davis
UC Berkeley
UC San Francisco
UC Merced
UC Santa Cruz
UC Los Angeles
UC Riverside
UC Santa Barbara
UC Irvine
Creating a Critical Mass of End Users on a Secure
LambdaGrid
UC San Diego
Source Fran Berman, SDSC , Larry Smarr, Calit2
10
Creating a North American Superhighway for High
Performance Collaboration
Next Step Adding Mexico to Canadas CANARIE and
the U.S. National Lambda Rail
11
Countries are Aggressively Creating Gigabit
ServicesInteractive Access to CAMERA Data System
Visualization courtesy of Bob Patterson, NCSA.
www.glif.is Created in Reykjavik, Iceland 2003
12
First Remote Interactive High Definition Video
Exploration of Deep Sea Vents
Canadian-U.S. Collaboration
Source John Delaney Deborah Kelley, UWash
13
PI Larry Smarr
14
Marine Genome Sequencing ProjectMeasuring the
Genetic Diversity of Ocean Microbes
CAMERA will include All Sorcerer II Metagenomic
Data
15
Calit2s Direct Access Core Architecture Will
Create Next Generation Metagenomics Server
User Environment
CAMERA Complex
Web Services
Source Phil Papadopoulos, SDSC, Calit2
16
Analysis Data Sets, Data Services, Tools, and
Workflows

• Assemblies of Metagenomic Data
• e.g, GOS, JGI CSP
• Annotations
• Genomic and Metagenomic Data
• All-against-all Alignments of ORFs
• Updated Periodically
• Gene Clusters and Associated Data
• Profiles, Multiple-Sequence Alignments,
• HMMs, Phylogenies, Peptide Sequences
• Data Services
• Raw and Specialized Analysis Data
• Rich Query Facilities
• Tools and Workflows
• Navigate and Sift Raw and Analysis Data
• Publish Workflows and Develop New Ones
• Prioritize Features via Dialogue with Community

Source Saul Kravitz Director of Software
Engineering J. Craig Venter Institute
17
Calit2 and the Venter Institute Will Combine
Telepresence with Remote Interactive Analysis
Live Demonstration of 21st Century
National-Scale Team Science
18
Calit2 Works with CENIC to Provide the
California Optical Core for CineGrid
Partnering with SFSUs Institute for Next
Generation Internet
SFSU
UCB
Digital Archive of Films
Calit2s CineGrid Team is Working with Cinema
Industry in LA and SF

• In addition, 1Gb and 10Gb Connections to
• Seattle, Asia, Australia, New Zealand
• Chicago, Europe, Russia, China
• Tijuana, Rosarita Beach, Ensenada

Prototype of CineGrid
USC
Extending SoCal OptIPuter to USC School of
Cinema-Television
Calit2 UCI
Calit2 UCSD
19
First Trans-Pacific Super High Definition
Telepresence Meeting in New Calit2 Digital Cinema
Auditorium
Lays Technical Basis for Global Digital
Cinema Sony NTT SGI