Title: National Science Foundation International Research Network Connections Program Kickoff
1National Science FoundationInternational
Research Network Connections Program Kickoff
March 11, 2005
- Julio Ibarra, PI
- Heidi Alvarez, Co-PI
- Chip Cox, Co-PI
- John Silvester, Co-PI
2Outline
- The WHREN-LILA project
- US - Latin America Connectivity
- Links Interconnecting Latin America (LILA) year 1
- The AtlanticWave Project
- Monitoring and Measurement Activities
- WHREN-LILA Year 1 Milestones
- E-Science and Engineering Collaborations
2
3The WHREN-LILA Project
- Proposal submitted by Florida International
University (FIU) and the Corporation for
Education Network Initiatives in California
(CENIC) - Award 0441095 - Links Interconnecting Latin America (LILA) aims
to Improve connectivity in the Americas through
the establishment of new inter-regional links - Western-Hemisphere Research and Education
Networks (WHREN) is a coordinating body of
organizations from across North and South America
that aims to leverage the network resources of
participating members to foster collaborative
research and advance education throughout the
Western Hemisphere
3
4Project Goals
- Improve network connectivity between North and
South America through the deployment, operation
and evolution of LILA links - Evolve the LILA links to their fullest capacities
as resources and economies permit - Foster collaborative research and advance
education throughout the Western Hemisphere and
other world regions - Support the evolving needs of US science and
engineering researchers - Foster new inter-regional and inter-disciplinary
communities of researchers and learners
4
5WHREN - Coordination in the Western Hemisphere
- WHREN will establish a consortium of
participating western-hemisphere organizations
that will collectively oversee the assignment of
lightpaths across administrative domains - A Governance Committee (GC) will collectively
oversee the assignment and management of
lightpaths and provide coordination between
member organizations - A Research Advisory Committee will be formed to
advise the GC on program and network needs for
the broad research and education community - An Engineering Committee (EC) will be comprised
of engineering managers from the various networks
participating in WHREN
5
6LILA Project Coordination
- Participating Organizations
- Project Steering Committee formed, with one
member from each participating organization, for
project implementation and operational decisions - Engineering Committee, comprised of network
engineers from each participation organization,
to make network engineering and operational
recommendations to the Steering Committee
- FIU (Awardee)
- CENIC (Awardee)
- ANSP (Sao Paulo)
- CLARA (Latin America)
- CUDI (Mexico)
- RNP (Brazil)
- REUNA (Chile)
6
7US - Latin America Connectivity before IRNC
- Argentina, Brazil (national and the State of Sao
Paulo), Chile, Panama and Venezuela connections
through Miami - Mexico connections through San Diego and El Paso
- Peerings with Internet2 and other US RE
networks through AMPATH, CalREN and UTEP - International and FedNet peerings at
STARTAP/Starlight from Miami provided by AMPATH
7
8Regional Development
- Cooperation of Latin American research networks
(CLARA) - _at_LIS Alliance of the Internet Society funded
program, providing 10 Million Euros for
interconnecting RD communities of Latin America
and Europe - Creates a regional backbone in Latin America
- Direct connectivity to Europe from Sao Paulo,
Brazil - Intraregional connectivity between connected
countries in Latin America - 3 DS3s from AMPATH to support CLARA initiative
Panama (REDCYT) Paraguay (ARANDU) Peru
(RAAP) Uruguay (RAU) Venezuela (REACCIUN)
Ecuador (CEDIA) El Salvador (RAICES) Guatemala
(RAGIE) Mexico (CUDI) Nicaragua (RENIE)
Argentina (RETINA) Brazil (RNP) Chile
(REUNA) Costa Rica (CRNET)
(NRENs in formation indicated in RED)
8
9Expected CLARA network topology
Network Characteristics
- 155 Mbps backbone ring
- 622 Mbps connection to Europe
- local traffic remains within the region
- 10 to 45 Mbps spur links
- 4Mbps satellite link to Cuba
- Network to be operated by CLARA (through CUDI
and RNP)
9
10RedCLARA Routed Network
10
11Current US - Latin America Topology
- RedCLARA network starts operating in August 2004
- Brazil/RNP and Chile/REUNA today transit CLARA,
then GEANT to reach US RE networks - NSF CHEPREO project and collaboration with Sao
Paulo RE community establishes STM-4 link
between US and Brazil - ITN services and transit to FedNets through
Abilene - Argentina, Panama and Venezuela maintaining
direct connections to US through AMPATH - Mexico has direct connection to US through UTEP
11
12Links Interconnecting Latin America (LILA) Year 1
- Increases Miami - Sao Paulo link from 622Mbps to
1.2Gbps - Q2 2005
- Evolving to 2.5Gbps
- Establishes a dark fiber segment between San
Diego and Tijuana for a 1Gbps link - May 2005
- Enables interregional peerings through east and
west coasts
12
13LILA Miami - Sao Paulo link design
Abilene
- Provides dedicated Gig-E interface to ANSP
- Provides shared Gig-E interface to CLARA and RNP
- Support planned for lightpath provisioning and
deterministic transport services through
AtlanticWave - Peering with Internet2s Abilene and other RE
networks through AMPATH
NAP of the Americas Miami
AtlanticWave
GigE
GigE
OC192
2 x VC4-4C (2 622Mbps 1.2Gbps)
COTIA Sao Paulo
GigE
GigE
GigE
GigE
USP
13
14LILA San Diego - Tijuana Link
- Provides dedicated Gig-E interface to CLARA
- Provides dedicated Gig-E interface to CUDI
- Growth across border possible through purchase of
additional Gig-Es up to maximum of 6 - Connections are to CENICs CalREN/HPR routed
network - Peering through CalREN to Internet2 and other RE
networks
14
15LILA San Diego - Tijuana link design
Logical Diagram
Physical Diagram
CENIC at UCSD/SDSC
CalREN/HPR
switch
CalREN/HPR
GX POP _at_ 3180 University
switch
CLARA
CUDI
switch
switch
CUDI Provided Equipment/fiber CLARA
Provided WHREN-LILA Provided
CUDI router
CLARA router
Cisco 7206 VXR
CLARA _at_ BESTEL in Tijuana
CUDI _at_ Telnor in Tijuana
15
16US - Latin America Year 1 Topology
- LILA links reestablish direct connectivity to
South America from east and west coasts - Reduces delay reaching sites in Chile and Brazil
from the US and Asia-Pacific - Introduces an infrastructure to develop a
distributed international exchange and peering - Leverages network resources to provide route
diversity and high-availability production
services
16
17AtlanticWave
- AtlanticWave is an International Peering Fabric
- US, Canada, Europe, South America
- Distributed IP peering points
- NYC, WDC, ATL, MIA, SPB
- SURA, FIU-AMPATH-CHEPREO, the IEEAF, MAX,
SoX/SLR, MANLAN, and in partnership with the
Academic Network of Sao Paulo (ANSP) are
combining efforts to establish AtlanticWave - Described as an integral component of the
WHREN-LILA proposal to extend LILA on the
Atlantic side to MANLAN in NYC - Complements the PacificWave distributed peering
facility on the west coast
17
18AtlanticWave Topology
- A-Wave provides multi-layer/multi-protocol
services between participating networks - Layer 3 peering services over ethernet
- GLIF light path services
- Others TBD
- A-Wave will to provide a Layer 3 distributed
exchange capability - Ethernet based
- Best effort packet exchange
- Linear topology unprotected (NLR based)
- 1 GE, 10GE LAN, 10GE WAN client access
- Jumbo frame support
18
19AtlanticWave Design
Initial East Coast US A-Wave Backbone
Future backbone Extensions within NA EU
To South America
To Europe Canada,
Miami, FL
Atlanta, GA
Washington, DC
New York City, NY
Sonet services
Ethernet services
Prepared by Jerry Sobieski
19
20Generic A-Wave Node Architecture(using separate
switching fabrics)
A-Wave Backbone OC192c
Sonet switch
Regional sonet handoff OC192c or OC48c Payload
agnostic
Ethernet WAN PHY
Regional ethernet handoff 10Gbs LAN or 1Gbs
20
Prepared by Jerry Sobieski
21Deployment Plans Timeline
- Phase 1 Deploy backbone OC192c Sept 05
- Between MIA-ATL, ATL-WDC, WDC-NYC
- 10Gbs WAN PHY ethernet over NLR wave initially.
- Migration of existing exchange switches/networks
- Regional backhaul
- Reconfiguration of existing exchange services and
networks - Phase 2 Sonet switch deployment Dec 05
- Map IP/Ethernet Peering Fabric across
appropriate sized VCG (GFP-F VCAT) - Engineer and deploy GLIF Common Services in
conjunction with other GLIF domains - Phase 3 Deploy dynamic light path services Mar
06 - Phase 4 Expansion Aug 06 -gt
- Integrate links between A-Wave, P-Wave, Northern
Tier, etc
21
22Monitoring and Measurement Activities
- NSF REU Distributed Network Monitoring using
NetFlow and MonALISA project - An integrated networking monitoring system using
Cisco Netflow, MonALISA and NLANR PMA/AMP tools - PingER and NLANR AMP active measurement resources
in service for links to Latin America
22
23Distributed Network monitoring using Netflow and
MonALISA
- Development project that integrates NetFlow
monitoring data with the MonALISA framework - Collaboration between FIU, Caltech and CERN
- Builds a lightweight, scalable and customizable
utility that enables viewing flows based on
source-destination pairs - Allows for a historical trend analysis of network
behavior as well as a close-to-realtime look at
flow data - Builds a framework for an Integrated Passive Flow
Measurement Toolkit (next slide) - Support from NSF REU Award SCI-0231844
- REU Report available at http//www.ampath.net/publ
ications.htm
23
24Integrated Passive Flow Measurement Toolkit
- A real-world deployable network monitoring
toolkit that improves the functionality of
MonALISA by integrating NetFlow and NLANR PMA - Cisco University Research Program (URP) Award to
Caltech and FIU - Leverages NSF REU project that integrates NetFlow
into MonALISA - Integrates MonALISA, Cisco NetFlow and NLANR PMA
tools to facilitate efficient network planning
and operation for the at large networking
community - Being deployed to monitor traffic flows for
CHEPREO between the US and Brazil - Toolkit will be available by Sept. 2005
24
25Measurement and Monitoring Plan
- Active measurement
- SLAC PingER (deployed and available, a Telnet
server and a PingER collector for delay/loss
information from/to AMPATH) - Passive measurement
- NLANR PMA (now taking a 90-second trace every
hour, tunable upon request) - NetFlow (available via the MonALISA service
module and SNMP/MRTG graphs) - Implementation and Deployment
- Service discovery and service integration based
on MonALISA - Modular design to allow flexible and robust
deployment and extensibility
25
26Year 1 Milestones
May 05 June 05 Sept. 05 Sept. 05 Dec. 05
- Implement LILA links
- Implement interregional peering through CalREN
and AMPATH - Establish Coordination and Control mechanisms for
service management - Deploy AtlanticWave OC192c backbone
- Deploy Next-Gen SONET switches
26
27E-Science and Engineering Collaborations
27
28Global LHC Data Grid Hierarchy
10s of Petabytes/yr by 2007-81000 Petabytes in
lt 10 yrs?
CMS Experiment
Online System
0.1 - 1.5 GBytes/s
CERN Computer Center
Tier 0
10-40 Gb/s
Tier 1
Argentina
gt10 Gb/s
Tier 2
2.5-10 Gb/s
Tier 3
Physics caches
Tier 4
PCs
28
29Grand Challenge ResearchCHEPREO
- An interregional grid-enabled Center for
High-Energy Physics Research and Educational
Outreach (CHEPREO) - Fosters an integrated program of research,
network infrastructure development, and education
and outreach - Collaboration with FIU, Caltech, University of
Florida, Florida State University, the State
University of Rio de Janeiro, University of Sao
Paulo - Augments bandwidth capacity to Brazil
- Joint funding by U.S. NSF (MPS-0312038) and State
of Sao Paulo Research Foundation (FAPESP)
29
30UltraLight Collaborationhttp//ultralight.caltec
h.edu
- Caltech, UF, UMich, SLAC,FNAL, CERN, FIU, NLR,
CENIC, UCAID, Translight, UKLight, Netherlight,
UvA, UCLondon, KEK, Taiwan, KNU (Korea),UERJ
(Rio), USP (Sao Paolo) - Cisco
- Integrated hybrid experimental network,
leveraging Transatlantic RD network
partnerships packet-switched dynamic optical
paths - 10 GbE across US and the Atlantic NLR, LHCNet,
NetherLight, UKLight, etc. Extensions to
Korea, Brazil, Taiwan - End-to-end monitoring Realtime tracking and
optimization Dynamic bandwidth provisioning - Agent-based services spanning all layers of the
system, from the optical cross-connects to the
applications.
30
31Grid3 ? Open Science Grid
- Build on Grid3 experience
- Persistent, production-quality Grid, national
international scope - Ensure U.S. leading role in international science
- Grid infrastructure for large-scale collaborative
scientific research - Create large computing infrastructure
- Combine resources at DOE labs and universities to
effectively become a single national computing
infrastructure for science - Provide opportunities for educators and students
- Participate in building and exploiting this grid
infrastructure - Develop and train scientific and technical
workforce - Transform the integration of education and
research at all levels
31
http//www.opensciencegrid.org
3232
Source Cindy Zheng
33Grand Challenge Science Instruments
- Gemini-South Optical Observatory
- NRAO telescopes
- La Serrena, Chile
Atacama Large Millimeter Array (ALMA) Atacama
plains in Chile
33
34Traditional VLBI
The Very-Long Baseline Interferometry (VLBI)
Technique(with traditional data recording)
The Global VLBI Array(up to 20 stations can be
used simultaneously)
34
35Pan-American Advanced Studies Institute
- NSF sponsored program to offer a series of
lectures at the advanced graduate and
postgraduate level involving domain researchers,
students and practitioners. Award 0418366, OISE
Americas Program - Aims to disseminate advanced scientific and
engineering knowledge, stimulate collaborative
learning and cooperation among the research
communities of the Americas
Mendoza Argentina
- CIARA, along with collaborators from the U.S.,
Argentina and Brazil, is organizing a PASI to
offer a series of lectures on the role of Grid
Computing and Advanced Networking for High-Energy
Physics and Astronomy - Our PASI is planned for May 15-20, 2005 in
Mendoza, Argentina - Approximately 40 students from the Americas will
learn of the major experiments, Grid and advanced
networking technologies and how the growing
interdependence between the science and the
technologies are forming global collaborations
35
36Thank You!
- WHREN-LILA, AMPATH infrastructure, CHEPREO,
science application support, education, outreach
and community building efforts are made possible
by funding and support from - National Science Foundation (NSF) awards
STI-0231844, MPS-0312038, OISE-0418366 and
SCI-0441095 - Florida International University
- Latin American Research and Education community
- The many national and international collaborators
who support our efforts
36