Circuitswitched Highspeed EndtoEnd Transport ArcHitecture CHEETAH Roadmap version number: ONT2 Sept.

1
Circuit-switched High-speed End-to-End Transport
ArcHitecture (CHEETAH) Roadmap version number
ONT2Sept. 12, 2005
CHEETAH ONT2 09/06/05

• Malathi Veeraraghavan, UVA
• Ibrahim Habib, CUNY
• Nagi Rao, Bill Wing, Tony Mezzacappa, ORNL
• John Blondin, NCSU

2
Outline

• What is CHEETAH?
• Status of CHEETAH
• Today
• End of 2005
• End of 2006 (project ends)
• Roadmap
• Optical Services
• Optical Technologies
• Interoperability Capabilities
• Key themes and research issues

3
What is CHEETAH

• A shared circuit-switched network to complement
  connectionless IP service
• establish, use release, rate-guaranteed (from
  10 Mbps to 1 Gbps) host-to-host circuits.
• support TSI (Terascale Supernova Initiative)
  applications.
• large file transfers
• remote visualization
• remote computational steering
• leverage equipment that supports protocols for
  the creation of distributed (large-scale) shared
  circuit-switched networks (SN 16K with EoS data
  plane and GMPLS control plane).
• Distributed Control Plane (GMPLS) supporting
  overlay GMPLS and Peer models.
• End hosts with two Ethernet NICs each
• Primary NIC connected to the enterprise
  LAN/Internet
• Secondary NIC connected to CHEETAH network node.
• C-VLSR software to extend connection-oriented to
  non-GMPLS devices (based upon the VLSR of DRAGON
  team).
• Routing decision when to use CHEETAH for file
  transfers.
• Optical Connectivity Service (OCS) Obtain remote
  hosts CHEETAH availability information and MAC
  address.
• Transport Protocol FRTP.
• Main Premise Dynamic Bandwidth Sharing among
  many users.
• Extend solution
• to a connection-oriented internet (e.g., VoD),
  grid computing, heterogeneous connections.
• to partial connections (impt. setup triggered
  from end hosts).

4
CHEETAH Network (data-plane)September 05
NC
Orbitty Compute Nodes
ORNL
1G
Cisco 7600 switch
Compute-0-4
H
1G
Force10 E300 switch
1G
1GFC
Compute-0-3
1G
H
X1(E)
UCNS
Compute-0-2
H
1G
Compute-0-1
H
1G
1Gbps VLAN
Compute-0-0
H
1G
1G
OC192
OC192
GbE
5x1Gbps VLAN
10GbE
GbE
OC192
1G
Cisco 7600 switch
1-7-33
1-8-33
1G
1G
Zelda4
1-8-34
1-7-34
H
1G
1G
1-6-1
1-7-1
1-8-35
1-7-35
Zelda5
1G
1-7-1
1-6-1
H
1-7-36
1-8-36
1G
1G
1-8-37
1-6-17
1-7-17
1G
Cheetah-ornl
1-8-38
Juniper 320 router
wukong
H
cheetah-nc
Atlanta
OC-192 lamda
Direct fibers
OC192
10GbE
GbE
1G
1-7-33
Zelda1
VLANs
H
1G
1-7-34
Zelda2
H
1G
MPLS tunnels
1-6-1
1-7-35
Zelda3
Cheetah-atlanta
H
1-7-36
1G
Juniper 320 router
1-7-1
1-7-37
2x1Gbps MPLS tunnels
1-7-38
1G
G. Tech
1-6-17
1-7-39
Hosts
Ethernet switch
1 GbE
5
CHEETAH Data Plane Evolution Roadmap
International networks
1 GBE via NYSERnet
NASA
CUNY
32 AoA NY PoP
Via HOPI
Dragon
McLean PoP
MPLS Via Abielene
2 GBE Via Vortex
New Users
5 GbEs
UVA
Raleigh PoP (MCNC) (Sycamore SN16000)
NCSU
Atlanta PoP (SoX/SLR) (Sycamore SN16000)
OC192
Duke
1 GbE
New Users
OC192
1 GbE
G. Tech
ORNL
End of 2005
End of 2006
To Ultra-Science Net
Beyond 2006
6
CHEETAH Control Plane - Phase I, as of Sept.
2005

• Out of band signaling through Internet (secured
  by IPsec tunnels set up by Juniper NS5XT firewall
  and OpenSwan open source IPsec software).
• IETF GMPLS Overlay model is adopted.
• End hosts run only RSVP (apps. signal SN16K
  nodes)
• TE links are configured directly between end-host
  and SN16k.
• BroafLeaf routing (OSPF based) and signaling are
  used between SN16K nodes.
• Virtual-TE link is configured between SN16ks
  providing logical adjacencies for the SN16ks that
  physically host UNI attached client devices (only
  connectivity information is provided).
• FSC for 1-Gbps EoS circuit setup.

7
CHEETAH Control Plane - Phase I, as of Sept.
2005
BroadLeaf
TE Link


TE Link



16kA
16kB
Virtual TE-link
Super computer
Ethernet Switch A
Ethernet Switch B
Other computers
UNI
UNI
8
CHEETAH Control Plane - Phase I, as of Sept.
2005 (signaling)

• End host initiates path setup

bwrequestor
bwmgr
OCS
Application
bwLib
CAC
RSVPD
To edge switch
9
Interaction with SN16KSept. 05 (signaling)
RSVP-TE Path
RSVP-TE Path
RSVP-TE Resv
ControlCard
ControlCard
RSVP-TE Path
BroadLeaf Message
GbE
OC192
GbE
OC192
SN16000
SN16000
10
CHEETAH Control Plane - Phase II, at end of 2005

• IETF GMPLS Overlay model is still adopted.
• FSC for 1-Giga EoS circuit setup
• CHEETAH Virtual Label Switch Router (CVLSR) will
  be deployed between end-hosts and SN16k.
• CHEETAH Virtual Label Switch Router (CVLSR) is
  based upon the RSVP-TE Kom and VLSR of Dragon
  team
• Add VLAN support.
• Add hop-by-hop routing.
• Add Cluster management and rate-limiting
  functions for cluster members.

11
CHEETAH Control Plane Evolvement - Phase II, at
end of 2005
CVLSR
BroadLeaf
CVLSR
VLAN Group
TE Link
TE Links

TE Link



TE Link




16kA
16kB
Virtual TE-link
Super computer
Ethernet Switch A
Ethernet Switch B
Other computers
UNI
UNI
12
CHEETAH Control Plane - Phase III, at end of
2006

• Both IETF GMPLS Overlay model and Peer model will
  be supported.
• OSPF-TE is deployed within Sycamore cloud to
  provide both connectivity and bandwidth
  information.
• More capabilities will be added to CVLSR
• L2SC support (for sub-1Gbps circuit setup)
• Inter-domain routing
• Heterogeneous path setup in multi-region and
  multi-layer networks.

13
CHEETAH Control Plane Evolvement - Phase III, at
end of 2006
CVLSR
OSPF-TE
CVLSR
VLAN Group
TE Link
TE Links

TE Link



TE Link




16kA
16kB
TE-link
Super computer
Ethernet Switch A
Ethernet Switch B
Other computers
GMPLS Peer Model
14
Work and Test Status (as of Sept. 2005)

• 1 Gbps FSC end-to-end (with hosts directly
  connected to the SN16ks in Atlanta and MCNC) EOS
  circuits have been provisioned through control
  plane initiated by end host RSVP-TE client.
• 1 GbE between CCNY and 32 AoA PoP is ready.
• End host file transfer software using FRTP for
  CHEETAH application is tested.
• OSPF adjacency was successfully brought up
  between CVLSR and SN16k, and TE-link state
  database was built in CVLSR.
• RSVP signaling (endhost-CVLSR-SN16k-SN16k-CVLSR-en
  dhost) before end of Sept. 05

15
Roadmap Optical Services
Dedicated lightpaths Dynamic lightpath
allocation TDM mux/demux Highly Granulated
Optical Subchanneling Distributed
Control Encapsulation Support Application Control
Signaling SONET Switching Attribute-Based
Lightpath selection
2005 2006 2007 2008 2009 2010
Project ends
Forecast for future
16
Roadmap Optical Technologies
OADM, ROADM
DWDM and CWDM
GMPLS Distributed Control Systems
Optical Packet Switches
2005 2006 2007 2008 2009 2010
Project ends
Forecast for future
17
Roadmap Interoperability Capabilities
Multiple Region and Layers Connection Setup
Inter-networks Routing and Signaling (CHEETAH,
HOPI, DRAGON, NASA, ..others)
Inter-networks Traffic Engineering
Control Plane Security
Services Management (e.g., accounting, policy)
2005 2006 2007 2008 2009 2010
Project ends
Forecast for future
18
Key Themes and Issues

• Connecting with other networks
• HOPI, DRAGON, Ultra-Science Net, NASA and
  inter-national networks
• Add new users and applications
• Remote visualization, Grid-computing,
  Web-download
• Inter-domain routing
• Heterogeneous path setup in multi-region and
  multi-layer networks (nested, stitched,
  contiguous LSP signaling)
• End host transport protocol and signaling engine
• Control plane security
• Scalability (distributed approaches)

19
Key Research

• Decision on initiating CHEETAH circuit set-up
• CAC and Bandwidth sharing modes
• Scheduled vs. immediate-request
• Long vs. short durations
• Granularities of calls
• Varying bandwidth rates
• Inter-domain Routing.
• Inter-domain Traffic engineering.

20
Centaur Lab (900 Main Campus Drive)
UVA
CHEETAH NETWORK
Abilene
CVLSR
100M
Ra/GW1 Downtown GSR (quest POP)
GbE
CMDF 15200
Ra 15200
H n
OC48
OC48
100M
ORNL
Summit4
OC192
H 1
ORNL Gateway
Firewall
Cray X1 Phoenix
GbE Switch
OC48
Centaur GSR
OC48
CVLSR
1GbE
NCNI/ NCREN
GbE
10GbE
CHEETAH
10G Ethernet Switch
HPSS
circuit
GbE Switch
Dell 2650
NCSU campus
GbE
10/100M
MSPP
15454
Orbitty
NIC
NIC
TSILAN
Dell 2650
100Mbps
1
Dell 2650
Fiber channel switch
Dell 2650
2
John's viz cluster
6
Dell 2650
MCNC (Building3)
EbE card
1-port OC-192
CVLSR
CMDF (Main Campus Dr.)
1G
GbE
unet1
H
Ciena CoreStream
SN16k
7600
.
CVLSR
1G
10G Ethernet Switch
H
5 1-GbE VLANs
10G Ethernet switch

15454
15454
SN16k
1G
H
H
Juniper E300 Router
32 Ave.
HOPI
To Ultra-Science network
To DC Dragon
Abilene
Departure Drive
Ciena CoreStream
15808
H
H
SN16k
Movaz Ray Express
1G
Juniper E300 Router
CVLSR/AAA server
HOPI
2x1GbE MPLS tunnels
100M
NLR PoP RAL
15454
SOX (56 Marietta Street)
Cisco
GbE
H n
100M
FESX424
New E-series card
H 1
Cheetah Test Host
1GbE fiber
Cisco
NYSERNET POP Convent Ave 138 St.
OC-192
555 West 57th St NYSERNET
Movaz Ray Express
Steinman Hall
15808
DWSM
MSPP
MSTP
New Lambda
15454
15454
MPLS tunnel
NLR Pop ATL (345 Courtland Street)
CCNY (141th St. Covent Ave)
Shepard Hall
Transparent (not controllable)
21
HOPI 10 GBE with VLSR In New York
JPL
Statically provisioned Links at 1 GBE each
To international networks via Statically
provisioned paths In MAN LAN switch in NY POP
USC-SIO
10 GBE
Dragon Nodes (MIT Observ, others)
NLR in Sunnyvale
10 GBE
Other networks (OPTIPUTR, MATP)
Columbia Project
Dragon network Dynamic provisioning Via GMPLS
GSFC 10 GE With VLSR
HOPI 10GE With VLSR
GSFC with VLSR Maryland GSFC
Hosts
Ames Router
ARC
Other nodes
McLean PoP
10GBE
Ultranet SONETXC
Other nodes Multiple domains
OC192
OC192
Hosts
SONET XC S1 (at Atlanta)
SONET XC S2 (at MCNC)
NCSU 10 GBE With VLSR
ORNL
ORNL Super computer
Ultranet
Dynamically Provisioned Ultranet Paths Via
Network Management
Dynamic Provisioning in Cheetah network via GMPLS
control plane
Hosts (Viz. Cluster)
Ultranet nodes
NCSU
22
CVLSR Architecture
CVLSR
GMPLS Engine (Linux PC)
Parameter Configuration
Routing
Signaling
Control Channel
Control Channel
RSVP Daemon
To / From Next Hop
CAC
Cluster mgt
Switch Fabric control
To / From Previous Hop
Data Channels
Data Channels
SNMP Msg.
Ethernet Switch