Abilene Observatory Update Short IRNC Measurement Update

1
Abilene Observatory Update(Short) IRNC
Measurement Update

• Matt Zekauskas, matt_at_internet2.edu
• 2005-10-06

2
Abilene Observatory Update
3
History and Motivation

• Original Abilene design included measurement
  devices
• Single PC in the rack for NOC use, and early
  OWAMP (Surveyor)
• Optical splitters in one location
• Motivation was primarily operational
• Data collections
• Collected and maintained by the NOC
• Answer How is network performing?
• The data was also valuable for research purposes

4
History and Motivation

• An important decision was made during the last
  upgrade process (Juniper T-640 routers and
  OC-192c)
• Two racks with one dedicated to measurement
  platform
• Potential for research community to collocate
  equipment
• Created two components to the Observatory
• Collocation - research groups are able to
  collocate equipment in the Abilene router nodes
• Measurement - data is collected by the NOC, the
  Ohio ITEC, and Internet2, and made available to
  the research community

5
Abilene router node
Power
Power (48VDC)
Eth. Switch
Measurement Machines (nms)
Out-of-band
(M-5)
Space!
Measurement(Observatory) Rack
T-640
6
Dedicated servers at each node

• Houston Router Node
• NMS machines
• PlanetLab machines

7
Abilene Measurement Machines

• In each rack
• nms1 9000 MTU 1000bSX, throughput
• nms2 1500 MTU 1000bSX, ad-hoc (NDT)
• nms3 1500 MTU 100bT, stats collection
• nms4 1500 MTU 100bT, latency
• bwctl popular. Adding 5th nms node like nms1
  (newer hardware, though) to allow for more peers.
  On most nodes now, configured soon.

8
Measurement Capabilities

• One way latency, jitter, loss
• IPv4 and IPv6 On-demand available
• Regular TCP/UDP throughput tests 1 Gbps
• IPv4 and IPv6 On-demand available
• SNMP (Abilene NOC)
• Octets, packets, errors collected frequently
• Netflow (ITEC Ohio)
• Addresses anonymized by 0-ing the low order 11
  bits
• Multicast beacon with historical data (NOC)
• Routing data
• Both IGP and BGP - Measurement device
  participates in both
• Router data (NOC) show snapshots syslog
• See also Abilene Router Proxy

9
Databases Date Types

• Data is collected locally and stored in a
  distributed databases
• Databases
• Usage Data
• Netflow Data
• Routing Data
• Latency Data
• Throughput Data
• Router Data
• Syslog Data

10
Databases - Interface

• Variety of Interfaces to data
• Simple web based for usage data
• Rsync for netflow
• Simple web based for routing data
• SOAP interface for latency data
• SOAP interface for throughput data
• SOAP interface for Router data
• Syslog data still under development

11
Data for Research

• Lots of netflow projects
• SIGCOMM and INFOCOM papers
• Some SNMP
• Some routing configuration
• Latency throughput, mostly to test webservices,
  schema development
• Others we are not aware of because the data is
  public

12
Colocation for Research

• PlanetLab
• New future MPLS links so can act as router w/own
  links and peering
• AMP active measurement from NLANR MNA (San Diego
  Supercomputer Ctr.)
• PMA passive monitoring. Currently every
  interface on the IPLS router is instrumented.
  From NLANR/MNA.

13
Other network research stuff

• Buffer sizing project (Stanford)
• Reduce buffers available to router interfaces
  (software controlled)
• Take an anonymized but correlated packet trace at
  IPLS
• Look for throughput and latency anomalies
• Rapid raw SNMP to test link capacity test
  programs
• Occasionally run programs on behalf of
  researchers on nms2 machines

14
Testing in to Abilene

• Want to test latency in to Abilene? Use one-way
  ping (OWAMP)http//e2epi.internet2.edu/owamp/
• No need to ask us first, we rate limit
• Want to test a host? Use the Network Diagnostic
  Tool (NDT)http//e2epi.internet2.edu/ndt/
• No need to install anything to test, just go to a
  server

15
Testing in to Abilene

• Want to debug a path problem by running a flow to
  the middle of the network? Use bandwidth test
  controller (BWCTL)http//e2epi.internet2.edu/bwct
  l/
• You must ask first before testing, but then you
  can test at your leisure http//e2epi.internet2.e
  du/pipes/ami/bwctl/

16
URLs

• http//abilene.internet2.edu/observatory
• Pointers to all measurements/sites/projects
• http//www.abilene.iu.edu/
• NOC home page. Weathermap, Proxy, SNMP
  measurements
• http//netflow.internet2.edu/weekly/
• Summarized flow data
• http//www.itec.oar.net/abilene-netflow/
• Raw anon. data matricies MOVING

17
International Research Networks Connection
Measurement
18
IRNC

• US Government National Science Foundation (NSF)
  program to fund (parts of) network links to other
  countries
• GLORIAD is one funded project
• http//www.irnclinks.net/

19
IRNC Measurement

• Matt Mathis and Matt Zekauskas funded to
  investigate common measurements and metrics
  across all the projects
• Make recommendations to NSF
• Work with IRNC awardees iterative investigative
  process
• Very much a work in progress

20
Measurement Areas

• Interface statistics
• Topology evolution
• BGP statistics
• For the link, and key collaboration sites
• Delay (roundtrip, one-way if possible)
• TCP bulk data rate
• Select (small) UDP flows
• Network flow statistics

21
Acknowledgement

• This material is based in part on work supported
  by the National Science Foundation (NSF) under
  Grant Nos. SCI-0457404 and SCI-0513437. Any
  opinions, findings and conclusions or
  recommendations expressed in this material are
  those of the author(s) and do not necessarily
  reflect the views of the NSF.

22
(No Transcript)