751.362Mbps over 5,626 km ~ 4e15 bit meters per second 4 Peta Bmps (

1
751.362Mbps over 5,626 km 4e15 bit meters
per second4 Peta Bmps (peta bumps)Single
Stream TCP/IP throughput

• Information Sciences Institute
• Microsoft
• QWest
• University of Washington
• Pacific Northwest Gigapop
• HSCC (high speed connectivity consortium)
• DARPA
• SysKonnect

2
Redmond/Seattle, WA
New York
Chicago, IL
Arlington, VA
San Francisco, CA
5626 km 10 hops
3
The Path

• DC -gt SEA
• C\tracert -d 131.107.151.194
• Tracing route to 131.107.151.194 over a maximum
  of 30 hops
• 0
  ------- DELL 4400 Win2K WKS
• Arlington Virginia, ISI SysKonnect GbE
• 1 16 ms lt10 ms lt10 ms 140.173.170.65
  ------- Juniper M40 GbE
• Arlington Virginia, ISI Interface ISIe
• 2 lt10 ms lt10 ms lt10 ms 205.171.40.61
  ------- Cisco GSR OC48
• Arlington Virginia, Qwest DC Edge
• 3 lt10 ms lt10 ms lt10 ms 205.171.24.85
  ------- Cisco GSR OC48
• Arlington Virginia, Qwest DC Core
• 4 lt10 ms lt10 ms 16 ms 205.171.5.233
  ------- Cisco GSR OC48
• New York, New York, Qwest NYC Core
• 5 62 ms 63 ms 62 ms 205.171.5.115
  ------- Cisco GSR OC48
• San Francisco, CA, Qwest SF Core
• 6 78 ms 78 ms 78 ms 205.171.5.108
  ------- Cisco GSR OC48
• Seattle, Washington, Qwest Sea Core
• 7 78 ms 78 ms 94 ms 205.171.26.42
  ------- Juniper M40 OC48 Seattle, Washington,
  Qwest Sea Edge
• 8 78 ms 79 ms 78 ms 208.46.239.90
  ------- Juniper M40 OC48

4
The Performance PetaBumps

• 751.362 Mbps for 299.829 seconds (28 GB)
• single-thread single-stream TCP/IP
  desktop-to-desktop out of the box performance
• 5626 km x 751.362 Mbps 4.22e15 bit meter
  / second 4.22 Peta bmps

• 4470 byte MTU
• TcpWindowSize set to 20 MB

5
Configuration Settings

• Standard Windows 2000 Professional
• Registry settings in Sender Receiver
• Hkey_Local_Machine\system\Currentcontrolset\Servi
  ces\Tcpip\Parameters
• TcpWindowSize 20 MB (20971520)
• Tcp1323Opts 3
• MTU 4470 bytes at all routers in path

6
Attached

• Description of benchmark
• Source code

7
Receiver Console Log

• Thread Realtime(s) Throughput(KB/s)
  Throughput(Mbit/s)
• 
  
• 0 299.829 93920.201
  751.362
• Total Bytes(MEG) Realtime(s) Total
  Throughput(Trans/s) Total Throughput(Mbit/s)
• 
  
• 28160.000000 299.829
  1776.366 751.362