Grid Network Performance Monitoring for eScience

1
Grid Network PerformanceMonitoring for e-Science

• Mark Leese - Daresbury Laboratory
• Thursday 15/5/2003
• m.j.leese_at_dl.ac.uk
  http//gridmon.dl.ac.uk/mjl

2
Contents

• Purpose of the work
• GridMon what it does how it does it
• Progress examples
• The future
• Conclusion
• Questions?

3
Purpose of the work

• design and deploy an infrastructure for
• network performance monitoring within
• the UK e-Science community.
• Fault finding
• Performance prediction
• Key aspects
• Publish results ? (adaptive) Grid middleware and
  Grid apps
• Visualisation for humans
• End-to-end
• ability of TCP wrt high b/w networks

4
Monitoring What?
5
Monitoring How(1)?
IperfER PingER UDPmon MiperfER bbcp/ftp
Publication service
Grid middleware
Monitoring Architecture
www.visualisation
6
Monitoring How(2)?
7
Progress

• Intitial toolkit (IperfER, PingER, UDPmon) at 11
  of 12 e-Science centres. Other useful UK sites
  being added.
• MiperfER on beta trial at Cambridge, Cardiff, MCC
  and Newcastle.
• Active map also on trial.
• Click for AMAZING live demo

8
Examples PingER
9
Examples IperfER(1)
10
Examples IperfER(1)
11
Examples IperfER(2)
12
Examples MiperfER
13
Examples bbcp bbftp
14
The Future
(Taskers) Trident
Tools www i/f
bbcp/ftp GridFTP
Web service

• Longer term
• More sitesbut mesh doesnt scale!
• Wishlist features (but perhaps not all 3,000,000)
• Investigate other issues window sizes, QoS
• And

15
TCP Best Practice

• Demo TCP best practice to users this is what
  you can achieve, if you tune your machine like
  this...
• Possibles variables
• Kernel versions and patches
• MTU
• Interrupt handling
• However
• ...performance from copper-based GigE cards are
  intimately connected with judicious use and
  understanding of the corresponding driver(s)...
  Gray and Betz
• Bus speed, bus width
• No new fangled gizmos using what we already
  have!

16
Conclusion

• Near national infrastructure
• A little basic, but improving
• Poised for web i/f into historic data
• . then web i/f tests on demand
• What do YOU do next?.........
• http//gridmon.dl.ac.uk/

17
Network Monitoring for e-Science

• Questions
• m.j.leese_at_dl.ac.uk
  http//gridmon.dl.ac.uk/mjl

? ? ? ? ?