Monitoring of Grid Applications Connection of GRM to Mercury and RGMA

1
Monitoring of Grid ApplicationsConnection of
GRM to Mercury and R-GMA

• Norbert Podhorszki
• Laboratory of Parallel and Distributed Systems
• MTA SZTAKI Research Institute
• pnorbert_at_sztaki.hu
• www.lpds.sztaki.hu

2
In Dagstuhl...

• History
• P-GRADE
• GRM semi-on-line monitor
• Status and plans
• Stand-alone GRM grid monitor
• Connection to R-GMA

3
GRM and PROVE
In Dagstuhl...
4
In Dagstuhl...
GRM in grid
Local Host
Main MonitorMM
PROVE
Site 1
Site 2
Host 1
Host 2
Host 1
Local MonitorLM
Local MonitorLM
Local MonitorLM
Application Process
Application Process
Appl. Process
Appl. Process
5
In Dagstuhl...
Users Host
Site
Host 1
Host 2
6
Since then

• GRM cannot be used stand-alone because of
  firewalls
• R-GMA is too slow to transfer trace data.
• SZTAKI has developed Mercury monitor within the
  Gridlab project
• GRM can use Mercury for trace delivery

7
Grid Application Monitoring

• GRM
• Instrumentation library and trace collector
• Mercury monitor
• Transfer trace data from the application
  processes to GRM
• R-GMA
• Information system for finding the application
  and the monitor components

8
Mercury monitor

• To deliver trace data from the application to the
  user efficiently.
• Uses TCP Socket communication
• Data in XDR format and could be optimised for TCP
  transmission
• Two sw. hops between application and GRM local
  and main monitors
• One hw. hop host of main monitor

9
R-GMA

• To find the application by the user/GRM
• Where is it running? -gt machineX.siteY
• What is its global job id? -gt GID
• To find the monitor to be connected
• What is the address of Mercury monitor running at
  siteY?
• To find the application by the monitor
• What processes (PIDs) belong to application GID?
• In EDG, global job ID is not a problem, as it is
  known both by the application processes and the
  user.

10
Modifications to GRM

• Job wrapper script
• Publish process info into R-GMA
• Global job ID
• address of corresponding Mercury monitor
• Instrumentation library
• Connect and publish trace to Mercury monitor
• GRM
• Look for application asking R-GMA
• Connect to Mercury monitor and query for trace

11
GRMMercuryR-GMA
12
Status (GRMMercury)
13
Status (GRMMercuryR-GMA)

• Works fine in our institute
• Currently under installation on EDG testbed

14

• Thank you