GridSAM Introduction

1
GridSAM Introduction Practical

• Steve Crouch, OMII-UK
• s.crouch_at_omii.ac.uk
• 14/07/09

2
Overview

• An example scenario - CPOSS
• Introduction to GridSAM
• How and where to get it, future developments
• The basic practical
• Client installation
• Basic job submission and monitoring
• A job with data using GILDA GridFTP service

3
Example Scenario - CPOSS ENGAGE Project
Condor
GridSAM
ActiveBPEL

• Users and their applications are all important
• Grid is an enabler

4
GridSAM Overview

• What is GridSAM to the resource owners?
• A Web Service to expose heterogeneous execution
  resources uniformly
• Single machine through Forking or SSH
• Condor
• Portable Batch Scheduler (PBS)
• Platform Load Sharing Facility (LSF)
• Sun GridEngine
• Globus
• Acts as a client to these resources
• What is GridSAM to end-users?
• A set of end-user command-line tools and
  client-side APIs to interact with GridSAM Web
  Services
• Submit, monitor and terminate compute jobs
• Cross-protocol file transfer (gsiftp, ftp, sftp,
  WebDav, http, https, soon SRB, iRODS) via
  Commons-VFS (http//sourceforge.net/projects/commo
  nsvfsgrid)

5
GridSAM and OGF Open Standards

• Two key standards for two key elements
• The Basic Execution Service interface (OGSA-BES)
• Handles basic job lifecycle management
• Defines simple (but extendable) job state model
• Pending, running, cancelled, failed or finished
• The Job Submission Description Language (JSDL)
• Specify job executable, data staging and resource
  requirements
• Partial support for (across some DRMs)
• HPC File Staging Profile fine-grained security
  for data staging
• JSDL Single Process Multiple Data (SPMD)
  Application Extension

6
GridSAM Architecture

• A staged event-driven architecture
• Submission pipeline is constructed as a network
  of stages connected by event queues
• Each stage performs a specific action upon
  incoming events

7
GridSAM Publications Enabled Activities
8
OMII Development Kit Server

• Currently version 3.4.4 comprised of
• Web Services Container
• Tomcat/Axis - Web Services provider/container
  with optional WS-Security - handles
  authentication
• Data persistence managed by readily-installable
  PostgreSQL or HyperSonic databases, or
  pre-installed MySQL
• Optionally downloadable and installable
  Commissioned Software server components
• GridSAM Job submission and monitoring
• AHE Application Hosting Environment
• Grimoires UDDI metadata registry
• Development Kit Client thats the practical ?

9
CGT The Campus Grid Toolkit

• Client/server solution that contains
• Apache Tomcat/Axis/WSS4j (WS-Security)
• GridSAM
• Optional - Application Hosting Environment (AHE)
• PostgreSQL or HyperSonic database
• Easy installation for quick deployment via
  autoconfiguration
• Initial security setup for testing
• Hooks into existing computational resources
• End-to-end, out of the box working examples
• Documentation
• Version 1.1.3 (with GridSAM 2.1.6) out now

10
Open Development

• GridSAM is Open Source, Open Development
• GridSAM SourceForge project
• 99.03 activity, 1 release/month
• SVN source code repository
• Developer User mailing lists
• You are more than welcome to contribute!

http//sourceforge.net/projects/gridsam/
11
Future Developments

• Consolidation, extensive testing towards public
  2.2.0 release end-Q3 2009
• Stress testing, improvement of support for
  standards
• Deployable as a standalone, vanilla web service
• PBS-based deployment on NGS
• JSDL Parameter Sweep Extension
• Single job submission that parameterises inputs
• Policy-based brokering to other GridSAM instances
• Publication of roadmap by end-July for comment
  and feedback
• ...what our users want!

12
The Practical

• Go to http//www.ecs.soton.ac.uk/stc/ISSGC09
• Use issgc-ui.polytech.unice.fr
• Username issgcltxxgt
• Password GridISSltxxgt
• Included in the Integrated Practical
• Good luck!
• If you want more information
• http//www.omii.ac.uk/wiki/Documentation - for
  docs
• http//www.omii.ac.uk/ - for general OMII-UK info