An Open Standards-based Scalable Heavy Lifting Data Transfer Service for e-Research IV

1
An Open Standards-based Scalable Heavy Lifting
Data Transfer Service for e-ResearchIV

• David Meredith, Peter Turner, Alex Arana, Gerson
  Galang, Steve McGough, Steve Crouch

2
Progress

• Revisited architecture (with Steve McGough)
• Cant see any major problems at this stage
• Topological domain constraints for workers
• Different ways of using JMS for this tagging of
  messages via broadcast for individual or via
  different queues (specialisation)
• At service level, specify workers within JSDL
  Resources element? how best to do this
• Messaging routing for DTS worker nodes with
  domain constraints issue
• HPC File Staging Profile Extension security
  issue
• DataStaging elements only contain 1 credential
  element
• Need 1 credential element per Source/Target URI
• Suggest extension to file staging profile
• But not via credential references
• Since they should be addressed at a higher level

3
Next Steps (Out of CW)

• Spec issues
• S1 Schedule discussion within OGSA-DMI WG
  (Mario to organise)
• S2 HPC File Staging Profile/JSDL WGs (David
  M/Steve C to organise)
• S3 DW attend the OGF PGI sessions (Steve C)
• Design considerations
• D4 Messaging routing for DTS worker nodes with
  domain constraints issue
• Implementation - ready to prototype
• I5 1. JMS worker nodes
• I6 2. JSDL/extensions messaging format key for
  parallelising work
• I7 3. Self-contained WS client
• GridSAM, GrisU standalone webservice, Hermes,
  NGS Portal
• Resourcing
• DataMINX 2 developers Alex/Gerson over 2
  years already committed
• STFC/NGS David Meredith
• OMII-UK Steve Crouch