ARDA Workshop and ATLAS Distributed Analysis Plans

1
ARDA Workshop and ATLAS Distributed Analysis
Plans
ATLAS ODCGMB Meeting

• David Adams
• BNL
• June 29, 2004

2
Contents

• ARDA workshop
• GLite issues
• ADA plans

3
ARDA workshop

• Workshop held last week
• Monday though Wednesday mid-afternoon
• http//agenda.cern.ch/fullAgenda.php?idaa042197
• Representatives from ARDA, EGEE and LHC exps
• For ATLAS David Adams, Laura Perini, Rob Gardner
• Also Solveig Albrand on Monday for metadata

4
GLite issues

• Architecture
• Does document really describe and architecture
• Can EGEE services be factored
• Only use pieces of the system
• Include pieces from other middleware providers
• Disagreements about the relative priorities of
  services to be delivered
• Between experiments
• Within EGEE
• Between exps and EGEE
• ARDA will try to define priorities

5
GLite issues (cont)

• Resources
• Need for compute resources
• Prototype is one worker node with AFS
• Licensing issues for non-EGEE sites
• At least before fall
• Promise to add resources by fall
• ATLAS ready much sooner

6
GLite issues (cont)

• GAS
• Much discussion about the merits
• Clear there is internal dissension in EGEE
• Statement will be able to use gLite services w/o
  GAS
• This is not clear from architecture document
• GAS might be replaced by each experiment
• E.g. ATLAS analysis service

7
GLite issues

• Metadata services
• EGEE view problem for experiments
• I asked for generic metadata service
• No commitment
• Solveig described the AMI service
• We could view them as our MW provider for this
• Should EGEE then adopt and maintain this?

8
GLite issues (cont)

• Data management
• Lots of discussion about GUID vs. LFN for
  identifying logical files
• Most files are read only (WORM)
• CMS has interest in mutable files for conditions
• Working plan file catalog is WORM CMS uses URL
  trick to make files mutable
• Agreement on need for file transfer service
• Proposal was made to use the CMS system for EGEE

9
GLite issues (cont)

• Package management
• I asked for more functionality and higher
  priority
• Good news architecture document includes more
  than predicted in January
• Communication
• Concern about communication between exps and
  gLite
• Like to have direct contact--not just through
  ARDA
• Did agree on a mailing list
• project-lcg-ardainfo

10
ADA news

• Some ADA items since the May SW week
• ATPROD analysis service
• Discussion last week
• Preference for a system that populates the prod
  DB
• Identify David Rebatto to work on this
• After LCG executor is working
• Miguel Branco will help

11
ADA news (cont)

• ARDA analysis service
• Dietrich Liko is working on this
• Able to deploy DIAL service with makeshift
  connection to EGEE WMS over a weekend
• Problems with WMS
• No end-to-end demo yet
• Much more work to do

12
ADA news (cont)

• ATPROD transformations
• Christian Haeberli is looking into reusing the
  transformations from ATPROD as ADA applications
• ATPROD analysis service could work from
  application name
• Package management
• Grigori Rybkine has begun work to deliver a
  package management service
• We should connect this to gLite