SE requirements from experiments

1
SE requirements from experiments

• Eric van Herwijnen
• Tuesday, 29 january 2002

2
Contents

• Data Production
• Jobs
• CERN (Castor)
• Lyon (HPSS)
• RAL (Datastore)
• Essential dg commands for testbed1

3
Data Production
Run
Gen
Gen
Step
Sim
Sim
Sim
Rec
Rec
Rec
Rec
Min
Min
Job
Workflow
4
Jobs

• Find input data
• Schedule job
• Get input data from mass store
• Reserve space for output data
• Execute program
• Check output
• Copy output to local mass store
• Copy output to CERN mass store
• Update production and bookkeeping databases

5
CERN (Castor)

• !/bin/csh
• stagein -M castorfile -h stagelhcb -p lhcbdata
  -s filesize localfile
• stageout -s file -p lhcbmc M castorfile
  localfile
• run fortran executable (open, read, write)
• stageupdc localfile
• update bookkeeping db via call to java program

6
Lyon (HPSS)

• setenv HPSSGROUP cchpsslhcb/hpss/in2p3.fr/group/l
  hcb
• setenv RFCP_HPSSCOS 0
• setenv localfile sfget -s 500 localfile
• rfcp HPSSGROUP/inputfile inputfile
• Executable writes to localfile
• rfcp localfile HPSSGROUP/localfile
• update bookkeeping db via call to java program

7
RAL (datastore)

• setenv TAPE_OWNER LHCB
• tape -b23040 -lal -tfb -r finputfile inputfile
• ln inputfile inputfile
• executable writes to dstfile
• datastore create dstfsize 1500MB
• tape -b23040 -lal -tfb -w -fdstfile dstfile
• update bookkeeping db via call to java program

8
Essential dg commands for testbed1

• gdmp_register_localfile (D5.2 use case 4.1.5)
• gdmp_publish_catalog (D5.2 use case 4.1.5)
• gdmp_get_catalog (D5.2 use case 4.1.1/2, 4.2.2)
• gdmp_replicate_get (D5.2 use case 4.1.1/2, 4.2.2)
• gdmp_stage_to_MSS CASTOR and HPSS (D5.2 use
  case 4.4.1.b)
• gdmp_stage_from_MSS at CERN and Lyon (D5.2 use
  case 4.4.1.b)
• gsiftpput, or equivalent GridFTP command (D5.2
  use case 4.1.1/2, 4.2.2)
• gsiftpget, or equivalent GridFTP command (D5.2
  use case 4.1.1/2, 4.2.2)