Distributed data analysis and survey production networks

1

• Distributed data analysis and survey production
  networks
• Liverpool, 14 June 2008

Edwin A. Valentijn OmegaCEN Kapteyn Institute
University Groningen
2
What is

• an e-science infrastructure with fully
  distributed resources,
• which allows teams distributed over Europe
• to jointly collaborate on the data production,
  calibration, QC, analysis of wide field imagers,
  
• in the optical, IR and radio.
• Current WFI_at_2.2m, INT, Subaru, ACS_at_ST
• Near future Panstarrs, VST, VISTA, Lofar
• Far future EUCLID

3
Paranal Monthly Data Rates 2007 statistics

• All Current Paranal
• Instruments 4 (433.2 GB)

• OmegaCAM 24 (2500 GB)

• VIRCAM 72
• (7500 GB)

• Mark Neeser

4
Example Public Survey KIDS VIKING
500 nights
250 nights
5
(No Transcript)
6
(No Transcript)
7
Astro-WISEGrid Computing

8
AstroWISE-Up
9
LOFAR _at_ 20-80 MHz 120-240 MHz

• EoR
• - transients
• Survey
• astroparticles

10
E-Lofar from experiment to observatory
11
E-LOFAR Participants

• GLOW
• -- Effelsberg station delivered
• -- Garching, Potsdam, Tautenburg stations ordered
• --Jülich station federal funding proposal
  submitted
• LOFAR-UK
• Chilbolton, Cambridge, Jodrell, Edinburgh
• 1 station funded, site to be chosen
• --3 more stations
• Sweden
• Onsala station funded
• Poland, Italy, Austria, Bulgaria, Ireland,
  France

12
Lofar Storage
13
Lofar distributed analysis
14
Astro-WISE Services
15
Extreme data lineage
16
Distributed data analysis and survey production
networks

• AstroWISE
• Observatories AstroGrid Euro-VO
• EGEE - GRID