C???????%20???????????%20????????%20??????????%20??????????????%20LCG%20(LHC%20Computing%20GRID)

1
C??????? ??????????? ???????? ??????????
?????????????? LCG (LHC Computing GRID)

• ????? ?.?. (????? ???),
• ????????? ?.?. (?????, ????)
• RELARN-2003
• 16-20 ???? 2003 ????
• ?????-?????????

2
Five Emerging Models of Networked Computing From
The Grid

• Distributed Computing
• synchronous processing
• High-Throughput Computing
• asynchronous processing
• On-Demand Computing
• dynamic resources
• Data-Intensive Computing
• databases
• Collaborative Computing
• scientists

Ian Foster and Carl Kesselman, editors, The
Grid Blueprint for a New Computing
Infrastructure, Morgan Kaufmann, 1999,
http//www.mkp.com/grids
3
?
4
(No Transcript)
5
CERN
6
(No Transcript)
7
The Large Hadron Collider Project 4 detectors
CMS
ATLAS
Storage Raw recording rate 0.1 1
GBytes/sec Accumulating at 5-8
PetaBytes/year 10 PetaBytes of
disk Processing 200,000 of todays fastest
PCs
LHCb
8

• Online system
• Multi-level trigger
• Filter out background
• Reduce data volume
• Online reduction 107
• Trigger menus
• Select interesting events
• Filter out less interesting

9
LHC Challenges Scale

• Data written to tape 10 Petabytes/Year and UP
  (1 PB 109 MBytes)
• Processing capacity 100 - TIPS and UP
  
• (1 TIPS 106 MIPS)
• Typical networks 0.5 - Few Gbps Per Link
• Lifetime of experiment 2-3 Decades
• Users 5000 physicists
• Software developers 300 (Four Experiments)

10
LHC Computing Model2001 - evolving
The opportunity of Grid technology
MONARC project
Tier1
11
??????? ???????? ????????? (???) ??????
??????, ????? ????????? ? ???????
0.1-1 ??/???
???? ??? 5-10
12
????????? Grid ???????
Name URL/Sponsor Focus
European Union (EU) DataGrid www.eu-datagrid.org European Union ???????? ???????? Grid ??? ????????? ?????????? ? ??????? ?????? ??????? ???????, ?????????????? ? ???.
EU DataTAG Project www.datatag.org Interoperability between European and US Grids
CrossGrid European Union
EuroGrid, Grid Interoperability (GRIP) www.eurogrid.org European Union ???????? ?????????? ??? ?????????? ??????? ? ???????????????? ? ?? ???????????
Globus Project globus.org DARPA, DOE, NSF, NASA, Msoft ???????????? ? ??????? Grid ?????????? ???????? ? ???. ????????? Globus Toolkit ??????????.
GridPP gridpp.ac.uk U.K. eScience ???????? ???????? Grid ? ?????? ??? ??????? ????????????
13
????????? Grid ???????
Name URL/Sponsor Focus
Grid Physics Network griphyn.org NSF C??????? ?????????? ??? ??????? ?????? ? ?????? ATLAS, CMS, LIGO, SDSS
International Virtual Data Grid Laboratory ivdgl.org NSF ???????? ???????? ????????????? Grid ??? ????????????? ??? Grid ???????????? ? ????????????
TeraGrid teragrid.org NSF ??????? ?????????????? ? ???, ??????????? 4 ??????????? 40 Gb/s
Particle Physics Data Grid ppdg.net DOE Science ???????? ???????? Grid ??? ??????? ?????? ? ?????? ??????? ??????? ? ??????? ??????
14
The 13.6 TF TeraGridComputing at 40 Gb/s
Site Resources
Site Resources
26
HPSS
HPSS
4
24
External Networks
External Networks
8
5
Caltech
Argonne
External Networks
External Networks
NCSA/PACI 8 TF 240 TB
SDSC 4.1 TF 225 TB
Site Resources
Site Resources
HPSS
UniTree
TeraGrid/DTF NCSA, SDSC, Caltech, Argonne
www.teragrid.org
15
iVDGLInternational Virtual Data Grid Laboratory
U.S. PIs Avery, Foster, Gardner, Newman, Szalay
www.ivdgl.org
16
DataTAG project
NewYork
Abilene
STAR-LIGHT
ESNET
Geneva
MREN
STAR-TAP
17
EDG overview structure , work packages

• The EDG collaboration is structured in 12 Work
  Packages
• WP1 Work Load Management System
• WP2 Data Management
• WP3 Grid Monitoring / Grid Information Systems
• WP4 Fabric Management
• WP5 Storage Element
• WP6 Testbed and demonstrators
• WP7 Network Monitoring
• WP8 High Energy Physics Applications
• WP9 Earth Observation
• WP10 Biology
  
• WP11 Dissemination
• WP12 Management

Applications
18
EDG middleware architecture Globus hourglass

• Current EDG architectural functional blocks
• Basic Services ( authentication, authorization,
  Replica Catalog, secure file transfer,Info
  Providers) rely on Globus 2.0
  (GSI, GRIS/GIIS,GRAM, MDS)

Specific application layer
ALICE
ATLAS
CMS
LHCb
Other apps
VO common application layer
LHC
Other apps
High level GRID middleware
GRID middleware
Basic Services
GLOBUS 2.?
OS Net services
19
DataGrid Architecture
Local Application
Local Database
Local Computing
Grid
Grid Application Layer
Data Management
Metadata Management
Object to File Mapping
Job Management
Collective Services
Information Monitoring
Replica Manager
Grid Scheduler
Underlying Grid Services
Computing Element Services
Authorization Authentication Accounting
Replica Catalog
Storage Element Services
Logging Book-keeping
Database Services
Grid
Fabric services
Fabric
Node Installation Management
Monitoring and Fault Tolerance
Fabric Storage Management
Configuration Management
Resource Management
20
LHC Computing Grid Project
21
Fundamental Goal of the LCG

• To help the experiments computing projects get
  the best, most reliable and accurate physics
  results from the data coming from the detectors
• Phase 1 2002-05prepare and deploy the
  environment for LHC computing
• Phase 2 2006-08acquire, build and operate the
  LHC computing service

22
????????? ???????????? ??????????? LCG1) ?
???????? ?????? ?????????????? ????????????
??????????? ?????? ????? ????????????????
??????? Globus 2) ????? VDT (Virtual Data
Toolkit), ????????????? ? ???????????? GRID
???????? PPDG The Particle Physics Data Grid ,
GriPhyN Grid Physics Network, ? iVDGL the
International Virtual Data Grid Laboratory .
???? ????? ???????????? ????? ????? ?????????
??? ??????????? ???????????????? ??????? GLOBUS,
??????????? ????????????? ??????????????
?????????????? ???????, ?? ??????????? ??? ?????
???? GRID ????????. ?? ????? ???????? ? ????
????? Condor/Condor-G, ??????? ???????????? ?
???????? ?????????????? ??????? ??????? ??????? ?
???????? ??????. 3) ????? ???????? ? ?????,
????????????? ? ??????? EU DataGRID
??????-?????? (?????????????? ?????? ??
????????????? ???????), ?????????????? ??????,
replica catalog ? ??.
23
Building a Grid
?The virtual LHC Computing Centre
Grid
Collaborating Computer Centres
Alice VO
CMS VO
24
(No Transcript)
25
DataGrid Architecture
Local Application
Local Database
Local Computing
Grid
Grid Application Layer
Data Management
Metadata Management
Object to File Mapping
Job Management
Collective Services
Information Monitoring
Replica Manager
Grid Scheduler
Underlying Grid Services
Computing Element Services
Authorization Authentication Accounting
Replica Catalog
Storage Element Services
Logging Book-keeping
Database Services
Grid
Fabric services
Fabric
Node Installation Management
Monitoring and Fault Tolerance
Fabric Storage Management
Configuration Management
Resource Management
26
??????? ?????????? ???????? ??????????????
???????? GIIS, ?????????? ?????????? ? ?????????
?????????????? ???????? ? ???????? ?? ????????
?????? (??????????? GLOBUS ??????? GRIS ?? ??????
???? ?????????????? ???????) ? ?????????? ???
?????????? ? ???????????? ?????? ? ???????????
?????? GIIS. ????? ???????, ??????? ?
?????????????? ????????????? ????????? ??????????
?????????????? ?????? GRIS-GIIS. ???????????
????? ?????????????? ?????? GIIS
(ldap//lhc-fs.sinp.msu.ru2137), ???????
???????? ?????????? ? ????????? ????????
?????????? ?????????? ?? ?????????????? ??????
GIIS (ldap//testbed1.cern.ch2137)
???????????? ??????? EU DataGRID.
27
Russian National GIIS

• SRCC MSU, KIAM and TCSS participate only in
  Russian DataGrid project and are not involved in
  CERN projects.

28
?????? ????????????? EDG middleware (CMS VO)
29
? ????? ??? ?????? ???????????????? ?????
(Certification authority, ??) ??? ???????????
????????. ??????????? ????? ?????? ???????????
????? ??????????? ???????????? ??????? EU
DataGRID. ??????????? ????? ?????????????
???????? ?? ??????????? ? ??????? ????????????? ?
?????? ???????????? ??????????????? ???????
(Registration authority, RC), ?????????? ???????
????????????? ??????????? ???????? ? ???????
??????????? GRID. ??????????? ?????????
?????????? ? ???????? ??????????? ???????, ?
????? ????? ???????? ??? ????????????? ??????
????????????????? ??????. ???????????? ?????
CARC ? ????? ???????? ??????? ? ????? ? ??????
?????????? ???????????? ??????? EU DataGRID.
30
?????????????? ? ?????????????? ?????????
?????????? ?????? ? ??? ?????? GDMP (GRID Data
Mirroring Package), ??????? ??????? ???
?????????? ????????? ???????? ? ???????????????
?????? ??????. ??? ?????????? ??????????? GRID ?
???????? ?? ????? ??????-??????, ?.?. ??????????
????????? ? ???? ?????? ?????????? ? ????????????
??????. ?????? ???????????? ????????? ???????? ??
?????????? ? ????, ? ??????? ??????????
??????????? ????? ? ??????? ??????? GSI-ftp.
??????? ?????? GDMP ???????? ? ????????-??????????
?????? ????? ?????? Objectivity DB, ? ?????
????????? ?????? ? ???????????? ???????????
??????? ??????. ????????? GDMP ???????
???????????? ??? ?????????? ? ???? ??????????????
???? ??????????????? ??????, ??????????? ? ????
(?????), ????? ??? ? ?????? ?????????? ?? ??????
??????? ??????? ??? ???????????? LHC-CMS.
????????? GDMP ??????????????? ? ???????? GRID
????????? ??? ?????????? ????????? ?
?????????????? ????? ??????.
31
? ???? ???????? ???????? ????? ?? ???????????
??????? ????????, ?????, ???????? ? ??????????.
?????????? ???? ????????? ??????? ? ????????
??????? ??????????? ??? ?????????????? ?????????
? ????? ??????? ??????????? ????? (10.000 ?
?????), ???????????? ? ??????????? ??????????????
EU DataGRID. ? ?????? ?????? Monitoring and
Fault Tolerance (?????????? ? ???????????? ???
?????) ??? ????????? ? ???????? ???????
?????????? ??????? (Correlation Engine). ??????
???? ??????? - ????????????? ???????????
?????????? ????????? ?? ????? ???????? ? ????????
??? ?? ?????????????? ?????. ? ???????
?????????? ????????? ??????? ?????????? ???????
(Correlation Engine) ??????? ???? ??????????
?????????? ????????? ????? ?? ???? ??????????????
????????? ????. ???????????? ?????? ??????????
?????? ??? ????????? ?????? ????? ?????. ??
?????? ????? ????????????? ?????????? ?????????
Correlation Engine ? ?????? ??????????
??????????? ? ????????? ???????
??????????????????? ?????????????? ????? ??
????????. ???? ???????? ?????????? ??
?????????????? ????????? ? ???? ? ????, ???
???????????? ???? ?????????? ?????????? ?????????
?????.
32
?????? ???????? ???????????????? ??? CMS ?? LHC
(??? ??? ????)
33
?????? ???????? ???????????????? ??? CMS ?? LHC
(???????????? ???????)
34
(No Transcript)
35
(No Transcript)
36
(No Transcript)
37
Useful References

• GLOBAL GRID FORUM http//www.gridforum.org
• European GRID FORUM http//www.egrid.org
• PPDG http//www.ppdg.org
• IVDGL http//www.ivdgl.org
• EU DATA GRID Project http//www.eu-datagrid.org
• DATATAG Project http//www.datatag.org
• GLOBUS Project http//www.globus.org
• GriPhynProject http//www.griphyn.org
• CrossGRID http//www.cyfronet.krakow.pl/crossgri
  d
• Condor http//www.cs.wisc.edu/condor
• TERAGRID Project http//www.teragrid.org
• RIVK-BAK Project http//theory.sinp.msu.ru/ilyin
  /RIVK-BAK
• LCG http//www.cern.ch/lcg
• Ope
• n Systems Journal http//www.osp.ru