The Open Science Grid Experience A US partner in the Global Distributed CyberInfrastructure that sup

1
The Open Science Grid Experience A US
partner in the Global Distributed
Cyber-Infrastructure that supports International
Computational ScienceRuth Pordes, Fermilab
Supported by the Department of Energy Office of
Science SciDAC-2 program from the High Energy
Physics, Nuclear Physics and Advanced Software
and Computing Research programs, and the
National Science Foundation Math and Physical
Sciences, Office of CyberInfrastructure and
Office of International Science and Engineering
Directorates.
2
OSGs Family History



LIGO operation
LIGO preparation


LHC construction, preparation
LHC Ops


iVDGL
(NSF)


OSG
Trillium
Grid3
GriPhyN
(NSF)

(DOENSF)
PPDG
(DOE)

DOE Science Grid
(DOE)

2000
2001
2002
2005
2003
2004
2006
2007
2008
2009
2010

European Grid Worldwide LHC Computing Grid

Campus, regional grids
3

• Transform processing and data intensive science
  through a cross-domain self-managed national
  distributed high throughput cyber-infrastructure
  that brings together Campus and Community
  infrastructures, supports opportunistic use, and
  facilitates the needs of virtual organizations at
  all scales.

The practice Achieve a transformative vision by
sets of small steps providing an inclusive,
usable, and responsive operating distributed
infrastructure supporting common and shared
software and hardware for ongoing science and
research acting in groups.
4
OSGdiverse, heterogeneous, includes very large
and very small organizations geographically
distributed

• 17 Scientific Communities Particle physics
  (e.g.Ian Fisk), Laser Interferometer
  Gravitational Wave Observatory (LIGO), Nuclear
  physics, molecular dynamics (JHU-CHARMM),
  mathematical optimizations (football pool
  problem), NanoHub, diverse application groups at
  RENCI
• 50 Resource (processing and storage) providers
  DOE national labs, university facilities,
  department clusters.
• 10 Software Providers Condor, Globus, gLITE,
  Storage Resource Manager, Internet2, ESNET,
  SciDAC-2 CEDPS, Fermilab accounting etc.
• 8 Partners - peer organizations - in the US,
  Europe, Asia and South America.

5
An International Science Community Common
Goals, Shared Data, Collaborative work
National Infrastructure boundaries in policies,
funding, culture, physical components
National Infrastructure
National Infrastructure
6
Challenges in Organization Communicating and
agreements take effort, time work, meetings,
non-parochial common forums, and needs high
level commitment.

• Organization forming the Consortium, bylaws,
  business processes, policies, decision making.
• Management 17 organization project with agreed
  upon program of work, reportable deliverables and
  schedules.
• Consensus common software stack, integration and
  release schedules, allocation of resources
• Commitment attention to detail and abide by
  rules, timely responses.

7
Now, 2010, for ever..International
Relationships Bridging and/or Common
Solutions?Both need us to work together.

• Global community of users requires attention to
  how OSG works with Europe, Asia, the rest of the
  Americas, Africa
• International needs immersed in all activities
• Security
• Software
• Operations
• Monitoring/measurement
• Data
• Computation
• Each needs technical meetings, and common work
  items.

8
Examples of work areas between EGEE - OSG
gt17 different work areas with activities, plans,
meetings, organization, communication, consensus
building and collaboration needs.

• OSG Blueprint - EGEE gLite Design.
• Middleware Security Working Group.
• Joint Security Policy Group.
• Joint operations meetings and workshops.
• Virtual Data Toolkit common software base release
  and support.
• Software build and test infrastructure ETICS -
  Metronome.
• Automated problem ticket exchange and cooperating
  support processes.
• Resource Service Validation (RSV) - Site
  Availability monitoring (SAM).
• Common Storage Resource Management (SRM)
  interface and API.
• Consistent Resource Information Publishing -
  Glue-Schema.
• International Grid Trust Federation (identity
  trust).
• Joint monitoring group - consistent monitoring
  information.
• Accounting information transfer.
• International training and education school.
• Grid Interoperability Now/Open Grid Forum
  multi-infrastructure contributions.
• Contributions to World Wide LHC Computing Grid.
• Planning for support of new cross-grid
  communities e.g. ITER, Dark Energy Survey, LIGO
  II -VIRGO.

9
Whats needed

• Means to contribute at least equally - preferably
  demonstrating US leadership - in cross-national
  joint initiatives and work common technical
  projects for all aspects of distributed
  infrastructures, in ways that are
• Inclusive, open, responsive, flexible, innovative
• International agreements and trust at all levels
  enabling global science and research.
• Defend against inevitable security incidents
  being too destructive.
• Defend against isolation and divergence.
• Recognised commitment to sustaining contributions
  already being made.
• Infrastructures, software, support, engagement
• Accurate recording and open communication of
  benefits and costs.
• Support for international face-to-face work
  exchanges balanced with support for
  easy-to-use/complete collaboration tools.

10
In particular for OSGs mission

• Collaborate during transitions in Europe with
  high profile outreach activities - EGEE II to
  III to EGI.
• Increase collaboration with other locally active
  countries - UK, Nordic, Italy etc.
• Ability to be leading players in emerging
  activities in Asia.
• Grasp the opportunities for energetic support and
  engagement with our neighbors in the Americas.