Nessun titolo diapositiva

1
GENIUS and EnginFrame GRID Portal across
Research and Industry
Roberto Barbera and Andrea Rodolico()
()work in collaboration with A. Falzone
2
Outline

• Industry and research collaboration
• GENIUS and EnginFrame technical background
• GENIUS features
• Workshop feedback

3
Why NICE INFN?

• NICE goals
• Deploy GRID Portal solutions to industry
• RD acknowledges the importance of standards
• Industry requires stable products and support

• INFN goals
• GRID research for HEP applications
• RD is focusing the whole GRID challenge
• Collaboration with NICE to drive Portal innovation

4
Why NICE INFN? (2)

• NICE role
• Contribute the foundation technologies
• Evolve the foundation to help INFN challenges
• Consolidate exploitable results

• INFN role
• Extend NICE off-the-shelf GRID portal
• Focus on leading edge challenges
• Aggressive and innovative GRID test-bed

5
INFN problems with GRID...

• EDG software (Globus, UI, JDL, WP2, WP3, etc.)
  contains tens of commands/switches which also
  have their own logical sequences
• Browsing Grid VO directories (users, RCs,
  DBs, etc.) requires LDAP speaking (or SQL
  tomorrow).
• User GRIDification is a tough task for a
  rookie ? does this fit with the claim that
  grids are for everybody?
• Furthermore, all this holds for DataGrid. What
  will happen when other grids software
  (especially UIs) will come up (PPDG, iVDGL,
  etc.) ? Will users have to learn tens of grid
  dialects ?
• Today grid computing is a rather complicated
  experience only possible at selected machines
  (UIs) ? does this fit with the vision grid
  computing from a PDA?
• Is there any way to set-up a user-friendly grid
  ?

6
A web portal why and how ?

• It can be accessed from everywhere and by
  everything (desktop, laptop, PDA, WAP phone).
• It can keep the same user interface to several
  back-ends (grid dialects ? command-line UIs).
• It must be secure at all levels
• 1) secure for web transactions,
• 2) secure for user authentication,
• 3) trustworthy at VO level.
• All available grid services must be incorporated
  in a logic way, just one mouse click away.
• Its layout must be easily understandable and user
  friendly.

7
Who is NICE?

• Mechanical Ferrari, Audi, FIAT Auto, FIAT Avio,
  CRF, Iveco, ELASIS, Marelli, UTS, Teksid,
  Brembo, Lear
• Energy ABB, Ansaldo, Nuovo Pignone, ENEL,
• EniChem, Enterprise Oil, Agip
• BioTech Pharmacia, (ENEA)
• Aerospace Alenia, CIRA, Galileo Avionica, IDS
• Electronics STMicroelectronics, Accent, Alcatel,
  Ericsson, Siemens
• Telecom Telecom Italia, Italtel, CSELT/TI-Lab,
  Pirelli
• Research ENEA, ICTP, INFN, CASPUR, CILEA, CNR,
  CRS4, Astronomical Obs.
• Education Scuola Normale Superiore di Pisa,
  Polit. Of Milan, Universities

7 years experience on Grid
8
Client
Grid Portal
Grid
NICE Deliverables
OGSA
9
Outline

• Industry and research collaboration
• GENIUS and EnginFrame technical background
• GENIUS features
• Workshop feedback

10
EnginFrame in brief

• Standards based GRID portal
• Java, Tomcat, XML/XSL GridML
• Solves back-end integration problems
• Visual rendering for most Grid objects
• jobs, job arrays, hosts, etc.
• Multiple Grid technologies support
• Globus, LSF, SGE, LoadLeveler, PBS, even OS!
• Authentication delegation (GSI,NIS,NT,Krb5, ...)
• Data management, UL/DL remote file browsing
• Integration with interactive apps, B.I. tools,
  etc.
• End-user oriented focus!
• Commercial application integrations

11
EnginFrame workflow
Application Servers
Interactive applications
Web Server
Clients
EnginFrame Server
Standard Web Browser
Grid / Compute Farm
12
Industrial Grid Portals
Black-box Grid solutions
13
GRID Job Submission work-flow
Replica Catalogue
Information Service
Resource Broker
Author. Authen.
Job Submission Service
Logging Book-keeping
Compute Element
GGF7 - Tokyo, March 2003
NICE INFN
14
GENIUS (Grid Enabled web eNvironment for site
Independent User job Submission)https//genius.c
t.infn.it INFN/NICE collaboration
GENIUS web portal
15
GENIUS how it works
WEB Browser
GENIUS
Local WS
EnginFrame
Apache
EDG UI
16
GENIUS architecture
EnginFrame Server
EnginFrame Agent
EDG Toolkit
Globus 2.x
Content Rendering
Replica Manager
GFTP
XML Processing
Service Repository
Service Execution
Resource Broker
GSI
...
...
...
...
17
Outline

• Industry and research collaboration
• GENIUS and EnginFrame technical background
• GENIUS features
• Workshop feedback

18
GENIUS show the main page
19
GENIUS show the authentication
20
New grid authentication à la MyProxy
EDG UI
MyProxy Server
GENIUS Server (EDG UI)
WEB Browser
Local WS
21
GENIUS show file services
22
GENIUS show job submission
23
GENIUS show job queue
24
GENIUS show job data
Roberto Barbera
25
GENIUS show interactive analysis
26
GENIUS show Web JDL Editor
27
GENIUS show Replica Catalog support
28
Present status and perspectives

• Current version of GENIUS (v2.2.0) has more than
  100 services!
• Current implementation of GENIUS already
  includes
• secure web transactions, user authentication and
  authorization
• Grid authentication à la MyProxy !
• remote interaction with the users and grid
  file system
• interfaces for job submission/control, data
  management, VO servers, and to monitoring
  systems
• Several Resource Brokers available
• persistent (users) book-keeping and spooler
  system
• web-guided creation of a job
• secure interactive analysis with TightVNC !
• CVS available !
• Todo
• multi-jobs (parallel and sequential)
• more application-specific customizations

29
GENIUS vs. other grid portals

• It is not a toolkit. It is a complete
  production-ready environment which combines the
  concepts of user portal and science portal.
• No client software needs to be installed apart
  from the web browser. GENIUS can be accessed from
  everywhere.
• Access passwords are securely streamed only
  when needed.
• Interactive analysis (via VNC) and web access to
  personal spooling areas are possible.
• User file system is not limited to input and
  output files.
• EnginFrame modularity makes different
  customizations easy to implement. Already
  available for EDG m/w, GLOBUS, LSF, etc. Under
  definition for CONDOR (Hungarian grids).

30
GENIUS where

• During 2002 GENIUS has been demonstrated in many
  occasions by various peoples
• 4th DataGrid Conference, Paris (R. Barbera)
• INFN Workshop on Physics and Industry, Erice (R.
  Barbera and M. Reale)
• Asian Pacific Grid Conference, Taipei (M. Reale)
• Launch Workshop of the EU GÈANT Project, Brussels
  (R. Barbera and M. Reale)
• CCGrid2002, Berlin (M. Draoli)
• 5th HLRS Metacomputing Workshop and 1st Public
  DAMIEN Workshop, Stutgart (R. Barbera)
• TERENA 2002, Limerick (R. Barbera and the CNR
  WP11 Team)
• Ba-Bar Grid meeting, Ferrara (R. Barbera)
• ACAT 2002 Conference, Moscow (R. Barbera)
• 5th DataGrid Conference, Budapest (R. Barbera)
• iGrid2002, Amsterdam (R. Barbera)
• CERN School 2002, Vico Equense (M. Reale)
• IST2002, Copenhagen (The WorldGrid Team)
• ER2002, Brussels (R. Barbera and the CNR WP11
  Team)
• SC2002, Baltimore (The WorldGrid Team)
• Nuclear Instruments and Methods A
• Future Generation Computing Systems

2003
31
GENIUS achievements

• GENIUS is the official portal of the EDG
  Dissemination Testbed and it has been adopted by
  the Italian CNR GRIDIS Project.
• Several GENIUS installations are currently up and
  running in Italy, Czech Republic, Taiwan and
  more.
• GENIUS has been used not only as a
  dissemination tool but also in production by
  ATLAS and CMS within the WorldGrid activities.
• During Conferences and events the demos of GENIUS
  have attracted many peoples (several tens
  officially registered by CNR WP11 Team), both
  specialists and common.
• The comment has always been that it is impressive
  to manage users own jobs and files on the grid
  through a web interface as they were local.
• GENIUS is well recognized within the grid
  community. A paper on GENIUS will be published on
  the web edition of Grid Book II by I. Foster and
  C. Kesselman.

32
Outline

• Industry and research collaboration
• GENIUS and EnginFrame technical background
• GENIUS features
• Workshop feedback

33
Workshop feedback

• Are the current portal frameworks, such as
  Jetspeed, sufficient for all our requirements?
• Good complement - but lets not restrict to one
  technology
• Is the portlet model the right one for Grid
  applications?
• In part we often create Grid Intranet pages -
  Customers have quite fancy requirements,
  sometimes!
• When is the Web "pull" model insufficient for
  Grid applications?
• Interactive applications, collaborative, I/O data
  staging

34
Workshop feedback

• What Grid services are needed to make Grid
  portals useful?
• All, but hidden!
• Interoperability
• Job tracking Data tracking with correlation
• Flow management
• Are the proposed OGSA core Grid services
  appropriate and useable by Grid portals?
• Didnt experience so far
• CRM is very welcome

35
Workshop feedback

• What other Grid middleware implications are there
  forGrid portal interoperability?
• Application level service definition
• Integration with COTS software
• What are the requirements for a messaging and
  notification model to be used by Grid portals?
• Long discussions what does OGSA offer?
• How do we build a GridShell?
• No idea, but with XML output option!
• How does one create a user's Grid Context?
• ???

36
Workshop feedback

• How do we design a Grid portal architecture that
  best supports collaboration?
• Very interesting topic in Industry as well
• Intellectual Property is the key!
• What do we mean by collaboration?
• Intra or Inter-portal?
• Grid is infrastructure - should collaboration
  reach app level?
• Do we address legacy apps?
• Solutions addressed so far server based
  computing (2D app collaborative), data sharing,
  flow sharing, project mgmt
• No info about WSIA and WSRP - sorry!

37
Getting started with GENIUS

• Send an email to Roberto.Barbera_at_ct.infn.it
  and/or Alberto.Falzone_at_ct.infn.it to get an
  account on the GENIUS CVS server
• Install and start GENIUS as described on the
  reference site https//genius.ct.infn.it
• GENIUS team is eager to contribute to the
• Grid Portal Architecture standardization
• and share experience and results
• !

Thanks!