Institut National de Recherche en Informatique et en Automatique

1
(No Transcript)
2
www.devoxx.com
3
Clouds
4
3 Speakers/Demos
Florin Alexandru Bratu (Romania)
Denis Caromel (France, Nice)
Franca Perrina (Italy)
www.devoxx.com
5
3 Strong Faiths

• Parallel Computing will make it
• mainstream with Java
• A need for a unified Parallel Abstraction
• Multi-Core Distributed
• 3. Java will make it possible to connect
• Enterprise Grids and Clouds

6

Effective SOA GRIDs with

• Agenda

• Background INRIA, OASIS, ActiveEon
• Programming, Optimizing
• 3. Scheduling
• 4. SOA WS, WSDL, BPEL (Franca Perrina)
• 5. Enterprise Grids, Clouds Amazon EC2
• 6. Java EE EJB (Florin Alexandru Bratu)

7
1. Background
8
OASIS Team INRIA

• A joint team between INRIA, Nice Univ. CNRS
• Now about 40 persons
• 2004 First ProActive User Group
• 2008 5th one, Acad./Indus. User Presentations
• ProActive 4.0.1 Distributed and Parallel
• From Multi-cores to Enterprise GRIDs

• Computer Science and Control
• 8 Centers all over France
• Workforce 3 800
• Strong in standardization committees
• IETF, W3C, ETSI,
• Strong Industrial Partnerships
• Foster company foundation
• 90 startups so far
• - Ilog (Nasdaq, Euronext)
• -
• - ActiveEon

9

• Startup Company Born of INRIA
• Co-developing, Providing support for Open Source
  ProActive Parallel Suite
• Worldwide Customers (EU, Boston USA, etc.)

10
2. Programming Optimizing
Parallel Acceleration Toolkit in
JavaParallelism Multi-CoreDistributed
Used in production by industry
11
(No Transcript)
12
(No Transcript)
13
ProActive Parallel Suite
14
ProActive Parallel Suite
15
Distributed and ParallelActive Objects
15
16
ProActive Active objects
A ag newActive (A, , VirtualNode) V v1
ag.foo (param) V v2 ag.bar (param) ... v1.bar(
) //Wait-By-Necessity
JVM
ag
v2
v1
V
Wait-By-Necessity is a Dataflow Synchronization
Java Object
Active Object
Req. Queue
Future Object
Proxy
Thread
Request
16
17
Standard system at RuntimeNo Sharing
NoC Network On Chip
Proofs of Determinism
17
18
TYPED ASYNCHRONOUS GROUPS
18
19
Creating AO and Groups
A ag newActiveGroup (A, , VirtualNode) V v
ag.foo(param) ... v.bar() //Wait-by-necessity
JVM
Group, Type, and Asynchrony are crucial for
Composition
Typed Group
Java or Active Object
19
20
Broadcast and Scatter

• Broadcast is the default behavior
• Use a group as parameter, Scattered depends on
  rankings

cg
ag.bar(cg) // broadcast cg ProActive.setScatter
Group(cg) ag.bar(cg) // scatter cg
20
21
Optimizing
21
22
(No Transcript)
23
(No Transcript)
24
IC2D
25
ChartIt
26
Pies for Analysis and Optimization
27
Video 1 IC2D OptimizingMonitoring, Debugging,
Optimizing
28
3. Scheduling
28
29
(No Transcript)
30
Scheduler and Resource ManagerUser Interface
31
Scheduler User Interface
32
Video 2Scheduler, Resource Manager
33
4. SOA IntegrationWeb Services, BPEL Workflow

• Franca Perrina
• OASIS Team - INRIA

34
Active Objects as Web Services
JVM

• Why ?
• Access Active Objects from any language
• How ?
• HTTP Server
• SOAP Engine (Axis)
• Usage

Web Services
ProActive.exposeAsWebService() ProActive.unExpos
eAsWebService()
Web Service Client
35
ProActive Services WorkflowsPrinciples3
kinds of Parallel Services

• 3. Domain Specific Parallel Services
• (e.g. Monte Carlo Pricing)
• 2. Typical Parallel Computing Services
• (Parameter Sweeping, DC, )
• Basic Job Scheduling Services
• (parallel execution on the Grid)

36
3 kinds of Parallel Services

• 3. Domain Specific Parallel
• Services
• providing business
• functionalities executed in
• parallel
• 2. Parallelization services
• typical parallel computing
• patterns (Parameter
• Sweeping, DC, )
• 1. Job Scheduling service
• Schedule and Run jobs in
• parallel on the Grid.

Operational Services
Parallel Services
Grid
37
A sample pattern Parameter Sweeping
Process using parameter sweeping service
I1 I2 In
O1 O2 On
Param Sweeping Service
parameter sweeping
I1 I2 In
O1 O2 On
All the running instances of the Exec logic X
are executed on the grid as a whole
Parameter Sweeping Service, customized with an
Exec logic X
Exec Logic

38
Demo
SOA IntegrationWeb Services, BPEL Workflow
39
5. Enterprise Grids, Clouds Standards
Amazon EC2
39
40
Deploy on Various Kinds of Infrastructures
41
GCM Fractal StandardizationFractal Based Grid
Component Model
Overall, the standardization is supported by
industrials BT, FT-Orange, Nokia-Siemens,
Telefonica, NEC, Alcatel-Lucent, Huawei

42
Protocols and Scheduler inGCM Deployment Standard

• Protocols
• Rsh, ssh
• Oarsh, Gsissh
• Scheduler, and Grids
• GroupSSH, GroupRSH, GroupOARSH
• ARC (NorduGrid), CGSP China Grid, EEGE gLITE,
• Fura/InnerGrid (GridSystem Inc.)
• GLOBUS, GridBus
• IBM Load Leveler, LSF, Microsoft CCS (Windows HPC
  Server 2008)
• Sun Grid Engine, OAR, PBS / Torque, PRUN
• Soon available in stable release
• Java EE
• Amazon EC2

43
6. J2EE Integration

• Florin Alexandru Bratu
• OASIS Team - INRIA

44
J2EE Integration with Parallelism Grids/Clouds

• Performing Grid Cloud Computing
• From In
• an Application Servers
• Delegating heavy computations outsides J2EE
  Applications
• Using Deployed J2EE Nodes as Computational
  Resources

45
ProActive J2EE Integration (1)

• Delegating heavy computations outsides J2EE
  Applications

46
ProActive J2EE Integration (2)
2. Using Deployed J2EE Nodes as Computational
Resources

• Objective
• Being able to deploy active objects inside the
  JVMs of application servers
• Implementation
• Based on a Sun standard Java Connector
  Architecture JSR112
• Deployment module resource adapter (RAR)?
• Works with all J2EE-compliant Application Servers

47
Integration(2)?
48
Grids CloudsAmazon EC2 Deployment
49
Big Picture Clouds
50
Clouds ProActive Amazon EC2 Deployment

• Principles Achievements
• ProActive Amazon Images (AMI) on EC2
• So far up to 128 EC2 Instances
• (Indeed the maximum on the EC2 platform, ready
  to try 4 000 AMI)
• Seamless Deployment
• no application change, no scripting, no pain
• Open the road to In house Enterprise Cluster
  and Grid Scale out on EC2

51
ProActive Deployment onAmazon EC2 Video
52
On Going
AGOSGrid Architecture for SOA
53
AGOSGrid Architecture for SOA
Building a Platform for Agile SOA with Grid

• AGOS Solutions

In Open Source with Professional Support
54
AGOS Generic Architecture for SOA with GRIDs
Business Intelligence
BI Monitoring
Service Level Management
SLM
SLM
SLM
SLM
Parallel Programming SPMD, workflow Agent,
Master/Worker Fork and Join In memory db
cache (JSR / JPI / javaspaces)
SOA Monitoring Reporting, Notifications, alarms
SLM
SOA BPEL Exec Repository, Registry, Orchestration
SLM
SCA Service Component Architecture
Task Services Scheduling
SLM
SLM
ESB Enterprise Service Bus
Resource Manager
SLM
SLM
OS Virtualization
Grid Utility interface
OS, HW
55
Summary
56
Conclusion Effective SOA GRIDs in Java with
Grid SOA J2EE, WS, BEPL, EG Amazon EC2
An Acceleration Toolkit ConcurrencyParallelis
mMulti-CoreDistributed
57
QA
58
www.devoxx.com