Utility-Oriented Cloud

1
Utility-Oriented Cloud Grid Computing A
Vision, Hype, and Reality

• Dr. Rajkumar Buyya

Grid Computing and Distributed Systems (GRIDS)
LabDept. of Computer Science and Software
EngineeringThe University of Melbourne,
Australiawww.gridbus.orgwww.buyya.comwww.manjra
soft.com
Gridbus Sponsors
2
The GRIDS Lab _at_ Melbourne
Education
R D

• Youngest and one of the rapidly growing research
  labs in our School/University
• Founded in 2002
• Houses 20 researchers consisting of
• Research Fellows/PostDocs
• Software Engineers
• PhD candidates
• Honours/Masters students
• Funding
• National and International organizations
• Australian Research Council DEST
• Many industries (Sun, StorageTek, Microsoft, IBM,
  Microsoft)
• University-wide collaboration
• Faculties of Science, Engineering, and Medicine
• Many national and international collaborations.
• Academics
• Industries
• Software
• Widely in academic and industrial users.
• Publication

Community Services e.g., IEEE TC for Scalable
Computing
3
Agenda

• Introduction
• Utility Networks and Grid Computing
• Application Drivers and Various Types of Grid
  Services
• Global Grids and Challenges
• Security, resource management, pricing models,
• Service-Oriented Grid Architecture and Gridbus
  Solutions
• Market-based Management, GMD, Grid Bank, Aneka
• Grid Service Broker
• Architecture, Design and Implementation
• Performance Evaluation Experiments in Creation
  and Deployment of Applications on Global Grids
• A Case Study in High Energy Physics
• Summary and Conclusion

4
Computer Utilities Vision Implications of the
Internet

• 1969 Leonard Kleinrock, ARPANET project
• As of now, computer networks are still in their
  infancy, but as they grow up and become
  sophisticated, we will probably see the spread of
  computer utilities, which, like present
  electric and telephone utilities, will service
  individual homes and offices across the country
• Computers Redefined
• 1984 John Gage, Sun Microsystems
• The network is the computer
• 2008 David Patterson, U. C. Berkeley
• The data center is the computer. There are
  dramatic differences between of developing
  software for millions to use as a service versus
  distributing software for millions to run their
  PCs
• 2008 Cloud is the computer Buyya!

5
Computing Paradigms and Attributes Realizing the
Computer Utilities Vision
?

• Web
• Data Centres
• Utility Computing
• Service Computing
• Grid Computing
• P2P Computing
• Market-Oriented Computing
• Cloud Computing

• -Ubiquitous access
• -Reliability
• Scalability
• Autonomic
• Dynamic discovery
• Composability
• -QoS
• -SLA
• -

• Trillion business
• Who will own it?

Paradigms
Attributes/Capabilities
6
Since Grids have been around for sometime
(early 2000), do we have a unified vision of what
Grids can do? And did we make sufficient
advances to turn vision of computer utilities
into a reality?

• - Let us take a look at views of
• industrial practitioners academics

7
Industrial vision of Grid computing

• IBM
• On Demand Computing
• Microsoft
• .NET
• Oracle
• 10g
• Sun
• N1 Sun Grid Engine
• HP
• Adaptive Enterprise
• Amazon
• Elastic Compute Cloud Services
• Manjrasoft
• Aneka for building enterprise Grids and Clouds.

8
Most academics view Cyberinfrastructure for
conducting collaborative (e-)Science
9
How do Grids look like?A Bird Eye View of a
Global Grid
Grid Information Service
Grid Resource Broker
Application
R2
R3
R4
R5
RN
Grid Resource Broker
R6
R1
Resource Broker
Grid Information Service
10
How do Grids look like?A Bird Eye View of a
Global Grid
Grid Information Service
Grid Resource Broker
Application
R2
R3
R4
R5
RN
Grid Resource Broker
R6
R1
Resource Broker
Grid Information Service
11
How Are Grids Used?
Utility computing
High-performance computing
Collaborative design
Collaborative data-sharing
Financial modeling
High-energy physics
E-Business
Life sciences
Drug discovery
Data center automation
E-Science
Natural language processing
Business Intelligence (Data Mining)
12
Agenda

• Introduction
• Utility Networks and Grid Computing
• Application Drivers and Various Types of Grid
  Services
• Global Grids and Challenges
• Security, resource management, pricing models,
• Service-Oriented Grid Architecture and Gridbus
  Solutions
• Market-based Management, GMD, Grid Bank, Aneka
• Grid Service Broker
• Architecture, Design and Implementation
• Performance Evaluation Experiments in Creation
  and Deployment of Applications on Global Grids
• A Case Study in High Energy Physics
• Summary and Conclusion

13
Grid Challenges
14
Some Grid Initiatives Worldwide

• Australia
• Nimrod-G
• Gridbus
• DISCWorld
• GrangeNet.
• APACGrid
• ARC eResearch
• Brazil
• OurGrid, EasyGrid
• LNCC-Grid many others
• China
• ChinaGrid Education
• CNGrid - application
• Europe
• UK eScience
• EU Grids..
• and many more...
• India
• Garuda

• USA
• Globus
• TeraGrid
• Cyberinfrasture
• AutoMate
• and many more...
• Industry Initiatives
• IBM On Demand Computing
• HP Adaptive Computing
• Sun N1
• Microsoft - .NET
• Oracle 10g
• Amzon Elastic Compute Cloud
• Infosys Enterprise Grid
• Satyam Business Grid
• Manjrasoft enterprise Clouds and Grids
• and many more
• Public Forums
• Open Grid Forum

1.3 billion 3 yrs
27 million
2? billion
120million 5 yrs
450million 5 yrs
486million 5 yrs
1.3 billion (Rs)
1 billion 5 yrs
http//www.gridcomputing.com
15
Open-Source Grid Middleware Projects
OurGrid
Slide by Hiro
16
Driving ThemeCommunity vs. Utility Grids
Type Feature Community Grids Utility Grids (Now Clouds)
User QoS Best effort Contract/SLA
Service Pricing Not considered / free access Usage, QoS level, Market supply and demand
Example Middleware Globus, Condor, OMII, Unicore Nimrod-G, Gridbus, many inspired efforts (IBM Business Grid, Sun Grid Market) .. Amazon EC2..
17
The Gridbus Project _at_ MelbourneEnable Leasing
of ICT Services on Demand
WWG
Gridbus
Pushes Grid computing into mainstream computing
18
(No Transcript)
19
Agenda

• Introduction
• Utility Networks and Grid Computing
• Application Drivers and Various Types of Grid
  Services
• Global Grids and Challenges
• Security, resource management, pricing models,
• Service-Oriented Grid Architecture and Gridbus
  Solutions
• Market-based Management, GMD, Grid Bank, Aneka
• Grid Service Broker
• Architecture, Design and Implementation
• Performance Evaluation Experiments in Creation
  and Deployment of Applications on Global Grids
• A Case Study in High Energy Physics
• Summary and Conclusion

20
What do Grid players want require?

• Grid Service Consumers (GSCs) - minimize
  expenses, meet QoS
• How do I express QoS requirements ?
• How do I trade between timeframe cost ?
• How do I discover services and map jobs to meet
  my QoS needs?
• How do I manage Grid dynamics and get my work
  done?
• Grid Service Providers (GSPs) maximise ROI
• How do I decide service pricing models ?
• How do I specify them ?
• How do I translate them into resource allocations
  ?
• How do I enforce them ?
• How do I advertise attract consumers ?
• How do I do accounting and handle payments?
• They need mechanisms, tools and technologies that
  help them in value expression, value translation,
  and value enforcement.

21
Service-Oriented Grid Architecture
Data Catalogue
Grid Bank
Information Service
Grid Market Services
Sign-on
HealthMonitor
Info ?
Grid Node N

Grid Explorer

Secure
ProgrammingEnvironments
Job Control Agent
Grid Node1
Applications
Schedule Advisor
QoS
Pricing Algorithms
Trade Server
Trading
Trade Manager
Accounting
Resource Reservation
Misc. services

Deployment Agent
JobExec
Resource Allocation
Storage
Grid Resource Broker

R1
R2
Rm
Core Middleware Services
Grid Service Consumer
Grid Service Providers
22
Market-Oriented Grid Software A union of Gridbus
and other technologies

Grid Applications
Grid Portals
Science
Commerce
Engineering
Collaboratories

Task, Parametric, and Components Programming
Workflow APIs
ExcellGrid
APIs/Tools
MPI
User-LevelMiddleware
Grid Workflow Engine
Grid Scheduling
Gridbus Resource Broker
Grid Exchange Federation
Grid MarketDirectory
Globus
Unicore

Grid Storage Economy
GridBank
Core Grid Middleware
Aneka Cloud (WS-based access SLA
NorduGrid
XGrid
Grid Economy
JVM
Condor
SGE
Tomcat
PBS
Libra
.NET
Grid Fabric Software
Mac
AIX
Solaris
Windows
Linux
IRIX
OSF1
Grid Fabric Hardware
Worldwide Grid
23
On Demand Assembly of Services in
Market-Oriented Grid Environments
24
On Demand Assembly of Services in Market-Oriented
Grid Environments
25
Cloud Services

• Infrastructure as a Services (IaaS)
• CPU, Storage Amazon.com et. al
• Platform as a Services (PaaS)
• Google App Engine, Microsoft Azure,
  andManjrasoft Aneka
• Software as a Service (SaaS)
• SalesForce.Com

Enterprise/Private Clouds
Clouds
Public/Internet Clouds
26
Layered view of services within a Cloud stack
27
Aneka

• A Software Platform for Building and Managing
  Enterprise Grids and Clouds

28
Aneka A 3rd Gen enterprise Grid Technology ?
Cloud model
Generation Properties Technologies
First (-2001) Application-specific platforms distributed.net,SETI_at_Home
Second (2002-2006) Single programming model, rigid architecture, no QoS UD, XtremeWeb, Alchemi, Digipede, DataSynapse, BOINC
Third (2007-2012?) SOA, extensible architecture, multiple programming models, multi-tenancy, enterprise QoS, SLAs, market-based resource allocation Aneka
29
ANEKA Product Overview (Alpha)

• .NET based service-oriented platform for grid /
  cloud computing
• Development and Run Time Environment
• Includes Development and Management Tools
• Suitable for
• Development of Enterprise Grid / Cloud
  Applications
• Grid / Cloud enabling legacy applications
• Ideal for Corporate Developers, Software, SaaS,
  Hosting Vendors and Application / System
  Integrators

ANEKA Product Architecture
30
Aneka Deployment Models

• Enterprise/Private
• Harness LAN connected resources
• Application Development, Testing, Execution
• Teaching and Learning
• Sensitive applications
• Public
• Hosted by a 3rd party service provider owning a
  large Data Center (1000s of servers)
• Offers subscription-based services to their
  shared infrastructure on pay-as go model.to
  many users from different organisations.
• Amazon.com, Microsoft Azure
• Aneka SDK Execution Manger

Enterprise/Private Clouds
Aneka
Public Clouds
31
Aneka components
FIRST PRODUCT
public DumbTask ITask public void
Execute()
Aneka enterprise Cloud
for(int i0 iltn i) DumbTask task
new DumbTask() app.SubmitExecution(task)
work units
internet
work units
Aneka Worker Service
Aneka Manager
internet
Aneka Users
32
How does it solve the problem?

• Divide the problem in to multiple small tasks and
  distribute them run in parallel on multiple
  computers within a Cloud.

• An Illustratioin

Executor
Application
Manager
Manager / Executor
GThreads/Tasks
33
User scenario GoFront(unit of China Southern
Railway Group)
Application Locomotive design CAD rendering
34
Aneka How can get it?

• Available to Download
• Software www.manjrasoft.com
• Manual Setting up Cloud using your LAN-network
  computers
• Teaching material
• parallel and distributed computing and
  programming,
• List of possible assignments for students
• Possible Projects for Final year students..
• Price highly affordable ?
• Fee you charge to 1 student (each year) and all
  students/teachers in entire college/university
  can use it!
• Applications
• Other Departments (Physics, Chemistry, Biology,
  Finance, Engineering) can use it for their
  applications.

35
On Demand Assembly of Services in Market-Oriented
Grid Environments
36
Agenda

• Introduction
• Utility Networks and Grid Computing
• Application Drivers and Various Types of Grid
  Services
• Global Grids and Challenges
• Security, resource management, pricing models,
• Service-Oriented Grid Architecture and Gridbus
  Solutions
• Market-based Management, GMD, Grid Bank, Aneka
• Grid Service Broker
• Architecture, Design and Implementation
• Performance Evaluation Experiments in Creation
  and Deployment of Applications on Global Grids
• A Case Study in High Energy Physics
• Summary and Conclusion

37
Grid Service Broker (GSB)

• A resource broker for scheduling task farming
  data Grid applications with static or dynamic
  parameter sweeps on global Grids.
• It uses computational economy paradigm for
  optimal selection of computational and data
  services depending on their quality, cost, and
  availability, and users QoS requirements
  (deadline, budget, T/C optimisation)
• Key Features
• A single window to manage control experiment
• Programmable Task Farming Engine
• Resource Discovery and Resource Trading
• Optimal Data Source Discovery
• Scheduling Predications
• Generic Dispatcher Grid Agents
• Transportation of data sharing of results
• Accounting

38
workload
Gridbus User Console/Portal/Application Interface
App, T, , Optimization Preference
Gridbus Broker
Gridbus Farming Engine
Schedule Advisor
Trading Manager
RecordKeeper
Grid Dispatcher
Grid Explorer
TM TS

GE GIS, NWS
Core Middleware
Grid Info Server
RM TS
G

Data Catalog
Data Node
C

U
G
Globus enabled node.
L
A
Amazon EC2/S3 Cloud.
39
Gridbus Broker Separating applications from
different remote service access enablers and
schedulers
Application Development Interface
Single-sign on security
Alogorithm1
SchedulingInterfaces
AlogorithmN
Plugin Actuators
Data Store
Access Technology
SRB
Grid FTP
40
Gridbus Services for eScience applications

• Application Development Environment
• XML-based language for composition of task
  farming (legacy) applications as parameter sweep
  applications.
• Task Farming APIs for new applications.
• Web APIs (e.g., Portlets) for Grid portal
  development.
• Threads-based Programming Interface
• Workflow interface and Gridbus-enabled workflow
  engine.
• Grid Superscalar in cooperation with BSC/UPC
• Resource Allocation and Scheduling
• Dynamic discovery of optional computational and
  data nodes that meet user QoS requirements.
• Hide Low-Level Grid Middleware interfaces
• Globus (v2, v4), SRB, Aneka, Unicore, and
  ssh-based access to local/remote resources
  managed by XGrid, PBS, Condor, SGE.

41
Click Here for Demo
Drug Design Made Easy!
42
s
43
Agenda

• Introduction
• Utility Networks and Grid Computing
• Application Drivers and Various Types of Grid
  Services
• Global Grids and Challenges
• Security, resource management, pricing models,
• Service-Oriented Grid Architecture and Gridbus
  Solutions
• Market-based Management, GMD, Grid Bank, Aneka
• Grid Service Broker
• Architecture, Design and Implementation
• Performance Evaluation Experiments in Creation
  and Deployment of Applications on Global Grids
• A Case Study in High Energy Physics
• Summary and Conclusion

44
Case Study High Energy Physics and Data Grid

• The Belle Experiment
• KEK B-Factory, Japan
• Investigating fundamental violation of symmetry
  in nature (Charge Parity) which may help explain
  why do we have more antimatter in the universe
  OR imbalance of matter and antimatter in the
  universe?.
• Collaboration 1000 people, 50 institutes
• 100s TB data currently

45
Case Study Event Simulation and Analysis
B0-gtDD-Ks

• Simulation and Analysis Package - Belle Analysis
  Software Framework (BASF)
• Experiment in 2 parts Generation of Simulated
  Data and Analysis of the distributed data

?Analyzed 100 data files (30MB each) that were
distributed among the five nodes within
Australian Belle DataGrid platform.
46
Australian Belle Data Grid Testbed
VPACMelbourne
47
Belle Data Grid (GSP CPU Service Price G/sec)
G4
NA
G4
G6
VPACMelbourne
G2
Datanode
48
Belle Data Grid (Bandwidth Price G/MB)
32
33
36
G4
31
30
34
NA
38
31
G4
G6
VPACMelbourne
G2
Datanode
49
Deploying Application Scenario

• A data grid scenario with 100 jobs and each
  accessing remote data of 30MB
• Deadline 3hrs.
• Budget G 60K
• Scheduling Optimisation Scenario
• Minimise Time
• Minimise Cost
• Results

50
Time Minimization in Data Grids
51
Results Cost Minimization in Data Grids
52
Observation
Organization   Node details Cost (in G/CPU-sec) Total Jobs Executed Total Jobs Executed
Organization   Node details Cost (in G/CPU-sec) Time Cost
CS,UniMelb belle.cs.mu.oz.au4 CPU, 2GB RAM, 40 GB HD, Linux N.A. (Not used as a compute resource) -- --
Physics, UniMelb fleagle.ph.unimelb.edu.au1 CPU, 512 MB RAM, 40 GB HD, Linux 2 3 94
CS, University of Adelaide belle.cs.adelaide.edu.au 4 CPU (only 1 available) , 2GB RAM, 40 GB HD, Linux N.A. (Not used as a compute resource) -- --
ANU, Canberra belle.anu.edu.au4 CPU, 2GB RAM, 40 GB HD, Linux 4 2 2
Dept of Physics, USyd belle.physics.usyd.edu.au4 CPU (only 1 available), 2GB RAM, 40 GB HD, Linux 4 72 2
VPAC, Melbourne brecca-2.vpac.org 180 node cluster (only head node used), Linux 6 23 2
53
Agenda

• Introduction
• Utility Networks and Grid Computing
• Application Drivers and Various Types of Grid
  Services
• Global Grids and Challenges
• Security, resource management, pricing models,
• Service-Oriented Grid Architecture and Gridbus
  Solutions
• Market-based Management, GMD, Grid Bank, Aneka
• Grid Service Broker
• Architecture, Design and Implementation
• Performance Evaluation Experiments in Creation
  and Deployment of Applications on Global Grids
• A Case Study in High Energy Physics
• Summary and Conclusion

54
Summary and Conclusion

• Grids exploit synergies that result from
  cooperation of autonomous entities
• Resource sharing, dynamic provisioning, and
  aggregation at global level ?Great Science and
  Great Business!
• Grids have emerged as enabler for
  Cyberinfrastructure that powers e-Science and
  e-Business applications.
• SOA Market-based Grid Management Utility
  Grids
• Grids allow users to dynamically lease Grid
  services at runtime based on their quality, cost,
  availability, and users QoS requirements.
• Delivering ICT services as computing utilities.
• Clouds are rapidly emerging, but more work is
  required
• Federation of Clouds, Cloud Exchange, and
  Application Scaling

55
Convergence of Competing Paradigms/Communities
Needed
?

• Web
• Data Centres
• Utility Computing
• Service Computing
• Grid Computing
• P2P Computing
• Cloud Computing
• Market-Oriented Computing

• Ubiquitous access
• Reliability
• Scalability
• Autonomic
• Dynamic discovery
• Composability
• QoS
• SLA

• Trillion business
• Who will own it?

Paradigms
Attributes/Capabilities
56
Thanks for your attention!

• Are there any
• Questions?
• Comments/ Suggestions

We Welcome Cooperation in RD and Business!
http/www.gridbus.org www.Manjrasoft.com rbuyya_at_
unimelb.edu.au raj_at_manjrasoft.com