SODA: - PowerPoint PPT Presentation

About This Presentation
Title:

SODA:

Description:

[3.1, 11/01] Justin Moore, Jeff Chase 'Cluster On Demand', CS Technical Report ... [5.3, 13/01] Kai Shen, Hong Tang, Tao Yang, and Lingkun Chu, 'Integrated Resource ... – PowerPoint PPT presentation

Number of Views:70
Avg rating:3.0/5.0
Slides: 35
Provided by: jia92
Category:
Tags: soda | chase | kai

less

Transcript and Presenter's Notes

Title: SODA:


1
  • SODA
  • a Service-On-Demand Architecture
  • An Utility Computing Perspective
  • Xuxian Jiang
  • Purdue University
  • 04/10/2003

2
Introduction
  • Essential Idea
  • Provide computation as utility, just as water and
    power etc.
  • Utility Computing has been widely recognized and
    adopted by industry and academia
  • IBM Oceano
  • HP Utility Data Center
  • PlanetLab
  • Opus

3
Todays Talk
  • Application Service Hosting from Utility
    Computing Perspective

4
  • Challenges ?

5
  • On-demand creation of services
  • Virtualization of services
  • Isolation between services

Physical node
Physical Link
Virtual node
Virtual Link
Utility demand
Shared Utility Infrastructure
6
  • Solution ?

7
Outline
  • System Overview
  • Related/Previous Work
  • On-Demand Service Creation
  • Service Isolation/Virtualization
  • Conclusion

8
System Overview
  • Node Deployment (CODA)
  • Dynamic Node Membership
  • Node Priming
  • Service Deployment
  • Service On-Demand Instantiation
  • Service Activation
  • Service Teardown

9
Related Work
  • Node Deployment (CODA)

Oceano
Utility OS for hosted Web services with dynamic
load.
Dynamic clusters
OS-Agnostic
CODA
Similar to COD
Beowulf
Emulab
Flexible configuration
Config tools for Linux computing clusters
Configures static sub-clusters for emulation
experiments.
Douglas E. Comer and Xuxian Jiang Running Linux
On Back-end Computers In the Xinu Lab Technical
Report, Department of Computer Sciences, Purdue
University, West Lafayette, IN, 2003
10
Related Work (contd)
  • Service Deployment (SODA)

Denali
Scalable isolation kernel
Clusters of Slices
Service-Agnostic
SODA
PlanetLab
Opus
Infrastructure Deployment
Internet-scale testbed
Overlay Peering Utility Services
Xuxian Jiang and Dongyan Xu SODA a
Service-On-Demand Architecture for Application
Service Hosting Utility Platforms to appear in
Proceedings of The 12th IEEE International
Symposium on High Performance Distributed
Computing (HPDC-12), Seattle, WA, June, 2003
11
Outline
  • SODA Overview
  • Related/Previous Work
  • On-Demand Service Creation
  • Service Isolation/Virtualization
  • Conclusion

12
On Demand - How?
  • Node deployment (CODA)
  • Hardware configuration
  • Node priming
  • Service deployment (SODA)
  • Service download
  • Service activation
  • Service resizing
  • Service teardown

13
Node Deployment (CODA)


A.K.A. Xinu Back-end Testbed
14
Application Service Deployment (SODA)
  • Service Download
  • Similar with kernel image download
  • Key Entities
  • Service Agent
  • Service Master
  • Service Daemon
  • Service Switch

15
Service Request From Clients
Service Request From Clients
Service Switch for S
Service Switch for S
Service S
SODA Daemon
Service S
SODA Daemon
Service S
SODA Daemon
Service S
Virtual Server
Guest OS
Guest OS
Guest OS
Guest OS
Host OS
Host OS
Host OS
SODA Master
SODA Agent
Service Creation Request From ASP
16
Outline
  • SODA Overview
  • Related/Previous Work
  • On-Demand Service Creation
  • Service Isolation/Virtualization
  • Conclusion

17
Service Isolation - How ?
One Physical node
  • Resource Virtualization
  • CPU Cycles
  • Network Bandwidth
  • Memory Size
  • Disk Storage
  • Virtual Machine
  • GuestOS (UML)
  • Isolation Kernel
  • Proportional Scheduler
  • CPU, Network Bandwidth, Memory
  • Virtual Server Internetworking

Virtual Server

GuestOS
GuestOS
Host OS
18
VM-based Isolation Features
  • Administrative Isolation
  • Fault/Intrusion Isolation
  • Resource Isolation

19
VM-based Sample Services
Scenario 1. One web service 2. One
honeynet hosting
20
Isolation Kernel
  • CPU Isolation
  • Network Out-bound Bandwidth Isolation
  • Memory Usage Limit

21
CPU Isolation
Scenario 1) CPU-intensive green 2)
IO-intensive blue 3) Web red
Original Linux CPU Scheduler
Linux CPU Fair Scheduler
22
Service Virtualization Load Balancing - How ?
Client Request
  • Virtual Server
  • Virtual Cluster
  • Service Switch

23
Service Virtualization Load Balancing
Scenario 1. ResaResb 12 2. ReqaReqb
12
Host OS
Distribution of requests by Service Switch
Response time from virtual service node
24
Service Bootstrapping Time
Linux Configuration Image size Time(seattle) Time(tacoma)
Rootfs_tomrtbt_1.7.205 15 MB 2.0 sec. 3.0 sec.
Rootfs_base_1.0 29.3 MB 3.0 sec. 4.0 sec.
Root_fs_lfs_4.0 400 MB 4.0 sec. 16.0 sec.
Root_fs.rh-7.2-server.pristine.20021012 253 MB 22.0 sec. 42.0 sec.
seattle Dell PowerEdge server with 2.66GHz Intel
Xeon processor and 2GB RAM tacoma Dell desktop
PC with 1.8GHz Intel Pentium 4 processor and
768MB RAM
25
Slow Down factor
Scenario 1. Virtual service node with
service switch 2. Service running in host OS
with service switch 3. Service running in
host OS without service switch
System call VM (cycles) Linux
getpid 27,276 1,208
geteuid 26,648 1,064
dup2 26,904 1,084
mmap 27,864 1,208
munmap 27,044 1,200
gettimeofday 37,004 1,368
26
Outline
  • SODA Overview
  • Related/Previous Work
  • On-Demand Service Creation
  • Service Isolation/Virtualization
  • Conclusion

27
Conclusion
  • Design and Implementation of SODA architecture
  • Highly Efficient On-demand Service Priming
  • Satisfactory Service Isolation
  • VM-based approach to address Application Service
    Hosting paradigm

28
Future Work
  • Other VMs
  • Resource Allocation Model Algorithm
  • Service Placement
  • Service Migration
  • Freeze / Migrate/ Restart
  • Security

29
Publication
  • Xuxian Jiang, Dongyan Xu, "Protection of
    Application Service Hosting Platforms an
    Operating System Perspective", submitted for
    publication, April 2003
  • Xuxian Jiang and Dongyan Xu SODA a
    Service-On-Demand Architecture for Application
    Service Hosting Utility Platforms to appear in
    Proceedings of The 12th IEEE International
    Symposium on High Performance Distributed
    Computing (HPDC-12), Seattle, WA, June, 2003
  • Douglas E. Comer and Xuxian Jiang Running Linux
    On Back-end Computers In the Xinu Lab Technical
    report, Department of Computer Sciences, Purdue
    University, work in progress 2003
  • Xuxian Jiang, Yu Dong, Dongyan Xu, Bharat
    Bhargava GnuStream A P2P Media Streaming System
    Prototype to appear in IEEE International
    Conference on Multimedia Expo (ICME), July 2003

30
References
  • Services Migration
  • 1.1, 09/01 Steven Osman, Dinesh Subhraveti,
    Gong Su, and Jason Nieh, "The Design and
    Implementation of Zap A System for Migrating
    Computing Environments", Proceedings of the Fifth
    Symposium on Operating Systems Design and
    Implementation (OSDI 2002), Boston, MA, December
    9-11, 2002, pp. 361-376.
  • 1.2, 14/01 S. Ranjan, J. Rolia, H. Fu, and E.
    Knightly, "QoS-Driven Server Migration for
    Internet Data Centers", in Proceedings of IWQoS
    2002, Miami, FL, May 2002.
  • 1.3, 05/02 Amin Vahdat, Thomas Anderson,
    Michael Dahlin, David Culler, Eshwar Belani, Paul
    Eastham, and Chad Yoshikawa, "WebOS Operating
    System Services For Wide Area Applications", in
    The Seventh IEEE Symposium on High Performance
    Distributed Computing, July 1998.
  • Utility Computing
  • 2.1, 09/01 K. Appleby, S. Fakhouri, L. Fong,
    G. Goldszmidt, and M. Kalantar, "Oceano SLA
    Based Management of a Computing Utility", in
    IFIP/IEEE Intl. Symp. on Integrated Network
    Management May 2001
  • 2.2, 06/02 Andrew A. Chien, "Architecture of
    the Entropia Distributed Computing System, ",
    International Parallel and Distributed Processing
    Symposium April 2002
  • 2.3, 12/02 R. Figueiredo, P. Dinda, J.
    Fortes, "A Case For Grid Computing on Virtual
    Machines ", ICDCS 2003, to appear 2003
  • Cluster
  • 3.1, 11/01 Justin Moore, Jeff Chase "Cluster
    On Demand", CS Technical Report Duke University,
    May 2002

31
References (2)
  • Virtual Machine
  • 4.1, 09/01 Andrew Whitaker, Marianne Shaw, and
    Steven D. Gribble, "Scale and Performance in the
    Denali Isolation Kernel" Proceedings of the Fifth
    Symposium on Operating System Design and
    Implementation (OSDI 2002), Boston, MA, December
    2002
  • 4.2, 15/01 George W. Dunlap, Samuel T. King,
    Sukru Cinar, Murtaza Basrai, Peter M. Chen,
    "ReVirt Enabling Intrusion Analysis through
    Virtual-Machine Logging and Replay" Proceedings
    of the 2002 Symposium on Operating Systems Design
    and Implementation (OSDI) ,, Boston, MA, December
    2002
  • 4.3, 15/01 C. P. Sapuntzakis, R. Chandra, B.
    Pfaff, J. Chow, M. S. Lam and M. Rosenblum,
    "Optimizing the Migration of Virtual Computers",
    in Proceedings of the Conference on Operating
    Systems Design and Implementation, December 2002.
  • 4.4, 15/01 Emin Gun Sirer, Robert Grimm,
    Arthur J. Gregory and Brian N. Bershad, "Design
    and Implementation of a Distributed Virtual
    Machine for Networked Computers", in Proceedings
    of the Seventeenth Symposium on Operating Systems
    Principles, pages 202-216, Kiawah Island, South
    Carolina, December 1999.
  • 4.5, 18/01 Peter M. Chen, Brian D. Noble,
    "When virtual is better than real", Proceedings
    of the 2001 Workshop on Hot Topics in Operating
    Systems (HotOS), May 2001. review 4.6, 01/02
    Karim Yaghmour, "Adaptive Domain Environment for
    Operating Systems", Opersys Inc., June 2002.

32
References (3)
  • Resource Management
  • 5.1, 10/01 John Reumann, Ashish Mehra, Kang G.
    Shin, and Dilip Kandlur, "Virtual Services A New
    Abstraction for Server Consolidation,'', in Proc.
    of USENIX 2000 Annual Technical Conference, June
    18-23, 2000, San Diego, CA, U.S.A.
  • 5.2, 12/01 Bhuvan Urgaonkar, Prashant Shenoy
    and Timothy Roscoe, "Resource Overbooking and
    Application Profiling in Shared Hosting
    Platforms'', Proceedings of the Fifth Symposium
    on Operating Systems Design and Implementation
    (OSDI),, Boston, MA, December 2002
  • 5.3, 13/01 Kai Shen, Hong Tang, Tao Yang, and
    Lingkun Chu, "Integrated Resource Management for
    Cluster-based Internet Services''. in Proc. of
    the 5th USENIX Symposium on Operating Systems
    Design and Implementation (OSDI'02), Boston MA,
    December 2002
  • 5.4, 15/01 Gaurav Banga, Jeffrey C. Mogul and
    Peter Druschel "Resource containers A new
    facility for resource management in server
    systems'' . in Proceedings of the Third Symposium
    on Operating Systems Design and Implementation
    (OSDI), , New Orleans, LA, February 1999
  • 5.5, 15/01 Mohit Aron, Peter Druschel and
    Willy Zwaenepoel, "Cluster Reserves A Mechanism
    for Resource Management in Cluster-based Network
    Servers". in Proceedings of the ACM SIGMETRICS
    Conference on Measurement and Modeling of
    Computer Systems , Santa Clara, CA, June 2000
  • 5.6, 17/01 Jose Renato Santos, Koustuv
    Dasgupta, G. (John) Janakiraman and Yoshio
    Turner, "Understanding service demand for
    adaptive allocation of distributed resources". in
    Proceedings of IEEE Global Internet Symposium
    (GLOBECOM '02), Taipei, Taiwan, November 17-21,
    2002

33
References (4)
  • Network Servers
  • 6.1, 15/01 Mohit Aron, Darren Sanders, Peter
    Druschel and Willy Zwaenepoel, "Scalable
    Content-aware Request Distribution in
    Cluster-based Network Servers". in Proceedings of
    the USENIX 2000 Annual Technical Conference , San
    Diego, CA, Jun 2000
  • 6.2, 16/01 Matt Welsh, David Culler, and Eric
    Brewer. "SEDA An Architecture for
    Well-Conditioned, Scalable Internet Services". in
    Proceedings of the Eighteenth Symposium on
    Operating Systems Principles (SOSP-18), Banff,
    Canada, October, 2001 6.3, 16/01 Matt Welsh,
    David Culler. "Virtualization Considered Harmful
    OS Design Directions for Well-Conditioned
    Services". in Proceedings of the 8th Workshop on
    Hot Topics in Operating Systems (HotOS VIII), ,
    Schloss Elmau, Germany, May, 2001
  • 6.4, 04/02 Jeremy Kerr "Achieving Linear
    Scalability of Network Services through Load
    Balancing".   "Research Proposal Selection
    Algorithms Dynamic Feedback in Network Load
    Balancer"  "A review of currently available
    literature on load balancing "  Course Project
  • Linux-Based extension
  • 7.1, 16/01 David Coulson, "UML-based
    pseudo-dedicated hosting service".
    OpenConsultancy 2002
  • 7.2, 17/01 Ashvin Goel, Luca Abeni, Charles
    Krasic, Jim Snow, and Jonathan Walpole,
    "Supporting time-sensitive applications on
    general-purpose operating systems.". In
    Proceedings of the Fifth USENIX Symposium on
    Operating Systems Design and Implementation Dec
    2002
  • 7.3, 05/02 Vijay Sundaram, Abhishek Chandra,
    Pawan Goyal and Prashant Shenoy, "Application
    Performance in the QLinux Multimedia Operating
    System ". Proceedings of the Eighth ACM
    Conference on Multimedia, Los Angeles, CA, pages
    127-136, November 2000.

34
References (5)
  • Emulation Network testbed
  • 8.1, 18/01 Amin Vahdat, Ken Yocum, Kevin
    Walsh, Priya Mahadevan, Dejan Kostic, Jeff Chase,
    and David Becker, "Scalability and Accuracy in a
    Large-Scale Network Emulator". Proceedings of 5th
    Symposium on Operating Systems Design and
    Implementation (OSDI), Dec. 2002
  • 8.2, 27/01 Christopher A. Telfer,
    "Implementation and Evaluation of Reconfigurable
    Network Testbed" Ph.D. Thesis March 2003
    chapters 2  3  4  5 
  • 8.3, 05/02 White, Lepreau, Stoller, Ricci,
    Guruprasad, Newbold, Hibler, Barb, and Joglekar,
    "An Integrated Experimental Environment for
    Distributed Systems and Networks" 0SDI 2002 Dec
    2002
  • 8.4, 05/02 Larry Peterson, Tom Anderson David
    Culler, and Timothy Roscoe, "A Blueprint for
    Introducing Disruptive Technology into the
    Internet" Proceedings of the 1st ACM Work on Hot
    Topics in Networks (HotNets-I), Princeton, NJ
    October 28-29, 2002
  • 8.5, 06/02 Xin Liu, Huaxia Xia, and Andrew
    Chien, "Network Emulation Tools for Modeling Grid
    Behaviors." The 3rd IEEE/ACM International
    Symposium on Cluster Computing and the Grid
    CCGrid 2003
Write a Comment
User Comments (0)
About PowerShow.com