Using Cloud APIs from Backup Software

1
Leveraging ZFS for blazing fast backups of
OpenSolaris and MySQL Paddy Sreenivasan, VP of
Engineerining, Zmanda
Using Cloud APIs from Backup Software
Paddy Sreenivasan, VP of Engineering at Zmanda
Inc.
2
Zmanda Business Model Philosophy

• Worldwide Leader in Open Source Backup
• 500,000 Protected Systems
• The Leader in Cloud Backup
• Open Source. Open Standards. Open Formats.
• Smashes traditional backup business model
• Annual Subscription Model
• Software Support Zmanda Subscription

3
The Solution Amanda Enterprise

• Easy and secure
• Cross-platform
• Intelligent scheduling
• Backup fault tolerance
• Reporting and monitoring
• Support for multiple media types
• Open Source with no proprietary data formats

4
Amanda Enterprise Network Backup
Every morning, I have peace of mind after
looking at the Zmanda backup logs. Ray
Zhu, Senior IT Manager, Vyatta
5
(No Transcript)
6
Backup up ZFS Platform
Cross Platform Recovery
Backup Method
Backup Speed
Sparse Files
File level Recovery
ACLs
no posix ZFS ACLs ZFS ACLs
normal normal normal fast
yes yes no yes
yes yes yes no
yes limited no no
gnutar star suntar ZFS send/receive
ZFS Snapshot plug-in works across all Backup
Methods providing support for backing up open
files.
7
Amanda and ZFS

• ZFS is excellent as target for Amanda disk based
  backups
• Scalability (Size and Throughput)?
• Easy to provision storage
• Built-in Robustness (RAID-Z)?
• Administration

8
Amanda and Solaris

• Support for Solaris 10, Open Solaris as Amanda
  server
• Support for Solaris 8, Solaris 9, Solaris 10 and
  Open Solaris as Amanda clients
• Support for Sun 7000 (Amber Road) appliances
• Support Sun Storage disk and tape storage

9
ZRM Functionality At-A-Glance

• LAMP Application Backup
• Backup MySQL database and associated files. E.g.
  backup of an entire e-commerce site.
• Open Data Formats
• No vendor lock-in via proprietary formats
• You can recover your data even without ZRM
• Backup all Platforms Implementations
• Supports MySQL servers (including cluster) on
  Linux, Solaris, Windows and Mac OS X
• Perform Flexible backups
• Full, incremental, raw or logical
• Use snapshots to perform hot backup
• Backup Live MySQL No impact on Applications
  Users
• Take advantage of Linux LVM, Solaris ZFS,
  Microsoft VSS, Veritas VxFS, NetApp SnapManager
  EMC snapshot technologies
• Perform One-Click Point-in-Time Recovery
• Flexible recovery level, i.e. recover the whole
  MySQL server, database, table or transaction

10
Zmanda Recovery Manager for MySQL
ZRM remote to MySQL
ZRM local to MySQL
Backup Server On-Premises
Backup Server at hosting provider
ZRM to MySQL Cluster
Enterprise-wide MySQL backup
11
ZRM and Solaris

• Supports MySQL running on Solaris 10 and Open
  Solaris
• ZFS snapshots as quick backups
• ZFS works well as disk storage for backups
• ZRM backups to Sun Cloud
• ZRM is resold by Sun for MySQL customers

12
Amanda Benchmark Configuration
Zmanda ZFS Pool 11TB RA IDZ2 Amanda vtapes
Pool 2 ZFS Pool 5TB RA IDZ2 Data files
X4500-240-01 Sun Fire X4500 Two socket Dual-Core
AMD Opteron 285 server at 2593 MHz 16GB of RAM 48
SATA drivers of 512MB
1000 GB Ethernet
X4200-240-01 Sun Fire X4200 Two socket Dual-Core
AMD Opteron 2000 server 16GB of RAM
data ZFS Pool 73GB storage Data files
13
Amanda ZFS Configuration

• Zmanda/vtapes to hold the backups (virtual
  tapes)?
• Zmanda/logs to hold the zmanda log files
• Pool to hold the data files being backed up

14
Benchmark Configuration

• Solution was tested out-of-the box
• The only OS tuning performed was to limit the
  amount of memory available to the ZFS ARC cache
  to 4 GB
• set zfszfs_arc_max 4294967296
• To optimize the disk throughput, ZFS record size
  was set to 128KB to match Amanda device block
  size setting

15

Amanda Baseline Performance
16

Local Backups
Throughput comparison in local backup
17
Network Backups
Throughput comparison in network backup
18
ZRM Benchmark Configuration
Zmanda ZFS Pool 11TB RA IDZ2 ZRM Backup Server
Pool 2 ZFS Pool 5TB RA IDZ2 MySQL Server
X4500-240-01 Sun Fire X4500 Two socket Dual Core
AMD Opteron 285 server at 2593 MHz 16GB of RAM 48
SATA drivers of 512MB
19
ZRM ZFS Configuration

• Zmanda/zrm to hold the backups (virtual tapes)?
• Zmanda/logs to hold the MySQL binary logs
• Pool to hold the MySQL data

20
ZRM ZFS Configuration

• db_STRESS open source database benchmarking tool
  was used to create database load
• The only OS tuning performed was to limit the
  amount of memory available to the ZFS ARC cache
  to 4 GB
• set zfszfs_arc_max 4294967296
• Solution was tested out-of-the box
• Level 0 backups with no compression were
  performed
• Raw-quick using ZFS snapshots
• Raw-copy backups
• Logical backups
• Storage engines MyISAM and InnoDB

21
ZRM Backups

• Level 0 backups with no compression were
  performed
• Raw-quick using ZFS snapshots
• Raw-copy backups
• Logical backups
• Storage engines MyISAM and InnoDB

22
MyISAM Performance 15 Load
23
InnoDB Performance 15 Load
24
Throughput with Idle Database
25
Throughput with Database at 15 Load
26
Throughput with Database at 90 Load
27
Contact Zmanda
Amanda 3.0 http//www.zmanda.com/amanda-enterpris
e-edition.html Amanda Enterprise 3.0 /
ZFS http//www.sun.com/bigadmin/features/articles
/amanda_opensolaris.jsp Zmanda Recovery Manager
for MySQLTM web site http//www.zmanda.com/zrm-my
sql-enterprise.html Zmanda Recovery Manager 3.0
for MySQLTM / ZFS http//www.sun.com/bigadmin/fe
atures/articles/zrm_mysql_zfs.jsp
28
Protected by Zmanda