Disaster Recovery and Business Continuity Planning for the Technology Incubator

1

• Disaster Recovery and Business Continuity
  Planning for the Technology Incubator
• MACTUA
• Dec. 14, 2004

1
2
Agenda

• Background on Anthony, Allan Quinn and
  Teralogix
• Discussion of Needs Challenges around Business
  Continuity Planning
• Overview of Business Case Analysis Option
  Selection for DR and Business Continuity
  Infrastructure
• Conclusions, Additional Thoughts, Q A

2
3
AAQ Organization (2003-2004)

• BUSINESSES
• Advanced Business Fulfillment
• Health Care Claims Fulfillment (EOB, Payment)
• DealerHQ
• Automotive Customer Relationship Management
• Teralogix
• IT Application Development Infrastructure
  Consulting
• Web-Based Project Communication System (SIMON)
• Encompass Advertising
• Creative Advertising Automotive Manufacturers
• CAC Finance
• Financial Services

• IT INFRASTRUCTURE
• Initially NT Network 300 Users
• Migrated to Active Directory 100 Users
• Exchange 2003
• 4 Site WAN incl. Prod. Server Co-location
• LTO Tape Back-ups (Mostly Contracted)
• Tadiran for 2 Locations, Wireless at 3rd
• Inbound Call Center

4
AAQ Organization (2004-2005)

• IT INFRASTRUCTURE
• - Active Directory 100 Users
• Exchange 2003
• 4 Site WAN incl. Prod. Server Co-location
• Planned Consolidation of Offices
• LTO Tape Back-ups (Mostly Contracted)
• Tadiran for 2 Locations, Wireless at 3rd
• - Planned Migration to new Voice System
• Outbound Call Center

• BUSINESSES
• DealerHQ
• Automotive Customer Relationship Management
• Teralogix
• IT Application Development Infrastructure
  Consulting
• Web-Based Project Communication System (SIMON)
• Mobile Link-Mail
• Encompass Advertising
• Creative Advertising Automotive Manufacturers
• CompareLife
• Life Insurance Brokering/Marketing
• Event Lab
• - Event Planning and Management

5
Needs Challenges

• Needs for New Disaster Recovery Business
  Continuity Systems
• Decrease Timeline to Recovery
• Lower Implementation and Ongoing Cost
• Scalability
• Ease of Use
• Systems must cover Production Servers and
  Business Operations Management Systems
• Redundant Connectivity
• Challenges
• Consolidating Office Space
• Voice Capabilities Outgoing Call Center Needs
  Changing
• Optimizing Cost Benefit for Multiple Businesses
  Stakeholders

5
6
Options Evaluated
Critical Business Systems and Data Recovery
Option 1 - Contracted Cold Site - Tape Restore
Option 2 - Local Standby (Warm) Site - Tape
Restore
Option 3 - Local Hot Site - Replication to NAS
Filer
Option 4 - Local Hot Site Snapshot to
Controller Array
6
7
Option 1 - Contracted Cold Site -Tape Restore

• Design
• Continue LTO Tape Back-up w/Hosting Provider
• Contract with Third Party for Infrastructure
• Connectivity upon a Declared Disaster
• Retrieve Tapes from Secure Facility
• Travel to Third Party Site
• Rebuild from Scratch Using LTO Tape
• Restore Time for All Businesses 36-48 hours

• Cost
• Implementation Cost
• Hardware/Software 4,000
• Monthly Recurring Cost (13,000/month)
• 5,000/month for Back-up Services
• 4,500/month for DR Contract
• 3,000/month for Internal FTE Costs
• 500/month for Tape Storage
• Additional Recurring Cost
• Semi-Annual Drills 30,000/year

• Pros
• Little Up Front Implementation or Investment
• Very Little Utilization of In House Team to
  Maintain

• Cons
• Hardware changes require contract amendments
• Unacceptable Time Line for our Businesses
• Expensive to perform drills
• Reliance on Tape Media
• Less Transparency to Readiness

7
8
Option 2 Local Standby (Warm) Site Tape
Restore

• Cost
• Implementation Cost
• Hardware/Software/Implementation 95,000
• Monthly Recurring Cost (11,200/month)
• 5,000/month for Back-up Services
• 3,000/month for Internal FTE Costs
• 1,500/month for Powered Racks at 2nd Co-Lo
• 1,200/month for Circuits
• 500/month for Tape Storage
• Additional Recurring Cost
• Semi-Annual Drills 20,000/year

• Design
• Continue LTO Tape Back-up w/Hosting Provider
• Secure Space at a Second Co-Location Facility
• Procure Hardware and Install at Second Co-Lo
• Provision PTP and IP Circuits
• Upon Declared Disaster
• Retrieve Tapes from Secure Facility
• Travel to Local Co-Lo Site
• Rebuild from Scratch Using LTO Tape
• Restore Time for All Businesses 28 Hours

• Pros
• Better Time Line
• Provides Additional Staging Infrastructure
• Better Transparency to Redundant Hardware State
• Less Costly to Perform Drills

• Cons
• Time Line Still Not Acceptable for Business
  Customers
• Expensive to Perform Drills
• Reliance on Tape Media
• Less Transparency to Readiness

8
9
Option 3 Local Hot Site Replication to NAS
Filer

• Cost
• Implementation Cost
• Hardware/Software/Implementation 390,000
• Monthly Recurring Cost (3,700/month)
• 1,000/month for Back-up Services for Monthly
  Tapes
• 1,500/month for Powered Racks at 2nd Co-Lo
  Facility
• 1,200/month for Circuits
• Additional Recurring Cost
• Semi-Annual Drills 12,500/year

• Design
• Secure Space at a Second Co-Location Facility
• Provision PTP and IP Circuits
• Procure Server Hardware Install at Second
  Co-Lo
• Procure, Implement and Train on NAS Filers
• Upon Declared Disaster
• Fail Over to Second Co-Location Site
• Utilize Data by Business to from NAS at Co-Lo
• Restore Time for All Businesses Under 2 Hours

• Pros
• Provides Additional Staging Infrastructure
• Excellent Timeline to Business Restoration
• Better Transparency to Redundant Hardware State
• Significantly Less Costly to Perform Drills
• Minimize Storage Capacity Requirements on
  Servers
• Minimal Data Loss
• Scalable

• Cons
• Most Expensive Option
• Data Replication must be Managed to Avoid
  Corruption
• Requires Significant Training (Time/Cost) on NAS
  Filers

9
10
Option 4 Local Hot Site Snapshot to
Controller Array

• Cost
• Implementation Cost
• Hardware/Software/Implementation 171,000
• Monthly Recurring Cost (3,700/month)
• 1,000/month for Back-up Services for Monthly
  Tapes
• 1,500/month for Powered Racks at 2nd Co-Lo
  Facility
• 1,200/month for Circuits
• Additional Recurring Cost
• Semi-Annual Drills 12,500/year

• Design
• Secure Space at a Second Co-Location Facility
• Provision PTP and IP Circuits
• Procure Server Hardware Install at Second
  Co-Lo
• Procure Implement RAID Controller Array
• Upon Declared Disaster
• Fail Over to Second Co-Location site
• Utilize Data by Business from Storage Array at
  Co-Lo
• Restore Time for All Businesses Under 2 Hours

• Pros
• Provides Additional Staging Infrastructure
• Excellent Timeline to Restore Operations
• Better Transparency to Redundant Hardware State
• Significantly Less Costly to Perform Drills
• Minimal Data Loss (1 hour)
• Minimize Storage Capacity Required on Servers
• Scalable
• Very Little Training Needed Devices are RAID
  10
• and iSCSI attached.
• Saves 90,000 annually over Option 2 while
• cutting downtime by min. of 26 hours.

• Cons
• Data Replication must be properly managed to
  avoid
• corruption.

10
11
Selection Implementation

• Option 4 Best Fit for AAQ Family of Companies
• Additional Systems to Support DR and BCP for AAQ
• SIMON Web-Based Process and Communication
• Pre-Loaded DR and BCP Plans to be developed for
  Initiation upon Disaster
• Web Based and Blackberry E-mail Synchronized
  Wirelessly
• Additional Tasks
• Voice Systems for planned Outbound Call Center

11
12
Conclusion

• Closing Thoughts
• Technology advances have Made High Availability
  Systems within reach of small and medium sized
  businesses
• Carefully evaluate your requirements and
  understand the differences concerning
• Point in Time Replication Snapshots
• Remote Point in Time Replication - Remote
  Snapshots
• Continuous Replication
• Questions

12