Running Oracle in EC2 Ahbaid Gaffoor Amazon.com/A9.com

1
Running Oracle in EC2Ahbaid GaffoorAmazon.com/A
9.com
2
Overview

• Section 1 Pricing and Licensing
• Section 2 Getting Started with AWS
• Section 3 Installing Oracle
• Section 4 Secure Backup

3
Section 1 Pricing and Licensing
4
Section 1 Pricing and Licensing

1. Amazon Web Services (AWS) Overview
2. Pricing of relevant AWS Services
3. Oracle Licensing and Support
4. Oracle Secure Backup Cloud Module

5
1.1 AWS Overview

• Amazon Elastic Compute Cloud (EC2)
• Amazon Simple Storage Service (S3)
• Amazon Cloud Front
• Amazon SimpleDB
• Amazon Simple Queue Service (SQS)
• Amazon Elastic MapReduce

6
1.2 AWS Pricing EC2

• Elastic Compute Cloud (EC2)
• Prices http//aws.amazon.com/ec2/pricing
• Amazon Machine Image (AMI)
• On Demand, Reserved 1 Year, 3 Years
• Standard CPU AMI
• Small 0.10/hr, 325/yr (0.03/hr),500/3yr
• Large 0.40/hr, 1300/yr(0.12/hr),2000/3yr
• XLarge 0.80/hr, 2600/yr(0.24/hr),4000/3yr
• High CPU AMI
• Medium 0.20/hr, 650/yr(0.06/hr),1000/3yr
• XLarge 0.80/hr, 2600/yr(0.24/hr),4000/3yr

7
1.2 AWS Pricing EC2 (Contd)

• Elastic Compute Cloud (EC2)
• Elastic IP
• Public, Static IP
• IP Map/Re-map gt 100/month 0.10 each
• 0.01 non-attached per hour
• Elastic Block Store (EBS)
• 0.10 GB/month provisioned
• 0.10 per 1MM/month I/O requests
• EBS Snapshots to S3
• 0.15 GB/month
• 0.01 per 1,000 PUT requests (when saving a
  snapshot)
• 0.01 per 10,000 GET requests (when loading a
  snapshot)

8
1.2 AWS Pricing S3

• Simple Storage Service (S3)
• Prices http//aws.amazon.com/s3/pricing
• Operations PUT, GET, DELETE
• Storage
• 0.15GB/Month lt 50TB
• 0.14GB/Month gt 50TB, lt 400TB
• 0.13GB/Month gt 400TB, lt 500TB
• 0.12GB/Month gt 500TB
• Data Transfer
• 0.10GB all data transfer in

9
1.2 AWS Pricing S3 (Contd)

• Requests
• 0.01 per 1,000 PUT, COPY, POST or LIST request
• DELETES are free
• 0.01 per 10,000 GET and all other requests
• AWS Import/Export
• Device Handling 80.00 each
• Data loading 2.49 per hr (hourly increment)

10
1.2 AWS Pricing Import/Export

• Not Database exp/imp
• AWS Import/Export
• Device Handling 80.00 each
• Data loading 2.49 per hr (hourly increment)
• http//aws.amazon.com/importexport/
• Calculator http//awsimportexport.s3.amazonaws.c
  om/aws-import-export-calculator.html

11
1.2 AWS Data Transfer Pricing

• Data Transfer
• Regions US, EU
• Sub-region (zone)
• Free within zones on private IP
• Elastic IP or Public IP outside AWS, regional
  charges

12
1.3 Oracle Licensing

• Existing or New License
• http//www.oracle.com/corporate/pricing/cloud-lice
  nsing.pdf
• Cost of AMI
• Pre-built Oracle AMI (11g)
• Roll your own AMI

13
1.3 Oracle Support

• Virtualization Support AWS
• Database Support
• Oracle Secure Backup Cloud Module
• http//www.oracle.com/technology/tech/cloud/faq.ht
  mlsupport
• No RAC

14
1.4 Oracle Secure Backup Cloud Module

• Backups to S3 via. RMAN
• 9i R2 and higher
• Pre-installed on Oracle AMIs
• EC2 and non-EC2 databases
• Requires S3 and OTN accounts
• Integrated with Enterprise Manager

15
Section 2 Getting Started with AWS
16
Section 2 Getting Started with AWS

1. AWS account
2. AWS EC2 Console
3. EC2 Security Groups
4. EC2 Key Pairs
5. EC2 Amazon Machine Images (AMIs)
6. EC2 Elastic IP
7. EC2 EBS Volumes
8. EC2 Snapshots
9. Using EC2 Command Line tools

17
2.1 AWS account

• Amazon.com account
• Sign up for services at http//aws.amazon.com
• EC2 Console http//console.aws.amazon.com

18
2.2 AWS EC2 Console
19
2.2 AWS EC2 Console

• Security Groups
• Key Pairs
• AMIs
• Instances
• Elastic IPs
• EBS Volumes
• EBS Snapshots

20
2.3 EC2 Security Groups
21
2.3 EC2 Security Groups - Create
22
2.3 EC2 Security Groups Configuration
23
2.4 EC2 Key Pairs
24
2.4 EC2 Key Pairs Create
25
2.4 EC2 Key Pairs Save PEM file
26
2.4 EC2 Key Pairs Save PEM file

• Only one opportunity
• Make a copy
• Make another offline copy
• Cannot be retrieved or restored
• PEM?

27
2.5 EC2 AMIs
28
2.5 EC2 AMIs List Options

• Show/Hide (Owner, Platform, Architecture)
• Oracle owner id 725966715235
• Linux only

29
2.5 EC2 AMIs Launch Instance
30
2.5 EC2 AMIs Instance Options
31
2.5 EC2 AMIs Availability Zones

• us-east-1a
• us-east-1b
• us-east-1c
• us-east-1d

32
2.5 EC2 AMIs Instance Launch
33
2.5 EC2 Instances - Pending
34
2.5 EC2 Instances Launched
35
2.5 EC2 Instances Command Line Tools

• Scriptable command line tools
• ec2-bundle-instance
• ec2-confirm-product-instance
• ec2-describe-instances
• ec2-describe-reserved-instances
• ec2-describe-reserved-instances-offerings
• ec2-monitor-instances
• ec2-purchase-reserved-instances-offering
• ec2-reboot-instances
• ec2-run-instances
• ec2-terminate-instances
• ec2-unmonitor-instances

36
2.6 EC2 Elastic IP

• Static IP tied to account
• Assign to any account instance
• Unassigned is more expensive
• Redirect failed services
• Scriptable command line tools
• ec2-allocate-address
• ec2-associate-address
• ec2-disassociate-address
• ec2-release-address

37
2.6 EC2 Elastic IPs
38
2.6 EC2 Elastic IP - Allocate
39
2.6 EC2 Elastic IP - Allocated
40
2.6 EC2 Elastic IP - Associate
41
2.6 EC2 Elastic IP - Associated
42
2.7 EC2 Elastic Block Store (EBS) Volumes

• Persistent Storage
• Pick zone and region
• Assign to an instance within a zone
• Scriptable command line tools
• ec2-create-volume
• ec2-delete-volume
• ec2-attach-volume
• ec2-detach-volume
• ec2-describe-volume

43
2.7 EC2 EBS Volumes
44
2.7 EC2 EBS Volumes - Create
45
2.7 EC2 EBS Volumes - Creating
46
2.7 EC2 EBS Volumes - Created
47
2.7 EC2 EBS Volumes - Attach
48
2.7 EC2 EBS Volumes - Attached
49
2.8 EC2 EBS Snapshots

• Copy of EBS Volume into S3
• S3 replicates snapshots across zones
• Snapshots restorable in any zone
• Snapshots used to copy EBS volumes within zones
• Scriptable command line tools
• ec2-create-snapshot
• ec2-delete-snapshot
• ec2-describe-snapshot

50
2.8 EC2 EBS Snapshots
51
2.8 EC2 EBS Snapshots - Create
52
2.8 EC2 EBS Snapshots - Created
53
2.9 Using EC2 Command Line Tools

• Requires at least Java 5 runtime
• SSH Acces for Linux (Putty for Windows SSH)
• RDC for windows (not covered)
• AWS -gt Resources Developer tools EC2-API
  tools (ec2-api-tools.zip)
• Setup ENV variables
• JAVA_HOME
• EC2_HOME is path to unzipped files
• EC2_PRIVATE_KEY (PEM file path)
• EC2_CERT (your X.509 cert file path)

54
Section 3 Installing Oracle
55
Section 3 Installing Oracle

1. Connecting to a new instance
2. Mount EBS Volumes
3. Create database

56
3.1 Connecting to a New Instance

• PEM file is private key
• First connection SSH as root
• Linux SSH command line connect using PEM file
• ssh -i ltPEM_filegt root_at_ltip_addressgt
• Windows Putty SSH Client
• PuttyGen to load and convert PEM file
• Save Windows equivalent Private Key file
• Create Session in Putty using new Private Key
  file for authentication

57
3.1 Connecting License Acceptance
58
3.1 Connecting Oracle Password
59
3.1 Connecting No DB auto creation
60
3.2 Mount EBS Volumes

• Create Partitions on devices
• fdisk /dev/sdf
• Create Filesystems
• mkfs.ext3 /dev/sdf1
• Create mount points, mount, set permissions
• mkdir /m1
• mount /dev/sdf1 /m1 chown R oracledba /m1
• Edit /etc/fstab to automount
• /dev/sdf1 /m1 ext3 defaults 1
  1
• Repeat for EBS Volumes

61
3.2 Mount EBS Volume Create FS
62
3.2 Mount EBS Volume /etc/fstab
63
3.2 Create Database - Choices

• 11g Oracle Home
• /u01/app/oracle/product/11.1.0/db_1
• Oracle provided script
• /home/oracle/scripts/run_dbca.sh (as root)
• Customize database post creation
• DBA crafted scripts (better)
• Free script
• http//ocpdba.net/dbcreate/index.html (10g)

64
3.2 Create Database - Recommendations

• Create separate EBS Volume for /admin
• /admin used for
• DB Creation scripts
• Admin scripts
• DB files (init.ora, spfile, broker files, etc.)
• Symlinks from /admin/ltdbnamegt/ltfilegt to Oracle
  software home
• EBS volume snapshot used for new DB hosts

65
3.2 Create Database - Recommendations

• Allow only SSH port to be open in Security Group
• Tunnel SQLNet across SSH outside the cloud
• If opened, restrict listener port to fixed IPs

66
3.2 Create Database - Cloning

• /admin EBS Snapshot cloneable to new Instances
• EBS volume snapshots (cold db) used for new db
  cloning of database files

67
3.2 Create Database - Performance

• CPU Memory fixed
• Within the cloud fastest for I/O
• I/O can be scaled
• Multiple EBS Volumes
• Oracle ASM
• Stripe across EBS Volumes

68
Section 4 Oracle Secure Backup (OSB) Cloud Module
69
Section 4 OSB Cloud Module

1. OSB Pre-requisites
2. OSB Setup
3. OSB RMAN Integration
4. OSB Performance
5. RMAN / OSB / S3 Use cases

70
4.1 OSB Pre-requisites

• Download Cloud Backup Installer
• Included in Oracle AMIs
• /home/oracle/scripts/osbws/osbws_install.jar
• S3
• Oracle 9i R2 and higher
• OTN account

71
4.2 OSB Setup Installer Options

• List options for OSB Installer
• su oracle
• java -jar oracle/scripts/osbws/osbws_install.jar
  
• more oracle/scripts/osbws/osbws_readme.txt

72
4.2 OSB Setup Installer Options

• Required
• AWSID AWS account access key ID
• AWSKey AWS account secret access key
• otnUser otnPass OTN Credentials for download
• walletDir Stores credentials for use
• libDir Location for platform specific
  download (RMAN SBT library)
• Optional platform and proxy parameters
• Optional Recommended
• configFile Initialization parameter file used
  by future RMAN jobs
• Default ORA_HOME/dbs/osbswsltORACLE_SIDgt.ora

73
4.2 OSB Setup Sample Installer Script

• install_osb.sh
• Set before running AWSID, AWSKEY, OTNUSER,
  OTNPASS
• libDir stores software specific to the platform
  for RMAN SBT library parms use
• java -jar oracle/scripts/osbws/osbws_install.jar
  \
• -AWSID AWSID \
• -AWSKEY AWSKEY \
• -otnUser OTNUSER \
• -otnPass OTNPASS \
• -walletDir /admin/osbws/wallet \
• -configFile /admin/osbws/osb_config.dat \
• -libDir /admin/osbws/software

74
4.2 OSB Setup Install Platform Library
75
4.3 OSB RMAN Integration

• RMAN SBT Parms configuration
• Installed to libDir parameter in installation
• RMAN Command
• RMANgt configure channel
• device type sbt parms
• SBT_LIBRARY/admin/osbws/sofware/libosbws11.so
• ENV(OSB_WS_PFILE/admin/osbws/osb_config.dat)
• Ready for backups

76
4.4 OSB RMAN Performance

• 11g Multiple RMAN Channels
• 11g datafiles can be backed up across multiple
  channels
• 11g Fast Backup Compression
• RMAN block change tracking

77
4.5 RMAN / OSB / S3 Use Cases

• Cloning
• Scalable backups
• Moving databases
• Regional Backup/Recovery Availability

78
Thank Youahbaid_at_amazon.coma9.comatt.nethttp
//redoblog.wordpress.comhttp//ocpdba.net