Post on 16-Apr-2017
PowerPoint Presentation
Today we are not going to install Oracle VM 3.3.3Instead we are going to installOracle VM 3.4.1
1
Simo VilmunenOracle eBS 10+ yearsTechnical Architect and DBA Oracle Databases 15+ yearsImplementationsUpgradesPerformanceLately focused on virtualization & infrastructure of Oracle technology stack
Started as Oracle Developer, quickly learned basic DBA skills and continued several years as DBA doing installations, backup&restore and basic administrative work but all the time more and more focus with performance tuning (8i through 11gr2)After some resistance learned eBS skills with 11.5.9 and then with current company 11.5.10.2 to 12.1.3 2
Terminology for this sessionOVM = The actual Oracle VMOVM Manager = Management GUIOVS = Physical server under virtual machinesVM = Virtual MachineServer Pool = Clustered physical servers for VMsRepository = Storage area for relevant files
Oracle VM ArchitectureOracle VM ManagerWeb GUIManagement ServerOracle VM ServerDom0DomuDomuDomuHypervisorOracle VM ServerOracle VM Server
OVM Manager installation packageThree (3) or more serversOVS installation packagePatience
PeopleWhat we need for installation?
Lets start with planning.
Total count of CPU and RAM Use www.spec.org to get estimate on current hardware capabilitySpec CINT2006 benchmarks for processor per hardware vendorCalculate total score for your hardware per Oracle VM server pool
ServerProcessorAmountSpec CINT2006 processor scoreTotal scoreRAMMT 1E5640111911916MT 2E52609211222416DB 1E5640211923864DB 2E5-2680216633264DB 3E5-2650v22341,568364
Server pool 1Server pool 2How are you currently utilizing your hardware
How many instances are you running
Future requirements
Licenses
Plan your initial Oracle VM architecture (Oracle VM server pools)
Uponor#Go through all hardware utilization reports: SAN, OS utilization (use OEM), AWR for databases (OEM)Total number of instances you have now and their average usage. What do you expect in the future so there is size to grow. How many licenses you have currently because it will limit the setup. Initial server pool setup how do you want to divide the instances. Do you want to put databases in one pool and application servers in another or do you want to separate by application etcWe measured current HW capability using spec int 2006 (compute-intensive integer performance) benchmarks and checked the matching or closest HW combination against our existing HWMade list of current HW which had the processor type, amount and cint2006 score per CPU and total. And RAM per each server. This gave good baseline what we have currently7
Processor limit per serverProcessor frequency and coresMemoryNetwork cardsSoftware licensesHardwareOracle Hardware Certification List for Linux and Oracle VM http://linux.oracle.com/pls/apex/f?p=117:1:0::NO:RP::Future requirements
What to considerDecide your hardware setup
Combine list of hardware combinations which are good for you
Uponor#From hardware vendor how many CPUs can you have in one server, what are options for CPU frequency and cores, how much memory should one server have. Story about CPU option limiting RAMNetwork cards should be looked closely and investigate deeper. Review HCL list to see what are currently supported .. Some new HW takes time to come up in the list and Oracle support seems to pay attention to this. And size HW based on future requirements. Scaling is relatively easy as you can just add servers when needed (although licensing)
Explain the excel made8
For Oracle VM 3.4.1Oracle VM Server ISO patch ID 22902487Oracle VM Manager Install/Upgrade ISO patch ID 22902502Google: Oracle VM downloads
And now we can continue with installation.
To start OVM Manager installation follow readme.Mount ISO file to Linux host as root.Execute runinstaller.sh as root.Installation takes around 15 minutes to complete.
11
[root@demovm dvd]# ./runInstaller.shOracle VM Manager Release 3.4.1 Installer
Please select an installation type: 1: Install 2: Upgrade 3: Uninstall 4: Help
Select Number (1-4): 1
Please enter your fully qualified domain name, e.g. ovs123.us.oracle.com, (or IP address) of your management server for SSL certification generation 10.225.101.112 [demovm.local]:
Verifying configuration ...
Start installing Oracle VM Manager: 1: Continue 2: Abort
Select Number (1-2): 1
Step 1 of 7 : Database Software ...
Step 2 of 7 : Java ...
Step 3 of 7 : WebLogic and ADF ...
Step 4 of 7 : Oracle VM ...
Step 5 of 7 : Domain creation ...
Step 6 of 7 : Oracle VM Tools ...
Step 7 of 7 : Start OVM Manager ...
Oracle VM Manager installed.
Installation Summary--------------------Database configuration: Database type : MySQL Database host name : localhost Database name : ovs Database listener port : 49500 Database user : ovs
Weblogic Server configuration: Administration username : weblogic
Oracle VM Manager configuration: Username : admin Core management port : 54321 UUID : 0004fb0000010000325bb
Oracle VM Manager installation complete.
Oracle VM Manager UI: https://demovm.local:7002/ovm/consoleLog in with the user 'admin', and the password you set during the installation.
OVM Manager is running now.
Now its time to install OVS.Boot server from downloaded OVS ISOand install OVS.
12345678
Discover just installed OVS server
OVS server is visible now in OVM Manager.
Oracle VM requires few networksServer ManagementCluster HeartbeatLive MigrationStorage networkVM Network
Add correct port from OVS to correctnetwork.
Still needs storage access.
iSCSI & multipath settings by default are not always set how your storage vendor requires.
And access to SAN
Oracle VM StorageServer pool file system holds the server pool and cluster data, and is also used for cluster heartbeat.Shared repository holds relevant data for operations.Virtual Machine files & disks, templates, ISOs and virtual appliances You can still assign disks directly from your storage system to VMs.20G500G
Add storage for server pool filesystem &VM repository
Create server pools as you require. We have separeted production / test pools for database & applications.
Think of:LicensingUsageHardware capability
Repository holds required files for specific server pool.
Unless you have repository via NFS.
Installation and setup is now complete.
Now the actual OVM can be utilized by creatingvirtual machines.Repeat the OVS process to as many servers as required.
Oracle has variety of prebuild templates available.Use them!Templates are optimized for OVM and create goodstarting point for your own gold templates.
Import template.
And create virtual machine from template.
For VMs the assigned disks will show up under infoVirtual disk assigned from repository
Physical disk assigned from storage system
Doing live migration on hard partitioned VM will lose hard partitioning (and license implications)30
Now you can manage your VM from OVM Manager.
Live migration is only supported without hard partitioning. Hard partitioning can only be done from command line with OVM tools or editing vm.cfg.
Doing live migration on hard partitioned VM will lose hard partitioning (and license implications)31
How we have setup Oracle VM
Oracle VM 3.3.3Dell Compellent SAN with 10GbE iSCSI (multipath)four server poolstest application serverstest database serversproduction application serversadministration toolsDell M6302x Intel E5-2667 v3 (3.2 GHz, 8c/CPU) X11Intel x520 for 10GbE iSCSI320GB RAMIntel x520 for 1GbE LAN
Identical hardwareImproved fault tolerance for failuresEasier manageabilityScalability possibilities
Administration pool Consolidate monitoring and administration servicesReused hardware
Administration poolOVSOVSOVSOVSTest ManagementMonitoringConfiguration managementDevelopment toolsOVM ManagerEM 12cnon-prod MT poolOVSOVSOVSOVSnon-prod DB poolOVSOVSOVSOVSprod MT poolOVSOVSOVS
Few things we have noticed with Oracle VM.
Enable hyperthreading from BIOS for OVS to maximize vCPU amountNumber of dom0 vCPUs to match your configuration for optimal performance dom0_vcpus_pin dom0_max_vcpus=16Backup mysql DB! Thats all you backup anyway.
Review iSCSI & sysctl configurationSAN refresh is slow and annoying if you work lot with LUNs - limit LUNs presentedUse jumbo frames for iSCSI network
About performance with iSCSILinux disk alignment is a MUST!
Installing Oracle VM is relatively easy & fastMake sure your hardware is certified for production usePay attention to performance tuningThink of your VM backup strategy
Oracle VM 3: 10GbE Network Performance Tuning http://www.oracle.com/technetwork/server-storage/vm/ovm3-10gbe-perf-1900032.pdf
Tuning Virtual Memory https://access.redhat.com/documentation/en-US/Red_Hat_Enterprise_Linux/6/html/Performance_Tuning_Guide/s-memory-tunables.html
Optimising Oracle VM 3.x Oracle Linux 5 guest I/Owrite performance through guest/host partitionboundary alignment (Doc ID 1632576.1)
Aligning Partitions to Maximize Storage Performancehttp://www.oracle.com/technetwork/server-storage/sun-unified-storage/documentation/partitionalign-111512-1875560.pdf