Optimizing Performance of your Oracle Database using 8Gb Fibre Channel

Emulex 8Gb Fibre Channel HBAs

Thanks for joining today’s webcast. We will begin at 9:00 am, Pacific Daylight Time.

To receive a call back, provide your phone number when you join the event, or call the number below and enter the access code.

Access code: 932 758 952

Call-in toll-free number (US/Canada): 1-877-668-4493

Call-in toll number (US/Canada): +1-408-600-3600

Global call-in numbers: http://support.webex.com/support/phone-numbers.html

2© 2011 Emulex Corporation

Fibre Channel and 8GFC

Fibre Channel remains dominant storage NW– Highest performance, availability, scalability

8GFC is now >75% of all HBA sales

IO Intensive apps driving need for 8GFC– Database– Data warehousing– Virtualization & private cloud– Backup– Rich media

It’s about more than bandwidth– IOPS, application response time, CPU efficiency, data integrity, and manageability

– More important than ever with new x86 platforms and Flash acceleration for databases

3© 2011 Emulex Corporation 3© 2012 Emulex Corporation

8GFC Improvements vs. 4GFC

Feature 8GFC 4GFC

More IOPS 200k 150k

Latency Improvements Up to 30% faster

Greater Throughput 800Mb/s per port 400Mb/s per port

Server Architecture: MSI-X Yes No

PCIe 2.0 1.0a

Virtualization: vPorts 255 100

Exchanges (XRI) per port 4096 1000

Enhanced Diagnostics Yes No

Non-volatile data Yes No

T10-PI Enhanced Data Integrity Yes No


Ubiquitous Platform Availability: Emulex LightPulse 8Gb Fibre Channel HBAs

8Gb/s HBAsSingle

Dual

Quad

8Gb/s Blade


Enhance 4G Infrastructures with 8G HBAs

LightPulse LPe12002 8GFC HBA vs. LPe11002 4GFC HBA Storage arrays support 4Gb/s port connectionsOrder entry & data warehousing workload

– Oracle Orion I/O tool, SwingBench load generator– Benchmarks results:

16% Improvement in I/O Latency

15% more IOPS Nearly 2x data warehousing throughput


Database-Optimized HBAs

Advantages of Using Emulex 8G HBAs

12

Performance

•37% greater total IOPS

vs competition•20-30% better

latency •>2x Dual

Channel IOPS vs competition •Ideal for P2V

migrations

Management

• Twice the management in

half the time• Powerful QoS,

availability, diagnostics• Vision performance management

Highest Availability

• Best HBA reliability: >10 million MTBF

• Best system reliability:

operates 27° Cooler

• No downtime FW upgrades

Database Throughput

• 15% better transaction rates

• Up to 33% more effective CPU

• Self-tuning performance

• 7 of 10 Top TPC-Cs


Unique Manageability for Databases: OneCommand Manager

OneCommand Manager (OCM)• Central lifecycle management &

automation • Multi-protocol - FC, FCoE, iSCSI, NIC• Broad OS support• Unique online FW and driver upgrades• Powerful deployment, configuration,

availability, QoS, diagnostics management

OneCommand Manager for VMware vCenter• Native software plug-in with vCenter

look and feel• Extends vCenter with real-time OCM

lifecycle management for Emulex HBAs and UCNAs

Provisioning Utilities

Update Utilities

Management APIs OCM SDK


Deploying 8Gbps Fibre Channel with Oracle Databases

James Morle


Who Am I?

James Morle

– Founder of Scale Abilities Ltd

– Co-founder of the OakTable Network (www.oaktable.net)

– Oracle ACE Director

– Author of Scaling Oracle8i and co-author of Oracle Insights

– Over 20 years large scale Oracle experience, 30 years in professional IT

http://www.oaktable.net/


Who Are Scale Abilities?

UK-based global consultancy specializing in full-stack Oracle-based architectures

– Full system architecture– Proactive Performance Management– Reactive Performance Management


Our Emulex Partnership

Commissioned by Emulex for an independent evaluation of their Fibre Channel products

– Scale Abilities always retains 100% editorial control over published content– Emulex retains control over whether or not to publish


Agenda

A bandwidth and latency refresher

Bandwidth and Business Intelligence

A primer on configuring Oracle for high-bandwidth throughput

A look at the testing performed and results obtained for the whitepaper entitled “Deploying 8Gbps Fibre Channel with Oracle Databases”

Q&A


Bandwidth and Latency Refresher

What is Bandwidth?

What is Latency?


Give me 1000x1MB chunks

2 Gbps Pipe 200x 1MB

2 Gbps Pipe

2 Gbps Pipe

2 Gbps Pipe

2 Gbps Pipe

200x 1MB

200x 1MB

200x 1MB

200x 1MB

200x 1MB 200x 1MB 200x 1MB 200x 1MB

Bandwidth


Latency

Give me a single 4KB chunk

2 Gbps Pipe 4KB

4ms

4ms=1/250s=250 sequential reads per second 10ms

10ms=1/100s=100 sequential reads per second

2 Gbps Pipe


Bandwidth and Business Intelligence

Bandwidth is a critical success factor in business intelligence (BI)

– BI queries frequently need to access a large proportion of available data

– Indexed access paths become less efficient than full or partial scanning

– Scanning rate equals bandwidth

– Higher scan rates mean faster queries

SAN performance matters for getting data from disk to the CPU


The Balancing Act

Storage, SAN and Server CPU must be balanced to achieve optimal throughput

For example: Oracle Database Machine (Exadata)


Tuning Focus:High Bandwidth Oracle

Key configuration points for high bandwidth throughput– Large I/Os– Asynchronous Processing and Prefetching– Parallel Execution


Large I/Os

8KB Read

1MB Read

Data Transfer


Async I/O

Ability to issue I/O requests without waiting for the response

Allows other tasks (such as processing, or other read requests) to take place while waiting for I/O to return


Blocking vs Async I/O

Processing

ServicingI/O

Blocking I/O

t

Processing

ServicingI/O

Async I/O(and prefetch)


Oracle Parallel Execution

Storage

Oracle Processes

Serial Parallel


Testing 8GFC

Bandwidth focused tests to demonstrate throughput of 8GFC versus 4GFC

– Large reads– Async I/O and prefetching– Parallel Execution


LPe11002 4Gbps FC

LPe12002 8Gbps FC

Disk Array(Write-back cached)

TMS RamSan x5

4x 4Gbps each(20 total)

2x 4Gbps

Brocade 6510

IBM x3850 X5

Test Hardware


OneCommand Manager


Test Configuration

8GFC and 4GFC cards are enabled and disabled at the switch

Five RamSan-400 SSDs: read and write latency 15 microseconds

Engenio e6000: 48 spindles - RAID-5

dm-multipath used to insulate Oracle ASM from the changing underlying devices


Large Tables

Engenio: ‘BIGTABLE’

RamSan: ‘SSD_BIGTABLE’

SQL> select segment_name,bytes/1048576 size_mb 2 from dba_segments 3 where segment_name like '%BIGTABLE';

SEGMENT_NAME SIZE_MB-------------------- ----------SSD_BIGTABLE 12307BIGTABLE 630618


Engenio Query

select /*+ parallel(bt,8) */ count(*) from bigtable bt


RamSan Query

declarei number;j number;beginfor i in 1..1000 loop select /*+ parallel(bt,32) */ count(*) into j from ssd_bigtable bt;end loop;end;


Key Discoveries

What’s the real difference between 4GFC and 8GFC?– Equal theoretical bandwidth – 4x4 = 2x8– Right?


Results

Bandwidth MB/s

4GFC 8GFC 8GFC0

200

400

600

800

1,000

1,200

1,400

1,600

SS

D a

nd

E

ng

en

io

SS

D o

nly

SS

D a

nd

E

ng

en

io


Further Detail

8GFC - Both queries active

8GFC - Only SSD query active

Switch between 8GFC and 4GFC

4GFC -Both queries active

Switch back to 8GFC


Conclusions

Optimal Oracle configuration is essential to utilize full SAN bandwidth

Tests show a surprising increase in bandwidth of 13%– Sufficient to knock an hour off an 8-hour batch run, if it spends the majority of its

time waiting on I/O


Q&A

Contacts:– James Morle:

• Email: [email protected]• Twitter: @jamesmorle @scaleabilities• Blog: www.scaleabilities.co.uk/author/morlej

– Emulex: – Barbara Porter• Email: [email protected]• Papers/blogs/tech tips/app notes: www.implementerslab.com

Optimizing Performance of your Oracle Database using 8Gb Fibre Channel

Technology

Transcript of Optimizing Performance of your Oracle Database using 8Gb Fibre Channel