World's Fastest Database Machine · City . 3 Oracle Exadata Database Machine ... disks to ASM...
Transcript of World's Fastest Database Machine · City . 3 Oracle Exadata Database Machine ... disks to ASM...
Oracle Exadata: The World‟s Fastest Database Machine
Marek Martofel
Oracle
Month, Day, Year
Venue
City
3
Oracle Exadata Database Machine One architecture for …
• Data Warehousing
• OLTP
• Database Consolidation
Exadata is Oracle‟s strategic database platform for ALL Oracle Database
workloads
© 2011 Oracle Corporation
4
Exadata Hardware Architecture Pre-integrated, optimized Oracle Database platform
• Database Pool
– Intel-based database servers
– Oracle Linux or Solaris 11
– 10 Gig Ethernet (to data center)
• Storage Pool
– Intel-based storage servers
– Up to 336 terabytes raw disk
– 5.3 terabytes Flash storage
• InfiniBand Network
– Internal high-bandwidth connectivity
A complete system – compute, storage and network; pre-configured,
balanced and optimized.
© 2011 Oracle Corporation
5 Copyright © 2011, Oracle Corporation and/or its affiliates – 5 –
Base configurations
• Exadata Database Machine X2-2
• Exadata Database Machine X2-8
Expansion for Exadata
• Exadata Storage Expansion HC
Expansion for database servers
• Exadata X2-2 Memory Expansion Kit
Exadata Database Machine Available Editions
6
Start Small and Grow
Field Upgradeable
Full Rack
Half Rack
Balanced Incremental Scaling for OLTP and DW
Quarter Rack
Copyright © 2011, Oracle Corporation and/or its affiliates – 6 –
7 Copyright © 2011 Oracle Corporation and/or its affiliates – 7 –
X2-2 Database Server (Sun Fire X4170 M2)
Processors 2 Six-Core Intel® Xeon® X5675 Processors (3.06 GHz)
Memory 96 GB (12 x 8GB) expandable to 144 GB (18 x 8GB)
Local Disks 4 x 300GB 10K RPM SAS Disks (Hot-Swappable)
Disk Controller Disk Controller HBA with 512MB Battery Backed Cache
Network 2 x InfiniBand 4X QDR (40Gb/s) Ports (1 Dual-port PCIe 2.0 HCA)
4 x 1GbE Ethernet Ports
2 x 10GbE Ethernet SFP+ Ports (1 Dual-port 10GbE PCIe 2.0
network card based on the Intel 82599 10GbE Controller technology)
Remote
Management
1 Ethernet port (ILOM)
Redundancy Redundant Hot-Swappable power supplies and fans
8
X2-8 Database Server (Sun Fire X4800)
Processors 8 x Eight-Core Intel® Xeon® X7560 Processors (2.26 GHz)
Memory 1 TB (128 x 8 GB)
Local Disks 8 x 300GB 10K RPM SAS Disks (Hot-Swappable)
Disk Controller Disk Controller HBA with 512MB Battery Backed Cache
Network 8 x InfiniBand 4X QDR (40Gb/s) Ports (4 Dual-port PCE 2.0 Express
Modules)
Two Network Express Modules (NEM), providing a total of
• 8 x 1GbE Ethernet Ports
• 8 x 10 GbE Ethernet SFP+ Ports (via 4 Fabric Express Modules
(FEM) based Intel 82599 10GbE Controller technology)
Remote
Management
1 Ethernet port (ILOM)
Redundancy Redundant Hot-Swappable power supplies and fans
Copyright © 2011 Oracle Corporation and/or its affiliates – 8 –
9 Copyright © 2011 Oracle Corporation and/or its affiliates – 9 –
Exadata Storage Server X2-2 (Sun Fire X4270 M2)
Processors 2 Six-Core Intel® Xeon® L5640 Processors (2.26 GHz)
Memory 24 GB (6 x 4GB)
Disks 12 x 600 GB 15K RPM High Performance SAS (hot-swap)
OR
12 x 2 TB 7.2K RPM High Capacity SAS (hot-swap)
Flash 4 x 96 GB Sun Flash Accelerator F20 PCIe Cards
Disk Controller Disk Controller HBA with 512MB Battery Backed Cache
Network 2 InfiniBand 4X QDR (40Gb/s) Ports (1 Dual-port PCIe 2.0 HCA)
4 Embedded Gigabit Ethernet Ports
Remote
Management
1 Ethernet port (ILOM)
Power Supplies Redundant Hot-Swappable power supplies and fans
10
Exadata Software Architecture Intelligent storage, standard Oracle Database
• Database Pool
– Oracle Database 11g
– Oracle RAC (Real Application Clusters)
• Storage Pool
– Intelligent storage
– Hybrid Columnar Compression
– Smart Flash Cache
Storage software innovations uniquely deliver extreme performance
and storage efficiency
© 2011 Oracle Corporation
11
Exadata Software Architecture Overview
LIBCELL
DB Server
LIBCELL
DB Server
LIBCELL
DB Server
Single-instance DB RAC DB
Exadata Server
OEL
CELLSRV
IORM
MS
RS
Exadata Server Exadata Server
Enterprise Manager
Cell Control CLI
(cellcli/dcli)
SSH
iDB Protocol over InfiniBand with Path Failover
Single ASM cluster ASM ASM ASM
InfiniBand Storage Switch/Network
DB Instance
DBRM
DB Instance DB Instance
DBRM DBRM
OEL
CELLSRV
IORM
MS
RS
OEL
CELLSRV
IORM
MS
RS
12
Exadata Storage – Hard Disk Drives
• 12 x 600GB High Performance or 2TB High Capacity
Uniquely identified by serial number
Automatically created by MS when new disks are inserted
Manually created using CellCLI initially
MS automatically recreates these entities for replacement disks
Manually add grid disks to ASM diskgroups
After that, if a physical disk is replaced, auto management feature will automatically online the corresponding ASM disk
13
Exadata Storage – Flash
• Each card has 4 x 24GB FDOMS
• Each storage cell has 4 Flash cards
• Total of 16 x 24GB flash celldisks per cell
(seen as FDOMs)
• Used for Smart Flash Cache, Smart Flash
Log, and Flash Grid Disks
CELLDISK ASM disk GRIDDISK
FLASHCACHE
OR FDOM
Automatically created by MS
FLASH LOG
MS automatically recreates these entities for replacement disks
14
Select sum(sales) where salesdate= ’17-Nov-2010’…
Sum
Return entire Sales table
What Were Yesterday‟s
Sales?
Discard most of
sales table
Traditional Query Problem
• Data is pushed to database server for processing
• I/O rates are limited by speed and number of disk drives
• Network bandwidth limits performance and concurrency
© 2011 Oracle Corporation
15
Select sum(sales) where salesdate= ’17-Nov-2010’…
Sum
Filter Sales for Nov 17 2010
What Were Yesterday‟s
Sales?
Exadata Smart Scans Improve data warehouse performance by at least 10x
• Data intensive processing runs in Storage Servers
• Rows and columns filtered as data streams from disk
• Parallelize query execution and remove bottlenecks
© 2011 Oracle Corporation
16
Oracle Exadata Hybrid Columnar Compression
• Data stored by column and then compressed
• Query mode for data warehousing tables
– Typical 10X compression ratios
• Archival mode for old data
– Typical 15- 50X compression ratios
© 2011 Oracle Corporation
17
Infrequently Used Data
Frequently Used Data
Exadata Smart Flash Cache Extreme performance for OLTP applications
• Frequently-accessed „hot‟ data cached in flash storage
• Process data at 50Gb/second
– Compressed data up to 500Gb/second
• Up to 1.5 million I/Os per second
© 2011 Oracle Corporation
18
Exadata Smart Flash Log
• Outliers in log writer IO slow down a
lot of clients
• Outliers from any one copy of the
mirror affect response time
• Performance critical algorithms such
as space management and index
splits are sensitive to log write latency
• Legacy storage cannot differentiate
redo log IO from other IO
foreground
client
Log Buffer
Log writer
foreground
client
foreground
client
foreground
client
ASM mirror 1
Log file member
ASM mirror 2
Log file member
19
Exadata Smart Flash Log
• Smart Flash Log uses Flash as a Parallel
write cache to disk controller cache
• Whichever write completes first wins (disk
or flash)
• Reduces response time and outliers – “log file parallel write” histogram improves
– Greatly improves “log file sync”
• Uses almost no flash capacity (0.1% of
capacity)
• Completely automatic and transparent
• Differentiates Exadata from competition for
OLTP
20
Exadata Smart Flash Log IO Path
1. Database issues redo log write
request to the Exadata cell
2. CELLSRV simultaneously issues
write request to both Flash and Disk
3. CELLSRV acknowledges redo log
write to the database as soon as the
faster of disk write or flash write
completes
E – Redo log writes saved on flash are
written to disk from flash only if there
were errors with the original disk write
request.
Note – Redo Log is permanently stored
on disk and is only stored temporarily on
flash.
CELLSRV
DB
Disk
Flash
1
2
2
3
E
21
Enabling Smart Flash Log
• Requirements
• Exadata Storage Server Software 11.2.2.4 or later
• Oracle Database 11.2.0.3 and BP1 (when supported on
Exadata) or Oracle Database 11.2.0.2 and BP11
• Enabling Smart Flash Log
• Automatically created in new cells with 11.2.2.4 or cell
software upgraded to 11.2.2.4
• Automatically enabled in Oracle database 11.2.0.2 (with
BP11) or later
22
Disabling Smart Flash Log
• To disable Smart Flash Log for all databases
• Use DROP FLASHLOG CellCLI command in the storage servers
• To disable Smart Flash Log for an individual database
• Use ALTER IORMPLAN dbplan=((name=test, flashLog=off))
23
CellCLI - CREATE FLASHLOG
Syntax:
CREATE FLASHLOG [ALL [FLASHDISK]] [attribute=value]
[,attribute=value] …
Examples:
CREATE FLASHLOG ALL
CREATE FLASHLOG ALL SIZE=1G
CREATE FLASHLOG CELLDISK='fd1,fd2'
CREATE FLASHLOG CELLDISK='fd1,fd2' SIZE=1G
Details:
Default size is 512MB and is automatically created for new cells, and
also during upgrades to 11.2.2.4.
24
CellCLI - DROP FLASHLOG
Syntax:
DROP FLASHLOG [FORCE]
Examples:
DROP FLASHLOG
DROP FLASHLOG FORCE
Details:
Note “DROP FLASHLOG” will fail if there is saved redo which has
not yet been written to size. The FORCE option will force the drop of
the flashlog even if there is saved redo and should be used with
caution
25
Exadata Delivers Extreme Consolidation Create a “Database-as-a-Service” platform
• Large Memory
– Many databases can be consolidated
• Extreme Performance
– OLTP, DW, data mining, batch, reporting, loading,
backups, files in the database
– Encryption, compression
• Workload Isolation
– Manage SLAs via Quality of Service (QoS)
– CPU and I/O resource management
– Instance caging
Shrink data center costs, increase system utilization and promote
application integration
© 2011 Oracle Corporation
26
Standardized and Simple to Deploy Eliminate systems integration trial-and-error
• No Unique Configurations
– Same as Oracle engineering
– Delivered tested and ready-to-run
– Highly optimized, top-to-bottom
– Highly supportable
• Existing Apps, Tools, Practices
– Oracle Database 11g
– Full 30 years of Oracle Database capabilities
– No Exadata certification required
– Skills, knowledge base, people, partners
Deploy in Days, Not Months
© 2011 Oracle Corporation
27
Faster Deployment with Lower Risk Build your own system vs. Exadata
Build From Scratch with Components
Reference Configurations
Take delivery of Oracle Database Machine
Weeks to Months
Pre-implementation
System sizing
Acquisition of
components
Installation and
configuration
Acquisition of
components
Installation and
configuration
Testing and
Validation
Testing and
Validation
Weeks to Months
Oracle Exadata Database Machine
Database pre-configured
Faster deployment
Lower Risk
< 1 Week after Delivery
Testing and Validation
Configuration
© 2011 Oracle Corporation
28 Copyright © 2011, Oracle Corporation and/or its affiliates – 28 –
Exadata Product Capacity (Uncompressed)
X2-8
Full Rack
X2-2
Full Rack
X2-2
Half Rack
X2-2
Quarter Rack
Raw Disk1 High Perf Disk 100 TB 100 TB 50 TB 21 TB
High Cap Disk 336 TB 336 TB 168 TB 72 TB
Raw Flash1 5.3 TB 5.3 TB 2.6 TB 1.1 TB
Usable Capacity with ASM
normal redundancy2
High Perf Disk 45 TB 45 TB 22.5 TB 9.25 TB
High Cap Disk 150 TB 150TB 75 TB 31.5 TB
Usable Capacity with ASM
high redundancy3
High Perf Disk 30 TB 30 TB 15 TB 6.25 TB
High Cap Disk 100 TB 100TB 50 TB 21.5 TB
1 - Raw capacity calculated using standard disk drive raw space terminology of 1 GB = 1000 x 1000 x 1000 bytes and 1 TB = 1000 x 1000 x 1000 x 1000 bytes.
2 - Actual space available for a database after mirroring (ASM normal redundancy) and leaving one empty disk to handle disk failures. Capacity calculated using normal space terminology of 1 TB = 1024 * 1024 * 1024 * 1024 bytes.
3 - Actual space available for the database computed after triple mirroring (ASM high redundancy). Capacity calculated using normal space terminology of 1 TB = 1024 * 1024 * 1024 * 1024 bytes.
29 Copyright © 2011, Oracle Corporation and/or its affiliates – 29 –
Exadata Product Performance
X2-8
Full Rack
X2-2
Full Rack
X2-2
Half Rack
X2-2
Quarter
Rack
Raw Disk Data
Bandwidth1,3
High Perf Disk 25 GB/s 25 GB/s 12.5 GB/s 5.4 GB/s
High Cap Disk 14 GB/s 14 GB/s 7 GB/s 3 GB/s
Raw Flash Data
Bandwidth1,3
High Perf Disk 75 GB/s 75 GB/s 37.5 GB/s 16 GB/s
High Cap Disk 64 GB/s 64 GB/s 32 GB/s 13.5 GB/s
Disk IOPS2,3 High Perf Disk 50,000 50,000 25,000 10,800
High Cap Disk 25,000 25,000 12,500 5,400
Flash IOPS2,3 1,500,000 1,500,000 750,000 375,000
Data Load Rate4 12 TB/hr 12 TB/hr 6 TB/hr 3 TB/hr
1 - Bandwidth is peak physical disk scan bandwidth achieved running SQL, assuming no compression.
2 - IOPs – Based on peak IO requests of size 8K running SQL. Note that other products quote IOPs based on 2K, 4K or smaller IO sizes that are not relevant for databases.
3 - Actual performance will vary by application.
4 - Load rates are typically limited by CPU, not IO. Rates vary based on load method, indexes, data types, compression, and partitioning
30
Complete Family Of Database Machines From quarter-rack to multi-rack configurations
Oracle Exadata X2-2 2 to 8 (12 core) database nodes
Oracle Exadata X2-8 2 (64 core) database nodes
Quarter Half
Full, Multi-Rack
Full-Rack
Multi-Rack Exadata models and configurations
span the full range of enterprise database deployments
© 2011 Oracle Corporation
31
Best OLTP Machine Runs all enterprise applications
• Oracle E-Business Suite
• Oracle Peoplesoft
• Oracle Siebel
• SAP applications
• 3rd party ISV applications
• In-house developed applications
© 2011 Oracle Corporation
32
For More Information
http://search.oracle.com
or
www.oracle.com/exadata
oracle exadata
© 2011 Oracle Corporation
33