Free Load Testing Tools for Oracle Database – Which One Do I Use?

BASEL BERN BRUGG DÜSSELDORF FRANKFURT A.M. FREIBURG I.BR. GENEVA

HAMBURG COPENHAGEN LAUSANNE MUNICH STUTTGART VIENNA ZURICH

Free Load Testing Tools for Oracle

Database – Which One Do I Use?Christian Antognini

8 November 2016

@ChrisAntognini

Free Load Testing Tools for Oracle Database – Which One Do I Use?2 08/11/2016

Senior principal consultant, trainer and partner at Trivadis

christian.antognini@trivadis.com

http://antognini.ch

Focus: get the most out of Oracle Database

Logical and physical database design

Query optimizer

Application performance management

Author of Troubleshooting Oracle Performance (Apress, 2008/14)

OakTable Network, Oracle ACE Director

Agenda

1. Introduction

2. Free Load Testing Tools I Use

3. Summary

Introduction

Common Situations Leading to Database Load

Generation

Perform usability and functionality checks of tools or utilities that require a

non-trivial load to be carried out

Assess the performance of a (new) platform or storage subsystem

Verify whether a set of SQL statements executed on a specific environment

and/or configuration fulfils the expected performance requirements

Golden Rule

Use the right tool

for the right job!

Free Load Testing Tools in My Toolbox

Swingbench

The Silly Little Oracle Benchmark (SLOB)

Apache JMeter

Swingbench

What’s Swingbench?

Load generator designed to stress test Oracle Database

Includes four configurable synthetic benchmarks

OrderEntry, SalesHistory, CallingCircle and StressTest

Extensible with user-defined transactions (StressTest provides an example)

Consists of several CLI and GUI utilities

Developed by Dominic Giles

Available at http://www.dominicgiles.com/swingbench.html

What Can Swingbench Do?

Carry out, with minimal effort, all necessary operations to run one of the four

provided benchmarks

Create test schema (incl. data population)

Generate load

Store key performance indicators about test run

Swingbench Key Components – Setup

Three wizards, that also expose a CLI, are available: OrderEntry, SalesHistory

and CallingCircle

StressTest doesn’t have a wizard because it requires no setup

XML file config dataoewizard

shwizard

ccwizard

Swingbench Key Components – Load Generation

swingbench

minibench

charbench

XML file

XML fileresults2pdf

PDF file

config

load KPI

Swingbench: Demo

Swingbench: Example of Utilization (1)

Purpose

Observe the impact of a vMotion

started while a database server

is subject to a non-trivial load

Benchmark

OrderEntry, scale 10

900 transactions/second

vMotion took 79 seconds

Purpose

Quantify the overhead of TDE

Compare encryption algorithms

Benchmark

OrderEntry, scale 50

160 distinct tests (30 minutes each)

– Users: 10..100

– Encryption: None, AES128,

AES192, AES256

– With and without AES-NI

– Buffer cache: 7GB and 70GB

No Yes

AES-NI

AES128

AES192

AES256

No Yes

AES-NI

AES128

AES192

AES256

The Silly Little Oracle Benchmark

(SLOB)

What’s SLOB?

Platform performance and stability-testing framework that

makes Oracle Database execute SQL statements

Synthetic benchmark

Consists of a few scripts

Developed by Kevin Closson

Available at https://kevinclosson.net/slob/

What Can SLOB Do?

Create one or several test schemas (incl. data population)

Generate load

Random PIO and/or LIO

– Generation of sequential/large PIO by forcing a FTS (e.g. invisible index)

Read only or read write

Lite or heavy redo generation

Store DB as well as OS key performance indicators about test run

SLOB Key Components – Setup

slob.conf config datasetup.sh

SLOB Key Components – Load Generation

runit.sh

slob.conf

reports

iostat

mpstat

vmstat

awr_info.sh

text file

config

SLOB: Demo

SLOB: Example of Utilization (1)

Purpose

Find out the maximum number

of random IOPS (and their

average latency) that a storage

subsystem can sustain

Benchmark

Read-only PIO/LIO

103718 103299 101258

48 64 96 128 160

Sessions

2.9 2.8 4.0 5.2 6.3

48 64 96 128 160

Sessions

db file sequential reads db file parallel reads

Purpose

Assess disk I/O performance in

a VMware environment

Questions

– What’s the impact of running

several DB per VM?

– What’s the impact of running

several VM per server?

Benchmark

1/2/4/8 VM

One/several DB per VM

Each server running an increasing

number of sessions

Read-only and read-write tests

Apache JMeter

What’s JMeter?

Application designed to load test functional behavior and measure

performance

No out-of-the box benchmark available DIY

Consists of several CLI and GUI utilities

Open source project supported by a number of contributors

Available at http://jmeter.apache.org/

What Can JMeter Do?

Many things!

For the intent of this presentation:

Execute SQL statements

through JDBC

Verify whether the executions

return the expected output

and/or in the expected time

Store key performance

indicators

But it’s “only” a framework… it requires

time to “code” a benchmark

Use real schema with data

Use the SQL statements to be

verified

– Bind variables can be either

generated or provided as input

SLOB Key Components – Load Generation

front end

GUI/CLI

test plan

defined

output

text file

config

loadKPI

JMeter: Demo

JMeter: Example of Utilization (1)

Purpose

Verify that a set of queries

performs acceptably under load

Verify that the DB server

supports the expected load

Benchmark

33 distinct queries, each with each

own set of bind variable values,

randomly picked out

100 queries/minute

AAS during a period of 13 minutes

Summary

Comparison

Swingbench SLOB JMeter

Can generates load forOracle

Database

Oracle

Database

any DB with

JDBC support

Synthetic benchmark

User-defined benchmark ()

Effort to implement minimal minimal low high

CLI for automation with scripts

Distributed load generation

Tool of Choice for Common Situations Leading to

Database Load Generation

Perform usability and functionality checks of tools or utilities that require a

non-trivial load to be carried out

Swingbench

Assess the performance of a (new) platform or storage subsystem

Verify whether a set of SQL statements executed on a specific environment

and/or configuration fulfils the expected performance requirements

Apache JMeter

Summary

No single tool can cover all

requirements

If used correctly, Swingbench and

SLOB are simple and effective tools

To run a specific set of SQL

statements don’t spend time build

your own script/tool, use JMeter

Questions and Answers

Christian Antognini

Senior Principal Consultant

christian.antognini@trivadis.com

@ChrisAntognini

08/11/2016 Free Load Testing Tools for Oracle Database – Which One Do I Use?44

Free Load Testing Tools for Oracle Database – Which One Do I Use?

Software

Transcript of Free Load Testing Tools for Oracle Database – Which One Do I Use?

Load Balancing Oracle Database Traffic

Oracle Database 10g Administration Workshop IIindex-of.co.uk/Database/Oracle Database/Oracle_Database_10g... · Oracle Database 10g: Administration Workshop II Electronic Presentation

Website: ...faculty.orangecoastcollege.edu/mmalaty/WhyTakeOracleAtOCC.pdf · •Database Developer? ... Oracle Forms & Reports Developer ... • Oracle Database 10g 22. Oracle Database

Upgrading from Oracle 9i to Oracle Database 11g...Upgrading from Oracle Database 9i to Oracle Database 11g Page 3 EXECUTIVE OVERVIEW An Oracle database upgrade is often considered

Oracle 12c Unified Auditing - Home: DOAG e.V. Oracle Backup & Recovery Oracle Database Security Oracle Advanced Security Audit Vault und Database Firewall, Database Vault Oracle Database

Oracle Database 11g Administration Workshop I vol Iindex-of.co.uk/Database/Oracle Database/Oracle Database...Oracle Database 11g: Administration Workshop I I - 6 Oracle Database 11g:

Oracle Database Semantic Technologies€¦ · Oracle Database Semantic Technologies: Understanding How to Install, Load, Query and Inference ... Social Network Analysis Metadata Registry

Blind Folio ORACLE Series TIGHT / Oracle Database 10g SQL ...media.techtarget.com/searchOracle/downloads/29810c05.pdf · 144 Oracle Database 10gSQL ORACLE Series TIGHT / Oracle Database

Oracle Database Backup and Recovery Reference · Oracle Database Concepts and the Oracle Database Administrator's Guide RMAN concepts and tasks as described in Oracle Database Backup

Oracle Database 12c · Title: Oracle Database 12c Author: Oracle Corporation Subject: Oracle Database 12c Keywords: Oracle Database 12c Created Date: 7/18/2013 10:19:16 AM

oracle database 11g | oracle database 11g training - oracle trainings

Maximizing Database Performance - Oracle...•Database load and performance testing with real production workloads –Production workload characteristics such as timing, transaction

Atlas 2 - Micro Focus Supportline · • Oracle Database 12c version 12.1.0.2.0. • Oracle Database 11g R2. • Oracle Database 11g version 11.1.0.6 (32-bit). • Oracle Database

Seminare zu Oracle-Datenbanken - Digicomp · PDF fileSeminare zu Oracle-Datenbanken ... Oracle Database 11g Oracle Database SQL Expert 1 Test verlangt: ... Oracle Database 11g –

DMS-EC2 Oracle database to Oracle RDS database

Oracle Database Administration I & Oracle Database ...

Maximum Availability Architecture(MAA) · F5 BIG-IP LTM 3400 Primary Site Oracle RAC and ASM Application Tier HA Storage Oracle Data Guard Oracle Database Database Tier Load Runner

Upgrading to Oracle Database 12c - Webs.nsit.com/.../shop/oracle/upgrading-oracle-database.pdfUpgrading to Oracle Database 12c 1 Introduction Oracle Database 12 c includes exciting

Oracle Database In-Memory - Oracle User Group · Oracle Database •Database In-Memory is an option for Oracle Database 12c Enterprise Edition •Database In-Memory is included in

Oracle Database 11g RAC Database and Oracle Clusterware Administration