Performance Testing Progress and Oracle
description
Transcript of Performance Testing Progress and Oracle
Performance Testing Progress and Oracle
Environment Variables and Installation
PUG Challenge Americas 2012 Performance Testing Progress
and Oracle
Progress Oracle
DLC /usr/dlc102B ORACLE_HOME /app/oracle/product/11.2.0
ORACLE_BASE /app/oracle
PATH $DLC/bin PATH $ORACLE_HOME/bin
To install
proinst To install runInstaller
Location /etc/oraInst.loc
inventory.xml
Physical Structure (data files)
PUG Challenge Americas 2012 Performance Testing Progress
and Oracle
Database File sports.db Control File(s) control01.ctl
System Area sports.d1 System Tablespace system.dbf
D Files area.d Datafiles tablespace.dbf
Before-Image File + After-Image File
sports.b1 + sports.a1
Undo tablespace +Redo Log
undotbs.dbf + redo01.log
Copy of After-Image File
sports.date_time_etc
Archive Log sports.date_time_etc
Structure file sports.st Backup of control file to trace file
Log File sports.lg Alert Log alert_sports.log
Parameter File sports.pf pfile (or spfile) initsports.ora
PUG Challenge Americas 2012 Performance Testing Progress
and Oracle
sports.dbsports.d1sports.licsports.b1sports.stsports_7.d1sports_8.d1sports_9.d1sports.lgsports.pf
control01.ctlcre_controlfile.sqlredo01.logredo02.logredo03.logsystem01.dbfsysaux01.dbftemp01.dbfundotbs01.dbfusers01.dbf
.srt, .DBI
ORACLE_HOME
Physical Structure
Logical Structure
PUG Challenge Americas 2012 Performance Testing Progress
and Oracle
Area Schema Area Tablespace System Tablespace
Area consists of objects
Objects are Tables or Indexes
Tablespace consists of segments
Segments: Tables, Indexes, Undo, etc
Each Object has one or more Clusters
Clusters size could be 8,64 or 512 blocks
Each Segment has one or more Extents
An extent is a series of blocks that are consecutively numbered within a datafile
Clusters consist of blocks
blocks 1,2,4 or 8K Extents consist of blocks
blocks 2,4,8,16,32 or 64K
Background Processes
PUG Challenge Americas 2012 Performance Testing Progress
and Oracle
Asynchronous Page Writer APW Database Writer DBWn
Before/After Image Writer BIW, AIW Log Writer LGWR
AI Management AIMGT Archive Process ARCn
Watch Dog WDOG Process Monitor PMON
Database Broker _mproserv System Monitor SMON
Checkpoint process CKPT
Many other …. 20 at least
Login Broker _mproserv Listener lsnrctl
PUG Challenge Americas 2012 Performance Testing Progress
and Oracle
Client Server -db db_name -H host -S service
Listener
Shared memory -db /full_path/db-name
N/A
Login Broker lsnrctl [start/stop/status]
Connecting to a database
$ORACLE_HOME/bin
PUG Challenge Americas 2012 Performance Testing Progress
and Oracle
-H host –S service1
-H host –S service2 S
Host:port:SIDSID
ListenerPort 1521
SID2
Connecting to a database
Host:port:SID2
Meta-schema and VST
PUG Challenge Americas 2012 Performance Testing Progress
and Oracle
Progress Table Field Oracle View Column
_Area _Area-name DBA_TABLESPACES TABLESPACE_NAME
_AreaExtent _Extent-Path DBA_DATA_FILES FILE_NAME
_StorageObject _Object-type (1,2 or 3) DBA_OBJECTS object_type (38 types)
_File _File-name DBA_TABLES TABLE_NAME
_Field _Field-name DBA_TAB_COLUMNS
COLUMN_NAME
_Index _Index-name DBA_INDEXES INDEX_NAME
_Sequence _Seq-name DBA_SEQUENCES SEQUENCE_NAME
Progress Meta-schema tables -80 < _file-number < 0
Progress VST _file-number < -16384
Meta-schema and VST
PUG Challenge Americas 2012 Performance Testing Progress
and Oracle
Virtual System Tables V$ (Vee dollar) Views
_Connect v$session, v$process
_DbStatus v$instance, v$sysstat
_Trans v$transaction
_Lock v$lock
_Latch v$latch
_AreaStatus v$tablespace
_Filelist v$datafile
_Startup (some) v$parameter
Data Types
PUG Challenge Americas 2012 Performance Testing Progress
and Oracle
character format "x(100)" varchar2 varchar2(100)
decimal format ">>>>9.99" number number(7,2)
integer format ">>>>9" number number(5)
date format 99/99/9999 date 'MMDDYY HH24:MI:SS'
logical format yes/no N/A N/A
datetime HH:MM:SS.SSS+HH:MM timestamp 'HH24:MI:SS.FF5'
int64 format ">>>>9" number number(38)
rowid rowid
recid N/A N/A
blob, clob,raw blob, clob,raw
10 -5
Create Database
PUG Challenge Americas 2012 Performance Testing Progress
and Oracle
PUG Challenge Americas 2012 Performance Testing Progress
and Oracle
PUG Challenge Americas 2012 Performance Testing Progress
and Oracle
Create Database
• prodb mydb• procopy empty8 mydb
• Min size 5 MB• Min memory 160KB• Time to create 1 second
• A set of .sql scripts • create database mydb;
• Min size 512 MB• Min memory 512MB• Time from 20 min to 1.5 hr
PUG Challenge Americas 2012 Performance Testing Progress
and Oracle
Shutdown
• Unconditional Shutdown• Emergency Shutdown
• Shutdown Normal• Shutdown Transactional• Shutdown Immediate• Shutdown Abort
PUG Challenge Americas 2012 Performance Testing Progress
and Oracle
Progress 10.2B-shutdownTimeout [ immed, 10m, 1h, maximum ]
Startup
PUG Challenge Americas 2012 Performance Testing Progress
and Oracle
Closed ClosedNomount modeMount mode
Open Open
ProrestRestoreinit*.ora
.ctl
Shared MemoryBackground Proc
Backup
PUG Challenge Americas 2012 Performance Testing Progress
and Oracle
Progress backup – simple Oracle RMAN – More complicated
probkup db_name file_name
Progress and Oracle : Online and Offline (Hot and Cold)
Progress and Oracle : Complete and Incremental
Oracle: could be Full and Partial
Compressed Backup
PUG Challenge Americas 2012 Performance Testing Progress
and Oracle
700 GB Progress DB makes about 600 GB probkup
1.4 TB Oracle DB makes either 1.2 TB regular backup or 250 GB RMAN compressed backup (BZIP2 is default).
Dump and Load
PUG Challenge Americas 2012 Performance Testing Progress
and Oracle
Dictionary Dump and Load in ASCII format (.d) or 4GL export/import
SQL select/insert“SQL Loader” or External Tables 10g
Binary Dump (proutil –C dump) Oracle export (exp tables=tbl_name)
Binary Load (proutil –C load) Oracle import (imp file=file_name)
Binary Dump multithreaded V10 Oracle Data Pump Export (expdp) 10g
Oracle Data Pump Import (impdp) 10g
Dump/Load .df Export/Import (exp full=y rows=n)
ATM Database Tests
PUG Challenge Americas 2012 Performance Testing Progress
and Oracle
Hardware: IBM POWER 6 p570, RAM 24GB, 2 CPUs 4704 MHz
Software: AIX 6.1, OpenEdge 11.0, Oracle 11gR2
Database: ATM database = 7GB
Tables # records
Branches 5,000
Tellers 50,000
Accounts 50,000,000
Database Size
PUG Challenge Americas 2012 Performance Testing Progress
and Oracle
Progress DB/area size 7,442,137,088Oracle DB/tablespace size 7,688,953,856
Oracle db appear to be 3% more in bytes
Backup Size and Speed
PUG Challenge Americas 2012 Performance Testing Progress
and Oracle
Progress Oracle Oracle ( compressed )time 94 sec 140 sec 240 secondssize 7GB 7.8GB 735MB
ASCII Dump (in seconds)
PUG Challenge Americas 2012 Performance Testing Progress
and Oracle
# records Progress Oracle10,000 0.31 0.43100,000 1.56 3.321,000,000 15 328,000,000 115 259
for each account where account.id < "condition“ no-lock: export account.
select * from account where account.id < "condition"
ASCII Load (in seconds)
PUG Challenge Americas 2012 Performance Testing Progress
and Oracle
# records Progress Oracle100,000 3.75 0.81,000,000 53 1210,000,000 413 139
repeat: create account. import account.
insert into account select * from stg_account; -- External table
Binary Dump (in seconds)
PUG Challenge Americas 2012 Performance Testing Progress
and Oracle
# records Progress Oracle50,000,000 80.38 55.46
proutil atm -C dump PUB.account /dir -index 0 –RO
expdp user/passwd TABLES=ACCOUNT directory=DATA_DIR dumpfile=expdp.dmp parallel=2 -- Data Pump
Binary Load with integrity
PUG Challenge Americas 2012 Performance Testing Progress
and Oracle
# records Progress Oracle50,000,000 920.38 60.43
proutil atm -C load account.bd -B 50000 -TB 31 -TM 32 -T /tmp
impdp user/passwd directory=DATA_DIR dumpfile=expdp.dmp -- Data Pump
Binary Load no integrity (-i)
PUG Challenge Americas 2012 Performance Testing Progress
and Oracle
# records Progress Oracle50,000,000 216.28 60.43
proutil atm -C load account.bd -i -B 50000 -TB 31 -TM 32 -T /tmp
impdp user/passwd directory=DATA_DIR dumpfile=expdp.dmp -- Data Pump
Binary Load
PUG Challenge Americas 2012 Performance Testing Progress
and Oracle
EmptyEmptyEmptyRM BlockFreeRM BlockFullRM Block
HWM
Binary Load
PUG Challenge Americas 2012 Performance Testing Progress
and Oracle
EmptyEmptyEmptyRM BlockFullRM BlockFullRM Block
HWM
Binary Load
PUG Challenge Americas 2012 Performance Testing Progress
and Oracle
EmptyEmptyFullRM BlockFullRM BlockFullRM Block
HWM
Oracle Load
PUG Challenge Americas 2012 Performance Testing Progress
and Oracle
EmptyEmptyEmpty
HWM
Oracle Load
PUG Challenge Americas 2012 Performance Testing Progress
and Oracle
FullFullFull
HWM
Oracle Load
PUG Challenge Americas 2012 Performance Testing Progress
and Oracle
FullFullFull
HWM
Build a brand new index
PUG Challenge Americas 2012 Performance Testing Progress
and Oracle
# records Progress Oracle50,000,000 148.96 118.31
proutil atm -C idxbuild area "Account Index" -thread 1 -threadnum 2 -TF 80 -TB 64 -TM 32 -B 256 -T /tmp -SG 64
CREATE UNIQUE INDEX account_pk ON account (id);
Rebuild existing index
PUG Challenge Americas 2012 Performance Testing Progress
and Oracle
# records Progress Oracle50,000,000 153.95 81.88
proutil atm -C idxbuild area "Account Index" -thread 1 -threadnum 2 -TF 80 -TB 64 -TM 32 -B 256 -T /tmp -SG 64
ALTER INDEX account_pk REBUILD PARALLEL 2;
ATM Test
PUG Challenge Americas 2012 Performance Testing Progress
and Oracle
atm1.sql
PUG Challenge Americas 2012 Performance Testing Progress
and Oracle
PUG Challenge Americas 2012 Performance Testing Progress
and Oracle
CL Trans TPS Conc AvgR MinR 50%R 90%R 95%R MaxR Prog
1 329961 1100.0 0.8 0.00 0.0 0.0 0.0 0.0 99.1 atm1.p
5 341090 1137.0 3.9 0.00 0.0 0.0 0.0 0.0 93.0 atm1.p
15 358355 1194.5 13.9 0.00 0.0 0.0 0.0 0.0 95.0 atm1.p
25 360396 1201.3 22.4 0.02 0.0 0.0 0.0 0.0 97.6 atm1.p
50 367093 1223.6 49.8 0.04 0.0 0.0 0.0 0.1 88.4 atm1.p
100 348467 1161.6 99.6 0.09 0.0 0.0 0.0 0.2 88.2 atm1.p
250 341653 1138.8 248.9 0.23 0.0 0.0 0.1 0.6 98.6 atm1.p
500 315142 1050.5 495.6 0.47 0.0 0.0 0.3 1.2 82.8 atm1.p
1000 310793 1036.0 872.2 0.95 0.0 0.0 1.0 2.3 117.6 atm1.p
Progress ATM ResultsAll tests run for 300 seconds
PUG Challenge Americas 2012 Performance Testing Progress
and Oracle
CL Time Trans TPS Conc AvgR Prog
1 300 35589 118.6 1.0 0.01 atm1.sql
5 300 160492 535.0 4.8 0.01 atm1.sql
15 300 480898 1603.0 14.4 0.01 atm1.sql
25 300 803263 2677.5 23.7 0.01 atm1.sql
50 300 953962 3179.9 47.4 0.01 atm1.sql
100 300 1023948 3413.2 69.4 0.01 atm1.sql
250 300 1063454 3544.9 226.4 0.02 atm1.sql
500 300 1092404 3641.4 472.3 0.06 atm1.sql
1000 300 1113454 3711.5 861.3 0.13 atm1.sql
Oracle ATM ResultsAll tests run for 300 seconds
PUG Challenge Americas 2012 Performance Testing Progress
and Oracle
PUG Challenge Americas 2012 Performance Testing Progress
and Oracle
IBM Power 7 Model p75016 3.4 GHz CPUs x 4 SMTsRAM 124 GBSAN V7000
Big box Test
PUG Challenge Americas 2012 Performance Testing Progress
and Oracle
PUG Challenge Americas 2012 Performance Testing Progress
and Oracle
Type: DBS and CC Only DBSAny -pf file anywhere init*ora In $ORACLE_HOME/dbsPromon R&D / 1 / 12 or _Startup select * from V$PARAMETER
Startup parameters
PUG Challenge Americas 2012 Performance Testing Progress
and Oracle
PUG Challenge Americas 2012 Performance Testing Progress
and Oracle
OEM parameters
PUG Challenge Americas 2012 Performance Testing Progress
and Oracle
-db db_name-B memory_target-bibufs log_buffer-n processes-spin spin_count-L dml_locks-Ma 1 Dedicated connections-Ma 2 or more Shared connections-cp* (I18N) NLS* National Language Support
Startup parameters
PUG Challenge Americas 2012 Performance Testing Progress
and Oracle
Questions
Web page www.proora.comEmail [email protected]