8/12/2019 Presentation - Exadata in Turkcell
1/31
TURKCELL DBAFerhat ENGNLhttp://ferhatsengonul.wordpress.com
http://twitter.com/ferhatsengonul
TURKCELLs EXADATAJourneyPart1 & Part 2
May 2011
http://ferhatsengonul.wordpress.com/http://twitter.com/ferhatsengonulhttp://twitter.com/ferhatsengonulhttp://ferhatsengonul.wordpress.com/8/12/2019 Presentation - Exadata in Turkcell
2/31
Who am I?
11 years in IT in finance sector.
Works with (nearly) all dbs from hierarchical to relation
Found peace in Exadata
Likes APEX (as an amateur) 1 year in Turkcell
http://ferhatsengonul.wordpress.com
http://twitter.com/ferhatsengonul
http://ferhatsengonul.wordpress.com/http://twitter.com/ferhatsengonulhttp://twitter.com/ferhatsengonulhttp://ferhatsengonul.wordpress.com/8/12/2019 Presentation - Exadata in Turkcell
3/31
Headlines
Turkcell in numbers
BI domain in numbers
First project
Migration to V2 (8 nodes) ( Total uncompressed size 250 TB)
Second project
Migration to 2 x2-2s (16 nodes)
Consolidation of 4 databases ( Total uncompressed size 600 TB)
Geographical (continental) change of data center
Future plans
8/12/2019 Presentation - Exadata in Turkcell
4/31
Turkcell in Numbers
Leading Telco in Turkey
34 million subscribers in Turkey as of Feb 28, 2011
Third biggest GSM operator in Europe in terms of subscribers
Turkcell started its operations in February 1994
Turkcell co-operates in 8 other countries and has over 60million subscribers total
First and only Turkish company listed on NYSE
Over 500 Oracle Databases, 150+ Production
DB Machine hosts our biggest Database from DWH Domain
8/12/2019 Presentation - Exadata in Turkcell
5/31
TurkcellsBI Environment
Reporting
MSTR
ETL
AB Initio
Oracle ODISource
DBs
Exadata
OtherDWH
DBs
Amount Of Data 3 Billion CDR per Day
600 -1000 GB raw data extracted from 20+ source databases
5 TB Data on file system processed
2-3 TB loaded into databases, all into Exadata
Approximately 600 TB Customer data stored in multiple Databases
600 TB (60 TB compressed) on Exadata
8/12/2019 Presentation - Exadata in Turkcell
6/31
TurkcellsBI Environment Application Footprint
ETL Environment
AB Initioruns on 8 Node Linux Cluster
Data loaded daily between 19:00 - 08:00 (SLA)
Sql*Loader used to load tables with 16 parallel threads
Works to implement external tables continue
Reporting Environment MSTR (Microstrategy) is used mostly.
4 nodes before migration. 3 nodes after migration.
300+ Users
3000 distinct reports with 50k run per month
Runs between 08:0020:00 (SLA)
8/12/2019 Presentation - Exadata in Turkcell
7/31
First Project ( completed in July 2010)
Turkcellslargest 100 TB (~250 TBuncompressed) DB wasmigrated to DBM v2, now only 25 TB with the help of HCC on
Full SAS Rack
Over 50K reports run every month on this DB, Performance
improvement up-to 400x, average 10x
1 RACK instead of 11 RACKS
8/12/2019 Presentation - Exadata in Turkcell
8/31
8/12/2019 Presentation - Exadata in Turkcell
9/31
8/12/2019 Presentation - Exadata in Turkcell
10/31
8/12/2019 Presentation - Exadata in Turkcell
11/31
The Project Overview
Planned as simplemigration
No Application version or interface changes
Migrate to new Exadata V2 machine
Upgrade to new Oracle Version (from 10.2.0.4 to 11.2.0.1)
Move from Single Instance to RAC4 Months (Apr-July) testing of all the components
Crash Tests (working closely with support)
Network Transfer Speed Tests (10G vs IB)
Backup/Restore Tests Performance Tests (RAT, Report run times, data load times)
8/12/2019 Presentation - Exadata in Turkcell
12/31
8/12/2019 Presentation - Exadata in Turkcell
13/31
Migration Facts
Insert/append over DB Links
Platform and version change forced us to use insert over db-link None of the other methods like TTS, ASM Rebalance was applicable
Used in-house pl/sql utility to perform migration
Metadata (Tablespaces were re-organized)
Insert/Append with 128 parallel sessions partition-wise
40TB data was transferred during the migration window
Transfer rate 300mB/sec, around 1 TB per hour approximately
Completed in 36 hours.
High CPU load on comp nodes because of HCC (expected)
SQL*Net compressing the data 2-3x (this was a nice finding)
20 TB readonly data was transferred before, ~30TB after
Network Infrastructure
10Gb-to-IB (Voltaire 4036E) gateway used to connect old system
8/12/2019 Presentation - Exadata in Turkcell
14/31
Migration Facts
After the test migration we ended-up staying on Exadata
End users were so happy, they did not let us go back
3 Weeks before the go-live date we were live
Parallel runs continued for few weeks till we completely feelcomfortable on Exadata
Stability of the system under real load was proved for various loadpatterns
Backup/Restore tests were completed
8/12/2019 Presentation - Exadata in Turkcell
15/31
Compression in Action
Old System 10gR2 Compression ~2-3 times ~250TB raw data to 100TB
Exadata V2 with EHCC Raw Data 250TB to 25TB (Data)+ 5TB (Temp) = 30TB
EHCC - Compress ratio ~7-10x
Archive compression is efficient but high CPU consumption
http://ferhatsengonul.wordpress.com/2010/08/09/getting-the-most-from-hybrid-columnar-compression/
SORT COMPRESS SIZE (GB) RATIO
NOSORT NOCOMP 137,59 1
NOSORT Q_HIGH 21,21 6,48
SORT_A Q_HIGH 12,18 11,29
SORT_B Q_HIGH 15,37 8,95
SORT_A_B Q_HIGH 11,64 11,80
http://ferhatsengonul.wordpress.com/2010/08/09/getting-the-most-from-hybrid-columnar-compression/http://ferhatsengonul.wordpress.com/2010/08/09/getting-the-most-from-hybrid-columnar-compression/http://ferhatsengonul.wordpress.com/2010/08/09/getting-the-most-from-hybrid-columnar-compression/http://ferhatsengonul.wordpress.com/2010/08/09/getting-the-most-from-hybrid-columnar-compression/http://ferhatsengonul.wordpress.com/2010/08/09/getting-the-most-from-hybrid-columnar-compression/http://ferhatsengonul.wordpress.com/2010/08/09/getting-the-most-from-hybrid-columnar-compression/http://ferhatsengonul.wordpress.com/2010/08/09/getting-the-most-from-hybrid-columnar-compression/http://ferhatsengonul.wordpress.com/2010/08/09/getting-the-most-from-hybrid-columnar-compression/http://ferhatsengonul.wordpress.com/2010/08/09/getting-the-most-from-hybrid-columnar-compression/http://ferhatsengonul.wordpress.com/2010/08/09/getting-the-most-from-hybrid-columnar-compression/http://ferhatsengonul.wordpress.com/2010/08/09/getting-the-most-from-hybrid-columnar-compression/http://ferhatsengonul.wordpress.com/2010/08/09/getting-the-most-from-hybrid-columnar-compression/http://ferhatsengonul.wordpress.com/2010/08/09/getting-the-most-from-hybrid-columnar-compression/http://ferhatsengonul.wordpress.com/2010/08/09/getting-the-most-from-hybrid-columnar-compression/8/12/2019 Presentation - Exadata in Turkcell
16/31
8/12/2019 Presentation - Exadata in Turkcell
17/31
8/12/2019 Presentation - Exadata in Turkcell
18/31
I had a great ho l iday
8/12/2019 Presentation - Exadata in Turkcell
19/31
Second Project
Monthly 1 TB increase in size.
Need a second RACK.
Management was satisfied and bought 2
RACKS in stead of one. Migration of Data Center from Europe to Asia
Consolidation on Exadata.
8/12/2019 Presentation - Exadata in Turkcell
20/31
SMARTCUBE - MicroStrategy
Operat ionalSources
Extract
S
..
..
RDS
ODS CDRDM
Feed
DDS
BIS INFRASTRUCTURE ROADMAP
EXADATA x2-2
8/12/2019 Presentation - Exadata in Turkcell
21/31
SINGLE DWH ENVIRONMENT
WITHOUT
DUPLICATION OF DATA
CDRDM 15TB
DDS 35 TB + 18 Ay
DEV DOMAIN 5 TBRDS 5 TB
SAS 60TB HOT
SAS 20TB COLD
100TB
COLD
Moving the data!
ODS 5 TB
TEST DOMAIN 5 TB
HIGH
AVAILABILTY
SOLUTION
FOR DWH 50TB
OTHER DBS
25TB
ZDDS 5TB
SINGLE DATABASE
8/12/2019 Presentation - Exadata in Turkcell
22/31
Project Status (Feb 2011)
RDS was migrated and became XRDS
Size : 15 TB decreased to 3 TB
A single tables compression rate 70x (Full of numbers)
Performance increase 3x even the ETL Server and
the DB are on different continents And runs in only one database node. (server pool
which has only one node.)
8/12/2019 Presentation - Exadata in Turkcell
23/31
Project Status (March 2011)
CDRDM was migrated and became XCDRDM
Size : 45 TB decreased to 15 TB
Our aim is to use this space for ETL server
migration.
8/12/2019 Presentation - Exadata in Turkcell
24/31
Project Status (April 2011)
Existing XDDS has migrated in April.
ETL servers and reporting servers have migrated
simultaneously.
8/12/2019 Presentation - Exadata in Turkcell
25/31
Project Status (End of May 2011)
ODS will be migrated in May
The existing v2 system will turn into a high
capacity disk system and will be the home of
XCDRDM/dev/test and high availability system.
8/12/2019 Presentation - Exadata in Turkcell
26/31
8/12/2019 Presentation - Exadata in Turkcell
27/31
GAINS and PROJECTION
DBNAME BEFORE AFTER END of 2011 END of 2012
XDDS 35TB 35TB 40TB 50TB
XCDRDM 60TB 13TB 15TB 20TB
XRDS 15TB 3TB 5TB 7TB
ZDDS 15TB 3TB 5TB 7TB
NODS 6TB 2TB 5TB 10TB
ARA
TOPLAM
96TB 21TB 30TB 44TB
TOTAL 131TB 56TB 70TB 94TB
120 TB (net space) of disk is given back with the first project.
100 TB (net space) of disk is given back with the second project.
8/12/2019 Presentation - Exadata in Turkcell
28/31
GAINS on reporting
6,42 min 7,1 min 3,28 min
Avg Time
Even though were using only 8 nodes on X2-2
cluster, we had performance increase.
8/12/2019 Presentation - Exadata in Turkcell
29/31
8/12/2019 Presentation - Exadata in Turkcell
30/31
8/12/2019 Presentation - Exadata in Turkcell
31/31
Thank YOU
Questions
www.turkcell.com.tr
Ferhat ENGNLhttp://ferhatsengonul.wordpress.com
http://twitter.com/ferhatsengonul
http://ferhatsengonul.wordpress.com/http://twitter.com/ferhatsengonulhttp://twitter.com/ferhatsengonulhttp://twitter.com/ferhatsengonulhttp://ferhatsengonul.wordpress.com/http://ferhatsengonul.wordpress.com/Top Related