8/18/2019 Exadata X4 Hardware Overview
1/70
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.1
Exadata Hardware Overview
Last updated !ov 2", 2013
8/18/2019 Exadata X4 Hardware Overview
2/70
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.2
Exadata Database Machine
The ultimate platform for all database w
OL#$, %arehousing, &ata'ase as a (ervic
Most advanced hardware
)ully scale*out servers and intelligent stora
nfini-and connectivity and $C flash
Most advanced software &ata'ase optiied copute, storage, and
algoriths draatically iprove perforan
Standardized, optimized, hardened end
8/18/2019 Exadata X4 Hardware Overview
3/70
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.3
Exadata Hardware
8/18/2019 Exadata X4 Hardware Overview
4/70
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
Exadata !rchitectureCoplete Optiied (tandardied ardened &ata'ase $latfo
Standard Database Servers
45 2*socet servers 162 cores, 2#- or
25 4*socet servers 190 cores, #-
"nified "ltra#ast $etwork 0 :' nfini-and internal connectivity all p
10 :' or 1 :' ;thernet data center connecti
Scaleout %ntelli&ent Stora&e Servers 15 2*socet servers 194 cores in s
194 (A( dis drives 9"2 #- C or
8/18/2019 Exadata X4 Hardware Overview
5/70Copyright © 2013, Oracle and/or its affiliates. All rights reserved.<
)rebuilt and Optimized Outofthe*ox
)
e r f o r m a n c e ! c h i e v e m
e n t
)
e r f o r m a n c e ! c h i e v e m
e n t
#ie
>&ays?
#ie
>8onths?
100@
Measure,diagnose,tune and
reconfigure
Test & debug
failure modes
Assembledozens of
components
Multi- vendorfinger
pointing
Custo Configuration
8/18/2019 Exadata X4 Hardware Overview
6/70Copyright © 2013, Oracle and/or its affiliates. All rights reserved.9
Standardized and Simple to Deplo'
• !ll Database Machines are the same
‒ &elivered ready*to*run
‒#ested
‒ ighly supporta'le
Deplo' in Da's,
$ot Months
eady
-
to- un
‒ !o uniue config
‒ dentical to confi
'y Oracle ;ngine
• (uns existin& O+T) and D application
‒ )ull 30 years of Oracle &- capa'ilities
‒!o ;5adata certification reuired
• +evera&es Oracle ecos'stem
‒ (ills, no+ledge 'ase, people and partners
8/18/2019 Exadata X4 Hardware Overview
7/70
Copyright © 2013, Oracle and/or its affiliates. All rights reserved."
Scalable from Ei&hth(ack to Multi(ac
#ield "p&radeable Supports
Multiple -enerations of
Hardware
Half #ull
Multi(ack
Ei&hth .uarter
8/18/2019 Exadata X4 Hardware Overview
8/70
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.4
Exadata Database Machine /01 #ull ($re*Configured for ;5tree $erforance
B 4 eon*'ased &ual*processor &ata'ase (ervers 162 cores >2 per server? 204 :- eory e5panda'le to 069 :- >2< per server?
B .4 #- igh (peed )lashB 1 ;5adata (torage (ervers *2
All +ith igh $erforance 12 5 1.2 #- (A( dissO7
All +ith igh Capacity 12 5 #- (A( diss
B 2 (un &atacenter nfini-and (+itch 39 39*port 8anaged D&7 >0:'/s? s+itch
B 1 EAdinF ;thernet s+itchB 7edundant $o+er &istri'utions Gnits >$&Gs?
!dd more racks for additional scalabilit'
8/18/2019 Exadata X4 Hardware Overview
9/70
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.6
Exadata Database Machine /23 #ull (;5tree $erforance for Consolidation, Large OL#$ and
B 2 eon*'ased ;ight*processor &ata'ase (ervers igh Core, igh 8eory &ata'ase (ervers
190 C$G cores >40 per server? #- eory >2#- per server?
10 :ig; connectivity to &ata Center B 19 5 10:' ;*ports >4 per server?
B .4 #- igh (peed )lashB 1 ;5adata (torage (ervers *2
All +ith igh $erforance 12 5 1.2#- (A( dissO7 All +ith igh Capacity 12 5 #- (A( diss
B 2 (un &atacenter nfini-and (+itch 39 39*port 8anaged D&7 >0:'/s? s+itch
B 1 EAdinF ;thernet s+itchB 7edundant $o+er &istri'utions Gnits >$&Gs?
!dd more racks for additional scalabilit'
8/18/2019 Exadata X4 Hardware Overview
10/70
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.10
Exadata /01 Memor' Expansion 4it
Optional it for *2 custoers +ho consolidate larg
data'ases and reuire ore eory Changes eory configuration of the *2 data'ase s
:- >19 5 19 :-? to 19 5 32 :-?
Availa'le for *2 )ull, alf, Duarter, and ;ighth 7a
8/18/2019 Exadata X4 Hardware Overview
11/70
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.11
Exadata Stora&e Expansion /01 #ull ()or additional storage 'acups, historical data, unstructu
Add storage capacity to &ata'ase 8achine online
14 ;5adata (torage (ervers *2
All +ith igh $erforance 12 5 1.2 #- (A( diss
O7
All +ith igh Capacity 12 5 #- (A( diss
8/18/2019 Exadata X4 Hardware Overview
12/70
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.12
Exadata Database Machine Hardware S3*4 )ull *2 )ull *2 alf *2 D
Database Servers 2 4 2
Database -rid 5ores 190 162 69 4
Database -rid Memor' 6-*7 069 204 >a5 069? 102 >a5 204? a5
%nfini*and switches 2 2 2 2
Ethernet switch 1 1 1 1
Exadata Stora&e Servers 1 1 " 3
Stora&e -rid 5)" 5ores 194 194 4 39
(aw #lash 5apacit' .4 #- .4 #- 22. #- 6.9 #
(aw Stora&e 5apacit'
Hi&h )erf 200 #- 200 #- 100 #- 3.2
Hi&h 5ap 9"2 #- 9"2 #- 339 #- 1
"sable mirrored capacit'Hi&h )erf 60 #- 60 #- < #- 16 #
Hi&h 5ap 300 #- 300 #- 1
8/18/2019 Exadata X4 Hardware Overview
13/70
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.13
Exadata Stora&e Expansion (ack Sum*2 )ull *2 alf *2 Duarter
%nfini*and switches 3 3 2
Ethernet switch 1 1 1
Exadata Stora&e Servers 14 6
Stora&e -rid 5)" 5ores 219 104 4
(aw #lash 5apacit'
8/18/2019 Exadata X4 Hardware Overview
14/70
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.1
/01 Database Server !e+ 12*core Evy-ridgeF C$Gs, )aster nfini-and Card, L
$rocessors 1 Twelve5ore %ntel8 /eon8 E91:;< v1 )rocessors 61=)5%e 2=>? *oth )o
5 1:';/10:'; -ase*# ;thernet $orts
2 5 10:'; ;thernet ()$= $orts >1 &ual*port 10:'; $Ce 2'ased on the ntel 42
8/18/2019 Exadata X4 Hardware Overview
15/70
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.1<
/01 Stora&e Server 9*core vy-ridge C$Gs, Larger diss, Larger )lash Cards, )lash
$rocessors 1 Six5ore %ntel8 /eon8 E91:2> v1 )rocessors 61=: -Hz
8eory ;: -* > 5 4:- = 5 19:-? More memor' needed to ma
&iss 12 5 @=1 T* @>4 ()M igh $erforance (A( >hot*s+ap?
O7
12 5 0 T* ".2H 7$8 igh Capacity (A( >hot*s+ap? 3.> -* (un )lash Accelerator #3> $Ce Cards Hardwa
&is Controller &is Controller -A +ith )5%e 2=>? *oth )ort
;'edded :iga'it ;thernet $orts for anageent connectiv
7eote 8anageent 1 ;thernet port >LO8?
$o+er (upplies 7edundant ot*(+appa'le po+er supplies and fans
8/18/2019 Exadata X4 Hardware Overview
16/70
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.19
/23 Database Server
$rocessors 4 5 #en*Core ntelI eonI ;"*44"0 $rocessors >2.0 :?
8eory 2 #- >124 519 :-?Local &iss 4 5 300:- 10H 7$8 (A( &iss >ot*(+appa'le?
&is Controller &is Controller -A +ith 0:'/s? $orts > &ual*port $C; 2.0 ;8odules?
#+o !et+or ;5press 8odules >!;8?, providing a total of
B 4 5 1:'; ;thernet $ortsB 4 5 10 :'; ;thernet ()$= $orts >via )a'ric ;5pres>);8? 'ased ntel 42
8/18/2019 Exadata X4 Hardware Overview
17/70
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.1"
Operatin& S'stem "pdates in @@=1=2=2=>
Oracle Linu5 distri'ution updated to 2.9.
(ae ernel on data'ase servers >2*soce
4*socet? and the storage servers
Oracle (olaris updated to (11 Gpdate 1 (
8/18/2019 Exadata X4 Hardware Overview
18/70
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.14
Environmental %nformation
8/18/2019 Exadata X4 Hardware Overview
19/70
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.16
Exadata /23 Environmental 6H) and H3*4 )ull $ 3*4 )ull C
$o+er8a5 111.< JA?
#ypical 10.10."JA? 10.0 % >10.2 JA?
Cooling
8a5 611.3 gs?
(hipping %t 2163 l's > 66." gs? 2163 l's > 66." gs?
Acoustics 4.- >operating? 4.- >operating?
Dimensions "4.99F >? 5 23.92F>%? 5 ".2F>&? >1664 >? 5 900 >%? 5 1200 >&??
Operatin& Temperature< MC to 32 MC >1 M) to 46.9 M)?, 10@ to 60@ relative huidity, non*condensing . !ltituda5. a'ient teperature is de*rated 'y 1N C per 300 a'ove 600
8/18/2019 Exadata X4 Hardware Overview
20/70
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.20
Exadata /01 Environmental 6H5 disks*2 )ull C *2 alf C *2 Duarter C
$o+er8a5 11.2 % >11.JA? 9.2% >9.3 JA? 3.1% >3.2JA?
#ypical ".6 % >4.1JA? .3 % >.JA? 2.2% >2.3JA?
Cooling
8a534,300 -#G/hr 0,00 K/hr
21, 200 -#G/hr 22, 00 K/hr
10,900 -#G/hr 11,200K/hr
#ypical2",000 -#G/hr 24,C)8? 12639.2 gs? 12"3 l's >
8/18/2019 Exadata X4 Hardware Overview
21/70
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.21
Exadata /01 Environmental 6H) disks*2 )ull $ *2 alf $ *2 Duarter $
$o+er8a5 12.1% >12. JA? 9.9 % >9.4 JA? 3.3 % >3. JA?
#ypical 4.< % >4." JA? ." % >.4 JA? 2. % >2.< JA?
Cooling
8a51,300 -#G/hr 3,900 K/hr
22,439
8/18/2019 Exadata X4 Hardware Overview
22/70
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.22
Stora&e Expansion /01 Environmental 6H5 d)ull C alf C Dua
$o+er8a5 4.6% >6.1JA? 9.3JA? 3.9 H% >3." JA? 1.6
Cooling
8a5 30,00 -#G/hr 32,100K/hr
1",00 -#G/hr 14,00 K/hr
4,60 6,
#ypical21,200 -#G/hr 22,00 K/hr
12,300 -#G/hr 13,000 K/hr
9,42.2 gs? 1131 l's >operating? ".9-
Dimensions "4.99F >? 5 23.92F>%? 5 ".2F>&? >1664 >? 5 900 >%? 5 1200 >&??
Operatin& Temperature< MC to 32 MC >1 M) to 46.9 M)?, 10@ to 60@ relative huidity, non*condensing . !ltitude a5. a'ient teperature is de*rated 'y 1N C per 300 a'ove 600
8/18/2019 Exadata X4 Hardware Overview
23/70
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.23
Stora&e Expansion /01 Environmental 6H) d)ull $ alf $ Dua
$o+er8a5 10.0 % >10.2JA? ".1JA? .0 % >.1 JA? 1.6
Cooling
8a5 3,100 -#G/hr 39,000 K/hr
16,100 -#G/hr 20,142.2 gs? 1131 l's >operating? ".9-
Dimensions "4.99F >? 5 23.92F>%? 5 ".2F>&? >1664 >? 5 900 >%? 5 1200 >&??
Operatin& Temperature< MC to 32 MC >1 M) to 46.9 M)?, 10@ to 60@ relative huidity, non*condensing . !ltitude a5. a'ient teperature is de*rated 'y 1N C per 300 a'ove 600
8/18/2019 Exadata X4 Hardware Overview
24/70
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.2
T'pical Data 5enter Deplo'ment 6!irflo
7ac )ront
Cold Air nlet
7ac 7ear
ot Air Outlet
• Assuing perforated tiles > 00front of the rac for cold air intae
• floor tiles for )ull 7ac
• 3 floor tiles for alf 7ac
• 1 floor tile for Duarter 7ac
• #iles can 'e arranged in any ordrac as long as cold air fro the tthe rac
• nadeuate cold air flo+ could re
inlet teperatures in the servers drecirculation
Each data center has a unique environment,universal optimal deployment is not possible
8/18/2019 Exadata X4 Hardware Overview
25/70
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.2<
)D" 5hoices
8/18/2019 Exadata X4 Hardware Overview
26/70
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.29
Exadata Database Machine )D"SB ;ach 7ac coes +ith 2 >t+o? redundant $o+er &istri'ution Gnits >$&G
B )our choices for the ;5adata &ata'ase 8achine *2 and ;5adata (tor
7acs *2
* Lo+ Joltage 1e5cluding Kapan / #ai+a
* igh Joltage 1< JA #hree $hase ;8;A / A$AC >e5cluding Kapan / #ai+an
B )our choices for the ;5adata &ata'ase 8achine 3*4 >different fro the
(torage ;5pansion 7ac?* Lo+ Joltage 22 JA (ingle $hase Aericas / Kapan / #ai+an
* Lo+ Joltage 2 JA #hree $hase Aericas / Kapan / #ai+an
* igh Joltage 22 JA (ingle $hase ;8;A / A$AC >e5cluding Kapan / #ai+a
* igh Joltage 2 JA #hree $hase ;8;A / A$AC >e5cluding Kapan / #ai+an
8/18/2019 Exadata X4 Hardware Overview
27/70
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.2"
/01 and Stora&e Expansion (ack /01 +ow Bolta&e Sin&le )hase )D" >Aericas / Kapan/ #ai+an?
2 >#+o? "2Ap 1(i5? $o+er $lugs >3 5 30Ap $lugs per $&G?
200 20JAC
&ata Center 7eceptacle #ype * !;8A L9*307
/0 1 d St E i ( k /0 1
8/18/2019 Exadata X4 Hardware Overview
28/70
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.24
/01 and Stora&e Expansion (ack /01+ow Bolta&e Three )hase )D" >Aericas / Kapan/ #ai+an?
2 >#+o? 96Ap 1#+o? $o+er $lugs >1 5 90Ap $lug per $&G?
200 204JAC 3ph
&ata Center 7eceptacle #ype * ;C306*3$%*$9" 90A 2u''ell euivalent is -L9076%?
/0 1 d S E i ( k /0 1
8/18/2019 Exadata X4 Hardware Overview
29/70
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.26
/01 and Stora&e Expansion (ack /01 Hi&h Bolta&e Sin&le )hase )D";8;A / A$AC >e5cluding Kapan/ #ai+an?
2 >#+o? "2 Ap 1(i5? $o+er $lugs >3 5 2< Ap $lugs per $&G?
220 20JAC
&ata Center 7eceptacle #ype * ;C306*2$3%*$ 32A 2<
>u''ell euivalent is -L33279%?
/0 1 d St E i ( k /0
8/18/2019 Exadata X4 Hardware Overview
30/70
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.30
/01 and Stora&e Expansion (ack /0Hi&h Bolta&e Three )hase )D";8;A / A$AC >e5cluding Kapan/#ai+an?
2 >#+o? 92."Ap 1#+o? $o+er $lugs >1 5 2
8/18/2019 Exadata X4 Hardware Overview
31/70
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.31
/23 +ow Bolta&e Sin&le )hase )D">Aericas / Kapan/ #ai+an?
2 >#+o? 110. Ap 22JA $&Gs #otal of 9 $o+er $lugs >3 5 39.4 Ap $lugs per $&G?
200 20JAC
&ata Center 7eceptacle #ype * u''ell C(429
8/18/2019 Exadata X4 Hardware Overview
32/70
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.32
/23 +ow Bolta&e Three )hase )D">Aericas / Kapan/ #ai+an?
2 >#+o? 120Ap 2JA $&Gs
#otal of >)our? $o+er $lugs >2 5 90Ap $lug per $&G? 200 204JAC 3ph
&ata Center 7eceptacle #ype * ;C306*3$%*$9" 90A 2u''ell euivalent is -L9076%?
/2 3 Hi h B lt Si l )h )D"
8/18/2019 Exadata X4 Hardware Overview
33/70
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.33
/23 Hi&h Bolta&e Sin&le )hase )D";8;A / A$AC >e5cluding Kapan/ #ai+an?
2 >#+o? 69 Ap 22JA $&Gs
#otal of 9 >(i5? $o+er $lugs >3 5 32 Ap $lugs per $&G?
220 20JAC
&ata Center 7eceptacle #ype * ;C306*2$3%*$ 32A 2<
>u''ell euivalent is -L33279%?
/2 3 Hi&h Bolta&e Three )hase )D"
8/18/2019 Exadata X4 Hardware Overview
34/70
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.3
/23 Hi&h Bolta&e Three )hase )D";8;A / A$AC >e5cluding Kapan/#ai+an?
2 >#+o? 106Ap 2JA $&Gs
#otal of >)our? $o+er $lugs >2 5 2
8/18/2019 Exadata X4 Hardware Overview
35/70
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.3<
%nfini*and $etwork
%nfini*and $etwork
8/18/2019 Exadata X4 Hardware Overview
36/70
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.39
%nfini*and $etwork Gnified nfini-and !et+or
(torage !et+or
7AC nterconnect
;5ternal Connectivity >optional?
igh $erforance, Lo+ Latency !et+or 40 :'/s 'and+idth per lin >0 :'/s each direction?
(A!*lie ;fficiency >Pero copy, 'uffer reservation?
(iple anagea'ility lie $ net+or
$rotocols Pero*copy Pero*loss &atagra $rotocol >P&$ 7&(v3?
Lo+ C$G overhead >#ransfer 3 :-/s +ith 2@ C$G usage?
nternet $rotocol over nfini-and >$o-?
Loos lie noral ;thernet to host soft+are >tcp/ip, udp, http, s
%nfini*and $etwork
8/18/2019 Exadata X4 Hardware Overview
37/70
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.3"
%nfini*and $etwork Gses (un &atacenter 39*port 8anaged D&7 >0:'/s? nfini
7uns su'net anager and autoatically discovers net+or topology
Only one su'net anager active at a tie
2 EleafF s+itches to connect individual server - ports 1 EspineF s+itch needed in each rac to scale out to additional 7acs
&ata'ase (erver and ;5adata (ervers ;ach server has &ual*port D&7 >0:'/s? - CA >3*4 data'ase serv
D&7 ;5press odules ?
Active*Active -onding Assign t+o $ addresses per dual*port CA for
and *2 storage servers 3*4 &ata'ase servers continue +ith Active*$assive as it is still $C
Connect one port fro the CA to one leaf s+itch and the other port to s+itch for redundancy
Connections pre*+ired in the )actory
/0 1 #ull (ack Server to +eaf Switch
8/18/2019 Exadata X4 Hardware Overview
38/70
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.34
/01 #ull (ack ? Server to +eaf Switch
B ;ach (erver C'oth leaf s+itche
B )ull -and+idthfails
B Connections pre
B alf, Duarter, afollo+ sae ca'le5cept they have
DB Servers (1,2,3,4)
Exadata Servers (1,2,..,7)
L1 L2
11
DB Servers (5,6,7,8)
Exadata Servers (8,9,..14)
DB Servers (5,6,7,8)
Exadata Servers (8,9,..,14)
DB Servers (1,2,3,4)
Exadata Servers (1,2,..,7)
11
11
11
$ort 1 $ort 1
$ort 2 $ort 2
Leaf s+itchLeaf s+itch 7
/2 3 #ull (ack Server to +eaf Switch
8/18/2019 Exadata X4 Hardware Overview
39/70
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.36
/23 #ull (ack ? Server to +eaf Switch
B ;ach (erver C'oth leaf s+itche
B )ull -and+idth fails
B Connections pre
DB Server1 (EM 1,2,3,4)
Exadata Servers (1,2,..,7)
L1 L2
11
DB Server2 (EM 1, 2, 3, 4)
Exadata Servers (8,9,..14)
DB Server2 (EM 1, 2, 3, 4)
Exadata Servers (8,9,..,14)
DB Server1 (EM 1,2,3,4)
Exadata Servers (1,2,..,7)
11
11
11
$ort 1 $ort 1
$ort 2 $ort 2
Leaf s+itchLeaf s+itch 7
Stora&e Expansion (ack? Server to +e
8/18/2019 Exadata X4 Hardware Overview
40/70
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.0
Stora&e Expansion (ack? Server to +e
B ;ach (erver C'oth leaf s+itche
B Active R $assiv'et+een leaf s+it
B )ull -and+idth fails
B Connections pre
B alf and Duarterac follo+ saeethodology e5cfe+er servers
Exadata Servers (1,2,..,9)
L1 L2
9
Exadata Servers (10,11,..18)
Exadata Servers (10,11,.,18)
Exadata Servers (1,2,..,9)
9
9
9
$ort 1 $ort 1
$ort 2 $ort 2
Leaf s+itchLeaf s+itch 7
Multirack cablin&
8/18/2019 Exadata X4 Hardware Overview
41/70
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.1
Multirack cablin&
!eed to purchase - spine s+itches >;5pansion (+itch Hconnecting *2 and 3*4 racs
;5cept for uarter rac in ost cases
!eed to purchase - ca'les as spares its no longer cont
ca'les
(ae ulti*rac ca'ling ethodology as 'efore (ae fat*tree topology to connect ultiple racs
Can no+ connect ore than 2 Dtr racs 'y siply purchasin
s+itches for the Duarter racs
Multirack 5ablin& ? #at Tree Topolo&'
8/18/2019 Exadata X4 Hardware Overview
42/70
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.2
Multirack 5ablin& ? #at Tree Topolo&'
(ingle nfini-and !et+or
(+itch to a E)at #reeF #opology
Jalid up to 14 7acs +ith no e5ternal s+itches Can go to 39 racs +ith 2 e5ternal s+itches
;very EleafF s+itch inter*connected +ith every EspineF s+itc
ELeafF s+itches not connected +ith other EleafF s+itches
E(pineF s+itches not connected +ith other EspineF s+itches
&ata'ase and ;5adata (erver ca'ling unchanged. nter*rac ca'ling done at installation tie
7efer to the &ata'ase 8achine O+nerSs :uide for e5act appings
Two (ack 5ase ? #at Tree Topolo&'
8/18/2019 Exadata X4 Hardware Overview
43/70
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.3
p &'
L1L2
L1
( (
Rack 1 Rack 2
4
4
44 4
4
4
B nstall (pine (+itch in each rac, if no spine s+itch e5istsB 7eove inter*s+itch lins 'et+een leaf s+itches >L1,L2? in eB Connect each leaf s+itch to 'oth the spine s+itches > lins
Multiple (ack 5ase ? "p to 3 (acks
8/18/2019 Exadata X4 Hardware Overview
44/70
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
Multiple (ack 5ase "p to 3 (acks
RackRack 1
!
Q
L1L2
(
Rack 2
L1L2
(
L1
(
B nstall (pine (+itch in each rac, if no spine s+itch e5istsB 7eove inter*s+itch lins 'et+een leaf s+itches >L1,L2? in each raB &istri'ute 4 lins fro every EleafF s+itch to every EspineF s+itch
B ;5aple rac case 2 lins fro each leaf to each spine
Multiple (ack 5ase ? ; to @3 (acks
8/18/2019 Exadata X4 Hardware Overview
45/70
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.<
Multiple (ack 5ase ; to @3 (acks
RackRack 1
!Q
L1L2
(
Rack 8
L1L2
(
L1
B nstall (pine (+itch in 1st eight racs, if no spine s+itch e5istsB 7eove inter*s+itch lins 'et+een leaf s+itches >L1,L2? in each raB &istri'ute 4 lins fro every EleafF s+itch to EspineF s+itch in 1st 4 r
Q
Scalin& Out to 2: (acks
8/18/2019 Exadata X4 Hardware Overview
46/70
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.9
Scalin& Out to 2: (acks (ingle nfini-and !et+or
7euire 2 Ee5ternal spineF 39*port nfini-and s+itches
Add another level to the )at #ree topology
&ivide 7acs into groups each having 2*4 racs
:roup related racs together for e5aple, racs that run a codata'ase or are part of a coon cluster
nter*connect racs +ithin each group using the t+o level )at #
nter*connect the groups via the t+o Ee5ternal spineF s+itche
Connect each Einternal spineF s+itch in each rac to the t+o Ees+itches
-and+idth fro/to each group is 40 :'/s T nu'er of racs
Can 'e done online
Multiple (ack 5ase ? ; to 2: (acks
8/18/2019 Exadata X4 Hardware Overview
47/70
Copyright © 2013, Oracle and/or its affiliates. All rights reserved."
Multiple (ack 5ase ; to 2: (acks
"r#$% (2 t# 8 "r#$% 1 (2 t# 8 racks)
!
!!
;5ternal (pine s+itches
%nterconnectin& .uarter (acks
8/18/2019 Exadata X4 Hardware Overview
48/70
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.4
%nter connectin& .uarter (acks Allo+ liited situations +here a Duarter 7ac can 'e inter*
+ith other rac +ithout reuiring a spine s+itch in the Duar
Case 1 * Connect t+o Duarter 7acs
B #he pre*reuisite is that at least ports reserved for e5ternaare open on each leaf s+itch
Case 2 Connect one Duarter 7ac +ith one other alf o
B #he pre*reuisite is that at least ports reserved for e5ternaare open on each leaf s+itch
Case 3 Connect one Duarter 7ac to t+o or ore racs are either ;5adata alf or )ull 7acs?
5ase @ ? Two .uarter (acks
8/18/2019 Exadata X4 Hardware Overview
49/70
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.6
.
nter*connect the leaf s+itches 'et+een racs +ith 2 lins ea
B Gse the ports reserved for e5ternal connectivity
L1
L2
L1
L2
&$arter Rack 1 &$arter Rac
7 7
2
2
2 2
5ase 1 ?.uarter (ack with One Half or
8/18/2019 Exadata X4 Hardware Overview
50/70
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
8/18/2019 Exadata X4 Hardware Overview
51/70
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
8/18/2019 Exadata X4 Hardware Overview
52/70
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
8/18/2019 Exadata X4 Hardware Overview
53/70
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
8/18/2019 Exadata X4 Hardware Overview
54/70
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
8/18/2019 Exadata X4 Hardware Overview
55/70
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.i.e connecting s+it
the sae rac?
ust 'e opti
Any ulti*rac involving or ore racs +ill definitely reuire
longer optical ca'les
10 ca'les typically sufficient if inter*connecting up to 4 phys
racs in the sae aisle +ith raised floor
%hen in dou't easureY
Sourcin& cables for multirack situatio
8/18/2019 Exadata X4 Hardware Overview
56/70
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.copper? 2121A*optical? "1024"0 \es, >2 5
optical? "102 5
!ote * \ou need 2 D()$ (7 transceivers >212A*!? for each optic
%nfini*and $etwork !ddresses
8/18/2019 Exadata X4 Hardware Overview
57/70
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
8/18/2019 Exadata X4 Hardware Overview
58/70
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
8/18/2019 Exadata X4 Hardware Overview
59/70
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
8/18/2019 Exadata X4 Hardware Overview
60/70
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.90
8anageent net+or
1 port fro EAdinF ;thernet s+itch
2 fro the $&Gs
&ata'ase / Client / Application Access
!eed to connect a iniu of 1 :'; or 1 10:'; port per &a
*2 &ata'ase (erver
3 5 1:'; / 10 :'; -ase*# ;thernet ports availa'le
2 5 10:'; ;thernet ()$= ports availa'le 3*4 &ata'ase (erver
" 5 1:'; ;thernet ports availa'le
4 5 10:'; ;thernet ()$= ports availa'le
!dditional Ethernet $etwork (euirem
8/18/2019 Exadata X4 Hardware Overview
61/70
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.91
Additional ;thernet $ addresses needed if ultiple cluste
deployed on the &ata'ase 8achine )ull 7ac, alf 7ac,
7ac 3 $ addresses per additional cluster for (CA! addresses
(tatic $ addressing only >no &C$?
All ;thernet $ addresses ust 'e registered in &!(
Ethernet $etwork !ddresses *2 3*4 (torage
8/18/2019 Exadata X4 Hardware Overview
62/70
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.92
g
)ull alf Dtr ;ighth )ull )ull
LO8 for &ata'ase (ervers 4 2 2 2 *
LO8 for ;5adata Cells 1 " 3 3 1 14
;th0 >gt? for &- (ervers 4 2 2 2 *
;th0 >gt? for ;5adata Cells 1 " 3 3 1 14
8gt port for - s+itches 2 2 2 2 3 3
$ address for ;thernet (+itch 1 1 1 1 1 1
$ address for $&Gs 2 2 2 2 2 2
M&mt Subnet Total 0; 1< @9 @9 23 01
Client Access &ata'ase (ervers 4 2 2 2 *
J$s for &ata'ase (ervers 4 2 2 2 *
(CA! Addresses >per Cluster? 3 3 3 3 3 *
5lient !ccess Total @; @@ < < <
Total :3 23 11 11 09 01
Exadata Database Machine
8/18/2019 Exadata X4 Hardware Overview
63/70
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.93
The ultimate platform for all database w
OL#$, %arehousing, &ata'ase as a (ervic
Most advanced hardware
)ully scale*out servers and intelligent stora
nfini-and connectivity and $C flash
Most advanced software
&ata'ase optiied copute, storage, andalgoriths draatically iprove perforan
Standardized, optimized, hardened end
8/18/2019 Exadata X4 Hardware Overview
64/70
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.9
8/18/2019 Exadata X4 Hardware Overview
65/70
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.9<
Exadata Database Machine /01 Half ($re*Configured for ;5tree $erforance
8/18/2019 Exadata X4 Hardware Overview
66/70
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.99
$re*Configured for ;5tree $erforance
B eon*'ased &ual*processor &ata'ase (ervers 69 cores >2 per server?
102 :- eory e5panda'le to 204 :- >2< per server?
B 22. #- igh (peed )lashB " ;5adata (torage (ervers *2
All +ith igh $erforance 12 5 1.2 #- (A( diss
O7 All +ith igh Capacity 12 5 #- (A( diss
B 2 (un &atacenter nfini-and (+itch 39 39*port 8anaged D&7 >0:'/s? s+itch
B 1 EAdinF ;thernet s+itchB 7edundant $o+er &istri'utions Gnits >$&Gs?
"p&radable to #ull (ack
Exadata Database Machine /01 .uarte$re*Configured for ;5tree $erforance
8/18/2019 Exadata X4 Hardware Overview
67/70
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.9"
$re Configured for ;5tree $erforance
B 2 eon*'ased &ual*processor &ata'ase (ervers 4 cores >2 per server?
8/18/2019 Exadata X4 Hardware Overview
68/70
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.94
t y e e Co gu at o
B 2 eon*'ased &ual*processor &ata'ase (ervers 2 cores >12 per server?
8/18/2019 Exadata X4 Hardware Overview
69/70
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.96
)or additional storage 'acups, historical data, unstructu
Gpgrada'le to )ull 7ac
6 ;5adata (torage (ervers *2
All +ith igh $erforance 12 5 1.2 #- (A(
dissO7
All +ith igh Capacity 12 5#- (A( diss
24.4 #- igh (peed )lash
3 (un &atacenter nfini-and (+itch 39
39*port 8anaged D&7 >0:'/s? s+itch
1 EAdinF ;thernet s+itch
7edundant $o+er &istri'utions Gnits >$&Gs?
Exadata Stora&e Expansion /01 .uart)or additional storage 'acups, historical data, unstructu
8/18/2019 Exadata X4 Hardware Overview
70/70
Copyright © 2013, Oracle and/or its affiliates. All rights reserved."0
)or additional storage 'acups, historical data, unstructu
Gpgrada'le to Duarter 7ac
;5adata (torage (ervers *2
All +ith igh $erforance 12 5 91.2 #- (A( diss
O7 All +ith igh Capacity 12 5 #- (A( diss
12.4 #- igh (peed )lash
2 (un &atacenter nfini-and (+itch 39
39*port 8anaged D&7 >0:'/s? s+itch
1 EAdinF ;thernet s+itch 7edundant $o+er &istri'utions Gnits >$&Gs?
Top Related