How I Built Two Failover VIO Servers

8/12/2019 How I Built Two Failover VIO Servers

1/53

HowtocreatetwoVIO

Serversand

two

Client

withfailover

Author:SiddharthaSSinha

Rev:1.0

Checkmywebsitewww.sinhass.comformoretechnicalstuffs.

Publishing without permission is prohibited

This document is created by Siddhartha Sinha


2/53

TestScenario:

TwoVIO

servers

will

have

these

physical

resources

4GBofmemory,

2CPU(uncappedwithweightof128)

20virtualprocessors

1quadportGigabitEthernetadapter(Networkcableonlyonport0)

FewSASadapterwithlocaldisks

TwoVIOClientswillhavethesephysicalresources

4GBofmemory

4

CPU

VirtualdiskwillbeprovidedbylogicalvolumecreatedineachVIOServer.I

willcreateoneseparateVolumeGroupforthispurposeineachVIOServer.

VGNamewillbeclientsrootvgand lvnameswillbetest1rootlv&test2rootlv

InbothVIOServer

WewillloadthebothVIOserversandtwotestVIOCLPARsfromaNIMServer.




3/53

Oncecompletedtestvio1willlooklikethis

testvio2willlooklikethis

test1lparwilllooklikethis




4/53

andtest2lparwilllooklikethis

Nowwehavetheplansowewillbuildthetestvio1servernow.

STEPSTOBUILDTESTVIO1SERVERIntheHMCIwillclickonthe+signbesideSystemsManagementthenagainI

willclickonServersandthenServerName.Nextscreenwillbelikethis.NowI

willexpandConfiguration>CreateLogicalPartition>VIOServer




5/53

IwilltypemyfirstvioPartitionnameastestvio1,leavethepartitionid2alone

andIwillclickNext.

NextIselectedSharedprocessor.ThisServerhas48CPUbutIwanted totry

SharedCPUstuffssoIdecidedtouseit.AndIwillclickNextnow.




6/53

Here I selected 2 minimum, 4 desired and 6 maximum. Then I selected

minimum 20 virtual Processor (1 CPU=10 Virtual CPU), 40 Desired and 60

Maximum. AndIcheckedtheuncappedWeight128.0,littleBittoomuch.Now

Iwillclicknext

Next screen I will straight select absolute 4GB memory requirement. So my

minimum,DesiredandMaximumMemory requirement is4GB.Nothingmore

orless.

Iwill

click

on

the

Next

button

once

Iam

done.




7/53

Ok,IwillselectthePhysicalI/OswhateverIplannedbeforeforthisServer.And

then

I

will

click

on

that

little

Add

as

required

button

before

I

click

on

next.

If

I

forgettoclickonAddasrequired Iwillhaveno I/Oatalland Iwillhave to

comebackand dothisagain.AsIdidsoIwillclickonNextButton.




8/53

Now I always like to add more numbers so I will bump Maximum Virtual

Adaptersto50. 20wouldbesufficientbutIamplanningtocreatesomemore

VIOCLparsto dosomemoretestafterthisfailovertest.




9/53

IjustclickedNextbuttonhereas Iamnotgoing touseanyof theseLogical

HostEthernetAdaptersformytest.

Samethinghere.IwilljustclickonNext.




10/53

IwillnotchangeanythinghereasIwantNormalModeasdefault.

Looksgoodtome.SoIwillclicktheFinishButton.




11/53

NowIamgoingtoactivateit.




12/53

But I want it to boot to SMS Mode for this session so that I can go and

configuretheNetworkto loadfrommyNIMServerand Iwant theconsole to

beopenedsametimeItisactivated.SoIcheckedOpenaTerminalwindowor

consolesessionandthenIwillclickonAdvancedButton.

NowitopenedanotherwindowsandIwillselectSMSandwillclickOK.




13/53

Now itwillopen the consoleand Iwill setup the interface toboot frommy

NIMServer.InthemeantimeIwillgotomyNIMserverandstageNIMImages

forthisServer.Thisisthe screenshotfrommyNIMServer. SoInstallationtype

ismksysbandmakesysbnameIgaveforthisImageasVIOS2_2_mksysb.AlsoI

needaspot

so

Icreated

one

and

named

it

as

vios_v2_2_spot

and

Icreated

lpp_source to for this VIO Image as well as all the VIO images we have. I

createdthe lpp_sourcetocoveranymissingdriver. Iwillcoverallthosesteps

some other time. Also I have a Customization Script which basically copies

extra drivers, softwares,my scripts etc to the client. Then twoother files,

BOSINST_DATA which I named as No_Prompt picks up some stuffs

automatically so that I dont have to wait for selecting disks etc And then

CustomizationFBscriptInstall_Driversactuallyinstallallsdd/sddpcmdevices

basedon theAIX versionanddoes lotofother stuffsautomatically so that I

donthave

to

be

worry

about

anything

missing.

AnywayIalreadycamebackandstartedtestvio1servertobootfromnetwork

andhereisthescreenshot




14/53

Now I can see how and why I needed that lpp_source. ThisVIO 2.2 version

doesmissingsomesoftwareordriversrequiredforthisMMB (latestPower7)

Serveranditisloadingthemnow.

NowIwillgoandbuildtestvio2samewayIdidtestvio1and load itfromNIM

Server.NowbothofmyVIOServersbuilt.Iamgoingtologinaspadminand it

willaskmetoChangethepassword.SoIwillchangeit.




15/53

FirstthingafterloggingintobothVIOserversIwilldoisrunthiscommand

$licenseaccept

NextthingIwilldoistocreatebothof mytestlpars, test1lparandtest2lpar.

I will go to Configuration> Create Logical Partition and will click on AIX or

Linux.




16/53

Iwillnameisastest1lparandclickNextbutton

ProfilenameIwillselectasNormalandwillclicknext.




17/53

IamgoingtousededicatedProcessorforthis lparso IwillclickonDedicated

andthenIwillclickonNext.




18/53

Iwilltype4forallMinimum,DesiredandMaximumprocessorsandthenIwill

clickon Next.

IwilldosamethingforMemoryandclickonnext

AsalltheI/OswillbeprovidedbytheVIOServersIwillselectnothinghereand

willjustClickonNext.




19/53

Iwillbumpupthenos.ofMaximumvirtualadaptersfrom10to20andclickon

Next

IwillselectnothinghereandclickonNext.




20/53

IwillselectnothingheretooandclickonNext

IwontchangeanythinghereandwilljustclickonNext.




21/53

IwillverifyCPUandMemoryfromthescreenandwillclickonFinish

Hereismynewlpar.Iwillleaveitaloneand willbuildthenextonesameway.




22/53

Nowallofmylparsbuilt.

NowIwillselecttest1vio and changetheprofiletoadd the virtualadapters.I

will select The lpar and click on Manage Profiles under Configuration

menu.




23/53

NowIwillclickonNormal.

Sometimes for theolderservers Ihad toclickon thecheckBoxunderSelect

and then had to go toActionsButton and then Edit button to get into Next

screen. IwillclickonVirtualAdaptersButtonhere.




24/53

NowIaminVirtualAdapterscreen.IwillclickonActions buttonherethen

CreateVirtualAdapterandthenEthernetAdapter




25/53

HereIwillchangeVirtualAdapterIDto10,IwillleaveVLANIDto1Iwillcheck

theboxForThisadapter is required forpartitionactivationAnd Iwillselect

checkbox for Accessexternalnetwork and Iwill leave Trunkpriority to1. I

amnotselectingIEEE802.1qcompatibleadapterforthistest. Iwouldselect

thatif

Ihad

few

CISCO

tagged

VLANS.

After

making

all

the

necessary

changes

IwillclickOK.

Iwilldoagaindothesameagainfornextadapter

ActionsCreateVirtualAdapterEthernetAdapter

AndthistimeIwillselectAdapterIDas11andVLAN99andnothingelse.This

willbeusedasControlChannelVirtualEthernet.




26/53

Now I will add the Virtual SCSI Adapters. So ActionsCreate Virtual

AdapterSCSIAdapter

ThenIwilluse20forVirtualSCSIAdapter.Iwillclickon thecheckboxforThis

Adapter is Required for partition activation and then I will select Only

selectedclient

partition

can

connect

and

from

the

drop

down

menu

Iwill

selecttest1lpar(4)andthenIwilltypeClientAdapterID15andthenIwillclick

OKbutton.




27/53

Now IwilladdanotherVirtualSCSIadapterusingthesamemethod.Thistime

Iwill use Virtual SCSIAdapter ID 21 Iwill clickon the checkboxon This

adapter is required for partition activation and Then I will click on Only

selected client partition can connect and from the drop down menu I will

selecttest2lpar(5)

and

then

Iwill

type

Client

Adapter

ID

15

and

then

Iwill

click

OKbutton.Finalscreen lookslikethis.

NowIwillclickOK,andthenIwillshutdowntestvio1lpar.

$shutdownforce

OncethislparisdownIwillreactivateitfromHMC.

Now Iwillselect testvio2andwilldo thesamething.For1stVirtualEthernet

adapterid

Iwill

use

12,

VLAN

ID

1,

Iwill

check

on

This

adapter

is

required

for

partition activation. Iwill also select This adapter isRequired forpartition

activationcheck box.Andmostimportantfor thisboxisTrunkPriority will

be2




28/53

Next adapter ID will be 13, VLAN ID 99 and I will select This adapter is

requiredforpartitionactivation

NowIwilladdtheVirtualSCSIAdapters.Finalscreenwillbelikethis.




29/53

NowIwillshutdownthislpartestvio2

$shutdownforce

Andthen

Iwill

activate

it

from

HMC.

Now

Iwill

log

in

to

testvio1

using

padmin

idandpasswordIsetbeforeandwillrunthiscommand

$lsdevvirtual

SoIgotent4and ent5asvirtualEthernetandvhost0andvhost1asvirtualscsi

adapterNow

Iwill

create

shared

Ethernet

adapter

using

ent4

and

ent5.

But

before that Ihavetoremoveexisting IPaddressas I installedthisserverfrom

NIMServer.TodothatIwillrun

rmtcpipallandselectyandenter.




30/53


31/53

$lsvglvclientsrootvg

NowIwillstartstartassigningtheselvstotheassociatedvhosts.

$lsdevslots#Slot Description Device(s)

U9117.MMB.102DB3FV2C0 VirtualI/OSlot vsa0

U9117.MMB.102DB3FV2C10 VirtualI/OSlot ent4

U9117.MMB.102DB3FV2C20 VirtualI/OSlot vhost0

U9117.MMB.102DB3FV2C21 VirtualI/OSlot vhost1

Vhost0isonslot20andwewillusethatfortest1lparandvhost1isonslot21

andweassociatedthattotest2lpar.Nowwewillrunthefollowingcommands

$mkvdevvdevtest1lparrootlvvadaptervhost0devtest1lparroottest1lparrootAvailable

$mkvdevvdevtest2lparrootlvvadaptervhost1devtest2lparroottest2lparrootAvailable

Iwill

verify

what

Idid

on

vhost0




32/53

Nowonvhost1

Now Iwillgoback totestvio2anddothesamethingstherebefore Istartthe

clientlpars.NowIwilladdtheVirtualAdapterstotest1lpar1andtest2lpar




33/53

Iwilladd theVirtual Ethernetand bothvirtual scsiadaptersusing the same

methodIdidforVIOServers.VirtualEthernetAdapterIdidasbelow

For the 1st Virtual SCSI Adapters I did as below whichwill be connected to

testvio1




34/53

For the2nd VirtualSCSIAdapters Ididasbelowwhichwillbeconnected totestvio2

Finalsettingwilllooklikethis.




35/53

Samethingfortest2lpar.SettingsbelowforEthernet

Andfor1stVirtualSCSIAdapterconnectedtotestvio1




36/53

HereiswhatIdidforthe2ndVirtualSCSIAdapterconnectedtotestvio2

NowbothofmyVIOC Lparsbuilt. Iwill load them fromNIMServer.Now to

makethingseasierforme Iusedhdisk0 forboth test1lparand test2lparfrom

testvio1Server.LaterIwillmirrorthemwithhdisk1whichcomesfromtestvio2

server.NIM

load

completed

now

and

Iwill

log

in

to

the

console

for

test1lpar

as

rootandnopassword. Iwillchecktheconfiguration now

#lsdevCcdisk

#lscfgvplhdisk0

#lscfgvplhdisk1




37/53

Fromtestvio1server

Fromtestvio2




38/53

Backtotest1violparandIwillverifydisksizes

NowIwilllogintotest2lparandwilldothesame




39/53

Nowbacktotestvio1and

Nowontesvio2




40/53

Everythingislookinggood.Backtotest2lparandwillcheckthedisksizes

NextthingIwilldoIwillgobacktotest1lparandmirrortherootvg




41/53

SofirstIwillextendtherootvgtohdisk1

#extendvgfrootvghdisk1

#mirrorvgSm rootvghdisk1 ( This commandwill run in thebackground

andwilltakeawhile)Now Iwillgoback totest2lparand dothe samething.

Oncemirroring

completed

in

both

test1lpar

and

test2lpar

Iwill

change

the

bootlist

#bootlistmnormalhdisk0hdisk1

Now Iwill run bootlistmnormal ifbothentriesdoesnt lookexactly the

samethenIwillRunbosbootad /dev/hdisk1andrerunbootlistmnormal

Hopefully this time itwillbeOK.Now Iwill check the rootvg statusonboth

test1lpar

Nowontest2lpar




42/53

Iwillshutdownviotest1servernow.




43/53

WillverifyfromHMCScreen




44/53

Nowwewillseeiftheserversstillcanpingoutsideornot.




45/53

Sonetworkfailoverworking, serverisalsoup.NowIwillcheckwithlsvg

Iwillchecktest2lparnow




46/53

Nowlsvgontestvio2

Now,Iwillrebootbothtest1lparandtest2lpartocheckwhetheritcansurvive

arebootwhentest1viofailed.NowIwillcheckhowtest1lparlookslike.




47/53

Sohdisk0 isdefinedandnotavailableanymore.And itsurvivedarebootand

networkalsoworking.Nowtest2lpar

Thislpar

also

survived

areboot

though

hdisk0

not

available

and

network

also

working. So we know now that both ofmy VIOC lpars will work evenwhen

testvio1failed.NowIwillrunthesametesttocheckwhetherthesetwolpars

can survive a reboot when testvio2 fails. But before that I need to bring

testvio1 online, resync the mirror and then I will test. So I am activating

testvio1 now. Once testvio1 is up I will run cfgmgr on both test1lpar and

test2lparand rerunthosecommands




48/53

Looksgood,nowontest2lpar




49/53

Thisonealsolooksgood.NowIwillcheckthemirrorstatus.Needsresync

Samethingontest2lpar




50/53

I will resync them. hdisk0 may come as removed state. I will use chpv

commandtofixthatandthenIwillrunsyncvgrootvg.Test1lparissynced

test2lparissynced

NowIwillshutdowntestvio2




51/53

test1lparrootvgstalestatus




52/53

test2lparlvstalestatus




53/53

Networkstillup

FewmorestatusafterIrebootedtest1lpar


How I Built Two Failover VIO Servers

Documents

Transcript of How I Built Two Failover VIO Servers