Configuring MPIO for the Virtual AIX Client

7
Configuring MPIO for the virtual AIX client This document describes the procedure to set up Multi-Path I/O on the AIX clients of the virtual I/O server. Procedure: This procedure assumes that the disks are already allocated to both the VIO servers involved in this configuration.  Creating Virtual Server and Client SCSI Adapters First of all, via HMC create SCSI server adapters on the two VIO servers and then two virtual client SCSI adapters on the newly created client partition, each mapping to one of the VIO servers´ server SCSI adapter.  A  A  n  ne e  x  x  a  a  m  m  p  pl l e e: :  Here is an example of configuring and exporting an ESS LUN from both the VIO servers to a client partition:  Selecting the disk to export You can check for the ESS LUN that you are going to use for MPIO by running the following command on the VIO servers. O On nt t h he e f  f i ir r st t V V  I  I O s se er r v ver r :   $  $ l l  s  s  d  d ev v -  t  t  y  y  p  pe d  d i i  s  s  k  k name status description .. hdisk3 Available MPIO Other FC SCSI Disk Drive hdisk4 Available MPIO Other FC SCSI Disk Drive hdisk5 Available MPIO Other FC SCSI Disk Drive ..  $  $l l  s  s  p  pv v .. hdisk3 00c3e35c99c0a332 None hdisk4 00c3e35c99c0a51c None hdisk5 00c3e35ca560f919 None .. In this case hdisk5 is the ESS disk that we are going to use for MPIO.

Transcript of Configuring MPIO for the Virtual AIX Client

8/8/2019 Configuring MPIO for the Virtual AIX Client

http://slidepdf.com/reader/full/configuring-mpio-for-the-virtual-aix-client 1/7

Configuring MPIO for the virtual AIX client

This document describes the procedure to set up Multi-Path I/O on the AIX clients of the virtual I/O server.

Procedure:

This procedure assumes that the disks are already allocated to both the VIO serversinvolved in this configuration.

•  Creating Virtual Server and Client SCSI Adapters

First of all, via HMC create SCSI server adapters on the two VIO servers andthen two virtual client SCSI adapters on the newly created client partition, eachmapping to one of the VIO servers´ server SCSI adapter.

 A A n n ee x x a a m m p pl l ee:: 

Here is an example of configuring and exporting an ESS LUN from both theVIO servers to a client partition:

• Selecting the disk to export

You can check for the ESS LUN that you are going to use for MPIO byrunning the following command on the VIO servers.

OOnn t t hhee f  f iir r sst t V V  I  I OO sseer r vveer r :: 

 $ $ l l  s s d  d eevv -- t t y y p pee d  d ii s s k k 

name status description

..

hdisk3 Available MPIO Other FC SCSI Disk Drivehdisk4 Available MPIO Other FC SCSI Disk Drivehdisk5 Available MPIO Other FC SCSI Disk Drive..

 $ $l l  s s p pvv ..hdisk3 00c3e35c99c0a332 Nonehdisk4 00c3e35c99c0a51c Nonehdisk5 00c3e35ca560f919 None..

In this case hdisk5 is the ESS disk that we are going to use for MPIO.

8/8/2019 Configuring MPIO for the Virtual AIX Client

http://slidepdf.com/reader/full/configuring-mpio-for-the-virtual-aix-client 2/7

 

Then run the following command to list the attributes of the disk that you choose for MPIO:

 $ $l l  s s d  d eevv -- d  d eevv h h d  d ii s s k k 5 5 -- a a t t t t r r 

..algorithm fail_over Algorithm True..lun_id 0x5463000000000000 Logical Unit Number ID False....pvid 00c3e35ca560f9190000000000000000 Physical volume identifierFalse..reserve_policy single_path Reserve Policy True

Note down the lun_id, pvid and the reserve_policy of the hdisk4.

• Command to change reservation policy on the disk

You see that the reserve policy is set to single_path.

Change this to no_reserve by running the following command:

 $ $ c c h h d  d eevv -- d  d eevv h h d  d ii s s k k 5 5 -- a a t t t t r r r ree s see r rvvee__ p p o ol l ii c c y y== n n o o__ r ree s see r rvvee hdisk4 changed

OOnn t t hhee sseeccoonnd d V V  I  I OO sseer r vveer r :: 

On the second VIO server too, find the hdisk# that has the same pvid, it couldbe a different one than the one on the first VIO server, but the pvid should thesame.

$$ llssppvv ..hdisk7 00c3e35ca560f919 None..

The pvid of the hdisk7 is the same as the hdisk5 on the first VIO server.

$$ llssddeevv --ttyyppee ddiissk k  name status description

..hdisk7 Available MPIO Other FC SCSI Disk Drive..

8/8/2019 Configuring MPIO for the Virtual AIX Client

http://slidepdf.com/reader/full/configuring-mpio-for-the-virtual-aix-client 3/7

$$llssddeevv --ddeevv hhddiissk k 77 --aattttrr ..algorithm fail_over Algorithm True..lun_id 0x5463000000000000 Logical Unit Number ID False

..pvid 00c3e35ca560f9190000000000000000 Physical volume identifierFalse..reserve_policy single_path Reserve Policy True

You will note that the lun_id, pvid of the hdisk7 on this server are the same asthe hdisk4 on the first VIO server.

$$ cchhddeevv --ddeevv hhddiissk k 77 --aattttrr rreesseerrvvee__ppoolliiccyy==nnoo__rreesseerrvvee hdisk6 changed

• Creating the Virtual Target Device

Now on both the VIO servers run the mkvdev command using the appropriatehdisk#s respectively.

$$ mmk k vvddeevv --vvddeevv hhddiissk k ## --vvaaddaapptteerr vvhhoosstt## --ddeevv vvhhddiissk k ## 

The above command might have failed when run on the second VIO server, if the reserve_policy was not set to no_reserve on the hdisk.

After the above command runs succesfully on both the servers, we have

same LUN exported to the client with mkvdev command on both servers.

• Check for correct mapping between the server and the client

Double check the client via the HMC that the correct slot numbers match therespective slot numbers on the servers.

In the example, the slot number 4 for the client virtual scsi adapter maps toslot number 5 of the VIO server VIO1_nimtb158.

8/8/2019 Configuring MPIO for the Virtual AIX Client

http://slidepdf.com/reader/full/configuring-mpio-for-the-virtual-aix-client 4/7

 

And the slot number 5 for the client virtual SCSI adapter maps to the slotnumber 5 of the VIO server VIO1_nimtb159.

8/8/2019 Configuring MPIO for the Virtual AIX Client

http://slidepdf.com/reader/full/configuring-mpio-for-the-virtual-aix-client 5/7

•  On the client partition

Now you are ready to install the client. You can install the client using any of the following methods described in the red book on virtualization at

http://www.redbooks.ibm.com/redpieces/abstracts/sg247940.html:

1.  NIM installation2.  Alternate disk installation3.  using the CD media

Once you install the client, run the following commands to check for MPIO:

 #  # l l  s s d  d eevv --C C  c c d  d ii s s k k hdisk0 Available Virtual SCSI Disk Drive

 #  # l l  s s p pvv 

hdisk0 00c3e35ca560f919 rootvg active

 #  # l l  s s p p a a t t h h Enabled hdisk0 vscsi0Enabled hdisk0 vscsi1

•  Dual Path

When one of the VIO servers goes down, the path coming from that servershows as failed with the lspath command.

 #  # l l  s s p p a a t t h h Failed hdisk0 vscsi0Enabled hdisk0 vscsi1

•  Path Failure Detection

The path shows up in the "failed" mode, even after the VIO server is upagain. We need to either change the status with the “chpath” command to“enabled” state or set the the attributes “hcheck_interval” and “hcheck_mode” to“60” and “nonactive” respectively for a path failure to be detected automatically.

• Setting the related attributes

Here is the command to be run for setting the above attributes on the clientpartition:

$ chdev -l hdisk# -a hcheck_interval=60 –a hcheck_mode=nonactive -P

8/8/2019 Configuring MPIO for the Virtual AIX Client

http://slidepdf.com/reader/full/configuring-mpio-for-the-virtual-aix-client 6/7

The VIO AIX client needs to be rebooted for hcheck_interval attribute to takeeffect.

•  EMC for Storage

In case of using EMC device as the storage device attached to VIO server,then make sure of the following:

1. Powerpath version 4.4. is installed on the VIO servers.2. Create hdiskpower devices which are shared between both the VIOservers.

•  Additional Information

Another thing to take note of is that you cannot have the same name forVirtual SCSI Server Adapter and Virtual Target Device. The mkvdev commandwill error out if the same name for both is used.

 $ $ m m k kvv d  d eevv --vv d  d eevv h h d  d ii s s k k p p o owwee r r00 --vv a a d  d  a a p p t tee r r vv h h o o s s t t00 -- d  d eevv h h d  d ii s s k k p p o owwee r r00 

Method error (/usr/lib/methods/define -g -d):0514-013 Logical name is required.

The reserve attribute is named differently for an EMC device than the attributefor ESS or FasTt storage device. It is “reserve_lock”.

Run the following command as padmin for checking the value of theattribute.

 $ $ l l  s s d  d eevv -- d  d eevv h h d  d ii s s k k p p o owwee r r #  # -- a a t t t t r r r ree s see r rvvee__l l  o o c c k k 

Run the following command as padmin for changing the value of the attribute.

 $ $ c c h h d  d eevv -- d  d eevv h h d  d ii s s k k p p o owwee r r #  # -- a a t t t t r r r ree s see r rvvee__l l  o o c c k k== n n o o 

•  Commands to change the Fibre Channel Adapter attributes

And also change the following attributes of the fscsi#, fc_err_recov to “fast_fail”and dyntrk to “yes”

 $ $ c c h h d  d eevv -- d  d eevv f  f  s s c c s sii #  # -- a a t t t t r r f  f  c c__ee r r r r__ r ree c c o ovv== f  f  a a s s t t__ f  f  a aiil l d  d  y y n n t t r r k k== y yee s s – – p pee r r m m 

The reason for changing the fc_err_recov to “fast_fail” is that if the FibreChannel adapter driver detects a link event such as a lost link between a storagedevice and a switch, then any new I/O or future retries of the failed I/Os will befailed immediately by the adapter until the adapter driver detects that the devicehas rejoined the fabric. The default setting for this attribute is 'delayed_fail’.

8/8/2019 Configuring MPIO for the Virtual AIX Client

http://slidepdf.com/reader/full/configuring-mpio-for-the-virtual-aix-client 7/7

Setting the dyntrk attribute to “yes” makes AIX tolerate cabling changes in theSAN.

The VIOS needs to be rebooted for fscsi# attributes to take effect.