Cheat Sheet

1. Useful links.........................................................2SAN Switch Configuration.........................................21.1. Brocade...........................................................21.1.1. Initial Setup.................................................21.1.2. Initial FOS Setup.........................................31.1.3. Zoning.........................................................31.2. Cisco...............................................................31.2.1. Useful Commands.......................................31.2.2. VSAN creation............................................41.2.3. Port configuration.......................................41.2.4. Port-Channel configuration.........................51.2.5. Alias creation..............................................51.2.6. Zone creation..............................................51.2.7. Loading Firmware.......................................51.2.8. Loading license...........................................51.2.9. FC ISL configuration..................................51.2.10. FCIP ISL configuration...............................61.3. McData............................................................72. EMC DMX..........................................................82.1. Generally useful commands............................82.2. mapfile lun modification.................................82.2.1. lun allocation...............................................82.2.2. lun unallocation...........................................92.3. Volume Logics................................................92.3.1. Setup...........................................................92.3.2. Verification.................................................92.4. Symacl...........................................................102.4.1. Symacl setup.............................................102.4.2. Symacl verification...................................102.5. SRDF.............................................................102.5.1. Syncronous Setup......................................102.5.2. SRDF-A Setup..........................................102.5.3. RDF Verification......................................123. EMC CX...........................................................124. HDS...................................................................124.1. AMS 1000.....................................................124.2. Array Setup...................................................124.3. Array Deployment (DPI)..............................124.4. USPv.............................................................134.4.1. Array installation......................................134.4.2. Array Configuration..................................135. Host Deployment..............................................135.1.1. Linux.........................................................135.1.2. Sun............................................................135.1.3. AIX HBA Replacement / failed path........156. Excel.................................................................156.1.1. Vlookup.....................................................156.1.2. Concatenate...............................................15

1. Useful links Livelink Approved Standards EMIS Standards and Best Practices Storage Support Matrix Shortcut to Array host settings

SAN Switch Configuration

1.1. Brocade 1.1.1. Initial Setup

timeout 60ipaddrset –cp 0ipaddrset –cp 1ipaddrset –sw 0ifmodeset eth0 (set to 100/full. Needs to be done on both CPs)switchname cdc1c001f01switchdisable

configure – yes to fabric param – set domain id – yes to insistent domain id – ctrl-d to endswitchenabletstimezone –interactive (select approp timezone)tstimezone America/New_Yorktsclockserver 169.86.40.180 (use ip address for time.amer.jpmchase.net)

syslogdipadd 169.81.16.48syslogdipadd 155.180.250.164syslogdipshow

auditcfg --class 1,2,3,4,5auditcfg --enableauditcfg --show

aaaconfig --add 204.27.45.69 -conf radius -p 1812 -s 2@\8ml245e"&"139 -a pap -t 20aaaconfig --add 204.27.45.5 -conf radius -p 1812 -s 2@\8ml245e"&"139 -a pap -t 20aaaConfig --authspec "radius;local"

fosconfig --disable iscsi

authutil --set -a dhchapbannerset *** IT IS AN OFFENSE TO CONTINUE WITHOUT THE CORRECT AUTHORIZATION ***

Individuals using this computer system with or without proper authority aresubject to having all of their activities monitored and recorded and shouldhave no expectation of privacy unless local law, regulation or contract provideotherwise.

Anyone using this system expressly consents to such monitoring andto all appropriate disclosure of any evidence of criminal activity to lawenforcement officials, as well as appropriate disclosure of any evidence ofviolation of the firm's rules policies procedures or standards of conduct tomanagement.

Individuals using this computer system have a legal obligation totreat all information on the system as strictly confidential and not todisclose or allow such information to be disclosed to any third party.

This obligation survives any termination of employment with JPMorganChase.Using keyboard-interactive authentication..secauthsecret --setlocal and remote key is Br0c@d3ssecauthsecret --show

1.1.2. Initial FOS Setup For a new fabric, configure on Core 1

fabricprincipal -f 1secpolicycreate "FCS_POLICY", "1;100;102;200"secpolicysavesecpolicyactivatedistribute -p "FCS" -d "*"secpolicydump

secauthsecret --setsecauthsecret --show

authutil --policy -sw ONdistribute -p "AUTH" -d "*"secpolicycreate "SCC_POLICY", "*"secpolicysavesecpolicyactivate

fddcfg --fabwideset "SCC:S;FCS"

firmwaredownload – use firmwaredownloadstatus to monitor Type of Firmware: Select FOS (should be default option) Server Name of IP Address: Enter FTP/SCP Server name or IP Address Network Protocol Enter 1 for Auto Select, 2 for FTP or 3 for SCP User Name Enter FTP User name File Name Enter Firmware File name & Path (Ex. ./v6.0.0c or ./v6.0.0c/release.plist) Password Enter FTP Server Password

TO BE DONE AFTER IRC review and prior to production.snmpconfig --set mibcapability snmpconfig --set accesscontrol

defzone --noaccess

1.1.3. Zoning cfgtransshowalicreate "emc21262fa9bbaix", "50060482cc198bb8"alicreate "cdcbet11fcs", "10000000c93fa01e"cfgsavezonecreate "cdcbet11fcs_emc21262fa9bbaix", "cdcbet11fcs; emc21262fa9bbaix"zoneadd "cdcbet11fcs_emc21262fa9bbaix", " emc21262fa11bbaix; emc21262fa10bbaix"cfgadd "cdc2_fab2", "cdcbet11fcs_emc21262fa9bbaix"cfgsavecfgenable "cdc2_fab2"

1.2. Cisco ******NOTE: Always cut zoneset name from show zoneset active vsan xxx output *****1.2.1. Useful Commands

sh port internal info interface fc2/2 – shows part and sn of SFP along with a ton of other stuff sh interface |inc "long wave" p 1 – lists all long wave ports in the switch copy run tftp://10.31.186.50/switchname.cfg term len 0 – this command will allow you to issue a command and have it run w/ having to hit space bar.

Good for tech show collections. show port-resource module 4 – shows resources available by port group

-Checking Port indexescdc2rc01f01# sh port index-allocationModule index distribution:------------------------------------------------------+ Slot | Allowed | Allotted indices info | | range | Total | Index values | -----|-----------|--------|------------------------------| 1 | ----- | - | (None) | 2 | 0- 255| 24 | 0-23 | 3 | 0- 255| 24 | 32-55 | 4 | 0- 255| 24 | 64-87 | 5 | 0- 255| 24 | 192-215 | 6 | 0- 255| 24 | 224-247 | 9 | 0- 255| 24 | 160-183 |10 | 0- 255| 24 | 96-119 |11 | 0- 255| 32 | 128-159 |12 | 0- 255| 4 | 24-27 |13 | 0- 255| 4 | 28-31 |SUP | 253-255 | 3 | 253-255 |

cdc2rc01f01# sh module 1 recovery-stepsPlease insert module in slot 1 and retry

- Clearing a config lockcarrc01f01floor1# sh device-alias statusFabric Distribution: EnabledDatabase:- Device Aliases 967 Mode: BasicLocked By:- User "v005445" SWWN 20:00:00:0d:ec:3a:81:40

carrc01f01floor1# clear device-alias session

carrc01f01floor1# sh device-alias statusFabric Distribution: EnabledDatabase:- Device Aliases 967 Mode: Basic

sh ips stats hw-comp allsh fcip countersclear counters fcip xx

1.2.2. VSAN creation vsan databasevsan 100 name "vsan0100"exitzone mode enhanced vsan 100fcdomain priority 60 vsan 100 (set priority to same as domain number)fcdomain domain 60 static vsan 100fcdomain restart disruptive vsan 100

1.2.3. Port configuration config tvsan databasevsan 200 interface fc2/13

int fc2/13switchport speed 2000switchport description e03859r3dano shut

1.2.4. Port-Channel configuration interface interface fc4/1, fc7/1, fc8/1, fc4/9, fc7/9, fc8/9switchport mode E channel-group 2

interface port-channel 2switchport description "To switch1 PortChannel2"switchport trunk mode onswitchport trunk speed 2000switchport trunk allowed vsan 100switchport trunk allowed vsan add 105

To add an interface to an existing port-channelinterface fc1/1 channel-group 1 force

1.2.5. Alias creation device-alias database device-alias name cdc1-e03859r3da_vsan200 pwwn 50:06:04:8a:d5:30:4c:d2exitdevice-alias commit

1.2.6. Zone creation zone name cdc1-e03859r3da_vsan200_cdc2-e03893r3da_vsan200 vsan 200member device-alias cdc1-e03859r3da_vsan200member device-alias cdc2-e03893r3da_vsan200exitzoneset name cdc1-cdc2_vsan200_f01 vsan 200member cdc1-e03859r3da_vsan200_cdc2-e03893r3da_vsan200exitzoneset activate name cdc1-cdc2_vsan200_f01 vsan 200zone commit vsan 200

1.2.7. Loading Firmware copy tftp://10.28.188.30/m9500-sf2ek9-kickstart-mz.3.2.3a.bin bootflash:m9500-sf2ek9-kickstart-mz.3.2.3a.bincopy tftp://10.28.188.30/m9500-sf2ek9-mz.3.2.3a.bin bootflash:m9500-sf2ek9-mz.3.2.3a.bininstall all kickstart bootflash:m9500-sf2ek9-kickstart-mz.3.2.3a.bin system bootflash:m9500-sf2ek9-mz.3.2.3a.binshow install status

1.2.8. Loading license copy tftp://10.31.186.50/MDS20080804113538459.lic bootflash:MDS20080804113538459.licinstall license bootflash:MDS20080804113538459.lic

1.2.9. FC ISL configuration Switch1# config tSwitch1# vsan databaseSwitch1# vsan 1009 name "BE800-Carlstadt"Switch1# exit

Switch1# zone mode enhanced vsan 1009Switch1# fcdomain domain 90 static vsan 1009Switch1# fcdomain priority 90 vsan 1009 #set priority to same as domain id so lower is principal#Switch1# fcdomain restart disruptive vsan 1009

Switch1# int port-channel 91Switch1# switchport description Port-Channel be800rc01f02-carrc01f02Switch1# switchport mode eSwitch1# switchport trunk mode on Switch1# switchport trunk allow vsan 1009Switch1# switchport speed 2000Switch1# channel mode activeSwitch1# exit

Switch1# int fc 11/1, fc13/1Switch1# switchport rate-mode dedicatedSwitch1# switchport mode e

Switch1# switchport trunk mode onSwitch1# switchport trunk allow vsan 1009Switch1# switchport speed 2000Switch1# channel-group 91Switch1# no shut

Switch2# config tSwitch2# vsan databaseSwitch2# vsan 1009 name "BE800-Carlstadt"Switch2# zone mode enhanced vsan 1009Switch2# fcdomain domain 100 static vsan 1009Switch2# fcdomain priority 100 vsan 1009 #set priority to same as domain id so lower is principal#Switch2# fcdomain restart disruptive vsan 1009

Switch2# int port-channel 91Switch2# switchport description Port-Channel be800rc01f02-carrc01f02Switch2# switchport mode eSwitch2# switchport trunk mode on Switch2# switchport trunk allow vsan 1009Switch2# switchport speed 2000Switch2# channel mode active

Switch2# int fc 9/2, fc10/2Switch2# switchport rate-mode dedicatedSwitch2# switchport trunk mode onSwitch2# switchport trunk allow vsan 1009Switch2# switchport speed 2000Switch2# switchport mode eSwitch2# channel-group 91Switch2# no shut

1.2.10. FCIP ISL configuration Calculating IP route. – Use IP calculator. Using the peer ip address, calculate the subnet ID. This will be the first value in the command. The next value is the subnet mask of the peer ip address. For the third value you use the local IP address and use the first ip address in the host range.

ip route 155.180.168.0 255.255.254.0 169.81.30.1o peer ip 155.180.168.154 – subnet for this address is 155.180.168.0o peer subnet mask - 255.255.254.0o local ip address 169.81.30.251 – first available address in that network is 169.81.30.1

sh ip route configured # to verify that the correct interface is used #

http://www.subnet-calculator.com/

Network switch config should look like for IOSmtu 9216no ip addressswitchportswitchport access vlan 410switchport mode access

Network switch config should look like for Cat-OSset port negotiation 3/7 disableset port jumbo 3/7 enableset spantree portfast 3/7

If the VSAN you are going to use does not exist..create it firstSwitch1# config tSwitch1(config) # fcip enable # enables fcip on the switchSwitch1(config) # interface gigabitethernet 2/1Switch1(config-if) # ip address 10.1.1.1 255.255.255.252Switch1(config-if) # switchport description to-switch2-8/2Switch1(config-if) # switchport mtu 2300Switch1(config-if) # no switchport auto-negotiate – May or may not be needed depending on network switch configSwitch1(config-if) # no shutSwitch1(config-if) # exit

Switch2# config tSwitch2(config) # fcip enable Switch2(config) # interface gigabitethernet 8/2Switch2(config-if) # ip address 10.1.1.2 255.255.255.252Switch2(config-if) # switchport description to-switch1-2/1Switch2(config-if) # switchport mtu 2300Switch2(config-if) # no switchport auto-negotiateSwitch2(config-if) # no shut

Switch2(config-if) # exit*** test connection by pinging remote switch port IP address now. ***

Switch1(config) # fcip profile 21 # creates fcip profile (range 1 to 255)Switch1(config-profile) # ip address 10.1.1.1 # associates profile 21 with ip addressSwitch1(config-profile) # do ips measure-rtt 10.1.1.2interface gigabitethernet 2/1 # use to measure round trip for rtt time belowSwitch1(config-profile)# tcp max-bandwidth-mbps 1000 min-available-bandwidth-mbps 900 round-trip-time-ms 28Switch1(config-profile) # exit

Switch2(config) # fcip profile 22 Switch2(config-profile) # ip address 10.1.1.2 Switch2(config-profile)# tcp max-bandwidth-mbps 1000 min-available-bandwidth-mbps 900 round-trip-time-ms 28Switch2(config-profile) # exit

Switch1 (config) # interface fcip 21 # creates FCIP interface 21Switch1 (config-if) # switchport mode ESwitch1 (config-if) # switchport trunk mode onSwitch1 (config-if) # switchport description to-switch2-fcip21Switch1 (config-if) # switchport trunk allowed vsan 2121Switch1 (config-if) # use-profile 21 # assigns profile 21 to fcip interface 21Switch1 (config-if) # peer-info ipaddr 10.1.1.2 # assigns peer ip address (of switch 2)Switch1 (config-if) # no shut

Switch2 (config) # interface fcip 21 Switch2 (config-if) # switchport mode ESwitch2 (config-if) # switchport trunk mode onSwitch2 (config-if) # switchport description to-switch1-fcip21Switch2 (config-if) # switchport trunk allowed vsan 2121Switch2 (config-if) # ip-compression mode1Switch2 (config-if) # use-profile 21 Switch2 (config-if) # peer-info ipaddr 10.1.1.1Switch2 (config-if) # no shut

1.3. McData

Root> config zoning

# verify that there are no pending zonesConfig.Zoning> show pending Default Zone Enabled: FalseThere are no zones in pending zoneset.

# this copies the current zoneset into scratch area for modificationConfig.Zoning> replacezoneset .

# verify that active zone is copied into scratch area.Config.Zoning> show pending

Default Zone Enabled: FalseZone Set: MCC-1Zone: Binr900h0_e02999fa3aaZone Member: 10:00:00:00:C9:71:DD:B8Zone Member: 50:06:04:82:D5:2F:75:C2Zone: aml-ntdb-dr-01h0_h10742sp1aZone Member: 10:00:00:00:C9:40:AD:3EZone Member: 50:06:0E:80:04:29:F6:00## Lines removed #Zone: tsmccursr02h0_e70047fa3caZone Member: 10:00:00:00:C9:44:DE:26Zone Member: 50:06:04:8A:CC:AA:D7:C2Zone: ttypde1-027h0_e80702fa4baZone Member: 10:00:00:00:C9:4B:A4:5BZone Member: 50:06:04:82:CC:B5:3F:93

# Add new zones – creates zoneset in scratch areaConfig.Zoning> addZone bakmedmcchh0_tapeConfig.Zoning> addWwnMem bakmedmcchh0_tape 10:00:00:00:C9:3F:2A:28Config.Zoning> addWwnMem bakmedmcchh0_tape 50:05:07:63:0F:40:5A:06Config.Zoning> addWwnMem bakmedmcchh0_tape 50:05:07:63:0F:40:5A:11Config.Zoning> addWwnMem bakmedmcchh0_tape 50:05:07:63:0F:40:5A:12Config.Zoning> addZone bakmedmccih0_tapeConfig.Zoning> addWwnMem bakmedmccih0_tape 10:00:00:00:C9:3D:0C:55

Config.Zoning> addWwnMem bakmedmccih0_tape 50:05:07:63:0F:40:5A:01Config.Zoning> addWwnMem bakmedmccih0_tape 50:05:07:63:0F:40:5A:02Config.Zoning> addWwnMem bakmedmccih0_tape 50:05:07:63:0F:40:5A:03

# verify that new zone is copied into scratch area.Config.Zoning> showpending

Default Zone Enabled: FalseZone Set: MCC-1Zone: Binr900h0_e02999fa3aaZone Member: 10:00:00:00:C9:71:DD:B8Zone Member: 50:06:04:82:D5:2F:75:C2Zone: aml-ntdb-dr-01h0_h10742sp1aZone Member: 10:00:00:00:C9:40:AD:3EZone Member: 50:06:0E:80:04:29:F6:00Zone: ana0bl-d0026s00h0_h10742sp3aZone Member: 10:00:00:00:C9:62:91:A6Zone Member: 50:06:0E:80:04:29:F6:20## Lines removed #Zone: bakmedmcchh0_tapeZone Member: 10:00:00:00:C9:3F:2A:28Zone Member: 50:05:07:63:0F:40:5A:06Zone Member: 50:05:07:63:0F:40:5A:11Zone Member: 50:05:07:63:0F:40:5A:12Zone: bakmedmccih0_tapeZone Member: 10:00:00:00:C9:3D:0C:55Zone Member: 50:05:07:63:0F:40:5A:01Zone Member: 50:05:07:63:0F:40:5A:02Zone Member: 50:05:07:63:0F:40:5A:03

# Activate modified zoneset in scratch areaConfig.Zoning> activatezoneset

# Verify new zones are in active zonesetConfig.Zoning> showactive

Default Zone Enabled: FalseZone Set: MCC-1Zone: Binr900h0_e02999fa3aaZone Member: 10:00:00:00:C9:71:DD:B8Zone Member: 50:06:04:82:D5:2F:75:C2Zone: aml-ntdb-dr-01h0_h10742sp1aZone Member: 10:00:00:00:C9:40:AD:3EZone Member: 50:06:0E:80:04:29:F6:00## Lines removed #Zone: bakmedmccjh0_tapeZone Member: 10:00:00:00:C9:3F:2C:00Zone Member: 50:05:07:63:0F:40:5A:15Zone Member: 50:05:07:63:0F:40:5A:16Zone Member: 50:05:07:63:0F:40:5E:06Zone Member: 50:05:07:63:0F:40:5E:11Zone Member: 50:05:07:63:0F:40:5E:12

Config.Zoning> ..Config> ..Root> logout

#Now need to go into EFCM. Backup current zoneset in EFCM database. Import active fabric zoneset into EFCM.

2. EMC DMX 2.1. Generally useful commands

symcfg -sid -ra 3d online - turns on an RA port symcfg -sid -sa 3d –p 0 online – turns on an FA port

2.2. mapfile lun modification 2.2.1. lun allocation

First perform:symdev list -sid xxxx -noport (list devices that are not currently allocated)symcfg list -sid xxxx -sa 8a -p 0 -address -available (list available luns)

symcfg list -sid xxxx -sa 9a -p 0 -addresses (list luns on the FA 9aa)

create a map file that contains luns to be added to the FA path:mapfile.txt: (Don't forget the ; at the end - a common mistake)

map dev 2A1 to dir 8a:0, lun=038;map dev 2A5 to dir 8a:0, lun=039;map dev 2A9 to dir 8a:0, lun=03a;map dev 2AD to dir 8a:0, lun=03b;map dev 2B1 to dir 8a:0, lun=03c;

To run the map filesymconfigure -sid xxxx -f c\mapfile.txt previewsymconfigure -sid xxxx -f c\mapfile.txt preparesymconfigure -sid xxxx -f c\mapfile.txt commit

2.2.2. lun unallocation Luns must be disabled before they can be removed.

symdev -sid xxxx write_disable 2A1symdev -sid xxxx write_disable 2A5symdev -sid xxxx write_disable 2A9

Mapfile example for creating metaform meta from dev 009, config=striped stripe_size=1920;add dev 00A to meta 009add dev 00B to meta 009

Create a mapfile that contains luns to be removed from the FA path:mapfile.txt (Don't forget the ; at the end - a common mistake)

unmap dev 2A1 from dir 8a:0;unmap dev 2A5 from dir 8a:0;unmap dev 2A9 from dir 8a:0;

Mapfile example for changing hot spare..should be Temporary - can be done nondisruptively set symmetrix hot_swap_policy=TEMPORARY|PERMANENT

2.3. Volume Logics 2.3.1. Setup symmaskdb –sid xxxx init –f mmddyyinit.dbsymmask -sid 0141 -wwn 10000000c93fa01e add devs 2A1,2A5,2A9,2AD,2B1symmask -sid 0141 -wwn 10000000c93fa01e rename cdc1bet11/fcs1symmask –sid 0001 set hba_flags on C,D –enable –wwn 10000000c93fa01e –dir 8a –p 0symmask -sid 0141 refresh -noprompt

2.3.2. Verification Sympd list –sid xxxx symcfg list -sid xxxx -sa 9a -p 0 -addresses (list luns on the FA 9aa)symmaskdb -sid 0141 list database -v -dir 8a -p 0symmask -sid 0141 list logins -dir 8a -p 0symcfg -sid 0141 -connections listsymmaskdb list database -wwn 10000000c9561aa2 –v symmask -sid 03859 list logins |find /i "hba"symmask -sid 1296 list logins | egrep "c9535b8d|c94e593d|c9488604|c94885dd|c93462fd|c94885dd|c951e318"symmaskdb -sid 03859 list capacity -host ret2f001symcfg -sid 0141 -FA 8a -p 0 list (shows wwn of FA)symaudit -sid 0141 list -u (shows command history + server who issued)symgate –sid xxxx define dev 0001 (must be 4 digit device ID)symmask -sid 0141 -wwn old_wwn replace new_wwnsymmaskdb -sid 0141 -wwn 10000000c93fa01e list devssymcfg -sid 0736 -FA 3a -p 0 list –v – Shows what flags are set on FAsymcfg -sid 638 -lockn all list (shows current locks on array)symmask -sid 4527 -wwn 5006048ad5310fc9 delete –login (dir 3a –p 0) removes login on FA

2.4. Symacl Provide EMC CE with Access ID, Unique ID, and Access PIN for the initial setup on the array. The Access ID is the SSID of the server in IMS.

o [v005445@gti0l001 ~]$ adw_query –h dss0l004 Unique ID is a value unique to the host and retrieved from the host

o [v005445@gti0l001 ~]$ symacl –unique Access PIN is always “3lions3lions”

2.4.1. Symacl site information for EMC setup CDC1 (ino0w279 / ino0s184)

Access Pin - 3lions3lions Access ID = I283478 - Unique ID 245303A9-554288C9-993C7572 Access ID = I283485 - Unique ID 2F5802A9-554489C9-9F3C757A

CDC2 (ino0w285 / ino0s185) Access Pin - 3lions3lions Access ID = I282758 - Unique ID 2C5F05AF-53408BCA-9B3F7578 Access ID = I282675 - Unique ID 2F5802A9-554489CA-933C757A

MCC (dss0l085 / dss0l089) Access Pin - 3lions3lions Access ID = I313342 - Unique ID 2C5306AF-57428CC1-933E7C7E Access ID = I516221 - Unique ID 2C5A02AF-5D418DCF-9D3E7C7E

2.4.2. Symacl setup

Overview – Setup config on array, Create admin group and add san management hosts to it. Create ECC group and add all ECC hosts to it. Delete unknown group, create Base group and add default user to it.

***these files are created on gti0l001/home/v005445***symacl -sid 04272 preview -file symacl.add.admingrp.txtsymacl -sid 04375 prepare -file symacl.add.admingrp.txtsymacl -sid 04375 commit -file preview symacl.add.admingrp.txt

symacl -sid 04375 preview -file symacl.add.eccgrp.txtsymacl -sid 04375 prepare -file symacl.add.eccgrp.txtsymacl -sid 04375 commit -file preview symacl.add.eccgrp.txt

symacl -a 3lions3lions -sid 04375 preview -file UnknwGrp.de.txtsymacl -a 3lions3lions -sid 04375 prepare -file UnknwGrp.de.txtsymacl -a 3lions3lions -sid 04375 commit -file UnknwGrp.de.txt

to create base group create a file and run…create accgroup BaseGrp;add default unknown name unknown to accgroup BaseGrp;grant access=Base to accgroup BaseGrp for ALL DEVS;

2.4.3. Symacl verification If symacl isn’t set up on a box it will look like this

Symacl list –sid 0549Symmetrix ID: 000187700594

Access Session Control Locked Time Last Updated -------- ------- ------------------------- Disabled N/A N/A (if symacl is disabled) Enabled No Thu Nov 13 14:27:54 2008 (if symacl is enabled)

Symacl –sid 1234 list –v Symacl –sid 1234 list –accgroup Symacl –sid 1234 list -accpool Symacl –sid 1234 list –acl

Using the show actions when you don’t have administrative rights, you only see access objects that are associated with the access group to which your host belongs.

Symacl –sid show accgroup AdminGrp Symacl –sid show accgroup ECCGrp

2.5. SRDF 2.5.1. Syncronous Setup

2.5.2. SRDF-A Setup The following are the procedures to implement SRDFA: Step1 –Run and connect Fibre cables from the EMC frame to the Cisco Switches Step2 –If there no RA’s defined, have EMC perform a bin file change to convert some of the D ports to RF ports

(Dynamic SRDF) and enable the FF bit on both the source and target box. Step3 –Zone the source and target RF’s on the CISCO switches. Step4 –Run symconfigure and set both the R1 & R2 devices to dynamic rdf.

o example: set dev 81b, attribute=dyn_rdf; Step5 –Create and label the dynamic groups on both the source and target boxes. Make sure that you specify the

source and target RF’s you are going to use. Also, the dynamic group you are going to create must not be used in both the source and target location.

o example: symrdf addgrp -label HOSTNAME -rdfg 19 -sid 906 -dir 7d,10d -remote_rdfg 19 -remote_sid 702 -remote_dir 4d,13d -link_limbo 60 -rem_link_limbo 60

Step6 –Run create pair and establish the R1 to R2 relationship. You must create a file that has all the R1 devices starting in column 1 and all the R2 devices starting in Column 2.

o example: symrdf createpair –file xxxxx.xxxxx –sid 906 –rdfg 19 –type rdf1 -establish Step7 –Set the session priority.

o example: set rdf group 19, session_priority=30 Step8 –Create the device group on the R1 side.

o example: symdg –type RDF1 create mfn1endr12_SRDFA Step9 –Add the R1 devices to the device group you just created.

o example: symld –sid 906 –g mfn1endr12_SRDFA add dev c4a Step10 –Begin the replication process by setting the group to Adaptive Copy.

o for example: symrdf –g mfn1endr12_SRDFA set mode acp_disk Step11 –Once all devices are synchronized set mode to async.

o example: symrdf –g mfn1endr12_SRDFA set mode async Step12 –Enable consistency protection.

o example: symrdf –g mfn1endr12_SRDFA enable

Example setup script***** run all scripts from this point on from frame 4272 ****

1. script to create a new label for servers nacasu001. Need to change the rdfg group number and the FA's you are going to use.

symrdf addgrp -label nacasu001 -rdfg 3 -sid 4272 -dir 3d,14d -remote_rdfg 3 -remote_sid 4541 -remote_dir 3d,14d -link_limbo 60 -rem_link_limbo 60

2. script to run the createpair. Need to change the rdfg group number and the file you are going to place the R1 & R2 devices.

symrdf createpair –file nacasu001-to-namcsu001-car-to-mcc-d11122008-Frame4272-to-Frame4541.srdfsetup –sid 4272 –rdfg 3 –type rdf1 -establish -rdf_mode acp_disk

0AC6 04040AC7 04050AC8 04060AC9 04070ACA 04080ACB 04090ACC 040a0ACD 040b0ACE 040c0ACF 040d0AD0 040e0AD1 040f0AD2 04100AD3 04110AD4 04120AD5 0413

3. script to set the session priority. Need to change the rdf group number.

set rdf group 3, session_priority=30

4. script to set the mode to adaptive copy. The file name should be the same name as what you created in step 2.Also, need to change the rdfg group number.

symrdf -sid 4272 -file nacasu001-to-namcsu001-car-to-mcc-d11122008-Frame4272-to-Frame4541.srdfsetup -rdfg 3 set mode acp_disk

5. script to set the mode to async once all devices are synchronized. Need to change the rdfg group number.

symrdf -sid 4272 -file nacasu001-to-namcsu001-car-to-mcc-d11122008-Frame4272-to-Frame4541.srdfsetup -rdfg 3 set mode async

6. script to enable consistency. Need to change the rdfg group number.

symrdf -sid 4272 -file nacasu001-to-namcsu001-car-to-mcc-d11122008-Frame4272-to-Frame4541.srdfsetup -rdfg 3 enable

7. script to query the devices.

symrdf -sid 4272 -file nacasu001-to-namcsu001-car-to-mcc-d11122008-Frame4272-to-Frame4541.srdfsetup -rdfg 3 query

8. create symdg group

symdg create nacasu001 -type RDF1

9. Add devs into group

symld -g nacasu001 -sid 4272 addall -range 0ac6:0ad5 devorsymld -g nacasu001 -sid 4272 addall -rdfg 3 dev

10. list groupsymld -g nacasu001 list

11. symrdf -g nacasu001 query

2.5.3. RDF Verification symcfg -ra all list -sid 3859

Symmetrix ID: 000190103859

S Y M M E T R I X R D F D I R E C T O R SRemote Local Remote

Ident Symb Num Slot Type Attr SymmID RA Grp RA Grp Status

RF-3D 03D 51 3 RDF-R1 - 000190103893 1 (00) 1 (00) OnlineRF-4D 04D 52 4 RDF-R1 - 000190103893 1 (00) 1 (00) OnlineRF-7D 07D 55 7 RDF-BI-DIR - - 1 (00) - OnlineRF-8D 08D 56 8 RDF-BI-DIR - - 1 (00) - OnlineRF-9D 09D 57 9 RDF-BI-DIR - - 1 (00) - OnlineRF-10D 10D 58 10 RDF-BI-DIR - - 1 (00) - OnlineRF-13D 13D 61 13 RDF-R1 - 000190103893 1 (00) 1 (00) OnlineRF-14D 14D 62 14 RDF-R1 - 000190103893 1 (00) 1 (00) Online

symcfg -sid -ra 3d online3. EMC CX

Use Sai’s spreadsheet to generate a script. Save script as name.batIssue name.bat >output.txt 2>&1 to run all commands and save output to file

4. HDS 4.1. AMS 1000 4.2. Array Setup

Addition to Hi-TrackLog into Hi-Track Monitor using bluekey password as Administrator

Log in to appropriate HDM via web interfaceLog in using SSO

Select subsystems in left painSelect add subsystem in right painFill out IP address and user/passwdIt will now show up in list as ams1000@ipaddressSelect it in list and modify properties to correct name

when enabling the ACCOUNT License you will need to log back in with a password. The default array account is root/storagelog back in and create a new account jpmcadm / (password is site unique and can be gotten from Tom Hope)

Addition to Storage Navigator Modular - Get password from Nicole Ait Oudhia or Mike MaxwellAdd array by IP address – Select Detailed and add array name and group at the same timeUnder Logical Status / License Keys

Enable SNMP-AgentEnable Account

This will log you out. when enabling the ACCOUNT License you will need to log back in with a password. The default array account is root/storagelog back in and create a new account jpmcadm / (password is site unique and can be gotten from Tom Hope)

Setting Access ModeHDM / Logical Status / Access Mode / Host Group Security

Right click on port and select modifyHDM / Logical Status / Access Mode / Mapping Mode

Right click select modify (enable)

4.3. Array Deployment (DPI) Raid group Config

o Config for DPI SIR array First shelf (Fiber Channel Drives) 4 drives 2 x 2 (Raid 1+0) 1 x 250GB lun and 1 x 1GB lun with default controller 0 1 x 250GB lun and 1 x 1GB lun with default controller 1. All remaining Shelves (ATA Drives) 14 drives 12+2 (Raid6) 15th drive is Hot Spare 6 1830Gb luns created. All on same default controller Alternate default controller every other shelf.

o Config for DPI VTL array First shelf (Fiber Channel Drives) 4 drives 2 x 2 (Raid 1+0) 1 x 6GB lun per VTL server with default controller 0 (delete all created luns on RG-00 All remaining Shelves (ATA Drives) 14 drives 12+2 (Raid6) 15th drive is Hot Spare 6 1830Gb luns created. All on same default controller Alternate default controller every other shelf.

#### REMEMBER TO FORMAT LUNS AFTER CREATION ###

Host group Configo The host group (create or rename to match hostname)

Right click Port to create a new host group Right click existing host group to rename

o Options (defines host type) Select Simple Settings Button & change Platform box to Linux Select Detail Button and check “UA(06/2A00) suppress Mode

o Logical Unit (defines storage to be seen by host) Select Modify Mapping button in bottom right Select the luns from the Available Logical Units list at bottom. (can use CTRL and SHIFT for multiple selections) Hit UP arrow to add them to Mapping Information section then hit OK Make FC luns H-LUN address 000

First SIR arrayallocate one 250GB lun to first sir host on port Aallocate one 250GB lun to sir host on port Ballocate one 1GB lun to sir host on port Callocate one 1GB lun to sir host on port DAllocate all ATL luns to all 5 sir hostsSecond SIR arrayallocate one 1GB lun to first sir host on port Aallocate one 1GB lun to host on port Ballocate one 250GB lun to host on port Callocate one 250GB lun to host on port DAllocate all ATL luns to all 5 SIR hostsVTL arrasallocate one unique 6GB lun to each VTL hostthe ATL raid groups are divided by the number of VTLs. Each VTL receives all luns from a raid group. The odd raid groups will be left unused for emergency deploymentThe last few configs have had luns from RG 1 through 5 for VTLserver1 from both arrays.RG 6-10 from both arrays to VTLserver2RG 11-15 from both arrays to VTLserver3

o WWN (defines host to see storage) Hit Modify WWN Information button at bottom right Choose WWN in Assignable WWN section and select Add WWN will move to Assigned WWN box. Select it again and select Change button Add hostname in box and hit OK

Access Mode Configo Enable Mapping Mode

right click right pain and select enableo Enable Host Group Security for all ports

right click right pain and select enable on each port

4.4. USPv 4.4.1. Array installation 4.4.2. Array Configuration

5. Host Deployment 5.1.1. Linux

[v005445@dss0l085 bin]$suexec /usr/sbin/lpfc/lun_scan allPassword: Scanning lpfc HBA instance with scsi host number : 0Scanning lpfc HBA instance with scsi host number : 1Scanning lpfc HBA instance with scsi host number : 2Scanning lpfc HBA instance with scsi host number : 3Scanning lpfc HBA instance with scsi host number : 4Scanning lpfc HBA instance with scsi host number : 5

[v005445@dss0l085 bin]$suexec symcfg discoverPassword:

5.1.2. Sun Steps for adding luns to a Solaris host without rebooting. Must have admin or sudo rights to accomplish

sudo /usr/sbin/lpfc/lputil

Main Menu -> Opt 2. Adapter Information ->Opt 4. IEEE Address -> go through each one to determine WWN of adapters to be usedMAIN MENU

1-List Adapters2-Adapter Information3-Firmware Maintenance4-Reset Adapter5-Persistent Bindings0-Exit

Enter choice => 5

PERSISTENT BINDINGS MENU

1-Display Current Bindings2-Display All Nodes3-Duplicate Adapter Bindings4-Bind Target Manually5-Bind Automapped Targets6-Delete Binding(s)0-Return to Main Menu

Enter choice => 5

1-lpfc02-lpfc13-lpfc24-lpfc3

Select an adapter => 1

Automapped FCP Nodes:Node Target WWPN WWNN---- ------ --------- --------Automapped FCP Node 1 50-06-04-82-cc-37-06-49 50-06-04-82-cc-37-06-49Press the Enter or Return key to continue:Bind all auto-mapped targets? (Y/N) => y### Document target value...this will be needed in sd.conf update #########PERSISTENT BINDINGS MENU

Display Current BindingsDisplay All NodesDuplicate Adapter BindingsBind Target ManuallyBind Automapped TargetsDelete Binding(s)

Return to Main Menu

Enter choice => 5lpfc0lpfc1lpfc2lpfc3

Select an adapter => 2

Automapped FCP Nodes:Node Target WWPN WWNN---- ------ --------- --------Automapped FCP Node 1 50-06-04-82-cc-37-06-46 50-06-04-82-cc-37-06-46

Press the Enter or Return key to continue:Bind all auto-mapped targets? (Y/N) => y

### Document target value...this will be needed in sd.conf update #########

Return to Main MenuExit

[CDC1] sudo vi /kernel/drv/sd.confadd lines for target discovered above and lun id converted from hex to decimal

# Added by Sai for EMC51449name="sd" parent="lpfc" target=1 lun=240;name="sd" parent="lpfc" target=1 lun=241;name="sd" parent="lpfc" target=1 lun=242;

[CDC1] sudo /usr/sbin/update_drv -f sdCannot unload module: sdWill be unloaded upon reboot.Forcing update of sd.conf.root@ino0s184:/:

[CDC1] sudo devfsadm[CDC1] sudo symcfg discoverThis operation may take up to a few minutes. Please be patient...[CDC1] sudo symcfg list

5.1.3. AIX HBA Replacement / failed path

In AIX with EMC Powerpath, If the following attributes are not at default and look like,

Fast I/O Failure for FC adaptersfc_err_recov=fast_fail (Default – delayed_fail)

Dynamic tracking of FC adaptersdyntrk=yes (Default – no)

Logical track group size for the base devices that form power devicesmax_transfer=0x100000 / 0x80000 (Default 0x40000)

Use this in the event of HBA / Path failure to avoid I/O errors on the LVs and file system unavailability.

Remove the adapter from power path.powermt remove adapter=N

Remove all base hard drives (hdiskNs) which is available on that pathslsdev –Ccadapter|grep fcsN|awk ‘{print $3}’|while read LOCdolsdev –Ccdisk|grep $LOC|awk ‘{print $1}’||xargs –n1 rmdev –Rdldone

Replace the adapter and using diag utiility, remove the old adapter from the slot and reconfigure the new adapter.Get the WWN for the new adapter

lscfg –vl fcsN|grep NetworkBefore zoning and masking updates, change the dyntrk and fc_err_recov attributes for the corresponding fscsiN.

chdev –a dyntrk=yes –a fc_err_recov=fast_fail –l fscsiNDo necessary zoning and masking changes.

Once the SAN path issues are resolvedNow run config manager on the specific adapter only.

cfgmgr –l fcsNBefore adding these devices to power path, change the max_transfer value for the new base hard drives that are detected on this adapter.

lsdev –Ccadapter|grep fcsN|awk ‘{print $3}’|while read LOCdolsdev –Ccdisk|grep $LOC|awk ‘{print $1}’||xargs –n1 chdev –a max_transfer=<recommendation> -l

doneAfter changing max_transfer value of the base hard drives, run powermt config and add these device to the power path.powermt config

And we are back to business.

6. Excel 6.1.1. Vlookup

Example {=VLOOKUP(E127,'Sheet 2'!A2:L397,10,FALSE)} E127 = cell on current sheet to be looked up 'Sheet 2'!A2:L397 = range on other tab to search 10 = column number to return value from

6.1.2. Concatenate =CONCATENATE(ref!B6,ref!D6,ref!A4,ref!C6,'Port Reservation Data'!G8,ref!D6)

6.1.3. Pull down lists Data / Validation – allow=list

Source – Must be on same page so create a column that does a vlookup from another list and reference it