Procedure for building DEFS virtualized systems at Mt Xia Franklin (MXF) Data Center


DEFS Slot/system/switch port/ip address mapping

  --
  Top Drawer DQDPYDK
  
  DQDPYDK-P1-C1		mxfapvio10	FC cable 4
  
  DQDPYDK-P1-C3-Port1	mxfapvio11	u8/11	10.189.41.8	etherchannel
  DQDPYDK-P1-C3-Port2	mxfapvio11	v9/47	206.245.38.62
  
  DQDPYDK-P1-C4-Port1	Open
  DQDPYDK-P1-C4-Port2	mxfapvio10	v9/46	206.245.38.61 (PROBLEM ON PORT/CABLE)
  
  DQDPYDK-T6		mxfapvio10	v9/33	10.189.41.7	etherchannel
  DQDPYDK-T7		Open
  
  --
  Middle Drawer DQDPKWA
  
  DQDPKWA-P1-C1		mxfapvio10	FC cable 2
  
  DQDPKWA-P1-C3-Port1	mxfapvio11	u8/12	10.189.41.8	etherchannel
  DQDPKWA-P1-C3-Port2	Open
  
  DQDPKWA-P1-C4		mxfapvio11	FC cable 3
  
  DQDPKWA-T6		mxfapvio10	v9/34	10.189.41.7	etherchannel
  DQDPKWA-T7		Open
  
  --
  Bottom Drawer DQDPRNR
  
  DQDPRNR-P1-C3-Port1	mxfapvio11	u8/12	10.189.41.8	etherchannel
  DQDPRNR-P1-C3-Port2	Open
  
  DQDPRNR-P1-C4		mxfapvio11	FC cable 1
  
  DQDPRNR-T6		mxfapvio10	v9/34	10.189.41.7	etherchannel
  DQDPRNR-T7		Open
  


# mxflphmc10: Establish passwordless ssh access from desktop to the DEFS HMC hscroot user


# mxfapnim01: The following script is configured for DEFS and ready to run to create the VIO servers, assuming your NIM server login ID has password-less access to the "hscroot" account on the DEFS HMC:

  mxfapnim01:/home/s45x/dukeEnergy/mkviolpar.mxfapvio10.ksh

# mxfapnim01: Execute this script to create both VIO servers on the p570, this requires password-less ssh access between your current login on the NIM server and the "hscroot" login on the HMC.

# mxfapnim01: You may also create the client LPAR's at this time as well, by running the following script:

  mxfapnim01:/home/s45x/dukeEnergy/mklpar.mxfapdef00.ksh

# mxfapnim01: This script requires the same password-less ssh access between your current login on the NIM server and the "hscroot" login on the HMC. This script will create 5 client LPAR's on the p570.

# mxflphmc10: If you ran the above scripts you should now see 7 total LPAR's on the p570: 2 VIO servers and 5 client LPAR's.

# mxfapnim01: REMOVING LPARs: If an error occurs and you need to remove the LPAR's and start over, using the following scripts for that purpose:

  mxfapnim01:/home/s45x/dukeEnergy/rmlpar.mxfapdef00.ksh # removes all client LPARs
  mxfapnim01:/home/s45x/dukeEnergy/rmlpar.mxfapvio10.ksh # removes both VIO Servers

# mxflphmc10: You may choose to perform these procedures manually if you want, the standards for creating these LPAR's are at the following URL:

  http://www.mtxia.comc/js/GlobalSysAdmin/Power5/standards.shtml

# mxflphmc10: Check each VIO server to ensure that all virtual adapters on mxfapvio10 are even numbered, and all virtual adpaters on mxfapvio11 are odd numbered. The purpose of the numbering scheme is to make it easier to identify which VIO server is providing which adapter to a client LPAR.


# mxflphmc10: The internal hard drives in the MXF p570 are attached as follows:

  hdisk0  U7879.001.DQDPYDK-P1-T12-L4-L0  16 Bit LVD SCSI Disk Drive (73400 MB)
  hdisk1  U7879.001.DQDPYDK-P1-T12-L5-L0  16 Bit LVD SCSI Disk Drive (73400 MB)
  hdisk2  U7879.001.DQDPKWA-P1-T12-L5-L0  16 Bit LVD SCSI Disk Drive (73400 MB)
  hdisk3  U7879.001.DQDPRNR-P1-T12-L5-L0  16 Bit LVD SCSI Disk Drive (73400 MB)


# mxflphmc10: Modify both VIO server profiles on the HMC to include the physical adapters as detailed below:

  DQDPYDK-P1-C1	mxfapvio10	Fiber Channal Adapter
  DQDPYDK-P1-C4	mxfapvio10	Ethernet Adapter (dual port)
  DQDPYDK-T6	mxfapvio10	Ethernet Adapter
  DQDPYDK-T7	mxfapvio11	Ethernet Adapter
  
  DQDPKWA-P1-C1	mxfapvio10	Fiber Channal Adapter
  DQDPKWA-T6	mxfapvio10	Ethernet Adapter
  DQDPKWA-T7	mxfapvio10	Ethernet Adapter
  DQDPKWA-T12	mxfapvio10	Storage Controller
  
  DQDPRNR-T6	mxfapvio10	Ethernet Adapter
  DQDPRNR-T7	mxfapvio10	Ethernet Adapter

  DQDPYDK-P1-C3	mxfapvio11	Ethernet Adapter (dual port)
  
  DQDPKWA-P1-C3	mxfapvio11	Ethernet Adapter (dual port)
  DQDPKWA-P1-C4	mxfapvio11	Fiber Channal Adapter
  
  DQDPRNR-P1-C3	mxfapvio11	Ethernet Adapter (dual port)
  DQDPRNR-P1-C4	mxfapvio11	Fiber Channal Adapter
  DQDPRNR-T12	mxfapvio11	Storage Controller


# mxflphmc10: Once the VIO Server LPARs have been created you may then load operating systems on the VIO servers. This is best done by performing a remote OS load from the NIM server. Boot a VIO server LPAR to the SMS menu using the HMC generated console terminal.

# mxflphmc10: Configure the VIO Server ethernet adapters as follows:

# mxflphmc10: For the VIO server named "mxfapvio10", use the following ethernet adapter as the boot device, this will also be the MC2 network adapter:

  Port 2 - IBM 2 PORT 10/100/100  U7879.001.DQDPYDK-P1-C4-T2 00096b6e71ef

# mxflphmc10: For the VIO server named "mxfapvio11", use the following ethernet adapter as the boot device, this will also be the MC2 network adapter:

  Port 2 - IBM 2 PORT 10/100/100  U7879.001.DQDPYDK-P1-C3-T2 00145ec56881

# mxflphmc10: From the HMC, boot the system to SMS and define the network boot IP information (use MC2 network IP addressing).

   Client IP: 206.245.38.61
   Server IP: 206.245.37.100
  Gateway IP: 206.245.38.1
     NetMask: 255.255.255.0

# mxflphmc10: From the HMC, boot the system to SMS and define the network boot IP information (use MC2 network IP addressing).

   Client IP: 206.245.38.62
   Server IP: 206.245.37.100
  Gateway IP: 206.245.38.1
     NetMask: 255.255.255.0

# mxflphmc10: Test ping from each VIO server LPAR to ensure communication with the NIM server.


# mxfapnim01: How to create VIO server NIM objects

  • Prepare Installation files:
  • AIX File Limit Size You must ensure that your file size security limitation isn't going to stop you from copying your mksysb image from your cdrom to your hard drive. On your NIM server, go to the /etc/security directory and edit the limit file. Change the fsize to -1 or something large enough to ensure the mksysb image will copy over. You will need to reboot your system for this to take place.

        cd /etc/security
        vi limit
        fsize = -1
        reboot
    

  • Copy installation files from mxdapnim01:

        scp root@mxdapnim01:/tftpboot/viospot_1300.chrp.mp.ent /tftpboot
        scp root@mxdapnim01:/export/mksysb/mksysb_gold_vio_1300 /export/mksysb
        scp root@mxdapnim01:/export/mksysb/bosinst_data_vio_1300 /export/nim
    

  • Define NIM Resources:
  • Define the mksysb_image resource object

        nim -o define -t mksysb \
        -a location=/export/mksysb/mksysb_gold_vio_1300 \
        -a server=master mksysb_gold_vio_1300
    

  • Define the SPOT resource object

        mkdir -p /export/spot
    

        nim -o define -t spot -a server=master \
        -a location=/export/spot \
        -a source=mksysb_gold_vio_1300 viospot_1300
    

  • Define the bosinst resource object

        nim -o define -t bosinst_data \
        -a location=/export/nim/bosinst_data_vio_1300 \
        -a server=master bosinst_data_vio_1300
    


    # mxfapnim01: NIM Configuration

      smitty nim
    

    # mxfapnim01: Define a new network for the 206.245.38.0 network.

    # mxfapnim01: Add 206.245.38.0 network as an install network.

    # mxfapnim01: Add mxfapvio10-mc2 as a machine.

      nim -o remove mxfapvio10-mc2
      nim -o define -t standalone -a if1='38_Network mxfapvio10-mc2 0' \
        -a platform=chrp -a netboot_kernel=mp -a cable_type1='N/A' mxfapvio10-mc2
    

    # mxfapnim01: Add mxfapvio11-mc2 as a machine.

      nim -o remove mxfapvio11-mc2
      nim -o define -t standalone -a if1='38_Network mxfapvio11-mc2 0' \
        -a platform=chrp -a netboot_kernel=mp -a cable_type1='N/A' mxfapvio11-mc2
    

    # mxfapnim01: Add mxfapdef00-mc2 as a machine.

      nim -o remove mxfapdef00-mc2
      nim -o define -t standalone -a if1='38_Network mxfapdef00-mc2 0' \
        -a platform=chrp -a netboot_kernel=mp -a cable_type1='N/A' mxfapdef00-mc2
    

    # mxfapnim01: Add mxfapdef01-mc2 as a machine.

      nim -o remove mxfapdef01-mc2
      nim -o define -t standalone -a if1='38_Network mxfapdef01-mc2 0' \
        -a platform=chrp -a netboot_kernel=mp -a cable_type1='N/A' mxfapdef01-mc2
    

    # mxfapnim01: Add mxfapdef02-mc2 as a machine.

      nim -o remove mxfapdef02-mc2
      nim -o define -t standalone -a if1='38_Network mxfapdef02-mc2 0' \
        -a platform=chrp -a netboot_kernel=mp -a cable_type1='N/A' mxfapdef02-mc2
    

    # mxfapnim01: Add mxfapdef03-mc2 as a machine.

      nim -o remove mxfapdef03-mc2
      nim -o define -t standalone -a if1='38_Network mxfapdef03-mc2 0' \
        -a platform=chrp -a netboot_kernel=mp -a cable_type1='N/A' mxfapdef03-mc2
    

    # mxfapnim01: Add mxfapdef04-mc2 as a machine.

      nim -o remove mxfapdef04-mc2
      nim -o define -t standalone -a if1='38_Network mxfapdef04-mc2 0' \
        -a platform=chrp -a netboot_kernel=mp -a cable_type1='N/A' mxfapdef04-mc2
    


    # mxfapnim01: Configure the NIM server to perform a remote operating system load of the VIO server "mxfapvio10":

      smitty nim
        Perform NIM Software Installation and Maintenance Tasks
          Install and Update Software
            Install the Base Operating System on Standalone Clients
              Select Target Machine - mxfapvio10-mc2
              Select the installation TYPE - mksysb
              Select the MKSYSB to use for the installation - mksysb_gold_vio_1300
              Select the SPOT to use for the installation - viospot_1300
      
              Install the Base Operating System on Standalone Clients
      
        BOSINST_DATA to use during installation            [bosinst_data_vio_1300]
          ACCEPT new license agreements?                   [yes]
        Initiate reboot and installation now?              [no]
          ACCEPT new license agreements?                   [yes]
    


    # mxfapnim01: Configure the NIM server to perform a remote operating system load of the VIO server "mxfapvio11":

      smitty nim
        Perform NIM Software Installation and Maintenance Tasks
          Install and Update Software
            Install the Base Operating System on Standalone Clients
              Select Target Machine - mxfapvio11-mc2
              Select the installation TYPE - mksysb
              Select the MKSYSB to use for the installation - mksysb_gold_vio_1300
              Select the SPOT to use for the installation - viospot_1300
      
              Install the Base Operating System on Standalone Clients
      
        BOSINST_DATA to use during installation            [bosinst_data_vio_1300]
          ACCEPT new license agreements?                   [yes]
        Initiate reboot and installation now?              [no]
          ACCEPT new license agreements?                   [yes]
    


    # mxflphmc10: Boot each VIO Server LPAR from the configured MC2 network interface and load the VIO operating system from the NIM server. For the initial install, select an internal SCSI disk for the OS load, do not select a SAN disk at this time. After the VIO operating system is loaded, some additional drivers will have to be added to enable MPIO communications with the SAN system.


    # mxfapvio10: Login to the VIO server "mxfapvio10" using the "padmin" account and accept the license agreement:

      license -accept
    

    # mxfapvio10: Then run the "oem_setup_env" command to gain "root" access to the VIO server system, and start a Korn Shell 93 shell

      ksh93
    

    # mxfapvio10: Set the root password to "password" for now.

    # mxfapvio10: Change the hostname to "mxfapvio10" and modify the /etc/rc.net file to reflect this hostname change:

      smitty tcpip
    

      vi /etc/rc.net
    

    # mxfapvio10: Setup the password-less ssh login between the NIM server and the VIO server for the "root" user.

    # mxfapvio10: Begin by loading the additional MPIO drivers necessary to communicate with the SAN system.

    # mxfapvio10: Login to the VIO server "mxfapvio10-mc2" as root

    # mxfapvio10: Copy the XP array MPIO tar file from the NIM server, extract and install:

      mkdir /tmp/xpmpio
      cd /tmp/xpmpio
      scp root@206.245.37.100:/home/s45x/dukeEnergy/XPMPIO1.tar .
      tar -xvf ./XPMPIO1.tar
      inutoc .
      smitty install_all
      
        INPUT device / directory for software              [.]
      
        Install and Update from ALL Available Software
          SOFTWARE to install                                [all]
          PREVIEW only? (install operation will NOT occur)    no
          COMMIT software updates?                            no
          SAVE replaced files?                                yes
          ACCEPT new license agreements?                      no
    

    # mxfapvio10: Remove all SAN disks, fscsi, and fcs adapters and reboot the VIO server in order for the new drivers to take effect:

      rmdev -Rdl fcs0
      rmdev -Rdl fcs1
      shutdown -Fr
    


    # mxfapvio10: After the system reboots, login to the VIO server using the "padmin" account, then run the "oem_setup_env" command to gain "root" access to the VIO server system, and start a Korn Shell 93 shell

      ksh93
    

    # mxfapvio10: Upgrade VIO IOS to latest level

      mount 206.245.37.100:/export/lpp_source/aix /mnt
      su - padmin
      emgr -P  # identify and remove any efixes
      emgr -e 'efix label'
      updateios -dev /mnt/vio_1301 --accept --install
    

    # mxfapvio10: Reboot VIO server.

      shutdown -Fr
    


    # mxfapvio10: After the system reboots, login to the VIO server using the "padmin" account, then run the "oem_setup_env" command to gain "root" access to the VIO server system, and start a Korn Shell 93 shell

      ksh93
    

    # mxfapvio10: verify WWN's and SAN connectivity with Mike wilson.

    # mxfapvio10: identify each disk by PVID and allocate for mxfapvio11 and client LPAR operating system usage.

    # mxfapvio10: Remove all FC attached disks

      for i in $( lsdev -Cc disk -s fcp -F name | grep hdisk )
      do
        print -- rmdev -Rdl ${i}
        rmdev -Rdl ${i}
      done
    

    # mxfapvio10: Set fast fail parameter for SCSI adapters and reconfigure FC adapters

      for i in 0 1
      do
        chdev -l fcs${i} -a init_link=pt2pt -P
        chdev -l fscsi${i} -a dyntrk=yes -P
        chdev -l fscsi${i} -a fc_err_recov=fast_fail -P
      done
    

      cfgmgr -vl fcs0
      cfgmgr -vl fcs1
    

    # mxfapvio10: Change reserve policy on hdisks to "no_reserve"

      for i in $( lsdev -Cc disk -s fcp -F name | grep hdisk )
      do
        chdev -l ${i} -a reserve_policy=no_reserve -P
        chdev -l ${i} -a algorithm=round_robin -P
        chdev -l ${i} -a hcheck_interval=20 -P
        chdev -l ${i} -a queue_depth=16 -P
        chdev -l ${i} -a pv=yes -P
      done
    

    # mxfapvio10: copy the vscsiPriority script from the NIM server to the VIO server and set the path priority for each disk.

      mkdir /usr/local/scripts
      scp root@206.245.37.100:/home/s45x/dukeEnergy/vscsiPriority.ksh /usr/local/scripts
      /usr/local/scripts/vscsiPriority.ksh -voi 20
      
      for i in $( lsdev -Cc disk -s fcp -F name )
      do
        P0=$( lspath -Al ${i} -p fscsi0 -F value -a priority )     
        P1=$( lspath -Al ${i} -p fscsi1 -F value -a priority )      
        print "${i} : fscsi0 : priority = ${P0}"     
        print "${i} : fscsi1 : priority = ${P1}"     
      done
    

    # mxfapvio10: Allocate each SAN disk for use as VIO operating system storage and mirror from internal hard drive. Change system to boot from SAN.

      extendvg rootvg hdisk1
      mirrorvg rootvg hdisk1
      bosboot -ad /dev/hdisk1
      bootlist -m normal hdisk1 hdisk0
      bootlist -m normal -o
    

    # mxfapvio10: remove the internal SCSI disk from the rootvg and the system

      unmirrorvg rootvg hdisk0
      reducevg roovg hdisk0
      rmdev -Rdl hdisk0
    

    # mxfapvio10: Reconfigure ethernet adapters for etherchannel configuration, begin by unconfiguring all ethernet adapters

      lscfg -l ent*
      for i in 15 14 13 12 11 10 9 8 7 6 5 4 3 2 1 0
      do
        ifconfig en${i} down
        ifconfig en${i} detach
        ifconfig et${i} down
        ifconfig et${i} detach
        rmdev -Rdl ent${i}
        rmdev -Rdl en${i}
        rmdev -Rdl et${i}
      done
      ifconfig -a
      lsdev -Cc adapter | grep ent
    

    # mxfapvio10: Rediscover all ethernet adapters

      cfgmgr
      lsdev -Cc adapter | grep ent
      lsdev -C | grep inet
      lsdev -C | grep lo
      lscfg -l ent*
    

    # mxfapvio10: turn off the chksum_offload parameter on all adapters

      for i in 10 9 8 7 6 5 4 3 2 1 0
      do
        lsattr -El ent${i} | grep chksum_offload
        chdev -l ent${i} -a chksum_offload=no
        chdev -l ent${i} -a chksum_offload=no -P
        lsattr -El ent${i} | grep chksum_offload
      done
    

    # mxfapvio10: identify the application ethernet adapters in slot T6

      lsdev -Cc adapter | grep ent
      ETHADAPT='ent0,ent4,ent6'
    

    # mxfapvio10: Create the application etherchannel adapter

      if mkdev -c adapter -s pseudo -t ibm_ech \
           -a adapter_names="${ETHADAPT}" \
           -a netaddr=10.189.41.1
      then
        /usr/lib/methods/defif
      fi
    

    # mxfapvio10: identify the MC2 ethernet adapter in slot P1-C4 port 2

      lsdev -Cc adapter | grep ent
      ETHADAPT='ent3'
    

    # mxfapvio10: Create the MC2 etherchannel adapter

      if mkdev -c adapter -s pseudo -t ibm_ech \
           -a adapter_names="${ETHADAPT}" \
           -a netaddr=206.245.38.1
      then
        /usr/lib/methods/defif
      fi
      lsdev -Cc adapter | grep ent
    

      chdev -l ent12 -a mode=round_robin
      lsattr -El ent12
    

      chdev -l ent13 -a mode=standard
      lsattr -El ent13
    

    # mxfapvio10: build the SEA's (shared ethernet adapters) Use the virtual ethernet adapters associated with slots 500 and 850.

      /usr/ios/cli/ioscli mkvdev -sea ent12 -vadapter ent8 -default ent8 -defaultid 2012
      /usr/ios/cli/ioscli mkvdev -sea ent13 -vadapter ent10 -default ent10 -defaultid 520
    

    # mxfapvio10: configure IP addresses on virtual ethernet adapters associated with slots 510 and 860

      smitty tcpip
    

    # mxfapvio10: en9: inet 10.189.41.7 netmask 255.255.255.0

    # mxfapvio10: en11: inet 206.245.38.61 netmask 255.255.255.0

      chdev -l inet0 -a delroute='net,-hopcount,0,,0,206.245.38.1'
      route add 206.245.37.0 206.245.38.1
      vi /etc/rc.net
          route add 206.245.37.0 206.245.38.1
    

    # mxfapvio10: Shutdown VIO LPAR and remove the SCSI adapters from HMC profile for this LPAR.

    # mxfapvio10: DQDPKWA-T12 mxfapvio10 Storage Controller

    # mxfapvio10: Reboot VIO server from SAN disk.


    # mxfapvio11: Login to the VIO server "mxfapvio11" using the "padmin" account and accept the license agreement:

      license -accept
    

    # mxfapvio11: Then run the "oem_setup_env" command to gain "root" access to the VIO server system, and start a Korn Shell 93 shell

      ksh93
    

    # mxfapvio11: Set the root password to "password" for now.

    # mxfapvio11: Change the hostname to "mxfapvio11" and modify the /etc/rc.net file to reflect this hostname change:

      smitty tcpip
      
      vi /etc/rc.net
    

    # mxfapvio11: Setup the password-less ssh login between the NIM server and the VIO server for the "root" user.

    # mxfapvio11: Begin by loading the additional MPIO drivers necessary to communicate with the SAN system.

    # mxfapvio11: Copy the XP array MPIO tar file from the NIM server, extract and install:

      mkdir /tmp/xpmpio
      cd /tmp/xpmpio
      scp root@206.245.37.100:/home/s45x/dukeEnergy/XPMPIO1.tar .
      tar -xvf ./XPMPIO1.tar
      inutoc .
      smitty install_all
      
        INPUT device / directory for software              [.]
      
        Install and Update from ALL Available Software
          SOFTWARE to install                                [all]
          PREVIEW only? (install operation will NOT occur)    no
          COMMIT software updates?                            no
          SAVE replaced files?                                yes
          ACCEPT new license agreements?                      no
    

    # mxfapvio11: Now remove all SAN disks, fscsi, and fcs adapters and reboot the VIO server in order for the new drivers to take effect:

      rmdev -Rdl fcs0
      rmdev -Rdl fcs1
      shutdown -Fr
    


    # mxfapvio11: After the system reboots, login to the VIO server using the "padmin" account, then run the "oem_setup_env" command to gain "root" access to the VIO server system, and start a Korn Shell 93 shell

      ksh93
    

    # mxfapvio11: Upgrade VIO IOS to latest level

      mount 206.245.37.100:/export/lpp_source/aix /mnt
      su - padmin
      emgr -P  # identify and remove any efixes
      emgr -e 'efix label'
      updateios -dev /mnt/vio_1301 --accept --install
    

    # mxfapvio11: Reboot VIO server

      shutdown -Fr
    


    # mxfapvio11: After the system reboots, login to the VIO server using the "padmin" account, then run the "oem_setup_env" command to gain "root" access to the VIO server system, and start a Korn Shell 93 shell

      ksh93
    

    # mxfapvio11: verify WWN's and SAN connectivity with Mike wilson.

    # mxfapvio11: identify hdisk to use for this VIO operating system SAN boot.

    # mxfapvio11: Remove all FC attached disks

      for i in $( lsdev -Cc disk -s fcp -F name | grep hdisk )
      do
        print -- rmdev -Rdl ${i}
        rmdev -Rdl ${i}
      done
    

    # mxfapvio11: Set fast fail parameter for SCSI adapters and reconfigure FC adapters

      chdev -l fscsi0 -a fc_err_recov=fast_fail
      chdev -l fscsi1 -a fc_err_recov=fast_fail 
      cfgmgr -vl fcs0
      cfgmgr -vl fcs1
    

    # mxfapvio11: Change reserve policy on hdisks to "no_reserve"

      for i in $( lsdev -Cc disk -s fcp -F name | grep hdisk )
      do
        chdev -l ${i} -a reserve_policy=no_reserve
        chdev -l ${i} -a algorithm=round_robin
        chdev -l ${i} -a hcheck_interval=20
        chdev -l ${i} -a queue_depth=16
        chdev -l ${i} -a pv=yes
      done
    

    # mxfapvio11: copy the vscsiPriority script from the NIM server to the VIO server and set the path priority for each disk.

      mkdir /usr/local/scripts
      scp root@206.245.37.100:/home/s45x/dukeEnergy/vscsiPriority.ksh /usr/local/scripts
      /usr/local/scripts/vscsiPriority.ksh -voi 20
      
      for i in $( lsdev -Cc disk -s fcp -F name )
      do
        P0=$( lspath -Al ${i} -p fscsi0 -F value -a priority )     
        P1=$( lspath -Al ${i} -p fscsi1 -F value -a priority )      
        print "${i} : fscsi0 : priority = ${P0}"     
        print "${i} : fscsi1 : priority = ${P1}"     
      done
    

    # mxfapvio11: Allocate each SAN disk for use as VIO operating system storage and mirror from internal hard drive. Change system to boot from SAN.

      extendvg rootvg hdisk2
      mirrorvg rootvg hdisk2
      bosboot -ad /dev/hdisk2
      bootlist -m normal hdisk2 hdisk0
      bootlist -m normal -o
    

    # mxfapvio11: remove the internal SCSI disk from the rootvg and the system

      unmirrorvg rootvg hdisk0
      reducevg roovg hdisk0
      rmdev -Rdl hdisk0
    

    # mxfapvio11: Reconfigure ethernet adapters for etherchannel configuration, begin by unconfiguring all ethernet adapters

      lscfg -l ent*
      for i in 15 14 13 12 11 10 9 8 7 6 5 4 3 2 1 0
      do
        ifconfig en${i} down
        ifconfig en${i} detach
        ifconfig et${i} down
        ifconfig et${i} detach
        rmdev -Rdl ent${i}
        rmdev -Rdl en${i}
        rmdev -Rdl et${i}
      done
      ifconfig -a
      lsdev -Cc adapter | grep ent
    

    # mxfapvio11: Rediscover all ethernet adapters

      cfgmgr
      lsdev -Cc adapter | grep ent
      lsdev -C | grep inet
      lsdev -C | grep lo
      lscfg -l ent*
    

    # mxfapvio11: turn off the chksum_offload parameter on all adapters

      for i in 10 9 8 7 6 5 4 3 2 1 0
      do
        lsattr -El ent${i} | grep chksum_offload
        chdev -l ent${i} -a chksum_offload=no
        chdev -l ent${i} -a chksum_offload=no -P
        lsattr -El ent${i} | grep chksum_offload
      done
    

    # mxfapvio11: identify the application ethernet adapters in slot P1-C3

      lsdev -Cc adapter | grep ent
      ETHADAPT='ent0,ent2,ent4'
    

    # mxfapvio11: Create the application etherchannel adapter

      if mkdev -c adapter -s pseudo -t ibm_ech -a adapter_names="${ETHADAPT}"
      then
        /usr/lib/methods/defif
      fi
    

    # mxfapvio11: identify the MC2 ethernet adapter in second port of the top drawer in slot P1-C3

      lsdev -Cc adapter | grep ent
      ETHADAPT='ent1'
    

    # mxfapvio11: Create the MC2 etherchannel adapter

      if mkdev -c adapter -s pseudo -t ibm_ech -a adapter_names="${ETHADAPT}"
      then
        /usr/lib/methods/defif
      fi
      lsdev -Cc adapter | grep ent
    

      chdev -l ent10 -a mode=round_robin
      chdev -l ent11 -a mode=standard
      lsattr -El ent10
      lsattr -El ent11
    

    # mxfapvio11: build the SEA's (shared ethernet adapters) Use the virtual ethernet adapters associated with slots 500 and 850.

      /usr/ios/cli/ioscli mkvdev -sea ent10 -vadapter ent6 -default ent6 -defaultid 2012
      /usr/ios/cli/ioscli mkvdev -sea ent11 -vadapter ent8 -default ent8 -defaultid 520
    

    # mxfapvio11: configure IP addresses on virtual ethernet adapters associated with slots 510 and 860

      smitty tcpip
    

    # mxfapvio11: en7: inet 10.189.41.8 netmask 255.255.255.0

    # mxfapvio11: en9: inet 206.245.38.62 netmask 255.255.255.0

      chdev -l inet0 -a delroute='net,-hopcount,0,,0,206.245.38.1'
      route add 206.245.37.0 206.245.38.1
      vi /etc/rc.net
          route add 206.245.37.0 206.245.38.1
    

    # mxfapvio11: Shutdown VIO LPAR and remove the SCSI adapters from HMC # profile for this LPAR.

    # mxfapvio11: DQDPRNR-T12 mxfapvio11 Storage Controller

    # mxfapvio11: Reboot VIO server from SAN disk.


    # mxfapvio10: login to VIO server as padmin and change to "oem_setup_env" and # start a Korn shell 93 shell.

      oem_setup_env
      ksh93
    

  • Identify SAN disk to use for operating system of LPAR mxfapdef00
  • Identify SAN disk to use for operating system of LPAR mxfapdef01
  • Identify SAN disk to use for operating system of LPAR mxfapdef02
  • Identify SAN disk to use for operating system of LPAR mxfapdef03
  • Identify SAN disk to use for operating system of LPAR mxfapdef04

      lspv
    

  • Identify vhost adapter to use for OS of LPAR mxfapdef00
  • Identify vhost adapter to use for OS of LPAR mxfapdef01
  • Identify vhost adapter to use for OS of LPAR mxfapdef02
  • Identify vhost adapter to use for OS of LPAR mxfapdef03
  • Identify vhost adapter to use for OS of LPAR mxfapdef04

      /usr/ios/cli/ioscli lsmap -all | grep vhost | head -30
    

  • Use vhost adapter in slot C10 for OS of LPAR mxfapdef00

      vhost adapter will probably be "vhost0"
    

  • Use vhost adapter in slot C20 for OS of LPAR mxfapdef01

      vhost adapter will probably be "vhost3"
    

  • Use vhost adapter in slot C30 for OS of LPAR mxfapdef02

      vhost adapter will probably be "vhost6"
    

  • Use vhost adapter in slot C40 for OS of LPAR mxfapdef03

      vhost adapter will probably be "vhost9"
    

  • Use vhost adapter in slot C50 for OS of LPAR mxfapdef04

      vhost adapter will probably be "vhost12"
    

    # mxfapvio10: Ensure the vhost adapters are empty, assuming the above # vhost adapter numbers.

      /usr/ios/cli/ioscli rmdev -pdev vhost0
      /usr/ios/cli/ioscli rmdev -pdev vhost3
      /usr/ios/cli/ioscli rmdev -pdev vhost6
      /usr/ios/cli/ioscli rmdev -pdev vhost9
      /usr/ios/cli/ioscli rmdev -pdev vhost12
    

    # mxfapvio10: Add the SAN boot disk to the vhost adapter for each LPAR

      /usr/ios/cli/ioscli mkvdev -vdev hdisk3 -vadapter vhost0  -dev Amxfapdef00003
      /usr/ios/cli/ioscli mkvdev -vdev hdisk4 -vadapter vhost3  -dev Amxfapdef01004
      /usr/ios/cli/ioscli mkvdev -vdev hdisk5 -vadapter vhost6  -dev Amxfapdef02005
      /usr/ios/cli/ioscli mkvdev -vdev hdisk6 -vadapter vhost9  -dev Amxfapdef03006
      /usr/ios/cli/ioscli mkvdev -vdev hdisk7 -vadapter vhost12 -dev Amxfapdef04007
    


    # mxfapvio11: login to VIO server as padmin and change to "oem_setup_env" and # start a Korn shell 93 shell.

      oem_setup_env
      ksh93
    

  • Identify SAN disk to use for operating system of LPAR mxfapdef00
  • Identify SAN disk to use for operating system of LPAR mxfapdef01
  • Identify SAN disk to use for operating system of LPAR mxfapdef02
  • Identify SAN disk to use for operating system of LPAR mxfapdef03
  • Identify SAN disk to use for operating system of LPAR mxfapdef04

      lspv
    

  • Identify vhost adapter to use for OS of LPAR mxfapdef00
  • Identify vhost adapter to use for OS of LPAR mxfapdef01
  • Identify vhost adapter to use for OS of LPAR mxfapdef02
  • Identify vhost adapter to use for OS of LPAR mxfapdef03
  • Identify vhost adapter to use for OS of LPAR mxfapdef04

      /usr/ios/cli/ioscli lsmap -all | grep vhost | head -30
    

  • Use vhost adapter in slot C10 for OS of LPAR mxfapdef00

      vhost adapter will probably be "vhost0"
    

  • Use vhost adapter in slot C20 for OS of LPAR mxfapdef01

      vhost adapter will probably be "vhost3"
    

  • Use vhost adapter in slot C30 for OS of LPAR mxfapdef02

      vhost adapter will probably be "vhost6"
    

  • Use vhost adapter in slot C40 for OS of LPAR mxfapdef03

      vhost adapter will probably be "vhost9"
    

  • Use vhost adapter in slot C50 for OS of LPAR mxfapdef04

      vhost adapter will probably be "vhost12"
    

    # mxfapvio11: Ensure the vhost adapters are empty, assuming the above vhost adapter numbers.

      /usr/ios/cli/ioscli rmdev -pdev vhost0
      /usr/ios/cli/ioscli rmdev -pdev vhost3
      /usr/ios/cli/ioscli rmdev -pdev vhost6
      /usr/ios/cli/ioscli rmdev -pdev vhost9
      /usr/ios/cli/ioscli rmdev -pdev vhost12
    

    # mxfapvio11: Add the SAN boot disk to the vhost adapter for each LPAR

      /usr/ios/cli/ioscli mkvdev -vdev hdisk3 -vadapter vhost0  -dev Amxfapdef00003
      /usr/ios/cli/ioscli mkvdev -vdev hdisk4 -vadapter vhost3  -dev Amxfapdef01004
      /usr/ios/cli/ioscli mkvdev -vdev hdisk5 -vadapter vhost6  -dev Amxfapdef02005
      /usr/ios/cli/ioscli mkvdev -vdev hdisk6 -vadapter vhost9  -dev Amxfapdef03006
      /usr/ios/cli/ioscli mkvdev -vdev hdisk7 -vadapter vhost12 -dev Amxfapdef04007
    


    # mxfapnim01: Create the client LPAR boot image on the NIM Server

  • Prepare Installation files:
  • Login to mxfapnim01 as root and copy installation files from mxdapnim01:

        scp root@mxdapnim01:/export/mksysb/mksysb_gold_5300-05-04 /export/mksysb
    

  • Define NIM Resources:
  • Define the mksysb_image resource object

        nim -o define -t mksysb \
        -a location=/export/mksysb/mksysb_gold_5300-05-04 \
        -a server=master mksysb_gold_5300-05-04
    

  • Define the SPOT resource object

        mkdir -p /export/spot
    

        nim -o define -t spot -a server=master \
        -a location=/export/spot \
        -a source=mksysb_gold_5300-05-04  aixspot_gold_5300-05-04
    


    # mxfapdef00: From the HMC, boot the system to SMS and define the network boot IP information.

       Client IP: 206.245.38.63
       Server IP: 206.245.37.100
      Gateway IP: 206.245.38.1
         NetMask: 255.255.255.0
    

    # mxfapnim01: Define the LPAR as a machine to NIM using the node name "mxfapdef00-mc2"

    # mxfapnim01: Configure the NIM server to perform a remote operating system load of the client LPAR "mxfapdef00-mc2":

      smitty nim
        Perform NIM Software Installation and Maintenance Tasks
          Install and Update Software
            Install the Base Operating System on Standalone Clients
              Select Target Machine - mxfapdef00-mc2
              Select the installation TYPE - mksysb
              Select the MKSYSB to use for the installation - mksysb_gold_5300-05-04
              Select the SPOT to use for the installation - aixspot_gold_5300-05-04
      
              Install the Base Operating System on Standalone Clients
    

          ACCEPT new license agreements?                   [yes]
        Initiate reboot and installation now?              [no]
          ACCEPT new license agreements?                   [yes]
    

    # mxfapdef00: Continue the network boot.


    # mxfapdef01: From the HMC, boot the system to SMS and define the network boot IP information.

       Client IP: 206.245.38.64
       Server IP: 206.245.37.100
      Gateway IP: 206.245.38.1
         NetMask: 255.255.255.0
    

    # mxfapnim01: Define the LPAR as a machine to NIM using the node name "mxfapdef01-mc2"

    # mxfapnim01: Configure the NIM server to perform a remote operating system load of the client LPAR "mxfapdef01-mc2":

      smitty nim
        Perform NIM Software Installation and Maintenance Tasks
          Install and Update Software
            Install the Base Operating System on Standalone Clients
              Select Target Machine - mxfapdef01-mc2
              Select the installation TYPE - mksysb
              Select the MKSYSB to use for the installation - mksysb_gold_5300-05-04
              Select the SPOT to use for the installation - aixspot_gold_5300-05-04
    

              Install the Base Operating System on Standalone Clients
      
          ACCEPT new license agreements?                   [yes]
        Initiate reboot and installation now?              [no]
          ACCEPT new license agreements?                   [yes]
    

    # mxfapdef01: Continue the network boot.


    # mxfapdef02: From the HMC, boot the system to SMS and define the network boot IP information.

       Client IP: 206.245.38.65
       Server IP: 206.245.37.100
      Gateway IP: 206.245.38.1
         NetMask: 255.255.255.0
    

    # mxfapnim01: Define the LPAR as a machine to NIM using the node name "mxfapdef02-mc2"

    # mxfapnim01: Configure the NIM server to perform a remote operating system load of the client LPAR "mxfapdef02-mc2":

      smitty nim
        Perform NIM Software Installation and Maintenance Tasks
          Install and Update Software
            Install the Base Operating System on Standalone Clients
              Select Target Machine - mxfapdef02-mc2
              Select the installation TYPE - mksysb
              Select the MKSYSB to use for the installation - mksysb_gold_5300-05-04
              Select the SPOT to use for the installation - aixspot_gold_5300-05-04
      
              Install the Base Operating System on Standalone Clients
      
          ACCEPT new license agreements?                   [yes]
        Initiate reboot and installation now?              [no]
          ACCEPT new license agreements?                   [yes]
    

    # mxfapdef02: Continue the network boot.


    # mxfapdef03: From the HMC, boot the system to SMS and define the network boot IP information.

       Client IP: 206.245.38.66
       Server IP: 206.245.37.100
      Gateway IP: 206.245.38.1
         NetMask: 255.255.255.0
    

    # mxfapnim01: Define the LPAR as a machine to NIM using the node name "mxfapdef03-mc2"

    # mxfapnim01: Configure the NIM server to perform a remote operating system load of the client LPAR "mxfapdef03-mc2":

      smitty nim
        Perform NIM Software Installation and Maintenance Tasks
          Install and Update Software
            Install the Base Operating System on Standalone Clients
              Select Target Machine - mxfapdef03-mc2
              Select the installation TYPE - mksysb
              Select the MKSYSB to use for the installation - mksysb_gold_5300-05-04
              Select the SPOT to use for the installation - aixspot_gold_5300-05-04
      
              Install the Base Operating System on Standalone Clients
      
          ACCEPT new license agreements?                   [yes]
        Initiate reboot and installation now?              [no]
          ACCEPT new license agreements?                   [yes]
    

    # mxfapdef03: Continue the network boot.


    # mxfapdef04: From the HMC, boot the system to SMS and define the network boot IP information.

       Client IP: 206.245.38.67
       Server IP: 206.245.37.100
      Gateway IP: 206.245.38.1
         NetMask: 255.255.255.0
    

    # mxfapnim01: Define the LPAR as a machine to NIM using the node name "mxfapdef04-mc2"

    # mxfapnim01: Configure the NIM server to perform a remote operating system load of the client LPAR "mxfapdef04-mc2":

      smitty nim
        Perform NIM Software Installation and Maintenance Tasks
          Install and Update Software
            Install the Base Operating System on Standalone Clients
              Select Target Machine - mxfapdef04-mc2
              Select the installation TYPE - mksysb
              Select the MKSYSB to use for the installation - mksysb_gold_5300-05-04
              Select the SPOT to use for the installation - aixspot_gold_5300-05-04
      
              Install the Base Operating System on Standalone Clients
      
          ACCEPT new license agreements?                   [yes]
        Initiate reboot and installation now?              [no]
          ACCEPT new license agreements?                   [yes]
    

    # mxfapdef04: Continue the network boot.


    # mxfapdef0?: On each client LPAR: copy the vscsiPriority script from the NIM server to the VIO server and set the path priority for each disk.

      mkdir /usr/local/scripts
      scp root@206.245.37.100:/home/s45x/dukeEnergy/vscsiPriority.ksh /usr/local/scripts
      /usr/local/scripts/vscsiPriority.ksh -voi 20
      
      for i in $( lsdev -Cc disk -s vscsi -F name )
      do
        P0=$( lspath -Al ${i} -p vscsi0 -F value -a priority )     
        P1=$( lspath -Al ${i} -p vscsi1 -F value -a priority )      
        print "${i} : vscsi0 : priority = ${P0}"     
        print "${i} : vscsi1 : priority = ${P1}"     
      done
    


    # mxfapdef0?: On each client LPAR: clean-up any leftover info from mksysb install

      rmuser oradef0
      rmuser oradef1
      rmuser oradef2
      rmuser oradef3
      rmuser oradef4
      rmuser oradef5
      rmuser oradef6
      rmuser oradef7
      rmuser oradef8
      rmuser oraedn1
      rmuser oraedn2
      rmuser shre
      rmuser organ
      
      rm -rf /home/organ
      rm -rf /home/oradef
      rm -rf /home/oraedn1
      rm -rf /home/oraedn2
      rm -rf /home/shre
      rm  -f /home/tibco
      
      rm -rf /ednddtu1
      rm -rf /ednddtu2
      rm -rf /aacal01
      rm -rf /adcal01
      rm -rf /mnt1
      rm -rf /mnt2
      rm -rf /mnt3
      rm -rf /mnt4
      rm -rf /mnt5
      rm -rf /nohup.out
      rm -rf smit.*
      rm -rf /dolvs.*
      rm /usr/local/scripts/defdd*
      rm /usr/local/hascripts/edn*
      rm /usr/local/hascripts/start_*
      rm /usr/local/hascripts/stop_*
    


    # mxfapdef0?: On each Client LPAR: configure the node name and host name

      uname -S mxfapdef00
      hostname mxfapdef00
    

      uname -S mxfapdef01
      hostname mxfapdef01
    

      uname -S mxfapdef02
      hostname mxfapdef02
    

      uname -S mxfapdef03
      hostname mxfapdef03
    

      uname -S mxfapdef04
      hostname mxfapdef04
    

    # mxfapdef0?: On each Client LPAR: Configure LPAR etherchannel devices

    # mxfapdef0?: On each client LPAR: configure a static route to the mxfapnim01 network

      lsattr -El inet0
      chdev -l inet0 -a delroute='net,-hopcount,0,,0,206.245.38.1'
      lsattr -El inet0
      route add 206.245.37.0 206.245.38.1
      netstat -rn
      
    

    # mxfapdef0?: ADMINISTRATORS NOTE: It is usually easier to remove all ethernet information and start from the beginning than to attempt to fix a flawed configuration.

    # mxfapdef0?: Unconfigure all ethernet adapters

      lscfg -l ent*
      for i in 15 14 13 12 11 10 9 8 7 6 5 4 3 2 1 0
      do
        ifconfig en${i} down  
        ifconfig en${i} detach
        ifconfig et${i} down  
        ifconfig et${i} detach
        rmdev -Rdl ent${i}
        rmdev -Rdl en${i}
        rmdev -Rdl et${i}
      done
      ifconfig -a
      lsdev -Cc adapter | grep ent
    

    # mxfapdef0?: Rediscover all ethernet adapters

      cfgmgr
      lsdev -Cc adapter | grep ent
      lsdev -C | grep inet
      lsdev -C | grep lo
      lscfg -l ent*
    

    # mxfapdef0?: turn off the chksum_offload parameter on all adapters

      for i in 10 9 8 7 6 5 4 3 2 1 0
      do
        lsattr -El ent${i} | grep chksum_offload
        chdev -l ent${i} -a chksum_offload=no   
        chdev -l ent${i} -a chksum_offload=no -P
        lsattr -El ent${i} | grep chksum_offload
      done
    

    # mxfapdef0?: Even numbered hosts should use the even numbered virtual ethernet adapter as primary network path.

    # mxfapdef0?: Odd numbered hosts should use the odd numbered virtual ethernet adapter as primary network path.

      
      NETADDR="10.189.40.1"   
      MC2ADDR="206.245.38.1"  
      ZERO=0
      ONE=1
      TWO=2
      THREE=3
    

    # mxfapdef0?: If the hostname is odd numbered, reverse the adapter order

      if [[ "$( hostname )" == *[13579] ]]
      then
        ZERO=1
        ONE=0
        TWO=3
        THREE=2
      fi
      
      if mkdev -c adapter -s pseudo -t ibm_ech \
         -a adapter_names="ent${ZERO}" \
         -a backup_adapter="ent${ONE}" \
         -a netaddr="${NETADDR}"  
      then
          /usr/lib/methods/defif
      fi
      if mkdev -c adapter -s pseudo -t ibm_ech \
         -a adapter_names="ent${TWO}" \
         -a backup_adapter="ent${THREE}" \
         -a netaddr="${MC2ADDR}"
      then
          /usr/lib/methods/defif
      fi
      lsdev -Cc adapter | grep ent   
      
      lsattr -El ent4
      lsattr -El ent5
      
    
    


    # mxfapdef0?: On each client LPAR: configure IP addresses on etherchannels

      smitty tcpip
    

    # mxfapdef0?: use the following information specific to each client LPAR

      
    
  • mxfapdef00-pers: en4: inet 10.189.41.10 netmask 0xffffff00
  • mxfapdef00-mc2: en5: inet 206.245.38.63 netmask 0xfffffe00
  • mxfapdef01-pers: en4: inet 10.189.41.11 netmask 0xffffff00
  • mxfapdef01-mc2: en5: inet 206.245.38.64 netmask 0xfffffe00
  • mxfapdef02-pers: en4: inet 10.189.41.12 netmask 0xffffff00
  • mxfapdef02-mc2: en5: inet 206.245.38.65 netmask 0xfffffe00
  • mxfapdef03-pers: en4: inet 10.189.41.13 netmask 0xffffff00
  • mxfapdef03-mc2: en5: inet 206.245.38.66 netmask 0xfffffe00
  • mxfapdef04-pers: en4: inet 10.189.41.14 netmask 0xffffff00
  • mxfapdef04-mc2: en5: inet 206.245.38.67 netmask 0xfffffe00
  • # mxfapdef0?: On each client LPAR: configure a static route to the mxfapnim01 network

      lsattr -El inet0
      chdev -l inet0 -a delroute='net,-hopcount,0,,0,206.245.38.1'
      lsattr -El inet0
      route add 206.245.37.0 206.245.38.1
      netstat -rn
      
      vi /etc/rc.net
          /usr/sbin/route add 206.245.37.0 206.245.38.1
          /bin/hostname mxfapdef0?
    


    # mxfapdef0?: On each client LPAR: Add the following entries to the /etc/hosts file on all client LPAR's, VIO servers, and mxfapnim01

      127.0.0.1	loopback		localhost
      206.245.37.100	mxfapnim01-mc2.def.ad	mxfapnim01-mc2	mxfapnim01
      
      206.245.38.60	mxflphmc10-mc2.def.ad	mxflphmc10-mc2
      206.245.38.61	mxfapvio10-mc2.def.ad	mxfapvio10-mc2
      206.245.38.62	mxfapvio11-mc2.def.ad	mxfapvio11-mc2
      206.245.38.63	mxfapdef00-mc2.def.ad	mxfapdef00-mc2
      206.245.38.64	mxfapdef01-mc2.def.ad	mxfapdef01-mc2
      206.245.38.65	mxfapdef02-mc2.def.ad	mxfapdef02-mc2
      206.245.38.66	mxfapdef03-mc2.def.ad	mxfapdef03-mc2
      206.245.38.67	mxfapdef04-mc2.def.ad	mxfapdef04-mc2
      
      10.189.41.6	mxflphmc10.def.ad	mxflphmc10
      10.189.41.7	mxfapvio10.def.ad	mxfapvio10
      10.189.41.8	mxfapvio11.def.ad	mxfapvio11
      
      10.189.41.10	mxfapdef00-pers.def.ad	mxfapdef00-pers
      10.189.41.11	mxfapdef01-pers.def.ad	mxfapdef01-pers
      10.189.41.12	mxfapdef02-pers.def.ad	mxfapdef02-pers
      10.189.41.13	mxfapdef03-pers.def.ad	mxfapdef03-pers
      10.189.41.14	mxfapdef04-pers.def.ad	mxfapdef04-pers
      10.189.41.20	mxfapdef00.def.ad	mxfapdef00
      10.189.41.21	mxfapdef01.def.ad	mxfapdef01
      10.189.41.22	mxfapdef02.def.ad	mxfapdef02
      10.189.41.23	mxfapdef03.def.ad	mxfapdef03
      10.189.41.24	mxfapdef04.def.ad	mxfapdef04
      10.189.41.30	mxfapdef00-rg01.def.ad	mxfapdef00-rg01
      10.189.41.31	mxfapdef01-rg01.def.ad	mxfapdef01-rg01
      10.189.41.32	mxfapdef02-rg01.def.ad	mxfapdef02-rg01
      10.189.41.33	mxfapdef03-rg01.def.ad	mxfapdef03-rg01
      10.189.41.34	mxfapdef04-rg01.def.ad	mxfapdef04-rg01
    


    # mxfapdef0?: Configure groups


    # mxfapdef0?: On each client LPAR: Configure users and set passwords

      mkdir /usr/local/bin
      scp root@mxfapnim01:/usr/local/bin/setpwd /usr/local/bin
    

      UID=$( echo avanduyn | sum -r )
      UID="${UID//[!0-9]/}"
      mkuser id=${UID} gecos="Al Vanduyn|CGE|816.459.3059|Alvin.VanDuyne@capgemini.com" avanduyn
      /usr/local/bin/setpwd -u avanduyn -p 'yrXB8jKX'
      grep avanduyn /etc/passwd
    

      UID=$( echo skuditin | sum -r )
      UID="${UID//[!0-9]/}"
      mkuser id=${UID} gecos="Sanjay Kuditini|CGE|816.347.7602|sanjay.kuditini@capgemini.com" skuditin
      /usr/local/bin/setpwd -u skuditin -p 'mixM5jm='
      grep skuditin /etc/passwd
    

      UID=$( echo avonnied | sum -r )
      UID="${UID//[!0-9]/}"
      mkuser id=${UID} gecos="Adam vonNieda|CGE|816.347.7941|adam.vonnieda@capgemini.com" avonnied
      /usr/local/bin/setpwd -u avonnied -p 'uA@Lj44&'
      grep avonnied /etc/passwd
    

      mkgroup -A id=369751 dbaora
      mkgroup -A id=574551 defs
    

      mkuser id=214 gecos="People Soft Account" groups='staff,defs' psoft
      chuser fsize='-1' psoft
      chuser  data='-1' psoft
      chuser stack='-1' psoft
      /usr/local/bin/setpwd -u psoft -p password
      id psoft
    

      mkuser id=3553 gecos="Oracle DB Account" groups='dbaora,defs' oracle
      chuser fsize='-1' oracle
      chuser  data='-1' oracle
      chuser stack='-1' oracle
      /usr/local/bin/setpwd -u oracle -p password
      id oracle
    

      mkgroup -A id=369751 dbaora
      chuser pgrp='dbaora' groups='dbaora,defs' psoft
      chuser pgrp='dbaora' groups='dbaora,defs' oracle
      egrep '^dbaora:|^defs:' /etc/group
     
    
    


    # mxfapdef0?: On each client LPAR: Configure performance tools/nfs directory

      smitty mknfsmnt
        Add a File System for Mounting
          Pathname of mount point                            [/prfpmce0]
          Pathname of remote directory                       [/prfpmce0]
          Host where remote directory resides                [206.245.37.100]
          Security method                                    [sys]
          Mount now, add entry to /etc/filesystems or both?   both
          /etc/filesystems entry will mount the directory     yes
            on system restart. 
          Mode for this NFS file system                       read-write
          Attempt mount in background or foreground           background
          Mount file system soft or hard                      hard
    

      rmfs /prfdmce0
      rmfs /prfpmce0
      /usr/sbin/mknfsmnt -f /prfpmce0 -d /prfpmce0 -h 206.245.37.100 -M sys \
        -B -A -t rw -w bg -Y -Z -X -H -j -q -g
    

      lsfs /prfpmce0
      df
    

      mkdir -p /prfpmce1/mxfapdef00/Top
      mkdir -p /prfpmce0/mxfapdef00/wlm
      mkdir -p /prfpmce0/mxfapdef01/Top
      mkdir -p /prfpmce0/mxfapdef01/wlm
      mkdir -p /prfpmce0/mxfapdef02/Top
      mkdir -p /prfpmce0/mxfapdef02/wlm
      mkdir -p /prfpmce0/mxfapdef03/Top
      mkdir -p /prfpmce0/mxfapdef03/wlm
      mkdir -p /prfpmce0/mxfapdef04/Top
      mkdir -p /prfpmce0/mxfapdef04/wlm
    


    # mxfapdef0?: On each client LPAR: Configure NFS installation NFS directory

      mount 206.245.37.100:/export/defs /mnt
    





    # mxfapdef0?: Request application storage from SAN Group - Mike Wilson


    # mxfapvio??: Configure application storage from SAN on both VIO servers

    # mxfapvio10: discover the application SAN storage disks

      cfgmgr
    

    # mxfapvio10: Change reserve policy on hdisks to "no_reserve"

        
      for i in $( lsdev -Cc disk -s fcp -F name | grep hdisk )
      do
        chdev -l ${i} -a pv=yes
        chdev -l ${i} -a reserve_policy=no_reserve
        chdev -l ${i} -a algorithm=round_robin
        chdev -l ${i} -a hcheck_interval=20
        chdev -l ${i} -a queue_depth=16
      done
    

      for i in $( lsdev -Cc disk -s fcp -F name | grep hdisk )
      do
        lsattr -El ${i} -a reserve_policy -F name=value
        lsattr -El ${i} -a algorithm -F name=value
        lsattr -El ${i} -a hcheck_interval -F name=value
        lsattr -El ${i} -a queue_depth -F name=value
      done
    

    # mxfapvio10: set the path priority for each disk.

      /usr/local/scripts/vscsiPriority.ksh -vi 20
      /usr/local/scripts/vscsiPriority.ksh -voi 20
    

      for i in $( lsdev -Cc disk -s fcp -F name )
      do
        P0=$( lspath -Al ${i} -p fscsi0 -F value -a priority )
        P1=$( lspath -Al ${i} -p fscsi1 -F value -a priority )
        print "${i} : fscsi0 : priority = ${P0}"
        print "${i} : fscsi1 : priority = ${P1}"
      done
    

    # mxfapvio10: copy the storage allocation script from the NIM server to mxfapvio10 and execute it on mxfapvio10.

    # mxfapvio10: You will need to EDIT mkvdev.mxfapvio10.ksh to have the correct hdisk numbers

    # mxfapvio10: allocate the hdisks to the vhost adapters using a prewritten script

      scp root@mxfapnim01:/home/s45x/dukeEnergy/mkvdev.mxfapvio10.ksh /home/padmin
      cd /home/padmin
      vi  ./mkvdev.mxfapvio10.ksh  # EDIT hdisk numbers
      ./mkvdev.mxfapvio10.ksh
    

    # mxfapvio10: reboot the VIO server so that path priority settings take effect


    # mxfapvio11: discover the application SAN storage disks

      cfgmgr
    

    # mxfapvio11: Change reserve policy on hdisks to "no_reserve"

        
      for i in $( lsdev -Cc disk -s fcp -F name | grep hdisk )
      do
        chdev -l ${i} -a reserve_policy=no_reserve
        chdev -l ${i} -a algorithm=round_robin  
        chdev -l ${i} -a hcheck_interval=20
        chdev -l ${i} -a queue_depth=16
        chdev -l ${i} -a pv=yes
      done
    

    # mxfapvio11: set the path priority for each disk.

      /usr/local/scripts/vscsiPriority.ksh -vi 20
      /usr/local/scripts/vscsiPriority.ksh -voi 20
    

      for i in $( lsdev -Cc disk -s fcp -F name )
      do
        P0=$( lspath -Al ${i} -p fscsi0 -F value -a priority )
        P1=$( lspath -Al ${i} -p fscsi1 -F value -a priority )
        print "${i} : fscsi0 : priority = ${P0}"
        print "${i} : fscsi1 : priority = ${P1}"
      done
    

    # mxfapvio11: copy the storage allocation script from the NIM server to mxfapvio11 and execute it on mxfapvio11.

    # mxfapvio11: You will need to EDIT mkvdev.mxfapvio11.ksh to have the correct hdisk numbers

    # mxfapvio11: allocate the hdisks to the vhost adapters using a prewritten script

      scp root@mxfapnim01:/home/s45x/dukeEnergy/mkvdev.mxfapvio11.ksh /home/padmin
      cd /home/padmin
      vi  ./mkvdev.mxfapvio11.ksh  # EDIT hdisk numbers
      ./mkvdev.mxfapvio11.ksh
    

    # mxfapvio11: reboot the VIO server so that path priority settings take effect

      shutdown -Fr
    


    # mxfapdef0?: On each client LPAR: configure application storage on LPAR's


    # mxfapdef0?: On each client LPAR: Configure path priorities for virtual disks

    # mxfapnim01: copy the vscsiPriority script from the NIM server to each client LPAR and set the path priority for each disk.

      if cd /home/s45x/dukeEnergy
      then
    

        for i in 0 1 2 3 4
        do
          ssh -x root@mxfapdef0${i}-mc2 'mkdir -p /usr/local/scripts'
          scp ./vscsiPriority.ksh root@mxfapdef0${i}-mc2:/usr/local/scripts
          ssh -x mxfapdef0${i}-mc2 '/usr/local/scripts/vscsiPriority.ksh -voi 20'
        done
    

        for i in 0 1 2 3 4
        do
          print -- "# mxfapdef0${i}-mc2"
          ssh -x mxfapdef0${i}-mc2 'for i in $( lsdev -Cc disk -s vscsi -F name )
            do
            P0=$( lspath -Al ${i} -p vscsi0 -F value -a priority )
            P1=$( lspath -Al ${i} -p vscsi1 -F value -a priority )
            print "${i} : vscsi0 : priority = ${P0}"
            print "${i} : vscsi1 : priority = ${P1}"
          done'
          print
        done
    

      fi
    


    # mxfapnim01: Configure VG, LVs, LG, FSs (attach dolvs.defpdcg?.sh)

    # mxfapdef0?: # You may create the Volume groups, logical volumes, log volumes, and filesystems manually, or you can use the provided scripts:

    # mxfapnim01: transfer the "dolvs" script to each client LPAR and execute it to create the VGs, LVs, LGs, and FSs

      if cd /home/s45x/dukeEnergy
      then
        for i in 0 1 2 3 4
        do
          ssh -x root@mxfapdef0${i}-mc2 "mkdir -p /usr/local/scripts"
          scp ./dolvs.defpdcg${i}.sh mxfapdef0${i}-mc2:/usr/local/scripts
          ssh -x mxfapdef0${i}-mc2 "/usr/local/scripts/dolvs.defpdcg${i}.sh"
      
    

    # mxfapdef00: dolvs.defpdcg0.sh should be run on mxfapdef00

    # mxfapdef01: dolvs.defpdcg1.sh should be run on mxfapdef01

    # mxfapdef02: dolvs.defpdcg2.sh should be run on mxfapdef02

    # mxfapdef03: dolvs.defpdcg3.sh should be run on mxfapdef03

    # mxfapdef04: dolvs.defpdcg4.sh should be run on mxfapdef04 ssh -x mxfapdef0${i}-mc2 "chown -R psoft:defs /defmxdg*" ssh -x mxfapdef0${i}-mc2 "chmod -R 775 /defmxdg*" ssh -x mxfapdef0${i}-mc2 "lsuser psoft" ssh -x mxfapdef0${i}-mc2 "lsuser oracle" ssh -x mxfapdef0${i}-mc2 "lsgroup defs" ssh -x mxfapdef0${i}-mc2 "find /defmxdg* -exec ls -ld {} \;" ssh -x mxfapdef0${i}-mc2 "rm /etc/ora*" ssh -x mxfapdef0${i}-mc2 "touch /etc/oratab" ssh -x mxfapdef0${i}-mc2 "chown oracle:defs /etc/oratab" ssh -x mxfapdef0${i}-mc2 "chmod 775 /etc/oratab" ssh -x mxfapdef0${i}-mc2 "ls -l /etc/oratab" done fi


    # mxfapnim01: Configure application server start/stop scripts

      DD_HASCR="/usr/local/hascripts"
      DD_LOC="/home/s45x/dukeEnergy"
      
      if cd "${DD_LOC}"
      then
       
        for i in 0 1 2 3 4
        do
      
          print -- "#!/usr/bin/ksh93
    ################################################################
    ifconfig en4 10.189.41.2${i} netmask 255.255.255.0 alias
    ifconfig en4 10.189.41.3${i} netmask 255.255.255.0 alias
    
    varyonvg defpdcg${i}01vg
    mount /defpdcg${i}
    init c
    cd /defpdcg${i}/mflmf
    /defpdcg${i}/mflmf/mflmman
    
    exit 0" > ${DD_LOC}/defpdcg${i}_appl01_start.sh
    
          print -- "#!/usr/bin/ksh93
    ################################################################
    ifconfig en4 10.189.41.2${i} netmask 255.255.255.0 delete   
    ifconfig en4 10.189.41.3${i} netmask 255.255.255.0 delete
    
    cd /defpdcg${i}/mflmf
    /defpdcg${i}/mflmf/lmfgetpv k
    umount -f /defpdcg${i}
    varyoffvg defpdcg${i}01vg
    
    exit 0" > ${DD_LOC}/defpdcg${i}_appl01_stop.sh
      
          chmod 755 ${DD_LOC}/defpdcg${i}_appl01_start.sh
          ls -l ${DD_LOC}/defpdcg${i}_appl01_start.sh
      
          chmod 755 ${DD_LOC}/defpdcg${i}_appl01_stop.sh
          ls -l ${DD_LOC}/defpdcg${i}_appl01_stop.sh
      
          ssh -x root@mxfapdef0${i}-mc2 "mkdir -p ${DD_HASCR}"
          scp ${DD_LOC}/defpdcg${i}_appl01_start.sh root@mxfapdef0${i}-mc2:${DD_HASCR}
          scp ${DD_LOC}/defpdcg${i}_appl01_stop.sh root@mxfapdef0${i}-mc2:${DD_HASCR}
          scp ${DD_LOC}/dolvs.defpdcg${i}.sh  root@mxfapdef0${i}-mc2:${DD_HASCR}
          ssh -x root@mxfapdef0${i}-mc2 "ls -alrt ${DD_HASCR}; echo"
          print -- "####"
      
        done
      
      fi
    


    # mxfapnim01: Configure PLM control of LPARs

      cd /etc/plm/setup
      for i in 0 1 2 3 4
      do
        print --     ./plmsetup mxfapdef0${i}-mc2.def.ad root
        CT_CONTACT=mxfapdef0${i}-mc2 lsrsrc IBM.HostPublic
        CT_CONTACT=mxfapdef0${i}-mc2 lsrsrc IBM.LPAR
      
        print --     ./plmsetup mxfapdef0${i}-mc2.def.ad root
        CT_CONTACT=mxfapdef0${i}-mc2 lsrsrc IBM.HostPublic
        CT_CONTACT=mxfapdef0${i}-mc2 lsrsrc IBM.LPAR
      
        print --     ./plmsetup mxfapdef0${i}-mc2.def.ad root
        CT_CONTACT=mxfapdef0${i}-mc2 lsrsrc IBM.HostPublic
        CT_CONTACT=mxfapdef0${i}-mc2 lsrsrc IBM.LPAR
      
        print --     ./plmsetup mxfapdef0${i}-mc2.def.ad root
        CT_CONTACT=mxfapdef0${i}-mc2 lsrsrc IBM.HostPublic
        CT_CONTACT=mxfapdef0${i}-mc2 lsrsrc IBM.LPAR
      
        print --     ./plmsetup mxfapdef0${i}-mc2.def.ad root
        CT_CONTACT=mxfapdef0${i}-mc2 lsrsrc IBM.HostPublic
        CT_CONTACT=mxfapdef0${i}-mc2 lsrsrc IBM.LPAR
        
      done
    


    # mxfapdef0?: Miscellaneous Tasks to perform on each client LPAR

    # mxfapdef0?: On each client LPAR: Add directory exclusions for mksysb backups to /etc/exclude.rootvg.

      print '^./tmp/\n./usr/websm/pc_client/\n./usr/sys/inst.images' > /etc/exclude.rootvg
    


    # mxfapdef0?: On each client LPAR: Set ulimits to unlimited as follows:

      UNAMES[0]='root'
      UNAMES[1]='oracle'
      UNAMES[2]='psoft'
      
      for UNAME in "${UNAMES[@]}"
      do
        chuser rss_hard=-1 ${UNAME}
        chuser stack_hard=-1 ${UNAME}
        chuser fsize=-1 ${UNAME}
        chuser cpu=-1 ${UNAME}
        chuser data=-1 ${UNAME}
        chuser rss=-1 ${UNAME}
        chuser stack=-1 ${UNAME}
        lsuser -a rss_hard stack_hard fsize cpu data rss stack ${UNAME}
      done
    


    # mxfapdef0?: On each client LPAR: AIX tuning parameters

      chdev -l sys0 -a maxuproc=4096
      
      vmo -po maxclient%=45
      vmo -po maxperm%=45
      vmo -po minperm%=3
      vmo -po lru_file_repage=0
      vmo -po strict_maxclient=1
      vmo -po strict_maxperm=0
      vmo -po maxfree=10880
      vmo -po minfree=9600
      vmo -po v_pinshm=1
      vmo -ro memory_affinity=0
      
      vmo -o maxclient%
      vmo -o maxperm%
      vmo -o minperm%
      vmo -o lru_file_repage
      vmo -o strict_maxclient
      vmo -o strict_maxperm
      vmo -o minfree
      vmo -o maxfree
      vmo -o v_pinshm
      vmo -o memory_affinity
    


    # mxfapdef0?: On each client LPAR: Asynchronous I/O and System Tuning Parameters

  • Maximum number of processes per user = 3000
  • Maximum Async I/O requests = 16386
  • Maximum number of Async I/O servers = 300
  • Minimum number of Async I/O servers = 150
  • Set aio0 to start at reboot and make it available in the active kernel

      chdev -l sys0 -a maxuproc=3000 -P
      chdev -l aio0 -a maxreqs=16386 -P
      chdev -l aio0 -a maxservers=300 -P
      chdev -l aio0 -a minservers=150 -P
      chdev -l aio0 -a autoconfig=available -P
      mkdev -l aio0
      lsdev -l aio0
      lsattr -El aio0
    


    # mxfapdef0?: On each client LPAR: Verify settings on each DEFS client LPAR

      ulimit -a
      lsps -a
      lsdev -l aio0
      lsattr -El aio0
      
      for i in $( lsdev -Cc disk -F name )
      do
        print "${i}: $( lsattr -El ${i} | grep queue)"
      done
      
      lsattr -El sys0 -a maxuproc
      vmo -o maxclient%
      vmo -o maxperm%
      vmo -o minperm%
      vmo -o lru_file_repage
      vmo -o strict_maxclient
      vmo -o strict_maxperm
      vmo -o minfree
      vmo -o maxfree
      vmo -o memory_affinity
    


    # mxfapdef0?: On each client LPAR: reboot each system to insure all changes take effect

      shutdown -Fr
    


    # mxfapvio10: create password-less ssh login to mxflphmc10-mc2

    # mxfapvio10: Copy the "mapluns.sh" script from the NIM server and execute it to create a DISKMAP of the LUNs configured by this VIO server:

      scp root@206.245.37.100:/home/s45x/dukeEnergy/mapluns.sh /home/padmin
      cd /home/padmin
      ./mapluns.sh -v \
        -h mxflphmc10-mc2 \
        -u hscroot \
        -s Server-9117-570-SN1013D6E 2>&1 | tee DISKMAP.$( date +"%Y%m%d" )
    


    # mxfapvio11: create password-less ssh login to mxflphmc10-mc2

    # mxfapvio11: Copy the "mapluns.sh" script from the NIM server and execute it to create a DISKMAP of the LUNs configured by this VIO server:

      scp root@206.245.37.100:/home/s45x/dukeEnergy/mapluns.sh /home/padmin
      cd /home/padmin
      ./mapluns.sh -v \
        -h mxflphmc10-mc2 \
        -u hscroot \
        -s Server-9117-570-SN1013D6E 2>&1 | tee DISKMAP.$( date +"%Y%m%d" )
    


    # Backup the client LPAR systems to mxfapnim01

    # mxfapnim01: export the mksysb storage directory

      exportfs -i -o 'root=*' /export/mksysb
    

    # mxfapdef0?: mount the mksysb NFS directory and backup the system

      umount /mnt
      mount 206.245.37.100:/export/mksysb /mnt
      ls -l /mnt/mksysb_[md]dcapdef0[0-9]_*
    

      mksysb -Xive /mnt/mksysb_$( hostname )_$( oslevel -s )_$( date +"%y%m%d" )
    

      ls -l /mnt/mksysb_[md]dcapdef0[0-9]_*
      df
      umount /mnt
      mount 206.245.37.100:/export/defs /mnt
      df
    


    # Backup the VIO servers to mxfapnim01

    # mxfapnim01: export the mksysb storage directory

      exportfs -i -o 'root=*' /export/mksysb
    

    # mxfapvio??: mount the mksysb NFS directory and backup the system

      umount /mnt
      mount 206.245.37.100:/export/mksysb /mnt
      ls -l /mnt/backupios_*
      su - padmin
    

      OUTFILE="/mnt/backupios"
      OUTFILE="${OUTFILE}_$( hostname )"
      OUTFILE="${OUTFILE}_$( ioslevel )"
      OUTFILE="${OUTFILE}_$( date +'%y%m%d' )"
      backupios -file "${OUTFILE}" -mksysb
      unset OUTFILE
    

      exit  # exit from the "padmin" shell
    

      ls -l /mnt/backupios_*
      df
      umount /mnt