|  | 
 
| p590 Microcode Upgrade procedures Scheduled for 06/03/2006  The following document describes the procedure to upgrade the
Microcode on the MX1 IBM p590 systems scheduled to occur on June 3,
2006. Upgrading the microcode requires the each frame in the pair to be
powered-down, causing all systems running on the frame to be shutdown. 
Since production databases are running on each frame, a microcode
upgrade requires the coordination of the AIX system administration team,
DBA's, and application administrators.  
 Summary of Activities
 The first phase of this process is to upgrade the HMC associated
with the p590 frames. Then failover all production systems to the alternate frame. 
Non-production systems will not be failed over, they will simply be
shutdown. Next, power off the p590 frame and perform the Microcode
upgrade.  After microcode upgrade is complete and verified, power up the
p590 and restart all systems. Failback all production systems and test. Repeat this process for the second p590 frame. 
 
  Materials Checklist
  Latest Microcode DVD
   Downloaded by: Dana French Download Date: 05/31/2006 Version......: SF_230_156_BP230_155 
  Latest HMC Upgrade DVD's
   Downloaded by: Dana French Download Date: 05/31/2006 Version......: HMC Recovery V5R2.1 
  Latest HMC fixes and patches
  
    Downloaded by:  Download Date:  Version......: None 
 
  Special Instructions: 
 None
 
 Phase 1- Upgrade the HMC associated with the MX1 p590
frames.
 
Phase 1 Start Time:
 Phase 1 Duration:
 
 
 
  Shutdown the HMC and boot from latest DVD's, Install HMC Upgrade
mx1lphmc01:
 
Start Time:
 Duration:
 
  Follow these steps to determine the current BIOS revision level on
the HMC.
  
   Shut down the HMC. Power on the HMC, and then press the F1 key to display the Setup
   utility. In the System Information menu, the BIOS Build Level should be
   T2E134AUS and the Machine Type/Model should be 7315-CR2 or 7310-CR2.
   Note: If the Machine Type/Model is NOT 7315-CR2 or 7310-CR2, then do 
   not install this BIOS update. If the BIOS Build Level is NOT T2E134AUS, then use the following   
   Download and install procedure to acquire and install the BIOS update. Follow these steps to download and install the BIOS update.
  
   Click the following link to download the EXE file for the BIOS
   update:ftp://ftp.software.ibm.com/eserver/pseries/hmc/fixes/73xxT12f.exe
 Copy the 73xxT12f.exe file to a PC running WindowsXX. To create the bootable diskette required to install the update, put a
   blank, formatted 1.44MB diskette in the PC's floppy drive. On the Start menu, select Run, browse to the 73xxT12f.exe file, and
   then click OK. Follow the instructions on the screen to create the diskette. To install the update, follow the installation instructions in the
   Readme First file. It is a good idea to print the Readme First file
   before you begin installing the BIOS update. mx1lphmc01:
 
Start Time:
 Duration:
 
  Install latest required HMC patches and fixes
mx1lphmc01:
 
Start Time:
 Duration:
 
  Restart HMC and verify upgrade, patches, fixes
mx1lphmc01
 
Start Time:
 Duration:
 
  Verify system information, network connectivity, DNS resolution
mx1lphmc01:
 
Start Time:
 Duration:
 
 
 Phase 2- System FailoversFailover all production systems to the alternate frame. 
Non-production systems will not be failed over, they will simply be
shutdown. 
 
Phase 2 Start Time:
 Phase 2 Duration:
 
 
 
 
  Contact p590 DBA's and  prior to outage start shutdown 
databases as follows:
  
   Shutdown any AIX databases "under construction" for project SUMO on MX1 lpars  Shutdown Clarity (NIKPRE) preprod database on mx1aaora03 Shutdown Production Month (ADWPRE) preprod database on mx1aaora03 Shutdown all EDNA databases on MX1APEDN01/MX1APEDN02 Shutdown all eGate preprod databases on MX1AAEGA01 and MX1AAEGA02  Shutdown all ATLAS 9i (dev/preprod) databases on MX1AACAL01/02 and MX1ADCAL01/02 (these database are NOT in use by anyone) mx1ap*: 
 
Start Time:
 Duration:
 
  Clear Oracle database off frame 9119-590-SN51A972E
  
   Failover CRIP (CRPP, crppdtu0) from mx1apora01 to mx1apora02 Failover Shadow Settlements and ERCOT Extracts ( EEXTPRD, ETSSPRD, etapdtu0) from mx1apora03 to mx1apora04 mx1apora01/02: 
 
Start Time:
 Duration:
 
  Shutdown all non-VIO LPARs
!(mx1apvio)*: 
 
Start Time:
 Duration:
 
  Shutdown VIO Servers
mx1apvio01: 
 
Start Time:
 Duration:
 
 
 mx1apvio02: 
 
Start Time:
 Duration:
 
  Verify application and database integrity and operation on frame 
9119-590-SN51A973E.  Obtain OK to proceed from management, DO NOT POWER
OFF YET.
9119-590-SN51A973E:
 
Start Time:
 Duration:
 
 
 Phase 3- Perform Microcode upgrade on frame
9119-590-SN51A972E
 
Phase 3 Start Time:
 Phase 3 Duration:
 
 
 
 
  Prepare HMC and Frame 9119-590-SN51A972E for microcode upgrade
mx1lphmc01:
 
Start Time:
 Duration:
 
Perform Microcode upgrade of p590 frame 9119-590-SN51A972E
 9119-590-SN51A972E:
 
Start Time:
 Duration:
 
  Verify Microcode upgrade of p590 frame 9119-590-SN51A972E
9119-590-SN51A972E:
 
Start Time:
 Duration:
 
  From HMC, modify VIO server settings, change VIO's to dedicated CPUs.
mx1apvio01/mx1apvio02
 
Start Time:
 Duration:
 
  Check HMC Settings for all LPAR's on frame 9119-590-SN51A972E.
mx1lphmc01
 
Start Time:
 Duration:
 
Minimum Memory: XXX
Desired Memory: XXX
Maximum Memory: XXX
Minimum Processing Units: 0.2
Desired Processing Units: 0.2
Maximum Processing Units: XXX
Minimum Virtual Processors: 2
Desired Virtual Processors: 2 
Maximum Virtual Processors: 9
Cap Mode: uncapped
Weight: 128
 
 Phase 4- Power on p590 Frame 9119-590-SN51A972E and
activate systems
 
Phase 4 Start Time:
 Phase 4 Duration:
 
 
 
 
 Phase 5- Application FailbackFailback the production databases and production application
servers. 
 
Phase 5 Start Time:
 Phase 5 Duration:
 
 
 
 
  Clear Oracle databases off FRAME2
  
   Shutdown NMarket (NKTPRD) production database on mx1apora04  Failover RiskDataMart (RDMPRD, znmpdtu0) production database from mx1apora04 to mx1apora03 Failover CRIP (CRPP, crppdtu0) from mx1apora02 to mx1apora01 Failover Shadow Settlements and ERCOT Extracts (EEXTPRD, ETSSPRD, etapdtu0) from mx1apora04 to mx1apora03 mx1apora*: 
 
Start Time:
 Duration:
 
  Shutdown all non-VIO LPARs on Frame 9119-590-SN51A973E
!(mx1apvio)*: 
 
Start Time:
 Duration:
 
  Shutdown VIO Servers on Frame 9119-590-SN51A973E
mx1apvio03: 
 
Start Time:
 Duration:
 
 
 mx1apvio04: 
 
Start Time:
 Duration:
 
  Verify application and database integrity and operation on frame 
9119-590-SN51A972E. Obtain OK to proceed from management, DO NOT POWER
OFF YET.
9119-590-SN51A972E:
 
Start Time:
 Duration:
 
  Prepare HMC/Frame for microcode upgrade
mx1lphmc01:
 
Start Time:
 Duration:
 
Perform Microcode upgrade of p590 frame 9119-590-SN51A973E
 9119-590-SN51A973E:
 
Start Time:
 Duration:
 
  Verify Microcode upgrade of p590 frame 9119-590-SN51A973E
9119-590-SN51A973E:
 
Start Time:
 Duration:
 
  From HMC, modify VIO server settings, change VIO's to dedicated CPUs.
mx1apvio03/mx1apvio04
 
Start Time:
 Duration:
 
  Check HMC Settings for all LPAR's on frame 9119-590-SN51A973E.
mx1lphmc01
 
Start Time:
 Duration:
 
Minimum Memory: XXX
Desired Memory: XXX
Maximum Memory: XXX
Minimum Processing Units: 0.2
Desired Processing Units: 0.2
Maximum Processing Units: XXX
Minimum Virtual Processors: 2
Desired Virtual Processors: 2 
Maximum Virtual Processors: 9
Cap Mode: uncapped
Weight: 128
 
 Phase 6- Power on p590 Frame 9119-590-SN51A973E and
activate systems
 
Phase 4 Start Time:
 Phase 4 Duration:
 
 
 
 
 Phase 7- Application FailbackFailback the production databases and production application
servers to the second frame. 
 
Phase 7 Start Time:
 Phase 7 Duration:
 
 
 
 
  Failback databases to FRAME2 (for those database's that have
primary homes on Frame2) 
  
   Failover RiskDataMart (RDMPRD) production database from mx1apora03 to mx1apora04 Startup NMarket (NKTPRD) production database on mx1apora04  mx1apora03/04: 
 
Start Time:
 Duration:
 
  Startup all non-production and "under construction" databases 
  
   Same list as #1 just perform startup mx1ap*: 
 
Start Time:
 Duration:
 
  Verify PLM communication with all LPAR's on frame 9119-590-SN51A972E:
mx1apnim01: 
 
Start Time:
 Duration:
 
tail -f /var/opt/plm/51A972E.log
  Verify PLM communication with all LPAR's on frame 9119-590-SN51A973E:
mx1apnim01: 
 
Start Time:
 Duration:
 
tail -f /var/opt/plm/51A973E.log
 
 Phase 8- Project Completion
Notify all interested parties of project completion.
 
Phase 8 Start Time:
 Phase 8 Duration:
 
 
 
 
  Contact p590 DBA's and application admins.
Application Admins: 
 
Start Time:
 Duration:
 
 
 DBA's: 
 
Start Time:
 Duration:
 
 
 Operations: 
 
Start Time:
 Duration:
 
 
 Management: 
 
Start Time:
 Duration:
 
  Update change request to completed state.
CHMN00002331386: 
 
Start Time:
 Duration:
 
 |  
 |  |