above 50 puts a higher priority on the RAID set creation at the expense of I/O activity. I Firmware revision--Shows the current firmware revision of the CR3500 RAID Controller. I Serial number--Shows the serial number of the controller. I Connection type--Shows the connection type, which can be serial or SCSI. Compaq Confidential Need to Know Required Writer: Linda Arnold Project: Compaq ProLiant CL380 Software User Guide Comments: Part Number: 157839-004 File Name: e-ch4 CR3500 Configuration Utility.doc Last Saved On: 12/14/00 8:50 AM 4-16 Compaq ProLiant CL380 Software User Guide The next tab, Host Ports (Figure 4-11), has the following properties. Figure 4-11. Controller Properties window, Host Ports tab I Failover mode--Enter the desired failover mode: Performance (active/active) or High Availability (active/passive). High availability is only available for systems with two controllers. If two controllers are present, both controllers must be set to the same failover mode. NOTE: Compaq recommends running in active/active mode only. I Host I/O channel 0--Enter the desired host I/O channel mode, which can be active or passive. NOTE: In stand-alone mode both host channels are active and they cannot be changed. Compaq Confidential Need to Know Required Writer: Linda Arnold Project: Compaq ProLiant CL380 Software User Guide Comments: Part Number: 157839-004 File Name: e-ch4 CR3500 Configuration Utility.doc Last Saved On: 12/14/00 8:50 AM CR3500 Configuration Utility 4-17 I Channel 0 Target ID--The physical address a bus initiator uses to connect with a bus target. Each bus target is assigned a unique target address. You must select an ID between 0 and 15 for a 16-bit module, or between 0 and 7 for an 8-bit module. Make sure the ID you select does not conflict with other IDs. Target IDs are also referred to as the SCSI ID. NOTE: Compaq recommends using the default values for the Channel 0 Target ID. I Mode--The default mode is NT and it cannot be changed. I Bus width--The default mode is 16 bit and it cannot be changed. I SCSI transfer rate--The default SCSI transfer rate is 40 MB and it cannot be changed. I Tag queuing--If your host adapter supports tag queuing, check the Enabled box. Tag queuing permits each initiator to have multiple commands outstanding and each target to optimize the commands it receives. Compaq Confidential Need to Know Required Writer: Linda Arnold Project: Compaq ProLiant CL380 Software User Guide Comments: Part Number: 157839-004 File Name: e-ch4 CR3500 Configuration Utility.doc Last Saved On: 12/14/00 8:50 AM 4-18 Compaq ProLiant CL380 Software User Guide The Environment tab (Figure 4-12) monitors the following items: I Power I Temperature I Fan State Figure 4-12. Controller Properties window, Environment tab Refer to the online help for more information regarding each area's warning icon and meaning. Compaq Confidential Need to Know Required Writer: Linda Arnold Project: Compaq ProLiant CL380 Software User Guide Comments: Part Number: 157839-004 File Name: e-ch4 CR3500 Configuration Utility.doc Last Saved On: 12/14/00 8:50 AM CR3500 Configuration Utility 4-19 The Cache tab (Figure 4-13) indicates the cache memory size for each occupied slot in a controller's memory. Figure 4-13. Controller Properties window, Cache tab Compaq Confidential Need to Know Required Writer: Linda Arnold Project: Compaq ProLiant CL380 Software User Guide Comments: Part Number: 157839-004 File Name: e-ch4 CR3500 Configuration Utility.doc Last Saved On: 12/14/00 8:50 AM 4-20 Compaq ProLiant CL380 Software User Guide Adding Physical Drives The system's CR3500 RAID Controllers must recognize the physical drives in the shared storage area before you can create logical drives from them. The controller will recognize all physical drives at start up. To add physical drives to your configuration after the controller has started, follow these steps: IMPORTANT: Before adding physical drives that have previously been used by another ProLiant CL380, it is necessary to delete any configuration settings on the drives. Failure to do so can cause conflicting RAID settings on the CR3500 controller. For additional information on deleting configuration settings present on the drives, see the "CRErase Utility Information" section at the end of this chapter. 1. Physically add the drives to the system. 2. Run the CR3500 Configuration Utility to configure the drives. NOTE: You cannot increase the capacity of an existing logical drive. 3. From the Main window, click Physical Drive, then click New. 4. The Add New Physical Drive window appears. Enter the channel number and Target ID for the new physical drive. The Target ID is displayed on the grid. NOTE: An alternate method for adding drives is to click on an empty cell in the grid, then right-click and select New. This presents the Add New Physical Drive window with the channel number and target ID currently assigned. 5. Click the OK button. The program adds the physical drive to your configuration and refreshes the main screen. Compaq Confidential Need to Know Required Writer: Linda Arnold Project: Compaq ProLiant CL380 Software User Guide Comments: Part Number: 157839-004 File Name: e-ch4 CR3500 Configuration Utility.doc Last Saved On: 12/14/00 8:50 AM CR3500 Configuration Utility 4-21 Adding Logical Drives From the Storage pull-down menu, select Add Logical Drive. There is a six-step wizard to assist you in adding a logical drive. 1. Select the RAID level for the new logical drive (Figure 4-14). Click the Next button to continue. Figure 4-14. Add Logical Drive: Step 1 Compaq Confidential Need to Know Required Writer: Linda Arnold Project: Compaq ProLiant CL380 Software User Guide Comments: Part Number: 157839-004 File Name: e-ch4 CR3500 Configuration Utility.doc Last Saved On: 12/14/00 8:50 AM 4-22 Compaq ProLiant CL380 Software User Guide 2. Select the physical drives for the new logical drive (Figure 4-15). The number of physical drives you choose will determine the amount of storage that will be available for the new logical drive. To select a physical drive, click on an available physical drive and it will be added to the selected physical drive list. The Next button is disabled until the minimum number of disks is chosen. Figure 4-15. Add Logical Drive: Step 2 Compaq Confidential Need to Know Required Writer: Linda Arnold Project: Compaq ProLiant CL380 Software User Guide Comments: Part Number: 157839-004 File Name: e-ch4 CR3500 Configuration Utility.doc Last Saved On: 12/14/00 8:50 AM CR3500 Configuration Utility 4-23 3. Add the capacity for the logical drive (Figure 4-16). Figure 4-16. Add Logical Drive: Step 3 I To create a single logical drive using the total capacity available, click Add. The capacity remaining changes to 0. The new logical drive will appear in the bottom window, along with its capacity. Click Next to continue. I To create more than one logical drive, enter a number less than the amount appearing in the Logical Drive Capacity window and click Add. The capacity remaining changes to reflect the new amount of capacity in use. Repeat this step to create another logical drive, or click Next to continue. IMPORTANT: Drive capacity that is not configured is lost and cannot be recovered without first deleting all logical drives of the RAID set. NOTE: Creating multiple logical drives links all logical drives together. Deleting one of the logical drives requires deletion of the remaining logical drives in the RAID set. Reassigning host port assignments of one drive requires reassignment of all member drives of the RAID set. Compaq Confidential Need to Know Required Writer: Linda Arnold Project: Compaq ProLiant CL380 Software User Guide Comments: Part Number: 157839-004 File Name: e-ch4 CR3500 Configuration Utility.doc Last Saved On: 12/14/00 8:50 AM 4-24 Compaq ProLiant CL380 Software User Guide 4. Define the strip size and the host port for the new logical drives (Figure 4-17). Click Next to continue. For more information on strip size and host ports, refer to the online help. Figure 4-17. Add Logical Drive: Step 4 Compaq Confidential Need to Know Required Writer: Linda Arnold Project: Compaq ProLiant CL380 Software User Guide Comments: Part Number: 157839-004 File Name: e-ch4 CR3500 Configuration Utility.doc Last Saved On: 12/14/00 8:50 AM CR3500 Configuration Utility 4-25 5. Select a Logical Unit Number (LUN) for the logical drive (Figure 4-18). The Step 5 screen also gives you the option of enabling the Writeback Cache to improve host performance. For more information on LUNs and Writeback Cache, refer to the online help. Figure 4-18. Add Logical Drive: Step 5 Compaq Confidential Need to Know Required Writer: Linda Arnold Project: Compaq ProLiant CL380 Software User Guide Comments: Part Number: 157839-004 File Name: e-ch4 CR3500 Configuration Utility.doc Last Saved On: 12/14/00 8:50 AM 4-26 Compaq ProLiant CL380 Software User Guide 6. View a summary of the new logical drives (Figure 4-19). In this summary you will find the RAID level, capacity, cache options, and member physical drives that you selected for each new logical drive. If you are not satisfied with these characteristics, you can make changes by clicking on the Back button. If you are satisfied with the summary, click Finish. Figure 4-19. Add Logical Drive: Step 6 Replacing a Failed Controller Replacing a Failed Controller in a Single Controller Environment 1. Power down the shared storage array. 2. Remove the failed controller. 3. Insert the new controller. 4. Restore the configuration settings. See the section, "Restoring Configuration Settings from a File," for this procedure. Compaq Confidential Need to Know Required Writer: Linda Arnold Project: Compaq ProLiant CL380 Software User Guide Comments: Part Number: 157839-004 File Name: e-ch4 CR3500 Configuration Utility.doc Last Saved On: 12/14/00 8:50 AM CR3500 Configuration Utility 4-27 Replacing a Failed Controller in a Redundant Controller Environment A failed controller can be replaced without powering down the shared storage array. To replace a failed controller: 1. Remove the failed controller. 2. Insert the new controller. IMPORTANT: Before removing a failed controller, always verify that the amber fault LED is lit and that the controller does not display a blinking activity LED. Replacing a Failed Drive A failed drive can be replaced without powering down the shared storage array. When a drive fails, two things can happen: I The logical drive associated with the failed drive uses a spare and rebuilds the spare drive to join the logical drive. The logical drive will be in a reconstructing state. I The logical drive stays in a reduced state until a new drive is added. To replace the failed drive: 1. Remove the failed drive. 2. Insert the new drive. 3. See the "Adding Physical Drives" section for procedures to make the new drive known to the system. 4. Set the new drive status. If a spare drive was used to reconstruct the affected logical drive, set the new drive as a spare drive. Compaq Confidential Need to Know Required Writer: Linda Arnold Project: Compaq ProLiant CL380 Software User Guide Comments: Part Number: 157839-004 File Name: e-ch4 CR3500 Configuration Utility.doc Last Saved On: 12/14/00 8:50 AM 4-28 Compaq ProLiant CL380 Software User Guide If there was no spare drive to use, the logical drive is still in a reduced state. Add the new physical drive to the logical drive for reconstruction to start. a. Select the logical drive in reduced status. b. Select Logical Drive from the Storage pull-down menu. c. Select Reconstruct. d. A list appears showing available drives. Select the drive you just added. e. Reconstruction begins. Setting a Physical Drive as a Spare NOTE: Spare drives serve as spares to all logical drives. They are not grouped with a particular logical drive. How a Spare Drive Works I If a physical drive fails in a RAID 1, RAID 0+1, RAID 4, or RAID 5 logical drive, the spare automatically replaces the failed physical drive and the controller reconstructs all logical drives that contained the failed physical drive as a member. I After the controller writes data to a spare, the spare becomes part of the same device group in which a device failed. I After the controller writes data to a spare, the status of the spare changes to Good. To Define a Spare Physical Drive 1. In the main window of the Configuration Utility, click the physical drive to be used as a spare. The physical drive must be in the Available state. 2. From the Storage menu, choose Physical Drive, then choose Make Spare. NOTE: The spare must have a capacity equal to or greater than the failed physical drive for an automatic reconstruct to start. Compaq Confidential Need to Know Required Writer: Linda Arnold Project: Compaq ProLiant CL380 Software User Guide Comments: Part Number: 157839-004 File Name: e-ch4 CR3500 Configuration Utility.doc Last Saved On: 12/14/00 8:50 AM CR3500 Configuration Utility 4-29 Managing Spare Physical Drives Making a spare physical drive part of a logical drive will protect the integrity of the RAID setup. This proves especially true for logical drives that have RAID requirements of two or more physical drives. Should one physical drive fail, the logical drive will automatically activate the spare physical drive as replacement for the failed drive. Managing Failed Physical Drives To return a failed physical drive to a non-failed state, from the Storage menu, select Physical Drive, and then select Clear Failure. You can easily identify a failed physical drive from the main screen because the failed icon will appear. See Table 4-5 for the physical drive icons. Deleting Logical Drives CAUTION: If you delete a logical drive, all of the data on that logical drive will be lost. The logical drives in the storage subsystem are logical units that contain user data. Although logical drives do not exist in a physical sense, it is their logical structure that ties together the physical pieces of data spread across their members. Use extreme caution when deleting a logical drive. 1. Click the logical drives that you want to delete. 2. From the Storage pull-down menu, select Logical Drive, then select Delete. A system message appears, asking if you want to delete all disks in the group. 3. Click Yes to delete all the disks in the group. Using Configuration Files You can use a configuration file to save the configuration settings of the CR3500 RAID Controllers and disk drives and to view or reconstruct the settings at a later time. You also can revert to one of these saved configurations at any time. The CR3500 Configuration Utility reads the configuration file you choose and sets up your subsystem accordingly. Compaq Confidential Need to Know Required Writer: Linda Arnold Project: Compaq ProLiant CL380 Software User Guide Comments: Part Number: 157839-004 File Name: e-ch4 CR3500 Configuration Utility.doc Last Saved On: 12/14/00 8:50 AM 4-30 Compaq ProLiant CL380 Software User Guide Saving Configuration Settings to a File From the Storage pull-down menu, select Controller, Configuration, then Save. The current configuration settings, including caches, LUNs, host ports, and strip size, will be saved. CAUTION: When saving a configuration, all controller data and RAID set data is preserved at the time of the Save operation. When restoring a configuration, the configuration being restored must EXACTLY match the configuration when it was saved. Any RAID sets in existence when the Restore Configuration operation takes place that were not in existence when the configuration was saved will be reinitialized, and any data on those RAID sets will be lost. Make sure you have a recent backup copy of your configuration data before you execute this operation. Restoring Configuration Settings from a File You can automatically restore or configure your entire storage subsystem from a previously saved configuration file. The CR3500 Configuration Utility can configure your subsystem from a file only if the file corresponds to your subsystem's hardware configuration. From the Storage pull-down menu, select Controller, Configuration, then Restore. All of the configuration settings, including caches, LUNs, host port, and strip size, will be restored to their original condition. CAUTION: When restoring a configuration, the configuration being restored must match the configuration EXACTLY as it was saved. Any RAID sets in existence when the Restore Configuration operation takes place that were not in existence when the configuration was saved will be reinitialized, and any data on those RAID sets will be lost. You will not be able to restore the original configuration settings if the original hardware and connections have been replaced or if the original configuration settings were not saved before implementing the changes. Compaq Confidential Need to Know Required Writer: Linda Arnold Project: Compaq ProLiant CL380 Software User Guide Comments: Part Number: 157839-004 File Name: e-ch4 CR3500 Configuration Utility.doc Last Saved On: 12/14/00 8:50 AM CR3500 Configuration Utility 4-31 Upgrading from a Single Controller Configuration to Redundant Controller Configuration Before upgrading your system from a single CR3500 RAID Controller to a redundant CR3500 RAID Controller configuration, verify that each CR3500 RAID Controller has the same firmware revision level by following these steps: 1. Compaq recommends that you download the latest firmware for the CR3500 RAID Controller by accessing the Compaq Support website: www.compaq.com/support IMPORTANT: Each CR3500 RAID Controller must have the same firmware level to allow it to bind in a redundant fault tolerant configuration. 2. Open the CR3500 Configuration Utility and double-click the controller icon for the original controller. Take note of the current firmware level. 3. Determine the firmware level of the new controller by reading the firmware revision level label found on the carrier of the controller. 4. If the firmware level of each controller matches the current release of firmware, follow the steps in the "Matching Firmware Revision Levels" section. 5. If the original controller has an older firmware level, follow the steps in the section titled "Updating the Firmware Revision Level of the Original CR3500 RAID Controller." 6. If the new controller has an older firmware level, follow the steps in the section titled "Adding a Second CR3500 RAID Controller." 7. If both controllers have firmware levels which are older than those posted on the Web, follow steps 1-7 in the "Updating the Firmware Revision Level of the Original CR3500 RAID Controller" section, followed by the section, "Adding a Second CR3500 RAID Controller," beginning with Step 7. Compaq Confidential Need to Know Required Writer: Linda Arnold Project: Compaq ProLiant CL380 Software User Guide Comments: Part Number: 157839-004 File Name: e-ch4 CR3500 Configuration Utility.doc Last Saved On: 12/14/00 8:50 AM 4-32 Compaq ProLiant CL380 Software User Guide Matching Firmware Revision Levels Follow these steps if the firmware revision levels are identical for both controllers. 1. Save the existing single controller configuration using the Save Configuration function of the CR3500 Configuration Utility. 2. Suspend all I/O and power down the shared storage subsystem. 3. Remove the Shared Storage RAID Controller CR3500 from bay 1 (top). 4. Insert the new Shared Storage RAID Controller CR3500 into bay 1 (top). IMPORTANT: Do not insert the original CR3500 RAID Controller into bay 2 (bottom) at this time. 5. Power up the shared storage area. 6. Restore the controller configuration settings saved in Step 1 using the Restore Configuration function of the CR3500 Configuration Utility. 7. Power down the shared storage area. 8. Remove the CR3500 RAID Controller blanking panel from bay 2 (bottom) and insert the original CR3500 RAID Controller into the bay. 9. Power up the shared storage area and verify proper installation and operation. NOTE: For more information on the Shared Storage RAID Controller CR3500 LED diagnostic checks, refer to the Compaq ProLiant CL380 User Guide. NOTE: After the controllers initialize, the shared storage subsystem will be running in a redundant controller configuration. Compaq Confidential Need to Know Required Writer: Linda Arnold Project: Compaq ProLiant CL380 Software User Guide Comments: Part Number: 157839-004 File Name: e-ch4 CR3500 Configuration Utility.doc Last Saved On: 12/14/00 8:50 AM CR3500 Configuration Utility 4-33 Updating the Firmware Revision Level of the Original CR3500 RAID Controller Follow these steps if the firmware revision level of the original controller is older than the most recent firmware revision level. 1. Save the existing single controller configuration using the Save Configuration function of the CR3500 Configuration Utility. 2. Suspend all I/O and power down the shared storage subsystem. 3. If you are upgrading controller firmware in Microsoft Windows NT Server 4.0, Enterprise Edition, or Microsoft Windows 2000 Advanced Server environments, open the CR3500 Configuration Utility. Select Storage, Controller, Update Firmware. Enter the path to the location of the firmware downloaded from the Compaq website or the file included with the second controller. The pointing icon will change to an hourglass as the update begins. When the update completes, you can verify the firmware revision level by clicking on the controller icon. If you are upgrading controller firmware under Novell NetWare 4.2 or NetWare 5.1, follow the steps in the section titled "Novell NetWare Firmware Upgrade Procedures." IMPORTANT: Microsoft Cluster Server under Windows NT Server 4.0, Enterprise Edition, Cluster Service under Windows 2000 Advanced Server, SNMP service, and any I/O must be stopped during the firmware update. 4. Power down the shared storage area. 5. Remove the Shared Storage RAID Controller CR3500 from bay 1 (top). 6. Insert the new Compaq Shared Storage RAID Controller CR3500 in bay 1 (top). IMPORTANT: Do not insert the original CR3500 RAID Controller into bay 2 (bottom) at this time. 7. Power up the shared storage area. 8. Restore the controller configuration settings saved in Step 1 using the Restore Configuration function of the CR3500 Configuration Utility. 9. Power down the shared storage area. 10. Remove the CR3500 RAID Controller blanking panel from bay 2 (bottom). Compaq Confidential Need to Know Required Writer: Linda Arnold Project: Compaq ProLiant CL380 Software User Guide Comments: Part Number: 157839-004 File Name: e-ch4 CR3500 Configuration Utility.doc Last Saved On: 12/14/00 8:50 AM 4-34 Compaq ProLiant CL380 Software User Guide 11. Insert the original CR3500 RAID Controller into bay 2 (bottom). 12. Power up the shared storage area and verify proper installation and operation. NOTE: For more information on the Shared Storage RAID Controller CR3500 LED diagnostic checks, refer to the Compaq ProLiant CL380 User Guide. NOTE: After the controllers initialize, the shared storage subsystem will be running in a redundant controller configuration. Adding a Second CR3500 RAID Controller Follow these steps if the firmware revision level of the new controller is older than the most recent firmware revision level. 1. Save the existing single controller configuration using the Save Configuration function of the CR3500 Configuration Utility. 2. Suspend all I/O and power down the shared storage subsystem. 3. Power down the shared storage area. 4. Remove the Shared Storage RAID Controller CR3500 from bay 1 (top). 5. Insert the new Compaq Shared Storage RAID Controller CR3500 into bay 1 (top). IMPORTANT: Do not insert the original CR3500 RAID Controller into bay 2 (bottom) at this time. 6. Power up the shared storage area. 7. If you are upgrading controller firmware in Microsoft Windows NT Server 4.0, Enterprise Edition, or Microsoft Windows 2000 Advanced Server environments, open the CR3500 Configuration Utility. Select Storage, then Controller, then Update Firmware. Enter the path to the location of the firmware downloaded from the Compaq website or the file included with the second controller. The pointing icon will change to an hourglass as the update begins. When the update completes, you can verify the firmware revision by double-clicking on the controller icon. Compaq Confidential Need to Know Required Writer: Linda Arnold Project: Compaq ProLiant CL380 Software User Guide Comments: Part Number: 157839-004 File Name: e-ch4 CR3500 Configuration Utility.doc Last Saved On: 12/14/00 8:50 AM CR3500 Configuration Utility 4-35 If you are upgrading controller firmware under Novell NetWare 4.2 or NetWare 5.1, follow the steps in the section titled "Novell NetWare Firmware Upgrade Procedures." IMPORTANT: Microsoft Cluster Server under Windows NT Server 4.0, Enterprise Edition, Cluster Service under Windows 2000 Advanced Server, SNMP service, and any I/O must be stopped during the firmware update. 8. Restore the controller configuration settings saved in Step 1 using the Restore Configuration option of the CR3500 Configuration Utility. 9. Power down the shared storage area. 10. Remove the CR3500 RAID Controller blanking panel from bay 2 (bottom). 11. Insert the original CR3500 RAID Controller into bay 2 (bottom). 12. Power up the shared storage area and verify proper installation and operation. NOTE: For more information on the Shared Storage RAID Controller CR3500 LED diagnostic checks, refer to the Compaq ProLiant CL380 User Guide. NOTE: After the controllers initialize, the shared storage subsystem will be running in a redundant controller configuration. Novell NetWare Firmware Upgrade Procedures Use the following procedures to upgrade firmware under Novell NetWare 4.2 or NetWare 5.1. Due to the use of a serial interface for firmware updates, this procedure must be used for each controller as needed. 1. Connect the controller to a system running Microsoft Windows 95, 98, or NT by means of the serial connector on the back of the shared storage subsystem. 2. Use a terminal program, such as HyperTerminal, to connect to the host system. Compaq Confidential Need to Know Required Writer: Linda Arnold Project: Compaq ProLiant CL380 Software User Guide Comments: Part Number: 157839-004 File Name: e-ch4 CR3500 Configuration Utility.doc Last Saved On: 12/14/00 8:50 AM 4-36 Compaq ProLiant CL380 Software User Guide 3. Use the following settings to connect: G Bits per second=9600 G Data bits=8 G Parity=None G Stop bits=1 G Flow control=Xon/Xoff 4. Power up the shared storage area and press Ctrl+C to abort the controller boot process. 5. Select option 2 to change the baud rate. 6. Select option 3 to set the baud rate to 38400. 7. Change the baud rate on the terminal to match the controller's baud rate of 38400. 8. Disconnect and reconnect the terminal service. 9. Press Enter to establish communication with the controller. 10. Select option 1 and press Enter. 11. Transfer the firmware file as a text file from the terminal service. The entire update should take about 15 minutes at a 38400 baud rate. 12. After the firmware update is complete, select option 2 and change the baud rate to 9600 by selecting option 1. 13. Change the baud rate to 9600 on the terminal service. 14. Disconnect and reconnect the terminal service. 15. Press Enter to establish communication with the controller. 16. Select option 9 to restart the controller. Compaq Confidential Need to Know Required Writer: Linda Arnold Project: Compaq ProLiant CL380 Software User Guide Comments: Part Number: 157839-004 File Name: e-ch4 CR3500 Configuration Utility.doc Last Saved On: 12/14/00 8:50 AM CR3500 Configuration Utility 4-37 Error and Warning Messages When you start the CR3500 Configuration Utility, the software checks each controller to detect errors in its configuration. If a problem is found, the CR3500 Configuration Utility displays a warning message that describes the problem. IMPORTANT: If a warning message indicates "Internal Error Has Been Detected" and cites an error code number, the problem requires assistance from Compaq technical support. See the "About This Guide" section at the beginning of this book for technical support phone numbers. Refer to the online help for more information. CRErase Utility Information The CRErase Utility provides a quick and easy way to erase the configuration information on the shared storage drives. To erase the configuration information perform the following steps: 1. Create a System Erase Utility diskette by using the Diskette Builder Utility on the latest SmartStart and Support Software CD. 2. Create a bootable diskette from a computer running either DOS, Microsoft Windows 95, or 98. To create a bootable diskette: a. Insert a blank diskette in the diskette drive. b. Open an MS-DOS Prompt window. c. Enter SYS A: at the DOS command prompt. 3. Copy the CRERASE.EXE file from the System Erase Utility diskette to the bootable diskette. 4. Power down both server nodes. 5. Insert the bootable diskette into one of the Compaq ProLiant CL380 server nodes and turn on the server node. 6. Type CRERASE at the DOS command prompt and press Enter to remove all RAID set configuration from the physical drives and the Shared Storage CR3500 RAID Controller. Compaq Confidential Need to Know Required Writer: Linda Arnold Project: Compaq ProLiant CL380 Software User Guide Comments: Part Number: 157839-004 File Name: e-ch4 CR3500 Configuration Utility.doc Last Saved On: 12/14/00 8:50 AM 5 Chapter Integrated Management Log NOTE: The Compaq Integrated Management Log (IML) only records events for the server nodes. The IML does not record events in the shared storage array. The Compaq Integrated Management Log (IML) records events and stores them in an easily viewable form. The Compaq Integrated Management Log records hundreds of events and then marks each event with a time-stamp with one-minute granularity. Events listed in the Compaq Integrated Management Log are categorized as one of four event severity levels: I Status--Indicates that the message is informational only. I Repaired--Indicates that corrective action has been taken. I Caution--Indicates a nonfatal error condition. I Critical--Indicates a component failure. The Compaq Integrated Management Log requires Compaq Operating System-dependent drivers. Refer to the Compaq SmartStart and Support Software CD for instructions on installing the appropriate drivers. Multiple Ways of Viewing the Log You can view an event in the Compaq Integrated Management Log two ways: I From within Compaq Insight ManagerTM I From within Compaq Survey Utility Compaq Confidential Need to Know Required Writer: Linda Arnold Project: Compaq ProLiant CL380 Software User Guide Comments: Part Number: 157839-004 File Name: f-ch5 Integrated Management Log.doc Last Saved On: 12/14/00 8:50 AM 5-2 Compaq ProLiant CL380 Software User Guide Compaq Insight Manager Compaq Insight Manager is a server management tool providing in-depth fault, configuration, and performance monitoring of hundreds of Compaq servers from a single management console. The system parameters that are monitored describe the status of all key server node components. By being able to view the events that occur, you can take immediate action. You can view and print the event list from within Compaq Insight Manager by following the instructions below. You can also mark a critical or caution event as repaired after the affected component has been replaced, for example, if a fan that has failed has been replaced. You can lower the severity of the event by marking it as repaired. Viewing the Event List 1. From Compaq Insight Manager, select the appropriate server node, then select View Device Data. The selected server node is displayed with buttons around its perimeter. 2. Select the Recovery button. 3. Select Compaq Integrated Management Log. NOTE: You can only view the event list from the Recovery/Integrated Management screen. To print the list, follow the instructions in the following section. 4. If a failed component has been replaced, select the event from the list and then select Mark Repaired. Printing the Event List You can only view the event list from the Recovery/Integrated Management Log screen as described in the previous section. To print the list, follow the instructions below. 1. From Compaq Insight Manager, select the appropriate server node. The selected server node displays with buttons around its perimeter. 2. Click the Configuration button. 3. Click the Recovery button. 4. Click Print. Compaq Confidential Need to Know Required Writer: Linda Arnold Project: Compaq ProLiant CL380 Software User Guide Comments: Part Number: 157839-004 File Name: f-ch5 Integrated Management Log.doc Last Saved On: 12/14/00 8:50 AM Integrated Management Log 5-3 Compaq Survey Utility The Compaq Survey Utility is a serviceability tool available for Microsoft Windows NT Server 4.0, Windows 2000, and Novell NetWare that delivers online configuration capture and comparison to maximize server node availability. The utility is delivered on the Compaq Management CD in the Cluster Setup and Management pack, or it is available on the Compaq website. Refer to the Compaq Management CD for information on installing and running the Survey Utility. After you have run the Survey Utility, you can view the Compaq Integrated Management Log by loading the output of the utility (typically called SURVEY.TXT) into a text viewer such as Microsoft Notepad. The event list follows the system slot information. Once you have opened the text file, you can print it using the print feature of the viewer. List of Events The event list displays the affected components and the associated error messages. Although the same basic information is displayed, the format of the list may be different depending on how you are viewing it from within Compaq Insight Manager or the Compaq Survey Utility. Table 5-1 identifies the event types (affected components) and associated event messages. Table 5-1 Event Messages Event Type Event Message Machine Environment Fan Failure System Fan Failure (Fan X, Location) Fans Not Redundant System Fans Not Redundant Overheat Condition System Overheating (Zone X, Location) Main Memory Correctable Error Threshold Corrected Memory Error threshold passed (Slot X, Memory exceeded Module X) Corrected Memory Error threshold passed (System Memory) Corrected Memory Error threshold passed (Memory Module unknown) continued Compaq Confidential Need to Know Required Writer: Linda Arnold Project: Compaq ProLiant CL380 Software User Guide Comments: Part Number: 157839-004 File Name: f-ch5 Integrated Management Log.doc Last Saved On: 12/14/00 8:50 AM 5-4 Compaq ProLiant CL380 Software User Guide Table 5-1 Event Messages continued Event Type Event Message Uncorrectable Error Uncorrectable Memory Error (Slot X, Memory Module X) Uncorrectable Memory Error (System Memory) Uncorrectable Memory Error (Module unknown) Processor Correctable Error Threshold Processor Correctable Error Threshold passed (Slot X, Socket X) exceeded Uncorrectable Error Processor Uncorrectable internal error (Slot X, Socket X) Host Bus Error Unrecoverable Host Bus Data Parity Error Unrecoverable Host Bus Address Parity Error PCI Bus Error PCI Bus Error (Slot X, Bus X, Device X, Function X) POST Error POST Error: Error message Power Subsystem Power Supply Failure System Power Supply Failure (Power Supply X) Power Supply Inserted System Power Supply Inserted (Power Supply X) Power Supply Removed System Power Supply Removed (Power Supply X) Power Supply Not Redundant System Power Supplies Not Redundant System Configuration Real-Time Clock Battery Failing Battery Low Power Module Failure A CPU Power Module (System Board, Socket X) A CPU Power Module (Slot X, Socket X) AC Voltage Problem System AC Power Problem (Power Supply X) Power AC Overload System AC Power Overload (Power Supply X) Automatic Server Recovery System Lockup ASR Lockup Detected: Cause continued Compaq Confidential Need to Know Required Writer: Linda Arnold Project: Compaq ProLiant CL380 Software User Guide Comments: Part Number: 157839-004 File Name: f-ch5 Integrated Management Log.doc Last Saved On: 12/14/00 8:50 AM Integrated Management Log 5-5 Table 5-1 Event Messages continued Event Type Event Message Operating System System Crash Blue Screen Trap: Cause [NT/2000] Kernel Panic: Cause [UNIX] Abnormal Program Termination: Cause [NetWare] Automatic OS Shutdown Automatic Operating System Shutdown Initiated Due to Fan Failure Automatic Operating System Shutdown Initiated Due to Overheat Condition Fatal Exception (Number X, Cause) Compaq Confidential Need to Know Required Writer: Linda Arnold Project: Compaq ProLiant CL380 Software User Guide Comments: Part Number: 157839-004 File Name: f-ch5 Integrated Management Log.doc Last Saved On: 12/14/00 8:50 AM 6 Chapter System Management Throughout the life of your Compaq ProLiant CL380, you will encounter the need to improve performance, upgrade hardware components, upgrade software, increase storage capacity, restructure cluster groups, back up cluster data, or monitor ongoing activities. This chapter primarily describes these management concepts as they pertain to Microsoft Cluster Server (MSCS) or Cluster Service clusters. This chapter also details the utilities and programs used in the ongoing management of your system. The topics addressed in this chapter include: I Cluster Management Concepts I Compaq Insight Manager I Microsoft Cluster Administrator I Novell ConsoleOne I Backing Up Your Cluster I Managing Cluster Performance Compaq Confidential Need to Know Required Writer: Linda Arnold Project: Compaq ProLiant CL380 Software User Guide Comments: Part Number: 157839-004 File Name: g-ch6 System Management.doc Last Saved On: 12/14/00 8:51 AM 6-2 Compaq ProLiant CL380 Software User Guide Cluster Management Concepts Using Microsoft Windows NT Server 4.0, Enterprise Edition, or Windows 2000 Advanced Server Managing a Cluster without Interrupting Applications or Services At some time during the life of your system, it is likely you will need to perform an operation on a server node that will require it to be powered down. Always use Cluster Administrator to fail over (or at a minimum, bring offline) clustered applications before powering down the server. Managing a Cluster in a Degraded Condition Due to the high-availability nature of clustering, applications and network clients remain operational even while some cluster components do not. When the cluster is in this degraded condition, it is important to follow this process: 1. Understand what caused the degradation. 2. Determine whether the condition will continually worsen. 3. Determine how critical it is to repair the problem. a. If the problem is considered non-critical, wait until a non-peak time to service the problem. b. If the problem is considered critical, fail over all clustered applications and resources to the other server node before servicing the problem. Managing Hardware Components of Individual Server Nodes Compaq Insight Manager has been enhanced to operate with the Compaq ProLiant CL380. While Compaq Insight Manager maintains its current features of viewing and managing servers and their components, it now allows you to view two server nodes as a single cluster entity. A comprehensive overview of the cluster capabilities of Compaq Insight Manager appears later in this chapter. Compaq Confidential Need to Know Required Writer: Linda Arnold Project: Compaq ProLiant CL380 Software User Guide Comments: Part Number: 157839-004 File Name: g-ch6 System Management.doc Last Saved On: 12/14/00 8:51 AM System Management 6-3 Managing Network Clients Connected to a Cluster An important aspect of managing network clients is to inform the users that their applications are now running on a cluster. Since users will experience some disruption of service, and possibly a performance degradation during failover, they might become concerned about the availability and stability of their applications. As the cluster is initially brought into a production environment, it might be beneficial to describe in a memorandum the effects a cluster will have on the users' information systems needs. When a failover or failback event occurs, the users' perspective will be only that they cannot access their application or data. When users have been properly forewarned of the effects of operating in a clustered environment, they will more readily recognize when a failover or failback event is occurring or has occurred. Most will wait several minutes before trying to reconnect to their application or data. Managing a Cluster's Shared Storage Compaq Insight Manager monitors the cluster. The physical drives and hardware are monitored by means of the Mass Storage Overview screen, which is accessed from the Device View screen. The shared logical drives (as well as other cluster resources and services) are monitored by means of the Cluster Management and Cluster Shared Resources screens, which are accessed from a cluster folder in the Device List. Because this storage system is shared, either server node could be the owner of any shared logical drive. While only one server node can own the logical drive at any given time, ownership can switch from one server node to another. Compaq Insight Manager reports the current owner of a logical drive and updates this information dynamically if a failover occurs. NOTE: Compaq Insight Manager shows the shared logical drives as cluster resources owned by a particular server node. It shows the cluster hardware as a physical resource of both servers in the cluster. When viewing the Compaq Insight Manager Cluster Shared Resources screen, you can determine which logical drive contains a particular drive by looking at the Physical ID field under the Shared Resources heading. Compaq Confidential Need to Know Required Writer: Linda Arnold Project: Compaq ProLiant CL380 Software User Guide Comments: Part Number: 157839-004 File Name: g-ch6 System Management.doc Last Saved On: 12/14/00 8:51 AM 6-4 Compaq ProLiant CL380 Software User Guide Remotely Managing a Cluster Both Compaq Insight Manager and Microsoft Cluster Administrator can be run from network client machines. Each program allows monitoring of multiple clusters from a single remote client. See the corresponding documentation to determine how to set up and configure each of these programs to run remotely. Cluster Events Cluster events are logged in the Windows System Log. Use the Windows Event Viewer to view the data in the log. Compaq Insight Manager Compaq Insight Manager is the Compaq application for easily managing network devices. Compaq Insight Manager delivers intelligent monitoring and alerting as well as visual control of your networked systems. Compaq Insight Manager 4.80 or later has been updated to recognize and monitor the Compaq ProLiant CL380. The following section provides an overview of the cluster-specific features found in Compaq Insight Manager. NOTE: The term cluster group used in this section refers to Compaq Insight Manager, not to Microsoft Cluster Server. Compaq Confidential Need to Know Required Writer: Linda Arnold Project: Compaq ProLiant CL380 Software User Guide Comments: Part Number: 157839-004 File Name: g-ch6 System Management.doc Last Saved On: 12/14/00 8:51 AM System Management 6-5 Explorer Device List Screen When Compaq Insight Manager discovers a cluster, a cluster group is automatically created and added to the group column on the left of the Device list screen (Figure 6-1). The cluster protocol and address are also displayed. Figure 6-1. Compaq Insight Manager Explorer Device list screen When the cluster group is selected in the group column, the two server nodes and a generic Cluster Software item are listed in the Device Name column of the Device list screen (Figure 6-2). Figure 6-2. Explorer Device list screen, Cluster Group selected Compaq Confidential Need to Know Required Writer: Linda Arnold Project: Compaq ProLiant CL380 Software User Guide Comments: Part Number: 157839-004 File Name: g-ch6 System Management.doc Last Saved On: 12/14/00 8:51 AM 6-6 Compaq ProLiant CL380 Software User Guide Cluster Management Screen Compaq Insight Manager includes a Cluster Management screen. From the Cluster Management screen you can: I Launch Microsoft Cluster Administrator. I Bring up the Compaq Insight Manager Cluster Shared Resources screen. I View the status of the cluster service running on each server node. I View the overall status of all cluster resources. This information is updated dynamically. You can launch the Cluster Management screen (Figure 6-3) by double-clicking on the Cluster Software Item. Figure 6-3. Cluster Management screen If Microsoft Cluster Administrator is installed on the Compaq Insight Manager console, you can launch Cluster Administrator by clicking on the Cluster Administrator button near the upper-right corner of the screen, or by selecting an option from the right-mouse menu of the Cluster Software item. Cluster Administrator will launch directly to the cluster represented by the Cluster Management screen. Compaq Confidential Need to Know Required Writer: Linda Arnold Project: Compaq ProLiant CL380 Software User Guide Comments: Part Number: 157839-004 File Name: g-ch6 System Management.doc Last Saved On: 12/14/00 8:51 AM System Management 6-7 Cluster Shared Resources Screen The Cluster Shared Resources screen (Figure 6-4) contains specific information about the cluster interconnect and all cluster resources running on the server node. From the Cluster Shared Resources screen you can: I View address, transport protocol, and physical ID of all cluster interconnects. I View the current state of all cluster resources. I Sort the interconnect information and resources by multiple criteria. Figure 6-4. Cluster Shared Resources screen All displayed interconnect and resource information is polled and updated dynamically, including status and ownership. For example, assume two drive volumes are defined in your shared storage. The primary owner of the drive volume labeled E: is server node 1. The primary owner of the drive volume labeled F: is server node 2. When the cluster is in a normal state, Insight Manager will show E: as being owned by server node 1, and F: as being owned by server node 2. When a failover event occurs, ownership of the drives changes. Assume server node 1 experiences a failure and its resources fail over to server node 2. When the failover is complete and Insight Manager polls the cluster, server node 2 will be identified as the owner of both F: and E:. Compaq Confidential Need to Know Required Writer: Linda Arnold Project: Compaq ProLiant CL380 Software User Guide Comments: Part Number: 157839-004 File Name: g-ch6 System Management.doc Last Saved On: 12/14/00 8:51 AM 6-8 Compaq ProLiant CL380 Software User Guide Cluster Group Hierarchy You can manage cluster groups at an appropriate level in the group hierarchy. Cluster groups are always displayed at the All Devices level (Figure 6-5), but cluster group shortcuts can be added to other groups. Figure 6-5. Sample group hierarchy Filter Groups Dialog Box The Filter Groups dialog box (Figure 6-6) is used to create, edit, or delete groups in the group list hierarchy. Follow these steps to launch the Filter Groups dialog box: 1. From the group column in the Device List window, select the group you want to work with. For example, to create a group within Network, select Network. Compaq Confidential Need to Know Required Writer: Linda Arnold Project: Compaq ProLiant CL380 Software User Guide Comments: Part Number: 157839-004 File Name: g-ch6 System Management.doc Last Saved On: 12/14/00 8:51 AM System Management 6-9 2. Select the Set Up Group button on the control bar. Figure 6-6. Filter Groups dialog box The Insert cluster shortcut button allows you to create shortcuts for existing cluster groups and place them in different levels in the group hierarchy. Cluster Address A cluster address acts as a proxy, communicating with different servers in the cluster depending on the state of the cluster. A Compaq Insight Manager device using a cluster address may switch communication from one physical device to another, which may result in erroneous information being delivered. Consequently, Compaq Insight Manager does not allow management of a device that uses a known cluster address. Compaq Confidential Need to Know Required Writer: Linda Arnold Project: Compaq ProLiant CL380 Software User Guide Comments: Part Number: 157839-004 File Name: g-ch6 System Management.doc Last Saved On: 12/14/00 8:51 AM 6-10 Compaq ProLiant CL380 Software User Guide Microsoft Cluster Administrator While the primary responsibility of Compaq Insight Manager is to monitor the overall status of the cluster hardware, services, and resources, Microsoft's Cluster Administrator is most adept at managing the groups, resources, and operating state of the cluster. Cluster Administrator gives you the ability to: I View the current status of cluster groups and resources. I Bring groups and resources online and offline. I Manually move groups and resources to another server node. I Manually move groups and resources to their preferred server. I Pause groups and resources. I Restructure a group's resource dependency tree. Cluster Administrator can be run remotely or on a server node. If Cluster Administrator is installed remotely, the remote node must be in the same domain as the server node. When running Cluster Administrator remotely, you should connect to the cluster by means of Compaq Insight Manager or by using the cluster IP address or cluster name. NOTE: The remote feature is not supported in Microsoft Windows 95 or 98. Refer to the Microsoft Cluster Server Administrator's Guide or the Microsoft Windows 2000 Advanced Server documentation for a thorough description of Cluster Administrator's features and specifics on how to use the utility. Compaq Confidential Need to Know Required Writer: Linda Arnold Project: Compaq ProLiant CL380 Software User Guide Comments: Part Number: 157839-004 File Name: g-ch6 System Management.doc Last Saved On: 12/14/00 8:51 AM System Management 6-11 Novell ConsoleOne The Novell ConsoleOne utility is a network management tool that runs on a Windows client or a NetWare 5.1 server. ConsoleOne does not run on a NetWare 4.2 server. The ConsoleOne utility allows you to perform the following tasks: I Browse and organize network resources. I Set up accounts for network users. I Control access to network resources. I Access remote server consoles. ConsoleOne also lets you to manage NetWare clusters, allowing you to perform any of the following cluster-related functions: I Create cluster volumes, resources and templates. I Configure load and unload scripts. I Set failover and failback modes. I Bring cluster resources offline and online. I Assign nodes to resources. I Migrate resources between servers. I Identify cluster and resource states. Refer to the ConsoleOne documentation for a thorough description of ConsoleOne's features and specifics on how to use the utility. Backing Up Your Cluster The need for cluster backup is essential for both business-critical and non-business-critical data. As data becomes an increasingly valued company asset, it needs to be backed up on a regular basis. The process of backing up data will ensure that a company's assets are secure and available when a disaster strikes. The cluster itself provides a high degree of application availability but does not prevent a user from deleting or corrupting a file or set of files. Backing up a cluster's data will increase the overall level of data availability. Compaq Confidential Need to Know Required Writer: Linda Arnold Project: Compaq ProLiant CL380 Software User Guide Comments: Part Number: 157839-004 File Name: g-ch6 System Management.doc Last Saved On: 12/14/00 8:51 AM 6-12 Compaq ProLiant CL380 Software User Guide There are several methods for backing up clustered systems. Compaq recommends using one of the following backup solutions: I The first solution uses two tape backup subsystems with one tape backup subsystem attached to each cluster node. I The second solution uses a separate backup server that uses the standard public client local area network (LAN) as the backup path. Tape backup software varies in its level of cluster awareness, integration, and operation. Contact your tape backup software vendor for more information regarding cluster implementation and support. Compaq Confidential Need to Know Required Writer: Linda Arnold Project: Compaq ProLiant CL380 Software User Guide Comments: Part Number: 157839-004 File Name: g-ch6 System Management.doc Last Saved On: 12/14/00 8:51 AM System Management 6-13 Managing Cluster Performance As applications or resources transfer from one server to another, the performance of the clustered servers will likely change. The extent of the performance change depends on how well equipped the other server node is to handle the increase in workload. This is especially obvious after a server failure, where all of the cluster resources may move to the other server. You can use the Windows Performance Monitor or the Novell NetWare MONITOR.NLM to observe and track system performance. Some applications may also have their own internal performance measurement capabilities. Constant monitoring of each system's performance in a cluster may identify a disparity in the workload being performed by each server. Adjust the distribution of the cluster applications so that the overall cluster performance is maximized. Dynamic load balancing is not available in MSCS, Cluster Service, or NCS. However, MSCS, Cluster Service and NCS do offer the ability to manually load balance your server nodes. Under Windows, you can use information obtained from Performance Monitor to determine whether either of the server nodes is operating at too high a performance level. Use Cluster Administrator to fail over as many cluster groups as necessary to balance the load of each server node. Similarly, under Novell NetWare, use MONITOR.NLM to determine whether either of the server nodes is operating at too high a performance level. The timing of manually moving a cluster group to balance the load should depend strongly on what type of group needs to be moved and how many clients are using the group. File and print services are normally not business-critical, nor do they sustain an extremely high utilization rate. For these reasons, file and print services are good candidates to move whenever load balancing needs to occur, even when the overall cluster utilization is high. However, some applications, such as databases, should not be moved from one server to another during peak processing periods. When a database is moved from one server to another, the database must be shut down and restarted. During the time it takes the database to restart, users do not have access to the database. In these cases, move a database group to another server during non-peak hours. Compaq Confidential Need to Know Required Writer: Linda Arnold Project: Compaq ProLiant CL380 Software User Guide Comments: Part Number: 157839-004 File Name: g-ch6 System Management.doc Last Saved On: 12/14/00 8:51 AM Index bus width 4-17 buttons A add logical drive 4-9 Cluster Administrator 6-6 active/active 4-14, 4-16 configuration 5-2 active/passive 4-14, 4-16 CR3500 Configuration add logical drive wizard 4-1 Utility 4-8 administrative tools 1-14, 2-11 details 4-9 applications help availability 6-11 accessing 1-2, 2-3, 3-2 configuring 1-17, 2-14 insert cluster shortcut 6-9 failing over 6-2 large icons 4-9 installing 1-17 list 4-9 performance 6-13 recovery 5-2 running on a cluster 6-3 set up group 6-9 setting up 1-17, 2-14 small icons 4-9 transferring 6-13 array controller driver installing 1-8, 1-12 C updating 1-9, 1-13 arrays cables, network 3-8 mirrored 4-1 cache single device 4-1 limit 4-15 striped memory size 4-19 mirrored 4-1 options 4-26 parity 4-1 tab 4-14 assisted integration path 1-2, 2-2, writeback 4-25 3-2 capacity adding 4-23 RAID 4-26 B storage 6-1 binding 4-31 cards blanking panel 4-32 network 3-8 boot process, abort 4-36 SCSI ID 1-5, 2-4, 3-4 Compaq Confidential Need to Know Required Writer: Linda Arnold Project: Compaq ProLiant CL380 Software User Guide Comments: Part Number: 157839-004 File Name: x-index Compaq ProLiant CL380 Software User Guide.doc Last Saved On: 12/14/00 8:52 AM 2 Compaq ProLiant CL380 Software User Guide Shared Resources screen 6-3, cautions 6-7 configurations software item 6-5 restoring 4-30 status 6-6 saving 4-30 testing 3-8 logical drives 4-29 verifying 1-14, 2-11, 3-8 CDs Cluster Administrator Microsoft Windows NT Server features 6-10 4.0, Enterprise Edition 1-3 installing 6-6, 6-10 SmartStart 1-1, 2-1, 3-1 launching 6-6 cluster using 1-14, 2-11 address 6-5, 6-9 verifying backing up 6-1, 6-11 cluster creation 1-14, 2-11 capabilities 1-17, 2-14 network client failover 1-15, configuring 3-6 2-13 creating 1-14, 2-11, 3-9, 3-10 server failover 1-15, 2-12 degraded 6-2 effect on user 6-3 documentation 2-14 events 6-4 2-4, 2-5, 2-10 folder 6-3 setting up cluster groups 2-14 group setting up cluster bringing online 1-16, 2-14 resources 2-14
| 157839-004 |