I Compaq SmartStart Installation poster
I Compaq SmartStart and Support Software CD
I Microsoft Windows 2000 Advanced Server Administrator's Guide
I Microsoft Windows 2000 Advanced Server CD with Service Pack 1 or
later
I Compaq Parallel Database Cluster Clustering Software for Oracle8i on
Microsoft Windows 2000 CD
I Oracle8i Enterprise Edition CD
I Oracle8i Parallel Server Setup and Configuration Guide
I Other documentation provided with the Oracle8i software
Installation Overview
The following summarizes the installation and setup of your PDC/O2000:
I Installing the hardware, including:
G Proliant servers
G Compaq StorageWorks Fibre Channel Host Bus Adapters or
Compaq StorageWorks 64-Bit/66 Fibre Channel Host Adapters
(Fibre Host Adapters)
G Gigabit Interface Converter-Shortwave (GBIC-SW) modules
G Compaq StorageWorks Fibre Channel SAN Switches (Fibre Channel
SAN Switches) for redundant Fibre Channel Fabrics
G Compaq StorageWorks Storage Hubs (Storage Hubs) or Compaq
StorageWorks FC-AL Switches (FC-AL Switches) for redundant
Fibre Channel Arbitrated Loops
G Compaq StorageWorks RAID Array 4000s (RA4000 Arrays)
G Compaq StorageWorks RAID Array 4100s (RA4100 Arrays)
G Cluster interconnect and client LAN adapters
G Ethernet hubs or switches
Compaq Confidential Need to Know Required
Writer: Carol Tatick Project: Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide Comments:
Part Number: 225082-002 File Name: f-ch5 Installation and Configuration.doc Last Saved On: 6/13/01 10:27 AM
Installation and Configuration 5-3
I Installing and configuring operating system software, including:
G SmartStart 4.9 or later
G Windows 2000 Advanced Server with Service Pack 1 or later
I Installing and configuring Secure Path for Windows 2000, including:
G Installing the Secure Path Server software
G Installing the Secure Path Client software
G Verifying Shared Storage Using Secure Path Manager
G Defining Active Array controllers
I Installing and configuring the Compaq operating system dependent
modules (OSDs), including:
G Using Oracle Universal Installer to install OSDs for an Ethernet
cluster interconnect
I Installing and configuring Oracle software, including:
G Oracle8i Enterprise Edition with the Oracle8i Parallel Server Option
I Installing Object Link Manager
I Verifying the hardware and software installation, including:
G Cluster communications
G Access to shared storage from all nodes
G Client access to the Oracle8i database
I Power distribution and power sequencing guidelines
Compaq Confidential Need to Know Required
Writer: Carol Tatick Project: Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide Comments:
Part Number: 225082-002 File Name: f-ch5 Installation and Configuration.doc Last Saved On: 6/13/01 10:27 AM
5-4 Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide
Installing the Hardware
Setting Up the Nodes
Physically preparing the nodes (servers) for a cluster is not very different than
preparing them for individual use. You will install all necessary adapters and
insert all internal hard disks. You will attach network cables and plug in SCSI
and Fibre Channel cables. The primary difference is in setting up the shared
storage subsystem.
Set up the hardware on one node completely, then set up the rest of the nodes
identically to the first one. Do not load any software on any cluster node until
all the hardware has been installed in all cluster nodes. Before loading
software, read "Installing the Operating System Software and Configuring the
RA4000/RA4100 Arrays" in this chapter to understand the idiosyncrasies of
configuring a cluster.
IMPORTANT: With some possible exceptions, the servers in the cluster must be set up
identically. The cluster components common to all nodes in the cluster must be identical,
for example, the ProLiant server model, cluster interconnect adapters, amount of memory,
cache, and number of CPUs must be the same for each cluster node. It also means the
Fibre host adapters must be installed into the same PCI slots in each server.
While setting up the physical hardware, follow the installation instructions in
your Compaq ProLiant Server Setup and Installation Guide and in your
Compaq ProLiant Server Installation poster. When you are ready to install the
Fibre Host Adapters and your cluster interconnect adapters, refer to the
instructions in the pages that follow.
Installing the Fibre Host Adapters
Each redundant Fibre Channel Fabric or redundant Fibre Channel Arbitrated
Loop (FC-AL) requires at least two Fibre Host Adapters in each cluster node.
Install these devices as you would any other PCI adapter.
Install two Fibre Host Adapters on the same PCI bus in each server and into
the same two PCI slots in each server. If you need specific instructions, see the
Compaq StorageWorks Fibre Channel Host Bus Adapter Installation Guide or
the Compaq StorageWorks 64-Bit/66 MHz Fibre Channel Host Adapter
Installation Guide.
Compaq Confidential Need to Know Required
Writer: Carol Tatick Project: Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide Comments:
Part Number: 225082-002 File Name: f-ch5 Installation and Configuration.doc Last Saved On: 6/13/01 10:27 AM
Installation and Configuration 5-5
Installing GBIC-SW Modules for the Fibre
Host Adapters
Each Fibre Host Adapter ships with two GBIC-SW modules. Verify that one
module is installed in the Fibre Host Adapter and the other in its Storage Hub,
FC-AL Switch, or Fibre Channel SAN Switch. Each end of the Fibre Channel
cable connecting a Fibre Host Adapter to a Storage Hub, FC-AL Switch, or
Fibre Channel SAN Switch plugs into a GBIC-SW module.
To install GBIC-SW modules:
1. Verify that a GBIC-SW module has been installed into each Fibre Host
Adapter in a server.
2. Insert a GBIC-SW module into the port for the Fibre Host Adapter on its
Storage Hub, FC-AL Switch, or Fibre Channel SAN Switch.
3. Repeat steps 1 and 2 for all other Fibre Host Adapters in the redundant
FC-AL or redundant Fibre Channel Fabric.
Cabling the Fibre Host Adapters to the Storage
Hubs or Switches
Each redundant Fibre Channel Fabric requires from two to four Fibre Channel
SAN Switches. Each redundant FC-AL requires from two to four Storage
Hubs or FC-AL Switches. The cabling from Fibre Host Adapters to the
Storage Hubs, FC-AL Switches, or Fibre Channel SAN Switches is the same
for active/standby (one active and one standby Fibre Host Adapter in each
server) and active/active (two active Fibre Host Adapters in each server)
configurations.
To cable the Fibre Host Adapters to the Storage Hubs, FC-AL Switches, or
Fibre Channel SAN Switches:
1. Using Fibre Channel cables, connect Fibre Host Adapter #1 in each
server to Storage Hub/Switch #1.
2. Using Fibre Channel cables, connect Fibre Host Adapter #2 in each
server to Storage Hub/Switch #2.
IMPORTANT: When connecting a Fibre Channel Host Adapter to a Storage Hub or Fibre
Channel SAN Switch, do not mount the Fibre Channel cables on cable management arms.
Support the Fibre Channel cable so that a bend radius at the cable connector is not less
than 3 inches.
Compaq Confidential Need to Know Required
Writer: Carol Tatick Project: Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide Comments:
Part Number: 225082-002 File Name: f-ch5 Installation and Configuration.doc Last Saved On: 6/13/01 10:27 AM
5-6 Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide
Figure 5-1 shows the Fibre Host Adapters in two servers connected to two
Storage Hubs, FC-AL Switches, or Fibre Channel SAN Switches.
Fibre Host Fibre Host
Adapters (2) Adapters (2)
Node 1 Node 2
Storage Storage
Hub/Switch #1 Hub/Switch #2
Figure 5-1. Connecting Fibre Host Adapters to Storage Hubs, FC-AL Switches,
or Fibre Channel SAN Switches
For more detailed information about the Fibre Channel SAN Switch, refer to
the Compaq StorageWorks Fibre Channel SAN Switch 8 Installation and
Hardware Guide, the Compaq StorageWorks Fibre Channel SAN Switch 16
Installation and Hardware Guide, and the Compaq StorageWorks Fibre
Channel SAN Switch Management Guide.
For more detailed information about the FC-AL Switch, refer to the Compaq
StorageWorks Fibre Channel Arbitrated Loop Switch (FC-AL Switch) User
Guide.
For more detailed information about the Storage Hub, refer the Compaq
StorageWorks Storage Hub 7 Installation Guide and the Compaq
StorageWorks Storage Hub 12 Installation Guide.
Installing the Cluster Interconnect Adapters
A PDC/O2000 running Oracle8i software uses an Ethernet cluster
interconnect. Both redundant and non-redundant cluster interconnects are
supported. However, a redundant cluster interconnect is recommended because
if provides fault tolerance along the entire cluster interconnect path.
Compaq Confidential Need to Know Required
Writer: Carol Tatick Project: Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide Comments:
Part Number: 225082-002 File Name: f-ch5 Installation and Configuration.doc Last Saved On: 6/13/01 10:27 AM
Installation and Configuration 5-7
Ethernet Cluster Interconnect Adapters
For a non-redundant Ethernet cluster interconnect, install one single-port or
dual-port Ethernet adapter into each cluster node. For a redundant Ethernet
cluster interconnect, install two single-port or two dual-port Ethernet adapters
into each cluster node.
For recommended dual-port and single-port Ethernet adapters, see the Compaq
Parallel Database Cluster Model PDC/O2000 Certification Matrix for
Windows 2000 at
www.compaq.com/solutions/enterprise/ha-pdc.html
If you need specific instructions on how to install an Ethernet adapter, refer to
the documentation of the Ethernet adapter you are installing or refer to the user
guide of the ProLiant server you are using.
Refer to the section "Cabling the Ethernet Cluster Interconnect" for more
information about building an Ethernet cluster interconnect.
Installing the Client LAN Adapters
Unlike other clustering solutions, the PDC/O2000 does not allow transmission
of intra-cluster communication across the client LAN. All such
communication must be sent over the cluster interconnect.
Install a NIC into each cluster node for the client LAN. Configuration of the
client LAN is defined by site requirements. To avoid a single point of failure
in the cluster, install a redundant client LAN.
If you need specific instructions on how to install an adapter, refer to the
documentation of the adapter you are installing or refer to the user guide of the
ProLiant server you are using.
Setting Up the RA4000/RA4100 Arrays
Unless otherwise indicated in this guide, follow the instructions in the Compaq
StorageWorks RAID Array 4000 User Guide or the Compaq StorageWorks
RAID Array 4100 User Guide o set up shared storage subsystem components.
For example, these user guides show you how to install shared storage
subsystem components for a single server; however, a PDC/O2000 contains
multiple servers connected to one or more RA4000/RA4100 Arrays through
redundant storage paths.
Compaq Confidential Need to Know Required
Writer: Carol Tatick Project: Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide Comments:
Part Number: 225082-002 File Name: f-ch5 Installation and Configuration.doc Last Saved On: 6/13/01 10:27 AM
5-8 Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide
Figure 5-2 shows two RA4000/RA4100 Arrays connected to two clustered
servers through one redundant Fibre Channel Fabric or redundant FC-AL. The
Fibre Channel Fabric or FC-AL is redundant because there are two paths from
each node to each RA4000/RA4100 Array.
Fibre Host Fibre Host
Adapters (2) Adapters (2)
Node 1 Node 2
Storage Storage
Hub/Switch #1 Hub/Switch #2
RA4000/4100 Array #2
RA4000/4100 Array #1
Figure 5-2. RA4000/RA4100 Arrays connected to clustered servers through
one redundant Fibre Channel Fabric or redundant FC-AL
IMPORTANT: Although you can configure the RA4000/RA4100 Array with a single drive
installed, it is strongly recommended for cluster configuration that all shared drives be in
the RA4000/RA4100 Array before running the Compaq Array Configuration Utility.
Compaq Array Configuration Utility
The Array Configuration Utility is used to set up the hardware aspects of any
drives attached to a RA4000 Array Controller, including the drives in the
shared RA4000/RA4100 Arrays. The Array Configuration Utility stores the
drive configuration information on the drives themselves; therefore, after you
have configured the drives from one of the cluster nodes, it is not necessary to
configure the drives from the other cluster node.
Before you run the Array Configuration to set up your drive arrays during the
SmartStart installation, review the instructions in the "Installing the Operating
System Software and Configuring the RA4000/RA4100 Arrays" section of
this chapter. These instructions include clustering information that is not
included in the Compaq StorageWorks RAID Array 4000 User Guide or the
Compaq StorageWorks RAID Array 4100 User Guide.
Compaq Confidential Need to Know Required
Writer: Carol Tatick Project: Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide Comments:
Part Number: 225082-002 File Name: f-ch5 Installation and Configuration.doc Last Saved On: 6/13/01 10:27 AM
Installation and Configuration 5-9
For detailed information about configuring the drives using the Array
Configuration Utility, see the Compaq StorageWorks RAID Array 4000 User
Guide or the Compaq StorageWorks RAID Array 4100 User Guide.
For information about configuring your shared storage subsystem with RAID,
see Chapter 4, "Cluster Planning."
Installing GBIC-SW Modules for the RA4000
Array Controllers
Each RA4000/RA4100 Array contains two Compaq StorageWorks RAID
Array 4000 Controllers (RA4000 Array Controllers) and ships with four
GBIC-SW modules. Insert one module into an RA4000 Array Controller and
the other module into a Storage Hub, FC-AL Switch, or Fibre Channel SAN
Switch. Each end of the Fibre Channel cable connecting an RA4000 Array
Controller to a Storage Hub, FC-AL Switch, or Fibre Channel SAN Switch
plugs into a GBIC-SW module.
To install GBIC-SW modules:
1. Insert a GBIC-SW module into each RA4000 Array Controller in an
RA4000/RA4100 Array.
2. Insert a GBIC-SW module into the correct port on each affected Storage
Hub, FC-AL Switch, or Fibre Channel SAN Switch (one module for
each RA4000 Array Controller).
3. Repeat steps 1 and 2 for all other RA4000/RA4100 Arrays in the
redundant Fibre Channel Fabric or redundant FC-AL.
Cabling the Storage Hubs or Switches to the
RA4000 Array Controllers
You can configure a redundant Fibre Channel Fabric or a redundant FC-AL
for an active/standby configuration or an active/active configuration. These
types of configurations indicate the state of the Fibre Host Adapters in each
node.
In an active/standby configuration, one Fibre Host Adapter in each cluster
node is connected to an active RA4000 Array Controller and the other Fibre
Host Adapter in each cluster node is connected to a standby RA4000 Array
Controller.
Compaq Confidential Need to Know Required
Writer: Carol Tatick Project: Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide Comments:
Part Number: 225082-002 File Name: f-ch5 Installation and Configuration.doc Last Saved On: 6/13/01 10:27 AM
5-10 Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide
In an active/active configuration, both Fibre Host Adapters in each node are
connected to an active array controller. The number of array controllers each
Fibre Host Adapter is connected to depends on the number of
RA4000/RA4100 Arrays in the redundant Fibre Channel Fabric or redundant
FC-AL. For more information, see Chapter 2, "Cluster Architecture."
In a PDC/O2000, each RA4000/RA4100 Array has two RA4000 Array
Controllers, one active and one standby. In some RA4000/RA4100 Arrays, the
top RA4000 Array Controller defaults to be the active array controller and in
other cases the bottom RA4000 Array Controller defaults to be the active array
controller. This default can be changed using Secure Path Manager.
NOTE: RA4000/RA4100 Arrays are available in rack and tower models. RA4000 Array
Controllers in rack models are located in top rear and bottom rear slots; in tower models,
the array controllers are located in right rear and left rear slots. The right rear and left rear
slots in tower models correspond to the top and bottom slots, respectively, in rack
models. The examples in this guide show the array controller locations in rack models.
Cabling an Active/Standby Configuration
In an active/standby configuration, Storage Hub/Switch #1 connects to active
RA4000 Array Controllers and Storage Hub/Switch #2 connects to standby
RA4000 Array Controllers. The cabling instructions are the same for any
number of RA4000/RA4100 Arrays.
NOTE: When defining the active array controllers as instructed later in this chapter, make
the top array controller in each RA4000/RA4100 Array the active controller.
To cable the Storage Hubs, FC-AL Switches, or Fibre Channel SAN Switches
to the RA4000 Array Controllers in an active/standby configuration:
1. Using Fibre Channel cables, connect Storage Hub/Switch #1 to the top
(active) RA4000 Array Controller in each RA4000/RA4100 Array.
2. Using Fibre Channel cables, connect Storage Hub/Switch #2 to the
bottom (standby) RA4000 Array Controller in each RA4000/RA4100
Array.
Compaq Confidential Need to Know Required
Writer: Carol Tatick Project: Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide Comments:
Part Number: 225082-002 File Name: f-ch5 Installation and Configuration.doc Last Saved On: 6/13/01 10:27 AM
Installation and Configuration 5-11
Figure 5-3 shows two Storage Hubs, FC-AL Switches, or Fibre Channel SAN
Switches connected to the RA4000 Array Controllers in two RA4000/RA4100
Arrays.
Storage Storage
Hub/Switch #1 Hub/Switch #2
Active Standby
RA4000/4100 RA4000/4100
Array Controller Array #1 Array Controller Array #2
Figure 5-3. Cabling Storage Hubs, FC-AL Switches, or Fibre Channel SAN
Switches to RA4000 Array Controllers in an active/standby configuration
Cabling an Active/Active Configuration
In an active/active configuration, each Storage Hub, FC-AL Switch, or Fibre
Channel SAN Switch is connected to active and standby RA4000 Array
Controllers.
You can cable the Storage Hubs, FC-AL Switches, or Fibre Channel SAN
Switches to the RA4000 Array Controllers using one of two methods. The
differences between the two methods are the location of the active array
controllers in the RA4000/RA4100 Arrays and the configuration of the Fibre
Channel cables that connect the Storage Hubs or switches to the array
controllers.
Compaq Confidential Need to Know Required
Writer: Carol Tatick Project: Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide Comments:
Part Number: 225082-002 File Name: f-ch5 Installation and Configuration.doc Last Saved On: 6/13/01 10:27 AM
5-12 Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide
Table 5-1 summarizes the active/active cabling methods. Select the method
that is best for your site.
Table 5-1
Active/Active Cabling Methods
Active Array
Method Controller Advantage Disadvantage
Location
1 Top array controller Consistency in active array Cabling is more complex
slot controller definition. All active than for method 2. Some
array controllers are defined to cables from each Storage
be in the top array controller slot Hub connect to the top array
in each RA4000/RA4100 Array. controller in each
RA4000/RA4100 Array, and
some cables from each
Storage Hub or FC-AL
Switch connect to the
bottom array controller in
each RA4000/RA4100 Array.
2 Top array controller Consistency in cabling. All cables Defining active array
slot in odd- from Storage Hub/Switch #1 controllers is more complex
numbered connect to the top array than for method 1. The
RA4000/RA4100 controller in each active array controller must
Arrays RA4000/RA4100 Array. All cables be defined as the top array
from Storage Hub/Switch #2 controller slot in some
Bottom array connect to the bottom array RA4000/RA4100 Arrays and
controller slot in controller in each as the bottom array
even-numbered RA4000/RA4100 Array. controller slot in other
RA4000/RA4100 RA4000/RA4100 Arrays.
Arrays
Compaq Confidential Need to Know Required
Writer: Carol Tatick Project: Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide Comments:
Part Number: 225082-002 File Name: f-ch5 Installation and Configuration.doc Last Saved On: 6/13/01 10:27 AM
Installation and Configuration 5-13
Figure 5-4 shows an example of using method 1 cabling to connect two
Storage Hubs, FC-AL Switches, or Fibre Channel SAN Switches to RA4000
Array Controllers in two RA4000/RA4100 Arrays.
Storage Storage
Hub/Switch #1 Hub/Switch #2
Active Stand by
RA4000/4100 RA4000/4100
Array Controller Array #1 Array Controller Array #2
Figure 5-4. Method 1: cabling an active/active configuration with two
RA4000/RA4100 Arrays
Compaq Confidential Need to Know Required
Writer: Carol Tatick Project: Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide Comments:
Part Number: 225082-002 File Name: f-ch5 Installation and Configuration.doc Last Saved On: 6/13/01 10:27 AM
5-14 Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide
Figure 5-5 shows an example of using method 2 cabling to connect two
Storage Hubs, FC-AL Switches, or Fibre Channel SAN Switches to RA4000
Array Controllers in two RA4000/RA4100 Arrays.
Storage Storage
Hub/Switch #1 Hub/Switch #2
RA4000/4100 RA4000/4100
Array #1 Array #2
RA4000/4100
RA4000/4100
Standby
Active Array #4
Array #3
Array Controller
Array Controller
Figure 5-5. Method 2: cabling an active/active configuration with two
RA4000/RA4100 Arrays
NOTE: When defining the active array controllers as instructed later in this chapter, for
method 1 cabling make the top array controller in each RA4000/RA4100 Array the active
controller. For method 2 cabling, make the top array controller in odd-numbered
RA4000/RA4100 Arrays the active controller; make the bottom array controller in even-
numbered RA4000/RA4100 Arrays the active controller.
To cable the Storage Hubs, FC-AL Switches, or Fibre Channel SAN Switches
to the RA4000 Array Controllers in an active/active configuration:
1. Using Fibre Channel cables, connect Storage Hub/Switch #1 to the
active RA4000 Array Controller in odd-numbered RA4000/RA4100
Arrays (RA4000/RA4100 Array #1, RA4000/RA4100 Array #3, and
RA4000/RA4100 Array #5).
2. Using Fibre Channel cables, connect Storage Hub/Switch #1 to the
standby RA4000 Array Controller in even-numbered RA4000/RA4100
Arrays (RA4000/RA4100 Array #2 and RA4000/RA4100 Array #4).
3. Using Fibre Channel cables, connect Storage Hub/Switch #2 to the
active RA4000 Array Controller in even-numbered RA4000/RA4100
Arrays.
4. Using Fibre Channel cables, connect Storage Hub/Switch #2 to the
standby RA4000 Array Controller in odd-numbered RA4000/RA4100
Arrays.
Compaq Confidential Need to Know Required
Writer: Carol Tatick Project: Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide Comments:
Part Number: 225082-002 File Name: f-ch5 Installation and Configuration.doc Last Saved On: 6/13/01 10:27 AM
Installation and Configuration 5-15
Installing Additional Redundant Fibre
Channel Fabrics
At this point, you have installed the hardware for one redundant Fibre Channel
Fabric or one redundant FC-AL. To add a second redundant Fibre Channel
Fabric to the PDC/O2000, install another set of the hardware required for one
redundant Fibre Channel Fabric, including:
I Two or more Fibre Host Adapters in each server
I Two or more Fibre Channel SAN Switches
I Fibre Channel cables connecting the Fibre Host Adapters to the Fibre
Channel SAN Switches
I One or more RA4000/RA4100 Arrays
I Fibre Channel cables connecting the Fibre Channel SAN Switches to the
RA4000/RA4100 Arrays
I GBIC-SW modules for Fibre Host Adapters, Fibre Channel SAN
Switches, and RA4000 Array Controllers
Installing Additional Redundant FC-ALs
To add a second redundant FC-AL to the PDC/O2000, install another set of
the hardware required for one redundant FC-AL, including:
I Two or more Fibre Host Adapters in each server
I Two or more Storage Hubs or FC-AL Switches
I Fibre Channel cables connecting the Fibre Host Adapters to the Storage
Hubs or FC-AL Switches
I One or more RA4000/RA4100 Arrays
I Fibre Channel cables connecting the Storage Hubs or FC-AL Switches
to the RA4000/RA4100 Arrays
I GBIC-SW modules for Fibre Host Adapters, Storage Hubs or FC-AL
Switches, and RA4000 Array Controllers
Compaq Confidential Need to Know Required
Writer: Carol Tatick Project: Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide Comments:
Part Number: 225082-002 File Name: f-ch5 Installation and Configuration.doc Last Saved On: 6/13/01 10:27 AM
5-16 Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide
Cabling the Ethernet Cluster Interconnect
A PDC/O2000 running Oracle8i software uses an Ethernet cluster
interconnect.
The following components are used in a non-redundant Ethernet cluster
interconnect:
I One Ethernet adapter in each cluster node
I Ethernet cables and a switch or hub
G For two-node PDC/O2000 clusters, you can either use one Ethernet
crossover cable or one 100-Mbit/second Ethernet switch or hub and
standard Ethernet cables to connect the two servers.
G For PDC/O2000 clusters with three or more nodes, you use one
100-Mbit/second Ethernet switch and standard Ethernet cables to
connect the servers.
The following components are used in a redundant Ethernet cluster
interconnect:
I Two Ethernet adapters in each cluster node
I Ethernet cables and switches or hubs
G For two-node PDC/O2000 clusters, you can use two 100-Mbit/sec
Ethernet switches or hubs with cables to connect the servers.
G For PDC/O2000 clusters with three or more nodes, you use two
100-Mbit/sec Ethernet switches connected by Ethernet cables to a
separate Ethernet adapter in each server.
NOTE: In a redundant Ethernet cluster configuration, one Ethernet crossover cable must
be installed between the two Ethernet switches or hubs that are dedicated to the cluster
interconnect.
To connect two nodes in a non-redundant Ethernet cluster interconnect using
an Ethernet crossover cable:
1. In both nodes, install the Ethernet crossover cable into the port on the
Ethernet adapter that is designated for the Ethernet cluster interconnect.
2. If you have a dual-port Ethernet adapter in each node, you can use the
second (lower) port on each to connect to a client LAN hub or switch.
Compaq Confidential Need to Know Required
Writer: Carol Tatick Project: Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide Comments:
Part Number: 225082-002 File Name: f-ch5 Installation and Configuration.doc Last Saved On: 6/13/01 10:27 AM
Installation and Configuration 5-17
Figure 5-6 shows the non-redundant Ethernet cluster interconnect components
used in a two-node PDC/O2000 cluster. These components include a dual-port
Ethernet adapter in each node. The top port on each adapter connects by
Ethernet crossover cable to the top port on the adapter in the other node. The
bottom port on each adapter connects by Ethernet cable to the client LAN
switch or hub.
Ethernet Crossover Cable
for Ethernet Cluster Interconnect
Dual-por t Dual-por t
Ethernet Ethernet
Adapter Adapter
Ethernet Cables
for Client LAN
Node 1 Node 2
Client LAN
Hub or Switch
Figure 5-6. Non-redundant Ethernet cluster interconnect using a crossover
cable
Compaq Confidential Need to Know Required
Writer: Carol Tatick Project: Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide Comments:
Part Number: 225082-002 File Name: f-ch5 Installation and Configuration.doc Last Saved On: 6/13/01 10:27 AM
5-18 Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide
To connect two or more nodes in a non-redundant Ethernet cluster
interconnect:
1. Install a standard Ethernet cable between an Ethernet adapter in one
node and one Ethernet hub or switch.
2. Repeat step 1 for every other node in the cluster.
Figure 5-7 shows another option for a non-redundant Ethernet cluster
interconnect in a two-node PDC/O2000 cluster. These include an Ethernet
adapter in each node connected by Ethernet cables to an Ethernet switch
or hub.
RA4000/4100 Array
Storage Hub/Switch
Ethernet Adapter Ethernet Adapter
Storage Hub/Switch
Ethernet
cables
Node 1 Node 2
Client LAN
Figure 5-7. Non-redundant Ethernet cluster interconnect using an Ethernet
switch or hub
To connect two or more nodes in a redundant Ethernet cluster interconnect:
1. Insert the ends of two Ethernet cables into two Ethernet adapter ports
designated for the cluster interconnect.
2. Connect the other end of one Ethernet cable to an Ethernet hub or
switch. Connect the other end of the second Ethernet cable to the second
Ethernet hub or switch.
3. Repeat steps 1 and 2 for all other nodes in the cluster.
4. Install one crossover cable between the Ethernet hubs or switches.
Compaq Confidential Need to Know Required
Writer: Carol Tatick Project: Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide Comments:
Part Number: 225082-002 File Name: f-ch5 Installation and Configuration.doc Last Saved On: 6/13/01 10:27 AM
Installation and Configuration 5-19
Figure 5-8 shows the redundant Ethernet cluster interconnect components used
in a PDC/O2000 with two or more nodes.
Ethernet Switch/Hub #1
for Cluster Interconnect
Ethernet Switch/Hub #2
Crossover
for Cluster Interconnect
Ca ble
Dual-por t Dual-por t
Ether net Ether net
Adapters (2) Adapters (2)
Node 1 Node 2
Crossover
Ca ble Client LAN
Hub/Switch #1
Client LAN
Hub/Switch #2
Figure 5-8. Redundant Ethernet cluster interconnect for a two-node
PDC/O2000 cluster
These components include two dual-port Ethernet adapters in each cluster
node. The top port on each adapter connects by Ethernet cable to one of two
Ethernet switches or hubs provided for the cluster interconnect. The bottom
port on each adapter connects by Ethernet cable to the client LAN for the
cluster. A crossover cable is installed between the two Ethernet switches or
hubs used in the Ethernet cluster interconnect.
For clusters of three or more nodes using a redundant Ethernet cluster
interconnect, Compaq requires that you use two Ethernet 100-Mbit/sec
switches to maintain good network performance across the cluster. If there are
only two nodes in a cluster, you can use either Ethernet hubs or switches and
standard Ethernet cables to connect the nodes.
For more information on configuring Ethernet connections in a redundant or
non-redundant cluster interconnect, including enabling failover from one
Ethernet path to another, see Supported Ethernet Interconnects for Compaq
Parallel Database Clusters Using Oracle Parallel Server at
www.compaq.com/support/techpubs/whitepapers
Compaq Confidential Need to Know Required
Writer: Carol Tatick Project: Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide Comments:
Part Number: 225082-002 File Name: f-ch5 Installation and Configuration.doc Last Saved On: 6/13/01 10:27 AM
5-20 Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide
Cabling the Client LAN
You can use any TCP/IP network to connect to a client LAN. The following
procedure contains instructions for cabling an Ethernet client LAN.
To cable an Ethernet client LAN:
1. Insert one end of an Ethernet cable into an Ethernet adapter port
designated for the client LAN in a cluster node.
If you are using a recommended dual-port Ethernet adapter for the
cluster interconnect, connect the client LAN to the empty port.
If you are using a recommended single-port adapter for the cluster
interconnect, connect the client LAN to the port on the embedded
adapter or to another single-port Ethernet adapter.
2. Connect the node to the client LAN by inserting the other end of the
client LAN Ethernet cable to a port in the Ethernet hub or switch.
3. Repeat steps 1 and 2 for all other cluster nodes.
Redundant Client LAN
If you elect to install an Ethernet client LAN, a redundant client LAN requires
two single-port Ethernet adapters or one dual-port Ethernet adapter in each
cluster node. It also requires two Ethernet hubs or switches, and one Ethernet
crossover cable must be installed between the Ethernet hubs or switches.
Installing redundant crossover cables directly between the nodes is not
supported.
For information on configuring Ethernet connections in a redundant client
LAN, including enabling failover from one Ethernet path to another, see
Supported Ethernet Interconnects for Compaq Parallel Database Clusters
Using Oracle Parallel Server at
www.compaq.com/support/techpubs/whitepapers
Compaq Confidential Need to Know Required
Writer: Carol Tatick Project: Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide Comments:
Part Number: 225082-002 File Name: f-ch5 Installation and Configuration.doc Last Saved On: 6/13/01 10:27 AM
Installation and Configuration 5-21
Installing the Operating System Software
and Configuring the RA4000/RA4100
Arrays
You will follow an automated procedure using Compaq SmartStart to install
the operating system software and configure the shared storage disks on the
RA4000/RA4100 Arrays.
Guidelines for Clusters
Installing clustering software requires several specific steps and guidelines that
might not be necessary when installing software on a single server. Be sure to
read and understand the following items before proceeding with the specific
software installation steps in "Automated Installation Steps."
I Because a PDC/O2000 contains multiple servers, have sufficient
software licensing rights to install Windows NT Server software
applications on each server.
I Be sure your servers, adapters, hubs, and switches are installed and
cabled before you install the software.
I Power on the cluster as instructed later in this chapter in "Power
Distribution and Power Sequencing Guidelines."
I SmartStart runs the Compaq Array Configuration Utility, which is used
to configure the drives in the RA4000/RA4100 Arrays. The Array
Configuration Utility stores the drive configuration information on the
drives themselves. After you have configured the shared drives from one
of the cluster nodes, it is not necessary to configure the drives from the
other cluster nodes.
When the Array Configuration Utility runs on the first cluster node,
configure the shared drives in the RA4000/RA4100 Array. When
SmartStart runs the utility on the other cluster nodes, you will be
presented the information on the shared drives that was entered when
the Array Configuration Utility was run on the first node. Accept the
information as presented and continue.
NOTE: Local drives on each cluster node still need to be configured.
Compaq Confidential Need to Know Required
Writer: Carol Tatick Project: Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide Comments:
Part Number: 225082-002 File Name: f-ch5 Installation and Configuration.doc Last Saved On: 6/13/01 10:27 AM
5-22 Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide
I When you set up an Ethernet cluster interconnect, be sure to select
TCP/IP as the network protocol. The Ethernet cluster interconnect
should be on its own subnet.
IMPORTANT: The IP addresses of the Ethernet cluster interconnect must be static, not
dynamically assigned by DHCP.
I Be sure to set up unique IP addresses and node names for each node in
the hosts and lmhosts files at %SystemRoot%\system32\drivers\etc.
G For an Ethernet cluster interconnect, one IP address and node name
is for the cluster interconnect, and the other IP address and node
name is for the client LAN. Both entries are required for each node
in the cluster.
G After setting up these file entries, be sure to restart the node so it
picks up the correct IP addresses.
I After you have installed Windows 2000 Advanced Server, run Disk
Management on each node to verify you can see the shared storage
subsystem resources on all RA4000/RA4100 Arrays and select Commit
Changes in Disk Management. Restart all nodes.
Automated Installation Using SmartStart
CAUTION: Automated installation using SmartStart assumes that it is being
installed on new servers. If there is any existing data on the servers, it will be
destroyed.
You will need the following during SmartStart installation:
I SmartStart and Support Software CD 4.9 or later
I Microsoft Windows 2000 Advanced Server with Service Pack 1 or later
I SmartStart Installation poster
I Server Profile diskette
Cluster-Specific SmartStart Installation
The SmartStart Installation poster describes the general flow of configuring
and installing software on a single server. The installation for a PDC/O2000
will be very similar.
Compaq Confidential Need to Know Required
Writer: Carol Tatick Project: Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide Comments:
Part Number: 225082-002 File Name: f-ch5 Installation and Configuration.doc Last Saved On: 6/13/01 10:27 AM
Installation and Configuration 5-23
The one difference is that through the Array Configuration Utility, SmartStart
gives you the opportunity to configure the shared drives on all servers. For
cluster configuration, you should configure the drives on the first server, then
accept the same settings for the shared drives when given the option on the
other servers.
Automated Installation Steps
You will perform the following automated installation steps to install
operating system software on every node in the cluster.
1. Power up the following cluster components in this order:
G RA4000/RA4100 Arrays
G Storage Hubs, FC-AL Switches, or Fibre Channel SAN Switches
G Ethernet hubs or switches
2. Power up a cluster node and put the SmartStart and Support Software
CD into the CD-ROM drive.
3. Select the Assisted Integration installation path.
4. When prompted, insert the Server Profile diskette into the floppy disk
drive.
5. Select Windows 2000 Advanced Server as the operating system.
6. Continue with the Assisted Integration installation. Windows 2000
Advanced Server is installed as part of this process.
NOTE: For clustered servers, take the default for Automatic Server Recovery (ASR) and
select standalone as the server type.
NOTE: When prompted to use the Array Configuration Utility, it is only necessary to
configure the shared drives during the first node's setup. When configuring the other
nodes, the utility shows the results of the shared drives configured during the first node's
setup.
NOTE: Do not install Microsoft Cluster Server.
7. From Start, select Settings and then select Network and Dial-up
Connections. Select the first connection and right click. Select
Properties. Select the Internet Protocol (TCP/IP) box and click OK.
8. Double-click on TCP/IP and the Internet Protocol (TCP/IP)
Properties screen is displayed. Enter the IP address as appropriate for
each of the port connections.
Compaq Confidential Need to Know Required
Writer: Carol Tatick Project: Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide Comments:
Part Number: 225082-002 File Name: f-ch5 Installation and Configuration.doc Last Saved On: 6/13/01 10:27 AM
5-24 Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide
9. Enter unique IP addresses and node names for each node in the hosts
and lmhosts files located at %SystemRoot%\system32\drivers\etc.
Record this information:
G For an Ethernet cluster interconnect, one IP address and node name
is for the redundant cluster interconnect, and the other IP address and
node name is for the client LAN. For example, node1 for the client
LAN and node1_san for the cluster interconnect. (The "_san" stands
for system area network.)
Due to the complexity of Windows 2000 Advanced Server and
multiple-NIC servers, you need to verify that the correct IP addresses
are assigned to the correct ports/NICs and that the Ethernet cables are
connected to the correct ports. If IP addresses are not assigned to the
correct port, Oracle software and external programs cannot
communicate over the proper network link. The next step describes how
to perform this verification.
10. Verify that the IP addresses for the client LAN and cluster interconnect
are correctly assigned by pinging the machine host name. (Find this
name by selecting the Network ID tab on the System Properties menu
in the System Control Panel.) The IP address returned by the ping utility
is one of the IP addresses you specified; it is the IP address that
Windows 2000 Advanced Server assigned to the client LAN.
11. If the ping command does not return the IP address you specified in the
TCP/IP Properties dialog box for the client LAN port and you are
using Service Pack 1 or later:
a. Double-click the Network and Dial-up Connections icon in the
Control Panel. From the Advanced menu, click Advanced Settings.
A list of Ethernet connections are shown. The first on the list is the
Primary Connection.
b. Select all protocols in the Show Bindings for scroll box.
c. Click + (plus sign) next to the TCP/IP protocol. A list of all installed
Ethernet NICs appears, including the slot number and port number
of each. Windows NT Server uses the NIC at the top of the list for
the client LAN.
d. Change the binding order of the NICs to put the NIC you specified
for the client LAN at the top of the list. Find the client LAN NIC in
the list and select it.
Compaq Confidential Need to Know Required
Writer: Carol Tatick Project: Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide Comments:
Part Number: 225082-002 File Name: f-ch5 Installation and Configuration.doc Last Saved On: 6/13/01 10:27 AM
Installation and Configuration 5-25
e. With the client LAN NIC selected, click Move Up to position this
NIC to the top of the list.
f. Click OK on the dialog box and restart the node when prompted.
IMPORTANT: Record the cluster interconnect node name, the client LAN node name, and
the IP addresses assigned to them. You will need this information later when installing
Compaq OSDs.
12. If you are installing node1, open Windows 2000 Advanced Server Disk
Management to create extended disk partitions and logical partitions
within the extended partitions on all RA4000/RA4100 Arrays. (If you
are installing a node other than node1, skip to step 13.)
Create all disk partitions on the RA4000/RA4100 Arrays from node1,
select Commit Changes Now from the Partition menu, and restart the
node.
For more information on creating partitions, see the Oracle8i Parallel
Server Setup and Configuration Guide.
13. If you are installing a node other than node1, open Disk Management to
verify that the same shared disk resources are seen from this node as are
seen from other installed nodes in the cluster. If they are not, restart the
node and review the shared disk resources again.
14. Repeat steps 2 through 13 on all other cluster nodes.
15. After configuring all nodes in the cluster, verify the client LAN
connections by pinging all nodes in the cluster from each cluster node.
Use the client LAN node name, (for example, node1) with the ping
command. If you are using a redundant Ethernet cluster interconnect,
verify the cluster interconnect connections by using the Ethernet cluster
interconnect node name (for example, node1_san) with the ping
command.
16. Power down the cluster nodes and client LAN Ethernet switches or
hubs.
Compaq Confidential Need to Know Required
Writer: Carol Tatick Project: Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide Comments:
Part Number: 225082-002 File Name: f-ch5 Installation and Configuration.doc Last Saved On: 6/13/01 10:27 AM
5-26 Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide
Installing Secure Path Software for
Windows 2000
The Secure Path software for Windows 2000 is installed on both the server
and the client. The Secure Path server software is installed on the Windows
host system to which the RAID storage system is connected. TCP/IP must be
installed on the host system. Secure Path software must be installed on each
member of the cluster.
NOTE: Secure Path installation requires that a temporary directory be available on the
system drive. For example: C:\Temp
Installing the Secure Path Server Software
To install the Secure Path Server software:
1. Insert the Compaq SANWorks Secure Path Software CD into your
CD-ROM drive.
2. If you have AutoRun enabled on your server, the Secure Path setup
program will start automatically. If AutoRun is not enabled, select Run
from the Start menu and enter the following command:
DRIVE_LETTER:\spinstall\setup.exe
where DRIVE_LETTER is the drive letter assigned to the CD-ROM drive.
3. When the setup begins, select the destination path. Select Secure Path
Server Install to install the required drivers and agent on your server.
The Server Install option prompts you to designate clients permitted to
manage the host. Setup, by default, lists the proper DNS name to use for
accessing the local host from a client (Secure Path Manager) running on
the local host.
NOTE: Check with your System Administrator to ensure that the correct TCP/IP network
configurations and protocols have been established.
4. Enter a validation password. The password must be the same for each
member of the cluster.
Compaq Confidential Need to Know Required
Writer: Carol Tatick Project: Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide Comments:
Part Number: 225082-002 File Name: f-ch5 Installation and Configuration.doc Last Saved On: 6/13/01 10:27 AM
Installation and Configuration 5-27
Installing the Secure Path Client Software
Install the Secure Path Client software on either the same Windows host
system as the Secure Path Server software or any Windows workstation. The
workstation must be TCP/IP-capable.
To install the Secure Path Client software:
1. Insert the Compaq SANWorks Secure Path Software CD into your
CD-ROM drive.
2. If you have AutoRun enabled on your server, the Secure Path setup
program will start automatically. If AutoRun is not enabled, select Run
from the Start menu and enter the following command:
DRIVE_LETTER:\spinstall\setup.exe
where DRIVE_LETTER is the drive letter assigned to the CD-ROM.
3. When the setup begins, select the destination folder. Select Secure Path
Client Install to install the Secure Path Manager software.
For more detail information on installing Secure Path software, refer to the
document Secure Path for Windows 2000 on RAID Array 4000/4100.
Verifying Shared Disk Storage Using Secure Path
Manager
Make sure you can see the same shared disk storage resources from each node
using Secure Path Manager as you can with Disk Management.
To verify the shared storage resources from Secure Path Manager:
IMPORTANT: Run Secure Path Manager from only one cluster node at a time. Otherwise,
multiple Secure Path Manager processes will try to control the same RA4000/RA4100
Arrays.
1. On a cluster node, click Start, Programs, and under Secure Path click
SPM. The Secure Path Manager (Fibre Channel) screen is displayed.
2. The Secure Path Manager is setup in a "tree" structure with storage
arrays as the first branch. Storage arrays are designated with the name
"Storage System X"; where X identifies the number of storage arrays
you have beginning with 0.
Compaq Confidential Need to Know Required
Writer: Carol Tatick Project: Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide Comments:
Part Number: 225082-002 File Name: f-ch5 Installation and Configuration.doc Last Saved On: 6/13/01 10:27 AM
5-28 Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide
3. If you double-click "Storage System X", you should get two more
branches that represent the two RA4000 Array Controllers in that array.
These controllers are named "ControllerA" and "ControllerB," which
correspond to the Active controller and the Standby controller,
respectively.
4. Once you are at the controller branch, you can identify and verify the
Active controller by double-clicking on the controller with a "+"
character next to it. When you open the controller marked with the "+"
character, the logical drives (LUNS) for that controller are displayed.
You can change the view of your logical drives by using the View
pull-down menu.
5. Repeat steps 1 through 4 on all PDC/O2000 cluster nodes to verify that
Secure Path Manager displays the same shared disk storage resources
information from each node.
Defining Active Array Controllers
When a new RA4000/RA4100 Array is first installed, the top array controller
should be the active controller and the bottom controller should the standby
controller. You can confirm the location of the active controller by verifying
that its ninth green LED is on. Over time, however, it is not uncommon for the
active and standby states of the two controllers to be interchanged.
Consequently, in some RA4000/RA4100 Arrays, the RA4000 Array
Controller in the top array controller slot will be the active array controller and
in other cases the RA4000 Array Controller in the bottom array controller slot
will be the active array controller.
You need to define the correct slot location (top or bottom) for the active array
controller in an RA4000/RA41000 Array according to the type of
configuration you are using (active/standby or active/active). If you are using
an active/active configuration, the active array controller's slot location also
depends on the cabling method employed, as discussed previously in "Cabling
an Active/Active Configuration." Table 5-2 provides guidelines for defining
the active array controller slot location under these various configurations.
Compaq Confidential Need to Know Required
Writer: Carol Tatick Project: Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide Comments:
Part Number: 225082-002 File Name: f-ch5 Installation and Configuration.doc Last Saved On: 6/13/01 10:27 AM
Installation and Configuration 5-29
Table 5-2
Active Array Controller Locations
Configuration Active Array Controller Location
Active/Standby Top array controller slot
Active/Active: Cabling Method 1 Top array controller slot
Active/Active: Cabling Method 2 Top array controller slot in odd-numbered
RA4000/RA4100 Arrays
Bottom array controller slot in even-numbered
RA4000/RA4100 Arrays
NOTE: If Secure Path Manager indicates that the active array controllers are already
located in the proper slots, you do not need to redefine their locations by performing the
following procedure.
Changing the location of the active array controller changes the entire
redundant Fibre Channel Fabric path or redundant FC-AL path, which
includes the Fibre Host Adapter, the Storage Hub, FC-AL Switch, or Fibre
Channel SAN Switch, and the RA4000 Array Controller. So, when you change
the active array controller, you change the entire active Fibre Channel Fabric
or FC-AL path.
To change the active Fibre Channel Fabric or FC-AL path:
IMPORTANT: Run Secure Path Manager from only one cluster node at a time. Otherwise,
multiple Secure Path Manager processes will try to control the same RA4000/RA4100
Arrays.
Compaq Confidential Need to Know Required
Writer: Carol Tatick Project: Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide Comments:
Part Number: 225082-002 File Name: f-ch5 Installation and Configuration.doc Last Saved On: 6/13/01 10:27 AM
5-30 Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide
1. On any cluster node, click Start, Programs. Under Secure Path, click
SPM. The Secure Path Manager (Fibre Channel) screen is displayed.
2. After clicking on the logical drives (LUNS) you would like to move to
the other array controller, right-click the first controller and a pop-up
message appears that states "Move to Other Controller." Left-click the
message and the logical drives will now move to the other controller.
You can also move the desired logical drives by left-clicking on the
drives and keeping the left mouse button held down while dragging
them to the other controller. Once you let go, the logical drives will be
"dropped" onto the other controller.
NOTE: You cannot drop logical drives (LUNs) from an array controller on one
RA4000/RA4100 Array to an array controller on another RA4000/RA4100 Array.
IMPORTANT: Wait at least 10 to 30 seconds after changing an FC-AL path in one
RA4000/RA4100 Array before changing an FC-AL path in another RA4000/RA4100 Array.
3. Repeat steps 1 and 2 for every RA4000/RA4100 Array in which you
need to change the active Fibre Channel Fabric or FC-AL path.
Installing Compaq OSDs
Use the Oracle Universal Installer (OUI) program to install the Compaq
operating system dependent modules (OSDs) for Oracle8i Parallel Server.
Compaq supplies a software package with the OUI that installs Compaq OSDs
for an Ethernet cluster interconnect.
The OUI runs from one node in the cluster and performs the following tasks:
I Copies the OSDs to the internal hard drive of all cluster nodes.
I Sets up registry entries for file location and standard registry parameters
for the OSDs on all cluster nodes.
Compaq Confidential Need to Know Required
Writer: Carol Tatick Project: Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide Comments:
Part Number: 225082-002 File Name: f-ch5 Installation and Configuration.doc Last Saved On: 6/13/01 10:27 AM
Installation and Configuration 5-31
From one node in the cluster, the OUI installs and configures OSDs on the
other nodes in the cluster, provided that:
I The servers are communicating through a local area network using a
TCP/IP protocol.
I The user running the OUI program has administrator privileges on every
node.
Verifying Cluster Communications
IMPORTANT: The successful completion of the OUI program depends on TCP/IP
connectivity being set up correctly. It also depends on the person running the OUI having
administrator access to every node in the cluster. Before running the OUI, verify cluster
communications and the administrator privileges of the person performing the installation.
If the OSDs do not install successfully, the OUI will not offer the option to install Oracle8i
Parallel Server.
The Compaq operating system dependent modules (OSDs) are installed from
one node in the cluster (the installing node). The node on which you run the
OUI program must be able to communicate with every other node in the
cluster in order to copy information to all other cluster nodes.
Use the ping utility to verify that each node in the cluster can communicate
with every other node.
Run the ping utility from each node in the cluster. Ping the client LAN name
of every node in the cluster. The client LAN name and client LAN IP address
were assigned to each cluster node while you were using SmartStart to install
the operating system software.
If you are using an Ethernet cluster interconnect, a cluster interconnect name
and IP address were assigned to each cluster node. Ping the Ethernet cluster
interconnect name of every node in the cluster.
When using the client LAN name with the ping command, the IP address
displayed by the ping utility should be the client LAN IP address. When using
an Ethernet cluster interconnect name, the IP address displayed by the ping
utility should be an Ethernet cluster interconnect address. If the ping utility
does not return the expected IP addresses, check the entries in the hosts and
lmhosts files at %SystemRoot%\system32\drivers\etc.
| 225082-002
|
