controllers fails. controller in each RA4000/RA4100 Array, and Fibre Channel cables.
A Fibre Host Adapter connected to None
the Fibre Channel SAN Switch that
is connected to the standby array
controllers fails.
Compaq Confidential Need to Know Required
Writer: John Blackburn Project: Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide Comments:
Part Number: 225082-002 File Name: c-ch2 Cluster Architecture.doc Last Saved On: 6/13/01 10:21 AM
Cluster Architecture 2-37
Table 2-5 identifies possible I/O path failure events in redundant Fibre
Channel Fabrics for active/active configurations with two or more
RA4000/RA4100 Arrays and the failover response, if any, implemented by
Secure Path for each failure.
Table 2-5
I/O Path Failure and Failover Scenarios in Redundant Fibre Channel Fabrics for
Active/Active Configurations With Two or More RA4000/RA4100 Arrays
Description of Failure Failover Response
The active array controller in one Secure Path makes the standby array controller in the
RA4000/RA4100 Array fails. RA4000/RA4100 Array active and reroutes I/O activity to that array
controller. The Fibre Channel SAN Switch that is connected to the
new active array controller becomes the active I/O path to this
RA4000/RA4100 Array. In each node, I/O activity between the Fibre
Host Adapter that is connected to the failed array controller is
rerouted to the second Fibre Host Adapter in the pair, but only along
the I/O path to the affected RA4000/RA4100 Array. The first Fibre
Host Adapter in each node continues to be the active I/O path for
active array controllers in other RA4000/RA4100 Arrays to which it
is connected.
The standby array controller in one None
RA4000/RA4100 Array fails.
The Fibre Channel cable Secure Path makes the active array controller to which the failed
connection between the active cable is connected inactive. The standby array controller in the
array controller in one RA4000/RA4100 Array becomes active. I/O activity is routed
RA4000/RA4100 Array and its through the Fibre Channel cable installed to the new active array
Fibre Channel SAN Switch is controller and the other Fibre Channel SAN Switch. In each node,
broken. I/O activity between the Fibre Host Adapter that is connected to the
failed array controller is rerouted to the second Fibre Host Adapter
in the pair, but only along the I/O path to the affected
RA4000/RA4100 Array. The first Fibre Host Adapter in each node
continues to be the active I/O path for active array controllers in
other RA4000/RA4100 Arrays to which it is connected.
continued
Compaq Confidential Need to Know Required
Writer: John Blackburn Project: Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide Comments:
Part Number: 225082-002 File Name: c-ch2 Cluster Architecture.doc Last Saved On: 6/13/01 10:21 AM
2-38 Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide
Table 2-5
I/O Path Failure and Failover Scenarios in Redundant Fibre Channel Fabrics for Active/Active
Configurations With Two or More RA4000/RA4100 Arrays continued
Description of Failure Failover Response
The Fibre Channel cable None
connection between the standby
array controller in one
RA4000/RA4100 Array and its
Fibre Channel SAN Switch is
broken.
A Fibre Channel SAN Switch fails. Secure Path makes each active array controller to which the failed
Fibre Channel SAN Switch is connected inactive. The standby array
controller in each affected RA4000/RA4100 Array becomes the
active array controller. The Fibre Channel SAN Switch that is
connected to the new active array controllers becomes the active
I/O path for these RA4000/RA4100 Arrays. In each node, the Fibre
Host Adapter that is connected to the failed Fibre Channel SAN
Switch becomes inactive, and all I/O activity is rerouted through the
other Fibre Host Adapter in the pair and the remaining active Fibre
Channel SAN Switch.
The Fibre Channel cable Secure Path makes all I/O path connections between the affected
connection between a Fibre Fibre Host Adapter and active array controllers inactive. The
Channel SAN Switch and a Fibre standby array controller in every affected RA4000/RA4100 Array
Host Adapter in one node is becomes the active array controller. The Fibre Channel SAN Switch
broken. connected to the newly active array controllers becomes the active
I/O path for the entire FC-AL. The Fibre Channel SAN Switch
connected to the failed Fibre Channel cable becomes inactive. The
second Fibre Host Adapter in each node, which is connected to the
only active Fibre Channel SAN Switch, becomes the only active
Fibre Host Adapter in the node's pair.
A Fibre Host Adapter in a node Secure Path makes all I/O path connections between the affected
fails. Fibre Host Adapter and active array controllers inactive. The
standby array controller in every affected RA4000/RA4100 Array
becomes the active array controller. The Fibre Channel SAN Switch
connected to the newly active array controllers becomes the active
I/O path for the entire FC-AL. The Fibre Channel SAN Switch
connected to the failed Fibre Host Adapter becomes inactive. The
second Fibre Host Adapter in each node, which is connected to the
only active Fibre Channel SAN Switch, becomes the only active
Fibre Host Adapter in the node's pair.
Compaq Confidential Need to Know Required
Writer: John Blackburn Project: Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide Comments:
Part Number: 225082-002 File Name: c-ch2 Cluster Architecture.doc Last Saved On: 6/13/01 10:21 AM
Cluster Architecture 2-39
I/O Path Configurations for Redundant
Fibre Channel Arbitrated Loops
Overview of FC-AL SAN Topology
Fibre Channel standards define a multi-layered architecture for moving data
across the storage area network (SAN). This layered architecture can be
implemented using the Fibre Channel Fabric or the Fibre Channel Arbitrated
Loop (FC-AL) topology. The PDC/O2000 supports both topologies.
A redundant FC-AL is two to four FC-AL Switches or Storage Hubs installed
between Fibre Host Adapters in a PDC/O2000's cluster nodes and the array
controllers in the shared storage subsystems. These hardware components
cannot be shared by other redundant FC-ALs or redundant Fibre Channel
Fabrics in the same cluster.
When Storage Hubs are used, the FC-AL SAN is a shared gigabit transport
with a total 100 MBps bandwidth divided among all Storage Hub ports. The
functional bandwidth available to any one device on a Storage Hub port is
determined by the total population on the segment and the level of activity of
devices on other ports. The more devices used, the less bandwidth that is
available for each port.
When FC-AL Switches are used, the FC-AL SAN supports multiple
100 MB/sec point-to-point connections in parallel. Each FC-AL Switch
provides multiple dedicated, non-blocking connections between Fibre Host
Adapters and array controllers (as contrasted with the shared connections on a
Storage Hub). The FC-AL Switch also eliminates the shared bandwidth speed
limitations of the Storage Hub.
Compaq Confidential Need to Know Required
Writer: John Blackburn Project: Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide Comments:
Part Number: 225082-002 File Name: c-ch2 Cluster Architecture.doc Last Saved On: 6/13/01 10:21 AM
2-40 Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide
Redundant Fibre Channel Arbitrated Loops
A redundant FC-AL refers to the redundant hardware implemented to connect
Fibre Host Adapters to a particular set of shared storage devices in a
PDC/O2000. Each redundant FC-AL consists of the following hardware:
I Two or more Fibre Host Adapters in each node
I Two or more Storage Hubs or FC-AL Switches
I One or more RA4000/RA4100 Arrays, each containing two single-port
RA4000 Array Controllers
I GBIC-SW modules installed in Fibre Host Adapters, Storage Hubs or
FC-AL Switches, and array controllers to connect Fibre Channel cables
I Fibre Channel cables used to connect the Fibre Host Adapters to the
Storage Hubs or FC-AL Switches to the array controllers
IMPORTANT: For detailed information about cascading two FC-AL Switches, refer to the
latest Compaq StorageWorks documentation. This guide does not document cascaded
configurations for the FC-AL Switch.
A redundant FC-AL consists of from two to four individual loops, each of
which traverses a single Storage Hub or FC-AL Switch. The number of loops
present is determined by the number of Fibre Host Adapters per node that are
dedicated to the redundant FC-AL: two Fibre Host Adapters per node create
two loops; four Fibre Host Adapters per node create four loops.
Compaq Confidential Need to Know Required
Writer: John Blackburn Project: Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide Comments:
Part Number: 225082-002 File Name: c-ch2 Cluster Architecture.doc Last Saved On: 6/13/01 10:21 AM
Cluster Architecture 2-41
Figure 2-15 shows a two-node PDC/O2000 with a redundant FC-AL that
contains two loops, one for each Fibre Host Adapter per node. The
components and cable paths for the first loop are shaded to distinguish them
from the components for the other loop.
Fibre Host Fibre Host
Adapters (2) Adapters (2)
Node 1 Node 2
FC-AL Switch/Storage FC-AL Switch/Storage
Hub #1 Hub #2
RA4000/4100 Array #2
RA4000/4100 Array #1
Figure 2-15. Two-node PDC/O2000 with a two-loop redundant Fibre
Channel Arbitrated Loop
Used in conjunction with the I/O path failover capabilities of Secure Path
software, this redundant FC-AL configuration gives cluster resources
increased availability and fault tolerance.
Compaq Confidential Need to Know Required
Writer: John Blackburn Project: Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide Comments:
Part Number: 225082-002 File Name: c-ch2 Cluster Architecture.doc Last Saved On: 6/13/01 10:21 AM
2-42 Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide
Multiple Redundant Fibre Channel Arbitrated Loops
The PDC/O2000 supports the use of multiple redundant FC-ALs within the
same cluster. You would install additional redundant FC-ALs in a
PDC/O2000 to:
I Increase the amount of shared storage space available to the cluster's
nodes. Each redundant FC-AL can connect to a finite number of
RA4000/RA4100 Arrays. These RA4000/RA4100 Arrays are available
only to the Fibre Host Adapters connected to that redundant FC-AL.
I Increase the cluster's I/O performance.
Adding a second redundant FC-AL to the cluster involves duplicating the
hardware components used in the first redundant FC-AL.
The maximum number of redundant FC-ALs you can install in a PDC/O2000
cluster is restricted by the number of Fibre Host Adapters your Compaq
servers support. Refer to the Compaq server documentation for this
information.
Compaq Confidential Need to Know Required
Writer: John Blackburn Project: Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide Comments:
Part Number: 225082-002 File Name: c-ch2 Cluster Architecture.doc Last Saved On: 6/13/01 10:21 AM
Cluster Architecture 2-43
Figure 2-16 shows a two-node PDC/O2000 that contains two redundant
FC-ALs. In this example, each redundant FC-AL has its own pair of Fibre
Host Adapters in each node, a pair of Storage Hubs or FC-AL Switches, and
two RA4000/RA4100 Arrays. In Figure 2-2, the hardware components that
constitute the second redundant FC-AL are shaded.
RA4000/4100 RA4000/4100
Array #1 Array #2
Redundant
FC-AL #1
FC-AL
FC-AL
Switch/Storage
Switch/Storage
Hub #2
Hub #1
Fibre Host
Adapters (4)
Fibre Host
Adapters (4)
Node 1 Node 2
FC-AL
FC-AL
Switch/Storage
Switch/Storage Redundant
Hub #2
Hub #1 FC-AL #2
RA4000/4100
RA4000/4100
Array #2
Array #1
Figure 2-16. Two-node PDC/O2000 with two redundant Fibre Channel
Arbitrated Loops
Compaq Confidential Need to Know Required
Writer: John Blackburn Project: Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide Comments:
Part Number: 225082-002 File Name: c-ch2 Cluster Architecture.doc Last Saved On: 6/13/01 10:21 AM
2-44 Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide
Maximum Distances Between Nodes and Shared
Storage Components in a Redundant FC-AL
By using standard short-wave Fibre Channel cables with Gigabit Interface
Converter-Shortwave (GBIC-SW) modules, the following maximum distances
apply:
I Each RA4000/RA4100 Array can be placed up to 500 meters from the
Storage Hubs or FC-AL Switches to which it is cabled.
I Each Storage Hub or FC-AL Switch can be placed up to 500 meters
from the Fibre Host Adapters to which it is cabled.
Figure 2-17 illustrates these maximum cable distances for a redundant FC-AL.
500 meters
maximum
Fibre Host Fibre Host
Adapters (2) Adapters (2)
Node 2
Node 1
FC-AL
FC-AL
Switch/Storage
Switch/Storage
Hub #2
Hub #1
500 meters
RA4000/4100 Array #1 maximum RA4000/4100 Array #2
Figure 2-17. Maximum distances between PDC/O2000 cluster nodes and
shared storage subsystem components in a redundant FC-AL
Compaq Confidential Need to Know Required
Writer: John Blackburn Project: Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide Comments:
Part Number: 225082-002 File Name: c-ch2 Cluster Architecture.doc Last Saved On: 6/13/01 10:21 AM
Cluster Architecture 2-45
I/O Data Paths in a Redundant FC-AL
A distinct I/O path connection exists between each Fibre Host Adapter in a
cluster node and every array controller port in each RA4000/RA4100 Array in
the redundant FC-AL.
Fibre Host Adapter-to-Storage Hub/Switch
Paths
Figure 2-18 highlights the I/O data paths that run between the Fibre Host
Adapters and the Storage Hubs or FC-AL Switches in a redundant FC-AL.
Fibre Host Fibre Host
Adapters (2) Adapters (2)
Node 1 Node 2
FC-AL FC-AL
Switch/Storage Switch/Storage
Hub #1 Hub #2
RA4000/4100 RA4000/4100
Array #1 Array #2
Figure 2-18. Fibre Host Adapter-to-FC-AL Switch/Storage Hub data paths
Secure Path monitors the status of the components along each active path. If
Secure Path detects the failure of a Fibre Host Adapter, Fibre Channel cable,
Storage Hub, or FC-AL Switch along an active path, it automatically transfers
all I/O activity on that path to the components on the defined backup path.
Compaq Confidential Need to Know Required
Writer: John Blackburn Project: Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide Comments:
Part Number: 225082-002 File Name: c-ch2 Cluster Architecture.doc Last Saved On: 6/13/01 10:21 AM
2-46 Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide
Storage Hub/Switch-to-Array Controller Paths
Figure 2-19 highlights the I/O data paths that run between the Storage Hubs or
FC-AL Switches and the two single-port RA4000 Array Controllers in each
RA4000/RA4100 Array.
Fibre Host Fibre Host
Adapters (2) Adapters (2)
Node 1 Node 2
FC-AL
FC-AL
Switch/Storage
Switch/Storage
Hub #2
Hub #1
RA4000/4100 RA4000/4100
Array #1 Array #2
Figure 2-19. FC-AL Switch/Storage Hub-to-RA4000/RA4100 Array data paths
If any component along an active path fails, Secure Path detects the failure and
automatically transfers all I/O activity to the components on the defined
backup path.
Compaq Confidential Need to Know Required
Writer: John Blackburn Project: Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide Comments:
Part Number: 225082-002 File Name: c-ch2 Cluster Architecture.doc Last Saved On: 6/13/01 10:21 AM
Cluster Architecture 2-47
I/O Path Configuration Guidelines for
Redundant Fibre Channel Arbitrated
Loops
You can use either of two I/O path configurations for every redundant FC-AL
in your PDC/O2000 cluster:
I Active/standby configuration
I Active/active configuration
In every redundant FC-AL, at least two Fibre Host Adapters must be installed
in each node (one Fibre Host Adapter for each Storage Hub or FC-AL Switch
in that redundant FC-AL).
In the active/standby configuration, only one of the two Fibre Host Adapters in
each node is active at any one time; the other Fibre Host Adapter is in the
standby state. The active Fibre Host Adapter is connected to the first Storage
Hub or FC-AL Switch, which is connected to the active array controller in
each RA4000/RA4100 Array. The standby Fibre Host Adapter is connected to
the second Storage Hub or FC-AL Switch, which is connected to the standby
array controller in each RA4000/RA4100 Array. The standby Fibre Host
Adapter remains in the standby state unless a failover from the active I/O path
occurs. In the active/standby configuration, the failure of any component along
an active I/O path (Fibre Host Adapter, Storage Hub or FC-AL Switch, active
array controller, or Fibre Channel cable) causes Secure Path to implement a
complete failover to the components on the standby I/O path.
In the active/active configuration, both Fibre Host Adapters in each node are
simultaneously active. Both are active because each Fibre Host Adapter is
connected to a Storage Hub or FC-AL Switch that, in turn, is connected to an
active array controller in each RA4000/RA4100 Array. Because each Fibre
Host Adapter and Storage Hub or FC-AL Switch must connect to at least one
active array controller, at least two RA4000/RA4100 Arrays must be present
in an active/active configuration.
Compaq Confidential Need to Know Required
Writer: John Blackburn Project: Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide Comments:
Part Number: 225082-002 File Name: c-ch2 Cluster Architecture.doc Last Saved On: 6/13/01 10:21 AM
2-48 Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide
See "Active/Standby Configuration Examples for Redundant FC-ALs" in this
chapter for a detailed description of active/standby configuration examples for
a redundant FC-AL with from one to five RA4000/RA4100 Arrays. See
"Active/Active Configuration Examples for Redundant FC-ALs" for a detailed
description of active/active configuration examples when two to five
RA4000/RA4100 Arrays are present.
Table 2-6 identifies the features of the active/standby and active/active
configurations for redundant FC-ALs.
Table 2-6
Features of Active/Standby and Active/Active Configurations for Redundant Fibre
Channel Arbitrated Loops
I/O Path Configuration Advantage Disadvantage
Active/standby with one Active/standby is the only I/O
RA4000/RA4100 Array path configuration you can use
in a redundant FC-AL that
contains just one
RA4000/RA4100 Array.
Active/standby with two or more Provides true cabling symmetry Load balancing between the two
RA4000/RA4100 Arrays between the Storage Hubs or Storage Hubs or FC-AL Switches
FC-AL Switches and array is less than ideal because the
controllers. A Storage Hub or connection to the active array
FC-AL Switch connects to the controller in every
same array controller slot (top or RA4000/RA4100 Array is routed
bottom) in every through the same Storage Hub
RA4000/RA4100 Array. or FC-AL Switch. The second
Storage Hub or FC-AL Switch
provides no active I/O pathway
unless an active array controller
or its cable connection to the
first Storage Hub or FC-AL
Switch fails.
continued
Compaq Confidential Need to Know Required
Writer: John Blackburn Project: Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide Comments:
Part Number: 225082-002 File Name: c-ch2 Cluster Architecture.doc Last Saved On: 6/13/01 10:21 AM
Cluster Architecture 2-49
Table 2-6
Features of Active/Standby and Active/Active Configurations for Redundant Fibre Channel
Arbitrated Loops continued
I/O Path Configuration Advantage Disadvantage
Active/active with two or more Provides a small but measurable Does not provide true cabling
RA4000/RA4100 Arrays improvement in I/O performance symmetry between Storage
over the active/standby Hubs or FC-AL Switches and
configuration because both Fibre array controllers if you
Host Adapters in each node and consistently configure the top or
both Storage Hubs or FC-AL rightmost array controller as the
Switches are simultaneously active controller. Each Storage
active. This improvement can be Hub or FC-AL Switch is cabled
meaningful for customers with to top (active) array controllers
large cluster databases or high in some RA4000/RA4100 Arrays
I/O transaction requirements. and bottom (standby) controllers
in others. You can achieve
Provides better load balancing cabling symmetry if you
between the two Storage Hubs configure the bottom array
than the active/standby controller in some
configuration. Both Storage RA4000/RA4100 Arrays as
Hubs or FC-AL Switches are active. However, this requires
connected to the same or using Secure Path to configure
equivalent numbers of both the lower array controller as
active and standby array active if it is in standby mode.
controllers in the
RA4000/RA4100 Arrays.
Compaq Confidential Need to Know Required
Writer: John Blackburn Project: Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide Comments:
Part Number: 225082-002 File Name: c-ch2 Cluster Architecture.doc Last Saved On: 6/13/01 10:21 AM
2-50 Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide
I/O Path Configuration Rules for Redundant FC-ALs
The following rules must be observed in I/O path configurations for
PDC/O2000 clusters with redundant FC-ALs:
I Each redundant FC-AL must use either an active/standby or
active/active configuration. The active/standby or active/active
configuration is confined to that redundant FC-AL.
I For each redundant FC-AL, at least two Fibre Host Adapters are
installed in each cluster node (one for each Storage Hub or FC-AL
Switch).
I For each redundant FC-AL, at least two Storage Hubs or FC-AL
Switches (Storage Hub/FC-AL Switch #1 and Storage Hub/FC-AL
Switch #2) are installed between the nodes and the RA4000/RA4100
Arrays.
I A minimum of one RA4000/RA4100 Array is required for the
active/standby configuration.
I A minimum of two RA4000/RA4100 Arrays is required for the
active/active configuration.
I Each RA4000/RA4100 Array must contain two array controllers to
provide redundant paths.
I Only one of the two array controllers in an RA4000/RA4100 Array can
be active at a given time. The other array controller is the standby
controller.
I I/O path hardware components must be connected using Fibre Channel
cables and GBIC-SW modules.
Compaq Confidential Need to Know Required
Writer: John Blackburn Project: Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide Comments:
Part Number: 225082-002 File Name: c-ch2 Cluster Architecture.doc Last Saved On: 6/13/01 10:21 AM
Cluster Architecture 2-51
Active/Standby Configuration Examples for
Redundant FC-ALs
This section describes examples of active/standby configurations when one,
two, three, four, and five RA4000/RA4100 Arrays are present in one
redundant FC-AL of a four-node PDC/O2000. These examples represent one
method for configuring active/standby configurations. They are presented here
to provide a relatively simple and consistent method for building
active/standby configurations.
IMPORTANT: Figures 2-20 through 2-24 show active/standby configurations for a
four-node cluster. Active/standby configurations for clusters with two, three, five, or more
nodes are not described here. However, the illustrated active/standby configuration
examples provided should supply sufficient information for building an active/standby
configuration in any PDC/O2000 cluster.
The active/standby configuration examples shown in Figures 2-20 through
2-24 follow these configuration guidelines:
I For every Fibre Host Adapter pair, the top or leftmost Fibre Host
Adapter in each node is connected to the odd-numbered Storage Hub or
FC-AL Switch (Storage Hub/FC-AL Switch #1). This is the active Fibre
Host Adapter in the pair.
I For every Fibre Host Adapter pair, the bottom or rightmost Fibre Host
Adapter in each node is connected to the even-numbered Storage Hub or
FC-AL Switch (Storage Hub/FC-AL Switch #2). This is the standby
Fibre Host Adapter in the pair.
I In each RA4000/RA4100 Array, the top (rack model) or right rear
(tower model) array controller is always the active controller.
Compaq Confidential Need to Know Required
Writer: John Blackburn Project: Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide Comments:
Part Number: 225082-002 File Name: c-ch2 Cluster Architecture.doc Last Saved On: 6/13/01 10:21 AM
2-52 Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide
I In each RA4000/RA4100 Array, the bottom (rack model) or left rear
(tower model) array controller is always the standby controller.
I The odd-numbered Storage Hub or FC-AL Switch (Storage Hub/FC-AL
Switch #1) is connected to the active array controller in each
RA4000/RA4100 Array.
I The even-numbered Storage Hub or FC-AL Switch (Storage
Hub/FC-AL Switch #2) is connected to the standby array controller in
each RA4000/RA4100 Array.
NOTE: The following active/standby configurations are examples only. You are not
required to follow these configurations.
For more information about installing active/standby configurations, refer to
the following sections in Chapter 5, "Installation and Configuration":
I "Cabling the Fibre Host Adapters to the Storage Hubs or Switches"
I "Cabling the Storage Hubs or Switches to the RA4000 Array
Controllers"
In Figures 2-20 through 2-24, active I/O path components have been shaded to
distinguish them from standby (inactive) components. Black Fibre Channel
cables identify connections between active components; gray cables identify
connections between standby components.
Compaq Confidential Need to Know Required
Writer: John Blackburn Project: Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide Comments:
Part Number: 225082-002 File Name: c-ch2 Cluster Architecture.doc Last Saved On: 6/13/01 10:21 AM
Cluster Architecture 2-53
Active/Standby Configuration with One
RA4000/4100 Array
Figure 2-20 shows an active/standby I/O path configuration for a redundant
FC-AL in a four-node cluster with one RA4000/RA4100 Array.
Fibre Host Fibre Host
ProLiant
Adapter Adapter
Servers (4)
(Active) (Standby)
Node 1 Node 2 Node 3 Node 4
FC-AL FC-AL
Switch/Storage Switch/Storage
Hub #2
Hub #1
Active
Array Controller
Standby
RA4000/4100
Array Controller
Array #1
Figure 2-20. Active/standby configuration with one RA4000/RA4100 Array
Compaq Confidential Need to Know Required
Writer: John Blackburn Project: Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide Comments:
Part Number: 225082-002 File Name: c-ch2 Cluster Architecture.doc Last Saved On: 6/13/01 10:21 AM
2-54 Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide
Active/Standby Configuration with Two
RA4000/4100 Arrays
Figure 2-21 shows an active/standby I/O path configuration for a redundant
FC-AL in a four-node cluster with two RA4000/RA4100 Arrays.
Fibre Host Fibre Host
ProLiant
Adapter Adapter
Servers (4)
(Active) (Standby)
Node 1 Node 2 Node 3 Node 4
FC-AL FC-AL
Switch/Storage
Switch/Storage
Hub #1 Hub #2
RA4000/4100 RA4000/4100
Active Standby
Array #1 Array #2
Array Controller Array Controller
Figure 2-21. Active/standby configuration with two RA4000/RA4100 Arrays
Compaq Confidential Need to Know Required
Writer: John Blackburn Project: Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide Comments:
Part Number: 225082-002 File Name: c-ch2 Cluster Architecture.doc Last Saved On: 6/13/01 10:21 AM
Cluster Architecture 2-55
Active/Standby Configuration with Three
RA4000/RA4100 Arrays
Figure 2-22 shows an active/standby I/O path configuration for a redundant
FC-AL in a four-node cluster with three RA4000/RA4100 Arrays.
Fibre Host Fibre Host
ProLiant
Adapter Adapter
Servers (4)
(Active) (Standby)
Node 1 Node 2 Node 3 Node 4
FC-AL FC-AL
Switch/Storage Switch/Storage
Hub #2
Hub #1
RA4000/4100 RA4000/4100
Array #1 Array #2
RA4000/4100 Standby
Active
Array #3 Array Controller
Array Controller
Figure 2-22. Active/standby configuration with three RA4000/RA4100 Arrays
Compaq Confidential Need to Know Required
Writer: John Blackburn Project: Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide Comments:
Part Number: 225082-002 File Name: c-ch2 Cluster Architecture.doc Last Saved On: 6/13/01 10:21 AM
2-56 Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide
Active/Standby Configuration with Four
RA4000/RA4100 Arrays
Figure 2-23 shows an active/standby I/O path configuration for a redundant
FC-AL in a four-node cluster with four RA4000/RA4100 Arrays.
Fibre Host Fibre Host
ProLiant
Adapter Adapter
Servers (4)
(Active) (Standby)
Node 1 Node 2 Node 3 Node 4
FC-AL FC-AL
Switch/Storage Switch/Storage
Hub #1 Hub #2
RA4000/4100 RA4000/4100
Array #1 Array #2
RA4000/4100 RA4000/4100
Standby
Active Array #3 Array #4
Array Controller
Array Controller
Figure 2-23. Active/standby configuration with four RA4000/RA4100 Arrays
Compaq Confidential Need to Know Required
Writer: John Blackburn Project: Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide Comments:
Part Number: 225082-002 File Name: c-ch2 Cluster Architecture.doc Last Saved On: 6/13/01 10:21 AM
Cluster Architecture 2-57
Active/Standby Configuration with Five
RA4000/RA4100 Arrays
Figure 2-24 shows an active/standby I/O path configuration for a redundant
FC-AL in a four-node cluster with five RA4000/RA4100 Arrays.
Fibre Host Fibre Host
ProLiant
Adapter Adapter
Servers (4)
(Active) (Standby)
Node 1 Node 2 Node 3 Node 4
FC-AL FC-AL
Switch/Storage Switch/Storage
Hub #1 Hub #2
RA4000/4100 RA4000/4100
Array #1 Array #2
Active
Array Controller
RA4000/4100
Array #4
RA4000/4100
Array #3
Standby
RA4000/4100
Array Controller
Array #5
Figure 2-24. Active/standby configuration with five RA4000/RA4100 Arrays
Compaq Confidential Need to Know Required
Writer: John Blackburn Project: Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide Comments:
Part Number: 225082-002 File Name: c-ch2 Cluster Architecture.doc Last Saved On: 6/13/01 10:21 AM
2-58 Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide
Active/Active Configuration Examples for
Redundant FC-ALs
This section describes examples of active/active configurations when two,
three, four, and five RA4000/RA4100 Arrays are present in one redundant
FC-AL of a four-node PDC/O2000 cluster. These examples represent one
method for configuring active/active configurations. They are presented here
to provide a relatively simple and consistent method for building active/active
configurations.
IMPORTANT: Figures 2-25 through 2-28 show active/active configurations for a
four-node cluster. Active/active configurations for clusters with two, three, five, or more
nodes are not described here. However, the illustrated active/active configuration
examples provided should supply sufficient information for building an active/standby
configuration in any PDC/O2000 cluster.
The active/active configuration examples shown in Figures 2-25 through 2-28
follow these configuration guidelines:
I For every Fibre Host Adapter pair, the top or leftmost Fibre Host
Adapter in each node is connected to the odd-numbered Storage Hub or
FC-AL Switch (Storage Hub/FC-AL Switch #1). This is an active Fibre
Host Adapter.
I For every Fibre Host Adapter pair, the bottom or rightmost Fibre Host
Adapter in each node is connected to the even-numbered Storage Hub or
FC-AL Switch (Storage Hub/FC-AL Switch #2). This is also an active
Fibre Host Adapter.
I In each RA4000/RA4100 Array, the top (rack model) or right rear
(tower model) array controller is always the active controller.
I In each RA4000/RA4100 Array, the bottom (rack model) or left rear
(tower model) array controller is always the standby controller.
I The odd-numbered Storage Hub or FC-AL Switch (Storage Hub/FC-AL
Switch #1) is connected to the active array controller in each
odd-numbered RA4000/RA4100 Array (1, 3, and 5).
I The odd-numbered Storage Hub or FC-AL Switch (Storage Hub/FC-AL
Switch #2) is connected to the standby array controller in each
even-numbered RA4000/RA4100 Array (2 and 4).
Compaq Confidential Need to Know Required
Writer: John Blackburn Project: Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide Comments:
Part Number: 225082-002 File Name: c-ch2 Cluster Architecture.doc Last Saved On: 6/13/01 10:21 AM
Cluster Architecture 2-59
I The even-numbered Storage Hub or FC-AL Switch (Storage
Hub/FC-AL Switch #2) is connected to the active array controller in
each even-numbered RA4000/RA4100 Array (2 and 4).
I The even-numbered Storage Hub or FC-AL Switch is connected to the
standby array controller in each odd-numbered RA4000/RA4100 Array
(1, 3, and 5).
NOTE: The following active/active configurations are examples only. You are not required
to follow these configurations.
For more information about installing active/active configurations, refer to
these sections in Chapter 5, "Installation and Configuration":
I Cabling the Fibre Host Adapters to the Storage Hubs or Switches
I Cabling the Storage Hubs or Switches to the RA4000 Array Controllers
In Figures 2-25 through 2-28, active I/O path components have been shaded to
distinguish them from standby (inactive) components. Black Fibre Channel
cables identify connections between active components; gray cables identify
connections between standby components.
Compaq Confidential Need to Know Required
Writer: John Blackburn Project: Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide Comments:
Part Number: 225082-002 File Name: c-ch2 Cluster Architecture.doc Last Saved On: 6/13/01 10:21 AM
2-60 Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide
Active/Active Configuration with Two
RA4000/RA4100 Arrays
Figure 2-25 shows an active/active I/O path configuration for a redundant
FC-AL in a four-node cluster with two RA4000/RA4100 Arrays.
Fibre Host ProLiant
Adapters (2) Servers (4)
Node 1 Node 2 Node 3 Node 4
FC-AL FC-AL
Switch/Storage Switch/Storage
Hub #1 Hub #2
Active Stand by
RA4000/4100 RA4000/4100
Array Controller Array #1 Array Controller Array #2
Figure 2-25. Active/active configuration with two RA4000/RA4100 Arrays
Compaq Confidential Need to Know Required
Writer: John Blackburn Project: Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide Comments:
Part Number: 225082-002 File Name: c-ch2 Cluster Architecture.doc Last Saved On: 6/13/01 10:21 AM
Cluster Architecture 2-61
Active/Active Configuration with Three
RA4000/RA4100 Arrays
Figure 2-26 shows an active/active I/O path configuration for a redundant
FC-AL in a four-node cluster with three RA4000/RA4100 Arrays.
Fibre Host ProLiant
Adapters (2) Servers (4)
Node 1 Node 2 Node 3 Node 4
FC-AL FC-AL
Switch/Storage Switch/Storage
Hub #1 Hub #2
RA4000/4100 RA4000/4100
Array #1 Array #2
RA4000/4100
Array #3 Standby
Active
Array Controller
Array Controller
Figure 2-26. Active/active configuration with three RA4000/RA4100 Arrays
Compaq Confidential Need to Know Required
Writer: John Blackburn Project: Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide Comments:
Part Number: 225082-002 File Name: c-ch2 Cluster Architecture.doc Last Saved On: 6/13/01 10:21 AM
2-62 Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide
Active/Active Configuration with Four
RA4000/RA4100 Arrays
Figure 2-27 shows an active/active I/O path configuration for a redundant
FC-AL in a four-node cluster with four RA4000/RA4100 Arrays.
Fibre Host ProLiant
Adapters (2) Servers (4)
Node 1 Node 2 Node 3 Node 4
FC-AL
FC-AL
Switch/Storage
Switch/Storage
Hub #1 Hub #2
RA4000/4100 RA4000/4100
Array #1 Array #2
RA4000/4100 RA4000/4100
Standby
Array #3 Array #4
Active
Array Controller
Array Controller
Figure 2-27. Active/active configuration with four RA4000/RA4100 Arrays
Compaq Confidential Need to Know Required
Writer: John Blackburn Project: Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide Comments:
Part Number: 225082-002 File Name: c-ch2 Cluster Architecture.doc Last Saved On: 6/13/01 10:21 AM
Cluster Architecture 2-63
Active/Active Configuration with Five
RA4000/RA4100 Arrays
Figure 2-28 shows an active/active I/O path configuration for a redundant
FC-AL in a four-node cluster with five RA4000/RA4100 Arrays.
Fibre Host ProLiant
Adapters (2) Servers (4)
Node 1 Node 2 Node 3 Node 4
FC-AL
FC-AL
Switch/Storage
Switch/Storage
Hub #2
Hub #1
RA4000/4100 RA4000/4100
Array #1 Array #2
Standby
RA4000/4100 RA4000/4100
Array Controller
Array #3 Array #4
Active
Array Controller RA4000/4100
Array #5
Figure 2-28. Active/active configuration with five RA4000/RA4100 Arrays
Compaq Confidential Need to Know Required
Writer: John Blackburn Project: Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide Comments:
Part Number: 225082-002 File Name: c-ch2 Cluster Architecture.doc Last Saved On: 6/13/01 10:21 AM
2-64 Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide
Summary of I/O Path Failure and Failover
Scenarios for Redundant FC-ALs
Table 2-7 identifies possible I/O path failure events in redundant FC-ALs for
active/standby configurations with one RA4000/RA4100 Array and the
failover response, if any, implemented by Secure Path for each failure.
Table 2-7
I/O Path Failure and Failover Scenarios in Redundant FC-ALs for Active/Standby
Configurations With One RA4000/RA4100 Array
Description of Failure Failover Response
The active array controller in the Secure Path forces a complete failover to the standby I/O path
RA4000/RA4100 Array fails. components, including the standby Fibre Host Adapter in each
node, the other Storage Hub or FC-AL Switch, the standby array
controller in the RA4000/RA4100 Array, and Fibre Channel cables.
The standby array controller in the None
RA4000/RA4100 Array fails.
The Fibre Channel cable Secure Path forces a complete failover to the standby I/O path
connection between the active components, including the standby Fibre Host Adapter in each
array controller and its Storage node, the other Storage Hub or FC-AL Switch, the standby array
Hub or FC-AL Switch is broken. controller in the RA4000/RA4100 Array, and Fibre Channel cables.
The Fibre Channel cable None
connection between the standby
array controller and its Storage
Hub or FC-AL Switch is broken.
The Storage Hub or FC-AL Switch Secure Path forces a complete failover to the standby I/O path
connected to the active array components, including the standby Fibre Host Adapter in each
controller fails. node, the other Storage Hub or FC-AL Switch, the standby array
controller in the RA4000/RA4100 Array, and Fibre Channel cables.
The Storage Hub or FC-AL Switch None
connected to the standby array
controller fails.
The Fibre Channel cable Secure Path forces a complete failover to the standby I/O path
connection between a Fibre Host components, including the standby Fibre Host Adapter in each
Adapter and the Storage Hub or node, the other Storage Hub or FC-AL Switch, the standby array
FC-AL Switch connected to the controller in the RA4000/RA4100 Array, and Fibre Channel cables.
active array controller is broken.
continued
Compaq Confidential Need to Know Required
Writer: John Blackburn Project: Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide Comments:
Part Number: 225082-002 File Name: c-ch2 Cluster Architecture.doc Last Saved On: 6/13/01 10:21 AM
Cluster Architecture 2-65
Table 2-7
I/O Path Failure and Failover Scenarios in Redundant FC-ALs for Active/Standby
Configurations With One RA4000/RA4100 Array continued
Description of Failure Failover Response
The Fibre Channel cable None
connection between a Fibre Host
Adapter and the Storage Hub or
FC-AL Switch connected to the
standby array controller is broken.
A Fibre Host Adapter connected to Secure Path forces a complete failover to the standby I/O path
the Storage Hub or FC-AL Switch components, including the standby Fibre Host Adapter in each
that connects to the active array node, the other Storage Hub or FC-AL Switch, the standby array
controller fails. controller in the RA4000/RA4100 Array, and Fibre Channel cables.
A Fibre Host Adapter connected to None
the Storage Hub or FC-AL Switch
that connects to the standby array
controller fails.
Compaq Confidential Need to Know Required
Writer: John Blackburn Project: Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide Comments:
Part Number: 225082-002 File Name: c-ch2 Cluster Architecture.doc Last Saved On: 6/13/01 10:21 AM
2-66 Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide
Table 2-8 identifies possible I/O path failure events for active/standby
configurations with two or more RA4000/RA4100 Arrays and the failover
response, if any, implemented by Secure Path for each failure.
Table 2-8
I/O Path Failure and Failover Scenarios in Redundant FC-ALs for Active/Standby
Configurations With Two or More RA4000/RA4100 Arrays
Description of Failure Failover Response
The active array controller in one Secure Path forces a complete failover to the standby I/O path
RA4000/RA4100 Array fails. components, including the standby Fibre Host Adapter in each
node, the other Storage Hub or FC-AL Switch, the standby array
controller in each RA4000/RA4100 Array, and Fibre Channel cables.
The standby array controller in one None
RA4000/RA4100 Array fails.
The Fibre Channel cable Secure Path forces a complete failover to the standby I/O path
connection between the active components, including the standby Fibre Host Adapter in each
array controller in one node, the other Storage Hub or FC-AL Switch, the standby array
RA4000/RA4100 Array and its controller in each RA4000/RA4100 Array, and Fibre Channel cables.
Storage Hub or FC-AL Switch is
broken.
The Fibre Channel cable None
connection between the standby
array controller in one
RA4000/RA4100 Array and its
Storage Hub or FC-AL Switch is
broken.
The Storage Hub or FC-AL Switch Secure Path forces a complete failover to the standby I/O path
that is connected to the active components, including the standby Fibre Host Adapter in each
array controller in each node, the other Storage Hub or FC-AL Switch, the standby array
RA4000/RA4100 Array fails. controller in each RA4000/RA4100 Array, and Fibre Channel cables.
The Storage Hub or FC-AL Switch None
that is connected to the standby
array controller in each
RA4000/RA4100 Array fails.
continued
Compaq Confidential Need to Know Required
Writer: John Blackburn Project: Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide Comments:
Part Number: 225082-002 File Name: c-ch2 Cluster Architecture.doc Last Saved On: 6/13/01 10:21 AM
Cluster Architecture 2-67
Table 2-8
I/O Path Failure and Failover Scenarios in Redundant FC-ALs for Active/Standby
Configurations With Two or More RA4000/RA4100 Arrays continued
Description of Failure Failover Response
The Fibre Channel cable Secure Path forces a complete failover to the standby I/O path
connection between the Storage components, including the standby Fibre Host Adapter in each
Hub or FC-AL Switch that is node, the other Storage Hub or FC-AL Switch, the standby array
connected to the active array controller in the each RA4000/RA4100 Array, and Fibre Channel
controllers and a Fibre Host cables.
Adapter is broken.
The Fibre Channel cable None
connection between the Storage
Hub or FC-AL Switch that is
connected to the standby array
controllers and a Fibre Host
Adapter is broken.
A Fibre Host Adapter connected to Secure Path forces a complete failover to the standby I/O path
the Storage Hub or FC-AL Switch components, including the standby Fibre Host Adapter in each
that is connected to the active node, the other Storage Hub or FC-AL Switch, the standby array
array controllers fails. controller in each RA4000/RA4100 Array, and Fibre Channel cables.
A Fibre Host Adapter connected to None
the Storage Hub or FC-AL Switch
that is connected to the standby
array controllers fails.
Compaq Confidential Need to Know Required
Writer: John Blackburn Project: Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide Comments:
Part Number: 225082-002 File Name: c-ch2 Cluster Architecture.doc Last Saved On: 6/13/01 10:21 AM
2-68 Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide
Table 2-9 identifies possible I/O path failure events in redundant FC-ALs for
active/active configurations with two or more RA4000/RA4100 Arrays and
the failover response, if any, implemented by Secure Path for each failure.
Table 2-9
I/O Path Failure and Failover Scenarios in Redundant FC-ALs for Active/Active
Configurations With Two or More RA4000/RA4100 Arrays
Description of Failure Failover Response
The active array controller in one Secure Path makes the standby array controller in the
RA4000/RA4100 Array fails. RA4000/RA4100 Array active and reroutes I/O activity to that array
controller. The Storage Hub or FC-AL Switch that is connected to
the new active array controller becomes the active I/O path to this
RA4000/RA4100 Array. In each node, I/O activity between the Fibre
Host Adapter that is connected to the failed array controller is
rerouted to the second Fibre Host Adapter in the pair, but only along
the I/O path to the affected RA4000/RA4100 Array. The first Fibre
Host Adapter in each node continues to be the active I/O path for
active array controllers in other RA4000/RA4100 Arrays to which it
is connected.
The standby array controller in one None
RA4000/RA4100 Array fails.
The Fibre Channel cable Secure Path makes the active array controller to which the failed
connection between the active cable is connected inactive. The standby array controller in the
array controller in one RA4000/RA4100 Array becomes active. I/O activity is routed
RA4000/RA4100 Array and its through the Fibre Channel cable installed to the new active array
Storage Hub or FC-AL Switch is controller and the other Storage Hub or FC-AL Switch. In each
broken. node, I/O activity between the Fibre Host Adapter that is connected
to the failed array controller is rerouted to the second Fibre Host
Adapter in the pair, but only along the I/O path to the affected
RA4000/RA4100 Array. The first Fibre Host Adapter in each node
continues to be the active I/O path for active array controllers in
other RA4000/RA4100 Arrays to which it is connected.
The Fibre Channel cable None
connection between the standby
array controller in one
RA4000/RA4100 Array and its
Storage Hub or FC-AL Switch is
broken.
continued
Compaq Confidential Need to Know Required
Writer: John Blackburn Project: Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide Comments:
Part Number: 225082-002 File Name: c-ch2 Cluster Architecture.doc Last Saved On: 6/13/01 10:21 AM
Cluster Architecture 2-69
Table 2-9
I/O Path Failure and Failover Scenarios in Redundant FC-ALs for Active/Active Configurations
With Two or More RA4000/RA4100 Arrays continued
Description of Failure Failover Response
A Storage Hub or FC-AL Switch Secure Path makes each active array controller to which the failed
fails. Storage Hub or FC-AL Switch is connected inactive. The standby
array controller in each affected RA4000/RA4100 Array becomes
the active array controller. The Storage Hub or FC-AL Switch that is
connected to the new active array controllers becomes the active
I/O path for these RA4000/RA4100 Arrays. In each node, the Fibre
Host Adapter that is connected to the failed Storage Hub or FC-AL
Switch becomes inactive, and all I/O activity is rerouted through the
other Fibre Host Adapter in the pair and the remaining active
Storage Hub or FC-AL Switch.
The Fibre Channel cable Secure Path makes all I/O path connections between the affected
connection between a Storage Fibre Host Adapter and active array controllers inactive. The
Hub or FC-AL Switch and a Fibre standby array controller in every affected RA4000/RA4100 Array
Host Adapter in one node is becomes the active array controller. The Storage Hub or FC-AL
broken. Switch connected to the newly active array controllers becomes the
active I/O path for the entire FC-AL. The Storage Hub or FC-AL
Switch connected to the failed Fibre Channel cable becomes
inactive. The second Fibre Host Adapter in each node, which is
connected to the only active Storage Hub or FC-AL Switch,
becomes the only active Fibre Host Adapter in the node's pair.
A Fibre Host Adapter in a node Secure Path makes all I/O path connections between the affected
fails. Fibre Host Adapter and active array controllers inactive. The
standby array controller in every affected RA4000/RA4100 Array
becomes the active array controller. The Storage Hub or FC-AL
Switch connected to the newly active array controllers becomes the
active I/O path for the entire FC-AL. The Storage Hub or FC-AL
Switch connected to the failed Fibre Host Adapter becomes
inactive. The second Fibre Host Adapter in each node, which is
connected to the only active Storage Hub or FC-AL Switch,
becomes the only active Fibre Host Adapter in the node's pair.
Compaq Confidential Need to Know Required
Writer: John Blackburn Project: Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide Comments:
Part Number: 225082-002 File Name: c-ch2 Cluster Architecture.doc Last Saved On: 6/13/01 10:21 AM
2-70 Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide
Cluster Interconnect Options
The cluster interconnect is the data path over which all of the nodes in a
cluster communicate. The nodes use the cluster interconnect data path to:
I Communicate individual resource and overall cluster status.
I Send and receive heartbeat signals.
I Coordinate database locks through the Oracle Integrated Distributed
Lock Manager.
NOTE: Several terms for cluster interconnect are used throughout the industry. Others
are: private LAN, private interconnect, system area network (SAN), and private network.
Throughout this guide, the term cluster interconnect is used.
A PDC/O2000 cluster running Oracle8i Parallel Server uses an Ethernet
cluster interconnect. An Ethernet cluster interconnects can be redundant or
non-redundant. A redundant cluster interconnect is recommended because it
uses redundant hardware to provide fault tolerance along the entire cluster
interconnect path.
Ethernet Cluster Interconnect
IMPORTANT: The cluster management software for the Ethernet cluster interconnect
requires the use of TCP/IP. When configuring the Ethernet cluster interconnect, be sure to
enable TCP/IP.
NOTE: Refer to the technical white paper Supported Ethernet Interconnects for Compaq
Parallel Database Clusters Using Oracle Parallel Server (ECG062/0299) for detailed
information about configuring redundant and non-redundant Ethernet cluster
interconnects. This document is available at
www.compaq.com/support/techpubs/whitepapers
Compaq Confidential Need to Know Required
Writer: John Blackburn Project: Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide Comments:
Part Number: 225082-002 File Name: c-ch2 Cluster Architecture.doc Last Saved On: 6/13/01 10:21 AM
Cluster Architecture 2-71
Non-Redundant Ethernet Cluster Interconnect
Components
The following components are used in a non-redundant Ethernet cluster
interconnect:
I One Ethernet adapter in each cluster node
I Ethernet cables and a switch or hub
G For two-node PDC/O2000 clusters, you can either use one Ethernet
crossover cable or one 100-Mbit/second Ethernet switch or hub and
standard Ethernet cables to connect the two servers.
G For PDC/O2000 clusters with three or more nodes, you use one
100-Mbit/second Ethernet switch and standard Ethernet cables to
connect the servers.
Redundant Ethernet Cluster Interconnect
Components
The following components are used in a redundant Ethernet cluster
interconnect:
I Two Ethernet adapters in each cluster node
I Ethernet cables and switches or hubs
G For two-node PDC/O2000 clusters, you can use two
100-Mbit/second Ethernet switches or hubs with cables to connect
the servers.
G For PDC/O2000 clusters with three or more nodes, you use two
100-Mbit/second Ethernet switches connected by Ethernet cables to
a separate Ethernet adapter in each server.
NOTE: In a redundant Ethernet cluster configuration, one Ethernet crossover cable must
be installed between the two Ethernet switches or hubs that are dedicated to the cluster
interconnect.
Compaq Confidential Need to Know Required
Writer: John Blackburn Project: Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide Comments:
| 225082-002
|
