Compaq Confidential Need to Know Required
Writer: Carol Tatick Project: Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide Comments:
Part Number: 225082-002 File Name: f-ch5 Installation and Configuration.doc Last Saved On: 6/13/01 10:27 AM
5-32 Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide
For example, the command ping node1 should return the following type of
information.
Pinging node1.loc1.yoursite.com [127.0.0.1] with 32 bytes of data:
Reply from 127.0.0.1: bytes=32 time<10ms TTL=128
Reply from 127.0.0.1: bytes=32 time<10ms TTL=128
Reply from 127.0.0.1: bytes=32 time<10ms TTL=128
Reply from 127.0.0.1: bytes=32 time<10ms TTL=128
Mounting Remote Drives and Verifying
Administrator Privileges
Because the OUI installs and configures OSDs on the other nodes in the
cluster from the installing machine, you must first mount a drive on all remote
nodes in the cluster. Remote nodes are those nodes other than the node on
which the OUI is running (the installing machine).
The drive you mount should be the drive the OUI will write to, and it must be
the same drive on all cluster nodes. There should be at least five megabytes of
space on the remote drives.
The net use command can be used to mount drives on remote nodes. The
person running the net use command must have administrator privileges.
Therefore, running the net use command not only mounts drives on remote
nodes but also verifies the administrator privileges of the installer.
Administrator privileges are required for most installation tasks, such as
installing device drivers and changing registry entries. To install the OSDs,
you must have administrator privileges on each node from the installing
machine.
To mount drives on remote nodes, enter a net use command from a C: prompt
on the installing machine. Enter one instance of the command for each remote
cluster node. The following example mounts the C: drive on a remote node.
C: net use \\machine_name\C$ * /User:
The "*" results in the system prompting you for a password, and the password
is not echoed. (The Map Network Drive option in Windows Explorer is an
alternative to the net use command.)
Compaq Confidential Need to Know Required
Writer: Carol Tatick Project: Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide Comments:
Part Number: 225082-002 File Name: f-ch5 Installation and Configuration.doc Last Saved On: 6/13/01 10:27 AM
Installation and Configuration 5-33
If successful, the net use command returns:
"The command completed successfully."
If the command is not successful, make sure the administrative shares on
remote node drives are present.
Installing the Ethernet OSDs
To install the OSDs for an Ethernet cluster interconnect:
1. From the installing node, log in as a user who has administrator
privileges on all nodes in the cluster. If all servers in the cluster are in
the same domain, log in as a user who is a member of the Domain
Administrators group. If the servers are in different domains, create a
local user on each server with the same Windows Server user name and
password on each node. Then make that local user a member of the local
Administrators group on each node before installing the OSDs.
2. Insert the Compaq Parallel Database Cluster Clustering Software for
Oracle8i on Microsoft Windows 2000 CD into the CD-ROM drive.
Compaq Confidential Need to Know Required
Writer: Carol Tatick Project: Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide Comments:
Part Number: 225082-002 File Name: f-ch5 Installation and Configuration.doc Last Saved On: 6/13/01 10:27 AM
5-34 Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide
3. If autorun is enabled, the Oracle Universal Installer Welcome screen
appears.
If autorun is disabled, enter d:\setup at a C: prompt. Substitute the letter
assigned to the CD drive for d. The Oracle Universal Installer Welcome
screen appears.
NOTE: The OUI screens presented here might indicate earlier revision levels for the OSDs.
Compaq Confidential Need to Know Required
Writer: Carol Tatick Project: Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide Comments:
Part Number: 225082-002 File Name: f-ch5 Installation and Configuration.doc Last Saved On: 6/13/01 10:27 AM
Installation and Configuration 5-35
4. Click Next to continue. The License screen appears.
5. Click Accept to accept the terms of the license agreement. The File
Locations screen appears.
Compaq Confidential Need to Know Required
Writer: Carol Tatick Project: Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide Comments:
Part Number: 225082-002 File Name: f-ch5 Installation and Configuration.doc Last Saved On: 6/13/01 10:27 AM
5-36 Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide
6. Click Next to continue. The Installation Types screen appears.
Compaq Confidential Need to Know Required
Writer: Carol Tatick Project: Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide Comments:
Part Number: 225082-002 File Name: f-ch5 Installation and Configuration.doc Last Saved On: 6/13/01 10:27 AM
Installation and Configuration 5-37
7. Select Typical to install the Ethernet OSDs into the default location,
C:\Compaq\OPS. Skip to step 12.
8. Select Custom to install the Ethernet OSDs into a location of your
choice. The Component Locations screen appears.
9. If you want to accept the default location, skip to step 13.
10. If you want to specify an alternate location and you know the exact
directory path, specify it by typing over the default location and skip to
step 12.
Compaq Confidential Need to Know Required
Writer: Carol Tatick Project: Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide Comments:
Part Number: 225082-002 File Name: f-ch5 Installation and Configuration.doc Last Saved On: 6/13/01 10:27 AM
5-38 Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide
11. If you want to specify an alternate location but do not know the exact
directory path, click Change Location. The Choose Directory screen
appears.
Compaq Confidential Need to Know Required
Writer: Carol Tatick Project: Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide Comments:
Part Number: 225082-002 File Name: f-ch5 Installation and Configuration.doc Last Saved On: 6/13/01 10:27 AM
Installation and Configuration 5-39
12. Browse to the location where you want to install the OSDs. Click OK.
The Component Locations screen appears indicating the alternate
location you specified.
Compaq Confidential Need to Know Required
Writer: Carol Tatick Project: Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide Comments:
Part Number: 225082-002 File Name: f-ch5 Installation and Configuration.doc Last Saved On: 6/13/01 10:27 AM
5-40 Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide
13. Click Next to continue. The Cluster Members screen appears.
14. The Cluster Members screen indicates the host name of the installing
machine. Define the node names for the client LAN by adding the node
names you specified in the hosts and lmhosts files for the client LAN for
all other cluster nodes. Do not use special characters. Use a space to
separate the node names.
Compaq Confidential Need to Know Required
Writer: Carol Tatick Project: Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide Comments:
Part Number: 225082-002 File Name: f-ch5 Installation and Configuration.doc Last Saved On: 6/13/01 10:27 AM
Installation and Configuration 5-41
15. Click Next to continue. The Cluster Members screen reappears.
16. The Cluster Members screen now shows the node names you specified
on the first Cluster Members screen with "_san" appended to each
name, indicating it as a cluster interconnect node name.
If necessary, retype the cluster interconnect node names to match the
names you entered into the hosts and lmhosts files for the Ethernet
cluster interconnect. Do not use special characters. Separate the node
names with a space.
Compaq Confidential Need to Know Required
Writer: Carol Tatick Project: Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide Comments:
Part Number: 225082-002 File Name: f-ch5 Installation and Configuration.doc Last Saved On: 6/13/01 10:27 AM
5-42 Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide
17. Click Next to continue. The OSD Summary screen appears.
Compaq Confidential Need to Know Required
Writer: Carol Tatick Project: Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide Comments:
Part Number: 225082-002 File Name: f-ch5 Installation and Configuration.doc Last Saved On: 6/13/01 10:27 AM
Installation and Configuration 5-43
18. If the information on the OSD Summary screen is not correct, click
Previous to modify the previous screens.
When the information is correct, click Next to continue. The Summary
screen appears.
19. Click Install to install the components listed in the summary. At this
point, the OUI verifies that the installing node can communicate with
other cluster nodes through both the client LAN and cluster interconnect
node names. If the OUI cannot communicate with all nodes, this process
can take awhile. If the node is not accessible, an error message will
appear asking you to check the hostname and the network connection.
20. An Install screen appears that shows a percentage completion bar as the
installation progresses.
Compaq Confidential Need to Know Required
Writer: Carol Tatick Project: Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide Comments:
Part Number: 225082-002 File Name: f-ch5 Installation and Configuration.doc Last Saved On: 6/13/01 10:27 AM
5-44 Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide
21. When the installation completes, the End of Installation screen
appears.
22. Click Exit to quit the OUI or Next Install to install another product.
23. Start the cluster manager, OracleCMService, on all nodes in the cluster.
This service must be started before installing Oracle software. See the
Oracle documentation for information on starting the cluster manager.
Installing Oracle Software
Using the Oracle8i Parallel Server Setup and Configuration Guide, follow the
steps to install Oracle8i Enterprise Edition software on all cluster nodes,
including:
I Oracle8i Server
I Oracle8i Parallel Server Option
Compaq Confidential Need to Know Required
Writer: Carol Tatick Project: Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide Comments:
Part Number: 225082-002 File Name: f-ch5 Installation and Configuration.doc Last Saved On: 6/13/01 10:27 AM
Installation and Configuration 5-45
I Oracle8i Parallel Server Manager
I Oracle8i Enterprise Manager
NOTE: If the Oracle Universal Installer does not offer the option to install Oracle8i Parallel
Server, it could mean that the OSDs did not install successfully or that the
OracleCMService is not running.
After installing Oracle software, the Oracle8i documentation instructs you to
install vendor-supplied operating system dependent modules (OSDs). You
have already completed this step.
Configuring Oracle Software
Configuring Oracle software includes configuring Oracle8i Parallel Server,
Oracle8i Parallel Server Manager, Oracle8i Enterprise Manager, and
administering multiple instances. Use the Oracle8i Parallel Server Setup and
Configuration Guide and the Oracle8i Enterprise Edition for Windows 2000 to
configure the Oracle software.
Installing Object Link Manager
IMPORTANT: Before installing and configuring an Oracle database, you must install
Object Link Manager on all cluster nodes. Object Link Manager maintains the symbolic
links between disk partitions and Oracle data files. Failure to install Object Link Manager
can result in the Oracle database not starting or, if it starts, in not finding the correct data.
Windows 2000 Advanced Server assigns disk numbers to drives in the shared
storage subsystems based on the order in which the shared storage subsystems
are powered on.
The order in which disks are brought online directly affects the disk numbers
assigned to the disk, which in turn affects the ability of Oracle8i Server to find
Oracle data files. If shared storage subsystems are powered off and then
powered on in a different order than they were when the cluster was initially
configured, the order and numbering of the shared disk drives will change for
all nodes in the cluster.
Compaq Confidential Need to Know Required
Writer: Carol Tatick Project: Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide Comments:
Part Number: 225082-002 File Name: f-ch5 Installation and Configuration.doc Last Saved On: 6/13/01 10:27 AM
5-46 Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide
Object Link Manager simplifies the creation and maintenance of symbolic
links between disk partitions and Oracle data files by placing the symbolic link
names directly into the disk partitions, thereby tracking the symbolic links
dynamically. This means that if the order in which disk drives are brought
online changes, Oracle8i Server can find the correct data files and can properly
start the Oracle database.
You must install Object Link Manager before installing the Oracle database
software to ensure that the symbolic links are defined before creating a
database.
For instructions on installing and using Object Link Manager, see the readme
file on the Compaq Parallel Database Cluster Clustering Software for Oracle8i
on Microsoft Windows 2000 CD at
\Object Link Manager\readme.txt
Additional Notes on Configuring Oracle Software
In addition to the steps outlined in the Oracle documents, you must create a
symbolic link for OPS_CMDISK. You should verify access to the shared
storage from all nodes of the cluster.
Creating a Symbolic Link for OPS_CMDISK
The OPS_CMDISK data file contains status information for all nodes in the
cluster. Using the Object Link Manager GUI, define a partition to be called
OPS_CMDISK and commit the change.
Verifying Access to Shared Storage from All Nodes
IMPORTANT: Verify access to shared storage from all nodes in the cluster before
starting any Oracle instance.
Open Disk Management to verify that the shared disk resources are seen from
this node as they are seen from other installed nodes in the cluster.
Compaq Confidential Need to Know Required
Writer: Carol Tatick Project: Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide Comments:
Part Number: 225082-002 File Name: f-ch5 Installation and Configuration.doc Last Saved On: 6/13/01 10:27 AM
Installation and Configuration 5-47
Verifying the Hardware and Software
Installation
Cluster Communications
Use the ping utility to verify that each node in the cluster can communicate
with every other node over the client LAN. Run the ping utility from the
installing cluster node. Verify the installing node can communicate with all
cluster nodes by pinging the client LAN name. The IP address displayed by
the ping utility should be the client LAN IP address.
If you are using an Ethernet cluster interconnect, ping the Ethernet cluster
interconnect name. The IP address displayed by the ping utility should be the
Ethernet cluster interconnect address. If this is not the case, check the entries
in the hosts and lmhosts files at %SystemRoot%\system32\drivers\etc.
Access to Shared Storage from All Nodes
Use Disk Management to verify that the same shared disk resources are seen
from this node as they are from other installed nodes in the cluster.
OSDs
After verifying all the nodes have access to the shared storage, start an Oracle
instance. For example, at a C: command prompt start an instance by entering:
net start oracleservice
If the OSDs are installed correctly, a message will appear indicating that the
Oracle service has started successfully.
If the Oracle service did not start successfully, make sure that the
OracleCMService is started and the SID is in the Oracle registry. There are
two logs that can provide information about why the Oracle service did not
start. These logs are:
I \Compaq\OPS\cmsrvr.log
I \Compaq\OPS\nm.log
Compaq Confidential Need to Know Required
Writer: Carol Tatick Project: Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide Comments:
Part Number: 225082-002 File Name: f-ch5 Installation and Configuration.doc Last Saved On: 6/13/01 10:27 AM
5-48 Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide
Other Verification Tasks
Perform these other verification tasks:
I Verify that Object Link Manager has been installed and is running.
I Verify that the OPS_CMDISK symbolic link has actually been set.
To verify the Object Link Manager has been installed and is running, select the
Services icon in the Control Panel. Once there, look for "Oracle Object
Service" in the list of services and see if it is shown as "Started".
If the Object Link Manager has been installed and the service is running,
verifying that the OPS_CMDISK symbolic link has been set can be done by
running the Object Link Manager to see if the link OPS_CMDISK is in the list
of links.
Power Distribution and Power
Sequencing Guidelines
It is recommended you connect most cluster components to a Compaq power
distribution unit (PDU). PDUs connect to an uninterruptible power supply
(UPS) or building power. The PDUs and UPSs are the only cluster
components connected to a building power source. If there is no UPS, the
PDU plugs into building power.
It is also recommended that you connect cluster components, such as servers,
storage subsystems, switches, and hubs, to two PDUs and UPSs so the cluster
components continue to operate if one PDU or UPS fails.
Compaq Confidential Need to Know Required
Writer: Carol Tatick Project: Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide Comments:
Part Number: 225082-002 File Name: f-ch5 Installation and Configuration.doc Last Saved On: 6/13/01 10:27 AM
Installation and Configuration 5-49
Server Power Distribution
Figure 5-9 shows an example of server power distribution for a three-node
cluster. Power supply #1 of each server is connected to PDU #1. Power
supply #2 of each server is connected to PDU #2.
PDU #1 is connected to UPS #1, and PDU #2 is connected to UPS #2. Each
UPS is connected to building power.
Building
Proliant Servers PDU #1 UPS #1
Power
Power
Supply #1
Power
Supply #2
UPS #2
PDU #2
Figure 5-9. Server power distribution in a three-node cluster
Having two PDUs and UPSs in the cluster provides two paths from the servers
to building power and means that the cluster stays up and running if a PDU or
UPS fails in one of the paths.
RA4000/RA4100 Array Power Distribution
An RA4000/RA4100 Array can have one or two power supplies. If each
RA4000/RA4100 Array in the cluster has two power supplies, the power
distribution (with respect to connecting them to PDUs and UPSs) can be
configured similarly to the example shown for server power distribution. By
substituting RA4000/RA4100 Arrays for ProLiant servers in Figure 5-9, you
can provide two redundant paths from the RA4000/RA4100 Arrays to building
power.
If each RA4000/RA4100 Array has one power supply, connect the
RA4000/RA4100 Array to a PDU, connect the PDU to a UPS, and then
connect the UPS to building power. If there is no UPS, connect the PDU
directly to building power.
Compaq Confidential Need to Know Required
Writer: Carol Tatick Project: Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide Comments:
Part Number: 225082-002 File Name: f-ch5 Installation and Configuration.doc Last Saved On: 6/13/01 10:27 AM
5-50 Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide
Power Sequencing
Be sure to power up the cluster components in the following order:
1. RA4000/RA4100 Arrays
2. Storage Hubs, FC-AL Switches, or Fibre Channel SAN Switches
(Power is applied to Storage Hub when the AC power cord is
plugged in.)
3. Ethernet hubs or switches
4. ProLiant servers
Be sure to power down the cluster components in the following order:
1. ProLiant servers
2. Ethernet hubs or switches
3. Storage Hubs, FC-AL Switches, or Fibre Channel SAN Switches
(Power is applied to Storage Hub when the AC power cord is
plugged in.)
4. RA4000/RA4100 Arrays
Shutting down and powering off the servers first allows them to perform tasks
such as flushing queued database write transactions to disk and properly
terminating running processes.
Compaq Confidential Need to Know Required
Writer: Carol Tatick Project: Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide Comments:
Part Number: 225082-002 File Name: f-ch5 Installation and Configuration.doc Last Saved On: 6/13/01 10:27 AM
6
Chapter
Cluster Management
Throughout the life of your cluster, you might need to improve its
performance, upgrade hardware components, upgrade software, increase
storage capacity, and monitor ongoing activities. This chapter describes these
management activities for the Compaq Parallel Database Cluster Model
PDC/O2000 (referred to here as the PDC/O2000). The topics addressed in this
chapter include:
I Cluster management concepts
I Management applications
I Software maintenance
I Managing changes to shared storage
I Replacing a cluster node
I Adding a cluster node
I Managing cluster operation
NOTE: The procedures in this chapter contain high-level instructions. The instructions
summarize what has either already been discussed in this guide, Oracle documentation,
or storage subsystem documentation.
Compaq Confidential Need to Know Required
Writer: John Blackburn Project: Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide Comments:
Part Number: 225082-002 File Name: g-ch6 Cluster Management.doc Last Saved On: 6/13/01 10:29 AM
6-2 Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide
Cluster Management Concepts
Powering Off a Node Without Interrupting
Cluster Services
At some time during the life of your cluster you will need to perform an
operation on a cluster node that will require it to be powered off. Physically
moving the cluster node, removing a hardware device, and adding a hardware
device commonly require the node to be powered off.
It is a good practice to gracefully shut down the node before powering it off.
The process of gracefully shutting down a node in a PDC/O2000 can be
summarized as:
1. Make sure that clients connecting to the database through the node can
reconnect to the database through one of the other nodes.
2. Properly shutdown the Oracle instance running on the node.
3. Shut down the server.
The node can now be powered off safely. The database will remain accessible
since the remaining cluster nodes are operating normally.
Managing a Cluster in a Degraded Condition
Due to the high availability benefits of clustering, applications and network
clients remain operational even while some cluster components do not. When
the cluster enters a degraded condition, it is helpful to follow this
troubleshooting process:
1. Determine what caused the degradation.
2. Determine whether the condition affects one cluster node, multiple
cluster nodes, or all cluster nodes.
If one or more nodes is unaffected by the condition, and if enough
performance can be obtained from the unaffected nodes, continue
operating the database.
3. Determine whether the condition will continue to worsen.
Compaq Confidential Need to Know Required
Writer: John Blackburn Project: Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide Comments:
Part Number: 225082-002 File Name: g-ch6 Cluster Management.doc Last Saved On: 6/13/01 10:29 AM
Cluster Management 6-3
4. Determine how critical it is to repair the problem.
G If the problem is not considered to be critical, wait until a non-peak
time to service the problem.
G If the problem is critical but does not affect all cluster nodes, shut
down the Oracle instances on the affected nodes and wait until a
non-peak time to service the problem.
G If the problem is critical and affects all the cluster nodes, shut down
the database instances on all cluster nodes and correct the problem.
Managing Network Clients Connected to a Cluster
An important aspect of managing network clients is informing users that their
applications are now running on a cluster. As the cluster is initially brought
into production, it can be helpful to describe in a memorandum the effects a
cluster will have on user ability to access the database.
Since users will experience some disruption of service and possibly a
performance degradation during a node eviction, they might become
concerned about the availability and stability of their applications.
When a node eviction or node integration occurs, the users will notice that for
a brief moment they cannot access their database. When users have been
properly forewarned of the effects of operating in a clustered environment,
they will more readily recognize when such an event is occurring. Most users
will then know to wait several seconds before attempting to reaccess their
database.
Cluster Events
The majority of cluster events can be viewed either within the System log or
within specific error log files. The Oracle8i Server events are sent to the
Application log and can be viewed from the Event Viewer.
The lower-level software components, such as the cluster manager, send
events to error log files.
NOTE: If the OSDs are not installed in the default directory, the log files will be in the
same directory as the OSDs.
Compaq Confidential Need to Know Required
Writer: John Blackburn Project: Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide Comments:
Part Number: 225082-002 File Name: g-ch6 Cluster Management.doc Last Saved On: 6/13/01 10:29 AM
6-4 Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide
The following log files are used:
I The Node Manager (NM), provided by Compaq, logs messages to
C:\compaq\ops\nm.log
I By default the OracleCMService sends messages to
C:\compaq\ops\cmsrvr.log
Management Applications
Monitoring Server and Network Hardware
Compaq Insight Manager is used to manage the hardware components of your
cluster. Compaq Insight Manager, loaded from the Compaq Management CD,
is an easy-to-use software utility for collecting server, storage, and network
information. Compaq Insight Manager performs the following functions:
I Monitors fault conditions and system status
I Monitors shared storage and interconnect adapters
I Forwards server alert fault conditions
I Remotely controls servers
In Compaq servers, each hardware subsystem, such as network adapters,
system processors, and system memory, has a robust set of management
capabilities. Compaq Full Spectrum Fault Management notifies of impending
fault conditions.
Several steps are required to configure the system for Insight Manager. For
example, you must:
I Load Insight agents on each cluster node.
I Install the Compaq Insight Manager Console.
I Make sure that proper user rights are granted.
For additional information concerning Compaq Insight Manager, see the
Compaq Server Setup and Management pack.
Compaq Insight Manager XE is a web-based management system that can also
be used to monitor cluster hardware components. Compaq Insight
Manager XE is an optional CD available upon request from the Compaq
System Management website at
www.compaq.com/sysmanage
Compaq Confidential Need to Know Required
Writer: John Blackburn Project: Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide Comments:
Part Number: 225082-002 File Name: g-ch6 Cluster Management.doc Last Saved On: 6/13/01 10:29 AM
Cluster Management 6-5
Managing Shared Drives
There are two levels of management with shared drives in RA4000 Arrays or
RA4100 Arrays. The physical disks and the drive arrays created from them are
managed with the Array Configuration Utility (ACU). The logical drives are
created and managed with the Disk Management utility.
The ACU is first run during initial configuration of the shared storage
subsystem and can be run any time afterward to view existing drive arrays,
modify existing drive arrays, or add new drive arrays. The ACU is available
on the SmartStart and Support Software CD, which is found in the Compaq
Server Setup and Management pack. For additional information about the
ACU, see the Compaq StorageWorks RAID Array 4000 User Guide or the
Compaq StorageWorks RAID Array 4100 User Guide.
Disk Management is first run after the drive arrays have been created by the
ACU. Disk Management is used to partition the drive arrays, create logical
drives, and assign volume labels. For additional information about Disk
Management, see your Microsoft Windows 2000 Advanced Server
documentation.
Monitoring Redundant Fibre Channel Fabrics
Each redundant Fibre Channel Fabric in a PDC/O2000 contains this hardware:
I One or more Compaq StorageWorks RAID Array 4100s (RA4100
Arrays) or Compaq StorageWorks RAID Array 4000s (RA4000 Arrays)
I Two Compaq StorageWorks RAID Array 4000 Controllers (RA4000
Array Controllers) installed in each RA4000 Array or RA4100 Array
I At least two Compaq StorageWorks Fibre Channel SAN Switches
(Fibre Channel SAN Switches)
I At least two Compaq StorageWorks 64-bit/66-MHz Fibre Channel Host
Adapters or Compaq StorageWorks Fibre Channel Host Adapter/Ps
(Fibre Host Adapters) installed in each server
I Gigabit Interface Converter-Shortwave (GBIC-SW) modules
I Fibre Channel cables
Compaq Confidential Need to Know Required
Writer: John Blackburn Project: Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide Comments:
Part Number: 225082-002 File Name: g-ch6 Cluster Management.doc Last Saved On: 6/13/01 10:29 AM
6-6 Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide
Compaq Secure Path software can detect failures in redundant Fibre Channel
Fabric components. When a failure occurs on an active path, Secure Path
reroutes I/O through the standby path, allowing applications to continue
processing.
The Secure Path product CD is included in the cluster kit for the Compaq
Parallel Database Model PDC/O2000 for Oracle8i on Microsoft
Windows 2000.
Monitoring Redundant Fibre Channel Arbitrated
Loops
Each redundant FC-AL in a PDC/O2000 contains this hardware:
I One or more RA4100 Arrays or RA4000 Arrays
I Two RA4000 Array Controllers installed in each RA4000 Array or
RA4100 Array
I At least two Compaq StorageWorks Storage Hubs (Storage Hubs) or
Compaq StorageWorks FC-AL Switches (FC-AL Switches)
I At least two Fibre Host Adapters installed in each server
I GBIC-SW modules
I Fibre Channel cables
The Fibre Channel Fault Isolation Utility (FFIU) can verify the integrity of a
newly installed or existing FC-AL installation. This utility provides fault
detection and help in locating a failing device on an FC-AL. FFIU is on the
SmartStart and Support Software CD.
Compaq Secure Path software can detect failures in redundant Fibre Channel
Fabric components. When a failure occurs on an active path, Secure Path
reroutes I/O through the standby path, allowing applications to continue
processing.
The Secure Path product CD is included in the cluster kit for the Compaq
Parallel Database Model PDC/O2000 for Oracle8i on Microsoft
Windows 2000.
Compaq Confidential Need to Know Required
Writer: John Blackburn Project: Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide Comments:
Part Number: 225082-002 File Name: g-ch6 Cluster Management.doc Last Saved On: 6/13/01 10:29 AM
Cluster Management 6-7
Monitoring the Database
Oracle8i Enterprise Manager uses agents to continuously monitor database
activities and offer a graphical console allowing administrators to manage the
database. From the Enterprise Manager Console, the administrator can
administer, diagnose, and tune multiple databases. Jobs can also be scheduled,
software can be distributed, and objects and events can be monitored from the
console.
Several steps are required to properly configure the system for Oracle8i
Enterprise Manager. Additional steps are required to integrate the management
of parallel databases. For example, you must do the following:
I Create an Enterprise Manager Repository on the console node.
I Obtain sufficient rights on the console machine as well as on the
managed cluster nodes.
I Install Oracle agents on each managed node.
Be sure to read through the Oracle documentation. For Oracle8i Enterprise
Manager, see:
I Oracle Enterprise Manager Administrator's Guide
I Oracle Enterprise Manager Configuration Guide
I Oracle Enterprise Manager Concepts Guide
I Oracle8i Parallel Server Setup and Configuration Guide
I Oracle8i Parallel Server Concepts
I Oracle8i Parallel Server Administration, Deployment, and Performance
Oracle8i Enterprise Manager and its corresponding documentation are shipped
as part of Oracle8i Enterprise Edition.
Remotely Managing a Cluster
Oracle8i Enterprise Manager, Compaq Insight Manager, and Compaq
Insight Manager XE can be run from any network client machine that has
network access to the cluster nodes. They can operate on Windows NT Server,
Windows 95, or Windows 2000.
Compaq Confidential Need to Know Required
Writer: John Blackburn Project: Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide Comments:
Part Number: 225082-002 File Name: g-ch6 Cluster Management.doc Last Saved On: 6/13/01 10:29 AM
6-8 Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide
Before installing Compaq Insight Manager, Compaq Insight Manager XE, or
Oracle8i Enterprise Manager, it is recommended that you read through the
corresponding documentation to determine how to set up and configure each
of these programs to run remotely.
Software Maintenance for Oracle8i
Deinstalling the OSDs
At some point, you might want to deinstall the operating system dependent
modules (OSDs). Some example situations are:
I When a node is being permanently removed from the cluster
I When a node is being replaced
I When a node is being added to the cluster
I When the OSDs are being upgraded to a newer revision level
Use Oracle Universal Installer to deinstall the OSDs.
IMPORTANT: The Oracle Universal Installer removes the OSDs from all cluster nodes. To
properly maintain the cluster, the Oracle Universal Installer cannot remove the OSDs from
individual nodes. After the OSDs are deinstalled, the cluster is disbanded and cannot run
until the OSDs are reinstalled on all the nodes.
Be sure to shut down the Oracle instance on all nodes and stop the Oracle
services running on all nodes prior to removing the OSDs.
To deinstall the OSDs:
1. Log in as a user who has administrator privileges on all nodes in the
cluster.
2. Insert the Compaq Parallel Database Cluster Clustering Software for
Oracle8i on Microsoft Windows 2000 CD into the CD-ROM drive of
the primary node. This is the node where the OSDs were installed
originally.
IMPORTANT: To deinstall the OSDs, you must run the Oracle Universal Installer from the
same node where the OSDs were installed.
3. If autorun is enabled, the Oracle Universal Installer Welcome screen
appears.
Compaq Confidential Need to Know Required
Writer: John Blackburn Project: Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide Comments:
Part Number: 225082-002 File Name: g-ch6 Cluster Management.doc Last Saved On: 6/13/01 10:29 AM
Cluster Management 6-9
4. If autorun is disabled, enter d:\setup at a C: prompt. Substitute the letter
assigned to the CD-ROM drive for d. The Oracle Universal Installer
Welcome screen appears.
Compaq Confidential Need to Know Required
Writer: John Blackburn Project: Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide Comments:
Part Number: 225082-002 File Name: g-ch6 Cluster Management.doc Last Saved On: 6/13/01 10:29 AM
6-10 Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide
5. Click Deinstall Products. Next, a window containing an inventory of
the installed components appears. The following shows the Inventory
screen that is displayed when Ethernet is used for the cluster
interconnect.
6. Select Compaq Ethernet OSDs and click Remove.
NOTE: Your screen might display later revision levels for the OSDs.
7. Follow the Oracle Universal Installer directions to complete the
deinstallation.
Compaq Confidential Need to Know Required
Writer: John Blackburn Project: Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide Comments:
Part Number: 225082-002 File Name: g-ch6 Cluster Management.doc Last Saved On: 6/13/01 10:29 AM
Cluster Management 6-11
Upgrading Oracle8i Server
The design of the PDC/O2000 is tightly integrated with Oracle8i Server.
Significant changes in Oracle8i Server will likely affect the operation of the
cluster.
Before upgrading to any new release of Oracle8i Server, consult your Compaq
and Oracle service representatives. Make sure that the new release is certified
and supported on the PDC/O2000, and get assistance to determine which
procedure you should follow to perform the upgrade properly.
Upgrading the OSDs
During the life of your PDC/O2000, you will need to upgrade the operating
system dependent modules as new versions are released.
Before beginning the upgrade procedure:
1. Make sure that the person performing the upgrade has administrative
privilege on each cluster node.
2. Make sure that all cluster nodes are active. From each node, run the ping
utility to verify that every node recognizes the other nodes by host
name.
3. Shut down the Oracle database on all nodes.
4. Stop the Oracle services (OracleCMService, OracleNMService, and
OracleServiceSID) on all nodes.
Once you have completed these steps, you can deinstall the existing OSDs and
install the new versions as described in the following procedure.
Compaq Confidential Need to Know Required
Writer: John Blackburn Project: Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide Comments:
Part Number: 225082-002 File Name: g-ch6 Cluster Management.doc Last Saved On: 6/13/01 10:29 AM
6-12 Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide
Upgrading the Ethernet OSDs
To upgrade the Ethernet OSDs:
1. Insert the CD containing the new revision of the OSDs into the
CD-ROM drive on the primary node. (This is the node that was used for
the previous installation of the OSDs.)
The Oracle Universal Installer window is displayed.
2. Click Deinstall Products. The Inventory screen displays a list of
installed components.
3. Select Compaq Ethernet OSDs and click Remove.
The Oracle Universal Installer removes all Ethernet OSDs.
4. After the deinstallation has finished, restart all nodes.
5. Install the new Ethernet OSDs from the new by following the procedure
described under "Installing Compaq OSDs" in Chapter 5, "Installation
and Configuration."
Compaq Confidential Need to Know Required
Writer: John Blackburn Project: Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide Comments:
Part Number: 225082-002 File Name: g-ch6 Cluster Management.doc Last Saved On: 6/13/01 10:29 AM
Cluster Management 6-13
6. After installing the new Ethernet OSDs, restart OracleCMService and
OracleNMService on all nodes.
7. Restart the Oracle instances on all nodes.
Deinstalling a Partial OSD Installation
While not a common occurrence, the Oracle Universal Installer might not be
able to complete the installation of the Compaq Ethernet OSDs. An incomplete
OSD installation could result for various reasons, for example:
I A client LAN cable is no longer seated tightly into its connector.
I The node from which you are running the OUI cannot communicate
with all other nodes in the cluster.
I The user running the OUI does not have administrator privileges on all
cluster nodes.
An incomplete installation can result in a partial installation of the OSDs on
the cluster. If this occurs, you must clean up after the partial installation (by
removing it) before you can successfully run the Oracle Universal Installer
again.
To remove a partial OSD installation:
1. Insert the Compaq Parallel Database Cluster Clustering Software for
Oracle8i on Microsoft Windows 2000 CD into the CD-ROM drive of a
cluster node.
2. From a command prompt, navigate to the CD-ROM drive.
3. Connect to the \Utilities directory.
4. Run the uninstall utility by entering:
uninstallOSD
5. Restart the node.
6. Repeat steps 1 through 5 on all other nodes in the PDC/O2000 cluster.
Compaq Confidential Need to Know Required
Writer: John Blackburn Project: Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide Comments:
Part Number: 225082-002 File Name: g-ch6 Cluster Management.doc Last Saved On: 6/13/01 10:29 AM
6-14 Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide
Upgrading Oracle8i Server
The design of the PDC/O2000 is tightly integrated with Oracle8i Server.
Significant changes in Oracle8i Server will likely affect the operation of the
cluster.
Before upgrading to any new release of Oracle8i Server, consult your Compaq
and Oracle service representatives. Make sure that the new release is certified
and supported on the PDC/O2000, and get assistance to determine which
procedure you should follow to perform the upgrade properly.
Managing Changes to Shared Storage
Components
Replacing a Failed Disk
At some point, you might need to replace a failed drive in an RA4000 Array or
RA4100 Array. It is assumed you are employing RAID levels 0, 1, 0+1, 4, or 5
for all devices in the storage array.
IMPORTANT: If the failed drive is not part of a fault-tolerant drive array you can lose
some or all of the data on the failed drive.
With RAID employed, the effects of replacing a drive are felt only by the
storage subsystem. The operating system and Oracle are unaware of the
activity.
The removal of a drive in an RA4000 Array or RA4100 Array must follow
certain rules are that interpreted by reading the LEDs on the disk drive. Before
proceeding, locate the information in the Compaq StorageWorks RAID Array
4000 User Guide or the Compaq StorageWorks RAID Array 4100 User Guide
that describes the conditions under which a drive can be removed. Once you
have determined it is safe to remove the drive, open both latches on the drive
tray and remove the drive from the drive bay. Put the replacement drive into
the drive bay and snap the latches in place.
CAUTION: Failure to follow the rules described in the Compaq StorageWorks
RAID Array 4000 User Guide or the Compaq StorageWorks RAID Array 4100 User
Guide can result in loss of data.
Compaq Confidential Need to Know Required
Writer: John Blackburn Project: Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide Comments:
Part Number: 225082-002 File Name: g-ch6 Cluster Management.doc Last Saved On: 6/13/01 10:29 AM
Cluster Management 6-15
Adding Disk Drives to Increase Storage Capacity
During the life of your PDC/O2000 cluster, you might need to expand the
capacity of an RA4000 Array or RA4100 Array. The following steps describe
how to add drives to an RA4000/RA4100 Array and how to allocate the added
disk capacity to Oracle.
The drive can be added and allocated to Windows 2000 Advanced Server
while the database is online. The following summarizes the procedure.
1. Physically add the drives to the RA4000/RA4100 Array.
2. On the primary node, run the Array Configuration Utility to create drive
arrays, configured with RAID, and then create logical drives.
3. Using Disk Management, create an extended partition on each of the
logical drives.
4. Using Disk Management, create logical partitions within each extended
partition.
IMPORTANT: Do not format the drives. Oracle Parallel Server uses raw partitions, which
requires that the drive not be formatted with any file system.
5. Verify that the same shared disk resources are seen from every node in
the cluster by running Disk Management on each node.
6. Make sure you can see the same shared disk resources from each node
using Secure Path Manager as you can using the Disk Management.
7. Perform the necessary Oracle commands to associate the new data files
to the database.
Refer to the Oracle8i Parallel Server Setup and Configuration Guide for more
detailed instructions.
Adding an RA4000/RA4100 Array
You must shut down the cluster to add an RA4000/RA4100 Array. The
following steps summarize the procedure:
1. Shut down the Oracle instance on each cluster node.
2. Stop the Oracle services running on each node.
3. Shut down Windows 2000 Advanced Server on each node and power
off all the cluster nodes.
4. Power off all of the RA4000/RA4100 Arrays.
Compaq Confidential Need to Know Required
Writer: John Blackburn Project: Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide Comments:
Part Number: 225082-002 File Name: g-ch6 Cluster Management.doc Last Saved On: 6/13/01 10:29 AM
6-16 Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide
5. Insert drives into the added RA4000/RA4100 Array.
6. Using the Fibre Channel cables, physically connect the RA4000 Array
Controllers in the added RA4000/RA4100 Array to the Fibre Channel
SAN Switches, FC-AL Switches, or Storage Hubs.
7. Connect all of the RA4000/RA4100 Arrays to a power source and
restart them.
8. Restart the primary cluster node.
9. On the primary node, run the Array Configuration Utility to create drive
arrays, configured with RAID, and then create logical drives.
10. Using Disk Management, create an extended partition on each of the
logical drives.
11. Using Disk Management, create logical partitions within each extended
partition.
IMPORTANT: Do not format the drives. Oracle8i Parallel Server uses raw partitions,
which requires that the drive not be formatted with any file system.
12. Power on the other cluster nodes.
13. Verify that the same shared disk resources are seen from every node in
the cluster by running Disk Management on each node.
14. Make sure you can see the same shared disk resources from each node
using Secure Path Manager as you can using the Disk Management.
15. Define the active array controller in the newly-added RA4000/RA4100
Array.
16. Perform the necessary Oracle commands to associate the new data files
to the database.
Refer to the Oracle8i Parallel Server Setup and Configuration Guide for more
detailed instructions.
Replacing a Failed Fibre Host Adapter
To replace a failed Fibre Host Adapter in a cluster node:
1. Shut down the Oracle instance on the node.
2. Shut down the Oracle services running on the node.
3. Shut down the server.
4. Power off the node.
Compaq Confidential Need to Know Required
Writer: John Blackburn Project: Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide Comments:
Part Number: 225082-002 File Name: g-ch6 Cluster Management.doc Last Saved On: 6/13/01 10:29 AM
Cluster Management 6-17
5. From the Fibre Host Adapter, disconnect the Fibre Channel cable
installed between the Fibre Host Adapter and its Fibre Channel SAN
Switch, FC-AL Switch, or Storage Hub.
6. Remove the failed Fibre Host Adapter and insert a new one.
7. From the new Fibre Host Adapter, connect the Fibre Channel cable that
runs to its Fibre Channel SAN Switch, FC-AL Switch, or Storage Hub.
8. Power on the node.
9. Restart the Oracle services on the node.
10. Start up the Oracle instance on the node.
Replacing a Cluster Node
Before replacing a node, verify that the new configuration is supported by the
PDC/O2000. To determine if your new server is supported, see the Compaq
Parallel Database Cluster Model PDC/O2000 Certification Matrix for
Windows 2000 at
www.compaq.com/solutions/enterprise/ha-pdc.html
IMPORTANT: With some possible exceptions, the servers in the cluster must be set up
identically. For example, this means using one model server for all nodes. The cluster
components common to all nodes in the cluster must be identical; for example, the
cluster interconnect adapters, amount of memory, cache, and number of CPUs must be
the same in each cluster node.
Replacing a node consists of removing it logically from the cluster, removing
it physically from the cluster, then adding a new server to take its place.
Removing the Node
1. Record pertinent information that will be needed when configuring the
replacement node. Such information includes:
G The IP address and network name of the client LAN adapters
G For an Ethernet cluster interconnect, the IP address and network
name of the Ethernet cluster interconnect adapters
2. If the new node will use applications or data that is stored locally on the
node being replaced, back up that data to a removable storage medium
or to a remote file server that can be restored onto the replacement node.
3. Stop the Oracle instance on the node to be removed.
Compaq Confidential Need to Know Required
Writer: John Blackburn Project: Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide Comments:
Part Number: 225082-002 File Name: g-ch6 Cluster Management.doc Last Saved On: 6/13/01 10:29 AM
6-18 Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide
4. Stop all Oracle services on the node to be removed.
5. Shut down the server on that node and power it off.
6. Disconnect the Fibre Channel cables between the evicted node and the
Fibre Channel SAN Switches, FC-AL Switches, or Storage Hubs.
7. Disconnect the cluster interconnect cables from the evicted node and
label them as the cluster interconnect cables.
8. Disconnect the client LAN cables from the evicted node and label them
as the client LAN cables.
9. If adapters from the evicted node will be used in the new node, move the
adapters to the new node.
Adding the Replacement Node
Adding the replacement node involves the following activities:
I Preparing the replacement node
I Installing the cluster software
NOTE: These subsections contain a high-level outline of the steps to follow. If you need
detailed instructions, read Chapter 5, "Installation and Configuration."
Preparing the Replacement Node
Several steps should be performed on the replacement node before it is
integrated into the cluster.
Prior to integrating the node into the cluster, perform the following steps:
1. Connect the server for the replacement node to the cluster interconnect
components and the client LAN. Power on the replacement node.
Although physically connected to the cluster, the node is not yet
integrated into the cluster.
2. Start the replacement node with the Compaq SmartStart and Support
Software CD in the CD-ROM drive.
3. Use the Compaq System Configuration Utility to configure the hardware
settings of the node and its adapters.
4. Use the Compaq Array Configuration Utility to configure the server's
local non-shared disks with RAID.
Compaq Confidential Need to Know Required
Writer: John Blackburn Project: Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide Comments:
Part Number: 225082-002 File Name: g-ch6 Cluster Management.doc Last Saved On: 6/13/01 10:29 AM
Cluster Management 6-19
5. Install and configure Windows 2000 Advanced Server with Service
Pack 1 or later (whichever is installed on the other cluster nodes).
6. Install necessary Compaq drivers and utilities from the Compaq
SmartStart and Support Software CD.
7. Install Fibre Host Adapters in the replacement node in the same slot
locations used in the other cluster nodes.
8. Enter unique IP addresses and node names for each node in the hosts
and lmhosts files located at %SystemRoot%\system32\drivers\etc.
9. Install Secure Path for Windows 2000. See "Installing Secure Path
Software for Windows 2000" in Chapter 5, "Installation and
Configuration."
10. Using Fibre Channel cables, connect the Fibre Host Adapters in the
replacement node to the Fibre Channel SAN Switches, FC-AL Switches,
or Storage Hubs.
11. Restart the replacement node.
12. Verify TCP/IP connectivity between the replacement node and the
existing cluster nodes. Run the ping utility from the replacement node,
pinging the client LAN adapters on all other nodes. If Ethernet is used
as the cluster interconnect, also ping the cluster interconnect adapters of
all other nodes.
13. Verify the replacement node can access the shared storage. From the
replacement node, start Disk Management to verify that the same shared
disk resources are seen from this node as they are seen from other
installed nodes in the cluster. Also make sure you can see the same
shared disk resources from the replacement node using Secure Path
Manager as you can using Disk Management.
Installing the Cluster Software
Now that the replacement node is configured and physically connected to the
cluster, the next procedure is to integrate the node into the cluster. This
involves installing the low-level cluster management software and the OSDs.
It also involves installing the application-level cluster software, including
Oracle8i Server with the Oracle8i Parallel Server Option.
All activities in this procedure are facilitated with the Oracle Universal
Installer (OUI). The installation is further simplified in that almost all steps are
performed from a single server, the primary cluster node.
To install the cluster software, perform the following steps:
Compaq Confidential Need to Know Required
Writer: John Blackburn Project: Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide Comments:
Part Number: 225082-002 File Name: g-ch6 Cluster Management.doc Last Saved On: 6/13/01 10:29 AM
6-20 Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide
1. To add a node to the cluster, you must disassemble the existing cluster
and then reform it to include the replacement node. Do the following on
all original cluster nodes (not the replacement node):
a. Shut down the Oracle instance.
b. Stop all Oracle services.
c. Deinstall the OSDs using the OUI from the original installing node.
d. Restart all nodes to complete the deinstallation process.
2. If the replacement node is the node on which you originally installed the
OSDs, do the following on all nodes:
a. Shut down the Oracle instance.
b. Stop all Oracle services.
c. Uninstall the OSDs from each node by running uninstall OSD,
located in the Utilities directory of the installation CD.
d. Restart all nodes to complete the deinstallation process.
3. Use the OUI to reinstall the OSDs on each cluster node, including the
original nodes and the replacement node.
4. Restart each cluster node to complete the OSD installation process.
5. Verify that Object Link Manager has been installed on the replacement
node. See "Installing the Object Link Manager" in Chapter 5,
"Installation and Configuration."
6. Install Oracle8i Server with the Oracle8i Parallel Server Option on the
replacement node.
7. Restart the replacement node which, upon restart, is now fully integrated
into the cluster.
8. At this point, all further operations are specific to Oracle configuration.
Refer to the Oracle setup and configuration documentation for
information on configuring Oracle software.
Compaq Confidential Need to Know Required
Writer: John Blackburn Project: Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide Comments:
Part Number: 225082-002 File Name: g-ch6 Cluster Management.doc Last Saved On: 6/13/01 10:29 AM
Cluster Management 6-21
Adding a Cluster Node
Before adding a node, verify the new configuration is supported by the
PDC/O2000. To determine if your new server is supported, see the Compaq
Parallel Database Cluster Model PDC/O2000 Certification Matrix for
Windows 2000 at
www.compaq.com/solutions/enterprise/ha-pdc.html
IMPORTANT: With some possible exceptions, the servers in the cluster must be set up
identically. For example, this means using one model server for all nodes. The cluster
components common to all nodes in the cluster must be identical, for example, the
cluster interconnect adapters, amount of memory, cache, and number of CPUs must be
the same in each cluster node.
During the life of the PDC/O2000, you might need to add a new node to the
cluster. A desire to increase performance or throughput can drive this decision.
Adding another node also can increase overall availability of the system.
This can be a time-consuming and complex procedure. Be sure to read through
all of the following directions as well as those in the Oracle documentation
before starting.
Adding a new node involves the following activities:
I Preparing the new node
I Preparing the existing cluster nodes
I Installing the cluster software
These subsections contain a high-level outline of the steps to follow. If you
need detailed instructions, read through Chapter 5, "Installation and
Configuration."
Compaq Confidential Need to Know Required
Writer: John Blackburn Project: Compaq Parallel Database Cluster Model PDC/O2000 for Oracle8i and Windows 2000 Administrator Guide Comments:
Part Number: 225082-002 File Name: g-ch6 Cluster Management.doc Last Saved On: 6/13/01 10:29 AM
| 225082-002
|
