Documente Academic
Documente Profesional
Documente Cultură
This guide contains detailed instructions for installing and removing HP StorageWorks EVA Cluster Extension Software in Microsoft Cluster Service and HP Serviceguard environments. The intended audience has independent knowledge of related Windows or Linux software and of the HP StorageWorks Enterprise Virtual Array and its software.
Legal and notice information Copyright 2006, 2008 Hewlett-Packard Development Company, L.P. Confidential computer software. Valid license from HP required for possession, use or copying. Consistent with FAR 12.211 and 12.212, Commercial Computer Software, Computer Software Documentation, and Technical Data for Commercial Items are licensed to the U.S. Government under vendor's standard commercial license. The information contained herein is subject to change without notice. The only warranties for HP products and services are set forth in the express warranty statements accompanying such products and services. Nothing herein should be construed as constituting an additional warranty. HP shall not be liable for technical or editorial errors or omissions contained herein. Microsoft, Windows, Windows XP, and Windows NT are U.S. registered trademarks of Microsoft Corporation. Java is a US trademark of Sun Microsystems, Inc.
Contents
1 Environment and pre-installation requirements ........................................ 5
Environment considerations .......................................................................................................... Ideal environment ................................................................................................................. Network communication requirements ..................................................................................... Data backup requirements ..................................................................................................... How EVA Cluster Extension Software interacts with its environment .................................................... Failover function ................................................................................................................... How EVA Cluster Extension utilizes vdisks ................................................................................ How EVA Cluster Extension stores information .......................................................................... Pre-installation requirements ......................................................................................................... Environmental setup .............................................................................................................. Required disk space and system memory ................................................................................. Software versions and supported features ...................................................................................... 5 5 5 5 6 6 6 6 7 7 7 8
Step 4: Configure the HP EVA storage system ......................................................................... 22 Step 5: Create hosts ........................................................................................................... 22 Step 6: Create vdisks and add a LUN presentation ................................................................. 22 Step 7: Create Data Replication (DR) groups .......................................................................... 23 Step 8: Set read-only mode and add a LUN presentation to the destination vdisk ....................... 23 Step 9: Configure the Logical Volume Manager ...................................................................... 23 Step 10: Install and configure HP Serviceguard for Linux on all cluster nodes ............................. 24 Installing EVA Cluster Extension Software for Linux ........................................................................ 24 Removing EVA Cluster Extension Software for Linux ....................................................................... 25
4 Licensing ......................................................................................... 27
Retrieving a license key .............................................................................................................. Using AutoPass to retrieve permanent license keys ......................................................................... clxautopass command line utility ................................................................................................. Installing the license ........................................................................................................... Importing a license key from a file ........................................................................................ EVA Cluster Extension registration tool (Windows 2008 only) ......................................................... 27 27 27 28 28 28
5 Reference ........................................................................................ 29
Related documentation .............................................................................................................. HP technical support ................................................................................................................. Subscription service .................................................................................................................. HP web sites ............................................................................................................................ Documentation feedback ........................................................................................................... 29 29 29 30 30
Environment considerations
Ideal environment
The ideal configuration environment consists of at least five servers (two at each data center site and one as an arbitrator at a third site) with separate, redundant communications links for cluster heartbeats, client access and HP Continuous Access EVA. All communications interfaces must be installed in pairs to serve as failover components, in order to prevent single points of failure.
Recommendation
Use two systems at each site to give local application service failover procedures among local cluster systems priority over remote, more time-consuming failover procedures. When failing over, the software must reconfigure the storage systems to change the mirroring direction. At the remote site, two systems should be available in case the primary failover system experiences a hardware or power failure.
Windows: Using an Majority Node Set (MNS) quorum requires an odd number of cluster nodes, with at least one system in a third location. For HP Serviceguard for Linux, the quorum server is not a cluster node and should reside in a location separate from either data center. CAUTION: EVA Cluster Extension Software works with only one system at each location, with a single I/O path between the server and the storage system and a single link between storage systems. However, those configurations are not considered highly available, nor are they disaster tolerant. Therefore, configurations with single points of failure are not supported by HP.
Pre-installation requirements
Environmental setup
Ensure that the following conditions are met before installing EVA Cluster Extension Software: Continuous Access EVA links (including extender hardware) are redundant and configured to be bidirectional. Alternate I/O paths between servers and the EVA storage system are set up. Cluster and client networks are redundant. Cluster nodes can communicate with each other (not required for Windows 2003). The latest supported software and firmware versions, fixes, FC adapter firmware, and driver versions for your servers and EVA storage systems are installed. The cluster nodes in your zoning configuration each recognize their respective (local) EVA, but not the remote EVA. Each management server recognizes both EVAs and can recognize each other. The following figure shows a zoning example.
Linux
5 MB for /opt/hpclxeva 1 MB for /etc/opt/hpclxeva 100 MB for /var/opt/hpclxeva
Windows
50 MB in %ProgramFiles%\Hewlett-Packard\Cluster Extension EVA At least 25 MB of system memory.
Pre-installation procedures
Complete the following configuration procedures for the local primary and remote secondary sites: Step Step Step Step Step Step Step Step Step Step 1: Check the IP network setup and SAN configuration, page 9. 2: Install multipath software, page 10. 3: Install and configure Java Runtime Environment (JRE) , page 10. 4: Install and configure the HP SMI-S EVA server on all management servers, page 10. 5: Configure the HP EVA storage system, page 10. 6: Create hosts, page 11. 7: Create vdisks and add a LUN presentation, page 11. 8: Create Data Replication (DR) groups, page 11. 9: Set read-only mode and add a LUN presentation to the destination vdisk, page 11. 10: Install MSCS on all nodes, page 12.
In an MNS quorum cluster, all nodes must be distributed so that an equal number of nodes are located in the local and remote data center and an additional node in a third location functions as a tie-breaker or arbitrator. The third location can be a separate room in a separate fire protection zone with separate power connections. The arbitrator node can act as a regular cluster node and can be connected to one of the storage systems. However, a connection to either storage system is not necessary for the node to act as a tie-breaker. SAN fabrics can be extended to allow for array-based data replication. Consult the HP StorageWorks Continuous Access EVA implementation guide and the SAN Design Guide for supported SAN extension configuration and instructions on setting up your HP Continuous Access EVA environment. EVA Cluster Extension Software works in dispersed data center environments with a separation distance of up to 500 km or a round-trip latency of up to 20 milliseconds.
Step 4: Install and configure the HP SMI-S EVA server on all management servers
Install the HP SMI-S EVA server component on all of the management servers that run the HP Command View EVA software. Review the HP StorageWorks Command View EVA installation guide and HP StorageWorks Command View EVA release notes to set the access properties. When you configure EVA Cluster Extension, you will need the following HP SMI-S information: HP SMI-S server name and IP address Port number. The default is 5989 with Secure Sockets Layer (SSL) enabled, and 5988 with SSL disabled. User name Password SSL use (yes or no)
10
Step 9: Set read-only mode and add a LUN presentation to the destination vdisk
The final steps of the HP Continuous Access EVA setup are to 1. 2. Set access mode to read-only for the destination vdisk. You can set this property only by using SSSU. Add a LUN presentation to your remote cluster node.
11
NOTE: HP recommends that you use the same LUN number for all servers in the cluster. This step assumes that you have created your remote host entry on the destination storage system as described in Step 6: Create hosts on page 11. For detailed instructions, see the HP StorageWorks Command View EVA user guide or the HP StorageWorks Storage System Scripting Utility reference.
After the cluster software is installed, you can install EVA Cluster Extension Software on all cluster nodes that have a FC connection to the local or remote HP EVA and are used to access storage resources on the HP EVA. If the system that acts as an arbitrator or tie-breaker is not connected to either HP EVA, you do not need to install the software on that cluster node.
12
Use this procedure to install the following components: Resource DLL (clxevamscs.dll) Cluster administrator extension DLL (clxevamscsex.dll) Command line interface (CLI) (clxevarun.exe) You can use the CLI for custom cluster software integration. For example, you can write your own online and offline scripts using the advanced DR group status checking options. NOTE: Installing the CLI is not required if you are using EVA Cluster Extension Software with MSCS.
CAUTION: The installation adds a resource type DLL to MSCS. The associations with this resource type DLL are lost if the cluster software is removed. Every new installation, removal, or reinstallation of MSCS requires running the Repair Cluster resource type setup program. For more information, see the EVA Cluster Extension Software administrator guide.
13
9.
In the Setup Type dialog box, select one of the following options, and then click Next: Select Typical to install the resource DLL, cluster administrator extension DLL, and documentation. Select Compact to install only the resource DLL and cluster administrator extension DLL without documentation. Select Custom to select specific components to install. The Custom setup allows the option of installing only the CLX cluster administrator DLL on a management server. This enables you to run the Cluster Administrator GUI and manage the resources from a management host without requiring a separate license for this node.
10. In the Enter SMI-S IP address, login, and password dialog box, enter the login name and password for SMI-S, which may be different from the actual host login name and password. For Port #, accept the default at this point. Do not overwrite. This is the number of the HP SMI-S connection port. Whether or not SSL is selected determines the default port number.
11. Click Add Next to clear the window and complete the dialog box for additional EVA management servers.
14
12. When you have added all desired EVA management servers, click Save/Finish. 13. Complete the license process. See Chapter 4 on page 27 for detailed procedures.
15
1.
Check whether the resource type is registered with MSCS by entering: \cd %SystemRoot%\system32 cluster resourcetype If the resource type is registered, the output includes the following information:
Display Name Cluster Extension EVA Resource Type Name Cluster Extension EVA
If the resource type is not registered: a. b. 2. Enter cluster resourcetype "Cluster Extension EVA" /CREATE /DLLNAME:clxevamscs.dll /TYPE:"Cluster Extension EVA". Run the cluster resourcetype command again to verify that the resource type is now registered.
Check whether the DLL is registered with MSCS to provide the Cluster Administrator GUI functionality by entering: cluster resourcetype "Cluster Extension EVA" /PROPERTIES If the DLL is registered, the output includes the following information:
T Resource Type Name SR Cluster Extension EVA DllName Value clxevamscs.dll
If the DLL is not registered: a. b. Enter cluster /REGADMINEXT:clxevamscsex.dll. Run the cluster resourcetype command again to verify that the DLL is now registered.
Install the latest version of the software. Repeat steps 13 for all other nodes where the software has been installed.
16
2. 3. 4. 5. 6. 7.
17
6. 7.
If this is the last cluster node with EVA Cluster Extension installed, click Yes. Otherwise, click No. Click Finish in the Maintenance Complete dialog box.
18
3.
Click Yes to confirm the uninstall request. The install wizard asks if you want to save the C:\Program Files\Hewlett-Packard\Cluster Extension EVA\bin\clxevacfg file. This file contains information about the EVA Cluster Extension configuration. If you save the file, you could import it to restore your EVA Cluster Extension configuration. Do one of the following: Click Yes if you want to save the file. Enter a file name, and then click Save. Click No if you do not want to save the file. Click OK. The install wizard asks if you want to unregister the cluster resource type from all nodes in the cluster. HP recommends that you do not unregister the cluster resource type until you are uninstalling EVA Cluster Extension from the last node in the cluster.
4.
5.
Do one of the following: If you have not uninstalled EVA Cluster Extension from all of the other cluster nodes, click No. If you have uninstalled EVA Cluster Extension from all of the other cluster nodes, click Yes. Click Finish.
6.
19
20
Pre-installation procedures
Complete the following configuration procedures for the local primary and remote secondary sites: Step 1: Check the IP network setup and SAN configuration, page 21. Step 2: Configure the HBA driver(s) for multipath failover, page 22. Step 3: Install and configure the HP SMI-S EVA server on all management servers, page 22. Step 4: Configure the HP EVA storage system, page 22. Step 5: Create hosts, page 22. Step 6: Create vdisks and add a LUN presentation, page 22. Step 7: Create Data Replication (DR) groups, page 23. Step 8: Set read-only mode and add a LUN presentation to the destination vdisk, page 23. Step 9: Configure the Logical Volume Manager, page 23. Step 10: Install and configure HP Serviceguard for Linux on all cluster nodes, page 24.
21
Step 3: Install and configure the HP SMI-S EVA server on all management servers
Install the HP SMI-S EVA server component on all of the management servers that run the HP Command View EVA software. Review the HP StorageWorks Command View EVA installation guide and HP StorageWorks Command View EVA release notes to set the access properties. When you configure the software, you will need the following HP SMI-S information: HP SMI-S server name and IP address Port number. The default is 5989 with Secure Sockets Layer (SSL) enabled, and 5988 with SSL disabled. User name Password SSL use (yes or no)
22
NOTE: Later in this installation process, you will have to create a LUN presentation for your remote destination vdisk and set the access mode property for the destination vdisk to read-only. You can set this property only by using SSSU. See Step 8: Set read-only mode and add a LUN presentation to the destination vdisk on page 23. For detailed instructions, see the HP StorageWorks Command View EVA user guide or the HP StorageWorks Storage System Scripting Utility reference.
Step 8: Set read-only mode and add a LUN presentation to the destination vdisk
The final steps of the HP Continuous Access EVA setup are to 1. 2. Set access mode to read-only for the destination vdisk. You can set this property only by using SSSU. Add a LUN presentation to your remote cluster node.
NOTE: HP recommends that you use the same LUN number for all servers in the cluster. This step assumes that you have created your remote host entry on the destination storage system as described in Step 6: Create hosts on page 11. For detailed instructions, see the HP StorageWorks Command View EVA user guide or the HP StorageWorks Storage System Scripting Utility reference.
23
are in read/write mode, the source side of the DR group must be in the local (currently active) data center. To make each disk accessible to the nodes located in the remote data center on a host with its disks on the source side of the DR group: 1. 2. 3. Create volume groups, logical volumes, and file systems on the source system for all HP Serviceguard for Linux cluster packages. Use Command View EVA to switch the DR mode of the destination side of the DR groups to source to make the shared disks accessible. Import volume groups and logical volumes on the remote nodes after creating the mount points on each node using vgscan.
Step 10: Install and configure HP Serviceguard for Linux on all cluster nodes
See the HP Serviceguard for Linux Version Release Notes for detailed installation procedures.
24
8.
After installation, read the /opt/hpclxeva/docs/README.ReleaseNotes file. Repeat steps 16 on each system that will run HP Serviceguard for Linux with EVA Cluster Extension Software. NOTE: For post-installation configuration, see the HP StorageWorks EVA Cluster Extension Software administrator guide.
25
26
4 Licensing
This chapter explains how to obtain and install the product license keys. A license key is required to use all of the product features. The License Entitlement Certificate provides instructions on how to obtain a license key. In the meantime, a temporary, instant-on license key is available so that you can immediately start using all of the features. The instant-on key is valid for 60 days from the first use. Upon expiration of the instant-on license key, the features will be disabled; you must obtain a permanent license key to continue using the features.
3.
27
28
Licensing
5 Reference
Related documentation
The following documents and web sites provide related information: HP StorageWorks EVA Cluster Extension Software administrator guide HP StorageWorks EVA Cluster Extension Software compatibility reference HP StorageWorks Continuous Access EVA implementation guide HP StorageWorks Command View EVA user guide HP StorageWorks Command View EVA online help (accessible from the HP Command View EVA user interface) HP StorageWorks Enterprise Virtual Array updating product software HP StorageWorks SAN design guide Managing HP Serviceguard for Linux HP Serviceguard for Linux. See the HP High Availability web site: http://docs.hp.com/en/ha.html and the HP Serviceguard for Linux ProLiant cluster web site: http://www.hp.com/info/sglx You can find the HP documents from the Manuals page of the HP Business Support Center web site: http://www.hp.com/support/manuals In the Storage section, click Storage software and then select a product.
HP technical support
For worldwide technical support information, see the HP support web site: http://www.hp.com/support Before contacting HP, collect the following information: Product model names and numbers Technical support registration number (if applicable) Product serial numbers Error messages Operating system type and revision level Detailed questions
Subscription service
HP recommends that you register your product at the Subscriber's Choice for Business web site:
29
http://www.hp.com/go/e-updates After registering, you will receive e-mail notification of product enhancements, new driver versions, firmware updates, and other product resources.
HP web sites
For additional information, see the following HP web sites: http://www.hp.com http://www.hp.com/go/storage http://www.hp.com/support/manuals
Documentation feedback
HP welcomes your feedback. To make comments and suggestions about product documentation, please send a message to storagedocsFeedback@hp.com. All submissions become the property of HP.
30
Reference
Glossary
CA CLI CV EVA HP StorageWorks Continuous Access EVA. CA lets you create and maintain duplicate copies of local logical volumes on a remote storage system. Command line interface. HP StorageWorks Command View Enterprise Virtual Array, a software product for managing EVA arrays. Command View runs on a Windows-based management workstation. A volume on the storage system that accepts HP Continuous Access or HP Business Copy control operations that are then executed by the storage system. Custom volume size. CVS devices (OPEN-x CVS) are custom volumes configured using array management software to be smaller than normal fixed-size OPEN system volumes. See also VSC A named group of disks selected from all the available disks in an array. One or more virtual disks can be created from a disk group. Data replication group. A named group of virtual disks selected from one or more disk groups to replicate to the same destination, fail over together if a member virtual disk fails, and preserve write order within the group. Enterprise Virtual Array. An HP StorageWorks disk array product that allows pooled disk capacity to be presented to hosts as one or more variably sized physical devices. An EVA consists of disks, controllers, cables, power supplies, and controller software. Storage system, virtual array, and storage array are other names for an EVA. See also virtual disk An operation that reverses replication direction so that the destination becomes the source and the source becomes the destination. Failovers can be planned or unplanned and can occur between DR groups, managed sets, fabrics or paths, and array controllers. Fibre Channel. Host bus adapter. A periodic synchronization signal issued by cluster software or hardware to indicate that a node is an active member of the cluster. A computer that runs user applications and uses (or potentially uses) one or more virtual disks that are created and presented by the array controller. A server on which HP StorageWorks Enterprise Virtual Array (EVA) management software is installed, including HP Command View EVA and HP Replication
EVA
failover
31
Solutions Manager, if used. A dedicated management server runs EVA management software exclusively. Other management servers include general-purpose servers, HP ProLiant Storage Server models, and the Storage Management Appliance. When there are multiple management servers in a SAN, two active instances of HP Command View EVA are allowed, but each array will only be managed by one instance. The active management server actively manages the array, while the standby management server takes control of the array if there is a failure on the active management server. There can be only one active management server at a time for any given management zone in a SAN. port A physical connection that allows data to pass between a host and the storage system. The number of ports on an EVA storage system depends on the number of supported I/O slots and the number of ports available per I/O adapter. The EVA family of storage systems supports Fibre Channel (FC) ports as well as other port types. Ports are named by port group and port letter, such as CL1-A, where CL1 is the port group, and A is the port letter. Data center location that owns the cluster group (quorum resource). In MSCS: A cluster resource that has been configured to control the cluster, maintaining essential cluster data and recovery information. In the event of a node failure, the quorum acts as a tie-breaker and is transferred to a surviving node to ensure that data remains consistent within the cluster. In HP Serviceguard for Linux: a cluster resource that provides tie-breaking services to prevent split-brain syndrome. Red Hat package manager. Small computer system interface. Location of the mirror copy of the quorum disk pair in the data center. A state of data corruption that can occur if a cluster is re-formed as subclusters of nodes at each site, and each subcluster assumes authority, starting the same set of applications and modifying the same data. An EVA. See also EVA and virtual array Terabytes. General term for an EVA. See also virtual disk Variable disk capacity that is defined and managed by the array controller and presentable to hosts as a disk. Volume size customization. See also CVS World Wide Name. A unique identifier assigned to a Fibre Channel device.
RPM SCSI secondary site split-brain syndrome storage system TB virtual array virtual disk VSC WWN
32
Glossary
Index
A
AutoPass command line utility, 27 AutoPass license program, 27
H
HBA drivers Serviceguard, 22 help obtaining, 29 HP technical support, 29 HP SMI-S EVA Linux, 22 Windows, 10
C
cautions resource type DLL in MSCS, 13 clxautopass command line utility, 27
D
data backup requirements, 5 disk space requirement, 7 document related documentation, 29 documentation HP web site, 29 providing feedback, 30 DR groups creating, 11, 23
I
installation EVA Cluster Extension Linux, 24 Windows, 12 installation prerequisites MSCS, 9 Serviceguard, 21 instant-on license, 27
E
EVA Cluster Extension failover function, 6 installation Linux, 24 Windows, 12 internal database, 6 pre-installation requirements, 7 removing Linux, 25 Windows, 17 supported features, 8 supported versions, 8 upgrading Windows, 16 vdisks, 6
J
Java Runtime Environment MSCS, 10
L
licensing, 27 installing license keys, 27 registration tool (Windows 2008), 28 retrieving license keys, 27, 27
M
memory requirement, 7 MSCS installation, 12 multipath software MSCS, 10 Serviceguard, 22
F
failover, 6
N
network requirements, 5
33
P
permanent license key, 27 pre-installation procedures MSCS, 9 create hosts, 11 DR groups, 11 EVA storage system, 10 HP SMI-S EVA, 10 installing MSCS, 12 IP network, 9 Java Runtime Environment, 10 multipath software, 10 SAN configuration, 9 vdisks, 11, 11 Serviceguard, 21 create hosts, 22 DR groups, 23 EVA storage system, 22 HBA drivers, 22 HP SMI-S EVA, 22 installing Serviceguard, 24 IP network, 21 Logical Volume Manager, 23 SAN configuration, 21 vdisks, 22, 23 pre-installation requirements, 7 data backup, 5 disk space and memory, 7 environment, 5 environmental setup, 7 network, 5
U
upgrading EVA Cluster Extension Windows, 16
V
vdisks, 6 creating, 11, 22 LUN presentation, 11, 23 presenting, 11, 22 setting read-only mode, 11, 23 versions supported software, 8
W
web sites HP , 30 HP Subscriber's Choice for Business, 29 product manuals, 29 Windows Server 2008 removing EVA Cluster Extension, 18
R
related documentation, 29 removing EVA Cluster Extension Linux, 25 Windows, 17 resource DLL registering manually, 15 Resource type registering manually, 15 retrieving license keys, 27
S
Subscriber's Choice, HP, 29
T
technical support HP, 29
34