Documente Academic
Documente Profesional
Documente Cultură
ProtecTier 3.1.8.0 Install/Setup and Use with Tivoli Storage Manager 6.3
TABLE OF CONTENT
1.
2.
Context
ProtecTier at a glance
2.1.
TSSC / PT Manager
3.
ProtecTier TS7650G configuration
3.1.
Checkpoints
3.2.
TS7650G Node1 Install
4.
File system layout creation
5.
Repository Creation
5.1.
Planning
5.2.
Creation
6.
RAS Configuration
7.
Clustered configuration
7.1.
Join the Node 2 within the cluster
8.
Host Attachment
8.1.
Configure the port attributes
8.2.
Front End Adapter Zoning
8.3.
Zoning information output
8.4.
Host Initiator Management
9.
Enable the LUN Masking Group (LMG)
10.
Setup a Virtual Library (VLib)
10.1.
Virtual Library at a glance
10.2.
Naming convention used for DYB Infra
10.3.
Maximums
10.4.
Create a new library
11.
Configure the Lun Masking Group
12.
TSM
12.1.
TSM Attachment description
12.2.
Library definition
12.3.
Label the virtual tapes:
12.4.
Define the device class
13.
PT User Management
14.
PT Notification configuration
14.1.
Mail notifications
15.
Report and diagnostics
15.1.
Generate a report
15.2.
PT configuration files backup (out of the box)
16.
Best practices for TSM
17.
Tips
17.1.
Community & Wiki
17.2.
Cluster System startup procedure information
17.3.
Display the serial Id of a machine
17.4.
Log
17.5.
Reboot
17.6.
How to clean an old repository configuration [to be done only per IBM Support request]
17.7.
Display WWN of PT cluster nodes (on linux):
17.8.
Use the PT Manager GUI to plan your repository
17.9.
Information about Time setting
17.10.
WWN list of multipath devices:
1
1
3
3
3
4
9
12
12
14
21
24
24
31
31
32
33
34
37
39
39
39
39
40
48
52
52
53
55
56
57
57
57
59
59
61
62
64
64
64
65
65
65
65
66
66
68
68
ProtecTier 3.1.8.0 Install/Setup and Use with Tivoli Storage Manager 6.3
1. Context
This installation is part of a shared storage infrastructure build.
This documentation is intended to help folks that wanted to configure a VTL TS7650G, working with TSM
server 6.3
2. ProtecTier at a glance
The IBM System Storage TS7650G ProtecTIER Deduplication Gateway is
designed to meet the disk-based data protection needs of the enterprise data center while enabling significant
infrastructure cost reductions. The solution offers industry-leading inline deduplication performance and
scalability.
The TS7650G Model DD4 ProtecTIER Deduplication Gateway provides:
High-speed backups: Up to 2000 MB/sec or more (7.2 TB/hr) sustained inline deduplication backup
performance
Even faster restores: Up to 2800 MB/sec or more (10 TB/hr) sustained recovery Performance
1/71
ProtecTier 3.1.8.0 Install/Setup and Use with Tivoli Storage Manager 6.3
2/71
ProtecTier 3.1.8.0 Install/Setup and Use with Tivoli Storage Manager 6.3
Default Username
ptadmin
ptoper
ptuser
gmadmin
root
Default Password
ptadmin
ptoper
ptuser
gmadmin
admin
3.1. Checkpoints
Be sure that you are working on the right machine by checking the system serial number
Use the command /usr/sbin/dmidecode -t 1
3/71
ProtecTier 3.1.8.0 Install/Setup and Use with Tivoli Storage Manager 6.3
Check that the devices are well managed by the Linux multipathd driver
multipath ll
4/71
ProtecTier 3.1.8.0 Install/Setup and Use with Tivoli Storage Manager 6.3
Attention: Before you begin ProtecTIER software configuration, confirm that the attached disk storage has
been properly configured for use with the TS7650G. Failure to do so could result in the Red Hat Linux
operating system having to be reinstalled on one or more of the TS7650G servers.
Prerequisites:
TCP ports 6520, 6530, 6540, 6550, 3501, and 3503 are open in the customer's firewall. Each ProtecTIER
server being used for replication must allow TCP access through these ports.
5/71
ProtecTier 3.1.8.0 Install/Setup and Use with Tivoli Storage Manager 6.3
Enter Yes.
6/71
ProtecTier 3.1.8.0 Install/Setup and Use with Tivoli Storage Manager 6.3
The second is asked only if the VTFD service is up. If so, click Yes .
These steps can take up to 30 minutes as well. (Step Checking repository elapsed time will depends on your
repository size, it can take a while )
7/71
ProtecTier 3.1.8.0 Install/Setup and Use with Tivoli Storage Manager 6.3
8/71
ProtecTier 3.1.8.0 Install/Setup and Use with Tivoli Storage Manager 6.3
Note the Default Gateway connectivity failed in our case because the firewall installed on it rejects the icmp
protocol.
Once the PT has been configured, create the file system layout, later used for repository creation
9/71
ProtecTier 3.1.8.0 Install/Setup and Use with Tivoli Storage Manager 6.3
The fsCreate tool creates the logical volumes and file systems on all accessible LUNs, updates the /etc/fstab
file, and mounts all file systems.
10/71
ProtecTier 3.1.8.0 Install/Setup and Use with Tivoli Storage Manager 6.3
It can run for a while depending of the number of mpath you have
Now, we will create the repository using the PT Manager GUI.
11/71
ProtecTier 3.1.8.0 Install/Setup and Use with Tivoli Storage Manager 6.3
5. Repository Creation
5.1. Planning
We performed our repository size plan using the PT Planner Tool. (https://w3connections.ibm.com/communities/service/html/communityview?communityUuid=c37424c5-7cf6-449f-8a36b418c85c466f#fullpageWidgetId%3DWbb131d2c8fb0_4d46_94b6_2717bc55af9e%26file%3Df575b89f-3aad4e1d-85aa-ddce89c6e0a9
)
Based on our assumption of performance ( dedup ratio 8:1 / throughput 1920MB/s), available hardware (7TB
of RAID10 disk capacity), we have the following results as output
We will start with a repository of 270 TB of user data, using an index of Meta Data of 7,6 TB , spreaded over 2
+ 1 File system
According the the PT Planner tool again, the maximum repository size we might have (keeping the same
ratio/performance) in case of n eeds, is 313 TB
12/71
ProtecTier 3.1.8.0 Install/Setup and Use with Tivoli Storage Manager 6.3
13/71
ProtecTier 3.1.8.0 Install/Setup and Use with Tivoli Storage Manager 6.3
5.2. Creation
NAME: MOPB4VTL42
14/71
ProtecTier 3.1.8.0 Install/Setup and Use with Tivoli Storage Manager 6.3
15/71
ProtecTier 3.1.8.0 Install/Setup and Use with Tivoli Storage Manager 6.3
Default balance displayed by GUI between Meta Data and User Data repository
16/71
ProtecTier 3.1.8.0 Install/Setup and Use with Tivoli Storage Manager 6.3
Usually the PT GUI manager assign the RAID10 detected LUN to the meta data group (left pane before).
The RAID10 LUNs in our case have specific serial numbers, identifiable by 43xx or 42xxx as serial end.
Check with the multipath ll to match the serial of RAID10 LUNs using the multipath ll command.
[root@MOPB4VTLN142 sbin]# multipath -ll | grep mpath | grep "042.."
mpath2 (36005076306ffc06c0000000000004202) dm-42 IBM,2107900
mpath1 (36005076306ffc06c0000000000004201) dm-40 IBM,2107900
mpath0 (36005076306ffc06c0000000000004200) dm-37 IBM,2107900
17/71
ProtecTier 3.1.8.0 Install/Setup and Use with Tivoli Storage Manager 6.3
18/71
ProtecTier 3.1.8.0 Install/Setup and Use with Tivoli Storage Manager 6.3
Repository created
19/71
ProtecTier 3.1.8.0 Install/Setup and Use with Tivoli Storage Manager 6.3
20/71
ProtecTier 3.1.8.0 Install/Setup and Use with Tivoli Storage Manager 6.3
6. RAS Configuration
Once the repository has been created, we can proceed on RAS configuration, still working on the NODE 1.
Be aware that the RAS configuration is an offline procedure.
If the setup has already been done, you just have to check the values, if not, enter the right values
21/71
ProtecTier 3.1.8.0 Install/Setup and Use with Tivoli Storage Manager 6.3
22/71
ProtecTier 3.1.8.0 Install/Setup and Use with Tivoli Storage Manager 6.3
Configuration is done. You can access to the TSSC to see that your hosts are now attached.
23/71
ProtecTier 3.1.8.0 Install/Setup and Use with Tivoli Storage Manager 6.3
7. Clustered configuration
If you have a clustered environment, you have to configure the second node, and then ask it to join the cluster
and finally perform the fence tests.
24/71
ProtecTier 3.1.8.0 Install/Setup and Use with Tivoli Storage Manager 6.3
25/71
ProtecTier 3.1.8.0 Install/Setup and Use with Tivoli Storage Manager 6.3
Enter your parameters when asked, about IP, mask, Gateway, name .
26/71
ProtecTier 3.1.8.0 Install/Setup and Use with Tivoli Storage Manager 6.3
27/71
ProtecTier 3.1.8.0 Install/Setup and Use with Tivoli Storage Manager 6.3
When the fence test on node 2 is completed, follow the same procedure from the node 1, this is a mandatory
step if you plan to use PT Replication feature.
During the fence test, you can have a look on the PT manager GUI side: corner right bottom, Software alert
button
28/71
ProtecTier 3.1.8.0 Install/Setup and Use with Tivoli Storage Manager 6.3
/!\ Caution, please not the following when you are doing reboot/fence tests:
Avoid performing the 2 fence tests within 1 hour, to avoid this error:
Tue May 15 23:08:41 CEST 2012
cmgnt 14103 (14103) 5020: The Cluster Manager detected that
there have been more than 2 unscheduled restarts in the last 60 minutes. It has stopped the process of
bringing up the services to prevent endless reboot cycles.
29/71
ProtecTier 3.1.8.0 Install/Setup and Use with Tivoli Storage Manager 6.3
30/71
ProtecTier 3.1.8.0 Install/Setup and Use with Tivoli Storage Manager 6.3
8. Host Attachment
31/71
ProtecTier 3.1.8.0 Install/Setup and Use with Tivoli Storage Manager 6.3
Once the port are set and connected, collect all the HBA information to build zoning.
32/71
ProtecTier 3.1.8.0 Install/Setup and Use with Tivoli Storage Manager 6.3
Collect the WWN for each desired HBA and pass it to your soning team.
At this point, you have to request the Zoning between VTL SAN Host adapters and your TSM server SAN
adapters.
You would have as many zones as you have VTL host adapter. In our case: dual node DD4 cluster => 8 Front
End ports => 8 zones (assuming that you have 8 FC ports on your backup server as well)
8 /
8 /
33/71
ProtecTier 3.1.8.0 Install/Setup and Use with Tivoli Storage Manager 6.3
DYB_mopb4tsmlc-42 / 48 / B4
10:00:00:00:c9:e8:7e:98
DYB_mopb4tsmlc-42 / 48 / B4
10:00:00:00:c9:e8:7f:98
DYB_mopb4tsmlc-42 / 49 / B4
10:00:00:00:c9:e8:7e:99
DYB_mopb4tsmlc-42 / 49 / B4
10:00:00:00:c9:e8:7f:99
DYB_mopb4tsmlc-42 / 48 / B4
10:00:00:00:c9:e8:78:b2
DYB_mopb4tsmlc-42 / 48 / B4
10:00:00:00:c9:e8:78:fc
DYB_mopb4tsmlc-42 / 49 / B4
10:00:00:00:c9:e8:78:b3
DYB_mopb4tsmlc-42 / 49 / B4
10:00:00:00:c9:e8:78:fd
8 /
8 /
34/71
ProtecTier 3.1.8.0 Install/Setup and Use with Tivoli Storage Manager 6.3
You see there, all the VTL host initiators (VTL cluster nodes front end initiators = 4 x 4) and the 8 HBA zoned
for the TSM server (4 HBA per Fabric for each TSM server)
It is strongly recommended to Set alias to WWN, it will be easier to work with after.
Right click Modify button in the Host Initiator Popup, then enter the Alias name
35/71
ProtecTier 3.1.8.0 Install/Setup and Use with Tivoli Storage Manager 6.3
36/71
ProtecTier 3.1.8.0 Install/Setup and Use with Tivoli Storage Manager 6.3
Warning: when you do that, you will mask all the devices if there is something already defined on the VT.
37/71
ProtecTier 3.1.8.0 Install/Setup and Use with Tivoli Storage Manager 6.3
Click Yes
Click OK.
38/71
ProtecTier 3.1.8.0 Install/Setup and Use with Tivoli Storage Manager 6.3
Library
<LOCATION><HW><VTLID>-4<N>
Virtual Volume
<BUILDING><LC_ID><NNN>L3
MOPB4TS3500-41
E4ZG2VTL42-01
MOPB4VTL41-03
B41000L3
G2R000L3
10.3. Maximums
Here are the maximum supported in the implemented TS7650G version:
39/71
ProtecTier 3.1.8.0 Install/Setup and Use with Tivoli Storage Manager 6.3
40/71
ProtecTier 3.1.8.0 Install/Setup and Use with Tivoli Storage Manager 6.3
41/71
ProtecTier 3.1.8.0 Install/Setup and Use with Tivoli Storage Manager 6.3
We will set each VTL with a total of 48 virtual drives spread among the 2 host initiator of each cluster nodes,
however activate only 32 per virtual lib tp backup systems (Using the LUN masking group. See details
hereafter). This setup will allow to add new virtual drive to backup system without any system downtime,
indeed a downtime of whole ProtecTier system is necessary to define new virtual drive to a virtual library.
[At this point, you must already think about your LUN Masking Group if you plan to use it. Indeed, you
will spread your devices over the LMG members only]
42/71
ProtecTier 3.1.8.0 Install/Setup and Use with Tivoli Storage Manager 6.3
43/71
ProtecTier 3.1.8.0 Install/Setup and Use with Tivoli Storage Manager 6.3
44/71
ProtecTier 3.1.8.0 Install/Setup and Use with Tivoli Storage Manager 6.3
45/71
ProtecTier 3.1.8.0 Install/Setup and Use with Tivoli Storage Manager 6.3
46/71
ProtecTier 3.1.8.0 Install/Setup and Use with Tivoli Storage Manager 6.3
47/71
ProtecTier 3.1.8.0 Install/Setup and Use with Tivoli Storage Manager 6.3
48/71
ProtecTier 3.1.8.0 Install/Setup and Use with Tivoli Storage Manager 6.3
LUN Masking groups define the connection between the host initiators and the VT library devices (robots or
tape drives). Devices which belong to a certain group can be seen by the host initiators of the group. A device
can belong to multiple LUN Masking groups, but a host initiator can belong to only one LUN Masking group.
LUN Masking is used to monitor device visibility by allowing specific devices (such as tape drives or robots),
to be seen only by a select group of host initiators.
This feature allows users to assign specific drives to a specific host running backup application modules. It
enables multiple initiators to share the same target FC port without having conflicts on the devices being
emulated.
The LUN Masking setup can be monitored and modified at all times during system operation. LUN Masking in
ProtecTIER influences the visibility of the devices by the hosts systems. Keep in mind that every modification
in the LUN Masking in ProtecTIER may affect the host configuration and may require re-scanning by the
hosts.
By default LUN masking is disabled. Without LUN Masking each backup host will be limited to one front-end
port or over-exposed all other hosts virtual devices. When LUN masking is enabled, no LUNs are assigned to
any host. The user must create LUN groups and associate them with backup host(s).
- When defining backup hosts aliases use a practical naming scheme as opposed to just WW names
(example: hostname-FE0).
- With more than two backup hosts it is recommended to use LUN Masking to load balance VTL
performance across multiple front-end ports.
- LUN Masking is recommended for use to establish two or more front-end paths to a backup server for
redundancy.
The Lun masking has been done accordingly to a defined strategy, illustrated on chapter 11.1
Use the graphical menu to do so:
49/71
ProtecTier 3.1.8.0 Install/Setup and Use with Tivoli Storage Manager 6.3
The goal here is to select good host initators to have redundancy over the two fabrics, and performance using
at least 2 VTL Host initiators
WARNING: You must have information from the zoning team of which Host Adapter is zoned with which
Backup Server FC port. This will give you the WWN you have to associate within a LMG.
50/71
ProtecTier 3.1.8.0 Install/Setup and Use with Tivoli Storage Manager 6.3
PS: last backup adapter not displayed in this panel due to scroll bar.
Result is as follows:
51/71
ProtecTier 3.1.8.0 Install/Setup and Use with Tivoli Storage Manager 6.3
In our configuration, one virtual library (and all its virtual drives) is assigned to One LUN masking Group
On you backup server, use the /tsm/bin/chtape_VTL.ksh script if to rename the devices.
12. TSM
12.1. TSM Attachment description
The purpose here is to have the performance and the availability together
To do so, we have chosen the following attachment (coming from the Best Practice guide)
52/71
ProtecTier 3.1.8.0 Install/Setup and Use with Tivoli Storage Manager 6.3
shared=yes
tsm:
MOPB4TSMLC-42>define
path
MOPB4TSMLC-42
MOPB4VTL42-02
srct=server
destt=libr device=/dev/DYB4_Vsmc0
ANR1720I A path from MOPB4TSMLC-42 to MOPB4VTL42-02 has been defined.
53/71
ProtecTier 3.1.8.0 Install/Setup and Use with Tivoli Storage Manager 6.3
54/71
ProtecTier 3.1.8.0 Install/Setup and Use with Tivoli Storage Manager 6.3
To define the paths, use the script chtape_VTL.ksh , it will generate also the path information
Example:
File lstapexx is the result of the script.
55/71
ProtecTier 3.1.8.0 Install/Setup and Use with Tivoli Storage Manager 6.3
tsm: MOPB4TSMLC-42>q pr
679 LABEL LIBVOLUME ANR8805I Labeling volumes in library MOPB4VTL42-02; 2 volume(s) labeled.
tsm: MOPB4TSMLC-42>q libv
MOPB4VTL42-02 B42000L3
MOPB4VTL42-02 B42001L3
MOPB4VTL42-02 B42002L3
MOPB4VTL42-02 B42003L3
MOPB4VTL42-02 B42004L3
MOPB4VTL42-02 B42005L3
MOPB4VTL42-02 B42006L3
MOPB4VTL42-02 B42007L3
MOPB4VTL42-02 B42008L3
MOPB4VTL42-02 B42009L3
MOPB4VTL42-02 B42010L3
Scratch
Scratch
Scratch
Scratch
Scratch
Scratch
Scratch
Scratch
Scratch
Scratch
Scratch
1,026
1,027
1,028
1,029
1,030
1,031
1,032
1,033
1,034
1,035
1,036
LTO
LTO
LTO
LTO
LTO
LTO
LTO
LTO
LTO
LTO
LTO
56/71
ProtecTier 3.1.8.0 Install/Setup and Use with Tivoli Storage Manager 6.3
57/71
ProtecTier 3.1.8.0 Install/Setup and Use with Tivoli Storage Manager 6.3
Then test the function by sending a test mail, using the menu >
Notification
58/71
ProtecTier 3.1.8.0 Install/Setup and Use with Tivoli Storage Manager 6.3
59/71
ProtecTier 3.1.8.0 Install/Setup and Use with Tivoli Storage Manager 6.3
60/71
ProtecTier 3.1.8.0 Install/Setup and Use with Tivoli Storage Manager 6.3
61/71
ProtecTier 3.1.8.0 Install/Setup and Use with Tivoli Storage Manager 6.3
Copy the content of file /root/.ssh/id_rsa.pub to your destination box, append it as a line into the
USER_HOME_DIR/.ssh/authorized_keys file
- Test the connection (without password) using the command
PT_shell> ssh USER@targetbox ..
You can schedule this one time per week, using the crontab for instance.
[root@mopb4vtln141 pt_work]# crontab -l
00 12 * * * scp /pt_work/ProtecTier_*_full_*_Report.tar.gz ibm02woy@10.6.10.102:/tsm/drm/bkp_TS7650G/
Use 256K I/O for the virtual tape drives this provides the best factoring ratio.
62/71
ProtecTier 3.1.8.0 Install/Setup and Use with Tivoli Storage Manager 6.3
When using Windows based TSM servers, the Tivoli TSM tape and libraries for Windows must be used. Native
Windows drivers for the emulated P3000 and DLT7000 drives will not function.
Given that ProtecTIER acts as a virtual tape library as well as a data deduplication device, the advantages
associated with disk backup over tape backup apply here too. The following points should also be considered
when using ProtecTIER with IBM Tivoli Storage Manager:
ITSM disk pools: For some large environments with several IBM Tivoli Storage Manager servers in place,
you do not need to assign dedicated ITSM disk storage pool(s) to each server. With ProtecTIER, you can
either share a virtual library or you can create virtual libraries for every server.
LAN-free backups are easier: As ProtecTIER is a virtual tape library; it has the major advantage of
presenting greatly increased tape resources to the backup server. This then positions you to be able to
perform LAN-free backups to ProtecTIER without much regard to the limitations normally applied to these
backups, such as tape drive availability. If you have many LAN-free clients already, then it is possible your
LAN-free backup windows were dictated not entirely by business needs but also by hardware availability.
With ProtecTIER and its maximum of 256 virtual tape drives per ProtecTIER node, you can almost
completely eliminate any hardware restrictions you may have faced previously, and schedule your backups
as and when they are required by your business needs.
Data streams: You may be able to reduce your current backup window by taking full advantage of
ProtecTIER's throughput performance capabilities. If tape drive availability has been a limiting factor on
concurrent backup operations on your ITSM server, you can define a greater number of virtual drives and
reschedule backups to run at the same time to maximize the number of parallel tape operations possible on
ProtecTIER servers.
Note: If you choose to implement this strategy, you may need to increase the value of the MAXSESSIONS option on
your ITSM server.
Reclamation: You should continue to reclaim virtual storage pools that are resident on ProtecTIER. The
thresholds for reclamation may need some adjustment for a period until the system reaches steady state
(see , Steady state on page 29 for an explanation of this term). When this point is reached,the fluctuating
size of the virtual cartridges should stabilize and you can make a decision on what the fixed reclaim limit
ought to be.
63/71
ProtecTier 3.1.8.0 Install/Setup and Use with Tivoli Storage Manager 6.3
restrictions of physical cartridges normally associated with this feature (such as media and slot
consumption), you can enable the option quite safely.
Consider these points when determining how many virtual cartridges are to be created. Remember that
you can always create additional virtual cartridges at any time.
Physical tape: Depending on your data protection requirements, it may still be necessary to copy the deduplicated data to physical tape. This can be achieved by using standard ITSM copy storage pools that
have device classes directing data to physical libraries and drives.
17. Tips
64/71
ProtecTier 3.1.8.0 Install/Setup and Use with Tivoli Storage Manager 6.3
In addition please verify your cabling, if you mixed up the cables, e.g. for the WTI switch, this could also
end up in a fencing condition.
And do not forget that if the VTFD service is up and running but the GFS mount points are not available, the
system will be fenced, so check also your backend disk connectivity.
17.4. Log
At any time you can check the /var/log/messages log to see whats going on on the system.
17.5. Reboot
CAUTION:
If for any reason you have to reboot a node , use the command shutdown r now , and not reboot command !
17.6. How to clean an old repository configuration [to be done only per IBM
Support request]
If, for any reason, you made an installation on a not fresh disk backend you migh have following message
when creating the file system layout using fsCreate tool:
65/71
ProtecTier 3.1.8.0 Install/Setup and Use with Tivoli Storage Manager 6.3
If so, please check contact your local support team, they might ask you to look at your CD/DVD set which
came with the machines for the "mfg_cleanup" script,it is the LUN scratch tool without recreating the Arrays
on the disk subsystems.
66/71
ProtecTier 3.1.8.0 Install/Setup and Use with Tivoli Storage Manager 6.3
67/71
ProtecTier 3.1.8.0 Install/Setup and Use with Tivoli Storage Manager 6.3
17.10.
68/71
ProtecTier 3.1.8.0 Install/Setup and Use with Tivoli Storage Manager 6.3
69/71