TSM V7.1 : Understanding TSM Deduplication Flashcards

1
Q

Is there a TSM license fee for deduplication?

A

No, it is an optional feature

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

Which functionality is incompatible with dedup? (name 6)

A
  • client side encryption (SSL, data-in-flight ok though)
  • LAN-free backup with client side (server side ok though)
  • simultaneous write
  • subfile backup
  • UNIX HSM (server side dedup ok though)
  • advice: no Client-side compression with server side dedup! (client side dedup with client side compression ok)
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

What type of dedup should you use when the network bandwith between client-server is constrained?

A

client side dedup

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

What is the advantage of client side dedup in terms of workload?

A

The workload can be distributed over several clients

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

when should server side dedup be considered as opposed to client side dedup (3X)?

A
  • when you need the fastest possible backup times
  • when you need the shortest possible window for copying dedup storage pools to offsite copypools
  • when cpu resources on client side inadequate
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

when is a dedup appliance preferrable over TSM dedup? (3X)

A
  • if you backup up mostly very large files (>2TB)
  • if you choose not to add multiple TSM server instances
  • if your daily backup exceeds 20TB (30TB Clientside dedup)
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

How can you determine how much storage you saved using dedup? (2X)

A
  • tsm>query stgpool f=d

* special script via …/support/docview….

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

what is the correct order to ensure the fastest restore (in general)?

1) deduplicated stgpool
2) non-deduplicated stgpool
3) tape storage pool

A

2,1,3 (usually, can differ)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

what reduction ratio’s can typically be achieved with dedup?

A

2:1 (50%) to 15:1 (93%) depending on type of data (unique or highly repetitive)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

what reduction ratio for dedup for storagepools should you use for planning purposes ?

A

3:1 (maybe 4:1)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

what is the additional size for dedup required for the TSM database when the amount of total backup data (that will go to a dedup pool) is 50TB?

A

0,5 TB (1 %) additional size

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

what types of Client store data are suitable for deduplication (4X)

A

backup, archive HSM data (server side only), API

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

the duplicates of the original pattern are replaced by a hash value of how many bytes?

A

20 bytes

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

What is an alternative to TSM client side dedup for LANfree backups (backups over SAN)?

A

VTL

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

Dedup storage pools are which device class ?

A

FILE device class only (sequential-access disk)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

what type of storage pools in the storage pool hierarchy can be a deduplication pool?
(3X)

A

primary, copy and active-data stgpools

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
17
Q

is HSM supported for client side deduplication?

A

no

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
18
Q

server side dedup identification takes place on the server , after the data arrives in the dedup backup storage pool. When does the actual reduction of data take place?Explain!

A

The data is backed up into the dedup storage pool. Then the identify duplicate processes that run regularly on the server, identify the duplicates. It is only after a reclamation or move data process that the data is in fact reduced. The reduction occurs when the data moves to another volume within the storage pool. [remember this is a sequential storage pool]

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
19
Q

How is the algorithm to identify duplicates different from server to client?

A

it is not, it is the same algorithm.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
20
Q

When is the data deduplicated when doing client side dedup?

A

in-line during backup

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
21
Q

where is the data deduplicated when doing client side dedup?

A

on the client itself.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
22
Q

Which three requirements must exist for client deduplication to be more scalable than server side dedup?

A
  • sufficient CPU resources on the client;
  • TSM database on fast disk & high network bandwith with low latency;
  • the server has the ability to run more parallel client sessions than “identify duplicate” sessions
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
23
Q

Which 2 types of TSM Clients benefit from a deduplication cache ? [as to client side dedup]

A

backup archive clients & VMWare clients (note: when concurrent pref a cache-per-session) .

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
24
Q

for which type of client is a deduplication cache not recommended and why? [as to client side dedup] ?

A

TSM API clients (cache may get out of sync)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
25
Q

What is the function of a deduplication cache? [client side dedup]

A

To maintain a local list of already identified duplicates. This way the client does not have to go to the server to find out. [although this entails very little traffic].

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
26
Q

Does the deduplication cache always result in faster backup times?

A

No,if the database is on fast disk and the network bandwith is high with low latency, disabling the cache may be wise.

27
Q

Mention 5 TSM features that are incompatible with client side dedup.

A
  • encryption
  • UNIX HSM client
  • subfile backup
  • simultaneneous storage pool write
  • Lan-free /Storage agent
28
Q

Which 2 parameters for storage pool definition enable deduplication?

A

-device class “ FILE & deduplication setting is enabled :

tsm>define stgpool MYPOOL FILE … deduplicate=yes

29
Q

3 extra settings/requirements to enable client side dedup (in addition to dedup stgpool settings on server side) …

A

1) tsm>register node/update node DEDUPNODE…dedup=clientorserver ….
2) client options file (dsm.opt): DEDUPLICATION YES
3) files must be bound to mgmt class that has dedup stg pool as its destination.

30
Q

How can I exclude files from deduplication (client side)

A

-client options file: exclude.dedup option

31
Q

From which TSM client + server version onwards is both client and server side dedup supported?

A

both client and server V6.2.0 or later !

32
Q

How is it that the usage of deduplication can reduce TSM license software costs?

A

For capacity based pricing, capacity is calculated after the deduplication has occurred, so that reduces the cost.

33
Q

What are the recommended limitations for dedup ( per server instance) as to maximum amount of backup data and daily ingest of data?

A

max amount of backup data is 400TB, daily ingest less than 30 TB.

34
Q

What are things to consider when using tape storage pools in a dedup environment?

A

Configuration with dedup should preferrably be to a dedup pool only or a dedupdiskpool-to dedupdiskpool configuration.However if tape is needed for disaster recovery purposes, make sure that you copy the data out of the primary pool before the dedup takes place (e.g before reclamation), that way the data does not need to be reconstructed before it is copied to tape.

35
Q

Dedup requires the TSM database & active log to be configured on what type of disk?

A

Low latency, High performance disk!

typically SAS/FC or SSD/Flash

36
Q

Minimal amount of CPU cores for dedup?

A

12 CPU cores (may get up to 32 CPU cores with maximum load)

37
Q

minumal amount of RAM for dedup?

A

64 GB of RAM (may getup to 192 GB with maximum load)

38
Q

how is dedup useful in combination with node replication?

A

for disaster recovery purposes, accross various geographically dispersed sites

39
Q

Explain the “identify duplicates” process on the server:

  • where is it configured?
  • when is it started?
  • how can I influence the amount of processes that run?
A

1)Configuration is at dedup storage pool definition:
tsm>define stgpool DEDUPPOOL ….IDENTIFYPROCESS=[0-50] [0: turn off the auto-start of identification processes].
2) auto started at server start if so specified in stgpool definition.
3) influence by using the manual command: IDENTIFY DUPLICATES

40
Q

If I were to copy data from a server side dedup storage pool to a non-dedup copy pool, when would I do that and why?

A

before the physical dedup takes place (before reclamation). Otherwise the data would have to be reconstructed in order to copy it and that would take up a long time.

41
Q

How can I enforce server side dedup to take place after the backup to a copy stg pool?

A
optionsetting: deduprequiresbackup.
[can be changed dynamically by using SETOPT]
[default setting : yes]
setting in dsmserv.opt:
deduprequiresbackup yes
42
Q

3 options for disaster recovery in combination with deduplication:

A

1) disk to tape (dedup to non-dedup: careful planning)
2) disk to disk (dedup to dedup; data remains in primary pool until it expires)
3) node replication to 2nd server (incremental, only unique data (dedupped) )

43
Q

Why is it not needed to empty the primary diskpool now that dedup is being used?

A

The amount of diskspace is significantly reduced in the primary diskpool because of dedup. It can remain there until it expires (in theory)

44
Q

What kind of data does not dedup well (2)?

A

unique binary files and encrypted data (exclude them from the mgmt class)

45
Q

When not to consider dedup? (2)

A
  • when VTL or tape is your storage location

- when the backup window is already constrained

46
Q

What is the general purpose of deduplication?

A

to limit the amount of (primary) disk storage needed for backup.

47
Q

what is the active log and how much space should you plan for it when dedup is used?

A

The active log maintans info about transactions that are in progress. Plan for it to be its maximal size: 128GB

48
Q

What is the archive log and how should you size it for dedup?

A

The archive log maintains info about old transactions. It is emptied after a full database backup. It can grow very large.
Plan for 500GB filesystem space for daily ingests of 4TB: 1 TB filesystem.

49
Q

What is the calculation that needs to be made for the size of the primary dedup storage pool when server-side dedup is in effect?

A

It must be able to maintain enough free capacity to receive the complete daily ingest of data + maintaining the dedupped data for the amount of time in the retention policies + some uplift (30% after dedup)

50
Q

How is the daily ingest of data calculated?

A

The total amount of data on the clients X the change rate (because of progressive incremental backup).

51
Q

What kind of disk configuration is required for TSM database and logs?

A

separate LUNS for TSM database and logs. No sharing with any other TSM storage pools or any other data file
-spread disk i/o across as many disk controllers as possible.

52
Q

Can server-side dedup and client side dedup be configured in 1 TSM server instance?

A

Yes, TSM is designed to allow dedup storage pools to handle both types of dedupped data. TSM is optimized to not perform server side dedup on client-side dedupped data. Objects are recognized by both types of dedup, even if they were dedupped “ by the other side”

53
Q

How to get the most storage savings out of client side dedup?

A

use compression.

54
Q

How can client-side dedup put a significant workload on the server?

A

with many clients simultaneous asking for the processsing of duplicate chunks.

55
Q

If you are using Lan Free backup what type of deduplication should you consider (server or client)?

A

Only server-side dedup (client side not supported)

56
Q

At what level is deduplication enabled in TSM?

A

storage pool level

57
Q

Does TSM identify duplicates across storage pools?

A

no

58
Q

What is the advantage of using 1 large TSM dedup storage pool vs many smaller ones?

A

Duplicates are not identified across storage pools.

59
Q

What considerations should be made regarding devclass definition for the dedup storage pools?

A
  • high mountlimit
  • maxcapacity of volumes 50GB
  • directories should represent separate filesystems on separate logical volumes on as many possible separate disks.
60
Q

What has proven to be most efficient in stgpool definition: use of scratch volumes or simple pre-allocated volume only?

A

use of scratch volumes, use the MAXSCRATCH parameter

61
Q

What is the preferred method of duplicate identification: scheduled or automatic?

A

scheduled. Therefore set the IDENTIFYPROCESS parameter (in DEFINE STG) to 0.

62
Q

How is automatic storage pool reclamation prevented?

A

set the RECLAIM parameter to 100 (in define stgpool)

63
Q

Example of policy setting:

A
define domain DEDUPDISK
> define policy DEDUPDISK POLICY1
> define mgmtclass DEDUPDISK POLICY1 STANDARD
> assign defmgmtclass DEDUPDISK POLICY1 STANDARD
> define copygroup DEDUPDISK POLICY1 STANDARD type=backup destination=DEDUPPOOL
VEREXISTS=nolimit VERDELETED=10 RETEXTRA=30 RETONLY=80
> define copygroup DEDUPDISK POLICY1 STANDARD type=archive destination=DEDUPPOOL
RETVER=30
> activate policyset DEDUPDISK POLICY1