An Introduction to z/os DASD Backup and Archiving

Transcription

1 An Introduction to z/os DASD Backup and Archiving Session Steve Pryor DTS Software, Inc.

2 Storage Management Objectives Data Availability Data available even if logically/physically damaged Dataset Backup and Recover/Restore Space Availability Sufficient free space for new/extended datasets Dataset Migrate/Archive and Recall

3 Backup vs. Archive/Migration Backup Short term (usually) Multiple copies Vault offsite Archive Long term (years) 1 or 2 copies Recycle needed

4 Storage Hierarchy High Cost Limited Resource High Data Availability Primary DASD (Migration Level 0) Auto storage tiering Most frequently used Compressed Data (Migration Level 1) Low Cost Unlimited Resource Low Data Availability Archived Data (Migration Level 2) Least frequently used

5 Dataset Life Cycle Dataset Creation Open/Extend/Close Backup / Restore Migrate / Recall Expiration and Deletion

6 Backup and Restore Management When do backups run? Daily? Weekly? >1 per day? What data is backed up? Updated data? All data? Selected data? How long is the backup retained? How can the backup be found? How is the backup restored? Overlay existing dataset? New volume?, Rename?

7 DFSMS Manages Storage SMS Constructs Dataset Characteristics Data Manager Data Class What services? PAV?, striped? Storage Class Dataset Mgmt Class What backups are needed? When should it migrate? application data sets Storage Group Data Mover What volume should be chosen? Backups Archives

8 Important SMS Constructs Management Class Storage Group data sets Expiration Attributes Migration Attributes Partial Release GDG generations Backup Attributes Transition Criteria ABARS Attributes Auto mig/bkup/dump dump class/system Alloc/migr threshold VOLSERs

9 Fields used by DASD Managers z/os Catalog VTOC SYS1. VVDS. volser Format-1 DSCB - DSN - dataset-changed (DS1IND02) - last-referenced date - backup info VVR or NVR - DSN / cluster name / components - Dataclas, Storclas, Mgmtclas name

10 Major DASD Management Vendors IBM Data Manager DFSMShsm IDP Data Manager FDRABR Data Mover DFSMSdss Data Mover FDR/FDRDSF CA CA-DISK

11 DFSMShsm Backup Process Select if updated Select if MC requires Turn off Change bit DFSMShsm Create bkup/ dump copy(s) Automatic Backup or BACKVOL or BACKDS Dataset info BCDS Bkup vol info OCDS Journal SMS SG Attributes or DFSMShsm Non-SMS Attributes PRIMARY BACKUP DUMP MIGRATION

12 DFSMShsm Backup Process Types of Backup Automatic Incremental Backup Automatic Dump Command Backup / Command Dump Other Inline Backup ABARS Backup Fast Replication Backup

13 DFSMShsm Backup Automatic Incremental Backup DEFINE BACKUP(YYYYYYN CYCLESTARTDATE(yyyy/mm/dd)) SETSYS AUTOBACKUPSTART(starttime latest quiesce) SETSYS BACKUP(DASD TAPE) SETSYS DUPLEX(BACKUP(Y N)) SETSYS MAXBACKUPTASKS(n) Automatic Dump DEFINE DUMPCYCLE(NNNNNNY CYCLESTARTDATE(yyyy/mm/dd)) SETSYS AUTODUMPSTART(starttime latest quiesce) SETSYS MAXDUMPTASKS(n) DEFINE DUMPCLASS(name...RETPD UNIT FREQ et al)

14 DFSMShsm Backup Command Backup (H)BACKDS dsn TARGET NEWNAME RETAINDAYS et al Command Dump BACKVOL VOLUMES(volser) DUMP(DUMPCLASS(class)) RETPD(days) BACKVOL STORAGEGROUP(sgname) DUMP(DUMPCLASS(class) STACK(nn))

15 DFSMShsm - Locating the Backup Obtain Info from BCDS, MCDS, OCDS TSO HLIST command DFSMShsm LIST command ISMF HLIST LIST DSNAME(dsn) MCDS/BCDS/BOTH - LIST(ODS(dsn)/SYSOUT/TERMINAL)

16 Recover (Restore) from Backup (H)RECOVER command DTS001 ACS routines replace existing dataset new or renamed dataset DFSMShsm obtain dataset info Mount bkup copy BCDS obtain vol info OCDS Journal DTS002 z/os Catalog Turn ON change bit Set LRdate

17 DFSMShsm Recovery Process Types of Recovery Dataset recovery from incremental (H)RECOVER dsn TOVOLUME(volser) UNIT(unit) REPLACE... Full volume restore from incremental RECOVER * TOVOLUME(original_volser) UNIT(unittype) - FROMDUMP(DUMPVOLUME(tape_volser) APPLYINCREMENTAL) Full volume restore from dump copy RECOVER * TOVOLUME(volser) UNIT(unittype) Other ABARS, Fast Replication Recovery

18 DFSMShsm Backup Expiration EXPIREBV Command Scan BCDS BCDS Obtain MC info Is backup expired? is dataset deleted? remove BCD record SMS Constructs (H)BDELETE Command Delete backup version of dataset

19 FDRABR Backup Process Select if updated Select unless MC forbids FDRABR (FDRDSF) // EXEC PGM=FDRABR DUMP TYPE=FDR / ABR Bkup vol info Turn off Change bit Update DSCB bkup info Create bkup copy(s) ABR Backup Catalog SMS SG Attributes and/or ABR Model DSCB

20 FDRABR Backup Process Types of Backup Incremental DUMP TYPE=ABR MOUNT VOL=, STORGRP= Full-Volume DUMP TYPE=FDR MOUNT VOL=, STORGRP= Other Dataset (TYPE=DSF, TYPE=AUTO) Application (TYPE=APPL)

21 FDRABR Backup Architecture Backup DSN=FDRABR.VDTS001.C VTOC DTS001 DSN=MY.DATA.SET Dataset Backup Info: -cycle table, flags, et al DSN=FDRABR.VTSO001 Volume Backup Info: -GEN, CYCLE, et al FDRABR Backup Catalog Tape Volume Info: Bkup DSN, fseq, expiration

22 FDRABR Locating the Backup Backup Information stored in: Dataset F1DSCB (dataset exists) ABR Scratch Catalog (dataset deleted) ABR Backup Catalog (tape volume info) PGM=FDRABRP, PRINT BACKUP function PGM=FDREPORT ISPF panels

23 FDRABR Recovery Process Obtain bkup info from F1DSCB DTS001 replace existing dataset FDRABR (FDRDSF) // EXEC PGM=FDRABR RESTORE TYPE=ABR SELECT DSN=, NEWN=... ACS Routines new or renamed dataset Mount bkup tape Obtain tape vol info Obtain bkup info if no F1DSCB DTS002 ABR Backup Catalog ABR Scratch Catalog z/os Catalog

24 FDRABR Backup Expiration All datasets on backup file expire together Tape expiration via: EXPDT/RETPD in JCL (date or catalog control) ABR model if no JCL value Same day as full vol for incremental Explicit expiration processing not required

25 Dataset Life Cycle Dataset Creation Open/Extend/Close Backup / Restore Migrate / Recall Expiration and Deletion

26 Migration and Recall Management How often to migrate? What data should be migrated? Which volumes? How old? What criteria? How long is the migrated copy retained? How is the data recalled? Explicit recall? Recall by reference?

27 DFSMShsm Migration Process z/os Catalog MIGRAT DFSMShsm Automatic Primary Space Mgmt or Command Migration Select if MC requires Delete dataset Dataset info Create migr copy(s) MCDS tape vol info OCDS Journal SMS SG Attributes or DFSMShsm Non-SMS Attributes PRIMARY BACKUP DUMP MIGRATION ML1 / SDSP Automatic Secondary Space Mgmt or Command Migration

28 DFSMShsm Space Management Space Management Functions Migrate, extent reduction, release, expire Automatic Primary Space Management Automatic Secondary Space Management Command Space Management Other Interval migration On-demand migration Fast Subsequent Migration

29 DFSMShsm Space Management Space Management Windows and Settings DEFINE PRIMARYSPMGMTCYCLE (YYYYYYY CYCLESTARTDATE(YYYY/MM/DD)) SETSYS PRIMARYSPACEMANAGEMENTSTART(hhmm hhmm) SETSYS MAXMIGRATIONTASKS(nn) SETSYS MAXEXTENTS(nn) SETSYS SECONDARYSPACEMANAGEMENTCYCLE (YYYYYYY) CYCLESTARTDATE(yyyy/mm/dd)) SETSYS SECONDARYSPMGMTSTART(hhmm) SETSYS MAXSSMTASKS (CLEANUP(2) TAPEMOVEMENT(1)) SETSYS SMALLDATASETPACKING(KB(110)) Space Management Commands HMIGRATE dsn ML2 MIGRATE DSN/VOLUME DELETE dsn

30 Locating the Migration Copy DFSMShsm H(LIST) dsn MCDS FDRABR PGM=FDRABRP, PRINT ARCHIVE ISPF panels FDREPORT

31 Automatic Recall DFSMShsm and FDRABR z/os Catalog MY.DATA.SET MIGRAT MCDS/ACF Determine if migrated DTS001 Obtain migr info IGG026DU DFSMShsm FDRABR front-end SVC 26 //DD1 DD DSN=MY.DATA.SET... Dataset is referred to. Catalog LOCATE requests volser Correct volume returned MY.DATA.SET TAP001 DFSMShsm / FDRABR attached Dataset restored And recatalogued TAP001 DTS001 MY.DATA.SET

32 FDRABR Archive Process z/os Catalog MIGRAT FDRABR // EXEC PGM=FDRABR DUMP TYPE=ARC, ADAYS= MOUNT VOLG=, STORGRP= Select if ABR requires Delete dataset Dataset info Create migr copy(s) Archive Control File tape vol info SMS SG Attributes or ABR Model DSCB

33 FDRABR Selection Criteria SMS Selection Criteria Management Class Migration Attributes Management Class Expiration Attributes optional FDRABR Selection Criteria ADAYS, IFNOTCAT, EXPIRED, MAXGDG, DSN

34 FDRABR Selection Criteria SMS Selection Criteria Management Class Migration Attributes Management Class Expiration Attributes optional FDRABR Selection Criteria ADAYS, IFNOTCAT, EXPIRED, MAXGDG, DSN

35 FDRABR Space Management Migration Deletion DUMP TYPE=ARC DUMP TYPE=SCR

36 FDRABR Archive Expiration All datasets on archive file expire together (usually) Tape expiration via: EXPDT/RETPD in JCL (date or catalog control) RETPD in SYSIN FDROPT default Archive Control File expiration Usually = tape expiration Unless SMSEXPIRE=YES

37 DFSMShsm vs. FDRABR DEFINE / SETSYS BCDS MCDS OCDS Functions, Commands (H)LIST FDROPT / SYSIN ABR Catlg/DSCB/Model Archive Control File ABR Catalog PGM=, SYSIN FDREPORT/FDRABRP

38 More Topics... Management of non-sms data Disk-to-Disk Data Movement Volume Defragmentation Flashcopy and FDRINSTANT CDS Backup, ACF Maintenance, Recycle Application Backup and ABARS Report Writing Serialization, Security, Standalone restore and much more...

39 Further Reading and Documentation IBM z/os DFSMShsm Primer DFSMShsm Storage Administration Reference ENTS?SHELF=DGT2BKB0&DN=SC &DT= FDR System User's Guide, C & F Guides ftp://ftp.fdrinnovation.com/public/manuals/

40 Questions? x162 Share Technology Exchange Booth Verity Systems, Inc FDR Training and Advice