Database Management using DB2 Tools

Transcription

1 IBM Software Group Database Management using DB2 Tools 2005 IBM Corporation

2 IBM DB2 Data Base Tools DB2 Data Base Tools Categories Database Administration Utility Management Performance Management Recovery Management Application Management Regulatory Compliance Information Integration Platforms System z Multiplatform (AIX, LINUX, Windows, HP-UX, Solaris) 2

3 Database Administration DB2 ADMINISTRATION TOOL DB2 OBJECT COMPARISON TOOL DB2 THREAD EXPERT Catalog Navigation Change Management Compare object structure in the same subsystem or across subsystems Generate APPLY jobs make the target look like the source Cancel threads on DB2 objects 3

4 DB2 ADMINISTRATION TOOL ISPF interface Supports DB2 z/os Supports DB2 V9 Catalog Navigation Change Management Complex Table Alters Migration 4

5 DB2 ADMINISTRATION TOOL Catalog Navigation Online help Primary / Line cmds Drill up/down Filtering Display detail info Extract DDL DDL GEN Explain SQL statements Generate / Execute IBM utilities Support DB2 V7 LISTDEF and TEMPLATE Issue DB2 Commands Browse data Drop Impact report Revoke Impact report Much, much more... 5

6 DB2 ADMINISTRATION TOOL Change Management MIG Migrate: Clone objects (DDL only, Data only, DDL and Data) Support global change capability MASK File ALC / AL Alter AL Make changes to an object which does not require the drop and recreation of the object ALC Alter Column Change column attributes (name, owner, data type, add / drop / move column, etc.) Change related objects view, index, etc. RDEF Redefine of tablespaces ADD / DROP / ROTATE partitions Convert non-partitioned to partitioned, non-segmented to segmented etc. 6

7 DB2 ADMINISTRATION TOOL Change Management Database Set of processes to manage changes to objects in a structured manner Store changed information in the Change Management Data Base (CMDB) Allow immediate and normal changes Allow collaborative change (virtual changes) Provides a change recovery capability Facilitates the moving of changes to other systems (promote / import) Allows for the reporting of changes (auditing) 7

8 DB2 ADMINISTRATION TOOL Change Management Process REGISTER a change ANALYZE the change Determines how to do the change RUN or implement the change RECOVER a change PROMOTE a set of changes IMPORT a set of changes 8

9 DB2 OBJECT COMPARISON TOOL ISPF interface Supports DB2 z/os Supports DB2 V9 Requires DB2 Administration Tool Compare structure of DB2 objects Reports Apply jobs make target look like the source 9

10 DB2 OBJECT COMPARISON COMPARE STRUCTURE OF DB2 OBJECTS DDL DB2 Catalog Flat file Versioning file Supports an ignore capability Supports a masking file Generate report(s) Generate JCL to make the target look like the source - APPLY JOBS Generate native JCL jobs or use Work Statement List Save the compare parameters in a file for recall (dialog) Ability to generate apply jobs against multiple targets 10

11 DB2 THREAD EXPERT ISPF or batch interface Supports DB2 z/os Supports DB2 V9 Cancel DB2 threads Audit Thread blocker 11

12 Why DB2 THREAD EXPERT? Prevent production batch job delay due to held resources by some thread in DB2. Prevent production job failure because of a DB2 thread was holding resources. Quickly and easily determine what threads were holding the resources and cancel them. Identify and cancel distributed applications holding connections to DB2. Terminate threads that are connected to a specific tablespace. Terminate threads from specific authorization ids or generic/mechanical authorization ids. 12

13 DB2 THREAD EXPERT Ability to display / terminate thread activity filtering criteria Specific objects (DB, TS, partition, TB, IX, VW, ALIAS, SYNONYM) Access type (read, update, all) Correlation id, Connection id and type Job name, program name, and ASID Plan, package, and collection ID DDF information, IP address, IP port, location Input masks supported (e.g., Database ABC*) Ability to cancel multiple threads Escalated cancel option issues the z/os Cancel command to terminate Batch job TSO user Started task Record audit information messages are logged in DB2 tables 13

14 DB2 THREAD EXPERT Thread Blocker Optional feature for batch interface Blocks new threads from forming on the DB2 objects for which you are canceling existing threads Changes the statuses of the DB2 objects to either RO (read only) or UT (utility access only). Ensures that a utility has exclusive access to the objects when it runs After the utility completes, the original statuses of the objects are restored. 14

15 Utility Management DB2 AUTOMATION TOOL Generate IBM utility JCL on an as needed basis - Exception DB2 STORAGE MANAGEMENT UTILITY (SMU) Manage DB2 space DB2 HIGH PERFORMANCE UNLOAD z/os or MP Goes directly against VSAM data sets Multiple output formats User exit to manipulate data DB2 UTILITY SUITE IBM utilities 15

16 DB2 AUTOMATION TOOL ISPF or batch interface Supports DB2 z/os Supports DB2 V9 Automate the generation of utility JCL on an as needed basis Disaster Recovery Auxiliary Functions Data Set Manager Data Page Display 16

17 DB2 AUTOMATION TOOL Product Architecture ISPF interface Object Profiles Profiles 1. Reusable 2. Support wildcarding 3. Support include / exclude 4 Export / Import Utility Profiles OPTIONAL Exception Profiles Disaster Recovery Profiles Job Profiles Save job in scheduler - evaluate statistics at time of execution to generate utility JCL Scheduler Build JOB OR Build JCL and store DB2 Catalog Automation Tool Statistics Repository Utility JCL 17

18 DB2 AUTOMATION TOOL - Utilities Utilities supported REORG (TS and IX) COPY Support for EMC and ESS devices (register in SYSCOPY) COPYTOCOPY RECOVER REPAIR RUNSTATS MODIFY QUIESCE 18

19 DB2 AUTOMATION TOOL Application Recovery BUILD RECOVER jobs for applications (multiple profiles) Store in PDS Catalog Recovery BUILD an application RECOVER profile that includes DSNDB01 DSNDB06 DLCDB Store in PDS Disaster Recovery Profiles PDS Primary Secondary DR SITE 19

20 DB2 AUTOMATION TOOL DR Profile Primary profile - Run once a day Includes Forcing a checkpoint Forcing the active log to archive Delete / redefine VCAT defined catalog spaces This job also builds JCL to Search the catalog and find all appropriate image copies Catalog the image copy data sets Copy the archive logs Rebuild the BSDS Secondary profile - Run periodically during the day The disaster recovery batch job that is produced Updates the archive log Backs up and rebuilds the BSDS. The PDS that contains the DR jobs and control records will contain the contents of the BSDS. This eliminates the need to mount tapes at the recovery site to build the BSDS. 20

21 DB2 AUTOMATION TOOL DATA SET MANAGER Review, evaluate, and relocate data sets Change the characteristics of the target Support for stogroup, user defined, and data set managed using SMS Move a user defined data set to a STOGROUP Move a user defined data set to the same VCAT or from one VCAT to a different VCAT Move a STOGROUP defined data set to a user defined VCAT Move a STOGROUP defined data set to the same STOGROUP or do a different STOGROUP DATA PAGE DISPLAY Analyze DB2 pages Edit pages to correct internal errors 21

22 DB2 STORAGE MANAGEMENT UTILITY (SMU) ISPF or batch interface Supports DB2 z/os Supports DB2 V9 Verify integrity DB2 table spaces and index spaces View information about your DASD space. 22

23 DB2 STORAGE MANAGEMENT UTILITY (SMU) Assist in tuning DB2 performance by providing space-related information, such as over-allocated data sets, data sets in extents, migrated data sets, and multivolume data sets Provide historical information for DASD trend analysis and capacity planning, including information about the number of data sets, number of extents, and the amount of space allocated compared to the amount of space that is used Generate batch jobs that can be run after prime hours which helps to reduce processing costs 23

24 DB2 STORAGE MANAGEMENT UTILITY (SMU) ISPF interface to display information by volume, database, or DB2 space, which makes it easy to understand DASD constraints Verify integrity of DB2 table spaces and index spaces Review space map pages Simplify the cleanup of nonexistent and forgotten DB2 objects View migrated data sets Identify orphan data sets Identify widows 24

25 DB2 HIGH PERFORMANCE UNLOAD ISPF or batch interface Supports DB2 z/os and multi-platform DB2 Supports DB2 V9 Unload utility Reads VSAM files directly 25

26 DB2 HIGH PERFORMANCE UNLOAD High Speed Unload Utility MP Supports all releases of DB2 Including DB2 V9 Supports multi-platform Runs outside of DB2 Unload from tablespace or image copy Support full SQL SELECT capability Supports sampling (unload every nth row) Multiple output formats DSNTIAUL Variable User defined Comma delimited Generate LOAD control statments User exit - inspect, modify, or discard rows Toleration of competitive unload products JCL Integrated ƒdb2 Administration Tool 26

27 Performance Management TIVOLI OMEGAMON XE for DB2 PERFORMANCE EXPERT TIVOLI OMEGAMON XE for DB2 PERFORMANCE MONITOR DB2 Performance Monitor Real time monitor DB2 connect monitoring Batch reporting DB2 Buffer Pool Analyzer tune BP s DB2 Performance Monitor Real time monitor DB2 connect monitoring Batch reporting DB2 BUFFER POOL ANALYZER DB2 QUERY MONITOR DB2 SQL PERFORMANCE ANALYZER DB2 OPTIMIZATION EXPERT Tune DB2 buffer pools DB2 SQL monitor static / dynamic SQL Enhanced explain tool Monitor and tune SQL statements in a work load 27

28 DB2 OPTIMIZATION EXPERT GUI Interface Requires DB2 z/os V9 Monitoring and tuning SQL statements running as part of a work load 28

29 DB2 OPTIMIZATION EXPERT Overview View query activity to find performance problems Quickly snap the cache Find what dynamic queries have been running Identify those which may be causing problems View query activity from a number of other sources DB2 Catalog Get expert tuning advice to improve SQL performance View the activity of groups of SQL statements to find performance problems Monitor the health of SQL processing Alert when problems develop or when more tuning activities are advised Monitoring profiles exception processing 29

30 DB2 OPTIMIZATION EXPERT Advisors Statistics Advisor recommends statistics to be updated or collected Generates RUNSTATS control cards Generates statistics beyond that of RUNSTATS ALL Query Advisor recommends ways to rewrite the SQL statements Index Advisor recommends new indexes to improve performance of a query CREATE INDEX statements can be generated Implement recommendations 30

31 Recovery Management UTILITY MGMT IBM APPLICATION RECOVERY for IMS and DB2 DB2 ARCHIVE LOG ACCELERATOR DB2 CHANGE ACCUMULATION TOOL DB2 LOG ANALYSIS DB2 OBJECT RESTORE DB2 RECOVERY EXPERT for z/os and MP DB2 AUTOMATION TOOL Synchronize DB2 & IMS databases Compress logs Able to get more logs on DASD Create SHRLEVEL REF IC AUDIT REDO / UNDO Recover dropped objects and their dependents PIT recovery Disaster Recovery Application Recovery 31

32 Application Management DB2 BIND MANAGER DB2 PATH CHECKER DB2 DATA ARCHIVE EXPERT DB2 TABLE EDITOR for z/os and MP DB2 TEST DATABASE GENERATOR for z/os and MP DATA QUANT DB2 WEB QUERY TOOL Bind avoidance DBRM checking Test / Compare / Report on access path Archive aged data Retrieval Edit DB2 data Generate test data Extract a subset of rows Graphical reporting tool Access DB2 data via a web interface 32

33 DB2 BIND MANAGER REDUCE APPLICATION MAINTENANCE EFFORTS Batch interface Supports DB2 z/os Supports DB2 V9 Bind avoidance DBRM checker ƒload library ƒdb2 Catalog 33

34 DB2 PATH CHECKER IDENTIFY ACCESS PATH CHANGES ISPF and Batch interface Supports DB2 z/os Supports DB2 V9 Integrates with DB2 SQL Performance Analyzer Report on access paths Determine the impact of doing a bind on an access path Before the bind After the bind 34

35 DB2 PATH CHECKER 3 Major Functions Report access path Compare access paths after bind Test DBRM's to identify potential access path changes without a bind MAKE command to make existing access path a hint EXPLAIN command Explain a DBRM without having to compare to a previous access path Populate a plan table without doing a BIND OPTION MATCHSQL - matches plan table rows based on SQL characteristics (rather than having to have a matching line number) Show new SQL statements 35

36 DB2 DATA ARCHIVE EXPERT Archive Aged Data ISPF interface Supports DB2 z/os Supports DB2 V9 Archive data Retrieve data 36

37 DB2 DATA ARCHIVE EXPERT Problem Inactive data costs you Increased concern of IT executives is how to manage complex enterprise databases that keep growing larger Expanding capacity is not always the most effective way to deal with growth Allowing databases to grow without bounds can affect bottom line by increasing costs in the following ways (each are studied in further detail): Performance Manageability Hardware and storage costs 37

38 DB2 DATA ARCHIVE EXPERT Solution Archiving is the process of moving inactive data to another storage location that can be located and accessed when necessary Archive specification Define multi-tiered archival approach Archive to tables Archive to files Ability to select data to be archived Supports deferred deletion from the source Captures information about the archival Can schedule archiving activity Supports system defined and application defined RI Supports hardware data compression 38

39 DB2 DATA ARCHIVE EXPERT Solution Retrieval is the process of bringing inactive data back to a set of tables when necessary Retrieval specification Selective retrieval Retrieve by version Supports the creation of target tables 39

40 DB2 DATA ARCHIVE EXPERT ARCHIVE AGED DATA Selective archival and retrieval Archive at the row level Supports application and system defined RI Supports hardware data compression 40

41 DB2 GROUPER Maintain sets of groupings Specify global relationships (nonenforced RI) Kick off dynamic (Units of work) relationship discoveries Specify input values to the group discovery process Group discovery scope (starting points) Boundary objects Additional relationships Launch the group discovery process Browse through the groupings Augment/Edit the groups GUI interface Used by DB2 Data Archive Expert, DB2 Test Data Base Generator, DB2 Recovery Expert 41

42 DB2 TEST DATABASE GENERATOR Sources ISPF interface Supports DB2 z/os and MP Supports DB2 V9 Target Transformations DB2 Tables (any platform) Recognize relationships Text Files (e.g. fixed, delimited, XML) Non-existent sources Mask & sensor sensitive data Restructure objects Filter Slice of related data Generate data from scratch SQL Direct to DB2 Tables (any platform) Text Files (e.g. fixed, delimited, XML) Load Format New or Existing 42

43 DB2 TEST DATABASE GENERATOR Transformation rules Static Values Source Column Values Data Lookup Data Masking Expressions Random Values Pattern Generation 43

44 DB2 TABLE EDITOR Edit DB2 Data Values ISPF and GUI interfaces Supports DB2 z/os and MP Supports DB2 V9 Integrated with DB2 Administration Tool DB2 Test Data Base Generator DB2 Web Query Tool DB2 Object Restore Edit DB2 data values 44

45 DB2 TABLE EDITOR EDIT DB2 DATA and/or APPLICATION GENERATION Editing Capabilities Toggle between edit and browse Freeze, Hide, Include/Exclude, Upper Case, Zoom, Count UNDO command for inserts and deletes Execute INSERT, DELETE, COPY, REPEAT, UNDO on blocks of dataelect column order for display Row at a time mode Change, Repeat Change, Change All, Find, Repeat Find... Application Development - GUI Includes drag and drop application building Native TCP/IP connectivity Linked forms Button to execute SQL 45

46 IBM DATA QUANT GRAPHICAL REPORTING TOOL GUI Interface Supports DB2 z/os and MP Supports DB2 and Informix Supports DB2 V7, V8 and V9 Comprehensive query reporting and data visualization platform for both web and work station environments Provides SOA infrastructure, allowing enterprises to share specific BI content/data with partners over secure Internet/Intranet connections 46

47 IBM DATA QUANT Rapid deployment of executive dashboards, information portals, and interactive data visualization solutions Drag and drop development of OLAP analytics, SQL queries, tabular reports, graphical reports, pivot tables, and data analysis views Dozens of charts, controls, and graphical primitives to visual reports Ability to bury sub-queries Full compatibility with QMF infrastructure and objects > 100 built in mathematical and analytical functions available in dashboard and visual solutions and in printed reports Rich security improved over that used for QMF for Windows Single sign-on Ability to restrict to a list of authorized objects 47

48 IBM DATA QUANT Dashboard / Interactive Visualization 48

49 DB2 WEB QUERY TOOL ACCESS DB2 DATA VIA A WEB INTERFACE Web interface Supports DB2 z/os and MP Supports DB2 V9 Integrated with DB2 Table Editor DB2 SQL Performance Analyzer Create and run SQL queries against DB2 data bases via a web browser View or export results for use in other applications 49

50 DB2 WEB QUERY TOOL Extensive support for DB2 server platforms ƒos/390 & z/os, iseries, AIX, Linux, HP-UX, Solaris, Windows Global data access for any user QMF like Web interface Uses DB2 security Access, create, share and execute SQL queries through browsers Create adhoc queries Store queries for access by other users Browse stored queries by name Supports stored procedures and LOB's Copy, convert, and compare data Download results.txt or.csv file for spreadsheets or other tools Export results as XML or XSL Import table data from XML files results Works with Netscape and Microsoft Explorer 50

51 Regulatory Compliance IBM Encryption for IMS and DB2 Data Bases DB2 Audit Management Expert Encrypt sensitive data at the IMS segment level or the DB2 row level Crypto hardware feature DB2 auditing for Auditors APPL MGMT DB2 Test Data Base Generator DB2 Data Archive Expert Transform sensitive data Archive aged data used in conjunction with DB2 Audit Management Expert 51

52 Regulatory and Compliance Considerations Health Insurance Portability and Accountability Act (HIPAA) Gramm-Leach-Bliley Financial Services Modernization Act (GLBA) Sarbanes Oxley (SOX) European Union Data Protection Directive (EUPA) International IT Security Standard (ISO 17799) 52

53 IBM ENCRYPTION for IMS and DB2 Databases Supports DB2 z/os Supports DB2 V9 Data encryption 53

54 IBM ENCRYPTION for IMS and DB2 Databases User customized, pre-coded exits IMS Segment DB2 row Data encryption on disk Data on channel is encrypted (protects against channel/network sniffers) Data in buffers is not encrypted Exploits zseries and S/390 Crypto Hardware features, which results in low overhead encryption/decryption Uses the ANSI Data Encryption Algorithm (DEA), also known as the U.S. National Institute of Science and Technology (NIST) Data Encryption Standard (DES) algorithm 54

55 DB2 AUDIT MANAGEMENT EXPERT GUI Interface Supports DB2 z/os Supports DB2 V9 Automated DB2 Auditing for Auditors 55

56 DB2 AUDIT MANAGEMENT EXPERT Features Collects and correlates information from DB2 resources. Audit Trace Data, Log Analysis data Provides a central resource for auditors to produce a coherent view of DB2 access information. Auditors will be able to Access: SELECT, INSERT, UPDATE, and DELETE activity by user or by object. CREATE, ALTER, and DROP operations against an audited object Utility access to an audited object DB2 commands entered Assignment or modification of an authorization ID Provides auditors with flexible options for examining the data in the audit repository. 56

57 DB2 AUDIT MANAGEMENT EXPERT Data Collection Capabilities Collection Profiles can be defined for the recording of audit data Data collection can be filtered based on any combination of: DB2 objects DB2 user IDs Applications connecting to DB2 Time Collection Profiles can be shared Exported/Imported using XML files to other AME servers, or assigned to another DB2 system within the same AME server Allows for filters created for common tables (such as SAP) to be created once and then used at other DB2 servers where the same application tables are installed 57

58 DB2 AUDIT MANAGEMENT EXPERT Comprehensive Reporting Facilities Robust reporting options enable auditors to view and report on data in a variety of ways Auditors can view audit data from several perspectives: Overview View all of the subsystems currently being monitored Subsystem - View activity for a selected subsystem Detail - View details for a particular type of activity for a selected subsystem Viewing filters by User, Object, Plan Graphical or Tabular Thresholds can be set to flag data that may need further investigation 58

59 Information Integration Websphere Replication Server for z/os SQL Replication Q Replication Websphere Data Event Publisher for z/os Publish DB2 Websphere Classic Data Event Publisher Websphere Classic Federation Server Websphere Classic Replication Server Publish IMS Publish VSAM Publish IDMS Publish ADABAS Access DB2 / IMS / VSAM Access Adabas Access CA-Datacom Access CA- IDMS Replicate IMS Replicate VSAM Replicate CA-IDMS Replicate Adabas 59

60 IBM DB2 Data Base Tools DATABASE ADMINISTRATION DB2 Administration Tool DB2 Object Comparison Tool DB2 Thread Expert IBM Data Encryption for IMS and DB2 Databases UTILITIES MANAGEMENT DB2 Automation Tool DB2 Storage Management Utility (SMU) DB2 High Performance Unload (Multi-Platform & z/os) DB2 Utility Suite 60

61 IBM DB2 Data Base Tools PERFORMANCE MANAGEMENT Tivoli Omegamon XE for DB2 Performance Expert Tivoli Omegamon XE for DB2 Performance Monitor DB2 Performance Expert (Multi-Platform) DB2 Buffer Pool Analyzer DB2 Query Monitor DB2 SQL Performance Analyzer DB2 Optimization Expert 61

62 IBM DB2 Data Base Tools RECOVERY MANAGEMENT DB2 Archive Log Accelerator DB2 Change Accumulation Tool DB2 Log Analysis Tool DB2 Object Restore DB2 Recovery Expert (Multi-Platform & z/os) IBM Application Recover for IMS and DB2 DB2 Automation Tool Part of Utility Management 62

63 IBM DB2 Data Base Tools APPLICATION MANAGEMENT DB2 Bind Manager DB2 Path Checker DB2 Data Archive Expert (Multi-Platform & z/os) DB2 Test Data Base Generator (Multi-Platform & z/os) DB2 Table Editor (Multi-Platform & z/os) IBM Data Quant (Multi-Platform & z/os) DB2 Web Query Tool (Multi-Platform & z/os) 63

64 IBM DB2 Data Base Tools REGULATORY COMPLIANCE IBM Encryption for IMS & DB2 Data Bases DB2 Audit Management Expert DB2 Test Data Base Generator Part of Application Management DB2 Data Archive Expert INFORMATION INTEGRATION Websphere Replication Server for z/os Websphere Classic Replication Server Websphere Data Event Publisher for z/os Websphere Classic Data Event Publisher Websphere Classic Federation Server 64