Db2 12 A new spin on a successful database

Transcription

1 Phil Grainger Principal Enablement Manager BMC Software Db2 12 A new spin on a successful database

2 Management Performance Administration So What's new with Performance Performance Management Db2 12? Availability Scalability Changes for Applications Continuous Delivery Security Utilities How do we get there?

3 Db by the Numbers 7 new and 2 changed built in functions 2 new and 1 changed stored procedure 12 new and 44 changed catalog tables

4 Performance

5 Performance Better Use of Storage Contiguous bufferpools Improvement on PGSTEAL NONE Automatic overflow area Save up to 8% CPU In-Memory Indexes Index Fast Traverse Block Faster traversal of index pages Storage area separate from bufferpools Usage managed by Db2 In-Memory Indexes -DISPLAY STATS IFCIDs 389 and 477 Exclude indexes if needed SYSINDEXCONTROL catalog table Up to 23% CPU reduction for index lookup From IBM material

6 Performance New Insert Algorithm Insert Algorithm 2 Up to 20% CPU reduction Over 1 million inserts per second As always, the new Db2 performs better than the old one

7 Performance Overview OLTP & Query * OLTP 2%-3% CPU reduction 5%-10% increase with Index FTB Contiguous bufferpools can improve this further * Data from IBM Material Query 0-20% CPU reduction with older access paths 10%-40% reduction with new access paths 90% CPU reduction is possible

8 Performance Management Changes

9 Dynamic SQL Stability Advanced Plan Management & Predictable Performance Bring advantages of Static SQL bind to dynamic SQL Allows dynamic SQL access paths to be retained in the catalog Can explain and free stabilized plans New SQL matched against stabilized plans before prepare/execute Access path can be read into cache from catalog

10 Static SQL Stability Continued improvements Bind Replace of same version does not change Last Used Free original or previous Optional free if invalid Rebind Switch to original Avoid accidental switch to invalid copy

11 RUNSTATS Improvements Mainly around Profiles Inline stats now support RUNSTATS profiles Optimizer can automatically update profiles Statement cache invalidations CLUSTERRATIO calculation improvements

12 Changes for Applications

13 SQL Changes Overview of selected SQL changes Unicode columns in EBCDIC tables Piecewise delete Inclusive-Inclusive for business and bitemporal Global variable extensions Procedural SQL enhancements

14 SQL Changes Piecewise Delete DELETE FROM (SELECT * FROM mytab WHERE.. FETCH FIRST 5000 ROWS ONLY) Allows interspersed COMMITs in large URs

15 Merge Support & SQL Pagination Changes Merge Support Multiple matched clauses Additional predicate support Delete support Signal and ignore allowed Simpler SQL Pagination Data Dependent Or Numeric based SELECT * FROM emp_tab WHERE (LASTNAME, FIRSTNAME) > ( GRAINGER, PHILIP ) -or- SELECT * FROM emp_tab OFFSET 23 ROWS FETCH FIRST 23 ROWS ONLY

16 More SQL Changes JDBC/ODBC Type 2 performance improvements ODBC driver support for TIMESTAMP with TIMEZONE Preserve cached SQL after ROLLBACK Increased maximum tables in View, UDF New built-in functions HEX2BIN, MEDIAN, HASH, GENERATE_UNIQUE (with length parm)

17 Scalability

18 System Scaling Changes Enhanced efficiency with high numbers of CPs 41% cpu and contention reduction on log latch EDMPOOL skeleton and DBD scalability improvements Total bufferpool limit is now 16TB Up to 1TB partition size Up to 4PB table size (and not finished yet) 256(ish) TRILLION rows per table space Active log datasets 4GB increased to 768GB Exploitation of z13 decompression enhancements Including LOB compression

19 Partition Limits Room for further growth NEW! UTS PBR RPN Relative Page Number Pages are numbered per partition Eliminates inverse relationship between number of partitions and individual partition size 7 byte RID (2 for partition, 5 for page number) Start of partition level attributes

20 PBR RPN Zparm for system default DDL PAGENUM absolute relative DSSIZE Increase is immediate DSSIZE Decrease is a pending alter 20

21 Availability

22 Online Schema Enhancements Insert Partition Index Compression Pending Alters from Immediate More DROP Avoidance

23 Security

24 Security Changes Transfer of ownership Installation/Migration without SYSDADM Unload privilege Long and CaMeL based DBRM names

25 Utilities

26 Utilities Reorg Load Load Reorg fails if FLASH fails PGB overflow & partition pruning Support for COMPRESSRATIO 17% more ziip offload Mapping Table changes RO Objects Reorg Better Load Replace partition with DUMMY Parallel load for SHRLEVEL CHANGE 90% additional ziip offload Preformatting for AUX tablespaces Maintain MAXASSIGNEDVAL for identity columns LOAD RESUME SHRLEVEL NONE BACKOUT YES avoids RECP on failure

27 Utilities Recovery PIT recovery support for some PBG alters Skip PIT recovery for unchanged objects Runstats Load/Reorg inline stats Invalidatecache Colgroup performance improvements Improved Load/Reorg concurrency DSNACCOX DSNUTILV with CLOBs

28 How do we get to Db2 12? Migration from Db2 11 ONLY

29 Migration Requirements Continuous Delivery Changes Single Phase Migration Requirements DFSMS v2.1 z/os v2.1+ RACF v2.1 Db2 11 NFM z196 machine or higher Pre-Requisites Db2 11 with fallback SPEs BSDS supporting 10-byte RBAs No pre Db2 10 bound packages Basic row format is deprecated

30 Continuous Delivery

31 Continuous Delivery Function Levels BNFA ( CM ) is now function level 100 (FL100 or M100) Activate function level 500 (V12R1M500) to get new Db2 12 function Was ANFA aka NFM Activate function level (V12R1Mnnn) to get newer functions as appropriate Display group will tell us where we are and where we have been. Test option for activate Can (un)activate backwards

32 Continuous Delivery Function Levels Db2 11 Db2 12

33 New Function Levels

34 FL501 - LISTAGG Produces a list of all values in a group Optional separator argument can be provided Ordering can also be specified for the items within the group 34

35 FL502 Encryption Key Labels in DDL DB2 11 and Db2 12 FL100 both support encrypted datasets FL502 introduces KEY LABEL syntax to create/alter objects Including STOGROUPs Use KEY LABEL <label> to indicate encryption is desired NO KEY LABEL indicates no encryption Standard utilities can be used to add/remove encryption Utility work datasets can also be encrypted via SMS Encryption can be specified at PART level for PBR tablespaces ENCRYPTION_KEYLABEL dsnzparm controls catalog/directory/archive log encryption 35

36 FL502 Explicit Numeric Casting Cast an explicit numeric value to a graphic string value SMALLINT, INTEGER, BIGINT, DECIMAL, REAL, DOUBLE, FLOAT, and DECFLOAT are all supported Optional decimal separator character can be specified This support is similar to the existing support for numeric input to the CHAR and VARCHAR built-in functions The result is Unicode (UTF-16), and the context must support Unicode data 36

37 FL503 Support for Db2 AI IBM Db2 AI for z/os leverages machine learning technology to empower the Db2 for z/os optimizer to determine the best-performing query access paths, based on your workload 37

38 FL503 Temporal Auditing System Temporal historical queries COULD return incomplete data Due to NULL values in the audit DATA CHANGE OPERATION column Queries about the past would exclude these nulls FL503 fixes this anomaly 38

39 FL503 Temporal Replication A new built-in global variable, SYSIBMADM.REPLICATION_OVERRIDE Default is N Applications not allowed to specify values for row-begin, row-end, transaction-start-id, and generated expression Temporal history for system temporal data is enabled Alternate Y Applications are allowed to specify values for row-begin, row-end, transaction-start-id, and generated expression Temporal history for a system temporal data is disabled Y allows replication of temporal data, as if it were regular Db2 data Intended for use by replication tools not intended for general use 39

40 FL503 CL/FL Messaging New console message DSNG014I Issued whenever the function level or catalog level changes DSNG014I member-name DB2 NEW CATALOG FUNCTION LEVEL (new-level) DB2 CATALOG LEVEL (catalog-level) CURRENT FUNCTION LEVEL (activated-level) Remember the SYSIBM.SYSLEVELUPDATES catalog table has the full story 40

41 FL504 Huffman Compression Compression of Db2 data with hardware-based encoding (Huffman) With the IBM z14 Compression Coprocessor (CMPSC). Huffman compression is only available for data in universal table spaces 41

42 FL504 Prevent creation of deprecated objects Prevent creation of certain deprecated objects SQL statement in packages that are bound with APPLCOMPAT(V12R1M504) or higher, or with comparable SQL options in effect, are prevented from creating deprecated objects: Synonyms Segmented or Classic Partitioned tablespaces Hash tables 42

43 FL504 Many New Built-In Functions Support for the passthrough-only built-in functions These are passed to the IBM Db2 Analytics Accelerator CUME_DIST CUME_DIST (aggregate) FIRST_VALUE LAG LAST_VALUE LEAD NTH_VALUE NTILE PERCENT_RANK PERCENT_RANK (aggregate) RATIO_TO_REPORT REGEXP_COUNT REGEXP_INSTR REGEXP_LIKE REGEXP_REPLACE REGEXP_SUBSTR 43

44 FL504 New SQL alternatives for special registers and NULL predicates New syntax alternatives to simplify porting of applications from other platforms For example, support is introduced in Db2 for z/os for the following alternative syntax for referencing existing special registers 44

45 The Future Performance and Administration of worlds best server Some preparation for future changes Continued relaxation of limits Even more growth? Continuous Delivery. Allied items, like IDAA on z

46 Questions?