DB2 9 for z/os Overview LSU 2009

Transcription

1 DB 9 for z/os Overview LSU 009

2 Brief DB History V9 V. V. V. V. V. Sequential Prefetch Referential Integrity Explain Sequential Detection V. Packages V Parallel IO Hiperspaces Data Sharing T Indexes Stored Procedures CPU Parallel Online Reorg TCPIP Sysplex Parallelism Universal Database Triggers UDF UDT LOBs Data Spaces GUI Tools Store Proc Language Rexx 6 bit Availability Performance SQL SQL Enhancements Stats History Utility Wildcards VLDB New Workloads Unicode Long Names V V V6 V7 V8 Native XML Autonomics Security Admin Adaptability Growth Porting Native SQL Procedures More 6 bit Scaling DDF New/Improved Data Types Breakthroughs 007

3 DB 9 for z/os Addressing Corporate Data Goals SOA Enablement Dynamic Warehousing Simplification, Reduced TCO Workload Consolidation purexml Optimistic locking for WebSphere LOB performance, usability Many SQL improvements Dynamic index ANDing Histogram statistics New built-in OLAP expressions Optimization Service Center Index compression Partition By Growth tables Cloned tables Volume based backup / recovery More online schema changes Online REBUILD INDEX Trusted context and ROLEs Parallel Sysplex clustering improvements

4 XML Capabilities Inside the Engine Performance, Performance, Performance CLIENT Data Management Client Customer Client Application SQL(X) Relational Interface XML Interface SERVER DB Server Relational Storage XML Storage Native storage Schema Index Functions Utilities

5 DB 9 for z/os Performance Improvements CPU reductions in utilities: LOAD, REORG, Online REORG with no BUILD phase LOB performance, function, scalability SQL and optimization improvements, inserts Use ziip more Remote native SQL Procedure Language Increased parallel work Improved varying length performance Sequential disk access

6 Most consumable DB 9 improvements CM very little to no action: Utility CPU reductions Logging improvements Improved index page split Larger prefetch, write & preformat quantities LOB performance DDF VSCR Optimization Service Center, Opt. Expert, & Data Studio Changed online REORG Improved RUNSTATS Optimization improvements, EDMPOOL VSCR NFM LOB lock avoidance Reordered row format Index: larger page sizes, compression, index on expression 6

7 DB 9 z9, z890 & z990 performance plan example scenario CPU - -6 V8 V9 CM V9 NFM V9 Use Utilities DB design adjustments Histogram statistics Index improvements REBIND application changes DSNZPARMS native SQL procedures SQL adjustments Your situation will vary. Less CPU is better. z800 and z900 expect +% to +0% CPU 7

8 SQL: Productivity, DB family & porting XML MERGE & TRUNCATE SELECT FROM UPDATE, DELETE, MERGE INSTEAD OF TRIGGER BIGINT, VARBINARY, BINARY, DECIMAL FLOAT Native SQL Procedure Language Nested compound Optimistic locking LOB File reference variable & FETCH CONTINUE FETCH FIRST & ORDER BY in subselect and fullselect INTERSECT & EXCEPT ROLE & trusted context Many new built-in functions, caseless comparisons Index on expression Improved DDL consistency CURRENT SCHEMA 8

9 DB SQL z z/os V8 common luw Linux, Unix & Windows V8. z c o m m o n Multi-row INSERT, FETCH & multi-row cursor UPDATE, Dynamic Scrollable Cursors, GET DIAGNOSTICS, Enhanced UNICODE for SQL, join across encoding schemes, IS NOT DISTINCT FROM, Session variables, range partitioning Inner and Outer Joins, Table Expressions, Subqueries, GROUP BY, Complex Correlation, Global Temporary Tables, CASE, 00+ Built-in Functions including SQL/XML, Limited Fetch, Insensitive Scroll Cursors, UNION Everywhere, MIN/MAX Single Index Support, Self Referencing Updates with Subqueries, Sort Avoidance for ORDER BY, and Row Expressions, M Statement Length, GROUP BY Expression, Sequences, Scalar Fullselect, Materialized Query Tables, Common Table Expressions, Recursive SQL, CURRENT PACKAGE PATH, VOLATILE Tables, Star Join Sparse Index, Qualified Column names, Multiple DISTINCT clauses, ON COMMIT DROP, Transparent ROWID Column, Call from trigger, statement isolation, FOR READ ONLY KEEP UPDATE LOCKS, SET CURRENT SCHEMA, Client special registers, long SQL object names, SELECT from INSERT l u w Updateable UNION in Views, ORDER BY/FETCH FIRST in subselects & table expressions, GROUPING SETS, ROLLUP, CUBE, INSTEAD OF TRIGGER, EXCEPT, INTERSECT, 6 Builtin Functions, MERGE, Native SQL Procedure Language, SET CURRENT ISOLATION, BIGINT data type, file reference variables, SELECT FROM UPDATE or DELETE, multi-site join, MDC 9

10 DB SQL z z/os 9 common luw Linux, Unix & Windows 9 New cross-platform SQL Reference on web now z c o m m o n l u w Multi-row INSERT, FETCH & multi-row cursor UPDATE, Dynamic Scrollable Cursors, GET DIAGNOSTICS, Enhanced UNICODE for SQL, join across encoding schemes, IS NOT DISTINCT FROM, Session variables, TRUNCATE, DECIMAL FLOAT, VARBINARY, optimistic locking, FETCH CONTINUE, ROLE, MERGE, SELECT from MERGE Inner and Outer Joins, Table Expressions, Subqueries, GROUP BY, Complex Correlation, Global Temporary Tables, CASE, 00+ Built-in Functions including SQL/XML, Limited Fetch, Insensitive Scroll Cursors, UNION Everywhere, MIN/MAX Single Index Support, Self Referencing Updates with Subqueries, Sort Avoidance for ORDER BY, and Row Expressions, M Statement Length, GROUP BY Expression, Sequences, Scalar Fullselect, Materialized Query Tables, Common Table Expressions, Recursive SQL, CURRENT PACKAGE PATH, VOLATILE Tables, Star Join Sparse Index, Qualified Column names, Multiple DISTINCT clauses, ON COMMIT DROP, Transparent ROWID Column, Call from trigger, statement isolation, FOR READ ONLY KEEP UPDATE LOCKS, SET CURRENT SCHEMA, Client special registers, long SQL object names, SELECT from INSERT, UPDATE or DELETE, INSTEAD OF TRIGGER, Native SQL Procedure Language, BIGINT, file reference variables, XML, FETCH FIRST & ORDER BY in subselect and fullselect, caseless comparisons, INTERSECT, EXCEPT, not logged tables, range partitioning, compression Updateable UNION in Views, GROUPING SETS, ROLLUP, CUBE, 6 Built-in Functions, SET CURRENT ISOLATION, multi-site join, MERGE, MDC, XQuery 0

11 Business Partners: Many enhancements!" #!$% # &' ( & ()!*+,%-,),%.!!" +)/$ $-#0% $$- &%%- %%( -(',- +%$0% &$0$.+) %-( + +, $(.++ -()(& 6-&(7 7)%% '((&%+)(+% (7 -((7 )))+(.,.(7 ' )+. $! % $ 0'&').+ 00! -(%) %)78#9:;#9<*# -(,) %(-(!*! +( ((( -+0 0)&.+ )%%-= (! $9 $ 9 $ $$( ( $ $!%$ $ -'%-'!! -- "-!*) >%0% $ 0!$?!$? +% $ 0;- %!-)).,$-%! -(% = %&&%.+- 6-) 0 0%- TCO Reduction Continuous Availability Performance Scalability SQL Portability

12 DB 9 Availability & Scalability Improvements New features enhance availability & scalability of the DB 9 environment to manage your 7x infrastructure easily New and improved DB capabilities Improved INSERT performance New universal table space Partition by growth Not logged table space Online schema change enhancements Clone tables Data sharing enhancements More online utilities Online Reorg enhancements Online Check Data, Check LOB Online Rebuild Index Memory improvements 6 bit++ UK government Land Registry runs DB for z/os to maintain the world s largest known transaction processing (OLTP) database. TB! - Winter Corporation s 00 Top Ten awards -

13 DB 9 Easier Application Development Simplify development process Improve performance Numerous SQL enhancements Merge / Truncate Select from update, delete & merge Instead of triggers BIGINT & DECIMAL FLOAT New Built-in functions e.g. SOUNDEX DDL porting improvements Optimistic locking Developer Workbench Spatial or geographic data Text Search server included Native SQL Stored Procedures

14 Optimize Infrastructure, Skills & Cost SAP Certified on DB 9 for z/os July 007 Enables growth of System z9 SAP workloads through resource optimization Enhancements in DB for z/os, along with the new ziip processor, will increase total value for our System z clients. We look forward to certifying DB for z/os as it becomes available so our clients may benefit from these new values and the unique System z qualities of service. Dr. Torsten Wittkugel, Vice President DB/OS Platform Development, SAP AG

15 Dynamic Warehousing A New Approach to Leveraging Information to Optimize Real-Time Processes Dynamic Warehousing to Understand Why and Recommend Future Action to Understand What Happened Dynamic Warehousing Requires:. Real-time access in context Traditional Data. Analytics as part of a business process Warehousing. Unstructured information extracted knowledge. Extended capabilities tightly integrated

16 Dynamic Warehousing with System z Mission-critical analysis of operational data Rapid and secure user-access to data analysis Interactive executive dashboards & information portals Improved query and reporting optimizations Parallel queries & SQL Procedures may run on ziip Improved SQL & optimization Up to 0% reduction of storage for indexes Index compression added to data compression Up to 0% reduction of CPU utilization Across many queries & most utilities InfoSphere Warehouse on System z 6

17 Reduced TCO and Administration Requirements DB 9 further reduces cost of ownership and System z-specific skill needs Improved productivity with increased consistency with DB family and other relational databases Cost reductions through processing reductions, use of ziip, disk compression and improved memory use IDC: Since 000, Labor Costs Have Exceeded the Cost of All Servers and are Still Growing Spending (USB$) $00 $80 $60 $0 $0 $00 $80 $60 $0 $0 $0 New server 00 spending (USM$) % CAGR Installed Base (M Units) Cost of mgmt. & admin. 0% CAGR Decreasing cost of IT? After consolidating SAP & DB on System z, IT expenses as a percentage of sales decreased from over % of sales to.9%! 0 0 7

18 System z & DB 9 = Synergy System z9 & z0 Integrated Information Processor (ziip) Enterprise Class & Business Class Enhanced Cryptography Channels ( Gb, MIDAW & AMP) Faster Processors Up to 6 Processors EC More memory, better value; 6 bit virtual storage z/architecture, new machines, new instructions Parallel Sysplex IPv6 SSL Java Decimal float Backup & restore Security Unicode collation Compression System z Application Assist Processor (zaap) WLM enhanced 8

19 IBM z0 EC Continues the CMOS Mainframe Heritage GHz. GHz MHz MHz 0 MHz 0 MHz 770 MHz. GHz.7 GHz G 998 G 999 G6 000 z z z9 EC 008 z0 EC G - st full-custom CMOS S/90 G - IEEE-standard BFP; branch target prediction G6 Copper Technology (Cu BEOL) z900 - Full 6-bit z/architecture z990 - Superscalar CISC pipeline z9 EC - System level scaling z0 EC Architectural extensions 9

20 IBM System z0 Benefits for DB Faster CPUs, more CPUs, more memory 0% more n-way performance on average 6% more uniprocessor performance 70% more server capacity (6->6 CPUs) Up to 6 CPUs, z/os.9 needed for 6-way in a single lpar Up to. TB, z/os.8 needed for >6G in a single lpar Infiniband Coupling Facility links New OSA-Express, 0 GbE for faster remote apps HiperDispatch Hardware Decimal Floating Point facility MB page size (DB X plans to exploit) 0+ instructions added to improve compiled code efficiency (DB X plans to use) 0

21 z/os.0 Benefits for DB Extended Addressing Volumes up to GB/volume VSAM data sets only at first (enabled for DB database objects) Needs appropriate DS8000 ucode, DB apars on V8 / DB 9 Additional XML use of zaap and ziip z/os XML performance enhancements WLM enhancements for lower priority lock holders to boost priority when higher priority waiters (DB X plans to exploit) TCP/IP performance enhancements HiperSockets Multiple Write Facility for better performance for bigger message sizes (like DRDA) Hash DSAB for better Open/Close performance Basic Hyperswap to remove DASD controller as a single point of failure ziip assisted Global Mirroring (XRC) Planned rollback to z/os.7 Planned rollback to z/os.9

22 IBM Data Studio A Consistent, Integrated Solution Application Developer Develop Coding Debugging Teaming Testing Tuning Database Developer Develop Other Deploy Database Administrator Manage Database Administration Data Management Change Management Recovery Management Storage Management Performance Management Design Logical Modeling Physical Modeling Integration Modeling Design Common User IBM Interface Manage Govern Security Access Security Analysis Data Auditing Data Archiving Data Masking Data Encryption Business Analyst Database Architect Govern Security Administrator

23 Online Schema Evolution Database Definition On Demand Online reorganization with no BUILD phase Fast replacement of one table with another Table space that can add partitions, for growth Improve ability to rebuild an index online Rename column and index Modify early code without requiring an IPL Alter table space and index logging Create & alter STOGROUP SMS constructs Alter column set default

24 Why Migrate to DB 9 for z/os? Business needs to save money Reduce CPU time & disk space Improve business agility Service Oriented Architecture Application developers need PureXML for a powerful SQL and XML interface to XML data Powerful new SQL enhancements Portability with SQL and data definition compatibility Database Administrators need Improve availability and performance More flexible security and easier regulatory compliance Better web application & data warehouse function and performance LOB function, performance, usability

25 DB 9 in IBM Redbooks Publications. DB 9 Technical Overview SG-70. DB 9 Performance Topics SG-77. DB 9 Stored Procedures SG-760. Index Compression with DB 9 for z/os redp. SQL Reference for Cross-Platform Development 6. Enterprise Database Warehouse, SG TB Data Warehouse on System z, SG DB 9 Optimization Service Center SG-7 9. LOBs with DB for z/os SG Deploying SOA Solutions SG-766. Enhancing SAP - DB 9 SG-79. SAP Application on Linux z SG-687. Best practices SAP BI - DB 9 SG Data Sharing in a Nutshell, SG-7. Securing DB & MLS z/os SG Data Sharing: Distributed Load Balancing & Fault Tolerant Configuration redp9 7. Considerations on Small & Large Packages redp 8. Backup and Recovery Considerations redp 9. Powering SOA with IBM Data Servers SG Packages Revisited, SG Data Studio V. Web Services redp0

26 Main DB for z/os Web Page ibm.com/software/dbzos Technical resources Events Support V8, DB 9 Developer Domain DB Magazine ziip Tools 6

27 Data Studio 7

28 ziip ibm.com/systems/z/ziip/ II9 II86 II087 8

29 INTERSECT/EXCEPT R R R R R R INTERSECT EXCEPT UNION subselect (fullselect) UNION EXCEPT INTERSECT DISTINCT ALL subselect (fullselect) 9

30 0 Example EXCEPT, INTERSECT (DISTINCT) (DISTINCT) (DISTINCT) INTERSECT INTERSECT ALL EXCEPT EXCEPT ALL UNION UNION ALL R R

31 Example EXCEPT, INTERSECT (DISTINCT) (DISTINCT) (DISTINCT) INTERSECT INTERSECT ALL EXCEPT EXCEPT ALL UNION UNION ALL R R

32 Example EXCEPT, INTERSECT (DISTINCT) (DISTINCT) (DISTINCT) INTERSECT INTERSECT ALL EXCEPT EXCEPT ALL UNION UNION ALL R R

33 Example EXCEPT, INTERSECT (DISTINCT) (DISTINCT) (DISTINCT) INTERSECT INTERSECT ALL EXCEPT EXCEPT ALL UNION UNION ALL R R

34 Example EXCEPT, INTERSECT (DISTINCT) (DISTINCT) (DISTINCT) INTERSECT INTERSECT ALL EXCEPT EXCEPT ALL UNION UNION ALL R R

35 Example EXCEPT, INTERSECT (DISTINCT) (DISTINCT) (DISTINCT) INTERSECT INTERSECT ALL EXCEPT EXCEPT ALL UNION UNION ALL R R

36 INSTEAD OF TRIGGERS CREATE TABLE WEATHER (CITY VARCHAR(), TEMPF DECIMAL(,)) CREATE VIEW CELCIUS_WEATHER (CITY, TEMPC) AS SELECT CITY, (TEMPF-)*.00/9.00 FROM WEATHER CREATE TRIGGER CW_INSERT INSTEAD OF INSERT ON CELCIUS_WEATHER REFERENCING NEW AS NEWCW DEFAULTS NULL FOR EACH ROW MODE DBSQL INSERT INTO WEATHER VALUES (NEWCW.CITY, 9.00/.00*NEWCW.TEMPC+) CREATE TRIGGER CW_UPDATE INSTEAD OF UPDATE ON CELCIUS_WEATHER REFERENCING NEW AS NEWCW OLD AS OLDCW DEFAULTS NULL FOR EACH ROW MODE DBSQL UPDATE WEATHER AS W SET W.CITY = NEWCW.CITY, W.TEMPF = 9.00/.00*NEWCW.TEMPC+ WHERE W.CITY = OLDCW.CITY 6

37 MERGE Upsert A combination of insert and update, MERGE is a single SQL operation Single row or multi-row If a row matches the ON condition it is updated, Otherwise it is inserted.! "#"!$ %$&$ '& ()*#"()*+"!$ %$&$ ()*"" %%,-%'. 7

38 Example - MERGE T.id T.balance S.id 0 S.amt MERGE INTO account AS T USING VALUES (:hv_id, :hv_amt) FOR ROWS AS S(id,amt) ON T.id = S.id WHEN MATCHED THEN UPDATE SET balance = T.balance + S.amt WHEN NOT MATCHED THEN INSERT (id, balance) VALUES (S.id, S.amt) NOT ATOMIC CONTINUE ON SQLEXCEPTION

39 Example - MERGE T.id T.balance S.id 0 S.amt MERGE INTO account AS T USING VALUES (:hv_id, :hv_amt) FOR ROWS AS S(id,amt) ON T.id = S.id WHEN MATCHED THEN UPDATE SET balance = T.balance + S.amt WHEN NOT MATCHED THEN INSERT (id, balance) VALUES (S.id, S.amt) NOT ATOMIC CONTINUE ON SQLEXCEPTION

40 Example - MERGE T.id T.balance S.id 0 S.amt MERGE INTO account AS T USING VALUES (:hv_id, :hv_amt) FOR ROWS AS S(id,amt) ON T.id = S.id WHEN MATCHED THEN UPDATE SET balance = T.balance + S.amt WHEN NOT MATCHED THEN INSERT (id, balance) VALUES (S.id, S.amt) NOT ATOMIC CONTINUE ON SQLEXCEPTION

41 Example - MERGE T.id T.balance S.id 0 S.amt MERGE INTO account AS T USING VALUES (:hv_id, :hv_amt) FOR ROWS AS S(id,amt) ON T.id = S.id WHEN MATCHED THEN UPDATE SET balance = T.balance + S.amt WHEN NOT MATCHED THEN INSERT (id, balance) VALUES (S.id, S.amt) NOT ATOMIC CONTINUE ON SQLEXCEPTION

42 Example - MERGE T.id T.balance S.id 0 S.amt MERGE INTO account AS T USING VALUES (:hv_id, :hv_amt) FOR ROWS AS S(id,amt) ON T.id = S.id WHEN MATCHED THEN UPDATE SET balance = T.balance + S.amt WHEN NOT MATCHED THEN INSERT (id, balance) VALUES (S.id, S.amt) NOT ATOMIC CONTINUE ON SQLEXCEPTION

43 Example - MERGE T.id T.balance S.id 0 S.amt MERGE INTO account AS T USING VALUES (:hv_id, :hv_amt) FOR ROWS AS S(id,amt) ON T.id = S.id WHEN MATCHED THEN UPDATE SET balance = T.balance + S.amt WHEN NOT MATCHED THEN INSERT (id, balance) VALUES (S.id, S.amt) NOT ATOMIC CONTINUE ON SQLEXCEPTION

44 Example - MERGE T.id T.balance S.id 0 S.amt MERGE INTO account AS T USING VALUES (:hv_id, :hv_amt) FOR ROWS AS S(id,amt) ON T.id = S.id WHEN MATCHED THEN UPDATE SET balance = T.balance + S.amt WHEN NOT MATCHED THEN INSERT (id, balance) VALUES (S.id, S.amt) NOT ATOMIC CONTINUE ON SQLEXCEPTION

45 Example - MERGE T.id T.balance S.id 0 S.amt MERGE INTO account AS T USING VALUES (:hv_id, :hv_amt) FOR ROWS AS S(id,amt) ON T.id = S.id WHEN MATCHED THEN UPDATE SET balance = T.balance + S.amt WHEN NOT MATCHED THEN INSERT (id, balance) VALUES (S.id, S.amt) NOT ATOMIC CONTINUE ON SQLEXCEPTION

46 Example - MERGE T.id T.balance S.id 0 S.amt MERGE INTO account AS T USING VALUES (:hv_id, :hv_amt) FOR ROWS AS S(id,amt) ON T.id = S.id WHEN MATCHED THEN UPDATE SET balance = T.balance + S.amt WHEN NOT MATCHED THEN INSERT (id, balance) VALUES (S.id, S.amt) NOT ATOMIC CONTINUE ON SQLEXCEPTION

47 Example - MERGE T.id T.balance S.id 0 S.amt MERGE INTO account AS T USING VALUES (:hv_id, :hv_amt) FOR ROWS AS S(id,amt) ON T.id = S.id WHEN MATCHED THEN UPDATE SET balance = T.balance + S.amt WHEN NOT MATCHED THEN INSERT (id, balance) VALUES (S.id, S.amt) NOT ATOMIC CONTINUE ON SQLEXCEPTION

48 8

49 Important Disclaimer $ $0 $$ $ $ $$ 00!? A $ $ $!! $ $ 00 $ $ $@ 9