<Insert Picture Here> Migrating to Oracle 11.2 for LoZ Performance upgrade

Transcription

1 1

2 <Insert Picture Here> Migrating to Oracle 11.2 for LoZ Performance upgrade Thomas Niewel Principal Sales Consultant Oracle Deutschland BV & CO KG

3 Agenda Oracle for Linux on System z Overview Oracle 11g Some interesting features Testing applications accessing Oracle

4 Oracle for 11.2 Linux on System z Previous version of the Oracle database on that platform was Current version is

5 System z configuration examples VM Guest 1 VM Guest 2 VM Guest 3 VM Guest n Virtual machines VM-Guests Linux for z VM 1 VM 60 VM n z/vm Operating System Logical partitions LPAR 1 LPAR LPAR s Basic Mode Hardware 5

6 Hipersockets Example in a z/os client environment LPAR 1 Oracle for Linux on z LPAR 2 z/os Application running under z/os Oracle Hipersockets 6

7 Agenda Oracle for Linux on System z Overview Oracle 11g Some interesting features Testing applications accessing Oracle

8 Some interesting Oracle 11g features Result Cache Faster results with help of Result Cache SQL Plan Management Minimize the risks of execution plan changes SQL Performance Analyzer Helps to compare the effects of changes Compression Saves disk space and improves performance Automatic SQL Tuning Automated tuning of SQL statements 8

9 Result Cache Concept: Dedicated cache in shared pool No installation necessary Automatic refresh if data changes Easy setup and monitoring Useful for SQL-queries PL/SQL-functions Use cases: Known queries and applications like DWH applications, reporting, etc. 9

10 Easy to use Enabled by init parameter RESULT_CACHE_MODE If RESULT_CACHE_MODE=MANUAL => Hint has to be used SELECT /*+ result_cache */ count(*) FROM sales If set to RESULT_CACHE_MODE=FORCE => Hint is automatically added to root select SELECT count(*) FROM sales... 10

11 Result Cache Settings RESULT_CACHE_MAX_RESULT 5 (%) RESULT_CACHE_MAX_SIZE depending on OS RESULT_CACHE_MODE MANUAL/FORCE RESULT_CACHE_REMOTE_EXPIRATION 0 (min) RESULT_CACHE_MAX_SIZE: specifies the maximum amount of SGA memory (in bytes) that can be used by the Result Cache RESULT_CACHE_MAX_RESULT: specifies the percentage of RESULT_CACHE_MAX_SIZE that any single result can use RESULT_CACHE_REMOTE_EXPIRATION: specifies the number of minutes that a result using a remote object is allowed to remain valid 11

12 Monitoring SQL> SELECT /*+ result_cache */ COUNT(*), SUM(salary) FROM hr.bigemp group by department_id ORDER BY department_id; Id Operation Name Rows Bytes Cost (%CPU) Time SELECT STATEMENT (2) 00:00:34 1 RESULT CACHE 91myw5c1bud0mcn64g3d0ykdhm 2 SORT GROUP BY (2) 00:00:34 3 TABLE ACCESS FULL BIGEMP 876K 4280K 2201 (1) 00:00:34 Statistics recursive calls 0 db block gets 0 consistent gets 0 physical reads 0 redo size 696 bytes sent via SQL*Net to client 419 bytes received via SQL*Net from client 2 SQL*Net roundtrips to/from client 0 sorts (memory) 0 sorts (disk) 12 rows processed 12

13 Monitoring SQL> SELECT name, type, row_count, status, invalidations, scan_count 2 FROM v$result_cache_objects; NAME TYPE ROW_COUNT INVALIDATIONS SCAN_COUNT HR.GET_DATUM Dependency SCOTT.EMP Dependency HR.BIGEMP Dependency SELECT /*+ result_ca Result che */ COUNT(*), SUM(salary) FROM hr.bigemp group by department_id OR DER BY department 13

14 Some interesting Oracle 11g features Result Cache Faster results with help of Result Cache SQL Plan Management Minimize the risks of execution plan changes SQL Performance Analyzer Helps to compare the effects of changes Compression Saves disk space and improves performance Automatic SQL Tuning Automated tuning of SQL statements 14

15 SQL Plan Management Is useful in case of Software upgrades Application changes If SQL execution plans should be controlled / frozen 15

16 SQL plan management Solution before 11g: Use of Hints? Manipulation of statistics? Use of stored outlines? 11g Structured SQL plan development Concept Statement Logging SQL Plan SQL Plan Baselines 16

17 SQL Plan Management Prerequisite: Plan management ist activated After the 1st Parse => Entry in statement log After the 2nd Parse => Entry in plan history and mark as SQL plan baseline If changes occur: Re-parsing of the statement Execution plan has changed => Plan baseline is used and the new execution plan is marked for verifcation 17

18 Administration Capture of SQL Plan baselines: OPTIMIZER_CAPTURE_SQL_PLAN_BASELINES=TRUE/FALS E Export or import Use of SQL tuning set or cursor cache Use of existing SQL Plan baselines: OPTIMIZER_USE_SQL_PLAN_BASELINES=TRUE/FALSE Evolve of existing baselines Enterprise Manager Package 18

19 Monitoring: SQL Plan Management execution plan Execution Plan Plan hash value: Id Operation Name Rows Bytes Cost (%CPU) Time SELECT STATEMENT (1) 00:01:13 1 SORT AGGREGATE 1 7 * 2 TABLE ACCESS FULL DOC (1) 00:01: Predicate Information (identified by operation id): filter("ort" LIKE 'Frankfurt%') Note SQL plan baseline "SYS_SQL_PLAN_bb53c5913fe9c83b" used for this statement 19

20 Monitoring: SQL Plan Management EM: Server => SQL Plan Control 20

21 Upgrade-Scenario Target: 11g execution plans should only be used after verification Idea: Use of OPTIMIZER_FEATURES_ENABLE optimizer_features_enable= Plan History Start of SQL Workload and capture of SQL Plan baselines GB Plan GB HJ Baseline GB HJ HJ HJ HJ 11g execution plans waiting for verification NL Only verified execution plans optimizer_features_enable= Oracle Database 11g 21

22 Some interesting Oracle 11g features Result Cache Faster results with help of Result Cache SQL Plan Management Minimize the risks of execution plan changes SQL Performance Analyzer Helps to compare the effects of changes Compression Saves disk space and improves performance Automatic SQL Tuning Automated tuning of SQL statements 22

23 SQL Performance Analyzer Is useful when A dedicated SQL-workload has to be analyzed after changes Risks have to be evaluated after changes A detailed performance analysis of a single SQL statement is necessary Performance evaluations of SQL workloads before Oracle 11g 23

24 SQL Performance Analyzer Benefits: No additional installation necessary No Scripting necessary Enterprise Manager Useful for Performance analysis of a dedicated workload Prerequisites: SQL Tuning Sets 24

25 SQL Performance Analyzer Workflow Productiondatabase Test Datenbank SQL Tuning Set Execution Cursor Cache ftp Export/Import Execution Plan & statistics Inkrementelles Capture Before Change Test After Change Test SQL Tuning Set Performance Comparison 25

26 Generate SQL Tuning Set 26

27 Enterprise Manager Report 27

28 Enterprise Manager reports - details 28

29 SQL Performance Analyzer (SPA) and Replay SPA DB Replay Focus Evaluation a set of SQL Statements Replay of the whole workload including concurrency Repeatable Yes Yes (with Backup) Installation 11g: - <11g: Patch 11g: - (wrc available) <11g: Patch Use before Version 11g (*) (*) (*) Prerequisites STS - Results Analysis of execution plans / execution statistics Capture and Replay Report, AWR und ASH diff report (*) See Note

30 Some interesting Oracle 11g features Result Cache Faster results with help of Result Cache SQL Plan Management Minimize the risks of execution plan changes SQL Performance Analyzer Helps to compare the effects of changes Compression Saves disk space and improves performance Automatic SQL Tuning Automated tuning of SQL statements 30

31 Selected Oracle 11g features - Compression Can be used To reduce cost and resources To save disk space of structured and unstructured data To utilize the Buffer cache more efficient To reduce duplicates in relational and unstructured data 31

32 Selected Oracle 11g features - Compression Compression is available for Indexes Structured table data (and partitions) with DIRECT Load And with Advanced Compression also for Unstructured data types (SecureFiles) Conventional DML(OLTP-compression) Datapump and RMAN data Redo Traffic with Data Guard 32

33 Selected Oracle 11g features - Compression Employee Table Nicht komprimierter Block ID FIRST_NAME LAST_NAME Header 1 2 John Jane Doe Doe 1 John Doe 2 Jane Doe 3 John Smith 4 Jane Doe 3 John Smith Free Space 4 Jane Doe INSERT INTO employee VALUES (5,'Jack','Smith'); COMMIT; 33

34 Selected Oracle 11g features - Compression Uncompressed block Header 1 John Doe 2 Jane Doe 3 John Smith 4 Jane Doe 5 Jack Smith Free Space Compressed block Header John= Doe= Jane= Smith= 1 John Doe Jane 3 4 Doe 3 John Smith 5 Jack 4 Jane Doe Free Space Local block information More data per block 34

35 Selected Oracle 11g features - Compression Activation CREATE TABLE ALTER TABLE MOVE COMPRESS for existing tables ALTER TABLE MOVE PARTITION COMPRESS for partitions Example - syntax: CREATE TABLE sales_history( ) COMPRESS FOR ALL OPERATIONS DIRECT_LOAD OPERATIONS Enterprise Manager: 35

36 Oracle SecureFiles New LOB s Advantages Enhanced performance Simplified LOB management Additional functionality Note: Compression Deduplication Encryption (AES128, AES192 etc) The programming API s remain unchanged Prerequisite: ASSM Tablespace ONLINE Migration via DBMS_REDEFINITION CREATE TABLE media_secure (id NUMBER,... lob1 BLOB) LOB (lob1) STORE AS SECUREFILE (TABLESPACE COMP DEDUPLICATE COMPRESS HIGH DISABLE STORAGE IN ROW) 36

37 Enterprise Manager 37

38 Table compression Compression Advisor (DBMS_COMPRESSION) declare block_comp PLS_INTEGER; block_uncomp PLS_INTEGER; row_comp PLS_INTEGER; row_uncomp PLS_INTEGER; comp_ratio NUMBER; comp_str VARCHAR2(200); begin DBMS_COMPRESSION.GET_COMPRESSION_RATIO ( SCRATCHTBSNAME =>'USERS', OWNNAME =>'TNIEWEL', TABNAME =>'EMPLOYEE', PARTNAME =>'', COMPTYPE =>DBMS_COMPRESSION.COMP_FOR_OLTP, BLKCNT_CMP =>block_comp, BLKCNT_UNCMP =>block_uncomp, ROW_CMP =>row_comp, ROW_UNCMP =>row_uncomp, CMP_RATIO =>comp_ratio, COMPTYPE_STR =>comp_str); 38

39 Table compression Compression Advisor (DBMS_COMPRESSION) continued dbms_output.put_line('# Blocks compressed => ' block_comp); dbms_output.put_line('# Blocks uncompressed => ' block_uncomp); dbms_output.put_line('ratio => ' comp_ratio); dbms_output.put_line('compression-typ => ' comp_str); end; # Blocks compressed => 15 # Blocks uncompressed => 83 Ratio => 5.5 Compression-Typ => "Compress For OLTP 39

40 Compression overview Index Table Lob Segment compression Data pump RMAN Data Guard Algorithm Bitmap and compressed index For all operations with SecureFile With parameter COMPRESSION=ALL CONFIGURE COMPRESSION ALGORITHM='...' LOG_ARCHIVE_DEST_3= '...COMPRESSION=ENABLE' Depending on object type 40

41 Some interesting Oracle 11g features Result Cache Faster results with help of Result Cache SQL Plan Management Minimize the risks of execution plan changes SQL Performance Analyzer Helps to compare the effects of changes Compression Saves disk space and improves performance Automatic SQL Tuning Automated tuning of SQL statements 41

42 Automatic SQL Tuning Allows the automatic tuning of SQL statements Test and implementation of profiles can be automated The tuning process can be fully automated 42

43 Manage Performance SQL Tuning AWR Workload implementation ADDM DBA SQL tuning camdidates DBA Evaluation of recommendations start advisor DBA SQL Tuning Advisor Recommendations 43

44 Manage Performance SQL Tuning Rewrite SQL Manual observation AWR Workload Indexes DBA Stale statistics ADDM Select candidates Implement profiles Automatic during maintenance window Automatic selection of candidates Automatic Test and implementation(optional) of SQL profiles SQL Tuning Kandidaten SQL tuning candidates Automatic Test profiles SQL Tuning Advisor Recommendations 44

45 Automated SQL Tuning 45

46 Agenda Oracle for Linux on System z Overview Oracle 11g Some interesting features Testing applications accessing Oracle

47 Oracle Real Application Testing 47

48 Enterprise Manager 48

49 Oracle Real Application Testing Capture Flow Create directory Set filter for capture (optional) Start the capture Stop capture Check and monitor capture (optional) Export AWR (optional) 49

50 Oracle Real Application Testing PL/SQL Create directory create or replace directory RAT as '/home/oracle/rat'; Set filter for capture SQL> execute dbms_workload_capture.add_filter (fname=>'filtersh', fattribute=>'user',fvalue=>'&schema'); Enter value for schema: TNIEWEL_RAT PL/SQL procedure successfully completed. 50

51 Oracle Real Application Testing PL/SQL Start capture SQL> execute dbms_workload_capture.start_capture (name=>'&name', dir=>'&dir',default_action=>'exclude'); Enter value for name: CAP1 Enter value for dir: RAT1 PL/SQL procedure successfully completed. Execute workload 51

52 Oracle Real Application Testing PL/SQL Stop capture SQL> execute dbms_workload_capture.finish_capture(); PL/SQL procedure successfully completed. 52

53 Oracle Real Application Testing PL/SQL Monitor Capture SQL> col name format a25 SQL> col status format a15 SQL> select id, name, status, errors, awr_exported, duration_secs from dba_workload_captures; ID NAME STATUS ERRORS AWR_EXPORTED DURATION_SECS tn1 COMPLETED 2 YES CAP1 COMPLETED 0 NO

54 Oracle Real Application Testing PL/SQL Export AWR SQL> execute dbms_workload_capture.export_awr('&id'); Enter value for id: 2 PL/SQL procedure successfully completed. 54

55 Oracle Real Application Testing - Replay flow Migrate data to 11.2 database on LoZ Activate flashback Create directory which contains the captured data Preprocess captured data Save current SCN 55

56 Oracle Real Application Testing - Replay flow Add filter (optional) Initialize replay Use filter (optional) Calibrate wrc client Start wrc clients Start replay Monitor replay run Import AWR data of capture 56

57 Oracle Real Application Testing - Replay flow Run reports Replay compare report AWR diff report Successive runs Flashback database to saved SCN startup mount FLASHBACK DATABASE to scn; alter database open resetlogs; 57

58 Oracle Real Application Testing - Replay flow Migrate database to 11.2 Activate flashback Create directory which contains the captured data Preprocess Captured data SQL> begin dbms_workload_replay.process_capture(capture_dir => '&dir'); end; Save current SCN for a rerun of the test 58

59 Oracle Real Application Testing PL/SQL Add filter (optional) SQL> begin 2 DBMS_WORKLOAD_REPLAY.ADD_FILTER( 3 fname => FILT1', 4 fattribute => 'USER', 5 fvalue => TNIEWEL_RAT'); 6 end; 7 / SQL> BEGIN 2 DBMS_WORKLOAD_REPLAY.CREATE_FILTER_SET( 3 replay_dir=> RAT', 4 filter_set => FSET1', 5 default_action => 'EXCLUDE'); 6 END; 7 / 59

60 Oracle Real Application Testing PL/SQL Initialize replay SQL> execute dbms_workload_replay.initialize_replay( REPLAY_10', RAT'); Use filterset (optional) SQL> BEGIN 2 3 DBMS_WORKLOAD_REPLAY.USE_FILTER_SET ( 4 filter_set => '&FILTERSET_NAME'); 5 6 END; 60

61 Oracle Real Application Testing PL/SQL Prepare replay SQL> begin dbms_workload_replay.prepare_replay(synchronization => FALSE, connect_time_scale => '&CONNECT_TIME', think_time_scale => '&THINK_TIME'); Calibrate wrc client wrc userid=tniewel_rat password=tniewel_rat MODE=CALIBRATE replaydir=./ 61

62 Oracle Real Application Testing wrc clients Report for Workload in:./ Recommendation: Consider using at least 1 clients divided among 1 CPU(s) You will need at least 7 MB of memory per client process. If your machine(s) cannot match that number, consider using more clients. Workload Characteristics: - max concurrency: 2 sessions - total number of sessions: 2 - Assumptions: - 1 client process per 50 concurrent sessions - 4 client process per CPU KB of memory cache per concurrent session - think time scale = connect time scale = synchronization = TRUE 62

63 Oracle Real Application Testing wrc clients Start wrc clients wrc userid=tniewel_rat password=tniewel_rat MODE=REPLAY replaydir=./ workload Replay Client: Release Production on Fri Jan 28 09:08: Copyright (c) 1982, 2009, Oracle and/or its affiliates. All rights reserved. Wait for the replay to start (09:08:36) Start replay SQL> EXEC dbms_workload_replay.start_replay(); Display on wrc screen Replay started (09:10:56) Replay finished (09:33:19) 63

64 Oracle Real Application Testing Monitoring replay SQL> select name, id, status, awr_exported,start_time, end_time from dba_workload_replays order by start_time; NAME ID STATUS AWR_EXPORTED START_TIM END_TIME play1 1 COMPLETED YES 26-JAN JAN-11 REP8 2 COMPLETED NO 27-JAN JAN-11 replay_10 5 IN PROGRESS NOT POSSIBLE 28-JAN-11 64

65 Oracle Real Application Testing Import AWR data of capture SQL> select name, id, status, awr_exported,start_time, end_time 2 from dba_workload_captures order by start_time 3 ; tn1 1 COMPLETED YES CAP1 5 COMPLETED YES CAP2 6 COMPLETED YES CAP3 7 COMPLETED YES CAP5 8 COMPLETED YES CAP7 10 COMPLETED YES CAP8 12 COMPLETED YES CAPTURE_10 15 COMPLETED YES rows selected. SQL> SQL> declare 2 t number; 3 begin 4 t:= DBMS_WORKLOAD_capture.IMPORT_AWR(&nr,'&schema', TRUE); 5 end; 6 / 65

66 Oracle Real Application Testing - reports Replay report set long set heading off set linesize 255 select dbms_workload_replay.report(replay_id=>'&repid', format=>'&format') from dual; Replay Compare period report set long set pagesize 0 set heading off variable results clob exec dbms_workload_replay.compare_period_report(replay_id1 =>'&id_1',replay_id2=>'&id2',format => '&Format',result=>:ergebnis); print results 66

67 Oracle Real Application Testing- Replay reports 67

68 Oracle Real Application Testing - Replay reports 68

69 Oracle Real Application Testing - Replay reports 69

70 More information

71 The preceding is intended to outline our general product direction. It is intended for information purposes only, and may not be incorporated into any contract. It is not a commitment to deliver any material, code, or functionality, and should not be relied upon in making purchasing decisions. The development, release, and timing of any features or functionality described for Oracle s products remains at the sole discretion of Oracle. 71

72 72

73 We encourage you to use the newly minted corporate tagline Hardware and Software, Engineered to Work Together. at the end of all your presentations. This message should replace any reference to our previous corporate tagline Software. Hardware. Complete. 73