Alain Fuhrer Oracle Database Administrator Swiss Mobiliar Insurance

Transcription

1 to Oracle Database 12.2 Real World Cases Mike Dietrich Master Product Manager Database s & Migrations Oracle Corporation Alain Fuhrer Oracle Database Administrator Swiss Mobiliar Insurance Presented with Copyright 2017, Oracle and/or its affiliates. All rights reserved. to Oracle Real World Cases

2 New Preupgrade Tool preupgrade.jar $ java -jar preupgrade.jar TEXT TERMINAL Checks source environment Detailed recommendations Fixup scripts Rerunable Always download from: MOS Note: Copyright 2017, Oracle and/or its affiliates. All rights reserved. to Oracle Real World Cases 2

3 ~40% faster upgrades than to Oracle 11g to Oracle Real World Cases 3

4 Restart Phase #:20 [UPGR] Files:1 Time: 0s Serial Phase #:21 [UPGR] Files:3 Time: 19s Restart Phase #:22 [UPGR] Files:1 Time: 0s catctl.pl - Parallel Parallel Phase #:23 [UPGR] Files:24 Time: 171s Restart Phase #:24 [UPGR] Files:1 Time: 0s [..] Restart Phase #:30 [UPGR] Files:1 Time: 0s *************** Catproc CDB Views ************** [..] ***************** Catproc PLBs ***************** [..] catctl.pl *************** [..] Catproc DataPump *************** ****************** Catproc SQL ***************** $ perl catctl.pl -l /logs catupgrd.sql [..] Non-CDBs and CDB$ROOT: 4 (default) - 8 workers ************* Final Catproc scripts ************ Serial Phase #:48 [UPGR] Files:1 Time: 8s Restart Phase #:49 [UPGR] Files:1 Time: 0s ************** Final RDBMS scripts ************* Serial Phase #:50 [UPGR] Files:1 Time: 32s ************ Component Start *********** Serial Phase #:51 [UPGR] Files:1 Time: 1s Restart Phase #:52 [UPGR] Files:1 Time: 0s PDBs: **************** Upgrading Java **************** Serial Phase #:53 [UPGR] Files:1 Time: 0s Restart Phase #:54 [UPGR] Files:1 Time: 1s Limited only by computing power ***************** Upgrading XDK **************** Serial Phase #:55 [UPGR] Files:1 Time: 0s Restart Phase #:56 [UPGR] Files:1 Time: 0s ********* Upgrading APS,OLS,DV,CONTEXT ********* Resumable: -R option Serial Phase #:57 [UPGR] Files:1 Time: 14s $ perl catctl.pl -R -l /logs catupgrd.sql ***************** Upgrading XDB **************** Restart Phase #:58 [UPGR] Files:1 Time: 0s Serial Phase #:60 [UPGR] Files:3 Time: 21s Serial Phase #:61 [UPGR] Files:3 Time: 9s Parallel Phase #:62 [UPGR] Files:9 Time: 4s Parallel Phase #:63 [UPGR] Files:24 Time: 3s Serial Phase #:64 [UPGR] Files:4 Time: 12s [..] Serial Phase #:70 [UPGR] Files:3 Time: 72s Restart Phase #:71 [UPGR] Files:1 Time: 0s ********* Upgrading CATJAVA,OWM,MGW,RAC ******** Serial Phase #:72 [UPGR] Files:1 Time: 92s **************** Upgrading ORDIM *************** Copyright 2017, Oracle and/or its affiliates. All rights reserved. to Oracle & Migrate 12.2 to -Oracle Real World Database Live Cases and Uncensored [..] 4

5 Overview and Timeline 337 databases Oracle Database to Oracle Database production databases 18 container databases 350 PDB s Max of 50 PDB s in one CDB in dev Move from schema-based consolidation to PDBs Timeline End of 2019 Copyright 2017, Oracle and/or its affiliates. All rights reserved. to Oracle Real World Cases 5

6 Pros and Cons Additionally PDBs Pure CDB architecture with Oracle 12.2 Except third party apps limitations Copyright 2017, Oracle and/or its affiliates. All rights reserved. to Oracle Real World Cases 6

7 Small DBA Team Only 4.8 FTE + 1 newbie Freeze periods for the Mobiliar applications Developers want Oracle 12.2 features NOW! Highly complex applications Queries with more than 1000 bind variables and 250 outer joins Copyright 2017, Oracle and/or its affiliates. All rights reserved. to Oracle Real World Cases 7

8 Performance Tracking Mobiliar s own AWR Warehouse Compare performance before/after 3 TB of historical performance data Covers entire database lifetime Performance Warehouse Copyright 2017, Oracle and/or its affiliates. All rights reserved. to Oracle Real World Cases 8

9 Testing and Releases Regression tests During the testing phase of the Mobiliar Software Release DATABASE RELEASE UPDATE (RU): Two Oracle Homes on the same server to Oracle Database 12.2 With catctl.pl embedded into home-built shell script Performance tests performed by application owner Copyright 2017, Oracle and/or its affiliates. All rights reserved. to Oracle Real World Cases 9

10 4 Checkpoints for CDBs 1) Check PDB default service name 2) Check length of PDB name 3) Check patch level of GI source home 4) Choose suitable parallel upgrade degree on your HW Copyright 2017, Oracle and/or its affiliates. All rights reserved. to Oracle Real World Cases 10

11 Behavior Change: PDB default service Issues Oracle recommendation: Create your own PDB service Oracle : You can disable the default service Oracle : Disabling the default service causes issues Solution: SQL> alter session set container=pdb1; ERROR: ORA-44787: Service cannot be switched into. - Don t disable the default service - Code fix in the next Oracle release Copyright 2017, Oracle and/or its affiliates. All rights reserved. to Oracle Real World Cases 11

12 PDB Naming Issues Maximum PDB name length: 30 byte to Oracle failed for PDB names >25 bytes Solution: Serial Phase #:109 [DOVVNZ_VVN_VERKENTSCHAEDIG] Files:1 wait_for_completion: unexpected error in next_proc() catconexec: unexpected error in wait_for_completions Unexpected error encountered in catctlmain; Error Stack Below; exiting Died at catctl.pl line main::catctldie("\x{a}unexpected error encountered in catconexec; exiting\x{a} 2") called at catctl.pl line Apply new prvtcr.plb package (bug ) Copyright 2017, Oracle and/or its affiliates. All rights reserved. to Oracle Real World Cases 12

13 Patch Level of source GI Issues Grid Infrastructure did not allow to add any 12.1 databases when a 12.2 database was registered first - Solution: srvctl add database -db my12db1_01 -oraclehome /u01/app/oracle/product/12102_1 \ -domain oracle.com -dbname MY12DB1 -instance my12db1 \ spfile PRCG-1036 : /u01/app/oracle/product/12102_1/dbs/spfilemy12db1.ora Internal error. PRCD-1095 : Failed to retrieve databases for version 11.1 and earlier PRKC-1137 : Unable to find Version object with string value Patch Oracle 12.1 Restart database home to at least January 2017 GI PSU/BP (bug ) Copyright 2017, Oracle and/or its affiliates. All rights reserved. to Oracle Real World Cases 13

14 Examine the optimal parallel degree catctl.pl allows to upgrade many PDBs at the same time: $ORACLE_HOME/perl/bin/perl catctl.pl -n xx -l $upgrade_base/upgrade catupgrd.sql CDB upgrade parallel degree balancing: Parallel Degree: -n Total Time Result with 32 CPU cores: 8 5 h 32 [Default] 2.6 h h Copyright 2017, Oracle and/or its affiliates. All rights reserved. to Oracle Real World Cases 14

15 Timing for 50 PDBs Steps (parallel degree: -n 32) PRE TASKS (online) Execution of preupgrade.jar Execution of pre upgrade fixup scripts TASKS (offline) Create guarantee restore point and change oracle home to 12.2 All in one of CDB$ROOT and all PDB s Recompile of CDB$ROOT and all PDB s after upgrade to 12.2 Enable local undo mode for container database Duration 13 min 5 min 8 min 3h 29 min 5 min 2h 46 min 32 min 6 min POST TASKS (online) Immediate create level 0 backup of container database Drop guarantee restore point after successful upgrade 11 min 10 min 1 min Total Time 3h 53 min Copyright 2017, Oracle and/or its affiliates. All rights reserved. to Oracle Real World Cases 15

16 Conclusion Parallel upgrade catctl.pl unfolds its full power when upgrading many PDBs at the same time 50 PDBs upgraded in less than 4 hours Still some issues/bugs to check and fix before upgrade We feel very well prepared for the new annual Oracle releases If you plan to or use already Oracle Multitenant, upgrade to Oracle Database The new features are really good Copyright 2017, Oracle and/or its affiliates. All rights reserved. to Oracle Real World Cases 16

17 Reference Program Benefits Great help and add a lot of value to our project s progress When we encounter issues, we fix them before going live Oracle monitored our SR s and pushed things forward In summary we can say, that we are very happy to be part of the Reference Program for the second time and hope we can also benefit from it in the future Copyright 2017, Oracle and/or its affiliates. All rights reserved. to Oracle Real World Cases 17

18 mobiliar.ch/db-blog