BUS1216 The Journey to Oracle Exadata and Autonomous Datawarehouse Cloud. 1

Transcription

1 BUS1216 The Journey to Oracle Exadata and Autonomous Datawarehouse Cloud 1

2 Agenda Erik Dvergsnes Aker BP Choice of Exadata First Impression Autonomous Way forward Autonomous The end / Questions erik.dvergsnes@akerbp.com 2

3 25 years experience Oracle Forms Programming, DBA, PM & Architect Industries: Oil & Gas and Finance Companies worked for: Cap Gemini, Shell, Deutsche Bank, Aker Kværner, BP Norway & Aker BP Deutsche Bank - Quality, effectiveness, systems in place Erik Dvergsnes We are now a Consultancy team to support others erik.dvergsnes@akerbp.com 3

4 The Company Aker BP Company has grown by M&A Focused on technology future no people offshore visit Spotify Measured in production, one of the largest independent oil companies in Europe Plan is to double its Production 4

5 5

6 Focused On New Technology & Protecting The Environment NOW FUTURE The NOAKA project together with Statoil in Norway will be the first to produce oil and gas with zero emissions is Autonomous unmanned platforms running on electricity from renewable energy, solar, wind & waves and zero emissions. 6

7 7

8 Aker BP Want To Automate Most Part - Working With Cognite erik.dvergsnes@akerbp.com 8

9 Consolidate on Exadata 120 Oracle databases between the two companies 105 BP Norge and only 15 from Det Norske Solaris, Linux, Windows, Vmware What would my friends in DB recommend? Evaluated: VMWare, ODA, Exadata, AIX Removing duplicate systems and decommission old ones Cloud at Customer not mature enough End state 25 prod and 50 dev, test and training Solution : 2 x Exadata Eight Rack X6-2 HC, April 2017 erik.dvergsnes@akerbp.com 9

10 Exadata 1 Prod DB srv 1 DB srv 2 Prod-HA cluster 16 vcpu 128 GB RAM = 4 DBEE & 4 RAC one license Prod cluster 16 vcpu 128 GB RAM = 4 DBEE license Exadata config OVM view Dataguard Dataguard Exadata 2 DR / Dev DB srv 1 DB srv 2 Prod-HA cluster 12 vcpu 96 GB RAM = 3 DBEE & 3 RAC one license Prod cluster 8 vcpu 64 GB RAM = 2 (DBEE) license Dev-Tst cluster 12 vcpu 128 GB RAM = 3 (DBEE) license Storage servers Storage servers ASM disk Prod-HA Cluster ASM disk Prod-HA Cluster ASM disk Prod Cluster Buffer ASM disk Prod Cluster Buffer ASM disk Dev-Tst Cluster erik.dvergsnes@akerbp.com 10

11 What is ORACLE Autonomous Database? 11

12 What are the principles of ORACLE Autonomous Database? 12

13 Use cases for ORACLE Autonomous Database? 13

14 Autonomous Data Warehouse Cloud Service First pilot Alarms & Archive system need it for audit Size =1 TB, two tables 2,5 billion and 408 mill rows Best query went from 1,5 hours down to 4 seconds joining these two large tables Summarize advantages: Very easy to get going, set it up Import very easy and fast only indexes for constraints (PK/FK) After import the size was now 180 GB (Hybrid Columnar Compression (HCC) + (most indexes not needed)) Queries went from over 2 minutes to seconds ON ADWC I could just add columns in where clause faster and faster (old system was on 10.2 and old Linux, but still impressed) Cost saving turn off when not in use, Less human interactions less errors The scalability -2 CPU s up to 72 ++? Archive system, be sure it is always available, upgraded Flashback & guaranteed restore points current project loads of issues IT Managementpleased so got approval to find morecandidates -> erik.dvergsnes@akerbp.com 14

15 So how did I get the data from old system into ADWC Start with the expdp expdp ": "/******** AS SYSDBA" directory=exadata DUMPFILE=aearch_MATRIKON%U.dmp logfile=aearch_matrikon.log filesize=5000m PARALLEL=8 SCHEMAS=MATRIKON erik.dvergsnes@akerbp.com 15

16 The command to copy 40.dmp files of 5 GB each to the Object store Oracle Cloud Infrastructure (OCI) commands OCI command to upload to object store. Name space (-ns) = akerbpxxxx Bucket name (-bn) atpakxxxx oci os object bulk-upload --ns akerbpxxxx --bn atpakxxxx --src-dir \\reustvss027\scratch0\erik --include aearch_matrikon*dmp --part-size 50 --parallel-upload-count 20 erik.dvergsnes@akerbp.com 16

17 17

18 18

19 Create Credential We need to run the create credential command for the ADW/ATP instances to access the Object Store. It creates an access credential on the db which allows us to use the files on Object Store (dump files, csv files, etc). You usually need it for import, data load operations and it is a one time process after provisioning the instance. erik.dvergsnes@akerbp.com 19

20 The impdp comand into ADWC impdp directory=data_pump_dir PARALLEL=8 ^ logfile=imp_aearch_matrikon.log TRANSFORM=SEGMENT_ATTRIBUTES:n PARTITION_OPTIONS=MERGE ^ transform=dwcs_cvt_iots:ytransform=constraint_use_default_index:y ^ exclude=index,cluster,indextype,materialized_view,materialized_view_log,materialized_zonemap,db_link ^ remap_tablespace=aearchive:data credential=obj_store_cred ^ dumpfile= account}/{bucketname}/aearch_matrikon02.dmp,^. account}/{bucketname}/aearch_matrikon40.dmp,^ account}/{bucketname}/aearch_matrikon41.dmp.. 26 tables in total but these two most important and biggest.. imported "MATRIKON"."PGEVENT" GB 408,825,359 rows.. imported "MATRIKON"."PGSYSTEMATTRIBUTE" 50.4 GB 2,544,088,569 rows erik.dvergsnes@akerbp.com 20

21 The impdp comand into ADWC Explained PARTITION_OPTIONS=MERGE -> Oracle will convert Partitioned tables into non-partitioned tables. TRANSFORM=SEGMENT_ATTRIBUTES:n -> Storage attributes for tables are ignored. TRANSFORM=CONSTRAINT_USE_DEFAULT_INDEX:y -> Oracle will create the indexes for PK / UK constraints EXCLUDE=INDEX -> Oracle will exclude all other indexes TRANSFORM=DWCS_CVT_IOTS:Y -> Oracle will convert Index-organized tables into regular tables REMAP_TABLESPACE=AEARCHIVE:DATA -> Only DATA tablespace in ADWC (at the moment) erik.dvergsnes@akerbp.com 21

22 Now run a query no tuning just load and run Joining 2,5 billion row table with 400 million row table done in 4 seconds! autotrace traceonly will still fetch the data but not print on the screen High arraysize to avoid the network fetch wait erik.dvergsnes@akerbp.com 22

23 Monitor sql in the Service Console 23

24 Monitor sql in the Service Console 24

25 Looking at the.html report in chrome Plan Statistics 25

26 Looking at the.html report in chrome Plan Display Graphical 26

27 Looking at the.html report in chrome Plan Display Tabular 27

28 Looking at the.html report in chrome Parallel 28

29 Looking at the.html report in chrome Metrics 29

30 Autonomous way forward - Culture slowing us down - Technology will deliver My Goal is to turn of EXA2 (DR & Dev/test q Identify more DB and Apps to move to cloud - Business ask why move again? - Aker BP long term goal is Cloud Start with our our dev-test in the cloud All Standby DB s in the cloud - Dataguard in the cloud < CPU - When DR scale up > CPU - test migration to cloud All backup in the cloud - 60 days backup included little left in our Prod EXA OVM only keep one cluster Bring your Own License to Cloud erik.dvergsnes@akerbp.com 30

31 More benefits with Autonomous and Cloud in general Change from perpetual License to Term License since move to Cloud Diagnostic & Tuning dropped in price 60% Following Packages are now included in all database services on the Cloud Diagnostic pack Tuning pack Real Application Testing Encryption 31

32 MORE BENEFITS Why Running so fast on ADWC? smart scan, flash cache, Hybrid Columnar Compression (HCC) and parallell execution Turning off EXA2 (DR/dev-tst) Savemoney on licensecosts and maintenance Patching on exadata - difficult to get agreement with a 24/7 business Offshore weather days move forward / backward Many applications Share same Oracle Home. Problem with OJVM in 11.2 & 12.1 Oracle Platinum to do our patching Grid Infrastructure 18C is not a certified version for Platinum (sept 2018) Late on patching vulnerable for attack from hackers erik.dvergsnes@akerbp.com 32

33 EVEN MORE BENEFITS Real Application Testing included for free. provision a new test database we are upgrading to and replay our real production workload on this system Our business users must raise Change requests to order a new database take weeks on our on premise - take minutes on the Autonomous. Business opportunities are lost. The 99,995% uptime is very favorable for our criticalsystems used 24/7 Auto-scaling the instance e.g. 16 -> 1 CPU is not yet available on ADWC. Friday evening remember to scale down to save money. You can use REST API s calls on your scripts and automate this. Old versions ofyour databaseswillcost you extra support fee Extended Support (ES) contract required from 1st Jan % on yearly supportcost Extended Support (ES)contract required from 1st Sept % on yearly supportcost erik.dvergsnes@akerbp.com 33

34 34

35 Not Autonomous but Oracle Cloud Example 5 databases running 5 days a month for 10 hours = 250 hours Pay as you Go - NOK 2,961 = US dollars 360 Monthly Flex NOK 2,146 = US dollars 261 erik.dvergsnes@akerbp.com 35

36 What are the principles of ORACLE Autonomous Database? 36

37 The END / Questions Questions? Exciting times ahead implementing more Autonomous solutions Happy to help others with Exadata & Autonomous migrations J GOOD LUCK! erik.dvergsnes@akerbp.com 37

38 38