<Insert Picture Here>

Transcription

1 1

2 <Insert Picture Here> S Enterprise-Class Online Transaction Processing (OLTP) on Exadata Mahesh Subramaniam - Senior Principal Product Manager, Oracle Michael Nowak - Consulting Member of Technical Staff, Oracle Manohar Reddy IT Manager, Sogeti 2

3 Agenda Introduction Best Practices Sogeti Q&A <Insert Picture Here> 3

4 Introduction 4

5 Exadata Database Machine Best Platform to Run the Oracle Database Best Machine for Data Warehousing Best Machine for OLTP Best Machine for Database Consolidation Unique Architecture Makes it Fastest, Lowest Cost Copyright 2010, Oracle Corporation and/or its affiliates 5 5

6 Exadata Hardware Architecture Scaleable Grid of industry standard servers for Compute and Storage Eliminates long-standing tradeoff between Scalability, Availability, Cost Database Grid 8 Dual-processor x64 database servers OR 2 Eight-processor x64 database servers InfiniBand Network Redundant 40Gb/s switches Unified server & storage network Intelligent Storage Grid 14 High-performance low-cost storage servers 100 TB High Speed disk, or 336 TB High Capacity disk 5.3 TB PCI Flash Data mirrored across storage servers Copyright 2010, Oracle Corporation and/or its affiliates 6 6

7 Exadata Storage Software Unique Features Intelligent Storage Grid Hybrid Columnar Compression Smart Flash Cache Copyright 2010, Oracle Corporation and/or its affiliates 7 7

8 Best Practices 8

9 OLTP Best Practices OLTP Most systems are a hybrid Think Response Time Focused Best Practices Many are already preconfigured for you Seeing is believing Watch for Best Practices in Action 9

10 OLTP Best Practices using Oracle Database Machine Generic Best Practices which sqlplus /u01/app/oracle/product/11.2.0/dbhome_1/bin/sqlplus You know this stuff! Top two generic Best Practices SQL Tuning Understand explain plans Generate statistics Use bind variables Connection Architecture Limiting connections with pools Avoiding excessive logon/logoff 10

11 OLTP Best Practices using Oracle Database Machine Use Exadata Smart Flash Cache Use Exadata smart flash cache for great IO performance create flashcache all As always, cache does need a warm up Humans are still smarter than computers so there are exceptions Cache attributes lets you tell Oracle about corner cases. Place objects in appropriate cache based on size 11

12 OLTP Best Practices using Oracle Database Machine Use Exadata Smart Flash Cache - Best Practices in Action Confirming proper smart flash cache config $ dcli -g $HOME/cell_group "cellcli -e 'list flashcache detail' grep effectivecachesize cel01: effectivecachesize: G cel02: effectivecachesize: G cel03: effectivecachesize: G cel04: effectivecachesize: G cel05: effectivecachesize: G cel06: effectivecachesize: G cel07: effectivecachesize: G cel08: effectivecachesize: G cel09: effectivecachesize: G cel10: effectivecachesize: G cel11: effectivecachesize: G cel12: effectivecachesize: G cel13: effectivecachesize: G cel14: effectivecachesize: G 12

13 OLTP Best Practices using Oracle Database Machine Use Exadata Smart Flash Cache - Best Practices in Action Lets look at a real example a classic response time query with index access. Pseudo code 1. Collect v$session_event.time_waited_micro 2. Run simple query select customer_id,order_total from orders where ORDER_ID= ; 3. Collect v$session_event.time_waited_micro and report diff The single row lookup in this example is the foundation for many SQL statements that run on Oracle OLTP systems Nothing special done to store objects in flash cache 13

14 OLTP Best Practices using Oracle Database Machine Use Exadata Smart Flash Cache - Best Practices in Action set serveroutput on declare r1 number; r2 number; cust_id number; ord_tot number; delta_ms number; begin select sum(time_waited_micro) into r1 from v$session_event where event='cell single block physical read' and sid = (select distinct sid from v$mystat); select customer_id,order_total into cust_id,ord_tot from soe.orders where ORDER_ID= ; select sum(time_waited_micro) into r2 from v$session_event where event='cell single block physical read' and sid = (select distinct sid from v$mystat); delta_ms:=r2-r1; dbms_output.put_line('milliseconds waiting on IO: ' delta_ms/1000); end; / Id Operation Name Rows Bytes Cost (%CPU) Time Pstart Pstop SELECT STATEMENT (0) 00:00:01 1 PARTITION HASH SINGLE (0) 00:00: TABLE ACCESS BY LOCAL INDEX ROWID ORDERS (0) 00:00: * 3 INDEX UNIQUE SCAN ORDER_PK 1 2 (0) 00:00:

15 OLTP Best Practices using Oracle Database Machine Use Exadata Smart Flash Cache - Best Practices in Action Results: Buffer cache Average milliseconds per IO: 0 No Flash cache (this is like traditional storage) Average milliseconds per IO : 8 Exadata Smart Flash Cache Average milliseconds per IO : <1 ~88% decrease in average IO time with Exadata Smart Flash Cache 15

16 OLTP Best Practices using Oracle Database Machine Use Exadata Smart Flash Cache - Best Practices in Action AWR excerpt from Sogeti production EBS system Top 5 Timed Foreground Events ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ wait % DB Event Waits Time(s) (ms) time Wait Class DB CPU 1, cell single block physical read 326, User I/O log file switch (checkpoint in Configurat library cache pin 68, Concurrenc cursor: pin S wait on X Concurrenc Avg 16

17 OLTP Best Practices using Oracle Database Machine Leverage the speedy Infiniband network Low latency = fast communication RDS bcopy (db->db) and zcopy (db->cell) You like this alert.log message: Cluster communication is configured to use the following interface(s) for this instance cluster interconnect IPC version:oracle RDS/IP (generic) Interface configuration, network configuration, etc all preconfigured for performance and HA Extending the IB fabric with IPoIB with no application changes Media servers, batch servers 17

18 OLTP Best Practices using Oracle Database Machine Leverage the speedy Infiniband network Best Practices in Action Example Rds-stress bcopy output tsks tx/s tx+rx K/s rw+rr K/s tx us/c rtt us cpu %

19 OLTP Best Practices using Oracle Database Machine Leverage the speedy Infiniband network Best Practices in Action AWR excerpt from Sogeti production EBS Global Cache and Enqueue Services - Workload Characteristics ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ Avg global enqueue get time (ms): 0.1 Avg global cache cr block receive time (ms): 0.3 Avg global cache current block receive time (ms): 0.2 Avg global cache cr block build time (ms): 0.0 Avg global cache cr block send time (ms): 0.0 Avg global cache current block pin time (ms): 0.1 Avg global cache current block send time (ms):

20 OLTP Best Practices using Oracle Database Machine Check your scan IQ Some facts about scans: Scans exists in OLTP systems Exadata smart scan requires a direct path read. A direct path read is chosen at runtime based on internal heuristics The STORAGE clause in an explain plan doesn t necessarily mean you will perform a smart scan. The buffer caching in certain OLTP environments can occasionally induce conventional reads when smart scan is faster. Typically see cell multiblock physical read instead of cell smart table scan waits No one-size-fits-all solution can be given here but it is very fixable. 20

21 OLTP Best Practices using Oracle Database Machine Understand Storage Index Cell maintains min/max value on cell storage regions IO automatically eliminated during smart scan via an internal index on storage regions. You don t need to do anything to get this feature! Loading data in sorted order further enhances the benefit of storage index Statistics available to assess storage index. Check out v$sysstat where name like %storage index% 21

22 OLTP Best Practices using Oracle Database Machine Understand Storage Index - Best Practices in Action Lets look at a reporting query with a full table scan against 310G compressed table with and without storage index Pseudo code: 1. Collect v$session_event.time_waited_micro, v$sysstat.name (storage index stats) 2. Run simple query select promo_id from sales where cust_id=23556 and amount_sold > 90; 3. Collect v$session_event.time_waited_micro, v$sysstat.name (storage index stats) and report diff No special data sorting for this example 22

23 OLTP Best Practices using Oracle Database Machine Understand Storage Index - Best Practices in Action set serveroutput on declare r1 number; r2 number; pr_id number; sid1 number; sid2 number; delta_ms number; delta_sid number; begin select sum(time_waited_micro) into r1 from v$session_event where event='cell smart table scan' and sid = (select distinct sid from v$mystat); select m.value into sid1 from v$mystat m, v$sysstat s where m.statistic#=s.statistic# and s.name = 'cell physical IO bytes saved by storage index'; select promo_id into pr_id from sh.sales where cust_id=23556 and amount_sold > 90; select sum(time_waited_micro) into r2 from v$session_event where event='cell smart table scan' and sid = (select distinct sid from v$mystat); select m.value into sid2 from v$mystat m, v$sysstat s where m.statistic#=s.statistic# and s.name = 'cell physical IO bytes saved by storage index'; delta_ms:=r2-r1; delta_sid:=sid2-sid1; dbms_output.put_line('milliseconds waiting on IO: ' delta_ms/1000); dbms_output.put_line('storage Index bytes saved: ' delta_sid); end; / 23

24 OLTP Best Practices using Oracle Database Machine Understand Storage Index - Best Practices in Action Results: No Storage Index (still getting Exadata benefits) Total seconds spent doing IO : 32 Total GB saved with storage index: 0 Exadata Storage Index Total seconds spent doing IO : 18 Total GB saved with storage index: % of IO eliminated with Exadata storage index Bonus question: how many seconds were spent performing IO if smart scan was disabled? Answer: It s a trick question; You should never disable smart scan 24

25 OLTP Best Practices using Oracle Database Machine Preconfigured Database and Schema Configuration Best Practices Don t throw out that database we gave you at deployment time! It has valuable best practices built in: Database GRID via Oracle Clusterware Services Storage GRID via Automatic Storage Management 8k default block size for database Memory Management Conservative OLTP starting point: 16G sga_target, 8G pga_aggregate_target 25

26 OLTP Best Practices using Oracle Database Machine Up-to-you Application and System Specific Best Practices CPU and IO Resource Management including setting of hard limits Operating System Hugepages can improve OS resource efficiency with large SGAs and/or many connections Requires proper configuration and testing 26

27 Customer Experience Sogeti 27

28 Consulting Services Technology Services Outsourcing Services Local Professional Services About Sogeti Local Touch Global Reach Sogeti is one of four professional disciplines of expertise. These services range from strategy development to IT systems maintenance. By combining its skills, The Group s four main professional disciplines offer Capgemini s clients integrated transformation services. The Group also combines its areas of expertise to offer specific solutions across six sectors. Four Capgemini Divisions Across 6 Sectors Consulting Services (Capgemini Consulting): helping our clients identify, structure and execute transformation projects that will have lasting effects on their growth and competitiveness. Technology Services (TS): designing, developing and implementing packaged-based ERP solutions such as SAP and Oracle for systems integration and global IT roll outs. Outsourcing Services (OS): Assisting our clients in the total or partial outsourcing of their IT systems. Local Professional Services (Sogeti): Supplying IT projected-based services that are suited to local needs (Microsoft, IBM, Oracle Technologies, business intelligence, testing, application development) while also leveraging Global Delivery. Consumer Products, Retail & Distribution Manufacturing Energy, Utilities & Chemicals Telecom, Media & Entertainment Financial Services Public Sector 28

29 High Level Scenario Local Touch Global Reach Sogeti uses Oracle e-business Suite to support its end-to-end business processes, including financials, human resources, project resource management, and project accounting. Key statistics: Existing Application: EBS Existing Database: 10gR2, Solaris 10 SPARC Number of users: 3000 Modules Implemented: Financials (Accounts Payable, Accounts Receivable, General Ledger, Purchasing) Human Resources Project Accounting (Project Resource Management, iexpenses, Time & Labor) Fixed Assets Other Applications (outside of EBS): Several legacy applications, CRM, and Payroll Challenge: A small IT team trying to meet the fast growing need of data A significant amount of time spent fighting fires, running ad-hoc queries against large data sets and optimize queries which have short shelf life Time lost due to performance issues with ad-hoc queries & reports 29

30 The Goals Local Touch Global Reach Based on anticipated savings and additional benefits, we decided to migrate our EBS environment to Oracle Database Machine. Oracle Exadata is helping us: Improve Consolidation Reduce number of instances by aggregating all Oracle database instances into a single instance Reduce effort needed to administer & optimize databases Reduce weekly tape backup from 4 hours to daily 4 minutes Enhance Reporting Eliminate batch processing for nightly and weekly custom reports/ batch jobs Provide real-time reporting for critical key performance indicators Create a highperforming platform for subsequent BI/ DW implementation Reduce Overall Costs/ Increase Productivity Reduce number of servers and simplify software licensing resulting in meaningful cost savings Reduced dependence on IT staff Higher availability resulting in significant productivity enhancements Better performance resulting in additional productivity 30

31 The Plan Local Touch Global Reach May 2010 June 2010 July 2010 August 2010 Kickoff and Information Gathering/Analysis Conduct Initial Migration to Linux ASM/single instance. Perform Technical Testing Perform UAT Testing Conduct Final Migration to Linux ASM/RAC Perform Technical Testing Go-Live 31

32 Upcoming Exadata Sessions Wednesday, September 22 1:00 pm 2:00 pm Oracle Exadata Tips, Tricks, and Best Practices: Backup and Recovery (S316821) Moscone South, Room 307 4:45 pm 5:45 pm Oracle Exadata Tips, Tricks, and Best Practices: Migrating to the Oracle Exadata (S316822) Moscone South, Room

33 Upcoming Exadata Sessions Thursday, September 23 12:00 pm 1:00 pm Oracle Exadata Technical Deep Dive: Architecture and Internals (S316820) Moscone South, Room 103 3:00 pm 4:00 pm The X-Files: Managing the Oracle Exadata and Highly Available Oracle Databases (S316974) Moscone South, Room

34 34

35 The preceding is intended to outline our general product direction. It is intended for information purposes only, and may not be incorporated into any contract. It is not a commitment to deliver any material, code, or functionality, and should not be relied upon in making purchasing decisions. The development, release, and timing of any features or functionality described for Oracle s products remains at the sole discretion of Oracle. 35