SmartDBA 솔루션을활용한종합적이고통합된데이타베이스관리

Transcription

1 SmartDBA 솔루션을활용한종합적이고통합된데이타베이스관리 drive BMC Software Korea 이정훈 / 소프트웨어컨설턴트 Jeonghoon_lee@bmc.com

2 Agenda Database Management Model In BSM Monitoring & Diagnostic Recovery Space Management SQL & Application Tuning 2

3 BSM Is a Solution That Spans the Entire Product Line Across R&D Business Services Service Impact Management Asset Management Help Desk Device Mainframe Database IT Service And Apps Management IT Ops and Infrastructure Management Service Model Business Relevance Event and Performance Managers Applications Network Change Management Service Level Agreement Performance Metrics Servers Business IT Analysis Performance Prediction Security Batch 3

4 Business Service Management Schematic Business Service The process being managed Optimize PERFORMANCE System Performance SQL Performance Database Performance SmartDBA Solutions - Intelligent Data Management Simplify Service Impact ADMINISTRATION Manager Database Administration Automatically Administrative relates Assistant business services to underlying IT assets IT Service Management Complete service lifecycle management of the IT environment IT Operations Oracle and Infrastructure Management The IMS specific tools and automation processes for administering specific elements of the IT stack Assure RECOVERY Recovery Management Recovery for SAP Recovery for Siebel Manage mainframe and distributed databases from a single console. DB2 UDB for Unix, Windows and Linux SQL Server Sybase DB2 UDB for z/os and OS/390 4

5 How SmartDBA Works for Business SmartDBA Solutions provide a source of rich, intelligent database events today (mainframe and distributed), accessible to BSM through PATROL and MAINVIEW. 5! 2004년 8월 24일

6 What is SmartDBA? SmartDBA is a scalable suite of Java-based tools designed to assist with all aspects of database management. SmartDBA provides functionality for: Database Administration Performance Analysis and Tuning SQL Analysis and Tuning Space Management Backup and Recovery 6

7 Database Management Model Proactively monitor 24 x 7 Visually identify trends Diagnose root causes Resolve Performance & Availability Problem 7

8 SmartDBA Performance Monitoring & Diagnostic Database Monitoring and Diagnostic Patrol & DB-Xray for Oracle 8

9 Performance Monitoring Needs Performance problems are important business issues Waste time and money Throwing resources at the problem is rarely the best solution Performance problems can have many causes The most obvious cause may not be the actual cause There may be multiple causes in combination Must access all relevant data to accurately analyze Sporadic problems require just-in-time analysis User sessions that are hogging resources Inefficient sorts Buffer activity 9

10 Performance Monitoring Needs Maintaining performance is a DBA s greatest challenge Must be able to monitor ALL of the following --and more -- to correctly diagnose performance problems Resource consumption CPU, Memory, I/O trends User sessions and associated SQL Locking conditions & latches Sort activity -- is it occurring in memory? Hit ratios Buffer cache Dictionary cache Library cache System Waits Redo log activity 10

11 PATROL for Oracle 24 x 7 Monitoring, Alerting, and Control Proactive Database Management Page or alert 24x7 Automated scripted responses Critical Performance Metrics Centralized Global and Local DB Management Operators Console Integration with SmartDBA Central Repository / Collectors Customizable Custom parameters Run arbitrary scripts PSL language 11

12 PATROL for Oracle 24 x 7 Monitoring, Alerting, and Control Parameters (over 200 available) Alerts (Availability) ArchiveFreeSpace (Availability) BGDumpLeft (Capacity) ExtentsLeft (Availability) FreeSpace (Availability) FreeSpaceDeficit (Availability) Instance Status (Availability) ProblemUsers (Users) RedoArchDelay (Log) [With Menu Command and Recovery Action] ResponseExecTime (Performance) ResponseSqlTime (Performance) Functions Blackout Building Custom SQL Parameters Category Management Containers Help Infobox Multi-line Graphs SQL*Net Monitoring SqlSnapshot SqlViewer Tablespace monitoring User Monitoring Reporting Active Sessions Shared Pool Users 12

13 Enterprise Data View Integration with SmartDBA Solution Common Database Administration 13

14 Operational Excellence with DBXray The Features that Ease Management Focus alerts using exception based monitoring Reduce analysis time using DBA-centric work flow Accessible from anywhere web based architecture Intelligent integration with 24 x 7 monitoring 14

15 Operational Excellence Seamlessly Drill Down Into Fix Tools Graphically display health of the database Click Users Single screen display of entire instance status Problem areas highlighted with one click access to more detail or expert advice Drill downs provide incontext launch of fix-it tools such as editors or tuning components 15 Click Tune to tune the SQL statement

16 End-to-End Database Performance Monitoring and Diagnostics Scalable, Web based DBA solution tightly integrated to provide complete, proactive performance management Enterprise Monitoring & Alerting Diagnostics Information on the Problem Problem Identification Solution Validation Diagnose Cause Recommend Action Find It, Fix It, Avoid It 16

17 SmartDBA Recovery Database Recovery SQL-BackTrack for Oracle 17

18 Data Management Challenges Customers, suppliers and internal staff expect faster, immediate access to data and the expectation is that we meet these demands while reducing costs to the business. Improve Service Delivery The majority of service level breaches are database related. More data means it takes longer for the applications to access the database, which impacts service delivery. Reduce Costs Physical size of databases is growing, making it more difficult and costly to optimize performance. Loss of business data can lead to business failure, lost revenue. 18

19 Data Management Challenges Recovery is an unfortunate fact of life... Up to 80% of all unplanned downtime is caused by software or human error* Up to 70% of recovery is think time! Investigate 20% Diagnose 20% Analyze 30% Recover 30% *Source: Gartner, Aftermath: Disaster Recovery, Vic Wheatman, September 21,

20 Data Management Challenges Ready for Recovery? Analysis Source Preparation Restore Recover Post-op Autodiscovery feature tells the DBA what is missing Historical backup management keeps track of backups Issues the appropriate commands needed to prepare the database for the recovery process Copies backup data to the correct destination Issues the appropriate command in the correct sequence Performs or advises DBA on the appropriate post-recovery clean-up process 20

21 Ready for Recovery! BMC Software assures recovery Analysis Source Preparation Restore Recover Post-op SQL-BackTrack Investigate data loss/ corruption and discover what information must be replaced Identify location of and retrieve backup data Issues the appropriate commands needed to prepare the database for the recovery process Copies backup data to the correct destination Issues the appropriate command in the correct sequence automates the entire recovery process! Perform appropriate postrecovery clean-up processes 21

22 Why SQL-BackTrack? An example of a recovery of an Oracle database using RMAN 1. Determine what to recover. 2. Determine location where necessary data files and archive logs are stored. 3. Determine recovery type: hot, cold, is there a specific point-in-time for the recovery? 4. Copy the parameter files from backup. [ RMAN does not handle parameter files, must copy them manually. ] 5. Edit the parameter files to reflect new locations for the control files. 6. Start RMAN. 7. Allocate channel(s.) 8. Shutdown abort. 9. Startup nomount. 10. Restore control files. 11. Ensure that the control files are copied to all the locations specified in the parameter file. 12. Startup mount. 13. Catalog any unarchived archive logs [ If the files are not cataloged, RMAN does not apply them.] 14. Determine the SCN to which we want to recover by querying V$LOG_HISTORY. 15. Set the SCN to the latest SCN. 16. Issue "ALTER data file <> OFFLINE IMMEDIATE" for all the affected data files. *** 17. Rename the files to new location [ for all the data files.] *** 18. Restore the data files. 19. Issue a switch data file command. 20. Restore the archivelogs. (SQL-BackTrack automates.) 21. Recover the database. 22. Issue "alter database open resetlogs. 23. If using a recovery catalog then issue a "reset database" command. 24. Shutdown the database. 25. Do a full backup of the database. 26. Determine database and application are ready for production use. *** These steps have to be done for each and every data file 22

23 Why SQL-BackTrack? An example of a recovery of an Oracle database using RMAN 1. Determine what to recover. 2. Determine location where necessary data files and archive logs are stored. 3. Determine recovery type: hot, cold, is there a specific point-in-time for the recovery? 4. Copy the parameter files from backup. [ RMAN does not handle parameter files, must copy them manually. ] 5. Edit the parameter files to reflect new locations for the control files. 6. Start RMAN. 7. Allocate channel(s.) 8. Shutdown abort. 9. Startup nomount. 10. Restore control files. 11. Ensure that the control files are copied to all the locations specified in the parameter file. 12. Startup mount. 13. Catalog any unarchived archive logs [ If the files are not cataloged, RMAN does not apply them.] 14. Determine the SCN to which we want to recover by querying V$LOG_HISTORY. 15. Set the SCN to the latest SCN. 16. Issue "ALTER data file <> OFFLINE IMMEDIATE" for all the affected data files. *** 17. Rename the files to new location [ for all the data files.] *** 18. Restore the data files. 19. Issue a switch data file command. 20. Restore the archivelogs. (SQL-BackTrack automates.) SQL-BackTrack reduces this effort to 2 STEPS!! 21. Recover the database. 22. Issue "alter database open resetlogs. 23. If using a recovery catalog then issue a "reset database" command. 24. Shutdown the database. 25. Do a full backup of the database. 26. Determine database and application are ready for production use. *** These steps have to be done for each and every data file 23

24 The SmartDBA Recovery Product Family SmartDBA Recovery Provides comprehensive solutions for intelligent backup and recovery of your complex database environments SQL-BackTrack for Database Provides enterprise level backup and recovery functionality for Oracle, SQL Server, DB2 Universal Database, Sybase and Informix databases SQL-BackTrack for Oracle Enterprise Snapshot Edition extends the SQL-BackTrack product to provide low impact backups in large warehouse environments as well as integration with intelligent storage devices SQL-BackTrack Modules Provides seamless integration with Veritas NetBackup, Legato NetWorker and Tivoli Storage Manager 24

25 SmartDBA Integration GUI is 100% parallel to the text menu Customers may choose to use either or both interfaces 25

26 SQL-BackTrack Key Benefits Improved Backup and Recovery Performance Parallel Streams and Striping increase backup and recovery performance by sending data to multiple locations simultaneously Improved Database Performance during the backup by operating outside of the database kernel Database-Aware Compression minimizes network transfer time of data significantly Enterprise Snapshot leverages your current investment in Intelligent Storage Devices (HW ESS) or system memory (SW ESS) to reduce impact of backup Reduce downtime to minutes instead of hours during cold backups (great for data warehouses) Example: 26 hours reduced to 2 minutes 700x faster! Improve recovery time and reduce the impact on database performance during hot backups 26

27 SQL-BackTrack Key Benefits Manages Complexity Supports your enterprise by providing a common solution regardless of the DBMS, OS and/or hardware in use Automates recovery for a wide range of recovery scenarios from a single object to large clustered databases Supports clustered environments including OPS/RAC, EEE and failover cluster environments Seamless integration with file management systems allowing DBAs full control over their backups and recoveries Leverages intelligent storage devices by performing backups from a mirrored device automatically no intervention by a storage administrator required Encryption secures data at backup time to control access to sensitive information 27

28 SQL-BackTrack Key Benefits Increases Staff Productivity Easy to use and deploy installs and configures in minutes little to no learning curve Web Access from the SmartDBA Cockpit providing administration, recovery and performance utilities from a single interface across your enterprise Simplifies recovery process for DBAs of all levels even junior DBAs can recover with confidence Automated Log Management Monitors archive log destination or thresholds and performs backups based on space and/or number of log files Backup of logs in sets allowing for easier restore Support for multiple log destinations Duplicate a Database feature allows for database cloning off of backups to any server Duplicated database can be a full or partial copy Remote system doesn t require access to the backup media 28

29 SQL-BackTrack Key Benefits Improved Disaster Recovery Simplifies disaster recovery process for system admins, DBAs or anyone responsible for testing and performing a disaster recovery even junior DBAs can recover with confidence Simplified alternate host recovery Automatic discovery of host change Simple text file directory copy and restore Fully guided process using the menu interface One tool fits all by providing support across all popular relational database types Commands and architecture are common across products Same look and feel of tool, only one utility to learn 29

30 SQL-BackTrack Differentiators SmartDBA Recovery Unique Features Added Recovery Assurance Dry Run Backup Cloning Guided Recovery Better Performance Minimal Database Impact Faster Backups and Restores Guided Recovery Enterprise SnapShot Technology Archive Log Management Compression Logical Extraction Restartabiltiy Manageability Easier to configure Guided recovery Automated Duplication Seamless Integration to Storage Management Systems One standard look and feel for Heterogeneous environments: we manage more than just Oracle/UDB/etc. SmartDBA Integration manage backups and recoveries from a single console Recovery experts on staff SmartDBA Recovery gives you functionality not available in other backup methods! 30

31 SmartDBA Roadmap: The Enterprise Recovery Solution 31

32 SmartDBA Roadmap: The Enterprise Recovery Solution 32

33 SmartDBA Space Management Database Space Management Space Expert for Oracle 33

34 Why Are Reorgs Performed? Longer application response times Unnecessary block reads More I/O s required for disorganized data Migrated rows Deleted leaf nodes Inefficient use of disk space Unusable white space Database activity causes disorganization Multiple extents 34

35 Why Some People Don t Reorganize Difficult to know when or what to reorg Very labor intensive Difficult to drop and recreate dependencies properly Error prone Require application downtimes Often lead to unplanned outages 35

36 Making All This Easy Space Expert for Oracle Space Expert for Database Analyzing space utilization Advising the DBA with corrective actions Automating the reorganization process 36

37 Space Management and Database Reorganizations with SmartDBA Identifies objects that can be causing performance problems Migrated rows Deleted leaf nodes Finds objects that are wasting space High Water Mark issues Unused datafiles Over-allocation of space Finds objects that can cause an application outage Objects that cannot extend Objects nearing MAXEXTENTS 37

38 Space Management and Database Reorganizations with SmartDBA SmartDBA will formulate object-by-object recommendations for blocksize, pctfree, and pctused parameters based on database activity observed over time Find and fix the underlying problems don t just fix the symptoms! 38

39 Fast Reliable Reorganizations Reduces the duration of the reorganization Proprietary unload/load technology Process multiple objects simultaneously Unload a single table with parallel unload streams Reduces the number of reorganizations A reorganization will only fix the symptoms of object storage issues Changing the storage parameters will keep the objects from requiring as many subsequent reorganizations Fail-Safe restartable scrip Dry run evaluation Automated restart at point of failure Application always available even in the event of failure 39

40 Reorganization - Flexibility Traditional (Outside) Online (Inside) Temp files F1 T1 T1 T1 T2 Online Read Write Traditional Standard 40

41 Space Expert for Oracle Summary Finds and fixes storage problems Reduces the duration of the reorganization Reduces the number of reorganizations Provides flexibility for reorganizations Automates the reorganization process 41

42 SmartDBA SQL Tuning Database SQL & Application Tuning SQL-Explorer for Oracle 42

43 Tuning SQL With SmartDBA Improve the performance of your business applications by enabling DBAs and developers to identify and tune problematic SQL. 43

44 Tuning SQL With SmartDBA Key Technology High-speed data collector Continuous capture of SQL statements Retrieves SQL directly from Oracle s SGA Stores the captured SQL either locally or in a remote repository Type of data gathered Dynamic SQL currently running Collected SQL (SGA History) 44

45 Tuning SQL With SmartDBA Key Technology Simplify the Tuning Process Automatically generate alternative SQL statements Hints Automated query rewrites Manual user rewrites Create trials to compare statements Provide both actual and simulated results of the trials 45

46 Tuning SQL With SmartDBA Key Technology Simulation Allows you to simulate the execution of a query without having to actually execute it in production Gathers metrics from the production server and uses those metrics to determine how long your SQL will run on that server Init.ora changes 46

47 Tuning SQL With SmartDBA Key Technology Index advisor Views information in the SGA or SQL collections Gather information over a period of time Give Index recommendations Add a column to an index Reorder the columns in a concatenated index Drop an index 47

48 Tuning SQL With SmartDBA 80% of all database performance problems are because of poorly written SQL. How well is your SQL tuned? 48

49 Tuning SQL With SmartDBA High speed SQL collection technology reads SQL directly from Oracle s shared memory segments Collect SQL as it executes in the database with minimal impact to the database server 49

50 Tuning SQL With SmartDBA Collect SQL over time and then review the saved collections Identify your key SQL over time and focus your tuning efforts where you will get the most benefit 50

51 Tuning SQL With SmartDBA Tune SQL from multiple sources including stored database objects (a view in this example) 51

52 Tuning SQL With SmartDBA Automatically tune and test the code 52

53 Tuning SQL With SmartDBA Replace the source code with the optimized SQL 53

54 Tuning SQL With SmartDBA View collected or application SQL by object Get another view of the code see the SQL performing full tablescans or index tablescans Identify indexing and partitioning opportunities See the most used tables and indexes 54

55 Tuning SQL With SmartDBA Use the Index Advisor to recommend indexes to build, change, or drop Uses saved collections of SQL not just a single statement Makes recommendations based on the whole group of collected SQL Get the whole picture of indexing, not just a small piece of the puzzle 55

56 Tuning SQL With SmartDBA 10 Key Init.ora parameters Select create index Test the impact of adding indexes without actually creating them Example: Select statement is issuing full table scan What-if index - an index is created against department_id column 56

57 SQL-Explorer Automates Everything 1. Locate problem queries 2. Run explain plan 3. Interpret Output Operation Order Full table scans Join operations 4. Indexes Too Many Unused No Index Easy Easy Unselective Indexes 5. Rewrite Query Easy 6. Create / Remove indexes 7. Run explain plan 8. Interpret Output Easy 7. Operation Order 8. Full table scans 9. Join operations 9. Compare with previous explain plan(s) Easy 10. Is it better? If not repeat steps 1-6 again 57

58 Connecting Systems and Data Management PATROL Systems Management View Monitoring PATROL for Database Capacity Planning Performance Management Service Level Management PATROL Performance Assurance APPLICATION ERP, Finance, Billing, CRM, etc. SmartDBA Database Management View Daily Tasks SmartDBA Cockpit Diagnostics DBXray Space Management Space Expert Platform Management Network Management Security Management Middleware Management Application Management Storage Management DATABASE DB2 UDB, Oracle, IMS, MS SQL Server, Sybase OS MS Windows, UNIX, OS/390, Red Hat Linux SQL Optimization and Tuning SQL-Explorer Backup and Recovery SQL-BackTrack 58

59 The Solution: SmartDBA Delivering Optimal Business Management IT Goals and Resources Business Service Management Business Objectives SmartDBA Three key innovations that accelerate the workflow Optimize across all critical Simplify data management Accelerate tasks Performance Administration Recovery Intelligent Automation Provide expert Scalable advice and Integration recommendations based on consistently High Speed collected Architecture and shared data Workflow Eliminate requirement for Expert single Integration platform skills specialization Advice Reduce manual effort for tedious Consistent Single Point of and error prone tasks Look & Feel Control Task Automation 59

60 Questions?