Expert Oracle Database 11g Administration

Transcription

1 Expert Oracle Database 11g Administration Sam R. Alapati

2 Expert Oracle Database 11g Administration Copyright 2009 by Sam R. Alapati All rights reserved. No part of this work may be reproduced or transmitted in any form or by any means, electronic or mechanical, including photocopying, recording, or by any information storage or retrieval system, without the prior written permission of the copyright owner and the publisher. ISBN-13 (pbk): ISBN-13 (electronic): Printed and bound in the United States of America Trademarked names may appear in this book. Rather than use a trademark symbol with every occurrence of a trademarked name, we use the names only in an editorial fashion and to the benefit of the trademark owner, with no intention of infringement of the trademark. Lead Editor: Jonathan Gennick Developmental Editor: Douglas Pundick Technical Reviewer: John Watson Editorial Board: Clay Andres, Steve Anglin, Mark Beckner, Ewan Buckingham, Tony Campbell, Gary Cornell, Jonathan Gennick, Michelle Lowman, Matthew Moodie, Jeffrey Pepper, Frank Pohlmann, Ben Renow-Clarke, Dominic Shakeshaft, Matt Wade, Tom Welsh Project Manager: Richard Dal Porto Copy Editor: Ami Knox Associate Production Director: Kari Brooks-Copony Production Editor: Laura Cheu Compositors: Susan Glinert Stevens, Ellie Fountain Proofreader: April Eddy Indexer: John Collin Cover Designer: Kurt Krames Manufacturing Director: Tom Debolski Distributed to the book trade worldwide by Springer-Verlag New York, Inc., 233 Spring Street, 6th Floor, New York, NY Phone SPRINGER, fax , orders-ny@springer-sbm.com, or visit For information on translations, please contact Apress directly at 2855 Telegraph Avenue, Suite 600, Berkeley, CA Phone , fax , info@apress.com, or visit Apress and friends of ED books may be purchased in bulk for academic, corporate, or promotional use. ebook versions and licenses are also available for most titles. For more information, reference our Special Bulk Sales ebook Licensing web page at The information in this book is distributed on an as is basis, without warranty. Although every precaution has been taken in the preparation of this work, neither the author(s) nor Apress shall have any liability to any person or entity with respect to any loss or damage caused or alleged to be caused directly or indirectly by the information contained in this work.

3 To my dear wife, Valerie, as a small token for her immense help and support

4 Contents at a Glance About the Author xxxvii About the Technical Reviewer xxxix Acknowledgments xli Introduction xliii PART 1 Background, Data Modeling, UNIX/Linux, and SQL*Plus CHAPTER 1 The Oracle DBA s World CHAPTER 2 Relational Database Modeling and Database Design CHAPTER 3 Essential UNIX (and Linux) for the Oracle DBA CHAPTER 4 Using SQL*Plus and Oracle Enterprise Manager PART 2 Oracle Database 11g Architecture, Schema, and Transaction Management CHAPTER 5 Oracle Database 11g Architecture CHAPTER 6 Managing Tablespaces CHAPTER 7 Schema Management CHAPTER 8 Oracle Transaction Management PART 3 Installing Oracle Database 11g, Upgrading, and Creating Databases CHAPTER 9 Installing and Upgrading to Oracle Database 11g CHAPTER 10 Creating a Database iv

5 PART 4 Connectivity and User Management CHAPTER 11 Connectivity and Networking CHAPTER 12 User Management and Database Security PART 5 Data Loading, Backup, and Recovery CHAPTER 13 Loading and Transforming Data CHAPTER 14 Using Data Pump Export and Import CHAPTER 15 Backing Up Databases CHAPTER 16 Database Recovery PART 6 Managing the Database CHAPTER 17 Automatic Management and Online Capabilities CHAPTER 18 Managing and Monitoring the Operational Database PART 7 Performance Tuning CHAPTER 19 Improving Database Performance: SQL Query Optimization CHAPTER 20 Performance Tuning: Tuning the Instance APPENDIX Oracle Database 11g SQL and PL/SQL: A Brief Primer INDEX v

6 Contents About the Author xxxvii About the Technical Reviewer xxxix Acknowledgments xli Introduction xliii PART 1 Background, Data Modeling, UNIX/ Linux, and SQL*Plus CHAPTER 1 The Oracle DBA s World The Oracle DBA s Role The DBA s Security Role The DBA s System Management Role The DBA s Database Design Role DBA Job Classifications Types of Databases Online Transaction Processing and Decision-Support System Databases Development, Test, and Production Databases Training and Certification Training Certification Resources and Organizations for Oracle DBAs Oracle by Example Oracle Database Two-Day DBA Course Oracle MetaLink Oracle Web Conference The Daily Routine of a Typical Oracle DBA Some General Advice Know When You Need Help Remember You Are Not Alone Think Outside the Box Primum Non Nocere vii

7 viii CONTENTS CHAPTER 2 Relational Database Modeling and Database Design Relational Databases: A Brief Introduction The Relational Database Model Database Schemas Relational Algebra Relational Calculus SQL Relational Database Life Cycle Requirements Gathering and Analysis Logical Database Design Physical Database Design Implementing the Physical Design Reverse-Engineering a Database Object-Relational and Object Databases The Relational Model The Object Model The Object-Relational Model Semi-Structured Data Models CHAPTER 3 Essential UNIX (and Linux) for the Oracle DBA Overview of UNIX and Linux Operating Systems UNIX Linux Midrange Systems Understanding the UNIX Shell(s) Accessing the UNIX System Overview of Basic UNIX Commands Getting Help: The man Command Changing the Prompt Finding Files and Directories Controlling the Output of Commands Showing the Contents of Files Comparing Files Understanding Operating-System and Shell Variables Redirecting Input and Output Protecting Files from Being Overwritten Navigating Files and Directories in UNIX Files in the UNIX System Linking Files

8 CONTENTS ix Managing Files Permissions: Reading from or Writing to Files in UNIX Directory Management Editing Files with the vi Editor Creating and Modifying Files Using vi Moving Around with the head and tail Commands Extracting and Sorting Text Using grep to Match Patterns Cutting, Pasting, and Joining Text Shell Scripting What Is a Shell Program? Using Shell Variables Evaluating Expressions with the test Command Executing Shell Programs with Command-Line Arguments Analyzing a Shell Script Flow-Control Structures in Korn Shell Programming Dealing with UNIX Processes Gathering Process Information with ps Running Processes after Logging Out Running Processes in the Background Terminating Processes with the kill Command UNIX System Administration and the Oracle DBA UNIX Backup and Restore Utilities The crontab and Automating Scripts Using Telnet Remote Login and Remote Copy Using SSH, the Secure Shell Using FTP to Send and Receive Files UNIX System Performance Monitoring Tools Disks and Storage in UNIX Disk Storage Configuration Choices Monitoring Disk Usage Disk Storage, Performance, and Availability RAID Systems RAID Levels Choosing the Ideal Disk Configuration Redundant Disk Controllers RAID and Backups RAID and Oracle

9 x CONTENTS Other Storage Technologies Storage Area Networks Networked Attached Storage InfiniBand Automatic Storage Management Oracle and Storage System Compatibility CHAPTER 4 Using SQL*Plus and Oracle Enterprise Manager Starting a SQL*Plus Session Setting the Environment Starting a SQL*Plus Session from the Command Line Connecting by Using the CONNECT Command Connectionless SQL*Plus Session with /NOLOG Connecting to SQL*Plus Through a Windows GUI Operating in SQL*Plus Exiting SQL*Plus SQL*Plus and SQL Commands SQL*Plus Security Setting the SQL*Plus Environment with the SET Command Setting Common SQL*Plus Variables SQL*Plus Error Logging SQL*Plus Command-Line Options SQL*Plus Administrative Commands CLEAR Command STORE Command SHOW Command Key SQL*Plus Working Commands SQLPROMPT Command DESCRIBE Command HOST Command SPOOL Command ACCEPT and PROMPT Commands EXECUTE Command PAUSE Command Commands for Formatting Output and Reporting BREAK Command COLUMN Command COMPUTE Command REPFOOTER Command REPHEADER Command BTITLE and TTITLE Commands

10 CONTENTS xi Creating Command Files in SQL*Plus Saving the SQL Buffer Contents to a File Executing SQL Scripts in SQL*Plus Creating a Windows Batch Script DEFINE and UNDEFINE Commands Predefined SQL*Plus Variables Using Comments in SQL*Plus Listing SQL Commands Editing Within SQL*Plus Inserting and Deleting Lines Adding to Text Incorporating Comments with the REMARK Command Copying Tables with the COPY Command Making DML Changes Permanent with SQL*Plus Creating Web Pages Using SQL*Plus Key SQL*Plus Database Administration Commands RECOVER Command STARTUP and SHUTDOWN Commands ARCHIVE LOG Command Using SQL to Generate SQL Oracle SQL Developer Oracle Enterprise Manager Benefits of Using OEM to Manage Databases OEM Architecture and Components Configuring and Using the Database Control Accessing the Database Control A Brief Tour of the Database Control Performance Availability Server Schema Data Movement Software and Support Oracle Software Cloning Configuring Using the Setup Page The Related Links Section and the Advisor Central Page Creating Database Control Roles Linking to MetaLink Policy-Based Configuration Framework Tracking Database Feature-Usage Statistics OEM Grid Control

11 xii CONTENTS Managing the Management Agent The Oracle Management Service Connecting to the Grid Control Logging Into the Grid Control Features of the Grid Control Using the Grid Control Home Page Monitoring Your Entire System with the Grid Control PART 2 Oracle Database 11g Architecture, Schema, and Transaction Management CHAPTER 5 Oracle Database 11g Architecture Oracle Database Structures Logical Database Structures Physical Database Structures Other Files Oracle Processes Interaction Between the User and Oracle Processes The Server Process The Background Processes Oracle Memory Structures Understanding Main Memory The System Global Area The Program Global Area A Simple Oracle Database Transaction Committing and Rolling Back Committing a Transaction Rolling Back a Transaction Data Consistency and Data Concurrency The Database Writer and the Write Ahead Protocol The System Change Number Undo Management Backup and Recovery Architecture User-Managed Backup and Recovery RMAN Oracle Secure Backup Flashback Recovery Techniques

12 CONTENTS xiii The Oracle Data Dictionary and the Dynamic Performance Views The Oracle Data Dictionary The Dynamic Performance (V$) Views The Three Sets of Data Dictionary Views How Is the Data Dictionary Created? Using the Static Data Dictionary Views The Oracle Optimizer Talking to the Database Connecting to Oracle Oracle Enterprise Manager SQL*Plus Oracle Utilities Data Pump Export and Import SQL*Loader LogMiner Automatic Diagnostic Repository Control Interface Scheduling and Resource Management The Oracle Scheduler Database Resource Manager Automatic Database Management Automatic Database Diagnostic Monitor Automatic Undo Retention Tuning Automatic Optimizer Statistics Collection Automatic Storage Management Automatic SQL Tuning Common Manageability Infrastructure Automatic Workload Repository Active Session History Server-Generated Alerts Automated Tasks Feature Advisory Framework Change Management Efficient Managing and Monitoring CHAPTER 6 Managing Tablespaces Tablespace Extent Sizing and Space Management Allocating the Extent Size: Autoallocate vs. Uniform Automatic vs. Manual Segment Space Management

13 xiv CONTENTS Creating Tablespaces Data Files and Tablespaces Extent Allocation and Deallocation Storage Parameters Storage Allocation to Database Objects Adding Space to a Tablespace Removing Tablespaces Number of User Tablespaces Tablespace Quotas Proactive Tablespace Space Alerts Managing Logging of Redo Data Renaming Tablespaces Read-Only Tablespaces Taking Tablespaces Offline Temporary Tablespaces Creating a Temporary Tablespace Altering a Temporary Tablespace Shrinking Temporary Tablespaces Default Temporary Tablespace Temporary Tablespace Groups Default Permanent Tablespaces Bigfile Tablespaces Restrictions on Using Bigfile Tablespaces Creating Bigfile Tablespaces Altering a Bigfile Tablespace Viewing Bigfile Tablespace Information Managing the Sysaux Tablespace Creating the Sysaux Tablespace Usage Restrictions for the Sysaux Tablespace Encrypting Tablespaces Why You Need Encrypted Tablespaces Creating the Oracle Wallet Creating an Encrypted Tablespace Data Dictionary Views for Managing Tablespaces DBA_TABLESPACES DBA_FREE_SPACE DBA_SEGMENTS DBA_DATA_FILES DBA_TABLESPACE_GROUPS V$DATAFILE V$FILESTAT

14 CONTENTS xv Easy File Management with Oracle Managed Files Benefits of Using OMF Creating Oracle Managed Files Different Types of Oracle Managed Files Copying Files Between Two Databases COPY_FILE GET_FILE PUT_FILE Finding Out How Much Free Space Is Left Working with Operating System Files Using the UTL_FILE Package Key UTL_FILE Procedures and Functions Exceptions A Simple Example Using the UTL_FILE Package CHAPTER 7 Schema Management Types of SQL Statements System-Control Statements Session-Control Statements Embedded SQL Statements Data Manipulation Language Statements Transaction-Control Statements Data Definition Language Statements Oracle Schemas Oracle Tables Estimating the Table Size Creating a Simple Table What Is a Null Value? Default Values for Columns Virtual Columns Adding a Column to a Table Dropping a Column from a Table Renaming a Table Column Renaming a Table Removing All Data from a Table Creating a New Table with the CTAS Option Placing a Table in Read-Only Mode Table Compression Dropping Tables

15 xvi CONTENTS Special Oracle Tables Temporary Tables Index-Organized Tables External Tables Partitioned Tables Range Partitioning Interval Partitioning Hash Partitioning List Partitioning Reference Partitioning Virtual Column-Based Partitioning System Partitioning Composite Partitioning Partition Maintenance Operations Data Dictionary Views for Managing Tables Clusters Hash Clusters Oracle Indexes Guidelines for Creating Indexes Oracle Index Schemes Estimating the Size of an Index Creating an Index Special Types of Indexes Bitmap Indexes Reverse-Key Indexes Key-Compressed Indexes Function-Based Indexes Partitioned Indexes Invisible Indexes Monitoring Index Usage Index Maintenance Managing Database Integrity Constraints Primary Key Constraints Not Null Constraints Check Constraints Unique Constraints Referential Integrity Constraints Integrity Constraint States Rely Constraints Deferrable and Immediate Constraints

16 CONTENTS xvii Constraint- and Index-Related Views DBA_CONSTRAINTS DBA_CONS_COLUMNS Using Views Using Materialized Views Query Rewriting The Rewrite_or_Error Hint Rewrite Integrity Refreshing Materialized View Data Using the DBMS_MVIEW Package Creating Materialized Views Creating the Materialized View Using the SQL Access Advisor Using the OEM Database Control Using the DBMS_ADVISOR Package Using the QUICK_TUNE Procedure Using Synonyms Creating a Public Synonym Creating a Private Synonym Dropping a Synonym Managing Synonyms Switching to a Different Schema Using Sequences Using Triggers Viewing Object Information Views for Managing Database Objects DBA_OBJECTS DBA_TABLES DBA_EXTERNAL_TABLES DBA_TAB_PARTITIONS DBA_PART_TABLES DBA_TAB_MODIFICATIONS DBA_TAB_COLUMNS DBA_VIEWS DBA_MVIEWS DBA_INDEXES DBA_IND_COLUMNS INDEX_STATS

17 xviii CONTENTS CHAPTER 8 Oracle Transaction Management Oracle Transactions COMMIT Statement ROLLBACK Statement Transaction Properties Transaction Concurrency Control Concurrency Problems Schedules and Serializability Isolation Levels and the ISO Transaction Standard Oracle s Isolation Levels Transaction- and Statement-Level Consistency Changing the Default Isolation Level Implementing Oracle s Concurrency Control Oracle Locking Methods Oracle Lock Types Allowing DDL Locks to Wait for DML Locks Explicit Table Locking Explicit Locking in Oracle Managing Oracle Locks Using Undo Data to Provide Read Consistency Automatic Undo Management Guaranteed Undo Retention Using the OEM to Manage Undo Data Flashback Error Correction Using Undo Data Querying Old Data with Flashback Query Flashback Using the DBMS_FLASHBACK Package Flashback Versions Query Flashback Transaction Query Using Flashback Transaction Query and Flashback Versions Query Together The Flashback Table Feature Transaction Management Discrete Transactions Autonomous Transactions Resumable Space Allocation Resumable Operations Common Resumable Errors Using the Resumable Space Allocation Feature Notification of Suspended Operations Operation-Suspended Alert Monitoring Resumable Space Allocation

18 CONTENTS xix Managing Long Transactions Benefits of Using the Workspace Manager Table Versioning and Workspaces PART 3 Installing Oracle Database 11g, Upgrading, and Creating Databases CHAPTER 9 Installing and Upgrading to Oracle Database 11g Installing Oracle Reviewing the Documentation Determining Disk and Memory Requirements Optimal Flexible Architecture Mount Points Directory and File-Naming Conventions Performing Preinstallation Tasks Checking the Preinstallation Requirements System Administrator s Preinstallation Tasks Oracle Owner s Preinstallation Tasks A Final Checklist for the Installation Accessing the Installation Software Installing the Software Using Response Files to Install Oracle Software After the Installation System Administrator s Post-Installation Tasks Oracle Owner s Post-Installation Tasks Uninstalling Oracle Removing All Oracle Databases Running on Your Server Removing the Oracle Software Upgrading to Oracle Database 11g Routes to Oracle Database 11g Upgrade Methods and Tools The Manual Upgrade Process The Database Upgrade Assistant The Pre-Upgrade Information Tool The Post-Upgrade Status Tool Preparing the Database for the Upgrade

19 xx CONTENTS Upgrading with the DBUA Starting the DBUA Running the DBUA Restoring the Pre-Upgrade Database Upgrading Manually Upgrade and Downgrade Scripts Creating a Spool File Running the Pre-Upgrade Information Tool Backing up the Database Copying the Parameter File Starting Up the New Database Running the Upgrade Script Running the Upgrade Actions Script Restarting the Instance Running the Post Upgrade Actions Script Checking for Invalid Objects Recompiling and Validating Objects Running the Post-Upgrade Status Tool Ending the Spool File Restarting the New Database After the Upgrade Resetting Passwords for Stronger Password Protection Downgrading to an Old Version CHAPTER 10 Creating a Database Getting Ready to Create the Database Installing the Oracle Software Creating the File System for the Database Ensuring Sufficient Memory Allocation Getting Necessary Authorizations Setting the OS Environment Variables Creating the Parameter File Types of Database Parameter Files The Initialization Parameter File Changing the Initialization Parameter Values Important Oracle Database 11g Initialization Parameters Undocumented Initialization Parameters Viewing the Current Initialization Parameter Values

20 CONTENTS xxi Creating a New Database Manual Creation Using the DBCA to Create a Database Using a Server Parameter File Creating a Server Parameter File Setting the Scope of Dynamic Parameter Changes Creating an SPFILE or PFILE from Memory Starting Up and Shutting Down the Database from SQL*Plus Starting the Database Automatically Starting Databases Restricting Database Access Shutting Down the Database Quiescing a Database Suspending a Database Dropping a Database Using the Data Dictionary to Monitor Database Status What Next? PART 4 Connectivity and User Management CHAPTER 11 Connectivity and Networking Oracle Networking and Database Connectivity Networking Concepts: How Oracle Networking Works How a Web Application Connects to Oracle Database Instance Names Global Database Names Database Service Names Connect Descriptors Connect Identifiers Connect Strings Establishing Oracle Connectivity The Oracle Client Installing the Oracle Client Using the TWO_TASK Environment Variable The Instant Client Installing the Instant Client

21 xxii CONTENTS The Listener and Connectivity Automatic Service Registration Listener Commands Listener Management Naming and Connectivity The Local Naming Method The Easy Connect Naming Method Database Resident Connection Pooling The External Naming Method The Directory Naming Method Oracle and Java Database Connectivity Establishing Database Connectivity Working with the Database A Complete Program CHAPTER 12 User Management and Database Security Managing Users Temporary and Default Tablespaces Creating a New User Altering a User Dropping a User Creating and Using User Profiles Managing Resources The Database Resource Manager Using the Database Resource Manager Using OEM to Administer the Database Resource Manager Controlling Database Access Privileges in an Oracle Database Roles Using Views and Stored Procedures to Manage Privileges DBA Views for Managing Users, Roles, and Privileges Fine-Grained Data Access Auditing Database Usage Standard Auditing Fine-Grained Auditing Authenticating Users Database Authentication External Authentication Proxy Authentication Centralized User Authorization

22 CONTENTS xxiii Enterprise User Security Shared Schemas Single Sign-On Data Encryption Tablespace Encryption Oracle Internet Directory Database Security Dos and Don ts Automatic Secure Configuration User Accounts Passwords Operating System Authentication Database Auditing Granting Privileges Dealing with Environments with Multiple DBAs Protecting the Data Dictionary Setting Permissions The Network and the Listener Fine-Grained Network Access Control Oracle s Advanced Security Option Application Security Useful Techniques for Managing Users PART 5 Data Loading, Backup, and Recovery CHAPTER 13 Loading and Transforming Data An Overview of Extraction, Transformation, and Loading Using the SQL*Loader Utility Exploring the SQL*Loader Control File Generating Data During the Load Invoking SQL*Loader Exploring the Loader Log File Using Return Codes Using the Direct-Path Loading Method Some Useful SQL*Loader Data-Loading Techniques

23 xxiv CONTENTS Using External Tables to Load Data Creating the External Table Layer Populating External Tables Using an External Table Using SQL*Loader to Generate External Table Creation Statements Transforming Data Deriving the Data from Existing Tables Using SQL to Transform Data Using the SQL MODEL Clause Using Oracle Streams for Replication and Information Sharing Exploring the Streams Architecture Setting Up Oracle Streams CHAPTER 14 Using Data Pump Export and Import Introduction to the Data Pump Technology Benefits of the Data Pump Technology Uses for Data Pump Export and Import Data Pump Components Data-Access Methods Data Pump Files Data Pump Privileges The Mechanics of a Data Pump Job Performing Data Pump Exports and Imports Data Pump Export Methods Data Pump Export Modes Data Pump Export Parameters Data Pump Export Examples Data Pump Import Types and Modes Data Pump Import Parameters Monitoring a Data Pump Job Viewing Data Pump Jobs Viewing Data Pump Sessions Viewing Data Pump Job Progress Using the Data Pump API Transportable Tablespaces Uses for Transportable Tablespaces Transporting a Tablespace

24 CONTENTS xxv Transporting Tablespaces Across Platforms with Different Endian Formats CHAPTER 15 Backing Up Databases Backing Up Oracle Databases Important Backup Terms Backup Guidelines Testing Your Backups Maintaining a Redundancy Set Backup Strategies The Flash Recovery Area Benefits of the Flash Recovery Area Setting the Size of the Flash Recovery Area Ways to Create a Flash Recovery Area Backing Up the Flash Recovery Area Working with the Flash Recovery Area Recovery Manager Benefits of RMAN RMAN Architecture Connecting to RMAN Scripting with RMAN Important RMAN Terms Specifying Backup Tags and Backup Formats Making Copies of RMAN Backups RMAN Backup Locations RMAN Commands RMAN Configuration Parameters Working with the Recovery Catalog Maintaining the Recovery Catalog Virtual Private Catalogs Examples of RMAN Backups Restarting an RMAN Backup Specifying Limits for Backup Duration Incrementally Updated Backups Fast Incremental Backups RMAN Compressed Backups Archival Backups Monitoring and Verifying RMAN Jobs Backing Up the Control File

25 xxvi CONTENTS Oracle Secure Backup Benefits of Oracle Secure Backup Oracle Secure Backup Administrative Domain Installing Oracle Secure Backup Using the Oracle Backup Web Interface Tool Configuring Oracle Secure Backup Performing Backups with Oracle Secure Backup User-Managed Backups Making Whole Database Backups Making Partial Database Backups Monitoring User-Managed Online Backups Database Corruption Detection Detecting Media Corruption Detecting Data Block Corruption Enhanced Data Protection for Disaster Recovery High-Availability Systems Oracle Data Guard and Standby Databases CHAPTER 16 Database Recovery Types of Database Failures System Failures Data Center Disasters Human Error Media Failures Failures and Data Repair The Oracle Recovery Process Crash and Instance Recovery Faster Instance Startup Media Recovery Media Recovery vs. Nonmedia Recoveries Performing Recovery with RMAN RMAN s Advantages for Recovery Using VALIDATE BACKUP to Validate RMAN Backups Using the RESTORE... VALIDATE Command Using the RESTORE... PREVIEW Command Identifying Necessary Files for Recovery RMAN Recovery Procedures Recovering with Incrementally Updated Backups

26 CONTENTS xxvii Monitoring RMAN Jobs User-Managed Recovery Procedures Typical Media Recovery Scenarios Complete Recovery of a Whole Database Recovering a Tablespace Recovering a Datafile Incomplete Recovery Recovering from the Loss of Control Files Recovering a Datafile Without a Backup The Data Recovery Advisor Working with the Data Recovery Advisor Cloning a Database Using RMAN to Clone a Database Using Database Control to Clone a Database Manually Cloning a Database Techniques for Granular Recovery Tablespace Point-in-Time Recovery Using LogMiner for Precision Recovery Flashback Techniques and Recovery Flashback Levels Flashback vs. Traditional Recovery Techniques Flashback Drop Flashback Database Using Restore Points Guaranteed Restore Points Viewing Restore Points Repairing Data Corruption and Trial Recovery Block Media Recovery Trial Recovery Troubleshooting Recovery Errors The ORA Error The ORA Error The ORA Error The Transaction Backout Feature Flashback Data Archive Managing the Flashback Data Archive Enabling the Flashback Data Archive Using Flashback Data Archives: Examples

27 xxviii CONTENTS PART 6 Managing the Database CHAPTER 17 Automatic Management and Online Capabilities The Automatic Database Diagnostic Monitor The Purpose of the ADDM Problems That the ADDM Diagnoses ADDM Findings ADDM Recommendations Managing the ADDM Automatic Memory Management Different Types of Memory Management Enabling Automatic Memory Management Tuning Automatic Memory Management Automatic Memory Parameter Dependency Automatic Optimizer Statistics Collection Automatically Collecting Optimizer Statistics Manually Collecting Optimizer Statistics Automatic Storage Management Benefits of ASM Examining the ASM Architecture Installing ASM ASM and Cluster Synchronization Service Creating an ASM Instance The ASM Fast Mirror Resync Feature ASM Preferred Mirror Read Changing ASM Disk Group Attributes The asmcmd Command-Line Tool Managing ASM Disk Groups Adding Performance and Redundancy with Disk Groups Creating a Disk Group Adding Disks to a Disk Group Dropping Disks and Disk Groups Rebalancing Disk Groups Managing ASM Files Types of ASM Filenames Working with ASM Filenames ASM File Templates Creating an ASM-Based Database Migrating Your Database to ASM

28 CONTENTS xxix Automatic Space Management Automatic Undo Management Easy File Management with OMF Online Segment Shrinking and the Segment Advisor Manual Segment Shrinking Using the Segment Advisor to Shrink Segments Automatic Segment Advisor Job Automatic Checkpoint Tuning Online Capabilities of Oracle Database 11g Online Data Reorganization Online Data Redefinition Dynamic Resource Management Online Database Block-Size Changes Using Database Quiescing for Online Maintenance Suspending the Database CHAPTER 18 Managing and Monitoring the Operational Database Types of Oracle Performance Statistics Cumulative Statistics Sample Data Baseline Data Database Metrics Server-Generated Alerts Default Server-Generated Alerts Baseline Metrics and Adaptive Thresholds Managing Alerts Proactive Tablespace Alerts Using the Alert Logs and Trace Files for Monitoring Data Dictionary Views Related to Metrics and Alerts The Automatic Workload Repository Types of Data Collected by the AWR AWR Data Handling Managing the AWR Moving Window Baselines AWR Baseline Templates Active Session History Current Active Session Data Older Active Session History Data Producing an ASH Report

29 xxx CONTENTS The Management Advisory Framework The Management Advisors Managing the Advisory Framework Working with the Undo and the MTTR Advisors Using the Undo Advisor Using the MTTR Advisor Managing Online Redo Logs Hardware Mirroring vs. Oracle Multiplexing Online Redo Log Groups Creating Online Redo Log Groups Adding Redo Log Groups Renaming Redo Log Files Dropping Online Redo Logs Online Redo Log Corruption Monitoring the Redo Logs Managing Database Links Creating a Private Database Link Creating a Public Database Link Using the Database Control to Create Database Links Comparing and Converging Database Objects Comparing Data Converging Data Copying Files with the Database Server Requirements for the File Copy Copying Files on a Local System Transferring a File to a Different Database Mapping Oracle Files to Physical Devices Architecture of File Mapping Setting Up File Mapping Using the Oracle Scheduler Basic Scheduler Components Types of Scheduler Jobs Advanced Scheduler Components Scheduler Architecture Scheduler Privileges Managing the Basic Scheduler Components Managing Lightweight Jobs Managing External Jobs Managing Advanced Scheduler Components Managing Scheduler Attributes

30 CONTENTS xxxi Purging Job Logs Default Scheduler Jobs Automated Maintenance Tasks Predefined Maintenance Windows Managing Automated Maintenance Tasks Monitoring Automated Maintenance Tasks Fault Diagnosability Automatic Diagnostic Repository ADRCI Incident Packaging Service The Support Workbench The Health Monitor Repairing SQL Statements with the SQL Repair Advisor The SQL Test Case Builder PART 7 Performance Tuning CHAPTER 19 Improving Database Performance: SQL Query Optimization An Approach to Oracle Performance Tuning A Systematic Approach to Performance Tuning Reactive Performance Tuning Optimizing Oracle Query Processing Parsing Optimization Query Execution Query Optimization and the Oracle CBO Choosing Your Optimization Mode Providing Statistics to the Optimizer Setting the Optimizer Mode Setting the Optimizer Level What Does the Optimizer Do? Drawbacks of the CBO Providing Statistics to the CBO Deferred Statistics Publishing Extended Statistics The Cost Model of the Oracle Optimizer Collecting System Statistics

31 xxxii CONTENTS Collecting Statistics on Dictionary Objects Frequency of Statistics Collection What Happens When You Don t Have Statistics Using the OEM to Collect Optimizer Statistics Writing Efficient SQL Efficient WHERE Clauses Using Hints to Influence the Execution Plan Selecting the Best Join Method Using Bitmap Join Indexes Selecting the Best Join Order Indexing Strategy Monitoring Index Usage Removing Unnecessary Indexes Using Similar SQL Statements Reducing SQL Overhead Via Inline Functions Using Bind Variables Avoiding Improper Use of Views Avoiding Unnecessary Full Table Scans How the DBA Can Help Improve SQL Processing Using Partitioned Tables Using Compression Techniques Using Materialized Views Using Stored Outlines to Stabilize the CBO SQL Plan Management SQL Plan Baselines Capturing SQL Plan Baselines The SQL Management Base Using Parallel Execution Other DBA Tasks Adaptive Cursor Sharing How Adaptive Cursor Sharing Works Monitoring Adaptive Cursor Sharing SQL Performance Tuning Tools Using EXPLAIN PLAN Using Autotrace Using SQL Trace and TKPROF End-to-End Tracing Using the DBMS_MONITOR Package Using the V$SQL View to Find Inefficient SQL

32 CONTENTS xxxiii The SQL Tuning Advisor Using the SQL Tuning Advisor How the SQL Tuning Advisor Works The SQL Tuning Advisor in Practice The Automatic SQL Tuning Advisor Interpreting Automatic SQL Tuning Reports Using Other GUI Tools Using the Result Cache Managing the Result Cache Setting the RESULT_CACHE_MODE Parameter Managing the Result Cache The PL/SQL Function Result Cache The Client Query Result Cache A Simple Approach to Tuning SQL Statements Identify Problem Statements Locate the Source of the Inefficiency Tune the Statement Compare Performance CHAPTER 20 Performance Tuning: Tuning the Instance An Introduction to Instance Tuning Automatic Performance Tuning vs. Dynamic Performance Views Tuning Oracle Memory Tuning the Shared Pool Hard Parsing and Soft Parsing Tuning the Buffer Cache Tuning the Large Pool, Streams Pool, and Java Pool Tuning PGA Memory Evaluating System Performance CPU Performance Memory Disk I/O Measuring I/O Performance Is the I/O Optimally Distributed? Reducing Disk Contention The Oracle SAME Guidelines for Optimal Disk Usage Network Performance

33 xxxiv CONTENTS Measuring Instance Performance Database Hit Ratios Database Wait Statistics Wait Events and Wait Classes Analyzing Instance Performance Examining System Performance Know Your Application Using the ADDM to Analyze Performance Problems Using AWR Reports for Individual SQL Statements Operating System Memory Management Analyzing Recent Session Activity with an ASH Report When a Database Hangs Handling a Stuck Archiver Process System Usage Problems Excessive Contention for Resources Locking Issues Abnormal Increase in Process Size Delays Due to Shared Pool Problems Problems Due to Bad Statistics Collecting Information During a Database Hang Using the Database Control s Hang Analysis Page A Simple Approach to Instance Tuning What s Happening in the Database? Using the OEM Database Control to Examine Database Performance Are There Any Long-Running Transactions? Is Oracle the Problem? Is the Network Okay? Is the System CPU Bound? Is the System I/O Bound? Is the Database Load Too High? Checking Memory-Related Issues Are the Redo Logs Sized Correctly? Is the System Wait Bound? The Compare Periods Report Eliminating the Contention Real Application Testing Database Replay SQL Performance Analyzer

34 CONTENTS xxxv APPENDIX Oracle Database 11g SQL and PL/SQL: A Brief Primer INDEX

35 About the Author SAM ALAPATI is currently an independent Oracle consultant, working at ERCOT (Electric Reliability Council of Texas). Prior to this, Sam was an Oracle DBA at the Boy Scouts of America, Sabre, Oracle Corporation, NBC, and AT&T. Sam has previously written Expert Oracle9i Database Administration and Expert Oracle Database 10g Administration, both for Apress, as well as three OCP certification books for Oracle Press. Sam has also coauthored Oracle Database 11g RMAN Recipes and Oracle Database 11g New Features for DBAs and Developers, both published by Apress. Sam has been working with relational databases since 1985, starting with the Ingres database. xxxvii