Oracle 11gR2 New Features for RAC. OTN APAC Tour (Thailand, China, Philippines, New Zealand)

Size: px

Start display at page:

Download "Oracle 11gR2 New Features for RAC. OTN APAC Tour (Thailand, China, Philippines, New Zealand)"

Augustine Young
5 years ago
Views:

1 Oracle 11gR2 New Features for RAC OTN APAC Tour (Thailand, China, Philippines, New Zealand)

2 About me Independent Oracle Consultant - Summersky Enterprises murali.vallath@summersky.biz blog: twitter/ym/skype: muralivallath murali.vallath@summersky.biz

3 Oracle Clusterware Components Grid Infrastructure New in CRS Stack CRS CSS EVM CTSS ONS ASM oraagent orarootagent crfmond HAS Stack GNS mdns GIPCD GPnPD crflogd

4 ClusterWare Files Oracle Cluster Registry (OCR) Oracle Local Registry (OLR) Voting Disk New in GPnP Profile

Oracle Clusterware Network Switch Public Network Interconnect Switch Cluster

2 ORADB1 ORADB2 ORADB3 ORADB4 VIP VIP SSKY3 VIP SSKY4 VIP SSKY1 SSKY2 GIPCD

CRS GPnP CTSS CSS EVM CRS GPnP CTSS CSS EVM CRS HAS HAS SAN switch HAS HAS

5 Oracle Clusterware Network Switch Public Network Interconnect Switch Cluster Interconnect New in ORADB1 ORADB2 ORADB3 ORADB4 VIP VIP SSKY3 VIP SSKY4 VIP SSKY1 SSKY2 GIPCD CRFMOND/LOGD DISKMON DISKMON DISKMON OCR CSS EVM NM GM CRS GPnP CTSS CSS EVM CRS GPnP CTSS CSS EVM CRS GPnP CTSS CSS EVM CRS HAS HAS SAN switch HAS HAS OLR OLR OLR OLR OCR prddb Vote Disk AA_00 AB_01 AC_02 AD_03 AE_04 AF_05 AG_06 AH_07 Summersky Enterprises LLC Murali Vallath Slide: 5

6 GPnPD Grid Plug and Play Daemon Started before CSS Allows easy addition and deletion of nodes Dynamic management of VIPs Maintains essential cluster information in an XML profile: Cluster name and unique cluster identifier Public and private network interface mappings Location for the OCR and voting disks Location for the ASM parameter file Manages and distributes the profile using the GPnP daemon Defines cluster name, networks and storage New in Summersky Enterprises LLC Murali Vallath Slide: 6

7 GPnP Profile New in Summersky Enterprises LLC Murali Vallath Slide: 7

8 CTSSD Provides automatic time synchronization across cluster nodes If NTP is present, CTSS will run in observer mode Starts in active mode. Installed as part of Grid Infrastructure installation. CTSS runs in two ways: Observer mode: If NTP is enabled, CTSS only observes. Active mode: If NTP is not enabled, CTSS designates one node as a master clock and synchronizes the other nodes. Started by OHAS daemon Summersky Enterprises LLC Murali Vallath Slide: 8

9 Cluster Stack Invocation init ASM EVMD ASM Instance oraagent GPNPD MDNSD DB Instance eons ONS Listener CRSD SCAN GNSD OHASD orarootagent CSSD Monitor CTSSD VIP SCAN VIP GNS VIP Network GNSD cssdagent CSSD Summersky Enterprises LLC Murali Vallath Slide: 9

10 OCR Level Resource Name Description New in SYSTEM Version Grid Infrastructure Version WALLET Security Wallet Manager GNS Grid Naming Services CSS Cluster Synchronization Services EVM Event Manager CRS Cluster Ready Services ACFS ASM Cluster File System GPnP Grid Plug & Play ORA_CRS_HOME GRID_HOME CRSD Cluster Ready Services Deamon DIAG Diagnostics CRSADMIN Grid Infrastructure Administrator CRSUSER Grid Infrastructure User 2 DATABASE NODEAPPS Node apps VIP_RANGE VIP range address LOG DATABASES Summersky Enterprises LLC 11gR2 RAC Murali Vallath Slide: 10

Process OCR Process OCR Process OEM Agent OUI srvctl OEM Agent

11 OCR Public Interface Cluster Interconnect ORADB1 ORADB2 ORADB3 ORADB4 OCR Cache OCR Cache OCR Cache OCR Cache OCR Process OCR Process OCR Process OCR Process OEM Agent OUI srvctl OEM Agent OCR (repository) Summersky Enterprises LLC Murali Vallath Slide: 11

12 Level Resource Name Description 1 SYSTEM crs Cluster Ready Services ORA_CRS_HOME WALLET GNS version GPnP css network OHASD OLR OCR GRID_HOME Security Wallet Manager Grid Nam Grid Infrastructure Version Grid Plug & Play Cluster Synchronization Services Network 2 DATABASE NODEAPPS Node Apps VIP_RANGE LOG ASM DATABASES OLR Oracle High Availability Services Deamon Oracle Local Repository manual backup info OCR Auto Backup info IP ranges used for VIP Logs ASM New in List of Databases Summersky Enterprises LLC 11gR2 RAC Murali Vallath Slide: 12

13 OCRDUMP Dump contents of Oracle Cluster/Local Registry to a file. ocrdump [-local] [<filename> [-xml]

14 Clusterware Log Directories ohasd crsd cssd evmd diag agent ohasd orarootagent_root oragent_oracle oracssdmonitor_root oracssdagent_root gpnpd GRID HOME log <nodename> e.g.. prddb1 gnsd client gipcd crsd orarootagent_root oragent_oracle oracssdmonitor_root crs diskmon srvm admin ctssd mdnsd racgmain racg racgevtf racgeut alert<nodename>.log

15 Clusterware Log Directories GRID HOME log crs diag node tnslsnr clients <node> user_root host_<nnnnn> listener_scan3 listener_scan2 listener_scan1 sweep stage metadata lck incpkg incident sweep stage metadata lck incpkg incident cdump alert trace cdump alert adrci_dir.mif trace

16 Clusterware Log Directories ohasd crsd cssd evmd diag agent ohasd orarootagent_root oragent_oracle oracssdmonitor_root oracssdagent_root gpnpd GRID HOME New in log <nodename> e.g.. prddb1 crs gnsd client gipcd diskmon srvm crsd orarootagent_root oragent_oracle oracssdmonitor_root acfssec admin acfsreplroot ctssd acfsrepl mdnsd racgmain crflogd racg racgevtf crfmond racgeut alert<nodename>.log Summersky Enterprises LLC Murali Vallath Slide: 16

17 VIP s Database VIP (also called RAC VIP) Application VIP HAIP (IC VIP) New in Summersky Enterprises LLC 11gR2 RAC Murali Vallath Slide: 17

18 Cluster Interconnect New in Oracle uses the interconnect for cache synchronization Interconnect is also used for Data blocks Locks SCN numbers Messages Summersky Enterprises LLC 11gR2 RAC Murali Vallath Slide: 18

19 Redundant Interconnects New in CLUSTER_INTERCONNECT NIC Bonding HAIP Summersky Enterprises LLC 11gR2 RAC Murali Vallath Slide: 19

20 Verify Deamons $GRID_HOME/bin/crsctl stat res -t -init NAME TARGET STATE SERVER STATE_DETAILS ora.asm 1 ONLINE ONLINE devsrv1 Started ora.cluster_interconnect.haip 1 ONLINE ONLINE devsrv1 ora.crf 1 ONLINE ONLINE devsrv1 ora.crsd 1 ONLINE ONLINE devsrv1 ora.cssd 1 ONLINE ONLINE devsrv1 ora.cssdmonitor 1 ONLINE ONLINE devsrv1 ora.ctssd 1 ONLINE ONLINE devsrv1 OBSERVER Summersky Enterprises LLC Murali Vallath Slide: 20

21 Part II Oracle Real Application Cluster Murali Vallath Slide: 21

22 RAC Background Process ACMS Atomic Controlfile to Memory Service GTX0-j Global Transaction Process RMSn Oracle RAC Management Processes (RMSn) RMSN Remote Slave Monitor LMS Global Cache Service Processes LMON Global Enqueue Service Monitor LMD Global Enqueue Service Daemon New in LCK Lock Process DBRM Database Resource Manager PING Response time agent Summersky Enterprises LLC Oracle Real Application Cluster Murali Vallath Slide: 22

23 ACMS Atomic Controlfile to Memory Service ACMS is behaves like an agent background process that contributes to ensuring a distributed SGA memory update is either globally committed on success or globally aborted if a failure occurs

24 GTX0-j Global Transaction Process GTX0-j process provides transparent support for XA global transactions in a RAC environment. The database autotunes the number of these processes based on the workload of XA global transaction.

25 RMSn Oracle RAC Management Process RMSn processes perform manageability tasks for RAC. Primarily around resource management when instances are added or removed from the cluster.

26 RMSN Remote Slave Monitor RMSN are slave background processes and perform tasks on behalf of a coordinating process running in another instance.

27 LMS Global Cache Service When spawned by Oracle, copy blocks directly from the holding instance s buffer cache and send a read consistent copy of the block to the requesting foreground process on the requesting instance to be placed into the buffer cache. LMS rolls back any uncommitted transactions for any blocks that are being requested for consistent read by the remote instance. RAC software provides for up to 36 LMS processes, depending on the amount of messaging traffic. Oracle uses new algorithm to allocate LMS processes New in Summersky Enterprises LLC Oracle Real Application Cluster Murali Vallath Slide: 27

28 SCAN SCAN Single Client Access Number Similar to a cluster alias available on Tru64 and VMS clusters Helps load balance across the database cluster Clients do not require VIP information Removes the requirement to change the client connection if cluster changes Must resolve to atleast one address on the public network Best practice.. resolve to 3 addresses for the entire cluster

29 SCAN Allows clients to use EZConnect or simple JDBC connections Each cluster will have 3 SCAN listeners, each having a SCAN VIP defined as cluster resources on network 1 A SCAN VIP/LISTENER will failover to another node in the cluster Instance registers with local listener on its node Database REMOTE_LISTENER registers instances with all SCAN listeners

30 Advanced Installation

31 SCAN/GNS Configuration SCAN configuration GNS configuration

32 Server Pools Node 1 Node 2 Node 3 Node 4 Node 5 Node 6 Node 7 Node 8 Node 9 Node 10 ssky1 ssky2 ssky3 ssky4 oltp5 oltp6 oltp7 dwh8 dwh9 dwh10 sskypool1 Min=2 Max=4 sskypool2 Min=3 Max=3 sskypool3 Min=3 Max=3

33 Server Pools Logical division of the cluster into pools of servers Applications (e.g. databases) can be configured to run in one or more server pools Managed by crsctl (applications), srvctl (Oracle) Defined by 3 attributes: MIN - minimum number of servers (default 0) MAX maximum number of servers (default 0 or -1) IMPORTANCE 0 (least important) to 1000

34 Server Pools One-to-one mapping between a database service and server pool A database service can only be defined to operate in one pool UNIFORM all servers in the pool SINGLETON one server in the pool Resources are contained in logical groups of server pools

35 Types of Server Pools System defined Free Generic User defined

36 Server Pools

37 Server Pools

38 Server Pools Node 1 Node 2 Node 3 Node 4 Node 5 Node 6 Node 7 Node 8 Node 9 Node 10 ssky1 ssky2 ssky3 ssky4 oltp5 oltp5 oltp6 oltp7 dwh8 dwh9 dwh10 sskypool1 Min=2 Max=4 sskypool2 Min=3 Max=3 sskypool3 Min=3 Max=3

39 Server Pools Node 1 Node 2 Node 3 Node 48 ssky1 ssky2 ssky3 ssky4 dwh8 oltp5 Node 5 Node 6 Node 7 Node 8 Node 9 Node 10 oltp5 oltp6 oltp7 dwh8 dwh9 dwh10 sskypool1 Min=3 Max=4 Importance = 10 sskypool2 Min=3 Max=3 Importance = 20 sskypool3 Min=3 Max=3 Importance = 30

40 crsctl Check if autostart of ohasd is configured crsctl config crs $GRID_HOME/bin/crsctl config crs CRS-4622: Oracle High Availability Services autostart is enabled.

41 crsctl Check the health of Oracle Clusterware crsctl check crs bin]#./crsctl check crs CRS-4638: Oracle High Availability Services is online CRS-4537: Cluster Ready Services is online CRS-4529: Cluster Synchronization Services is online CRS-4533: Event Manager is online

42 crsctl Add additional voting disk to CFS crsctl add css votedisk E.g.. crsctl add css votedisk /u03/oradata/cssvotedisk root]# crsctl add css votedisk /u03/oradata/cssvotedisk Now formatting voting disk: /u03/oradata/cssvotedisk Read -1 bytes of 512 at offset 0 in voting device (CssVoteDisk) successful addition of votedisk /u03/oradata/cssvotedisk.

crsctl Query css voting disk crsctl query css votedisk [root@prddb1 bin]#.

43 crsctl Query css voting disk crsctl query css votedisk bin]#./crsctl query css votedisk ## STATE File Universal Id File Name Disk group ONLINE b cc244fb0bf79f51c9fbb1f60 (ORCL:ASM_SSKY1) [PRD_GRID] Located 1 voting disk(s).

44 crsctl Debug to trace crs activity crsctl debug statedump crs e.g.. root]# crsctl debug statedump crs dumping State for crs objects Dynamic state dump information is appended to the crsd log file $GRID_HOME/log/<node name>/crsd/crs.log

45 crsctl Query crs software version crsctl query crs softwareversion Query crs active version crsctl query crs activeversion Query Grid Infrastructure administrator crsctl query crs administrator

46 ACFS General Purpose file system integrated with ASM Oracle Clusterware Oracle Enterprise Manager File system features across multiple vendor platforms Single Node and cluster wide shared Oracle homes Uniform, coherent shared file access

47 ASM Dynamic Volume Manager Provides volume management services Disk device interface to ACFS Volume is created using management tool Should be enabled to generate an OS device Devices reside at /dev/asm/<volume-name> ADVM driver maps IO requests against a volume to the corresponding volume file located within an ASM diskgroup

48 ACFSUTIL Command line utility for ACFS Similar to ASMCMD Set ORACLE_SID=<asm sid> before executing acfsutil Located in /sbin/acfsutil

49 New in ACFS Replication Asynchronous replication from primary to standby Replication across network to another site. Provides DR option to the filesystem Used in conjunction with Oracle dataguard

50 New in ACFS Tagging Method for relating a group of files Use alone or with other features

51 Create ACFS Volumes Create ASM diskgroup Enable ASM diskgroup as Volume Create filesystem with ACFS mkfs command Register file system with acfsutil registry Mount the filesystem Test the file system

52 Q U E S T I O N S A N S W E R S blog: twitter/ym/skype: muralivallath murali.vallath@summersky.biz Complete your evaluations

murali.vallath@summersky.biz Thank You blog: www.muralivallath.

53 Thank You blog: twitter/ym/skype: muralivallath Murali Vallath Slide: 53

12 Cool Features in Oracle RAC

12 Cool Features in Oracle RAC Murali Vallath murali.vallath@summersky.biz Murali Vallath Slide: 1 About me Over 22 years of IT and 18 years using Oracle products Founder and past president of Oracle RAC