MIGRATION FROM RAW DEVICES TO ASMLib, STEP BY STEP EXAMPLE

Transcription

1 MIGRATION FROM RAW DEVICES TO ASMLib, STEP BY STEP EXAMPLE Alejandro Vargas Oracle Israel PRE MIGRATION STEPS... 1 Install and configure ASMLib on both servers... 1 MIGRATION STEPS... 4 REMOVE RAW DEVICES CONFIGURATION (Except for OCR, Voting Disk and ASM spfile)... 4 STOP SERVICE RAWDEVICES AND REBOOT BOTH SERVERS... 6 LABEL EMC DEVICES AS ORACLE ASM DISKS on Node SCAN DISKS ON SECOND NODE... 8 RESTART NODE APPLICATIONS AND ASM INSTANCE RECONFIGURE DISCOVERY DISK STRING STOP ASM RESTART ALL RAC COMPONENTS CHECK ASM CHECK DATABASE END OF THE PROCEDURE PRE MIGRATION STEPS Install and configure ASMLib on both servers On Linux platforms, ASM can use raw devices or devices managed via the ASMLib interface. Oracle recommends ASMLib over raw devices for ease-of-use and performance reasons. ASMLib 2.0 is available for free download

2 from OTN. This section walks through the process of configuring a simple ASM instance by using ASMLib 2.0 and building a database that uses ASM for disk storage. Determine Which Version of ASMLib You Need ASMLib 2.0 is delivered as a set of three Linux packages: oracleasmlib the ASM libraries oracleasm-support utilities needed to administer ASMLib oracleasm - a kernel module for the ASM library Each Linux distribution has its own set of ASMLib 2.0 packages, and within each distribution, each kernel version has a corresponding oracleasm package. The following paragraphs describe how to determine which set of packages you need. First, determine which kernel you are using by logging in as root and running the following command: uname -rm Ex: [root@proddb1 root]# uname -rm EL i686 The example shows that this is a kernel for a box using Intel i686 CPU. Use this information to find the correct ASMLib packages on OTN: 1. Point your Web browser to 2. Select the link for your version of Linux. 3. Download the oracleasmlib and oracleasm-support packages for your version of Linux 4. Download the oracleasm package corresponding to your kernel. In the example above, the oracleasm EL i686.rpm package was used. Next, install the packages by executing the following command as root on all nodes, one after the other: rpm -Uvh oracleasm-kernel_version-asmlib_version.cpu_type.rpm \ oracleasmlib-asmlib_version.cpu_type.rpm \ oracleasm-support-asmlib_version.cpu_type.rpm Ex: [root@proddb1 ASMlib]# ls -ltr

3 total 116 -rwxrwxrwx Apr oracleasm-support i386.rpm -rwxrwxrwx Apr oracleasm el i686.rpm -rwxrwxrwx Apr oracleasmlib i386.rpm [root@proddb1 ASMlib]# rpm -Uvh oracleasm el i686.rpm \ > oracleasmlib i386.rpm \ > oracleasm-support i386.rpm Preparing... ########################################### [100%] 1:oracleasm-support ########################################### [ 33%] 2:oracleasm EL ########################################### [ 67%] 3:oracleasmlib ########################################### [100%] Configuring ASMLib Before using ASMLib, you must run a configuration script to prepare the driver. Run the following command as root, and answer the prompts as shown in the example below. Run this on each node in the cluster. [root@vmractest1 ASMlib]# /etc/init.d/oracleasm configure Configuring the Oracle ASM library driver This will configure the on-boot properties of the Oracle ASM library driver. The following questions will determine whether the driver is loaded on boot and what permissions it will have. The current values will be shown in brackets ('[]'). Hitting <ENTER> without typing an answer will keep that current value. Ctrl-C will abort. Default user to own the driver interface []: oracle Default group to own the driver interface []: dba Start Oracle ASM library driver on boot (y/n) [n]: y Fix permissions of Oracle ASM disks on boot (y/n) [y]: y Writing Oracle ASM library driver configuration: [ OK ] Creating /dev/oracleasm mount point: [ OK ] Loading module "oracleasm": [ OK ]

4 Mounting ASMlib driver filesystem: [ OK ] Scanning system for ASM disks: [ OK ] MIGRATION STEPS REMOVE RAW DEVICES CONFIGURATION (Except for OCR, Voting Disk and ASM spfile) On servers PRODDB1 and PRODDB2 edit file /etc/sysconfig/rawdevices; comment all lines pointing to ASM disks, leave open OCR, Voting Disk and ASM spfile raw devices: /dev/raw/votingdisk /dev/emcpowerl1 /dev/raw/ocr.dbf /dev/emcpowerl2 /dev/raw/spfile+asm.ora /dev/emcpowerl3 #/dev/raw/asm1 /dev/emcpowerk1 #/dev/raw/asm2 /dev/emcpowerj1 #/dev/raw/asm3 /dev/emcpoweri1 #/dev/raw/asm4 /dev/emcpowerh1 #/dev/raw/asm5 /dev/emcpowerg1 #/dev/raw/asm6 /dev/emcpowerf1 #/dev/raw/asm7 /dev/emcpowere1 #/dev/raw/asm8 /dev/emcpowerd1 #/dev/raw/asm9 /dev/emcpowerc1 #/dev/raw/asm10 /dev/emcpowerb1 On servers PRODDB1 and PRODDB2 edit file /etc/udev/scripts/raw-dev.sh; comment all lines pointing to ASM disks, leave open OCR, Voting Disk and ASM spfile raw devices:

5 MAKEDEV raw mv /dev/raw/raw1 /dev/raw/votingdisk mv /dev/raw/raw2 /dev/raw/ocr.dbf mv /dev/raw/raw3 /dev/raw/spfile+asm.ora #mv /dev/raw/raw4 /dev/raw/asm1 #mv /dev/raw/raw5 /dev/raw/asm2 #mv /dev/raw/raw6 /dev/raw/asm3 #mv /dev/raw/raw7 /dev/raw/asm4 #mv /dev/raw/raw8 /dev/raw/asm5 #mv /dev/raw/raw9 /dev/raw/asm6 #mv /dev/raw/raw10 /dev/raw/asm7 #mv /dev/raw/raw11 /dev/raw/asm8 #mv /dev/raw/raw12 /dev/raw/asm9 #mv /dev/raw/raw13 /dev/raw/asm10 chmod 660 /dev/raw/votingdisk chmod 660 /dev/raw/ocr.dbf chmod 660 /dev/raw/spfile+asm.ora #chmod 660 /dev/raw/asm1 #chmod 660 /dev/raw/asm2 #chmod 660 /dev/raw/asm3 #chmod 660 /dev/raw/asm4 #chmod 660 /dev/raw/asm5 #chmod 660 /dev/raw/asm6 #chmod 660 /dev/raw/asm7 #chmod 660 /dev/raw/asm8 #chmod 660 /dev/raw/asm9 #chmod 660 /dev/raw/asm10

6 chown oracle:dba /dev/raw/votingdisk chown oracle:dba /dev/raw/ocr.dbf chown oracle:dba /dev/raw/spfile+asm.ora #chown oracle:dba /dev/raw/asm1 #chown oracle:dba /dev/raw/asm2 #chown oracle:dba /dev/raw/asm3 #chown oracle:dba /dev/raw/asm4 #chown oracle:dba /dev/raw/asm5 #chown oracle:dba /dev/raw/asm6 #chown oracle:dba /dev/raw/asm7 #chown oracle:dba /dev/raw/asm8 #chown oracle:dba /dev/raw/asm9 #chown oracle:dba /dev/raw/asm10 STOP SERVICE RAWDEVICES AND REBOOT BOTH SERVERS # service rawdevices stop # init 6 After reboot only CRS, Voting and Asm Spfile are up: [root@proddb1 scripts]# service rawdevices status /dev/raw/raw1: bound to major 120, minor 177 /dev/raw/raw2: bound to major 120, minor 178 /dev/raw/raw3: bound to major 120, minor 179

7 LABEL EMC DEVICES AS ORACLE ASM DISKS on Node 1 [root@proddb1 ~]# /etc/init.d/oracleasm force-renamedisk /dev/emcpowerk1 VOL1 Renaming disk "/dev/emcpowerk1" to "VOL1": [ OK ] [root@proddb1 ~]# /etc/init.d/oracleasm force-renamedisk /dev/emcpowerj1 VOL2 Renaming disk "/dev/emcpowerj1" to "VOL2": [ OK ] [root@proddb1 ~]# /etc/init.d/oracleasm force-renamedisk /dev/emcpoweri1 VOL3 Renaming disk "/dev/emcpoweri1" to "VOL3": [ OK ] [root@proddb1 ~]# /etc/init.d/oracleasm force-renamedisk /dev/emcpowerh1 VOL4 Renaming disk "/dev/emcpowerh1" to "VOL4": [ OK ] [root@proddb1 ~]# /etc/init.d/oracleasm force-renamedisk /dev/emcpowerg1 VOL5 Renaming disk "/dev/emcpowerg1" to "VOL5": [ OK ] [root@proddb1 ~]# /etc/init.d/oracleasm force-renamedisk /dev/emcpowerf1 VOL6 Renaming disk "/dev/emcpowerf1" to "VOL6": [ OK ] [root@proddb1 ~]# /etc/init.d/oracleasm force-renamedisk /dev/emcpowere1 VOL7 Renaming disk "/dev/emcpowere1" to "VOL7": [ OK ] [root@proddb1 ~]# /etc/init.d/oracleasm force-renamedisk /dev/emcpowerd1 VOL8 Renaming disk "/dev/emcpowerd1" to "VOL8": [ OK ] [root@proddb1 ~]# /etc/init.d/oracleasm force-renamedisk /dev/emcpowerc1 VOL9 Renaming disk "/dev/emcpowerc1" to "VOL9": [ OK ] [root@proddb1 ~]# /etc/init.d/oracleasm force-renamedisk /dev/emcpowerb1 VOL10 Renaming disk "/dev/emcpowerb1" to "VOL10": [ OK ] [root@proddb1 ~]# /etc/init.d/oracleasm listdisks VOL1 VOL10 VOL2 VOL3 VOL4

8 VOL5 VOL6 VOL7 VOL8 VOL9 oracleasm]# pwd /dev/oracleasm oracleasm]# ls -l disks/ total 0 brw-rw oracle dba 120, 161 Apr 11 23:57 VOL1 brw-rw oracle dba 120, 17 Apr 12 00:01 VOL10 brw-rw oracle dba 120, 145 Apr 11 23:58 VOL2 brw-rw oracle dba 120, 129 Apr 11 23:58 VOL3 brw-rw oracle dba 120, 113 Apr 11 23:58 VOL4 brw-rw oracle dba 120, 97 Apr 11 23:59 VOL5 brw-rw oracle dba 120, 81 Apr 11 23:59 VOL6 brw-rw oracle dba 120, 65 Apr 12 00:00 VOL7 brw-rw oracle dba 120, 49 Apr 12 00:00 VOL8 brw-rw oracle dba 120, 33 Apr 12 00:01 VOL9 SCAN DISKS ON SECOND NODE [root@proddb2 ~]# /etc/init.d/oracleasm scandisks Scanning system for ASM disks: [ OK ] [root@proddb2 ~]# [root@proddb2 ~]# /etc/init.d/oracleasm listdisks VOL1 VOL10

9 VOL2 VOL3 VOL4 VOL5 VOL6 VOL7 VOL8 VOL9 ~]# cd /dev/oracleasm/ oracleasm]# ls -l disks/ total 0 brw-rw oracle dba 8, 65 Apr 12 00:03 VOL1 brw-rw oracle dba 8, 209 Apr 12 00:03 VOL10 brw-rw oracle dba 8, 81 Apr 12 00:03 VOL2 brw-rw oracle dba 8, 129 Apr 12 00:03 VOL3 brw-rw oracle dba 8, 97 Apr 12 00:03 VOL4 brw-rw oracle dba 8, 145 Apr 12 00:03 VOL5 brw-rw oracle dba 8, 113 Apr 12 00:03 VOL6 brw-rw oracle dba 8, 177 Apr 12 00:03 VOL7 brw-rw oracle dba 8, 193 Apr 12 00:03 VOL8 brw-rw oracle dba 8, 161 Apr 12 00:03 VOL9 RESTART NODE APPLICATIONS AND ASM INSTANCE 1 {oracle} /PRODdb/app01/oracle/product [PRODdb1] > srvctl start nodeapps -n PRODdb1 {oracle} /PRODdb/app01/oracle/product [PRODdb1] > srvctl start nodeapps -n PRODdb2 {oracle} /PRODdb/app01/oracle/product [PRODdb1] > srvctl start asm -n PRODdb1

10 RECONFIGURE DISCOVERY DISK STRING {oracle} /PRODdb/app01/oracle/product [PRODdb1] > 10asm /PRODdb/app01/oracle/product >sts +ASM1 SQL> alter system set asm_diskstring='orcl:vol*' SCOPE=SPFILE SID='*'; System altered. STOP ASM {oracle} /PRODdb/app01/oracle/product [PRODdb1] > srvctl stop asm -n PRODdb1 RESTART ALL RAC COMPONENTS {oracle} /PRODdb/app01/oracle/product [PRODdb1] > srvctl start asm -n PRODdb1 {oracle} /PRODdb/app01/oracle/product [PRODdb1] > srvctl start asm -n PRODdb2 {oracle} /PRODdb/app01/oracle/product [PRODdb1] > srvctl start database -d refldb {oracle} /PRODdb/app01/oracle/product [PRODdb1] > chkcrs HA Resource Target State ora.proddb1.asm1.asm ONLINE ONLINE on PRODdb1 ora.proddb1.listener_proddb1.lsnr ONLINE ONLINE on PRODdb1 ora.proddb1.gsd ONLINE ONLINE on PRODdb1 ora.proddb1.ons ONLINE ONLINE on PRODdb1 ora.proddb1.vip ONLINE ONLINE on PRODdb1 ora.proddb2.asm2.asm ONLINE ONLINE on PRODdb2 ora.proddb2.listener_proddb2.lsnr ONLINE ONLINE on PRODdb2

11 ora.proddb2.gsd ONLINE ONLINE on PRODdb2 ora.proddb2.ons ONLINE ONLINE on PRODdb2 ora.proddb2.vip ONLINE ONLINE on PRODdb2 ora.refldb.proddba.cs ONLINE ONLINE on PRODdb1 ora.refldb.proddba.reflprod1.srv ONLINE ONLINE on PRODdb1 ora.refldb.proddba.reflprod2.srv ONLINE ONLINE on PRODdb2 ora.refldb.db ONLINE ONLINE on PRODdb1 ora.refldb.reflprod.cs ONLINE ONLINE on PRODdb2 ora.refldb.reflprod.reflprod1.srv ONLINE ONLINE on PRODdb1 ora.refldb.reflprod.reflprod2.srv ONLINE ONLINE on PRODdb2 ora.refldb.reflprod1.inst ONLINE ONLINE on PRODdb1 ora.refldb.reflprod2.inst ONLINE ONLINE on PRODdb2 CHECK ASM {oracle} /PRODdb/app01/oracle/product [PRODdb1] > 10asm /PRODdb/app01/oracle/product >sts +ASM1 /PRODdb/app01/oracle/product >asmcmd lsdg State Type Rebal Unbal Sector Block AU Total_MB Free_MB Req_mir_free_MB Usable_file_MB Offline_disks Name MOUNTED EXTERN N N PRODARCHDG/ MOUNTED EXTERN N N PRODDATADG/ {oracle} /PRODdb/app01/oracle/product [PRODdb2] > 10asm /PRODdb/app01/oracle/product >sts +ASM2 /PRODdb/app01/oracle/product >asmcmd lsdg State Type Rebal Unbal Sector Block AU Total_MB Free_MB Req_mir_free_MB Usable_file_MB Offline_disks Name MOUNTED EXTERN N N PRODARCHDG/ MOUNTED EXTERN N N PRODDATADG/

12 CHECK DATABASE {oracle} /PRODdb/app01/oracle/product [PRODdb1] > 10db /PRODdb/app01/oracle/product >sts reflprod1 /PRODdb/app01/oracle/product >sql SQL*Plus: Release Production on Thu Apr 12 00:32: Copyright (c) 1982, 2006, Oracle. All Rights Reserved. Connected to: Oracle Database 10g Enterprise Edition Release bit Production With the Partitioning, Real Application Clusters, OLAP and Data Mining options SQL> set pages lines 120 SQL> select file_name from dba_data_files; FILE_NAME PRODDATADG/refldb/datafile/tbs_refl_client PRODDATADG/refldb/datafile/undotbs PRODDATADG/reflprod/datafile/system PRODDATADG/reflprod/datafile/undotbs PRODDATADG/reflprod/datafile/sysaux PRODDATADG/reflprod/datafile/refl_data PRODDATADG/reflprod/datafile/refl_index PRODDATADG/reflprod/datafile/undotbs PRODDATADG/refldb/datafile/undotbs PRODDATADG/refldb/datafile/tbs_refl PRODDATADG/refldb/datafile/tbs_refl_data PRODDATADG/refldb/datafile/tbs_refl_data PRODDATADG/refldb/datafile/tbs_refl_data

13 +PRODDATADG/refldb/datafile/tbs_refl_data PRODDATADG/refldb/datafile/tbs_refl_data PRODDATADG/refldb/datafile/tbs_refl_data PRODDATADG/refldb/datafile/tbs_refl_data PRODDATADG/refldb/datafile/refl_data PRODDATADG/refldb/datafile/refl_data PRODDATADG/refldb/datafile/refl_data PRODDATADG/refldb/datafile/refl_index PRODDATADG/refldb/datafile/refl_index PRODDATADG/refldb/datafile/refl_index PRODDATADG/refldb/datafile/users PRODDATADG/refldb/datafile/tbs_snap_data PRODDATADG/refldb/datafile/tbs_oper PRODDATADG/refldb/datafile/tbs_quest rows selected. END OF THE PROCEDURE