IT - SS - Corporate & Web Systems - Strategy : Confluence migration

Transcription

1 IT - SS - Corporate & Web Systems - Strategy : Confluence migration This page last changed on May 01, 2008 by mansours. This article will outline how to migrate a Confluence database schema from MySQL to Oracle. Things you will need for this article: 1. Oracle SQL Developer 2. MySQL 3. Oracle 10g It is assumed you have all those downloaded and installed. It is also assumed that you will have SYS/ DBA access to both databases. Additonally it is also assumed you have already migrated your images and attachments. This article only covers the databse migration. 1. Setup Oracle Im not writing instructions for this - just read the doco. Im assuming you have installed Confluence to an empty schema in Oracle. (We will overwrite this later with our import) 2. Setup MySQL Locally 1. Download and install mysql 2. Lets grab an export of the existing schema from the production environment. We will use this in our local instance. Connect to production and do the following: [user@host user]$ mysqldump -p confluencedb > confluencedb.dump 3. Then download that dump file and import it to your local instance of mysql [user@localhost user]$./mysql -u root -p confluence < confluencedb.dump Note: I had migration issues doing this, I was trying to import a dump taken form MySQL 3.2 into MySQL Server 5.1. Some brief notes: I was always getting the error when trying to import: ERROR 1064 (42000) at line 2: You have an error in your SQL syntax; check the manual that corresponds to our MySQL server version for the right syntax to use near ' What I did to fix this was just open up the confluencedb.dump file in my favourite text editor, and deleted all the comments at the start, and re-saved it. So just delete this at the start of the file: -- MySQL dump Host: localhost Database: confluencedb Server version And that worked. Not sure what the issue was here? Anyways Setup Oracle SQL Developer 1. Download and install Oracle SQL Developer Note you will need to have the Java JDK Installed 2. To start SQL Developer, go to <sqldeveloper_install>\sqldeveloper, and double-click sqldeveloper.exe a. If you are asked to enter the full pathname for java.exe, click Browse and find java.exe. For example, the path might have a name similar to C:\Program Files\Java\jdk1.5.0_06\bin \java.exe 3. Configure Oracle SQL Developer to work with MySQL Document generated by Confluence on May 01, :12 Page 1

2 If you try to get Oracle SQL Developer to talk to Mysql out-of-the box, it won't work! You will nee to ensure you get the right Jars for this. (The Oracle doco inst that clear about this). If you are using SQL Developer older than , you will see a MySQL option - but get a "Status: Failure -Unable to find driver: com.mysql.jdbc.driver" error message. If you are using Oracle SQL Developer 1.5 or newer, you wont even see a MySQL option. To do this you will need to download the MySQL Java Connector, then: a. Ensure Oracle SQL Developer is shutdown b. Extract the file mysql-connector-java bin.jar from your MySql connector archive to the jdbc\lib folder of your SQL Developer installation (eg:c:\dev\sqldeveloper\jdbc\lib) c. Edit the sqldeveloper\bin\sqldeveloper.conf so you include the MySQL connector in there. Add a new AddJavaLibFile for Mysql as per the last line below: IncludeConfFile../../ide/bin/ide.conf AddVMOption -Dapple.laf.useScreenMenuBar=true AddVMOption -Dcom.apple.mrj.application.apple.menu.about.name="SQL_Developer" AddVMOption -Dcom.apple.mrj.application.growbox.intrudes=false AddVMOption -Dcom.apple.macos.smallTabs=true AddVMOption -Doracle.ide.util.AddinPolicyUtils.OVERRIDE_FLAG=true AddVMOption -Dsun.java2d.ddoffscreen=false AddVMOption -Dwindows.shell.font.languages= AddVMOption -XX:MaxPermSize=128M AddJavaLibFile../../jdbc/lib/mysql-connector-java bin.jar d. Save, and start Oracle SQL developer again. You have now configured MySQL connectivity with Oracle SQL Developer. You should now see a MySQL tab if you are using SQL Developer 1.5 or greater. 4. Configure SQL Developer Next step is to setup your connections to MySQL and Oracle using SQL Developer. 1. Go to File > New > Database Connection. Lets setup MySQL first. a. Click on the MySQL Tab. Type in your MySQL database details, and select 'choose database' and select the database you just imported. b. Press 'Test' to test the connection. 2. Go to File > New > Database Connection. Lets Setup your SYS/ROOT Oracle Database Connection a. Type in your Oracle details in the Oracle tab. Be sure to select 'SYSDBA' in the role Document generated by Confluence on May 01, :12 Page 2

3 5. Create Oracle Migration User The next step is to create a confluence_migration user which we will use for the Oracle migration. The confluence_migration user will hold temporary info for the migration in their schema. We can easily create these users with our new Oracle connection we just setup in SQL developer. To do this. 1. Open up an SQL developer connection to your 'Local Oracle' 2. Expand your tree on the left. Go to "other users. 3. Here you have listed all the Oracle suers. Right click on Other users and select 'Create User' 4. Now create a new user called 'confluence_migration'. Run through the rest of the tabs up the top and give them 'Admin all'. Then press 'apply'. This will create the confluence user for you. 5. Now create a new Oracle SQL Developer connection for the confluence_migration users. (As per the steps in Configuring your SQL developer) So you should have the following connections available: Document generated by Confluence on May 01, :12 Page 3

4 Note: I have an extra one for the confluence user because I already installed confluence to Oracle but with an empty schema. At the end of this implementation plan, we will overwrite that user with the new one. 6. Create your migration repository We will now create your migration repo using the confluence_migration user. 1. Go to "Migration" > "Repository Management" > "Create Repository" 2. Then select the connection you created with the confluence_migration user 3. Press 'Create'. This will go off and create some generic migration tables Once complete, you should notice that it has created some tables under your "Local Oracle (confluence_migration)" connection tables. You can see this by expanding the connection on the left pannell, and opening up the tables: If you see these tables, you have successfully created your migration user. Document generated by Confluence on May 01, :12 Page 4

5 7. Migrate MySQL to Oracle Assuming you have created your migration user, you are ready to prepare Oracle SQL Developer to migrate to Oracle. 7.1 Capture the MySQL Schema 1. Ensure you are connected to the repository you just created. Go to "Migration" > "Repositry Management" > "Select Current Repository" and select the confluence_migration connection 2. Capture your MySQL Schema a. Connect to MySQL on the left panel b. Expand the tree and right-click on your recently imported confluencedb database. Select "capture schema": This will then go through and capture your schema and put the relevant metadata in your confluence_migration user tables: This may run for a minute. You have now captured your MySQL Schema to your Oracle Migration user. c. You should now notice you have a captured schema in your "Captured Objects" panel on the left: Document generated by Confluence on May 01, :12 Page 5

6 7.2 Convert MySQL Schema into an Oracle Model The next step is to convert the captured schema into an Oracle model. 1. Right-click on your captured schema, and select 'convert to oracle model': 2. The next screen you have presented will allow you to choose any data conversions you may have from MySQL to Oracle. (Ie Column types). We won't change anything for this, so just press Apply. This will go ahead and create an Oracle converted model of your Mysql database. 3. You should now see a converted model appear in the "Converted Objects" panel on the left: Document generated by Confluence on May 01, :12 Page 6

7 7.3 Migrate the MySQL Schema to an Oracle Schema The final key step is to migrate the captured model and the data into Oracle. As we have captured our MySQL schema, and converted it into an Oracle one, we are now ready to complete the migration. To do this: 1. Right-click on your recently "Converted Model" in your Converted Objects plane. Select "Generate": 2. This will then go through and generate SQL scripts for your Oracle Schema: Press close, and a new window should pop-up with all the SQL required to setup your schema: Document generated by Confluence on May 01, :12 Page 7

8 What has this done? This has created the SQL for creating a new database user and the skeleton schema for Oracle. Our next step is to run this as a DBA user (eg SYS). 3. We will now create the Oracle schema. However, its important to note that we already have an existing schema (confluence) as that was what we made a clean/blank install of Confluence on. Our old database was called confluencedb so Oracle SQL developer wants to create a user and schema under the confluencedb user. Which is fine, we will just need to quickly re-configure Confluence to point to the new schema. a. Connect to your Oracle database using the SYS connection on the connections b. Copy-paste all the generated SQL into the SYS user connection. c. Run all the scripts. You should get a lot of script output:...create UNIQUE succeeded. CREATE TABLE succeeded. ALTER TABLE spacepermissions succeeded. CREATE INDEX succeeded. CREATE INDEX succeeded. CREATE INDEX succeeded. CREATE INDEX succeeded. CREATE TABLE succeeded. ALTER TABLE spaces succeeded You have now successfully created your new Oracle schema. 7.4 Migrate the MySQL Data into the Oracle Schema Now lets pump all the data into Oracle. 1. Create a new Oracle SQL developer connection for the new confluencedb user (we will migrate the data to this) 2. Go to "Migration" > "Migrate Data". Select your "source connection" as the Mysql database, select the "target connection" as the newly created confluencedb user Press OK. 3. This will now take some time and migrate the data: Document generated by Confluence on May 01, :12 Page 8

9 This will take some time. Some Benchmarks We have done this in a few environments. Here are some benchmarks on a 120MB sized Mysql dump: Migration Run #1: Took 20 minutes On a 2xProcessor 2.3ghz, 500meg Virtual Machine Running Windows XP. Migration Run #2: Took 4 minutes On a 1xProcessor 3.2ghz, 4GB Desktop Machine Running Windows XP. 4. Once complete run some checks a. Check the "Errors Column" to ensure there are no errors b. Check the "migration log" panel to ensure there are no errors: c. You might also want to do some SELECT comparisons on some tables to ensure the row count is the same, and check some data You have now migrated the data into the new oracle database. 7.5 Configure Confluence to Communicate with the new Oracle schema Connect to your Confluence server, and edit the following file <<CONFLUENCE-HOME>>/ confluence.cfg.xml, eg /usr/local/apps/confluence/current/confluence.cfg.xml. Change it so it points to the new databse. <confluence-configuration> <setupstep>complete</setupstep> <setuptype>custom</setuptype> <buildnumber>913</buildnumber> <properties>... <property name="hibernate.connection.driver_class">oracle.jdbc.oracledriver</property> <property name="hibernate.connection.password">confluencedb</property> Document generated by Confluence on May 01, :12 Page 9

10 <property name="hibernate.connection.username">confluencedb</property> <property </properties> </confluence-configuration> The confluence_migration user can now be dropped. (You can do this via the Oracle SQL developer as well) Document generated by Confluence on May 01, :12 Page 10