Database Migration with MySQL Workbench. Alfredo Kojima, Team Lead MySQL Workbench Mike Frank, Product Manager

Transcription

1

2 Database Migration with MySQL Workbench Alfredo Kojima, Team Lead MySQL Workbench Mike Frank, Product Manager Copyright Copyright 2014, 2014, Oracle Oracle and/or and/or its its affiliates. affiliates. All Arll ights rights reserved. reserved.

3 Safe Harbor Statement The following is intended to outline our general product direction. It is intended for information purposes only, and may not be incorporated into any contract. It is not a commitment to deliver any material, code, or functionality, and should not be relied upon in making purchasing decisions. The development, release, and timing of any features or functionality described for Oracle s products remains at the sole discretion of Oracle.

4 Program Agenda MySQL Workbench Workbench Migration Wizard MS Access to MySQL Demo Migration Details After Migration

5 MySQL Workbench

6 MySQL Workbench MySQL admin and development tool Windows 7 and newer (32 and 64bits) Mac (Snow Leopard and newer) Linux (Ubuntu, Fedora, Oracle Linux or sources) Latest version 6.2 New Supports MySQL 5.1 and above

7 MySQL Workbench Free/Open Source Community Edition Commercial Edition GUI for Online Backup, Audit, DBDoc etc Included with commercial MySQL Editions

8 MySQL Workbench! MySQL Administration MySQL Development Database Modeling Migration

9 MySQL Workbench - Administration Server Status Start/Stop Connections Accounts Dump/Import Logs Configuration Performance Reports

10 MySQL Workbench SQL Editor Browse Databases View/Edit Data Run Queries and Scripts Create/Alter Objects (online) Query Optimization (Visual Explain etc)

11 MySQL Workbench Modeling Visually model database schemas Reverse engineer existing databases Generate SQL code from diagram Synchronize

12 Migration Wizard

13 MySQL Workbench Migration Wizard Migrate tables and data Part of MySQL Workbench

14 Migrate schema and data to MySQL MS SQL Server MS Access Sybase ASE New in WB 6.2 Sybase SQL Anywhere PostgreSQL SQLite Generic MySQL

15 DB Migration Process Original Schema Convert Tables to MySQL MySQL Schema Source DB ODBC Driver Workbench Migration Wizard Source Data Copy Data Target Data

16 Migration Wizard

17 Migration Wizard - Overview

18 Requirements Network access to the source database Adequate credentials for the source database (eg. sa/root account, or a limited one with full metadata read access) Pre- configured ODBC Data Source (optional)!

19 Migration Wizard - Overview

20 Migration Wizard - ODBC Administrator Utility ODBC Administrator 32 vs 64bit ODBC Administrator C:\Windows\SysWOW64\odbcad32.exe - 32bit C:\Windows\System32\odbcad32.exe - 64bit Many drivers are 32bit only! Use the Workbench architecture for the driver you need

21 ODBC - Is my driver 32 or 64bits? 64bits 32 bits

22 Source Connectivity - SQL Server Use official ODBC drivers if in Windows or FreeTDS if migrating from Mac/Linux Ensure TCP connections enabled in SQL Server

23 Source Connectivity - Access Database Character Set Depends on your Access edition (English, Russian, Chinese etc) Default cp1252 for most western editions of Access Used when copying data

24 Setting Up an ODBC Data Source Setup your source ODBC Data Source beforehand In Workbench you ll only need DSN and password

25 Setting Up an ODBC Data Source DSN connection from ODBC Utility Use the built- in Test Function

26 Schema Migration

27 Select Source DB Connection

28 Select Target DB Connection

29 Fetch Schema List from Source

30 Schema Selection

31 MySQL Terminology MySQL MS SQL Server/Sybase ASE MS Access PostgreSQL Instance Instance? Cluster n/a Catalog? Catalog Database/Schema Schema Database/File Schema Table Table Table Table

32 Name Mapping Keep schemas as they are Schema.Table As many MySQL schemas as original dbo.<table> HumanResources.<table> Person.<table> Production.<table> Only one schema (drop schema name) Catalog.Table AdventureWorks2012.<ta ble> All tables merged into the same schema Table names must be unique Only one schema (prefix original name) Catalog.Schema_Table AdventureWorks2012.dbo_<ta ble> AdventureWorks2012.HumanR esources_<table> AdventureWorks2012.Person_< table>

33 Reverse Engineer Source

34 Reverse Engineer Source Fetch selected schemas Fetch tables Columns (name, type, charset, default value, NULL) Primary Key Foreign Keys Indexes Code for views, procedures, functions

35 Reverse Engineer Source - Common Issues Foreign keys that reference a table in a different schema Insufficient privileges on system/metadata tables MS Access: MSysRelationships Unsupported server version - > (SQL Server tends to change metadata access on every version)

36 Select Objects to Migrate Select individual objects to migrate All tables selected by default Other objects can be included, but will be left commented in generated script

37 Migrate Objects

38 Migrate Objects Goes through all objects that were reverse engineered and: Create matching ones for MySQL Convert data types Convert character sets Other specific conversions (foreign key etc)

39 Migrate Objects - Default Data Type Mapping (MS SQL) MySQL MySQL VARCHAR VARCHAR or LONGTEXT XML TEXT SMALLINT/INT/BIGINT SMALLINT/INT/BIGINT ROWVERSION BINARY TINYINT UNSIGNED TINYINT BIT TINYINT MONEY DECIMAL UNIQUEIDENTIFIER VARCHAR(64) + UNIQUE IMAGE BLOB SQL_VARIANT TEXT VARBINARY VARBINARY or LONGBLOB SYSNAME VARCHAR(160)

40 Migrate Objects - Other Notes (MS SQL) IDENTITY columns AUTO_INCREMENT (must be PRIMARY KEY in MySQL) Text columns migrated to utf8 by default Limited Functional Default Values TIMESTAMP getdate() TIMESTAMP DEFAULT CURRENT_TIMESTAMP DATETIME getdate() TIMESTAMP DEFAULT CURRENT_TIMESTAMP

41 Migrate Objects - Default Data Type Mapping (Access) MySQL MySQL VARCHAR VARCHAR REAL DOUBLE INTEGER/INT INT CURRENCY DECIMAL COUNTER INT AUTO_INCREMENT BINARY BLOB BIT TINYINT LONGBINARY LONGBLOB BYTE UNSIGNED TINYINT LONGCHAR LONGTEXT SINGLE FLOAT DATETIME DATETIME

42 Create Target Objects

43 Create Target - Errors Correct SQL for each object Apply changes Recreate Objects SQL Code for Object Objects created Output from executed SQL

44 Data Migration

45 Data Transfer Setup

46 Data Transfer Setup Copy data from Workbench or Generate a batch/script file to do data copy separately Can be executed from command line Leave running in background while doing other things, at night etc

47 Data Transfer

48 Done!

49 Table Copy Tool wbcopytables Copy data to MySQL Copy missing records (resume) Count rows Command line and standalone Connect to any DB via ODBC Can be used in scripts, system scheduler etc

50 Table Copy Tool wbcopytables.exe --odbc-source="dsn=northwind" --target= --thread-count=2 --table "Northwind" "Orders" `Northwind` `Orders` "Order ID `Order ID` "Order ID", "Employee ID", "Customer ID", "Order Date", "Shipped Date", "Shipper ID", "Ship Name", "Ship Address! <source schema> <source table> <target schema> <target table> <columns>,

51 Table Copy Tool Schema, Table, Column, Primary Key Specification Column list may include a cast ex.: [sysnamecol] as VARCHAR(160) See documentation for more options Use save script for data copy to have a template

52 After Migration

53 Verification Review data copy logs Check column types, defaults, indexes, foreign keys Compare original and copied data Specially for non- ASCII text Reverse engineer and review data model

54 Inspect Tables

55 View Data

56 EER Model

57 Access Applications: Linking Tables in MySQL Connector/ODBC for MySQL (32 bits) Create an ODBC DSN for MySQL Link migrated tables from Access Rename linked tables to original names

58 Demo

59 Now What? Doing things in MySQL land

60 Tooling All platforms MySQL Workbench mysql command line client mysqldump - backup/export Connectors (

61 Tooling Windows Full C# /.NET and ODBC Support Visual Studio Integration Excel Integration Unified Installer System Tray Integration

62 MySQL Connector/Net Fully managed C# provider stack to connect and work with MySQL databases Fully managed Full ADO.Net implementation Connection pooling Pluggable authentication Pluggable load balancing/replicatoin Supports C# 5 async/await Very fast Mono compatible!!

63 MySQL Connector/Net Web and Client Features Full ASP.Net support Including MVC Most providers supported Full Entity Framework Fabric support With sharding! Windows Store Easy to analyze Enterprise Monitor

64 MySQL for Visual Studio Work with MySQL databases directly inside Visual Studio! Fully supports all recent versions 2008, 2010, 2012, 2013 Plugs directly into Server Explorer Create, edit, and drop database objects Execute scripts in custom editor Syntax highlighting Autocompletion

65 MySQL for Visual Studio (cont.) Stored procedure debugging Uses native VS windows Breakpoints, watches, locals Wizards for app development Winforms, ASP.Net, MVC

66 MySQL for Excel Work with MySQL data directly inside Microsoft Excel! Imports MySQL data from tables, views and stored procedures to Excel refreshable tables Exports Excel data to new or existing MySQL tables in a few clicks Uses Excel worksheets as a front- end to edit MySQL table s data (add, delete or update rows)

67 MySQL for Excel (cont.) Allows the analysis of MySQL data through Excel PivotTables, or PowerPivot to do self- service BI Shares MySQL connections with Workbench Technical knowledge about databases or SQL queries is not required Works with Excel 2007 and higher

68 MySQL Notifier Keep an eye on your MySQL servers! Runs in system tray Uses Workbench connections Configurable monitoring of MySQL servers Notifies you when service status changes Services management (start / stop) Notifies you of available updates to installed MySQL products Integrates with MySQL Installer

69 MySQL Installer Easiest way to get all the MySQL software Comes bundled with all server bundles Single app to install all MySQL products Supports commercial and community Allows you to configure and reconfigure your servers Automatically checks for product updates Identifies and manages product requirements

70 Thank You!!! Download Team Blog, Articles Documentation

71 MySQL Community Oracle OpenWorld! Mingle with the MySQL community and the MySQL team from Oracle for a fun and informative evening!! Time: September 30 7pm Jillian s at Metreon 175 Fourth Street, San Francisco, CA! At the corner of Howard and 4 th st.; only 2- min walk from Moscone Center!!!!

72

73