Analyzing MemSQL data in TIBCO Spotfire R

Transcription

1 Analyzing MemSQL data in TIBCO Spotfire R JDBC is the recommended connection method between Spotfire and MemSQL. The Windows client Spotfire Analyst and web clients Business Author and Consumer connect via the Spotfire Server where the JDBC driver is installed. If you do not already have a Spotfire Server and Spotfire Analyst client installed, follow step 1 and 2 below. Otherwise skip to step 3. Step 1: Downloading and installing Spotfire Server The Spotfire Server is downloaded from TIBCO edelivery. Once downloaded follow the step by step installation instructions available here. Step 2: Downloading and installing Spotfire Analyst TIBCO Spotfire Analyst is the Windows client from which we will configure the connection to MemSQL. It s also used to author analysis files and dashboards. Spotfire Analyst is also downloaded from TIBCO edelivery. Spotfire Analyst is installed as any other Windows application. Please follow the installation wizard. Step 3: Downloading and installing the MemSQL JDBC driver We currently recommend that the MariaDB JDBC driver is used. 1. The MariaDB JDBC driver is available for download here. 2. Locate the Spotfire Server library directory and copy the JDBC driver file to that directory: <TSS-home-directory>/tomcat/lib For example, on a Linux server: /usr/local/bin/tibco/tss/7.10.0/tomcat/lib For example, on a Windows server: C:\tibco\tss\7.10.0\tomcat\lib 3. Restart the Spotfire Server process to load the JDBC driver.

2 Step 4: Deploying the MemSQL data source template on the Spotfire Server 1. Open the Spotfire Server configuration tool from the Windows Start menu or from <Spotfire Server-home-directory>\tomcat\bin\uiconfig. 2. Log in using the tool password.

3 3. Select the Configuration tab. 4. Select Data Source Templates in the left menu and click New.

4 5. In the Add data source template dialog, give the data source template a name, for example MemSQL. 6. Paste the following data source template into the text field. Then click OK. <jdbc-type-settings> <type-name>mariadb</type-name> <driver>org.mariadb.jdbc.driver</driver> <connection-urlpattern>jdbc:mariadb://<host>:<port>/<database>?jdbccomplianttr uncation=false&useserverprepstmts=false</connection-url-pattern> <ping-command>select 1</ping-command> <column-name-pattern>`$$name$$`</column-name-pattern> <table-name-pattern>`$$name$$`</table-name-pattern> <catalog-name-pattern>`$$name$$`</catalog-name-pattern> <procedure-name-pattern>`$$name$$`</procedure-name-pattern> <sql-runtime>com.spotfire.ws.im.ds.sql.mysql.mysqldriversqlruntime</sql-runtime> <fetch-size>10000</fetch-size> <batch-size>100</batch-size> <table-types>table, VIEW</table-types> <supports-catalogs>true</supports-catalogs> <supports-schemas>false</supports-schemas> <supports-procedures>true</supports-procedures> <max-in-clause-size>1000</max-in-clause-size> <condition-list-threshold>10000</condition-list-threshold> <expand-in-clause>false</expand-in-clause> <column-alias-pattern>`$$name$$`</column-alias-pattern> <table-expression-pattern>[$$catalog$$.]$$table$$</table-expression-pattern> <date-format-expression>date_format($$value$$, '%Y-%m-%d')</date-formatexpression> <time-format-expression>date_format($$value$$, '%H:%i:%s')</time-formatexpression>

5 <date-time-format-expression>date_format($$value$$, '%Y-%m-%d %H:%i:%s')</datetime-format-expression> <java-to-sql-type-conversions> <from max-length="255">string</from> <to>varchar($$value$$)</to> <from>string</from> <to>text</to> <from>integer</from> <to>decimal(10)</to> <from>long</from> <to>decimal(38)</to> <from>float</from> <to>real</to> <from>double</from> <to>double PRECISION</to> <from>date</from> <to>date</to> <from>time</from> <to>time</to> <from>datetime</from> <to>datetime</to> </java-to-sql-type-conversions> <use-ansii-style-outer-join>true</use-ansii-style-outer-join> </jdbc-type-settings> 7. Select the new MemSQL data source template in the list, and make sure the enabled checkbox is selected. 8. Save the configuration and provide a reason for the update. 9. Close the Spotfire Server configuration tool and restart the Spotfire Server process. 10. Start the Spotfire Server configuration tool again and make sure that the new MemSQL data source template has the following Status: XML parsed OK.

6 Step 5: Connecting to MemSQL from Spotfire A MemSQL instance with username and password is required. You may want to create a Spotfire user on the MemSQL instance by using the following commands: memsql> grant all on *.* to 'spotfire'@'%' identified by 'spotfire'; memsql> grant all on *.* to 'spotfire'@'localhost' identified by 'spotfire'; JDBC connections are configured in a Spotfire Data Source and in Spotfire Information Links. You can create multiple Information Links representing different selections of data. They can share a single data source if the authentication method can be shared between users of the Information Links. To configure a data source and an Information Link for MemSQL, we use the Information Designer tool in the Spotfire Analyst Windows client. Creating a MemSQL data source 1. Launch Spotfire Analyst in Windows. 2. Launch Information Designer from the Tools menu.

7 3. Select New > Data Source. 4. Provide a name for the new data source and select the data source template you created earlier from the Type drop-down menu. 5. Save the data source to the Library. If you have a freshly installed Spotfire Server, you might have to create a folder first. This is done from the Library Administrator, also

8 available from the Tools menu. When the data source is saved you will be able to navigate the schema. Creating a MemSQL Information Link 1. Right-click on one of the MemSQL tables under the newly created data source and select Create Default Information Model. 2. Select a destination folder. 3. You should now have a folder and an Information Link with the same name as the table you selected. 4. Double-click on the Information Link to open it in a new tab. 5. The SQL syntax to retrieve the data can be validated by clicking the SQL button. Many other operations can be performed in the Information Link, including joins, filters, and much more. 6. To immediately add the data represented by the Information Link to a new analysis file, click Open Data. This will close Information Designer and load data into Spotfire Analyst. 7. Once data is loaded you can start to visualize it.

9 8. If you want to use the Information Links you have created in other analysis files, you open them from the start page, like in the image below. 9. You can also open your Information Links from the Add Data Tables dialog, by selecting File > Add Data Tables.

10 Step 7: Working with larger data sets by loading data ondemand MemSQL is designed to present rapid insight into terabyte scale data sets. Spotfire s integration with MemSQL currently brings rows of data into Spotfire s in-memory engine for super fast analytics. Since row level data is extracted from MemSQL it s recommended to utilize Spotfire s on-demand data tables. With on-demand data tables you will be able to pull in rows of data on the fly as users interact with dashboards and analysis files instead of loading rows upfront and then do the analytics. How to configure a data table to load data on-demand is thoroughly explained in the Spotfire User s Guide. Here are a couple of links to get you started: Loading data overview On-demand overview Example of Marking Controlled On-Demand Details Visualization Example of Property Controlled On-Demand Data