Migration and Source Control of SAS Business Intelligence objects in an ITIL environment

Transcription

1 Migration and Source Control of SAS Business Intelligence objects in an ITIL environment David Waters Griffith University Title: Business Intelligence Systems Analyst Actual: Data Architect/Data Modeller/ETL Developer

2 ITIL - Information Technology Infrastructure Library The Information Technology Infrastructure Library (ITIL) is a set of concepts and policies for managing information technology (IT) infrastructure, development and operations. The goal of Change Management is to ensure that standardised methods and procedures are used for efficient handling of all changes

3 The Most Boring Topic Imaginable Source Control is Boring Migration is Boring Releasing software into Production is Boring 3

4 Unless Unless you have to rollback to an old version that you no longer have Unless you migrate the wrong thing Unless the software you release crashes the CEOs Browser Window 4

5 About Griffith 37,786 Students (Fulltime and Part-time) 3,563 Staff (Full Time Equivalent) 5 Campuses (Nathan, Gold Coast, Mt Gravatt, Logan, South Bank) 8,847 International Students from 119 countries 38 Research Centres 268 Undergraduate Programs 382 Postgraduate Programs 104 Research Programs 5

6 Technology in Use at Griffith SAS BI Suite DI - Data Integration Studio BI - Info Maps, Web Report Studio, Office Add In etc 6

7 Technology in Use at Griffith SAS SPM (Strategic Performance Management) DI Studio, BMF Load for Data Loads SPM Scorecards and WRS for User Experience 7

8 Technology in Use at Griffith Oracle RDBMS PeopleSoft, Finance, HR, Campus Solutions Blackboard, etc 8

9 Design Methodology Kimball Method (Data Warehousing Design Patterns) Star Schemas (in Oracle RDBMS) Cubes (SAS) 9

10 Design Methodology Web Delivery SAS Information Delivery Portal SAS Information Maps for exposing data Web Report Studio Java Cube Viewer 10

11 Design Methodology Business Intelligence Initiatives of less than 12 weeks and preferably less than 8 weeks Lots of client engagement by the Business Analysts Early and iterative user testing Fast delivery cycles, Agile (Scrum) etc Separate Development, Test and Production 11

12 Development/Release Methodology ETL Jobs, Info Maps, Cubes go through full development, test, production life cycle WRS reports built on existing Maps/Cubes can be fast tracked 12

13 Development/Release Methodology 13

14 Source Control Work units exported from ETL Studio, Management Console or OLAP Cube Studio Imported into SVN (File source control) 14

15 Exporting Metadata DI Studio 15

16 Exporting Metadata DI Studio 16

17 Exporting Metadata OLAP Cube Studio 17

18 Exporting Metadata OLAP Cube Studio 18

19 Exporting Metadata 19

20 Exporting Metadata 20

21 Exporting Metadata 21

22 DI Studio 22

23 Tortoise SVN 23

24 SVN Subversion (SVN) is a version control system, it's intended as a successor to Concurrent Versions System (CVS). Open Source 24

25 SVN Does have locking but generally: A server stores the current version(s) of a project and clients connect to the server and "check out" a complete copy, work on the copy and later "check in" their changes; If two developers make a change to a file only changes made to the latest version are acceptable; If both changes are made to the latest version then manual intervention may be required (pretty rare); Developers can update from the server repository; and Developers can commit their changes 25

26 Tortoise SVN 26

27 Tortoise SVN 27

28 Tortoise SVN 28

29 Tortoise SVN 29

30 Tortoise SVN 30

31 Some Process Details ETL Jobs Migrate Tables first (before Jobs) File Loaders lose their mappings Keep them simple so we can automagically remap them Lookups lose their mappings Use SQL nodes instead 31

32 e.g 32

33 Some Process Details OLAP Indexes created by OLAP cube studio don t migrate OLAP Cube Studio Wizard needs to be rerun 33

34 Some Process Details Info Maps Have to manually edit the SAS Library details in the XML of the Map Database Schemas are different on each environment Edit the XML in the Info Map and change the Database Schema we have a procedure on doing this (BI-info@griffith.edu.au) 34

35 Questions? Contact Details Telephone (07) Mobile Griffith Location Community Centre (N66) 1.21B Campus Address Nathan Campus, Griffith University 170 Kessels Road, Nathan, QLD, Address 35