BRIDGING THE GAP: COLLIBRA CONNECT FROM THE BUSINESS POINT OF VIEW

Transcription

1 BRIDGING THE GAP: COLLIBRA CONNECT FROM THE BUSINESS POINT OF VIEW Piotr Boczkowski, Collibra Connect Development Leader Adrian Hsieh, Product Integration Architect Sina Heshmati, Strategic Technical Advisor Miguel Santana, Solutions Architect May 3, Collibra Collibra Inc

2 Agenda Introduction to Collibra Connect 10 min Demo 10 min Salesforce Metadata to Collibra Query Tool Environment Setup 10 min Getting Data into Collibra 85 min Retrieving Data out of Collibra 85 min Next Steps and Q&A 10 min Developer Certification Exam 60 min* *(available online afterward) 2 Collibra 2017

3 INTRODUCTION TO COLLIBRA CONNECT 3 Collibra Collibra Inc

4 Introduction to Collibra Connect 4 Collibra 2017

5 Build vs. Buy Why license Collibra Connect when Collibra Data Governance Center REST API can be invoked directly? 5 Collibra 2017

6 Expose Anypoint API Designer Not Included Anypoint API Portal Not Included Anypoint API Gateway & Anypoint API Manager Build Not Included Not Included Manage Anypoint Studio & Anypoint DataWeave Anypoint Templates MuleESB Run CloudHub Anypoint Connectors & Anypoint DevKit Mule Enterprise Management Anypoint Analytics 6 Collibra 2017 Connect

7 SEDA Staged Event Driven Architecture Foundation of Anypoint Platform Queue-based instead of thread-based Better performance with higher reliability 7 Collibra 2017

8 COLLIBRA CONNECT IN ACTION Salesforce to Collibra Data Governance Center Integration 8 Collibra Collibra Inc

9 Business Application Integration 9 Collibra 2017

10 SETTING UP THE ENVIRONMENT 10 Collibra Collibra Inc

11 Setting Up the Environment 1. Run the Anypoint Studio installer 2. Locate the Collibra Data Governance Center Connector zip file and keep it zipped 11 Collibra 2017

12 Setting Up the Environment Start Anypoint Studio Select a new workspace 12 Collibra 2017

13 Setting Up the Environment Click accept & continue Skip the release notes Close the welcome page 13 Collibra 2017

14 Installing the Data Governance Center Connector Click Help > Install New Software Click Add > Archive Collibra DGC Connector only available from Community Portal 14 Collibra 2017

15 Installing the Data Governance Center Connector Browse to the Collibra Data Governance Center Connector update site Install the Connector 15 Collibra 2017 Next > Accept license agreement > Finish > Restart Anypoint Studio

16 GETTING DATA INTO COLLIBRA DATA GOVERNANCE CENTER Use Case and Solution 16 Collibra Collibra Inc

17 The Problem How can we view data from another system inside of Collibra Data Governance Center? 17 Collibra 2017

18 The Use Case Collibra Data Governance Center File available from Collibra University 18 Collibra 2017

19 The Solution Upsert assets operation Combines inserting new assets and updating existing ones Uses DataSense and DataWeave Collibra Data Governance Center Collibra Connect 19 Collibra 2017

20 LET S BUILD THE INTEGRATION Exercise 20 Collibra Collibra Inc

21 Preparing the Data Governance Center Data Governance Center instances: User: datacitizen1 Password: connect 21 Collibra 2017

22 Preparing the Data Governance Center Navigate to Data Citizens Community 22 Collibra 2017

23 Creating a Project Start by creating a new project 23 Collibra 2017

24 Reading the Files Use file component to read codes.csv and log #[payload] 24 Collibra 2017

25 Running the Application Run the project: right-click on Project > Run As > Mule Application Move codes.csv to the codes folder 25 Collibra 2017

26 Configuring the Data Governance Center Connector Add Data Governance Center Connector Configure and test the connection 26 Collibra 2017

27 Configuring Upsert Assets Operation Select Upsert assets by external entity ID operation Choose Code Set Asset Type Enter SKIPPED as Default Domain Id Enter a unique External System Id 27 Collibra 2017

28 Configuring Tranform Message Component Add Transform Message component Define metadata from example codes.csv file 28 Collibra 2017

29 Configuring the Transform Message Component Define the transformation logic Code Set 29 Collibra 2017

30 Running the Application and Checking Results Run the project: right-click on Project > Run As > Mule Application Refresh the Data folder (F5) Move codes.csv to the codes folder Inspect the Data Citizens Community 30 Collibra 2017

31 Upserting Codes Extend the flow Find in 31 Collibra 2017 next page

32 Upserting Codes Configure the Transform Message component Code Copied from Transform Code Sets 32 Collibra 2017

33 Running the Application and Checking Results Run the project: right-click on Project > Run As > Mule Application Move codes.csv to the codes folder Inspect the domains in Data Citizens Community Configure the Hierarchy 33 Collibra 2017

34 The Result 34 Collibra 2017

35 35 Collibra Collibra Inc RETRIEVING RECORDS FROM COLLIBRA DATA GOVERNANCE CENTER

36 Use Case What if we want to extract records out of Collibra? Find records in Collibra Export in format that can be imported into other systems 36 Collibra 2017

37 Prepare Collibra Data Governance Center Community and Domain Pick the community and domain you would like to use Make sure assets in domain for development test 37 Collibra 2017

38 LET S BUILD ANOTHER 38 Collibra Collibra Inc

39 Create New Project Choose new Mule project 39 Collibra 2017

40 On-Demand Trigger of Integration HTTP inbound endpoint HTTP/HTTPS inbound endpoint provides an easy-touse mechanism to trigger integration 40 Collibra 2017

41 HTTP Listener Configuration Must configure a listener or used a shared one via domain (advanced topic) 41 Collibra 2017

42 Get Record by Name Easier way to retrieve records Many types of records, such as Community, Domain, and Asset, can be retrieved by name 42 Collibra 2017

43 Results Entire record returned Note that entire record will be retrieved Use standard convention to obtain value from specific field needed 43 Collibra 2017

44 Payload Can change along flow Result from each processor become the current payload and feed into next processor 44 Collibra 2017

45 Custom Metadata Create custom models for DataWeave When metadata is unknown, e.g. for csv file, user can define it 45 Collibra 2017

46 Custom Metadata Can create from example 46 Collibra 2017

47 Custom Metadata Proceed with Dataweave 47 Collibra 2017

48 Trigger Use any browser Simply hit localhost with the port and path configured 48 Collibra 2017

49 NEXT STEPS Questions? 49 Collibra Collibra Inc

50 Next Steps Beyond the basics Collibra Connect is the supported mechanism for integrating Data Governance Center with other enterprise systems Workshop only touched on the fundamentals Review requirements, prioritized use cases, allocate proper development resources Training, coaching, and professional services 50 Collibra 2017

51 DEVELOPER CERTIFICATION Exam 51 Collibra Collibra Inc

52 THANK YOU 52 Collibra Collibra Inc