BRIDGING THE GAP: COLLIBRA CONNECT FROM THE BUSINESS POINT OF VIEW Piotr Boczkowski, Collibra Connect Development Leader Adrian Hsieh, Product Integration Architect Sina Heshmati, Strategic Technical Advisor Miguel Santana, Solutions Architect May 3, 2017 1 Collibra 2017 2017 Collibra Inc
Agenda Introduction to Collibra Connect 10 min Demo 10 min Salesforce Metadata to Collibra Query Tool Environment Setup 10 min Getting Data into Collibra 85 min Retrieving Data out of Collibra 85 min Next Steps and Q&A 10 min Developer Certification Exam 60 min* *(available online afterward) 2 Collibra 2017
INTRODUCTION TO COLLIBRA CONNECT 3 Collibra 2017 2017 Collibra Inc
Introduction to Collibra Connect 4 Collibra 2017
Build vs. Buy Why license Collibra Connect when Collibra Data Governance Center REST API can be invoked directly? 5 Collibra 2017
Expose Anypoint API Designer Not Included Anypoint API Portal Not Included Anypoint API Gateway & Anypoint API Manager Build Not Included Not Included Manage Anypoint Studio & Anypoint DataWeave Anypoint Templates MuleESB Run CloudHub Anypoint Connectors & Anypoint DevKit Mule Enterprise Management Anypoint Analytics 6 Collibra 2017 Connect
SEDA Staged Event Driven Architecture Foundation of Anypoint Platform Queue-based instead of thread-based Better performance with higher reliability 7 Collibra 2017
COLLIBRA CONNECT IN ACTION Salesforce to Collibra Data Governance Center Integration 8 Collibra 2017 2017 Collibra Inc
Business Application Integration 9 Collibra 2017
SETTING UP THE ENVIRONMENT 10 Collibra 2017 2017 Collibra Inc
Setting Up the Environment 1. Run the Anypoint Studio installer 2. Locate the Collibra Data Governance Center Connector zip file and keep it zipped 11 Collibra 2017
Setting Up the Environment Start Anypoint Studio Select a new workspace 12 Collibra 2017
Setting Up the Environment Click accept & continue Skip the release notes Close the welcome page 13 Collibra 2017
Installing the Data Governance Center Connector Click Help > Install New Software Click Add > Archive Collibra DGC Connector only available from Community Portal 14 Collibra 2017
Installing the Data Governance Center Connector Browse to the Collibra Data Governance Center Connector update site Install the Connector 15 Collibra 2017 Next > Accept license agreement > Finish > Restart Anypoint Studio
GETTING DATA INTO COLLIBRA DATA GOVERNANCE CENTER Use Case and Solution 16 Collibra 2017 2017 Collibra Inc
The Problem How can we view data from another system inside of Collibra Data Governance Center? 17 Collibra 2017
The Use Case Collibra Data Governance Center File available from Collibra University 18 Collibra 2017
The Solution Upsert assets operation Combines inserting new assets and updating existing ones Uses DataSense and DataWeave Collibra Data Governance Center Collibra Connect 19 Collibra 2017
LET S BUILD THE INTEGRATION Exercise 20 Collibra 2017 2017 Collibra Inc
Preparing the Data Governance Center Data Governance Center instances: https://dcc2017-developer-1.collibra.com https://dcc2017-developer-2.collibra.com https://dcc2017-developer-3.collibra.com User: datacitizen1 Password: connect 21 Collibra 2017
Preparing the Data Governance Center Navigate to Data Citizens Community 22 Collibra 2017
Creating a Project Start by creating a new project 23 Collibra 2017
Reading the Files Use file component to read codes.csv and log #[payload] 24 Collibra 2017
Running the Application Run the project: right-click on Project > Run As > Mule Application Move codes.csv to the codes folder 25 Collibra 2017
Configuring the Data Governance Center Connector Add Data Governance Center Connector Configure and test the connection 26 Collibra 2017
Configuring Upsert Assets Operation Select Upsert assets by external entity ID operation Choose Code Set Asset Type Enter SKIPPED as Default Domain Id Enter a unique External System Id 27 Collibra 2017
Configuring Tranform Message Component Add Transform Message component Define metadata from example codes.csv file 28 Collibra 2017
Configuring the Transform Message Component Define the transformation logic Code Set 29 Collibra 2017
Running the Application and Checking Results Run the project: right-click on Project > Run As > Mule Application Refresh the Data folder (F5) Move codes.csv to the codes folder Inspect the Data Citizens Community 30 Collibra 2017
Upserting Codes Extend the flow Find 1 2 3 5 4 in 31 Collibra 2017 next page
Upserting Codes Configure the Transform Message component Code Copied from Transform Code Sets 32 Collibra 2017
Running the Application and Checking Results Run the project: right-click on Project > Run As > Mule Application Move codes.csv to the codes folder Inspect the domains in Data Citizens Community Configure the Hierarchy 33 Collibra 2017
The Result 34 Collibra 2017
35 Collibra 2017 2017 Collibra Inc RETRIEVING RECORDS FROM COLLIBRA DATA GOVERNANCE CENTER
Use Case What if we want to extract records out of Collibra? Find records in Collibra Export in format that can be imported into other systems 36 Collibra 2017
Prepare Collibra Data Governance Center Community and Domain Pick the community and domain you would like to use Make sure assets in domain for development test 37 Collibra 2017
LET S BUILD ANOTHER 38 Collibra 2017 2017 Collibra Inc
Create New Project Choose new Mule project 39 Collibra 2017
On-Demand Trigger of Integration HTTP inbound endpoint HTTP/HTTPS inbound endpoint provides an easy-touse mechanism to trigger integration 40 Collibra 2017
HTTP Listener Configuration Must configure a listener or used a shared one via domain (advanced topic) 41 Collibra 2017
Get Record by Name Easier way to retrieve records Many types of records, such as Community, Domain, and Asset, can be retrieved by name 42 Collibra 2017
Results Entire record returned Note that entire record will be retrieved Use standard convention to obtain value from specific field needed 43 Collibra 2017
Payload Can change along flow Result from each processor become the current payload and feed into next processor 44 Collibra 2017
Custom Metadata Create custom models for DataWeave When metadata is unknown, e.g. for csv file, user can define it 45 Collibra 2017
Custom Metadata Can create from example 46 Collibra 2017
Custom Metadata Proceed with Dataweave 47 Collibra 2017
Trigger Use any browser Simply hit localhost with the port and path configured 48 Collibra 2017
NEXT STEPS Questions? 49 Collibra 2017 2017 Collibra Inc
Next Steps Beyond the basics Collibra Connect is the supported mechanism for integrating Data Governance Center with other enterprise systems Workshop only touched on the fundamentals Review requirements, prioritized use cases, allocate proper development resources Training, coaching, and professional services 50 Collibra 2017
DEVELOPER CERTIFICATION Exam 51 Collibra 2017 2017 Collibra Inc
THANK YOU 52 Collibra 2017 2017 Collibra Inc