API-First: An Agile Approach to Data Management ERIK HENNUM

Transcription

1 API-First: An Agile Approach to Data Management ERIK HENNUM Principal Engineer, 4 June 2018 MARKLOGIC CORPORATION

2 Stress on the business Excess inventory levels Competitive pressure on price Fraud levels rising Regulatory compliance challenges Problems with data integration SLIDE: 2 4 June 2018 MARKLOGIC CORPORATION

3 It s an opportunity. Now it s Carla s problem SLIDE: 3 4 June 2018 MARKLOGIC CORPORATION

4 Data First Design 1. DATA SOURCES 2. MODEL 3. SERVICES 4. APPLICATIONS SLIDE: 4 4 June 2018 MARKLOGIC CORPORATION

5 A Model for Integration + Customer in CRM, order, and support systems + Product in order and inventory systems + Staff in HR and support systems + = reconcile the semantics, vocabularies, structures, identity, properties, formats, SLIDE: 5 4 June 2018 MARKLOGIC CORPORATION Public domain

6 The Enterprise-Wide Model Thing PhysicalThing NonPhysicalThing Agent??? Customer EmployeeInRole Price More work required SLIDE: 6 4 June 2018 MARKLOGIC CORPORATION

7 1. DATA SOURCES 2. MODEL 3. SERVICES 4. APPLICATIONS? Questioning Data First Integrate all of the data before any use? No feedback or course correction? Waste of effort on the unused data? Transport data to clients for joins and grouping? Transfer domain expertise to app developers? Designing from implementation not for use SLIDE: 7 4 June 2018 MARKLOGIC CORPORATION

8 API First Design 5. DATA SOURCES 4. MODEL 3. DATA SERVICES 2. API SERVICES 1. APPLICATIONS SLIDE: 8 4 June 2018 MARKLOGIC CORPORATION

9 Identifying the First Application effort to implement Replace static pricing with dynamic pricing value to the business SLIDE: 9 4 June 2018 MARKLOGIC CORPORATION

10 Design for Dynamic Pricing 4. MODEL 5. DATA SOURCES 3. DATA SERVICES 2. API SERVICES 1. APPLICATIONS Load the source data for the price model Integrate the price data needed by the data service Look up the price factors needed by the pricing engine Take customer and product identifiers and return the price Provide a real-time price to a customer for a product SLIDE: 10 4 June 2018 MARKLOGIC CORPORATION

11 Stack for the Price Dynamically Service Application API Gateway API service (Java) Partitioned service Data Service (SJS) SLIDE: 11 4 June 2018 MARKLOGIC CORPORATION

12 Demo

13 Alternative Stacks Application API Gateway Java service Data service API Gateway Java service Data service On premise GraphQL Node.js service Data service SLIDE: 13 4 June 2018 MARKLOGIC CORPORATION

14 Great progress. It s still Carla s problem SLIDE: 14 4 June 2018 MARKLOGIC CORPORATION

15 Identifying the First Application ^ Fraud detection effort to implement value to the business SLIDE: 15 4 June 2018 MARKLOGIC CORPORATION

16 Developer Roles in Partitioned Services API service (Java) Data Service (SJS) Middle tier generalist Java Database specialist JavaScript SLIDE: 16 4 June 2018 MARKLOGIC CORPORATION

17 Design for Check Fraud Service 4. MODEL 5. DATA SOURCES 3. DATA SERVICES 2. API SERVICES 1. APPLICATIONS Load the source data for the account model Integrate the account data needed by the data service Match potential fraud signature and write audit record Take customer identifier and total price and return approval Check for fraudster before purchase SLIDE: 17 4 June 2018 MARKLOGIC CORPORATION

18 Iterative Expansion of the Solution Data Source 1. Identify the next application Data Source Data Source Data Source 3. Load and integrate the data 2. Design the services & model SLIDE: 18 4 June 2018 MARKLOGIC CORPORATION

19 Time to Value PRICE DYNAMICALLY LAUNCH CHECK FRAUD LAUNCH next launches API FIRST first launch DATA FIRST SLIDE: 19 4 June 2018 MARKLOGIC CORPORATION

20 Evolving the Model and APIs API Gateway harmonized customers v2 matchsignatures v1 matchsignaturesor LookupFactors v1 lookupfactors v1.2 checkfraud v1 pricedynamically v1 applications independent partitioned services SLIDE: 20 4 June 2018 MARKLOGIC CORPORATION

21 API First Summarized Feasible now: an agile approach to design - Limit the scope to the minimum requirements for the next application - Execute the business logic in the middle tier the data logic close to the persisted data - Success is iterative expansion of the set of APIs and the integrated model Coming soon: easier rapid development of partitioned API services - Declare a database function, generate the Java class, and write the function endpoint Requested: your feedback SLIDE: 21 4 June 2018 MARKLOGIC CORPORATION

22 Questions? 4 June 2018 MARKLOGIC CORPORATION