Sun Java TM Composite Applications Platform Suite Implementing Selected EAI Patterns

Transcription

1 Sun Java TM Composite Applications Platform Suite Implementing Selected EAI Patterns Michael Czapski, Enterprise Architect, Sun Microsystems Frank Kieviet, Senior Staff Engineer, Sun Microsystems TS-5301

2 Discover Enterprise Application Integration (EAI) Patterns and how they can be implemented in Java CAPS to greatly accelerate the creation of EAI solutions 2008 JavaOne SM Conference java.sun.com/javaone 2

3 Assumptions about You You have a requirement to integrate disparate applications You have a notion of what design patterns are You know design patterns can accelerate development You want to / have to develop EAI solutions You want to use patterns to accelerate development You want to know how to apply patterns in real solutions You are curious how Java CAPS assists EAI development 2008 JavaOne SM Conference java.sun.com/javaone 3

4 Agenda Enterprise Application Integration Enterprise Integration Patterns Business Problem Implementation with CAPS Exercise Summary 2008 JavaOne SM Conference java.sun.com/javaone 4

5 Agenda Enterprise Application Integration Enterprise Integration Patterns Business Problem Implementation with CAPS Exercise Summary 2008 JavaOne SM Conference java.sun.com/javaone 5

6 An example of EAI Situation 10 years ago in a random enterprise An ERP system generates purchase orders The orders are printed out and mailed using USPS ERP system po.ps 2008 JavaOne SM Conference java.sun.com/javaone 6

7 Now The same ERP system still generates purchase orders There is now also a web ordering application for internal use There is now a financial Order Approval System that is used to guarantee that the company never commits more funds than it can. There is now also a Financial Monitoring System Purchase orders are now delivered electronically over the Internet using a Transaction Delivery Network application Web procurement system order.xml ERP system po.csv po.edi TDN system po.xml Order Approval System po.xml Financial Monitoring system 2008 JavaOne SM Conference java.sun.com/javaone 7

8 Observations There are interactions between systems These interactions are constantly changing New interactions are added regularly Number of interactions can grow rapidly (number of permutations) When systems interact, they typically exchange messages Business documents Messages > enterprise dictionary / vocabulary Message is a structured octet string not an object. The structure is specific to the particular system that uses it 2008 JavaOne SM Conference java.sun.com/javaone 8

9 Enterprise Application Integration (EAI) Comes to the rescue 2008 JavaOne SM Conference java.sun.com/javaone 9

10 Why is EAI software needed The number of interactions grows exponentially Externalizing interactions decouples applications Externalized interactions require common services: Application Connectivity Message Routing Data Transformation / Mapping Data Enrichment Process / Service Orchestration Service Composition Transactions: Two phase commit (short running transactions) Compensating transactions (long running transactions) Expressions of business logic 2008 JavaOne SM Conference java.sun.com/javaone 10

11 EAI Software is used to Facilitate exchange of data between disparate applications Synchronise data between disparate applications Protect legacy investment for new developments Decouple applications Support master data management Integrate processes across business units Provide foundation for new enterprise architectures Avoid vendor lock-in 2008 JavaOne SM Conference java.sun.com/javaone 11

12 Enterprise Application Integration (EAI) Common Approaches to Application Integration File Transfer Shared Database RPC Messaging Service Enablement Common Application Integration Models Point-to-Point Hub-and-Spokes / Message Broker (Message / Service) Bus Common Technology Choices Dominant CRM / ERP Vendor Tools Dominant low-level non-eai development technologies Proprietary closed EAI Toolkits Standards-compliant open EAI Toolkits 2008 JavaOne SM Conference java.sun.com/javaone 12

13 Agenda Enterprise Application Integration Enterprise Integration Patterns Business Problem Implementation with CAPS Exercise Summary 2008 JavaOne SM Conference java.sun.com/javaone 13

14 Patterns A proven way to capture experts knowledge in fields where there are no simple one size fits all answers application architecture object-oriented design message-oriented integration. Each pattern addresses a specific design problem discusses the considerations surrounding the problem presents a solution that balances the various forces or drivers JavaOne SM Conference java.sun.com/javaone 14

15 Enterprise Integration Patterns Enterprise Integration Patterns: Designing, Building, and Deploying Messaging Solutions By Gregor Hohpe, Bobby Woolf Addison Wesley October 10, 2003 ISBN : JavaOne SM Conference java.sun.com/javaone 15

16 EIP Pattern Groups Messaging Channels Message Construction Message Routing Message Transformation Messaging Endpoints System Management 2008 JavaOne SM Conference java.sun.com/javaone 16

17 Messaging Channels Point-to-Point Channel Publish-Subscribe Channel Datatype Channel Invalid Message Channel Dead Letter Channel Guaranteed Delivery Channel Adapter Messaging Bridge Message Bus 2008 JavaOne SM Conference java.sun.com/javaone 17

18 Messaging Channels Point-to-Point Channel Publish-Subscribe Channel Datatype Channel Invalid Message Channel Dead Letter Channel Guaranteed Delivery Channel Adapter Messaging Bridge Message Bus How can the caller be sure that exactly one receiver will receive the document or perform the call? 2008 JavaOne SM Conference java.sun.com/javaone 18

19 Messaging Channels Point-to-Point Channel Publish-Subscribe Channel Datatype Channel Invalid Message Channel Dead Letter Channel Guaranteed Delivery Channel Adapter Messaging Bridge Message Bus How can the sender broadcast an event to all interested receivers? 2008 JavaOne SM Conference java.sun.com/javaone 19

20 Messaging Channels Point-to-Point Channel Publish-Subscribe Channel Datatype Channel Invalid Message Channel Dead Letter Channel Guaranteed Delivery Channel Adapter Messaging Bridge Message Bus How can the application send a data item such that the receiver will know how to process it? 2008 JavaOne SM Conference java.sun.com/javaone 20

21 Messaging Channels Point-to-Point Channel Publish-Subscribe Channel Datatype Channel Invalid Message Channel Dead Letter Channel Guaranteed Delivery Channel Adapter Messaging Bridge Message Bus How can a messaging receiver gracefully handle receiving a message that makes no sense? 2008 JavaOne SM Conference java.sun.com/javaone 21

22 Messaging Channels Point-to-Point Channel Publish-Subscribe Channel Datatype Channel Invalid Message Channel Dead Letter Channel Guaranteed Delivery Channel Adapter Messaging Bridge Message Bus What will the messaging system do with a message it cannot deliver? 2008 JavaOne SM Conference java.sun.com/javaone 22

23 Messaging Channels Point-to-Point Channel Publish-Subscribe Channel Datatype Channel Invalid Message Channel Dead Letter Channel Guaranteed Delivery Channel Adapter Messaging Bridge Message Bus 2008 JavaOne SM Conference java.sun.com/javaone 23

24 Messaging Channels Point-to-Point Channel Publish-Subscribe Channel Datatype Channel Invalid Message Channel Dead Letter Channel Guaranteed Delivery Channel Adapter Messaging Bridge Message Bus Message Construction Command Message Document Message Event Message Request-Reply Return Address Correlation Identifier Message Sequence Message Expiration Format Indicator 2008 JavaOne SM Conference java.sun.com/javaone 24

25 Message Routing Content-Based Router Message Filter Dynamic Router Recipient List Splitter Aggregator Resequencer Composed Message Processor Scatter-Gather Routing Slip Process Manager Message Broker Message Transformation Envelope Wrapper Content Enricher Content Filter Claim Check Normalizer Canonical Data Model 2008 JavaOne SM Conference java.sun.com/javaone 25

26 Messaging Endpoints Messaging Gateway Messaging Mapper Transactional Client Polling Consumer Event-Driven Consumer Competing Consumers Message Dispatcher Selective Consumer Durable Subscriber Idempotent Receiver Service Activator System Management Control Bus Detour Wire Tap Message History Message Store Smart Proxy Test Message Channel Purger 2008 JavaOne SM Conference java.sun.com/javaone 26

27 Agenda Enterprise Application Integration Enterprise Integration Patterns Business Problem Implementation with CAPS Exercise Summary 2008 JavaOne SM Conference java.sun.com/javaone 27

28 Business Problem 2008 JavaOne SM Conference java.sun.com/javaone 28

29 ERP system read convert Approval system po.csv po.xml Monitoring system Notify po.xml convert po.txt convert Following an Order in the ERP System A batch of orders in CSV format is created File needs to be picked up, read and converted to a canonical format The CSV file does not contain all information necessary for the canonical format so it needs to be enriched All orders in the CSV file need to be approved by an approval system Each order needs to be sent out to the Internet Gateway (TDN) in EDI format, or to a Fax gateway in PS format A financial monitoring application needs to get a copy of the order An needs to be sent to the submitter of the order when the order goes out The goods receiving department needs to be notified of the order to prepare for arrival of goods TDN system po.edi 2008 JavaOne SM Conference java.sun.com/javaone 29

30 Business Solution is implemented in parts Each major interaction is in its own solution Allows for incremental development and testing Solutions ERP EAI Web procurement EAI Order approval EAI Financial Monitoring EAI TDN EAI Fax gateway EAI notification EAI 2008 JavaOne SM Conference java.sun.com/javaone 30

31 Solution in parts po.xml Finance Reserve.xml Monitoring system ERP system po.csv ERP po.xml approval po.xml T po.xml po.edi T TDN TDN system Approval system Web procurement order.xml Web po.xml Fax po.ps Fax system Q EAI applications or infrastructure po.xml po.txt Existing systems Messages 2008 JavaOne SM Conference java.sun.com/javaone 31

32 The solution in parts: ERP ERP system po.csv ERP po.xml ERP to order approval application Reads the file Converts it to Infoset, one for each PO in the CSV file Maps it to the canonical PO Looks up missing data in a database Invokes Order Approval Application Patterns Content Enricher Canonical data model Splitter Message translator Channel Adapter Document Message 2008 JavaOne SM Conference java.sun.com/javaone 32

33 Web procurement Is a web application that lives on a separate machine Web procurement EAI application Exposes a service through HTTP or JMS Uses a JMS queue for transaction isolation Looks up missing data Converts to canonical data format Patterns Content Enricher Canonical data model Message translator Point-to-point channel Channel Adapter Document Message Web procurement order.xml Q Web po.xml 2008 JavaOne SM Conference java.sun.com/javaone 33

34 Order approval system Is a J2EE application that lives on a separate machine Interaction must be transactional; interaction may take a long time (seconds to hours) Communication using JMS Store and Forward with Correlation Order approval application po.xml approval Approval system po.xml Exposes a service that takes the canonical purchase order Calls the approval system through JMS Waits for the response from JMS and correlates it Publishes the approved order into the Purchase Order Topic Topic decouples multiple receivers Rejected purchase orders go to a different topic Patterns Return Address, Splitter, Message Bus, Process Manager Message Correlation, Correlation Identifier, Content-based Router Guaranteed Delivery, Invalid Message Channel T T 2008 JavaOne SM Conference java.sun.com/javaone 34

35 Finance monitoring system Is a J2EE web service Finance application Receives Purchase Order from Topic Converts into reserve.xml format Invokes web service Patterns Durable Subscriber Messaging Mapper Request-Reply Process Manager Publish-Subscribe Channel Message Bus po.xml Finance Reserve.xml Monitoring system 2008 JavaOne SM Conference java.sun.com/javaone 35

36 po.xml TDN system Receives EDI messages over JMS TDN application Receives Purchase Order from Topic Ignores orders that should not go out over this channel Looks up additional data Converts into EDI Sends message to TDN over JMS Patterns Durable subscriber Message Router Message Translator Channel Purger Composed Message Processor Content Enricher Publish-Subscribe Channel TDN po.edi TDN system 2008 JavaOne SM Conference java.sun.com/javaone 36

37 Agenda What is Enterprise Application Integration Enterprise Integration Patterns Business Problem Implementation with CAPS Exercise Summary 2008 JavaOne SM Conference java.sun.com/javaone 37

38 Java CAPS / Open ESB Java CAPS Java Composite Application Platform Suite Open ESB the open source community around Java CAPS Supports (amongst others) Data format transformations / data mapping Transactions Two phase commit (short running transactions) Compensating transactions (long running transactions) Orchestration Connectivity to numerous external systems Expressions of business logic Service Composition 2008 JavaOne SM Conference java.sun.com/javaone 38

39 Java CAPS facilities Data format transformations / data mapping Readers for many different formats (idoc, edi,...) Object wrappers for these formats Mapping facilities in Java, XSLT, BPEL Transactions Two phase commit (short running transactions): through Java EE transaction manager Compensating transactions (long running transactions): through BPEL engine Orchestration: through BPEL engine Connectivity to numerous external systems 40+ JCA connectors, binding components Expressions of business logic (in Java, BPEL) Service Composition (composite applications) 2008 JavaOne SM Conference java.sun.com/javaone 39

40 Java CAPS consists of Design time An IDE in which you graphically lay out data flows and connections between systems / services Includes a graphical BPEL editor Includes graphical mappers for both Java, BPEL and XSLT Editor for wiring service units together Runtime A Java EE server / JBI runtime JCA connectors / Binding Components BPEL Engine Management and monitoring Browser based, graphical displays 2008 JavaOne SM Conference java.sun.com/javaone 40

41 Java CAPS Runtime EE and JBI in GalssFish v2 JBI (JSR-208) is a spec that enables interoperability of components between different JBI-compliant runtimes Components Service engines such as BPEL, XSLT, SQL, etc. EE is also considered a service engine Binding components such as JMS, File, HTTP, etc. Communication between components is message based is asynchronous can be mediated can be transactional can be very fast 2008 JavaOne SM Conference java.sun.com/javaone 41

42 The solution in parts: ERP ERP system po.csv ERP po.xml ERP specific data Reads and parses file In-out message exchange; all others are in-only All these message exchanges are inmemory Data mapping Canonical data Database lookup 2008 JavaOne SM Conference java.sun.com/javaone 42

43 Order approval system po.xml approval po.xml T BPEL process Exposed service Approval system T Request BPEL process OK Topic Reply Not OK Topic 2008 JavaOne SM Conference java.sun.com/javaone 43

44 Patterns Implemented in Solution Canonical data model Channel Adapter Channel Purger Composed Message Processor Content Enricher Content-based Router Correlation Identifier Document Message Durable Subscriber Guaranteed Delivery Invalid Message Channel Message Bus Message Correlation Message Router Message Translator Messaging Mapper Point-to-point channel Process Manager Publish-Subscribe Channel Request-Reply Return Address Splitter 22 Patterns 2008 JavaOne SM Conference java.sun.com/javaone 44

45 Infrastructure-assisted patterns JMS Message Server 12 patterns Point-to-point Channel Guaranteed Delivery Message Store Messaging Bridge Request/Reply Event-Driven Consumer Return Address Channel Adapter Message Bus Message Broker Message Dispatcher Event Message 2008 JavaOne SM Conference java.sun.com/javaone 45

46 Infrastructure-assisted patterns JBI NMR, BCs and Encoders 14 patterns Message Bus Message Routing Message Normalisation Message Broker Message Dispatcher Control Bus Canonical Data Model Event-Driven Consumer Request/Reply Content Based Router Datatype Channel Document Message Normalizer Event Message 2008 JavaOne SM Conference java.sun.com/javaone 46

47 Infrastructure-assisted patterns JBI BPEL SE and SUs, J2EE SE and SUs 6 patterns Message Correlation Composed Message Processor Message Mapper Splitter Content Enricher Process Manager NetBeans 6, GlassFish v2, Metro WS Infrastructure Channel Adapter Request/Reply 2008 JavaOne SM Conference java.sun.com/javaone 47

48 Agenda Enterprise Application Integration Enterprise Integration Patterns Business Problem Implementation with CAPS Exercise Summary 2008 JavaOne SM Conference java.sun.com/javaone 48

49 Let s exercise the solution 2008 JavaOne SM Conference java.sun.com/javaone 49

50 Agenda Enterprise Application Integration Enterprise Integration Patterns Business Problem Implementation with CAPS Exercise Summary 2008 JavaOne SM Conference java.sun.com/javaone 50

51 Summary EAI benefits from patterns-based development approach Tools can assist in pattern-based development Java CAPS infrastructure directly supports most patterns 2008 JavaOne SM Conference java.sun.com/javaone 51

52 Java CAPS EAI Patterns Java CAPS Basics Implementing Common EAI Patterns By Michael Czapski Sebastian Krueger Brendan Marry Saurabh Sahai Peter Vaneris Andrew Walker Prentice Hall, April, 2008 ISBN : Our blogs Frank - Michael JavaOne SM Conference java.sun.com/javaone 52

53 2008 JavaOne SM Conference java.sun.com/javaone 53

54 Michael Czapski, Enterprise Architect Frank Kieviet, Senior Staff Engineer TS JavaOne SM Conference java.sun.com/javaone 54