The Power of Events. An Introduction to Complex Event Processing in Distributed Enterprise Systems. David Luckham

Transcription

1 The Power of Events An Introduction to Complex Event Processing in Distributed Enterprise Systems David Luckham AAddison-Wesley Boston San Francisco New York Toronto Montreal London Munich Paris Madrid Capetown Sydney Tokyo Singapore Mexico City

2 Preface Acknowledgments PART I A Simple Introduction to Complex Event Processing l 1 The Global Information Society and the Need for New Technology Distributed Information Systems Everywhere The Global Communication Spaghetti Pot Event Causality Electronic Archeology: Layers upon Layers A Layered Enterprise System Vertical Causality: Tracking Events up and down the Layers Event Aggregation: Making High-Level Sense out of Low-Level Events The Gathering Storm of New Activities on the Web Global Electronic Trade Agile Systems Cyber Warfare and the Open Electronic Society Summary: Staying ahead of Chaos 26 2 Managing the Electronic Enterprise in the Global Event Cloud How the Global Event Cloud Forms The Open Enterprise The Global Event Cloud The Electronic Enterprise Operating in the Global Event Cloud Going Beyond Workflow Parallel and Asynchronous Processes On-the-Fly Process Evolution 37 xv xix vii

3 viii Contents 2.6 Exceptions Must Be First-Class Citizens in Process Design Summary: Managing the Electronic Enterprise 41 3 Viewing the Electronic Enterprise Keeping the Human in Control Today's Event Monitoring Is Too Primitive System Monitoring Focuses on the Network Layer Network-Level Monitoring Doesn't Even Solve Network Problems An Example of Causal Tracking Information Gaps Examples of Information Gaps Problem-Relevant Information Viewing Enterprise Systems Creating and Coordinating Multiple Views Hierarchical Viewing An Example of Hierarchical Viewing Summary: Viewing the Electronic Enterprise 59 4 Designing the Electronic Enterprise Process Architectures Roles of Architecture in the Process Lifecycle Constituents of Process Architectures Annotations Architectural Structure Interface Communication Architectures Architecture Diagrams Behavior Specification Design Constraints Examples of Informal Annotations Dynamic Process Architectures Diagrams for Dynamic Architectures? Layered Architectures and Plug-and-Play Abstraction Principle Summary: Technology to Support Process Architecture 84 5 Events, Timing, and Causality What Events Are How Events Are Created 90

4 ix 5.3 Time, Causality, and Aggregation The Cause-Time Axiom Genetic Parameters in Events Timestamps, Causal Vectors Time Causality and Posets Causal Event Executions Real-Time Posets Orderly Observation Observation and Uncertainty Summary Event Patterns, Rules, and Constraints Common Kinds of Pattern Searching Event Patterns A Strawman Pattern Language Pattern Matching Writing Patterns in STRAW-EPL Event Pattern Rules Constraints Summary Complex Events and Event Hierarchies Aggregation and Complex Events Creating Complex Events Event Abstraction Hierarchies Viewing a Fabrication Line Building Personalized Concept Abstraction Hierarchies Viewing Network Activity Viewing Stock-Trading Activity Summary 141 PART II Building Solutions with CEP The RAPIDE Pattern Language Event Pattern Languages Basic Requirements Features of RAPIDE Types Predefined Types Structured Types 150

5 8.3.3 Event Types Execution Types Subtyping of Executions Attributes of Events Basic Event Patterns Placeholders and Pattern Matching Matching Basic Event Patterns Placeholder Bindings Notation to Aid in Writing Patterns Relational Operators and Complex Patterns Relational Operators Guarded Patterns Content-Based Pattern Matching Context-Based Pattern Matching Temporal Operators Repetitive Patterns Pattern Macros Summary 174 CEP Rules and Agents Overview Event Pattern Rules Definition of Event Pattern Rules Rule Bodies Context and Visibility Laws Semantics of Event Pattern Rules Examples of Rules Event Processing Agents Definition of EPAs Semantics of EPAs Event Pattern Filters Definition of Filters Semantics of Filters Action Name Filters Content Filters Context Filters Event Pattern Maps Definition of Maps Semantics of Maps Event Pattern Constraints Definition of Constraints 195

6 xi Semantics of Constraints Examples of Constraints Other Classes of EPAs Summary Event Processing Networks Common Structures of EPNs Flexibility of Event Processing Networks Connecting Event Processing Agents Basic Connections Guarded Connections Multiple Basic Connections Dynamic Event Processing Networks Class Connections Creation and Termination Rules Connection Generators Architectures and Event Processing Networks Architecture Classes Semantics of Architecture Classes Examples of EPNs and Architectures Case Study: EPNs for Network Viewing Visual Tools for Constructing EPNs Security Scalability Summary Causal Models and Causal Maps Causality between Events, Revisited Why We Need Causal Models What Causal Models Are Defining a Causal Model and a Causal Map Using Pattern Pairs to Specify Causal Models Using Causal Rules Resolving Ambiguities Causal Maps A Small Example of a Causal Map A Second Example of a Causal Map Developing Accurate Causal Models Summary 260

7 xli Contents 12 Case Study: Viewing Collaboration between Business Processes A Collaborative Business Agreement An Interface Communication Architecture Causal Model Causal Map Examples of Causal Rules Examples of Constraints Analysis of Examples of Posets Constraint Checking Becomes Part of the Collaboration Implementing Event Abstraction Hierarchies The Accessible Information Gap Event Abstraction Hierarchies, Revisited Induced Causality Abstraction Effect on Constraints Modifiability Bridging the Information Gaps Steps to Apply a Hierarchy to a Target System A Hierarchy for a Fabrication Process Personal Views Implementation Diagnostics Case Study: Viewing a Financial Trading System A Small Stock-Trading System The Information Gap for STS An Event Abstraction Hierarchy for STS Building the Event Abstraction Hierarchy Level Level Level Implementing Hierarchical Viewing for STS Three Steps toward Human Control Drill-Down Diagnostics Detecting Constraint Violations The Abstraction Effect Summary 327

8 xiii 15 Infrastructure for Complex Event Processing Examples of Forms of Observed Events Interfacing CEP Infrastructure to Target Systems CEP Adapters CEP Runtime Infrastructure Infrastructure Interfaces and Components Functionality of the Interface Off-the-Shelf Infrastructure Event Pattern Languages Complex Event Pattern Matchers Quest for Scalability The Naive View of Pattern Matchers What Pattern Matchers Really Do Design Structure Rules Management Analysis Tools Summary 356 Bibliography 357 Index 359