Cost-effective development of flexible self-* applications

Transcription

1 Cost-effective development of flexible self-* applications Radu Calinescu Computing Laboratory University of Oxford

2 Outline Motivation Generic self-* framework Self-* application development

3 Motivation cost-effective word processing spreadsheets flexible no general-purpose architecture & generic development approaches for self-* applications cost-effective flexible

4 Framework objectives Significant reduction in development effort/expertise/cost component reuse off-the-shelf technologies & tools Major improvement in application flexibility/robustness model-based development automated code generation New powerful capabilities new classes of policies support for system-of-systems development

5 Typical drawbacks of self-* architectures

6 Typical drawbacks of self-* architectures application-specific metadata hard-coded within the autonomic manager

7 Typical drawbacks of self-* architectures resource-specific code application-specific metadata hard-coded within the autonomic manager

8 Typical drawbacks of self-* architectures resource-specific code application-specific metadata hard-coded within the autonomic manager manually-implemented interfaces

9 Typical drawbacks of self-* architectures statically-defined high-level interfaces resource-specific code application-specific metadata hard-coded within the autonomic manager manually-implemented interfaces

10 Generic self-* architecture statically-defined high-level interfaces resource-specific code supply the knowledge at runtime to application-oblivious autonomic manager manually-implemented interfaces

11 Generic self-* architecture statically-defined high-level interfaces resource-oblivious code supply the knowledge at runtime to application-oblivious autonomic manager manually-implemented interfaces

12 Generic self-* architecture statically-defined high-level interfaces resource-oblivious code supply the knowledge at runtime to application-oblivious autonomic manager automatic generation of autonomic manager interfaces & computer-aided development of resource interfaces

13 Generic self-* architecture policy-driven, runtime generation of high-level interfaces resource-oblivious code supply the knowledge at runtime to application-oblivious autonomic manager automatic generation of autonomic manager interfaces & computer-aided development of resource interfaces

14 Implementation Policy engine = (.NET/C#) web service platform independence standards-based support for security loose coupling

15 Implementation Policy engine = (.NET/C#) web service Knowledge = XML-encoded model of resource parameters & behaviour off-the-shelf tools to process model (XSLT engines, XSD code generators)

16 Implementation Policy engine = (.NET/C#) web service Knowledge = XML-encoded model of resource parameters & behaviour Manageability adaptors = web services that subclass abstract Adaptor class Adaptor class implements the bulk of the functionality several other components generated automatically from the system model Policy engine interface = generated online from model using OO reflection

17 Implementation Policy engine = (.NET/C#) web service Knowledge = XML-encoded model of resource parameters & behaviour Manageability adaptors = web services that subclass abstract Adaptor class Policy engine interface = generated online from model using OO reflection High-level interfaces = policy-driven, automatically generated web services expose system to its environment specified by resource definition policies enable system integration into self-* systems of systems

18 Implementation hierarchical system of systems Policy engine = (.NET/C#) web service Knowledge = XML-encoded model of resource parameters & behaviour Manageability adaptors = web services that subclass abstract Adaptor class Policy engine interface = generated online from model using OO reflection High-level interfaces = policy-driven, automatically generated web services

19 Implementation system-of-systems federation Policy engine = (.NET/C#) web service Knowledge = XML-encoded model of resource parameters & behaviour Manageability adaptors = web services that subclass abstract Adaptor class Policy engine interface = generated online from model using OO reflection High-level interfaces = policy-driven, automatically generated web services

20 Application development generate/implement application-specific components configure policy engine & deploy new components specify/select self-* policies (system developer) (system administrator) (system user) Generation Deployment Exploitation

21 Application development generate/implement configure policy application-specific engine & deploy new Sample self-* application components components specify/select self-* policies Allocate data-centre servers to clusters of different priorities & (system variable developer) workloads such (system that administrator) they achieve user-defined (system levels user) of availability in the presence of cluster component failures. Generation Deployment Exploitation

22 (XML) system model Build XML model describing the system resources, their parameters and behaviour Instance of pre-defined XML schema (meta-model ) Generation

23 (XML) system model Generation

24 (XML) system model Generation

25 (XML) system model G2: XSL transformation System (XML) schema Generation

26 (XML) system model G2: XSL transformation System (XML) schema G3: XSD code generation System data types (classes) Generation

27 (XML) system model G2: XSL transformation System (XML) schema G3: XSD code generation System data types (classes) G4: generic service subclassing Manageability adaptor Generation

28 (XML) system model G2: XSL transformation Configured D1: policy policy engine engine configuration System (XML) schema G3: XSD code generation System data types (classes) Use web client to supply model to the policy engine G4: generic service subclassing Manageability adaptor Generation Deployment

29 (XML) system model G2: XSL transformation Configured D1: policy policy engine engine configuration System (XML) schema G3: XSD code generation System data types (classes) Use web client to supply model to the policy engine G4: generic service subclassing Manageability adaptor Generation Deployment

30 (XML) system model G2: XSL transformation Configured D1: policy policy engine engine configuration System (XML) schema G3: XSD code generation System data types (classes) G4: generic service subclassing Manageability adaptor Generation Manageable D2:adaptor resources deployment Deployment

31 (XML) system model G2: XSL transformation Configured D1: policy policy engine engine configuration System (XML) schema G3: XSD code generation System data types (classes) Self-* system G4: generic service subclassing Manageability adaptor Generation Manageable D2:adaptor resources deployment Deployment E2: resource discovery Exploitation

32 (XML) system model G2: XSL transformation System (XML) schema G3: XSD code generation System data types (classes) G4: generic service subclassing Manageability adaptor Generation Configured D1: policy policy engine engine configuration Manageable D2:adaptor resources deployment Deployment E1: policy specification Self-* system E2: resource discovery Exploitation

33 Utility-function policy

34 Utility-function policy

35 Utility-function policy

36 Utility-function policy

37 Online quantitative analysis in self-* systems Sample self-* application: summary user-specified target availabilities monitored workload Autonomic manager server allocation decisions The allocation of data-centre servers to clusters is managed automatically, based on high-level system objectives specified by data-centre administrators.

38 Case study summary Resource type self-* areas & policy type application domain Allocation of CPU capacity software data hardware legacy autonomic-enabled self-monitoring self-optimisation main self-* functional areas action goal utility-function resource-definition CPU capacity allocation Goal-driven CPU sched. self-monitoring self-optimisation CPU capacity allocation Disk drive DPM Ctrl. of cluster availability Dynamic gen. of web content self-monitoring self-adaptation self-configuration self-protection self-monitoring self-generation dynamic power management availability management online report generation