Automated Reliability Prediction & Analysis of SwAs

Size: px

Start display at page:

Download "Automated Reliability Prediction & Analysis of SwAs"

Junior Cunningham
5 years ago
Views:

1 Automated Reliability Prediction & Analysis of SwAs jmfranco [at] dei.uc.pt Postgraduate Colloquium Series 2012

2 Outline Motivation Main Goal Background Proposed Approach Experiments & Validation Conclusions & Future Work 2

3 Motivation

4 Software Architecture 4

5 Quality Attributes Performance Availability Reliability Maintainability Security 5

6 SwA Quality Attributes Assessment Early architectural decisions Influence software quality Prevent additional costs Assure architects on stakeholder requirements Problem - In current practice, very few software quality attributes are automatically checked 6

7 Main Goal

8 Main Goal Automated Reliability Prediction and Analysis from a Software Architecture Description Prediction 90 % ADL File Stochastic Model Analysis 8

9 Background

10 Background Software Architecture [Shaw96, Bass03, Taylor10] Reliability Prediction Reliability modeling using Markov Chains [Cheung78] Reliability assessment from a SwA description [Cortellessa02; Reussner03; Brosch11] Surveys [Goseva-Popstojanova01; Gokhale07; Immonen08; Pengoria09] 10

11 Reliability Assessment Approaches Architecture + Failure Behaviour Additive Model Path-based Model State-based Model Composite Hierarchical 11

12 Proposed Approach

13 Architectural Description To Reliability Prediction ADL File Architectural Constituents Annotations 13

14 Architectural Description To Reliability Prediction Parser Input ADL File Architectural Constituents Annotations 14

Architectural Description To Reliability Prediction Parser Translator S 1 0.6 0.2 0.2 Input S 2 0.7 S 4 S 3 0.3 1 0.4 0.6 0.5 0.

15 Architectural Description To Reliability Prediction Parser Translator S Input S S 4 S ADL File 0.4 S 5 S Architectural Constituents S S S 8 Annotations From any other state F C 0.9 S

16 Architectural Description To Reliability Prediction Parser Translator Generate Prism File Input ADL File Architectural Constituents Annotations 16

17 Architectural Description To Reliability Prediction Parser Translator Generate Prism File Input Loaded into ADL File Prism Tool Architectural Constituents Annotations 17

18 Architectural Description To Reliability Prediction Parser Translator Generate Prism File Input Loaded into ADL File Prism Tool Architectural Constituents Annotations Report 18

19 Sensitivity Analysis Identify reliability bottlenecks R =1 10 x, x = log 10 (1 R) Analyze usage profile variation Pij 0 = P ij ± 10% p = P ij P 0 ij P 0 ik = P ik p P ik P n k6=j P ik Analysis Ranking 19

20 Experiments & Validation

21 Reliability Prediction Literature Our Approach Difference Composite % Gokhale 2002 Hierarchical % Lo et al % 21

22 Sensitivity Analysis S S S 4 S S 5 S S S 9 S 8 From any other state F C 0.9 S

23 Architectural Styles Style Wang et al Our approach Reliability Diff. Batch-sequential % Parallel % Fault-tolerance % Call-and-return % 23

24 Conclusions & Future Work

25 Conclusions Overcome some shortcomings Lack of support for tools Weak reliability analysis Weak validation of methods Supports four degrees of freedom 25

26 Future Work Apply to a real case-study - ZNN.com Performance Vs. Reliability Validate our approach with real values Compare different reliability prediction methods 26

27 What to Remember? Automated stochastic model generation Discard the manual effort Supports design and evolution phases 27

28 Questions?

A Hierarchical Framework for Estimating Heterogeneous Architecture-based Software Reliability

Andrews University Digital Commons @ Andrews University Master's Theses Graduate Research 2014 A Hierarchical Framework for Estimating Heterogeneous Architecture-based Software Reliability Wayne Morris