Agile Engineering. and other stuff I m working on

Transcription

1 Agile Engineering and other stuff I m working on 2008 Gilb conference on Risk Ryan Shriver > Managing Consultant > rshriver@dominiondigital.com Leader in IT Performance Improvement > The Agile Engineer - theagileengineer.com 1 1

2 About Me Live and work in Richmond, Virginia, USA Leader in 50-person consulting boutique Like slinging code...just not every day Mostly coaching and high-level architecture currently Starting to write a bit at theagileengineer.com 2

3 Today s Agenda Story Telling Agile Engineering Augmenting Scrum with Evo Recent Case Studies Value Meter Demo 3

4 What I know about Risk 4

5 What I know about Risk Next to nothing Mitigation by Design Tackle head-on 4

6 Story Telling 5

7 My Agile Journey Scrum XP Evo Developer Software Architect Agile Coach Systems Engineer Started using XP Lead Architect - Product Development development practices J2EE extreme Programming Explained Beck Design Patterns JUnit Refactoring Fowler Martin Test-Driven Domain Driven Project Start using XP with 6 developers. In 18 months we had 40 developers, 100+ project members Automation Scaling Agility Gilb Learned how to make XP adapt firsthand, but struggled with issues not addressed by XP (size and complexity) FitNesse 3-week iterations Sun Labs Collins Contract: 4,400 2,000+ requirements user stories Evo and Scrum Lean Smart Rails Decisions Drucker What s Business Value? Production 6

8 My Agile Journey Scrum XP Evo Developer Software Architect Agile Coach Systems Engineer Started using XP Lead Architect - Product Development development practices J2EE extreme Programming Explained Beck Design Patterns JUnit Refactoring Fowler Martin Test-Driven Domain Driven Project Start using XP with 6 developers. In 18 months we had 40 developers, 100+ project members Scaling Agility Gilb Automation Learned how to make XP adapt firsthand, but struggled with issues not addressed by XP (size and complexity) FitNesse 3-week Collins iterations Sun Labs Contract: 4,400 requirements 2,000+ user stories Evo and Scrum Lean Smart Rails Decisions Drucker What s Business Value? Production Can we build large scale systems efficiently and effectively using Agile? 6

9 System Background Suite of Lending Products Web-based system-of-record for billions in assets Platform O/S Database App Servers Rules OS Libraries Tools Testing Performance Java 2 Enterprise Edition Solaris, Windows, Linux, z390 Oracle, SQL Server, DB2 BEA WebLogic, IBM WebSphere Embedded Blaze Rules Engine Hibernate, Spring, Struts, Apache Commons CVS, Maven, CruiseControl, Eclipse, Jira, WIki JUnit, FitNesse, Selenium Mercury, JProfiler, verbose:gc 7

10 Software Specifications Lines of Code 673,000 Java classes 5,300 FitNesse Selenium JUnit 118,000 assertions run nightly 9,000 test scripts 637 Test classes - 3,243 test methods Libraries 97 Architecture Adapters MVC, Domain Driven, Events, Services Web Services, JMS, File 8

11 Sources of Complexity Accounting Domain Configurability of Product Range of Client Needs Implementation Complexity Performance Requirements 9

12 Our User Stories Story Estimate Story Name Unique Story Number QA Testing Estimate Color-coded sticker per application layer / components Signed and dated by QA when approved Strikethrough signifies this developer is done with their piece Developer s initials & their estimate 10

13 Our Iteration Tracking 11

14 Our Release Backlog Upcoming Stories Upcoming Iterations 12

15 Our Continuous Integration 13

16 What I Learned 14

17 What I Learned Agile technical books didn t provide much guidance on building large scale, high-performance systems 14

18 What I Learned Agile technical books didn t provide much guidance on building large scale, high-performance systems System qualities must be Priority #1 for Architects 14

19 What I Learned Agile technical books didn t provide much guidance on building large scale, high-performance systems System qualities must be Priority #1 for Architects It s never too late if you follow simple design principles and have an agile codebase Customer Search: s => s 2x TPS 14

20 What I Learned Agile technical books didn t provide much guidance on building large scale, high-performance systems System qualities must be Priority #1 for Architects It s never too late if you follow simple design principles and have an agile codebase Customer Search: s => s 2x TPS I wish I had known sooner about the exponential importance of qualities...i was busy focusing on user stories 14

21 What I Want To Do Establish Agile as a legitimate method for building large, complex systems Get beyond code-level and move towards systemsengineering agile topics Distill the best ideas into digestible Principles and Practices 15

22 Agile Engineering 16

23 Principles of Agile Engineering 1. Deliver Value 2. Quantify Qualities 3. Reduce Feedback Cycles 4. Explore Alternatives 5. Last Responsible Moment 6. Front-to-Back 7. Test-Driven Development 17

24 Principles of Agile Engineering 1. Deliver Value 2. Quantify Qualities 3. Reduce Feedback Cycles 4. Explore Alternatives 5. Last Responsible Moment 6. Front-to-Back 7. Test-Driven Development 17

25 Focus on Delivering Value to Stakeholders What they said 18

26 Quantify Qualities Why people buy ipods: It s not what you do, it s how well you do it, that matters 19

27 Quantify Qualities Why people buy ipods: It s not what you do, it s how well you do it, that matters $10 price Sales: Zune [Nov May 2008]: 2 million units ipod [Oct Mar 2008]: 84 million units difference 19

28 Reduce Feedback Cycles Communication Learning Release Build Integration Testing Plan Do Act Study The only sustainable competitive advantage is the ability to learn faster than the competition. - Arie de Geus, author of The Living Company 20

29 Last Responsible Moment Maximize time to gather data and make decision Design for Unknowns 21

30 Last Responsible Moment Maximize time to gather data and make decision Design for Unknowns 21

31 Explore Alternative Designs Time Don t decide here Decide here 22

32 Explore Alternative Designs Alternative Design Prototypes Time Don t decide here Gathering Facts Team Learning & Knowledge Decide here 22

33 Front-to-Back 23

34 Front-to-Back Client System 23

35 Front-to-Back Client System User Interface Layer Business Logic Layer Data Access Layer Operating System 23

36 Front-to-Back Client System User Interface Layer Business Logic Layer Data Access Layer Operating System Database System 23

37 Front-to-Back S P I K E Client System User Interface Layer Business Logic Layer Data Access Layer Operating System Database System 23

38 Front-to-Back S P I K E Client System User Interface Layer Business Logic Layer Data Access Layer Operating System Database System 23

39 Front-to-Back Client System S S S P I K User Interface Layer Business Logic Layer P I K P I K E Data Access Layer E E Operating System Database System 23

40 Test-Driven Development 24

41 Test-Driven Development Design Implement Test? 24

42 Test-Driven Development Design Implement Test? 24

43 Test-Driven Development Design Implement Test? Test Design Implement Test 24

44 Measuring Business Value with Scrum 25

45 Premise Agile is a fine method to help you do things right Agile doesn t help you do the right things 26

46 So can we adapt Agile? Yes, but we need to: 27

47 So can we adapt Agile? Yes, but we need to: Deliver the Right Thing 27

48 So can we adapt Agile? Yes, but we need to: Deliver the Right Thing Measure Business Value 27

49 So can we adapt Agile? Yes, but we need to: Deliver the Right Thing Measure Business Value Focus on Value Alignment 27

50 So can we adapt Agile? Yes, but we need to: Deliver the Right Thing Measure Business Value Focus on Value Alignment Measure Progress to Goals 27

51 Recent Case Studies 28

52 Evo + Scrum Case Study Start-up subsidiary of international company Building patent-pending, dynamic online marketing engine. Company founded Jan We started in Mar. Production in Nov. Used Evo for Business Objectives & Requirements. Scrum for implementation As of April 2008 three US airlines and large online travel company live, 3 more airlines and rail in Q3-Q ~1 million daily transactions hitting target response times 29

53 Value Meter Demo 30

54 Value Meter Tool to specify and measure progress to goals Shooting to open source project in Q3 - Q4 Also hope for hosted solution 31

55 Thank You Questions? Ryan Shriver > Managing Consultant > Leader in IT Performance Improvement > Download this and all my presentations from theagileengineer.com 32 32