Variability differences among products in PL. Variability in PLE. Language Workbenches. Language Workbenches. Product Line Engineering

Transcription

1 PPL 2009 Keynote Markus Voelter Indepenent/itemis Language Workbenches in Product Line Engineering Variability in PLE Language Workbenches in Domain Specific Languages Modeling and Programming Modeling as Programming Programming as Modeling Expressing Configurabiliy in DSLs Modular Languages Summary Product Line Engineering Variability in PLE Variability differences among products in PL 1

2 Variability Mechanisms Removal optionally take away from overall whole Variability Mechanisms Injection optionally add to minimal core Variability Mechanisms Parametrization define values for predefined params Configuration vs. Customization Variability Routine Configuration Guidance, Efficiency Complexity, Flexibility Creative Construction Configuration Parameters Property Files Wizards Feature-Model Based Configuration Tabular Configurations Graph-Like Languages Framworks Manual Programming Configuration selecting options setting param values Configuration Feature Models mandatory optional Aircraft mandatory Wing Engine Materials or (n of m) alternative (1 of m) or (n of m) high shoulder low Jet Piston metal wood cloth plastic 2

3 Customization real languages instantiation connections Customization Languages PLE is also about Process Organization People Product Mgt. PLE is also about Process Organization People Product Mgt. not today! 3

4 Focus of this talk! Domain Specific Languages Domain Specific Languages programming started close to the hardware abstractions computing chips abstractions computing bits abstractions computing C 4

5 abstractions computing? Java abstractions computing? SQL? 5

6 general purpose domain specific tailor made effective++ specialized, limited used by experts together with other specialized tools execute? map 6

7 DSL Program (aka Model) automated! map map Generation Transformation Compilation GPL Program Interpretation Platform Architecture DSL As you understand and develop your Platform Architecture Develop a language to express it! 7

8 Language resembles architectural concepts Express the applications with the language. Another Story Architecture As Language 8

9 Modeling and Programming Compare Modeling Programming Domain Specific Notations and Abstractions Flexible! Limited! Frameworks Libraries (Fluent) APIs 9

10 Graphical Textual Forms Tables Customize Generator or Interpreter Flexible! Limited! Flexible! Limited! Textual Trees Reflection Meta Programs Open Compilers Define custom Query or or Navigate Transform Custom Validation or Error Checks Flexible! Limited! Flexible! Limited! AST APIs Static Analysis Regex IDE plugins Static Analysis Open Compilers Different Representations and Projections Mixing and Composing Languages Flexible! Limited! Flexible? Limited! Text is Text Code Folding Tree Views Visualizations Python-to-C-like Internal DSLs Embed-As-String Specific: LINQ 10

11 Scalable Usable IDE Support Debugging Refactoring Testing Brittle! Mature! Brittle! Mature! Modeling Tools!?? Versioning Diff, Merge Branching Brittle! Mature! Gets some Jobs done. Gets the Job Done! some people doubt that everybody agrees for some tools Different Worlds Programming Tools!= Modeling Tools 11

12 Different Worlds Modeling Tool!= Modeling Tool Different Worlds Mix Models and Programs Different Worlds Mix Models and Programs AST Navigation & Query Different Worlds Mix Models and Programs AST Navigation & Query Integration of 3GL code Different Worlds Mix Models and Programs AST Navigation & Query Integration of 3GL code Code Constraints 12

13 History? Why the difference? Modeling Programming Modeling Programming (Mostly) Textual Notations Concrete Syntax Storage (Fancy) ASCII Editors Read-Only Visualizations Modeling (Mostly) Graphical Notations Abstract Syntax Storage Projecting Editors Different editable views for model Programming (Mostly) Textual Notations Concrete Syntax Storage (Fancy) ASCII Editors Read-Only Visualizations Why the difference? 13

14 It is time for a Different Perspective Programming the way we do Modeling? Modeling Programming == == Programming Modeling Modeling the way we do Programming? We don t want to model, we want to program! 14

15 We don t want to model, we want to program! at different levels of abstaction from different viewpoints integrated! We don t want to model, we want to program! with different degrees of domain-specificity with suitable notations with suitable expressiveness We don t want to model, we want to program! And always: precise and tool processable Language Workbench (Martin Fowler) 15

16 Language Workbench (Martin Fowler)? Freely use define persistent languages and abstract representation integrate them Language Workbench (Martin Fowler) Language Workbench (Martin Fowler)? language ::= projectional editing + schema + editors generators Language Workbench (Martin Fowler) Language Workbench (Martin Fowler) persist incomplete or contradictory information Language Workbench (Martin Fowler) + powerful editing testing refactoring debugging groupware language definition implies IDE definition 16

17 Language Workbench (Martin Fowler) support for classical classical and+ modeling programming Syntax primarily textual Syntax primarily textual with more symbols think: mathematics Syntax primarily textual sometimes box&line style Syntax primarily textual sophisticated visualizations 17

18 Modeling as Programming Modeling as Programmig (Mostly) Textual Notations Concrete Syntax Storage (Fancy) ASCII Editors Read-Only Visualizations Parser-based text to tree to text Custom Syntax Graphical Textual Symbolic++ IDE Support Teamwork Debugging Custom Editors 18

19 Complete Symbolic Integration Goto Def Find Refs Refactoring Integrates with Current Dev Infrastructure Version Mgt Diff/Merge Cmd Line Tools Limited to Unicode how to handle non-character symbols Graphics!= Text two worlds separate editors per syntax/viewpoint models can still be ref integrated 19

20 Eclipse Xtext Building Textual Editors Eclipse Xtext Xtext: Specify Grammar Building Textual Editors Xtext: Gen. Meta Model Xtext: Constraints 20

21 Xtext: Generated Editor Xtext: Generated Editor Code Completion Xtext: Generated Editor Xtext: Generated Editor Syntax Coloring Custom Keyword Coloring Realtime Constraint Validation Xtext: Generated Editor Customizable Outlines Xtext: Generated Editor Code Folding 21

22 Xtext: Generated Editor Xtext: Generated Editor Goto Definition Find References Cross-File References Model as EMF DEMO I Building DSLs with Eclipse Xtext Programming as Modeling 22

23 Programming as Modeling (Mostly) Graphical Notations Abstract Syntax Storage Projecting Editors Different editable views for model Programming as Modeling (Mostly) Graphical Any kind of Notations Abstract Syntax Storage Projecting Editors Different editable views for model Projectional tree to text-lookalike (editor) to other trees **+ to text Language Composition There s no parsing. Unique Language Element Identity. Unlimited language composition. Flexible Notations Textual like ASCII box & line mathematical Graphical Semi-Graphical treated the same can be mixed 23

24 Automatic IDE Extension tool support is inherent for languages built with projectional tools language definition implies IDE definition Multiple Notations for the same concepts e.g. in different contexts or for different tasks Partial Projections different views for different roles/people only a particular variant Storage!= Schema store arbitrary meta data change log conflicting information variability annotations independent of language schema! aspects, overlay Live Programs think: spreadsheet a change to one part of program can lead to (dependent) changes in other parts useful e.g. for tests running in the workbench Tree Editing is different from editing text try to make it feel like text takes some getting used to but: for more flexible notations a more general editing paradigm is needed 24

25 Infrastructure Integration storage is not text diff/merge must be in tool existing text tools don t work Proprietary Tools no standards no out-of-the-box interop Jetbrains Meta Programming System Build new standalone DSLs released in Q licensed under Apache

26 Build new standalone DSLs Build DSLs that reuse parts of other languages Build new standalone DSLs Build DSLs that reuse parts of other languages (MPS comes with BaseLanguage) extend base language Java++ Build new standalone DSLs Build DSLs that reuse parts of other languages Language Extension Example (MPS comes with BaseLanguage) extend base language build DSLs that reuse parts of BaseLanguage Java++ Language Extension Example Language Extension Example Old ReadWriteLock l = l.readlock().lock(); try { //code finally { l.readlock().unlock(); Old ReadWriteLock l = l.readlock().lock(); try { //code finally { l.readlock().unlock(); New ReadWriteLock l = lock (l) { //code 26

27 Structure Editor Typesystem Generator Structure Editor Typesystem Generator Structure Editor Typesystem Generator Structure Editor Typesystem Generator Structure Editor Typesystem Generator Structure Editor Typesystem Generator 27

28 Structure Editor Typesystem Generator Structure Editor Typesystem Generator Structure Editor Typesystem Generator Language Extension Example Result behaves like a native base language construct Language Extension Example Result behaves like a native base language construct Language Extension Example Translated to regular Java code based on the generator package jaxdemo.sandbox.sandbox; import java.util.concurrent.locks.lock; public class DemoClass { private Lock lock; public DemoClass() { try { this.getlock().lock(); SharedResouce.instance().doSomething(); finally { this.getlock().unlock(); private Lock getlock() { return this.lock; 28

29 DEMO II Extending Java with JetBrains MPS Example Languages UI Language Example Languages HTML Templates Example Languages Persistent Classes 29

30 Tabular Projection Native Projection Textual DSL Projection Version 1.0 released in Dec 15, 2008 currently at 1.5 Statemachine Example Commercial Product Eval available upon request Statemachine Example Statemachine Example 30

31 Java Projection Ruby Projection Ruby Projection Two projections side/side Statemachine Example Statemachine Example Statemachine Example Statemachine Example Pension Workbench Example Text Editing Domain 31

32 Pension Workbench Example Pension Workbench Example Insurance Mathematics Domain Pension Rules Domain w/ tests Pension Workbench Example Pension Workbench Example All in one Document Symbolically integrated Expressing Configurability 32

33 Configuration on model level fewer variation points less complex expanded via generator Model Transformation Implementation Artefacts more abstract less detailed less abstract more detailed Configuration on model level fewer variation points less complex expanded via generator Transformation = Variation Point Negative Variability: Conditionally taking something away Negative Variability: Conditionally taking something away Feature Models 33

34 component DelayCalculator { provides default: IDelayCalculator requires screens[0..n]: IInfoScreen provides mon: IMonitoring feature monitoring component DelayCalculator { provides default: IDelayCalculator requires screens[0..n]: IInfoScreen provides mon: IMonitoring feature monitoring System Failover Monitoring Data Management Graceful Degradation Redundancy Centralized Distributed namespace monitoringstuff feature monitoring { component MonitoringConsole { requires devices:[*]: IMonitor instance monitor: MonitoringConsole dynamic connect monitor.devices query { type = IMonitor Positive Variability: Conditionally adding something to a minimal core Positive Variability: Conditionally adding something to a minimal core Aspects 34

35 namespace monitoring { component MonitoringConsole instance monitor: dynamic connect monitor.devices aspect (*) component { provides mon: IMonitoring component DelayCalculator { component AircraftModule { component InfoScreen { component DelayCalculator { component AircraftModule { component InfoScreen { aspect (*) component { provides mon: IMonitoring component DelayCalculator { provides mon: IMonitoring component AircraftModule { provides mon: IMonitoring component InfoScreen { provides mon: IMmonitoring Weaver isgeneric: works with all (container) model elements aspect (*) <type> all instances of type aspect (tag=bla) <type> all instances with tag bla aspect (name=s*) <type> all instances whose name starts with S AO + Features namespace monitoring feature monitoring { component MonitoringConsole instance monitor: dynamic connect monitor.devices aspect (*) component { provides mon: IMonitoring 35

36 DEMO III Adding Variability and connectivity to a feature model to an Xtext DSL A statemachine Actually, several! Variant for Pedestrians 36

37 Variant for Cars DEMO IV Expressing Variability with MPS Facilities to express Variability are completely independent of the target language! Facilities to express Variability are completely independent of the target language! which leads to 37

38 Modular Languages Viewpoints Business custom purpose-built create/include Custom Notations Viewpoints real business expert integration Business Viewpoints Technical predefined library configure Big Language? m k a o b n c L j i h d e f g with many first class concepts! 38

39 Small Language? L Modular Language a b c d e f my L g h i j k l with a few, orthogonal and poweful concepts with many optional, composable concepts Modular Language Like frameworks and libraries, Modular Language Like frameworks and libraries, but with syntax and IDE support Not a new idea 39

40 Growing A Language (Guy L Steele) (Seemingly) Simple Example Adding matrices to C in an embedded environment. Currently: Currently: Declare Data Structures in XML Generate Headers Implement manually in C Matrices not supported in XML format and generator 40

41 Currently: Currently: Tool team would have to do the extension a lot of work busy one central tool No real compiler support in the resulting C code type checks operator overloading generics (matrix<int>) matrix syntax? Better Solution Better Solution Better Solution generic matrix and vector types real matrix and vector literals 41

42 Better Solution Better Solution syntax highlights for vectors and matrices operator overloading Better Solution Better Solution operator overloading static optimization symmetrical matrices identity matrix diagonal matrices math notation Better Solution a separate language module used only by those who really need it 42

43 In addition: PLE Variability In addition: PLE Variability annotating variability expressions to arbitrary regions annotating variability expressions to arbitrary regions statically checked In addition: PLE Variability annotating variability expressions to arbitrary regions project variant 43

44 44

45 45

46 46

47 DEMO V Language Modularity with MPS 47

48 Summary Usefulness of DSLs Usable tools Variability in Models Modular Languages Usefulness of DSLs Usable tools Variability in Models Modular Languages Usefulness of DSLs Usable tools Variability in Models Modular Languages Usefulness of DSLs Usable tools Variability in Models Modular Languages 48

49 THE END Usefulness of DSLs Usable tools Variability in Models Modular Languages Markus Voelter Indepenent/itemis 49