ETSI ES V1.1.1 ( )

Transcription

1 ES V1.1.1 ( ) Standard Methods for Testing and Specification (MTS); The Test Description Language (TDL); Specification of the Abstract Syntax and Associated

2 2 ES V1.1.1 ( ) Reference DES/MTS-140_TDL Keywords language, MBT, methodology, testing, TSS&TP, TTCN-3, UML 650 Route des Lucioles F Sophia Antipolis Cedex - FRANCE Tel.: Fax: Siret N NAF 742 C Association à but non lucratif enregistrée à la Sous-Préfecture de Grasse (06) N 7803/88 Important notice The present document can be downloaded from: The present document may be made available in electronic versions and/or in print. The content of any electronic and/or print versions of the present document shall not be modified without the prior written authorization of. In case of any existing or perceived difference in contents between such versions and/or in print, the only prevailing document is the print of the Portable Document Format (PDF) version kept on a specific network drive within Secretariat. Users of the present document should be aware that the document may be subject to revision or change of status. Information on the current status of this and other documents is available at If you find errors in the present document, please send your comment to one of the following services: Copyright Notification No part may be reproduced or utilized in any form or by any means, electronic or mechanical, including photocopying and microfilm except as authorized by written permission of. The content of the PDF version shall not be modified without the written authorization of. The copyright and the foregoing restriction extend to reproduction in all media. European Telecommunications Standards Institute All rights reserved. DECT TM, PLUGTESTS TM, UMTS TM and the logo are Trade Marks of registered for the benefit of its Members. 3GPP TM and LTE are Trade Marks of registered for the benefit of its Members and of the 3GPP Organizational Partners. GSM and the GSM logo are Trade Marks registered and owned by the GSM Association.

3 3 ES V1.1.1 ( ) Contents Intellectual Property Rights... 6 Foreword Scope References Normative references Informative references Definitions and abbreviations Definitions Abbreviations Basic Principles What is TDL? Applicability of the present document Design Considerations Document Structure Notational Conventions Conformance Foundation Overview Abstract Syntax Classifier Description Element PackageableElement Package ElementImport Comment Annotation AnnotationType TestObjective TestObjectiveRealizer Data Overview Abstract Syntax Classifier Description DataElement MappableDataElement DataSet DataInstance DataProxy DataResourceMapping DataElementMapping Test Architecture Overview Abstract Syntax Classifier Description TestConfiguration GateType GateInstance ComponentType ComponentInstanceRole ComponentInstance Connection... 27

4 4 ES V1.1.1 ( ) 8 Test Behaviour Overview Abstract Syntax Classifier Description TestDescription Block Behaviour CombinedBehaviour SingleCombinedBehaviour CompoundBehaviour OptionalBehaviour BoundedLoopBehaviour UnboundedLoopBehaviour MultipleCombinedBehaviour AlternativeBehaviour ConditionalBehaviour ParallelBehaviour AtomicBehaviour Break Stop VerdictAssignment VerdictType Interaction Action ActionReference TestDescriptionReference ArgumentSpecification DataInstanceArgumentSpecification DataProxyArgumentSpecification DataSetArgumentSpecification ExceptionalBehaviour DefaultBehaviour InterruptBehaviour PeriodicBehaviour Time Overview Abstract Syntax Classifier Description Time TimeUnit TimeOperation Wait Quiescence TimeConstraint Timer TimerOperation TimerStart TimeOut TimerStop Predefined Types Overview Predefined Element Instances of 'VerdictType' pass fail inconclusive Predefined Element Instances of 'TimeUnit' tick nanosecond microsecond millisecond... 52

5 5 ES V1.1.1 ( ) second minute hour Annex A (informative): Annex B (informative): Technical Representation of the TDL Meta-Model Examples of a TDL Concrete Syntax B.1 Introduction B.2 A 3GPP Conformance Example in Textual Syntax B.3 An IMS Interoperability Example in Textual Syntax B.4 An Example Demonstrating TDL Data Concepts B.5 TDL Textual Syntax Reference B.5.1 Conventions for the TDLan Syntax Definition B.5.2 TDL Textual Syntax EBNF Production Rules Annex C (informative): Bibliography History... 71

6 6 ES V1.1.1 ( ) Intellectual Property Rights IPRs essential or potentially essential to the present document may have been declared to. The information pertaining to these essential IPRs, if any, is publicly available for members and non-members, and can be found in SR : "Intellectual Property Rights (IPRs); Essential, or potentially Essential, IPRs notified to in respect of standards", which is available from the Secretariat. Latest updates are available on the Web server ( Pursuant to the IPR Policy, no investigation, including IPR searches, has been carried out by. No guarantee can be given as to the existence of other IPRs not referenced in SR (or the updates on the Web server) which are, or may be, or may become, essential to the present document. Foreword This Standard (ES) has been produced by Technical Committee Methods for Testing and Specification (MTS).

7 7 ES V1.1.1 ( ) 1 Scope The present document specifies the abstract syntax of the Test Description Language (TDL) in the form of a meta-model based on the OMG Meta Object Facility (MOF) [1] and also specifies the semantics of the individual elements of the TDL meta-model. The intended use of the present document is to serve as the basis for the development of TDL concrete syntaxes aimed at TDL users and enable TDL tools such as documentation generators, specification analyzers, and code generators. The specification of concrete syntaxes for TDL is outside the scope of the present document. However, for illustrative purposes, an example of a possible textual syntax together with its application on some existing test descriptions are provided. 2 References References are either specific (identified by date of publication and/or edition number or version number) or non-specific. For specific references, only the cited version applies. For non-specific references, the latest version of the referenced document (including any amendments) applies. Referenced documents which are not found to be publicly available in the expected location might be found at NOTE: While any hyperlinks included in this clause were valid at the time of publication, cannot guarantee their long term validity. 2.1 Normative references The following referenced documents are necessary for the application of the present document. [1] "OMG Meta Object Facility (MOF) Core Specification V2.4.1", formal/ NOTE: Available at [2] "OMG Unified Modeling Language TM (OMG UML) Superstructure, Version 2.4.1", formal/ [3] ISO/IEC :1994: "Information technology - Open Systems Interconnection -- Conformance testing methodology and framework -- Part 1: General concepts". 2.2 Informative references The following referenced documents are not necessary for the application of the present document but they assist the user with regard to a particular subject area. [i.1] [i.2] [i.3] ES (V4.5.1): "Methods for Testing and Specification (MTS); The Testing and Test Control Notation version 3; Part 1: TTCN-3 Core Language". TS (V10.2.0): "LTE; Evolved Universal Terrestrial Radio Access (E-UTRA) and Evolved Packet Core (EPC); User Equipment (UE) conformance specification; Part 1: Protocol conformance specification (3GPP TS version Release 10)". TS : "Technical Committee for IMS Network Testing (INT); IMS NNI Interoperability Test Specifications; Part 2: Test descriptions for IMS NNI Interoperability".

8 8 ES V1.1.1 ( ) 3 Definitions and abbreviations 3.1 Definitions For the purposes of the present document, the following terms and definitions apply: abstract syntax: graph structure representing a TDL specification in an independent form of any particular encoding NOTE: The TDL abstract syntax is defined in terms of the TDL meta-model. action: any procedure carried out by a component of a test configuration or an actor during test execution that could result in changes to the test verdict actor: abstraction of entities outside a test configuration that interact directly with the components of that test configuration component: active element of a test configuration that is either in the role tester or system under test concrete syntax: particular representation of a TDL specification, encoded in a textual, graphical, tabular or any other format suitable for the users of this language interaction: any form of communication between components that is accompanied with an exchange of data NOTE: An interaction can be a point-to-point or a point-to multipoint communication. meta-model: modelling elements representing the abstract syntax of a language System Under Test (SUT): role of a component within a test configuration whose behaviour is validated when executing a test description TDL model: instance of the TDL meta-model TDL specification: representation of a TDL model given in a concrete syntax test configuration: specification of a set of components that contains at least one tester component and one system under test component plus their interconnections via gates and connections test description: specification of test behaviour that runs on a given test configuration test verdict: Result from executing a test description [3]. tester: role of a component within a test configuration that controls the execution of a test description against the components in the role system under test 3.2 Abbreviations For the purposes of the present document, the following abbreviations apply: EBNF Extended Backus-Naur Form IMS IP Multimedia Subsystem MBT Model-Based Testing MOF Meta-Object Facility SUT System Under Test TDD Test Driven Development TDL Test Description Language TTCN-3 Testing and Test Control Notation version 3 UML Unified Modelling Language URI Unified Resource Identifier UTP UML Testing Profile

9 9 ES V1.1.1 ( ) 4 Basic Principles 4.1 What is TDL? TDL is a language that supports the design and documentation of formal test descriptions that can be the basis for the implementation of executable tests in a given test framework, such as TTCN-3 [i.1]. Application areas of TDL that will benefit from this homogeneous approach to the test design phase include: Manual design of test descriptions from a test purpose specification, user stories in test driven development (TDD) or other sources. Representation of test descriptions derived from other sources such as MBT test generation tools, system simulators, or test execution traces from test runs. TDL supports the design of black-box tests for distributed, concurrent real-time systems. It is applicable to a wide range of tests including conformance tests, interoperability tests, tests of real-time properties and security tests based on attack traces. Being a formal notation, TDL clearly separates the specification of tests from their implementation by providing an abstraction level that lets users of TDL focus on the task of describing tests that cover the given test objectives rather than getting involved in implementing these tests to ensure their fault detection capabilities onto an execution framework. TDL is designed to support different abstraction levels of test specifications. On one hand, the concrete syntax of the TDL meta-model can hide meta-model elements that are not needed for a declarative (more abstract) style of specifying test descriptions. For example, a declarative test description could work with the time operations wait and quiescence instead of explicit timers and operations on timers (see clause 9). On the other hand, an imperative (less abstract or refined) style of a test description supported by a dedicated concrete syntax could provide additional means necessary to derive executable test descriptions from declarative test descriptions. For example, an imperative test description could include timers and timer operations necessary to implement the reception of SUT output at a tester component and further details. It is expected that most details of a refined, imperative test description can be generated automatically from a declarative test description. Supporting different shades of abstraction by a single TDL meta-model offers the possibility of working within a single language and using the same tools, simplifying the test development process that way. 4.2 Applicability of the present document The TDL language design is centered around the three separate concepts of abstract syntax, concrete syntax, and semantics (see figure 4.1). The present document covers the TDL abstract syntax given as the TDL meta-model and its associated semantics. The TDL concrete syntax is application or domain specific and is not specified in the present document. However, for information, see annex B for an example of a concrete textual syntax. The semantics of the meta-model elements are captured in the individual clauses describing the meta-model elements defined in the present document.

10 10 ES V1.1.1 ( ) Concrete Syntax user-defined & standardized in future Abstract Syntax MOF based ES Figure 4.1: TDL language concepts The abstract syntax (TDL meta-model) and semantics defined in the present document serve as the basis for the development of TDL tools such as editors for TDL specifications in graphical, textual or other forms of concrete syntaxes, analyzers of TDL specifications that check the consistency of TDL specifications, test documentation generators that retransform a TDL specification into another concrete syntax that is more appealing to some stakeholders, and (test) code generators to derive executable tests. 4.3 Design Considerations TDL makes a clear distinction between concrete syntax that is adjustable to different application domains and a common abstract syntax, which a concrete syntax is mapped to (an example concrete syntax can be found in annex B). The definition of the abstract syntax for a TDL specification plays the key role in offering interchangeability and unambiguous semantics of test descriptions. It is defined in this TDL standard in terms of a MOF meta-model. A TDL specification consists of the following major parts that are also reflected in the meta-model: A test configuration consisting of at least one tester and at least one SUT component and connections among them reflecting the test environment. A set of test descriptions, each of them describing one test scenario based on interactions between the components of a given test configuration and actions of components or actors. The control flow of a test description is expressed in terms of sequential, alternative, parallel, iterative, etc. behaviour. A set of data instances grouped into data sets that are used in interactions and as parameters of test description invocations. Behavioural elements used in test descriptions that operate on time. Using these major ingredients, a TDL specification is abstract in the following sense: Interactions between tester and SUT components of a test configuration are considered to be atomic and not detailed further. For example, an interaction can represent a message exchange, a remote function/procedure call, or a shared variable access. All behavioural elements within a test description are totally ordered, unless it is specified otherwise. That is, there is an implicit synchronization mechanism assumed to exist between the components of a test configuration. The behaviour of a test description represents the expected, foreseen behaviour of a test scenario assuming an implicit test verdict mechanism, if it is not specified otherwise. If the specified behaviour of a test description is executed, the 'pass' test verdict is assumed. Any deviation from this expected behaviour is considered to be a failure of the SUT, therefore the 'fail' verdict is assumed. There is a possibility for explicit verdict assignment if in a certain case there is a need to override this implicit verdict setting mechanism (e.g. to assign 'inconclusive' or any user-defined verdict values). However, there is no assumption about verdict arbitration, which is implementation-specific. The data exchanged via interactions and used in parameters of test descriptions are represented as name tuples without further details of their underlying semantics, which is implementation-specific.

11 11 ES V1.1.1 ( ) A TDL specification represents a closed system of tester and SUT components. That is, each interaction of a test description refers to one source component and at least one target component that are part of the underlying test configuration a test description runs on. The actions of the actors (entities of the environment of the given test configuration) can be indicated in an informal way. Time in TDL is considered to be global and progresses in discrete quantities of arbitrary granularity. Progress in time is expressed as a monotonically increasing function. Time starts with the execution of an unreferenced ('base') test description. TDL can be extended with tool, application, or framework specific information by use of annotations. 4.4 Document Structure The present document defines the TDL abstract syntax expressed as a MOF meta-model. The TDL meta-model offers language features to express: Fundamental concepts such as structuring of TDL specifications and tracing of test objectives to test descriptions (clause 5). Abstract representations of data used in test descriptions (clause 6). Test configurations, on which test descriptions are executed (clause 7). A number of behavioural operations to specify the control flow of test descriptions (clause 8). Concepts of time, time constraints over behavioural elements of a test description, and timers; as well as their related operations (clause 9). Predefined values for verdicts and time units that can be extended by a user (clause 10). 4.5 Notational Conventions In the present document, the following notational conventions are applied: 'element' The name of an element or of the property of an element from the meta-model, e.g. the name of a meta-class. «metaclass» Indicates an element of the meta-model, which corresponds to a node of the abstract syntax, i.e. an intermediate node if the element name is put in italic or a terminal node if given in plain text. «Enumeration» Denotes an enumeration type. /name The value with this name of a property or relation is derived from other sources within the metamodel. [1] Multiplicity of 1, i.e. there exists exactly one element of the property or relation. [0..1] Multiplicity of 0 or 1, i.e. there exists an optional element of the property or relation. [*] or [0..*] Multiplicity of 0 to many, i.e. there exists a possibly empty set of elements of the property or relation. [1..*] Multiplicity of one to many, i.e. there exists a non-empty set of elements of the property or relation. {unique All elements contained in a set of elements shall be unique. {ordered All elements contained in a set of elements shall be ordered, i.e. the elements form a list. Furthermore, the definitions and notations from the MOF 2 core framework [1] and the UML class diagram definition [2] apply. 4.6 Conformance For an implementation claiming to conform to this version of the TDL meta-model, all features specified in the present document shall be implemented consistently with the requirements given in the present document. The electronic attachement in annex A can serve as a starting point for a TDL meta-model implementation conforming to the present document.

12 12 ES V1.1.1 ( ) 5 Foundation 5.1 Overview The 'Foundation' package specifies the fundamental concepts of the TDL meta-model. All other features of the TDL meta-model rely on the concepts defined in this 'Foundation' package. 5.2 Abstract Syntax Figure 5.1: Foundational Language Concepts

13 13 ES V1.1.1 ( ) Figure 5.2: Comments and Annotations Figure 5.3: Test Objective Concepts 5.3 Classifier Description Element An 'Element' is a constituent of a TDL Specification. It is the super-class of all other classes in the meta-model. It provides the ability to add comments and annotation to each 'Element'.

14 14 ES V1.1.1 ( ) There are no generalizations specified. name : String [0..1] The optional name of the 'Element'. The 'name' can contain any character, including white-spaces. Having no name specified is different from the empty name (which is represented by an empty string). comment : Comment [0..*] {unique A possibly empty set of 'Comment's attached to the 'Element'. annotation : AnnotationType [0..*] {unique A possibly empty set of 'Annotation's attached to the 'Element' PackageableElement A 'PackageableElement' is contained in a 'Package'. It has a mandatory 'qualifiedname' that shall be unique throughout the owning and any imported 'Package'. The 'qualifiedname' distinguishes equally named 'PackageableElement's of different 'Package's from each other. This makes it possible that a 'PackageableElement' with the same name can be imported into a 'Package' without causing a name clash. The 'qualifiedname' is a compound name derived from the directly and all indirectly enclosing parent 'Package's by concatenating the names of each 'Package'. As a separator between the segments of a 'qualifiedname' the string '::' shall be used. The name of the root 'Package' that (transitively) owns the 'PackageableElement' shall always constitute the first segment of the 'qualifiedname'. The visibility of a 'PackageableElement' is restricted to the 'Package' in which it is directly contained. A 'PackageableElement' may be imported into other 'Package's by using 'ElementImport'. A 'PackageableElement' has no means to actively increase its visibility. Element /qualifiedname : String [1] {read-only A derived property that represents the unique name of a package within a TDL model. owningpackage : Package [0..1] The 'Package' that owns the 'PackageableElement'. Distinguishable qualified names All qualified names shall be distinguishable within a TDL model.

15 15 ES V1.1.1 ( ) Package A 'Package' represents a container for 'PackageableElement's. A TDL model may contain any number of 'Package's, which may have any arbitrary substructure. A 'Package' may contain any number of 'PackageableElement's. A 'Package' builds a scope of visibility for its contained 'PackageableElement's. A 'PackageableElement' is only accessible within its owning 'Package' and within any 'Package' that directly import it. A 'Package' may import any 'PackageableElement' from any other 'Package' with the means of 'ElementImport'. By importing a 'PackageableElement', the imported 'PackageableElement' becomes visible and accessible within the importing 'Package'. Cyclic imports of packages are not permitted. PackageableElement packagedelements : PackageableElements [0..*] {unique The 'PackageableElement's that are directly contained in the 'Package'. import : ElementImport [0..*] {unique The list of import declarations. No cyclic imports Cyclic imports are not allowed. That is, a package shall not import itself directly or indirectly via other packages ElementImport An 'ElementImport' allows importing 'PackageableElement's from other 'Package's into the scope of an importing 'Package'. By establishing an import, the imported 'PackageableElement's become accessible within the importing 'Package'. Only those 'PackageableElement's can be imported via 'ElementImport' that are directly contained in the exporting 'Package', that is, the import is not transitive. If an 'ElementImport' declares the import of a 'Package', all the directly contained 'PackageableElement's in that imported 'Package' become accessible within the importing 'Package'. Element importedelement : PackageableElement [1..*] {unique The 'PackageableElement's that are imported into the context package via this 'ElementImport'. Consistency of imported elements The imported 'PackageableElement' shall be directly owned by the exporting 'Package'.

16 16 ES V1.1.1 ( ) Comment 'Comment's may be attached to elements for documentation or for other informative purposes. Any 'Element' except for a 'Comment' may contain any number of 'Comment's. The contents of comments shall not be used for adding semantics to elements. Element commentedelement : Element [1] The 'Element' to which the 'Comment' is attached. body : String [1] The content of the 'Comment' Annotation An 'Annotation' is a means to attach user- or tool-defined semantics to any 'Element' of a TDL model, except 'Comment' and 'Annotation' itself. An 'Annotation' provides a pair of a 'key'/'value' attributes, whereas the 'value' might be empty. Element annotatedelement : Element [1] The 'Element' to which the 'Annotation' is attached. key : AnnotationType [1] Reference to a user-defined 'AnnotationType'. value : String [0..1] The 'value' mapped to the 'key' AnnotationType An 'AnnotationType' is a 'PackageableElement' used to define the 'key' attributes of an 'Annotation'. PackageableElement

17 17 ES V1.1.1 ( ) There are no properties specified TestObjective A 'TestObjective' specifies the reason for designing either a 'TestDescription' or a particular 'Behaviour' of a 'TestDescription'. A 'TestObjective' may either contain a 'description' of the objective directly or refer to an external resource for further information about the objective. The 'description' of a 'TestObjective' should be in natural language, however, it may be provided as structured (i.e. machine-readable) text. PackageableElement description : String [0..1] A textual description of the 'TestObjective'. objectiveuri : String [0..*] A set of URIs locating resources that provide further information about the 'TestObjective'. These resources are usually external to a TDL model such as requirements specifications or TPLan artefacts TestObjectiveRealizer A 'TestObjectiveRealizer' establishes traces to 'TestObjectives'. The semantics of such a trace are that a 'TestObjectiveRealizer' realizes the objective stated or referred to by the 'TestObjective'. Element testobjective : TestObjective [0..*] {unique The set of 'TestObjective's that is realized by the 'TestObjectiveRealizer'.

18 18 ES V1.1.1 ( ) 6 Data 6.1 Overview The 'Data' package defines the various meta-model elements to represent data within a TDL specification. TDL does not feature a complete data type system. Instead, it relies on parameterizable data instances that are grouped into data sets. Data sets, data proxies, and data instances, denoted data elements in TDL, are abstract representations of corresponding data-related concepts in a concrete type system. Data elements in TDL can be mapped to the corresponding elements in a concrete type system by means of data element mappings, which represent the location of the concrete data definition within a resource, e.g. the concrete element name. The resource in which the mapped concrete type system element is located is represented by a data resource mapping which defines a resource where the concrete data definition is located, e.g. a file name. In addition to static data defined in files or other resources, data elements can also be mapped to dynamic data which is only available at runtime, e.g. a data instance can represent a session ID. The execution environment shall provide an interface to such dynamic data by means of a runtime element URI. There are no specific restrictions on the mapping imposed by TDL. In particular, a TDL data set could also map to several concrete data types. Since data sets are packageable elements, they can be reused in other TDL specifications. Data element specifications shall be complete up to the level that all data sets and data instances used in a test description, as well as in data instance definitions are defined and accessible. EXAMPLE 1: Consider the data set STATUS of data instances 200, 4xx, 5xx, and RetVal. A realization of these data definitions in a concrete data type system could be defined such that STATUS maps to the Java type int, while data instance 200 maps to the Java int value 200 and 4xx and 5xx map to a range of int values and , respectively. The data instance RetVal could be mapped to a Java int variable of the same name. Data instances may be related to other data instances by means of parameters. Data instance parameters can be either other data instances or data sets. In the latter case, a data set parameter serves as a wildcard referring to any of the data instances that are grouped into that data set. EXAMPLE 2: Consider the following data set STATUS of data instances 200, 4xx, 5xx and data set HTTP-MSG of data instances HttpRequest and HttpResponse(STATUS). The latter is a shorthand notation for the data instances HttpResponse(200), HttpResponse(4xx), and HttpResponse(5xx). TDL does not support variables. Data instances that are mapped to a runtime URI cover the basic scenarios where a concrete data instance that is only available at runtime needs to be shared among several interactions. In order to express formal parameters of a test description, TDL provides the data proxy construct. A data proxy, which is associated to a data set to determine the set of allowed data elements that it can be bound to, acts as a placeholder in the test description and can be used as the argument of interactions, as a parameter for the arguments of interactions, or as an actual parameter in a test description reference. In the operational semantics, this data proxy is bound to the data element (data instance, data set, or a data proxy) specified as the actual parameter of a reference to this test description.

19 19 ES V1.1.1 ( ) 6.2 Abstract Syntax Figure 6.1: Basic Data Concepts

20 20 ES V1.1.1 ( ) Figure 6.2: Data Mapping Concepts 6.3 Classifier Description DataElement A 'DataElement' is an abstraction of 'MappableDataElement' and 'DataProxy' used to express data in TDL specifications. Element There are no properties specified MappableDataElement A 'MappableDataElement' is an abstraction of 'DataSet' and 'DataInstance' used to express data elements that can be referenced as parameters of data instance definitions in TDL specifications. DataElement

21 21 ES V1.1.1 ( ) There are no properties specified DataSet A 'DataSet' is a 'MappableDataElement' and by extension a 'DataElement, and a 'PackageableElement', that contains a set of 'DataInstance' elements. It may correspond to and be mapped to a concrete data type specification outside of TDL. Mapping is done by means of a 'DataMappingElement'. PackageableElement MappableDataElement datainstance : DataInstance [0..*] {unique The set of contained data instances DataInstance A 'DataInstance' is a 'MappableDataElement' contained in a 'DataSet' element. It is linked to a data set and may reference other data elements as parameters. This provides basic data composition and structuring facilities in TDL. The exact data composition mechanism is implementation specific. A TDL data instance with parameters only implies that the provided parameters are related in some way or are a part of the concrete type system data element. Data instances defined with parameters shall always be referenced with the same number of parameters when used as the arguments of interactions and as actual parameters in test description references. A data instance may be mapped to a concrete data value by means of a 'DataElementMapping'. MappableDataElement parameter : MappableDataElement [0..*] {ordered References to further mappable data elements which are attached to the given data instance. No self-reference The same 'DataInstance' element shall not occur as a reference in its data instance parameter set, i.e. no recursive structure shall be defined.

22 22 ES V1.1.1 ( ) DataProxy A 'DataProxy' is a 'DataElement' that serves as a placeholder for instances of 'DataInstance', 'DataSet', or 'DataProxy' in the definition of formal parameters of 'TestDescription' elements (see clause 8.2.1). 'DataProxy' elements defined as formal parameters of a 'TestDescription' element are bound to the 'DataInstance', 'DataSet', or 'DataProxy' elements specified as actual parameters of a 'TestDescriptionReference' element referencing the 'TestDescription' element. DataElement dataset : DataSet [1] References the data set of acceptable data instances, to which the 'DataProxy' element can be bound in actual test description parameters. The data set itself as well as 'DataProxy' elements having the same data set can also be bound to the 'DataProxy' element in actual test description parameters. Constraint DataResourceMapping A 'DataResourceMapping' is a 'PackageableElement'. It defines the resource where the concrete data definitions from an underlying concrete data type system are located as identified by the 'resourceuri' property. PackageableElement resourceuri : String [0..1] Location of the resource that contains concrete data definitions. The location shall resolve to an unambiguous name DataElementMapping A 'DataElementMapping' is a 'PackageableElement'. It represents the location of a single concrete data definition within the resource referred to in the referenced 'DataResourceMapping' element. The location within the resource is described by means of the 'elementuri' property.

23 23 ES V1.1.1 ( ) PackageableElement mappabledataelement : MappableDataElement [1] {unique Refers to the mappable data element (data set or data instance) to be mapped to a concrete data definition. elementuri : String [0..1] Location of a concrete data element within the resource it refers to in the 'DataResourceMapping' element. The location shall resolve to an unambiguous name within the resource. dataresourcemapping : DataResourceMapping [1] References the data resource that contains the actual data definition of the referred mappable data element. 7 Test Architecture 7.1 Overview The 'Test Architecture' package describes the elements needed to define a 'TestConfiguration' consisting of tester and SUT components, gates, and their interconnections represented as 'Connection's. A 'TestConfiguration' specifies the structural foundations on which test descriptions can be built upon. The fundamental units of a 'TestConfiguration' are the 'ComponentInstance's. Each 'ComponentInstance' specifies a functional entity of the test system. A 'ComponentInstance' may either be a ( part of a) tester or a ( part of an) SUT. That is, both the tester and the SUT can be decomposed, if required. The communication exchange between 'ComponentInstance's is established through interconnected 'GateInstance's. To offer reusability, TDL introduces 'ComponentType's and gate types.

24 24 ES V1.1.1 ( ) 7.2 Abstract Syntax Figure 7.1: Test Architecture Concepts 7.3 Classifier Description TestConfiguration A 'TestConfiguration' specifies the communication infrastructure necessary to build 'TestDescription's upon. As such, it contains all the elements required for information exchange, such as 'ComponentInstance's and 'Connection's. It is not necessary that all 'ComponentInstance's contained in a 'TestConfiguration' are actually connected via 'Connection's but for any 'TestConfiguartion' at least the semantics of a minimal 'TestConfiguration' shall apply. PackageableElement componentinstance : ComponentInstance [2..*] {unique The 'ComponentInstance's of the 'TestConfiguration'. connection : Connection [1.*] {unique The 'Connection's of the 'TestConfiguration' over which 'Interaction's are sent and received.

25 25 ES V1.1.1 ( ) 'TestConfiguration' and components roles A 'TestConfiguration' shall contain at least one 'Tester' and one 'SUT' 'ComponentInstance'. Minimal 'TestConfiguration' Each 'TestConfiguration' shall specify at least one 'Connection' that connects a 'GateInstance' of a 'Tester' 'ComponentInstance' with a 'GateInstance' of an 'SUT' 'ComponentInstance' GateType A 'GateType' represents a point of communication for exchanging information between 'ComponentInstance's. A 'GateType' specifies the 'DataSets' (and, thus, the DataProxies and DataInstances that belong to that 'DataSet') that can be exchanged via that 'GateType'. The same 'GateType' can be shared among multiple 'ComponentType's, thus, allowing for reuse. PackageableElement dataset : DataSet [1..*] {unique The 'DataSet's that can be exchanged via that 'GateType'. The arguments of 'Interactions' shall adhere to the 'DataSet' that are allowed to be exchanged via the 'GateType' GateInstance A 'GateInstance' represents an instance of a 'GateType'. 'GateInstance's are the means to exchange information by specifying an 'Interaction' and to execute 'TimeOperation's. A 'GateInstance' may, but need not, be connected by 'Connection'. Additionally, a 'GateInstance' may be the endpoint of more than one 'Connection'. Element type : GateType [1] The 'GateType' of the 'GateInstance'. componentinstance : ComponentInstance [1] The 'ComponentInstance' that owns this 'GateInstance'. No additional constraints specified.

26 26 ES V1.1.1 ( ) ComponentType A 'ComponentType' specifies the type of one or multiple 'ComponentInstance's that participate in a 'TestConfiguration'. A 'ComponentType' refers to at least one 'GateType' and may contain any number of 'Timer's. Instances of 'ComponentType's represent the functional entities of a test system. An instance of a 'ComponentType' has local copies of the 'Timer's that are listed in the 'ComponentType' definition. Instances of 'ComponentType's may either act as a 'Tester' or as an 'SUT' within a 'TestConfiguration'. It is possible that the very same 'ComponentType' participates in one 'TestConfiguration' as a 'Tester' and in another 'TestConfiguration' as an 'SUT'. PackageableElement gatetype : GateType [1..*] {ordered The 'GateType's used for the purpose of attaching 'GateInstance's to a 'ComponentInstance' of that 'ComponentType'. timer : Timer [0..*] {unique The 'Timer's owned by a 'ComponentType' ComponentInstanceRole 'ComponentInstanceRole' specifies the role of a 'ComponentInstance', whether it acts as a 'Tester' or as an 'SUT' component. There are no generalizations specified. Literals SUT The 'ComponentInstance' assumes the role 'SUT' in the enclosing 'TestConfiguration'. Tester The 'ComponentInstance' assumes the role 'Tester' in the enclosing 'TestConfiguration'.

27 27 ES V1.1.1 ( ) ComponentInstance A 'ComponentInstance' represents a communication entity of the test system. It acts either as a 'Tester' or as an 'SUT' 'ComponentInstance'. A 'ComponentInstance' contains one or more 'GateInstance's that are the endpoints of 'Connection's. The number and the types of 'GateInstance's contained in a 'ComponentInstance' shall be the same as the number and the types of 'GateType's referred to by the 'ComponentType' this 'ComponentInstance' is an instance of. The 'Timer's that can be utilized by timer-related 'Behaviour's of a 'TestDescription' are derived from the 'Timer's that the corresponding 'ComponentType's possesses. Thus, only 'Timer's that are known by the 'ComponentInstance's can be used within a 'TestDescription'. Element type : ComponentType [1] The 'ComponentType' of this 'ComponentInstance'. role : ComponentInstanceRole [1] The role of the 'ComponentInstance' plays within the given 'TestConfiguration'. It can be either 'Tester' or 'SUT'. gateinstance : GateInstance [1..*] {unique, ordered The 'GateInstance's this 'ComponentInstance' contains. /timer : Timer [0..*] {unique, read-only The set of timers is derived from the set of timers contained in the 'ComponentType' of the 'ComponentInstance'. That is, a 'ComponentInstance' shall have the same set of timers as specified in the 'ComponentType', which the 'ComponentInstance' belongs to. Named component instances A component instance shall have a name. Number of 'GateInstance's in a 'ComponentInstance' A 'ComponentInstance' shall contain as many 'GateInstance's of corresponding types as the number of gate types declared in the associated 'ComponentType'. Timers of 'ComponentInstance's A 'ComponentInstance' shall refer exactly to the same set of timers as contained in the associated 'ComponentType' Connection A 'Connection' is a communication channel for exchanging information by specifying an 'Interaction' between 'GateInstance's and, thus, 'ComponentInstance's. 'Connection's do not specify or restrict the nature of the communication channel that is eventually used in an implementation. 'Connection's are always binary. A 'Connection' can be established between 'GateInstance's contained in any kind of 'ComponentInstance's as long as there is at most one 'Connection' between any two 'GateInstance's. The 'GateInstance's connected by a 'Connection' shall not be identical, i.e. self-looped 'Connection's are not permitted. Multiple 'Connection's can refer to the very same 'GateInstance'. This allows for specifying multicast communication exchange capability.

28 28 ES V1.1.1 ( ) Element endpoint : GateInstance [2] {unique The two 'GateInstance's that are the endpoints of this 'Connection'. Self-looped connections not allowed The two 'GateInstance's (endpoints) of any 'Connection' shall be different from each other, i.e. no self-loop 'Connection' is allowed. Only one connection allowed Between any two 'GateInstance's at most one 'Connection' can exist. 8 Test Behaviour 8.1 Overview The 'Test Behaviour' package defines all elements needed to describe the behaviour of a test description. 8.2 Abstract Syntax Figure 8.1: Test Description Concepts

29 29 ES V1.1.1 ( ) Figure 8.2: Behaviour Concepts Figure 8.3: Atomic Behaviour Concepts

30 30 ES V1.1.1 ( ) Figure 8.4: Interaction Concepts Figure 8.5: Argument Specification Concepts

31 31 ES V1.1.1 ( ) Figure 8.6: Exceptional Behaviour and Periodic Behaviour Concepts 8.3 Classifier Description TestDescription The 'TestDescription' is a 'PackageableElement' and a 'TestObjectiveRealizer'. A 'TestDescription' defines the test behaviour based eventually on ordered 'AtomicBehaviour' elements. A test description may contain a 'CompoundBehaviour' defining the behaviour of the test description. It may also contain a list of 'DataProxy' elements that act as formal parameters of this test description. A test description is associated with exactly one 'TestConfiguration' and may be associated with any number of 'DataProxy' elements. These 'DataProxy' elements represents the formal parameters of the 'TestDescription' used for parameterization. If a test description has formal parameters, it shall be invoked within another test description that is possibly parameterfree in order to be able to provide actual parameters. PackageableElement TestObjectiveRealizer testconfiguration : TestConfiguration [1] The property 'testconfiguration' refers to the 'TestConfiguration' that is associated with the 'TestDescription'. behaviour : CompoundBehaviour [0..1] The property 'behaviour', if present, defines the actual behaviour of the test description in terms of a 'CompoundBehaviour' element.

32 32 ES V1.1.1 ( ) timeconstraint : TimeConstraint [0..*] {unique This property, if present, refers to the expressions that shall be evaluated to Boolean. It is used to express time constraints between behavioural elements within this test description. formalparameter : DataProxy [0..*] {ordered This property refers to 'DataProxy' elements. The property, if present, defines the formal parameters that shall be substituted by actual data elements when the 'TestDescription' is executed. Named test description A test description shall have a name Block A 'Block' element is a container for 'Behaviour' elements that are executed in a strictly sequential way. A 'Block' element may have a 'guard' defined. If a 'Block' has a 'guard', it shall only be executed if its guard condition evaluates to true. Element behaviour : Behaviour [1..*] {unique, ordered This property is a list of 'Behaviour' elements describing the behaviour of the 'Block' element. The 'Behaviour' elements shall be executed in their definition order. guard : String [0..1] The 'guard' property is a String that represents a Boolean expression. The 'guard' when present determines if the behaviour of the 'Block' element shall be executed or not. If the 'guard' expression evaluates to true, the behaviour is executed, otherwise not. If a 'Block' element has no 'guard' it is unconditionally executed. Guard shall evaluate to Boolean The 'guard' property is a String that shall represent a Boolean expression Behaviour A 'Behaviour' is a generic, abstract 'Element' that is refined into 'AtomicBehaviour' and 'CombinedBehaviour'. Some 'Behaviour's operate on gate instances or component instances and some are completely independent. TestObjectiveRealizer There are no properties specified. No additional constraints specified.

33 33 ES V1.1.1 ( ) CombinedBehaviour A 'CombinedBehaviour' element is a 'Behaviour' that involves all gate instances defined in the associated test configuration. It can contain a single 'Block' element (in case of 'SingleCombinedBehaviour') or a list of ordered and potentially guarded 'Block' elements (in case of 'MultipleCombinedBehaviour'). A 'CombinedBehaviour' may have any number of ordered 'PeriodicBehaviour' and 'ExceptionalBehaviour' elements. The 'PeriodicBehaviour' and the 'ExceptionalBehaviour' elements shall be evaluated in their definition order. Behaviour periodic : PeriodicBehaviour [0..*] {unique, ordered A 'CombinedBehaviour' element can contain any number of 'PeriodicBehaviour' elements. The 'periodic' property refers to the list of 'PeriodicBehaviour' elements. exceptional : ExceptionalBehaviour [0..*] {unique, ordered A 'CombinedBehaviour' element can contain any number of 'ExceptionalBehaviour' elements. The 'exceptional' property refers to the list of 'ExceptionalBehaviour' elements SingleCombinedBehaviour A 'SingleCombinedBehaviour' element is a 'CombinedBehaviour' that contains a single potentially guarded 'Block' element. It can be further refined to a 'CompoundBehaviour', a 'BoundedLoopBehaviour', an 'UnboundedLoopBehaviour', or an 'OptionalBehaviour'. CombinedBehaviour block : Block [1] The 'block' property refers to a 'Block' element that specifies the behaviour of the 'SingleCombinedBehaviour' CompoundBehaviour A 'CompoundBehaviour' element groups any positive number of 'Behaviour' elements together in an ordered list of 'Behaviour' elements contained in a single 'Block' element. The list defines the execution order of the 'Behaviour' elements of the 'CompoundBehaviour'. As a derived 'CombinedBehaviour' element, a 'CompoundBehaviour' element can have also exceptional or periodic behaviour attached to it.

34 34 ES V1.1.1 ( ) SingleCombinedBehaviour There are no properties specified OptionalBehaviour An 'OptionalBehaviour' element is a 'SingleCombinedBehaviour', therefore it shall contain one 'Block' element, which may have a guard condition and shall start with one of the following 'AtomicBehaviour' elements: 'Interaction', 'TimeOut', or 'Quiescence'. For the 'Interaction' element it is required that the target 'GateInstance' shall be associated to a 'ComponentInstance' with the 'role' of 'Tester'. If a 'Block' has no guard condition, it is equivalent to a 'Block' with a guard condition of true. If the guard condition of the 'Block' element is evaluated to true and the first event of the 'Block' occurs, the 'OptionalBehaviour' will be executed, otherwise the execution continues with the next behaviour after the 'OptionalBehaviour' element. SingleCombinedBehaviour There are no properties specified. First event allowed The contained 'Block' element shall start with one of the following 'AtomicBehaviour' elements: 'Interaction' received by a 'Tester' component, 'TimeOut', or 'Quiescence' BoundedLoopBehaviour A 'BoundedLoopBehaviour' element is a 'SingleCombinedBehaviour', therefore it shall contain one 'Block' element, which shall not have a guard condition. The 'Block' element shall be executed as many times as is determined by the 'numiteration' attribute. SingleCombinedBehaviour numiteration : Integer [1] This property of a 'BoundedLoopBehaviour' element determines how many times the 'Block' element of a 'BoundedLoopBehaviour' element shall be executed.