TDL – Test Description Language
Transcript of TDL – Test Description Language
![Page 1: TDL – Test Description Language](https://reader030.fdocuments.us/reader030/viewer/2022012522/619627cbc8830206b11be1c8/html5/thumbnails/1.jpg)
Slide subtitle
TDL –Test Description Language
Gusztáv Adamis
Ericsson Hungary Test Solutions and Competence Center
![Page 2: TDL – Test Description Language](https://reader030.fdocuments.us/reader030/viewer/2022012522/619627cbc8830206b11be1c8/html5/thumbnails/2.jpg)
Software Testing 2015 | 2015-04-22 | Page 2
Introduction
Overview of ETSI Test Languages
Design Considerations of TDL
Structure of TDL
• Language Constructs of TDL
• Graphical Representation of TDL
TDL: Present and Future
Contents
![Page 3: TDL – Test Description Language](https://reader030.fdocuments.us/reader030/viewer/2022012522/619627cbc8830206b11be1c8/html5/thumbnails/3.jpg)
Software Testing 2015 | 2015-04-22 | Page 3
Telecommunications systems become more and more complex
• Complex architecture (system of systems)
• Complex behaviour (concurrency, complex protocols)
• Complex data (complex data structure, „big data”)
... and these systems shall be tested
Testing
![Page 4: TDL – Test Description Language](https://reader030.fdocuments.us/reader030/viewer/2022012522/619627cbc8830206b11be1c8/html5/thumbnails/4.jpg)
Software Testing 2015 | 2015-04-22 | Page 4
Testing
![Page 5: TDL – Test Description Language](https://reader030.fdocuments.us/reader030/viewer/2022012522/619627cbc8830206b11be1c8/html5/thumbnails/5.jpg)
Software Testing 2015 | 2015-04-22 | Page 5
What to test?
• Test purposes
How to test?
• Test configuration
Which data to test with?
• Test data specification
What the test shall contain?
• Test behaviour description
Testing
![Page 6: TDL – Test Description Language](https://reader030.fdocuments.us/reader030/viewer/2022012522/619627cbc8830206b11be1c8/html5/thumbnails/6.jpg)
Software Testing 2015 | 2015-04-22 | Page 6
TPLan
• Describes Test Purposes
• „List of wishes”
Overview of ETSI Test Languages
![Page 7: TDL – Test Description Language](https://reader030.fdocuments.us/reader030/viewer/2022012522/619627cbc8830206b11be1c8/html5/thumbnails/7.jpg)
Software Testing 2015 | 2015-04-22 | Page 7
Overview of ETSI Test Languages
TTCN-3
• Testprogram
![Page 8: TDL – Test Description Language](https://reader030.fdocuments.us/reader030/viewer/2022012522/619627cbc8830206b11be1c8/html5/thumbnails/8.jpg)
Software Testing 2015 | 2015-04-22 | Page 8
Missing…
• Something between the two abstraction levels
• Which can be used also by non-programmers
• Graphical
Overview of ETSI Test Languages
TDL – Test Description Language
![Page 9: TDL – Test Description Language](https://reader030.fdocuments.us/reader030/viewer/2022012522/619627cbc8830206b11be1c8/html5/thumbnails/9.jpg)
Software Testing 2015 | 2015-04-22 | Page 9
Test design
Test documentation
Test representation
Shall be easy-to-learn, easy-to-use, intuitive
One language throughout the whole development cycle
Design Considerations of TDL
![Page 10: TDL – Test Description Language](https://reader030.fdocuments.us/reader030/viewer/2022012522/619627cbc8830206b11be1c8/html5/thumbnails/10.jpg)
Software Testing 2015 | 2015-04-22 | Page 10
Iterative Design
UE Network
Connection Establishment
Data Transfer
![Page 11: TDL – Test Description Language](https://reader030.fdocuments.us/reader030/viewer/2022012522/619627cbc8830206b11be1c8/html5/thumbnails/11.jpg)
Software Testing 2015 | 2015-04-22 | Page 11
Iterative Design
UE Network
Data Transfer
Request
Accept
![Page 12: TDL – Test Description Language](https://reader030.fdocuments.us/reader030/viewer/2022012522/619627cbc8830206b11be1c8/html5/thumbnails/12.jpg)
Software Testing 2015 | 2015-04-22 | Page 12
Iterative Design
UE Network
Data Transfer
Request (ID=1, Type=Voice)
Accept (ID=1)
![Page 13: TDL – Test Description Language](https://reader030.fdocuments.us/reader030/viewer/2022012522/619627cbc8830206b11be1c8/html5/thumbnails/13.jpg)
Software Testing 2015 | 2015-04-22 | Page 13
Iterative Design
UE Network
Data Transfer
Request (ID=1, Type=Voice)
Accept (ID=1)
Deny
![Page 14: TDL – Test Description Language](https://reader030.fdocuments.us/reader030/viewer/2022012522/619627cbc8830206b11be1c8/html5/thumbnails/14.jpg)
Software Testing 2015 | 2015-04-22 | Page 14
› Meta-model
› Graphical Syntax
› Transfer Syntax
› Structured Test Objective
Specification
TDL Standard
![Page 15: TDL – Test Description Language](https://reader030.fdocuments.us/reader030/viewer/2022012522/619627cbc8830206b11be1c8/html5/thumbnails/15.jpg)
Software Testing 2015 | 2015-04-22 | Page 15
Well-defined language constructs
• UML MOF-based description
Makes it possible to develop different domain-specific concrete syntaxes
Meta-model
![Page 16: TDL – Test Description Language](https://reader030.fdocuments.us/reader030/viewer/2022012522/619627cbc8830206b11be1c8/html5/thumbnails/16.jpg)
Software Testing 2015 | 2015-04-22 | Page 16
Test Data
Time, Timers
Test Configuration
Test Behaviour
Test Objectives
Structure of TDL
Test Configuration
Test Objective
Data TimeFoundation
Test Behaviour
Test Description Test Behaviour Elements
TDL meta-model
![Page 17: TDL – Test Description Language](https://reader030.fdocuments.us/reader030/viewer/2022012522/619627cbc8830206b11be1c8/html5/thumbnails/17.jpg)
Software Testing 2015 | 2015-04-22 | Page 17
Abstract data
Simple and Structured Data (declarative)
• Mandatory and optional fields
Can be mapped to ‘real’ data implementation
Test data
Test Configuration
Test Objective
Data TimeFoundation
Test Behaviour
Test Description Test Behaviour Elements
TDL meta-model
![Page 18: TDL – Test Description Language](https://reader030.fdocuments.us/reader030/viewer/2022012522/619627cbc8830206b11be1c8/html5/thumbnails/18.jpg)
Software Testing 2015 | 2015-04-22 | Page 18
Time
• Time Labels
• Time Constraints
• Wait
Timers
• Definition
• Operations
• start, stop, timeout
Time, Timers
Test Configuration
Test Objective
Data TimeFoundation
Test Behaviour
Test Description Test Behaviour Elements
TDL meta-model
![Page 19: TDL – Test Description Language](https://reader030.fdocuments.us/reader030/viewer/2022012522/619627cbc8830206b11be1c8/html5/thumbnails/19.jpg)
Software Testing 2015 | 2015-04-22 | Page 19
Components and Gates (Interfaces)
TESTER and SUT roles
Connections between Gates
Test Configuration
Test Configuration
Test Objective
Data TimeFoundation
Test Behaviour
Test Description Test Behaviour Elements
TDL meta-model
![Page 20: TDL – Test Description Language](https://reader030.fdocuments.us/reader030/viewer/2022012522/619627cbc8830206b11be1c8/html5/thumbnails/20.jpg)
Software Testing 2015 | 2015-04-22 | Page 20
Test Description
• ~ Testcase
Contains:
• Test Objective
• Test Configuration
• Test Behaviour
Test Behaviour
Test Configuration
Test Objective
Data TimeFoundation
Test Behaviour
Test Description Test Behaviour Elements
TDL meta-model
TDL describes the expected behaviour
• Any deviation – automatic fail verdict
• Can be overwritten by explicit verdict setting
• Pre-defined verdicts: pass, fail, inconclusive
• Extensible
![Page 21: TDL – Test Description Language](https://reader030.fdocuments.us/reader030/viewer/2022012522/619627cbc8830206b11be1c8/html5/thumbnails/21.jpg)
Software Testing 2015 | 2015-04-22 | Page 21
Atomic Behaviours
• Interaction
• generalized communication
• Action, Function Call, Assignment
• Call other Test Descriptions
• Explicit verdict setting
• Assertion
• Stop
Test Behaviour
Test Configuration
Test Objective
Data TimeFoundation
Test Behaviour
Test Description Test Behaviour Elements
TDL meta-model
![Page 22: TDL – Test Description Language](https://reader030.fdocuments.us/reader030/viewer/2022012522/619627cbc8830206b11be1c8/html5/thumbnails/22.jpg)
Software Testing 2015 | 2015-04-22 | Page 22
Combined Behaviours
• Sequential (Compound)
• Parallel
• Alternative
• Conditional (~if..then..else)
• Cycles
• For
• While
• Periodical
• Handling of non-expected behaviour
• Default
Test Behaviour
Test Configuration
Test Objective
Data TimeFoundation
Test Behaviour
Test Description Test Behaviour Elements
TDL meta-model
![Page 23: TDL – Test Description Language](https://reader030.fdocuments.us/reader030/viewer/2022012522/619627cbc8830206b11be1c8/html5/thumbnails/23.jpg)
Software Testing 2015 | 2015-04-22 | Page 23
Definition of Test Objectives
• Textual description
• Reference to test documents
At behaviour description the satisfied test objective can be indicated
Test Objectives
Test Configuration
Test Objective
Data TimeFoundation
Test Behaviour
Test Description Test Behaviour Elements
TDL meta-model
![Page 24: TDL – Test Description Language](https://reader030.fdocuments.us/reader030/viewer/2022012522/619627cbc8830206b11be1c8/html5/thumbnails/24.jpg)
Software Testing 2015 | 2015-04-22 | Page 24
Similar approach to UML SD
New symbols to new constructs
Graphical symbols
• Formal description of the contained text
Graphical Syntax
![Page 25: TDL – Test Description Language](https://reader030.fdocuments.us/reader030/viewer/2022012522/619627cbc8830206b11be1c8/html5/thumbnails/25.jpg)
Software Testing 2015 | 2015-04-22 | Page 25
Data Specification
![Page 26: TDL – Test Description Language](https://reader030.fdocuments.us/reader030/viewer/2022012522/619627cbc8830206b11be1c8/html5/thumbnails/26.jpg)
Software Testing 2015 | 2015-04-22 | Page 26
Test Configuration
![Page 27: TDL – Test Description Language](https://reader030.fdocuments.us/reader030/viewer/2022012522/619627cbc8830206b11be1c8/html5/thumbnails/27.jpg)
Software Testing 2015 | 2015-04-22 | Page 27
Test Behaviour
![Page 28: TDL – Test Description Language](https://reader030.fdocuments.us/reader030/viewer/2022012522/619627cbc8830206b11be1c8/html5/thumbnails/28.jpg)
Software Testing 2015 | 2015-04-22 | Page 28
![Page 29: TDL – Test Description Language](https://reader030.fdocuments.us/reader030/viewer/2022012522/619627cbc8830206b11be1c8/html5/thumbnails/29.jpg)
Software Testing 2015 | 2015-04-22 | Page 29
Goals:
• Interoperability between tools
• Interoperability between different concrete syntaxes
XMI (XML Metadata Interchange)
• To serialize the meta-model
• Syntactical check possible
• For semantic check constraints described in meta-model shall also be considered
Transfer Syntax
![Page 30: TDL – Test Description Language](https://reader030.fdocuments.us/reader030/viewer/2022012522/619627cbc8830206b11be1c8/html5/thumbnails/30.jpg)
Software Testing 2015 | 2015-04-22 | Page 30
Transfer Syntax
![Page 31: TDL – Test Description Language](https://reader030.fdocuments.us/reader030/viewer/2022012522/619627cbc8830206b11be1c8/html5/thumbnails/31.jpg)
Software Testing 2015 | 2015-04-22 | Page 31
Goals:
• Formalize the description of test purposes
• Unify the content
• Possibility of automatic validation
• Preserving the compatibility with TPLan
Structured Test Objective Specification
![Page 32: TDL – Test Description Language](https://reader030.fdocuments.us/reader030/viewer/2022012522/619627cbc8830206b11be1c8/html5/thumbnails/32.jpg)
Software Testing 2015 | 2015-04-22 | Page 32
Structured Test Objective Specification
TP Id
Test Objective
Reference
TP/GEONW/FDV/BAH/BV/01
Check defined values of default Gn parameters in the basic header
PICS Selection PICS_F1
Initial Conditions
Expected Behaviour
with {
the IUT entity being in the initial state
}
ensure that{
when {
the IUT entity is requested to send a "GUC packet"
}
then {
the IUT entity sends a "GUC packet" containing
BasicHeader containing
"version field" indicating value "itsGnProtocolVersion MIB parameter" ,
"RHL field" indicating value "itsGnDefaultHopLimit MIB parameter"
;
;
}
}
Final Conditions
![Page 33: TDL – Test Description Language](https://reader030.fdocuments.us/reader030/viewer/2022012522/619627cbc8830206b11be1c8/html5/thumbnails/33.jpg)
Software Testing 2015 | 2015-04-22 | Page 33
ETSI Standard
TDL v1 – 2013
TDL v2 – Multi-part Standard
TDL v3
• Reference editor
• UML profile
TDL v4
• TDL -> TTCN-3 Mapping
TDL: Present and Future
![Page 34: TDL – Test Description Language](https://reader030.fdocuments.us/reader030/viewer/2022012522/619627cbc8830206b11be1c8/html5/thumbnails/34.jpg)
Software Testing 2015 | 2015-04-22 | Page 34
One language throughout the whole development cycle
Easy-to-use, Easy-to-learn
Graphical
Supports different abstraction levels
• From very high level to close to implementation
At different standardisation/industry areas
• Telecommunication, Internet, Vehicle, Medical, etc.
• Simple and structured systems
Summary