Post on 01-Apr-2015
© Fraunhofer FIRST
Dr. Stephan Weißleder
Research Manager TestingDepartment Quality of Embedded Systems(QUEST)Fraunhofer-Institute FIRST
Relation of Model-Based Testing andSafety-Relevant Standards
© Fraunhofer FIRST
Page 2
Fraunhofer-Institute FIRST – Department QUEST
Review and Assessment
Testing Verification
IEC 61508DO-178B
ISO 26262IEC 62061EN 50128
certified
© Fraunhofer FIRST
Page 3
Model-Based Testing
© Fraunhofer FIRST
Page 4
– Early testing
– Low costs
– Support for certification
– Early testing
– Low costs
– Support for certification
– Better test management
– Early testing
– Low costs
– Support for certification
– Better test management
– High degree of automation
– Better test coverage
Model-Based Testing
Requirements
Model
Implementation
Unit test
System test
Acceptance test
Validation andtraceability ofrequirements
Generation of test design & test oracle
Early acceptance testby model simulation
Design
Test management,Variant management
© Fraunhofer FIRST
Page 5
How Does MBT Support Safety-Relevant Standards?
© Fraunhofer FIRST
Page 6
How Does MBT Support Safety-Relevant Standards?
Requirements
Tests
?
Higher Efficiency,Automatic Traceability
Validation of requirements,Better Traceability?
Measure/Achievecode coverage,
More detailed coverageinformation for system
tests?
Relation of model coverage and
requirements coverage?
TraceabilityCoverage
© Fraunhofer FIRST
Page 7
How do Safety-Relevant Standards Support MBT?
© Fraunhofer FIRST
Page 8
Standards
The good things about standards is there are so many to choose from.
VDE 0801
IEC 61508
ISO 15408
ISO 26262
RTCA DO-178B
ARINC 653
EN 50126EN
50128EN
50159
IEC 62061 EN ISO 13849
ISO TR 15497
General purpose
Automotive
Aviation
Railway
Machinery
© Fraunhofer FIRST
Page 9
ISO 26262 (under publication)
26262-4
26262-6
"Testing activities are also treated differently since models can be used as a useful source of information for the testing process (model-based testing)."
© Fraunhofer FIRST
Page 10
RTCA DO-178B – 1992
DAL E DAL D DAL C DAL B DAL A
No effect Minor Major Hazardous Catastrophic
(Source: John Joseph Chilenski)(Source: DO-178B Standard)
© Fraunhofer FIRST
Page 11
RTCA DO-178B – 1992
Objective DAL
A B C D
Test coverage of high-level requirements is achieved.
X X X X
Test coverage of low-level requirements is achieved.
X X X
Test coverage of software structure is achieved. (MC/DC)
X
Test coverage of software structure is achieved. (Decision Coverage)
X X
Test coverage of software structure is achieved. (Statement Coverage)
X X X
Test coverage of software structure is achieved. (Data coupling / control coupling)
X X X
No support for model-based testing. Things are getting better in DO-178C ?
© Fraunhofer FIRST
Page 12
IEC 61508 – 2010
!!!
© Fraunhofer FIRST
Page 13
IEC 61508 – 2010
© Fraunhofer FIRST
Page 14
IEC 61508 – 2010
Advantages:
- Early requirements validation- Automatic test case generation- Combination of test case generation and code coverage measurement
Model-based testing is (highly!) recommended.
© Fraunhofer FIRST
Page 15
Dr. Stephan Weißlederstephan.weissleder@first.fraunhofer.de
+49 (0)30 6392 1876
Our mission is to bring model-based testing to
industrial practice.