ENABLE-S3 and scenario-based safety validation · Presentation of project results About 35...

Restricted, all rights with ENABLE-S3 project team November 2018 1

This project has received funding from the ECSEL Joint Undertaking under grant agreement No 692455. This Joint Undertaking receives support from the European Union’s Horizon 2020 research and innovation programme and Austria, Denmark, Germany, Finland, Czech Republic, Italy, Spain, Portugal, Poland, Ireland, Belgium, France, Netherlands, United Kingdom, Slovakia, Norway.

ENABLE-S3 ECSEL EU PROJECT

ENABLE-S3 and scenario-based safety validation

Andrea Leitner, Michael Paulweber, Jürgen Holzinger, Tobias Düser, AVL, May 12th, 2019

http://www.enable-s3.eu/





ENABLE-S3: International Project Consortium

68 Partners

70 M€ budget

16 Countries

6 Domains

12 Use Cases

Industry as well as academia


How to Avoid This? …. and Achieve That?

http://www.bostonherald.com http://thinkinghighways.com https://s.aolcdn.com

http://cardesignresearch.com http://cardesignresearch.com http://www.auto.de

How to verify that automated vehicles behave safe and correct in EVERY situation?


Modular validation framework in ENABLE-S3

Validation scenarios

Full scenario coverage with all

variations 10^12 tests

Virtual world models

Reusable validation procedures

Intelligent accelerated validation 10^3 tests

Scenario variations

System variants

Environment

Routes

Personality types

Scenario parameters

Runtime validation

Input from other related projects

Real world data analysis

Results of safety &

security analysis

Scenario extraction

Hardware in the loop

System variants in the loop

Validation Methodology

Validation Platform

Proving ground Model/Software in

the loop

… other parameters


ADAS/AD Validation Scopes

ADAS / AD Function Validation

Sensor Validation & Model Calibration

ADAS / AD vehicle Validation

Sensor fusion validation

Homologation

Test Verdicts

Operational performance

validation


ENABLE-S3 and PEGASUS


ENABLE-S3 Generic Reference Validation Architecture

Test Management

Test Execution Platform

Test framework

Instantiation/initialization Results

Test Data Management


Test planning & test case generation Te

st M

anag

emen

t


Scenario DB Scenario DB

Scenario DB Scenario DB

Test Execution Platform

Test planning KPI calculation Office/cloud

Qu

ery scen

arios

Visualization Office/cloud

Scenario execution


Relying on standard interfaces

Test Management

Test

Exe

cuti

on

Pla

tfo

rm



Virtual Test Environment Supported by Standard Interfaces

Camera

Model

Radar

Model

GNSS

Model

Lidar

Model

Virtual Environment

Static Scenario Content

(Lanes, traffic signs, barriers, …)

System-under-

Test ADAS/AD functions

Augmented and

validated sensor models

Sensor output with

performance indicators

Actuators

Co-Simulation Framework

Dynamic Scenario Content

(other vehicles, pedestrians, dynamic traffic signs,, …)

Scenario parameters (e.g.

weather conditions)

Source: RobustSense

research project funded by

European Commission and

National funding authortities

FMI

OpenDrive

OpenCRG

OpenFlight

OpenScenario

OSI

Test vehicle

Modelica


Cloud Simulation to Identify Critical Scenarios

Scalable simulation environment Identify critical regions

Define test sequence with

parameter variations

(experiment)

Define Digital Twin

Vehicle modelling (e.g.AVL VSM™)

Automatic model calibration

Sensor models

Test Scenario DB

Synthetic test scenario

Measurement Based

Test Scenario

Test Sequence Generator

Rig

Virtual World Real World

Validation of system performance in critical scenarios using

more detailed models or real components

Road


Dangerous Vehicle Scenarios Tested in Save Environment With Real Sensors (or Sensor Models)

Vehicle XCUs

Vehicle Actuators

Real Sensors

)))

Visualization System

Powertrain System

Interface

Simulation Platform

Sensor Models

Sensor Stimulation

Chassis Dyno

Powertrain Test Bed

Chassis Dyno Test Bed


Summary

ENABLE-S3 Focus: ADAS/AD Validation tool chain

Virtual validation is key to cope with complexity of ADAS/AD validation;

Real world testing also required due to differences of digital twin and real twin

Scenarios are base; Models critical

Sensor stimulation enables near real-world tests in safe environment

Close cooperation with PEGASUS

Main Results:

Reference validation architecture proven in 35 different demonstrators in many different scenarios and different domains

Interface Standards handed over to standardization organizations (to ensure

sustainability)


Invitation to Final Public Event

May 16/17th, 2019 Hans List Hall – Graz – Austria Expert Keynotes on ADAS/AD validation

Presentation of project results

About 35 demonstrators of tool chain in various applications

THANK YOU

The research leading to these results has received funding from the H2020-ECSEL-2015-2-IA-two-stage for ENABLE-S3 – European Initiative to Enable Validation for Highly Automated Safe and Secure Systems Joint Undertaking under grant agreement

n° 692455 and from specific national programs and / or funding authorities.

ENABLE-S3 and scenario-based safety validation · Presentation of project results About 35...

Documents

Transcript of ENABLE-S3 and scenario-based safety validation · Presentation of project results About 35...