Cluster Simulation ·  · 2017-10-24Cluster Simulation ... ADAS and Autonomous Driving Imagine …...

27

Transcript of Cluster Simulation ·  · 2017-10-24Cluster Simulation ... ADAS and Autonomous Driving Imagine …...

Page 1: Cluster Simulation ·  · 2017-10-24Cluster Simulation ... ADAS and Autonomous Driving Imagine … … an autonomous car on a crowded crossroads 3 Test Drive Test Drive Test Drive
Page 2: Cluster Simulation ·  · 2017-10-24Cluster Simulation ... ADAS and Autonomous Driving Imagine … … an autonomous car on a crowded crossroads 3 Test Drive Test Drive Test Drive

Cluster Simulation with Integrated Workflow and Test Management

Chandu PulirojudSPACE Inc.

Page 3: Cluster Simulation ·  · 2017-10-24Cluster Simulation ... ADAS and Autonomous Driving Imagine … … an autonomous car on a crowded crossroads 3 Test Drive Test Drive Test Drive

ADAS and Autonomous Driving

Imagine …

… an autonomous car on a

crowded crossroads

3

Test DriveTest Drive

Test DriveTest Drive

Test DriveTest Drive

Test DriveTest Drive

Test DriveTest Drive

Test DriveTest Drive

Page 4: Cluster Simulation ·  · 2017-10-24Cluster Simulation ... ADAS and Autonomous Driving Imagine … … an autonomous car on a crowded crossroads 3 Test Drive Test Drive Test Drive

Daily Problems

Many tests

Few HILs

4

test case

test case

test case

test case

Page 5: Cluster Simulation ·  · 2017-10-24Cluster Simulation ... ADAS and Autonomous Driving Imagine … … an autonomous car on a crowded crossroads 3 Test Drive Test Drive Test Drive

Software-in-the-Loop

5

XIL-API

XCP

COM

Experimentation

Test Automation

XIL-API

XCP

COM

Experimentation

Test Automation

Faster than real

time

Faster than real

timeSame tooling

test case

test case

Page 6: Cluster Simulation ·  · 2017-10-24Cluster Simulation ... ADAS and Autonomous Driving Imagine … … an autonomous car on a crowded crossroads 3 Test Drive Test Drive Test Drive

Offline Platform

What is VEOS?

MS Windows-based

Simulation (and integration) platform

Simulates “Virtual ECUs”

Simulates other models

(e.g., Functional Mockup Units)

No real time (faster, slower, pause)

C code debugging possible

… and more

“yet another platform” (plus extras)

Page 7: Cluster Simulation ·  · 2017-10-24Cluster Simulation ... ADAS and Autonomous Driving Imagine … … an autonomous car on a crowded crossroads 3 Test Drive Test Drive Test Drive

VEOS – A flexible and fast Simulation and Validation Platform

7

PC-based simulation platform for virtual ECUs, plant and environment models

Supports Simulink, C Code, C++ Code, AUTOSAR, and 3rd party models using

FMI standard

Provides possibilities to co-simulate even with proprietary simulators (e.g.

RTMaps, ADTF)

Interfaces to standard calibration and test tools (XCP, XIL-API)

Step-by-Step debug during run time.

FMI: Functional Mockup Interface

Page 8: Cluster Simulation ·  · 2017-10-24Cluster Simulation ... ADAS and Autonomous Driving Imagine … … an autonomous car on a crowded crossroads 3 Test Drive Test Drive Test Drive

One tool-chain for SIL and HIL testing

8

Early, PC-based validation of ECU

software and functions

Seamless reuse of tools, models, tests,

layouts, data, etc. in real ECU testing

SYNECT

Data management

ASM

Open simulation models

MotionDesk

3-D visualization

AutomationDesk

Testing and evaluation

Real-time validation of

components and systemSeamless reuse of data

HIL

Early PC-based validation of

ECU software and functions

SIL

ISO 26262 ready.

Prequalified for

all ASILs

ControlDesk

Experiment environment

Page 9: Cluster Simulation ·  · 2017-10-24Cluster Simulation ... ADAS and Autonomous Driving Imagine … … an autonomous car on a crowded crossroads 3 Test Drive Test Drive Test Drive

SIL Environment

9

NEW

XIL API

®

Virtual ECUs (V-ECUs)

®

Plant models

®

Simulation environment:

Use Case

Test of new controller functions in realistic

environment

Early integration test

Benefit of using VEOS

Reuse of models, test, layout throughout

the whole development process

Integration test with realistic V-ECUs

PC Cluster Simulation

Non-

Page 10: Cluster Simulation ·  · 2017-10-24Cluster Simulation ... ADAS and Autonomous Driving Imagine … … an autonomous car on a crowded crossroads 3 Test Drive Test Drive Test Drive

Speedup of (selected) HIL tests with SIL Simulation

10

XIL-API

XCP

COM

Experimentation

Test Automation

Page 11: Cluster Simulation ·  · 2017-10-24Cluster Simulation ... ADAS and Autonomous Driving Imagine … … an autonomous car on a crowded crossroads 3 Test Drive Test Drive Test Drive

11

Too many Tests for SIL?

Page 12: Cluster Simulation ·  · 2017-10-24Cluster Simulation ... ADAS and Autonomous Driving Imagine … … an autonomous car on a crowded crossroads 3 Test Drive Test Drive Test Drive

VEOS Cluster

Man

ag

er

No

de

12

Too many Tests for SIL? Scalability with Cluster Simulation

Page 13: Cluster Simulation ·  · 2017-10-24Cluster Simulation ... ADAS and Autonomous Driving Imagine … … an autonomous car on a crowded crossroads 3 Test Drive Test Drive Test Drive

Example: Adaptive Cruise Control Test Drive

Page 14: Cluster Simulation ·  · 2017-10-24Cluster Simulation ... ADAS and Autonomous Driving Imagine … … an autonomous car on a crowded crossroads 3 Test Drive Test Drive Test Drive

General Structure: Simulation Cluster

Manager Node: Distributes test

cases, handles measurement

data

Execution Node: Loads test

case, executes SIL test, collects

measurements

Example:

Maneuver: ACC with Cut-In

14

VEOS Cluster

SIL Tool Chain(e.g., XIL, VEOS, ASM)

Test Automation(e.g., Python)

Execution(e.g., via SYNECT Execute Agent *)

Cluster Management(e.g., via SYNECT)

Tool Automation(e.g., Python)

Manager Node

Page 15: Cluster Simulation ·  · 2017-10-24Cluster Simulation ... ADAS and Autonomous Driving Imagine … … an autonomous car on a crowded crossroads 3 Test Drive Test Drive Test Drive

Data Management

15

Cluster Setup

Results

VEOS Cluster

Manager Node

Database

Scenario A

ACC Cut-In

Scenario …

Variant 1

Variant 2

Variant …

Variant n

Test

Gen

era

tio

n

Scenario X

Page 16: Cluster Simulation ·  · 2017-10-24Cluster Simulation ... ADAS and Autonomous Driving Imagine … … an autonomous car on a crowded crossroads 3 Test Drive Test Drive Test Drive

Data

Management

Why Cluster?

A Simulation Cluster …

… is open to integrate

test generation methods

… leverages

SIL tool chain in general (VEOS, XIL-API,

ASM) by scaling up,

SYNECT Test Management

Real Time Testing

16

VEOS Cluster

Manager Node

Results

Scenario A

ACC Cut-In

Scenario …

Variant 1

Variant 2

Variant …

Variant nTest

Gen

era

tio

nR

esu

lt

An

aly

sis

Generate

Classify

Scale/Adapt

NEW

Scenario X

ManageManage

Page 17: Cluster Simulation ·  · 2017-10-24Cluster Simulation ... ADAS and Autonomous Driving Imagine … … an autonomous car on a crowded crossroads 3 Test Drive Test Drive Test Drive

17

CLUSTER SIMULATION DEMO

Page 18: Cluster Simulation ·  · 2017-10-24Cluster Simulation ... ADAS and Autonomous Driving Imagine … … an autonomous car on a crowded crossroads 3 Test Drive Test Drive Test Drive

18

OPTIMIZING HIL TESTING TIME

Page 19: Cluster Simulation ·  · 2017-10-24Cluster Simulation ... ADAS and Autonomous Driving Imagine … … an autonomous car on a crowded crossroads 3 Test Drive Test Drive Test Drive

19

Test case authoring using Test Manager

Test Project = 1 AUD Sequence = 1 Framework

Test Steps UI in Test Manager = Test Implementation

Page 20: Cluster Simulation ·  · 2017-10-24Cluster Simulation ... ADAS and Autonomous Driving Imagine … … an autonomous car on a crowded crossroads 3 Test Drive Test Drive Test Drive

20

SYNECT Project Navigator

Test Management Project

Test Cases

Test Steps Manager

Test Automation (TA) Framework

Page 21: Cluster Simulation ·  · 2017-10-24Cluster Simulation ... ADAS and Autonomous Driving Imagine … … an autonomous car on a crowded crossroads 3 Test Drive Test Drive Test Drive

21

Test Actions

Favorite Actions

Test Phases Test Steps

Step Properties

Variable Mappings

Page 22: Cluster Simulation ·  · 2017-10-24Cluster Simulation ... ADAS and Autonomous Driving Imagine … … an autonomous car on a crowded crossroads 3 Test Drive Test Drive Test Drive

22

How to optimize HIL time?

Test case 1 Test case 2 Test case 3 Test case 4

Test c

ase

5

Test case 9 Test case 8 Test case 7 Test case 6

Test c

ase

10

Test case 11 Test case …. . .

Test case 100. . .

100 Test Cases = 600 mins (10 Hours) of HIL Time!!!

400 mins of HIL Time is wasted!

Sequential Testing Process

EXECUTION

EVALUATION

Test Case - 1

2 mins

4 mins

HIL Testing

1 Test Case = 6 mins

®

Page 23: Cluster Simulation ·  · 2017-10-24Cluster Simulation ... ADAS and Autonomous Driving Imagine … … an autonomous car on a crowded crossroads 3 Test Drive Test Drive Test Drive

23

Optimizing HIL Testing Time

EXECUTION

EVALUATION

Test Case - 1

2 mins

4 mins

Offline PC

2 mins HIL Time

Iteration

Test case 1

Test case 2

Test case 3

Test case 4

. . .

Execution

Iteration

Test case 1

Test case 2

Test case 3

Test case 4

. . .

Post-Processing

Offline PC

Captured

DataResults

.mat / .mf4 1 Passed

.mat / .mf4 2 Failed

.mat / .mf4 3 Passed

.mat / .mf4 4 Passed

. . . . . .

HIL PC

Master Data Manager

100 Test Cases = 200 mins (~3 Hours) of HIL Time

Reduced from 7 Hours to 3 Hours = Saves ~58% of HIL Time

SYNECT

Page 24: Cluster Simulation ·  · 2017-10-24Cluster Simulation ... ADAS and Autonomous Driving Imagine … … an autonomous car on a crowded crossroads 3 Test Drive Test Drive Test Drive

24

DEMO

Page 25: Cluster Simulation ·  · 2017-10-24Cluster Simulation ... ADAS and Autonomous Driving Imagine … … an autonomous car on a crowded crossroads 3 Test Drive Test Drive Test Drive

Thank you for listening!

25

Page 26: Cluster Simulation ·  · 2017-10-24Cluster Simulation ... ADAS and Autonomous Driving Imagine … … an autonomous car on a crowded crossroads 3 Test Drive Test Drive Test Drive

26

Important Information!

© 2017, dSPACE GmbHAll rights reserved. Written permission is required for reproduction of all or parts of this publication. The source must be stated in any such reproduction.This publication and the contents hereof are subject to change without notice. Benchmark results are based on a specific application. Results are generally not transferable to other applications.Brand names or product names are trademarks or registered trademarks of their respective companies or organizations.

Page 27: Cluster Simulation ·  · 2017-10-24Cluster Simulation ... ADAS and Autonomous Driving Imagine … … an autonomous car on a crowded crossroads 3 Test Drive Test Drive Test Drive