Enrique Alba, Sebastián Luna, and Jamal ToutouhAccuracy and Efficiency in Simulating VANETs...

15
Enrique Alba, Sebastián Luna, and Jamal Toutouh Accuracy and E ciency in Simulating VANETs MCO’08 Metz, France September 8-10 th , 2008 Accuracy and E ciency in Simulating VANETs Enrique Alba, Sebastián Luna, and Jamal Toutouh Universidad de Málaga Introduction and Motivation VANETs Simulation The CARLINK-UMA Scenario Results Conclusions and Future Work

Transcript of Enrique Alba, Sebastián Luna, and Jamal ToutouhAccuracy and Efficiency in Simulating VANETs...

Page 1: Enrique Alba, Sebastián Luna, and Jamal ToutouhAccuracy and Efficiency in Simulating VANETs MCO’08 Metz, France September 8-10 th, 2008 MCO’08 Metz, France.

Enrique Alba, Sebastián Luna, and Jamal Toutouh

Accuracy and Efficiency in Simulating VANETs

MCO’08Metz, France

September 8-10th, 2008

MCO’08Metz, France

September 8-10th, 2008

Accuracy and Efficiency in Simulating VANETs

Enrique Alba, Sebastián Luna, and Jamal Toutouh

Universidad de Málaga

Accuracy and Efficiency in Simulating VANETs

Enrique Alba, Sebastián Luna, and Jamal Toutouh

Universidad de Málaga

Introduction and MotivationVANETs Simulation

The CARLINK-UMA ScenarioResults

Conclusions and Future Work

Page 2: Enrique Alba, Sebastián Luna, and Jamal ToutouhAccuracy and Efficiency in Simulating VANETs MCO’08 Metz, France September 8-10 th, 2008 MCO’08 Metz, France.

Enrique Alba, Sebastián Luna, and Jamal Toutouh

Accuracy and Efficiency in Simulating VANETs

MCO’08Metz, France

September 8-10th, 2008

MCO’08Metz, France

September 8-10th, 2008

3

Outline Outline

Introduction and Motivation

VANETs Simulation

The CARLINK-UMA Scenario

Results

Conclusions and Future Work

1

2

4

5

Introduction and MotivationVANETs Simulation

The CARLINK-UMA ScenarioResults

Conclusions and Future Work

5

2 /13

Page 3: Enrique Alba, Sebastián Luna, and Jamal ToutouhAccuracy and Efficiency in Simulating VANETs MCO’08 Metz, France September 8-10 th, 2008 MCO’08 Metz, France.

Enrique Alba, Sebastián Luna, and Jamal Toutouh

Accuracy and Efficiency in Simulating VANETs

MCO’08Metz, France

September 8-10th, 2008

MCO’08Metz, France

September 8-10th, 2008

Introduction and Motivation Introduction and Motivation

The performance evaluation of the different VANET protocols and applications is done by using both outdoor experiments and simulations

The evaluation through outdoors experiments has several drawbacks:

neither easy nor cheap difficult to analyze in an inherently distributed and complex environment reproduction of all kinds of situations where they must act is not possible

The simulation avoid the previous drawbacks. Nevertheless it presents the following one:

the fidelity of the simulated results versus the real ones

Introduction and MotivationVANETs Simulation

The CARLINK-UMA ScenarioResults

Conclusions and Future Work

We present here a comparison between simulations and real tests

The goal is to better know the actual VANET simulator used in CARLINK and the data/delay rates affecting the final applications

3 /13

Page 4: Enrique Alba, Sebastián Luna, and Jamal ToutouhAccuracy and Efficiency in Simulating VANETs MCO’08 Metz, France September 8-10 th, 2008 MCO’08 Metz, France.

Enrique Alba, Sebastián Luna, and Jamal Toutouh

Accuracy and Efficiency in Simulating VANETs

MCO’08Metz, France

September 8-10th, 2008

MCO’08Metz, France

September 8-10th, 2008

VANET Simulation VANET Simulation

Three kinds of approaches in VANET simulation have been initially considered:

Using an specially-designed VANET simulatorAlternatives: TraNS, MOVE, CARISMA, and STRAW

Introduction and MotivationVANETs Simulation

The CARLINK-UMA ScenarioResults

Conclusions and Future Work

Integrating a vehicular mobility model generator into an existing network (MANETs) simulator

Mobility model generator: SUDO and VanetMobiSimNetwork simulators: Ns-2, GlomoSim, QualNet, and OpNet

MANET applications programming framework which allows the developer to test the applications via simulations:

Alternative: JANE

VanetMobiSim/Ns-2

VanetMobiSim/Ns-2

JANEJANE

4 /13

Page 5: Enrique Alba, Sebastián Luna, and Jamal ToutouhAccuracy and Efficiency in Simulating VANETs MCO’08 Metz, France September 8-10 th, 2008 MCO’08 Metz, France.

Enrique Alba, Sebastián Luna, and Jamal Toutouh

Accuracy and Efficiency in Simulating VANETs

MCO’08Metz, France

September 8-10th, 2008

MCO’08Metz, France

September 8-10th, 2008

VanetMobiSim/Ns-2 [ mobility model generator + network simulator ]

VANET Simulation. VanetMobiSim/Ns-2 VANET Simulation. VanetMobiSim/Ns-2

Introduction and MotivationVANETs Simulation

The CARLINK-UMA ScenarioResults

Conclusions and Future Work

- Freely available- Different kind of outputs- Generates realistic models Macro-mobility features Micro-mobility features

Ns-2: - Freely available- Easily adding features- Widely used- Numerical output

+

VanetMobiSim:

Vehicular Data Transfer Protocol (VDTP) has been added

Vehicular Data Transfer Protocol (VDTP) has been added

TARGET: making precise simulations of the real systems 5 /13

Page 6: Enrique Alba, Sebastián Luna, and Jamal ToutouhAccuracy and Efficiency in Simulating VANETs MCO’08 Metz, France September 8-10 th, 2008 MCO’08 Metz, France.

Enrique Alba, Sebastián Luna, and Jamal Toutouh

Accuracy and Efficiency in Simulating VANETs

MCO’08Metz, France

September 8-10th, 2008

MCO’08Metz, France

September 8-10th, 2008

JANE: Java Ad hoc Network Environment Open source Java-based middleware platform which is intended to assist ad-hoc network researchers in application and protocol design

Three different execution modes:1. Simulation Mode: the complete environment is simulated2. Hybrid Mode: the devices and the ad-hoc network are

simulated, but real users can interact with the simulation3. Platform Mode: the whole setting is real

Drawback: It is not specialized for VANETs not provide realistic mobility models for thesimulation of vehicular networks

TARGET: programming high level applications

VANET Simulation. JANE VANET Simulation. JANE

Introduction and MotivationVANETs Simulation

The CARLINK-UMA ScenarioResults

Conclusions and Future Work

6 /13

Page 7: Enrique Alba, Sebastián Luna, and Jamal ToutouhAccuracy and Efficiency in Simulating VANETs MCO’08 Metz, France September 8-10 th, 2008 MCO’08 Metz, France.

Enrique Alba, Sebastián Luna, and Jamal Toutouh

Accuracy and Efficiency in Simulating VANETs

MCO’08Metz, France

September 8-10th, 2008

MCO’08Metz, France

September 8-10th, 2008

The CARLINK-UMA scenario The CARLINK-UMA scenario

The scenarios are defined by their specific mobility models:

File transfers between two cars by using ad-hoc operation mode of the IEEE 802.11b MAC Layer Standard

PROXiM ORINOCO PCMCIA transceiver Range extender antenna gain: 7 dBi

Introduction and MotivationVANETs Simulation

The CARLINK-UMA ScenarioResults

Conclusions and Future Work

7 /13

Page 8: Enrique Alba, Sebastián Luna, and Jamal ToutouhAccuracy and Efficiency in Simulating VANETs MCO’08 Metz, France September 8-10 th, 2008 MCO’08 Metz, France.

Enrique Alba, Sebastián Luna, and Jamal Toutouh

Accuracy and Efficiency in Simulating VANETs

MCO’08Metz, France

September 8-10th, 2008

MCO’08Metz, France

September 8-10th, 2008

The CARLINK-UMA scenario The CARLINK-UMA scenario

Each experiment is composed of different tests The tests consist in repeatedly transferring a file in

specific scenarios: File type 1: traffic information documents (1 MB) File type 2: multimedia files (10 MB)

The file transfers are carrying out by using the Vehicular Data Transfer Protocol (VDTP):

Chunk size: 25Kbytes Retransmission time: 8 seconds Max number of attempts per packet: 8

The test are named as follows: Test A1 Test A2 Test B1 Test B2

It describes the scenario: Scenario A Scenario B

Introduction and MotivationVANETs Simulation

The CARLINK-UMA ScenarioResults

Conclusions and Future Work

Test Xi

It denotes the file type: File type 1 = 1 MB File type 2 = 10 MB

8 /13

Page 9: Enrique Alba, Sebastián Luna, and Jamal ToutouhAccuracy and Efficiency in Simulating VANETs MCO’08 Metz, France September 8-10 th, 2008 MCO’08 Metz, France.

Enrique Alba, Sebastián Luna, and Jamal Toutouh

Accuracy and Efficiency in Simulating VANETs

MCO’08Metz, France

September 8-10th, 2008

MCO’08Metz, France

September 8-10th, 2008

Results Results

Test A1 (same sense, 1 MB files)

Average values:Real Experiments JANE VanetMobiSim/Ns-2

Transmission Time 1.6 secs 1.8 secs 1.6 secs

Data Rate 626.9 KB/s 563.8 KB/s 609.7 KB/s

Introduction and MotivationVANETs Simulation

The CARLINK-UMA ScenarioResults

Conclusions and Future Work

Accurate results

9 /13

Page 10: Enrique Alba, Sebastián Luna, and Jamal ToutouhAccuracy and Efficiency in Simulating VANETs MCO’08 Metz, France September 8-10 th, 2008 MCO’08 Metz, France.

Enrique Alba, Sebastián Luna, and Jamal Toutouh

Accuracy and Efficiency in Simulating VANETs

MCO’08Metz, France

September 8-10th, 2008

MCO’08Metz, France

September 8-10th, 2008

Results Results

Test A2 (same sense, 10 MB files)

Average values: Real Experiments JANE VanetMobiSim/Ns-2

Transmission Time 17.3 secs 17.9 secs 16.7 secs

Data Rate 585.1 KB/s 564.4 KB/s 611.1 KB/s

Introduction and MotivationVANETs Simulation

The CARLINK-UMA ScenarioResults

Conclusions and Future Work

Difference 0.6 secs

Difference 0.6 secs 10 /13

Page 11: Enrique Alba, Sebastián Luna, and Jamal ToutouhAccuracy and Efficiency in Simulating VANETs MCO’08 Metz, France September 8-10 th, 2008 MCO’08 Metz, France.

Enrique Alba, Sebastián Luna, and Jamal Toutouh

Accuracy and Efficiency in Simulating VANETs

MCO’08Metz, France

September 8-10th, 2008

MCO’08Metz, France

September 8-10th, 2008

Results Results

Test B1 (opposite sense, 1 MB files)

Average values:Real Experiments JANE VanetMobiSim/Ns-2

Transmission Time 2.7 secs 1.8 secs 2.6 secs

Data Rate 371.4 KB/s 563.7 KB/s 391.4 KB/s

JANE: Only 3 completed transfers

Introduction and MotivationVANETs Simulation

The CARLINK-UMA ScenarioResults

Conclusions and Future Work

Accurate results

11 /13

Page 12: Enrique Alba, Sebastián Luna, and Jamal ToutouhAccuracy and Efficiency in Simulating VANETs MCO’08 Metz, France September 8-10 th, 2008 MCO’08 Metz, France.

Enrique Alba, Sebastián Luna, and Jamal Toutouh

Accuracy and Efficiency in Simulating VANETs

MCO’08Metz, France

September 8-10th, 2008

MCO’08Metz, France

September 8-10th, 2008

Results Results

Test B2 (opposite sense, 10 MB files)

Average values:Real Experiments JANE VanetMobiSim/Ns-2

Transmission Time 20.1 secs N/A 19.9 secs

Data Rate 502.1 KB/s N/A 513.3 KB/s

JANE: No transfers completed

Introduction and MotivationVANETs Simulation

The CARLINK-UMA ScenarioResults

Conclusions and Future Work

Accurate results

12 /13

Page 13: Enrique Alba, Sebastián Luna, and Jamal ToutouhAccuracy and Efficiency in Simulating VANETs MCO’08 Metz, France September 8-10 th, 2008 MCO’08 Metz, France.

Enrique Alba, Sebastián Luna, and Jamal Toutouh

Accuracy and Efficiency in Simulating VANETs

MCO’08Metz, France

September 8-10th, 2008

MCO’08Metz, France

September 8-10th, 2008

Results Results

Global average results

Mean data rate differences (absolute value in KB/s) between real and simulation results Test A1 Test A2 Test B1 Test B2

JANE 63.1 KB/s 20.6 KB/s 192.3 KB/s N/A

VanetMobiSim/Ns-2 17.2 KB/s 25.8 KB/s 20.0 KB/s 11.3 KB/s

Introduction and MotivationVANETs Simulation

The CARLINK-UMA ScenarioResults

Conclusions and Future Works

13 /13

Page 14: Enrique Alba, Sebastián Luna, and Jamal ToutouhAccuracy and Efficiency in Simulating VANETs MCO’08 Metz, France September 8-10 th, 2008 MCO’08 Metz, France.

Enrique Alba, Sebastián Luna, and Jamal Toutouh

Accuracy and Efficiency in Simulating VANETs

MCO’08Metz, France

September 8-10th, 2008

MCO’08Metz, France

September 8-10th, 2008

Conclusions Conclusions

The real world is quite difficult to simulate in a trustworthy manner. Our simulations can be changed by including:

obstacles signal reflections etc.

At the CARLINK-UMA Scenario an important quantity of data can be transferred with a transmission data rate always higher than 300 KB/s

VanetMobiSim/Ns-2 is the most realistic simulator, if the goal is to model the VANET in a computer

JANE is useful for programming/testing high-level applications

• As a future work: perform simulations of other scenarios in order to predict the performance of the communications at urban and highway environments (almost finished) combine the simulator (VMS/Ns-2) with optimization techniques in order to offer an optimal configuration of VDTP (in progress)

Introduction and MotivationVANETs Simulation

The CARLINK-UMA ScenarioResults

Conclusions and Future Work

14 /13

Page 15: Enrique Alba, Sebastián Luna, and Jamal ToutouhAccuracy and Efficiency in Simulating VANETs MCO’08 Metz, France September 8-10 th, 2008 MCO’08 Metz, France.

Enrique Alba, Sebastián Luna, and Jamal Toutouh

Accuracy and Efficiency in Simulating VANETs

MCO’08Metz, France

September 8-10th, 2008

MCO’08Metz, France

September 8-10th, 2008

Introduction and MotivationVANETs Simulation

The CARLINK-UMA ScenarioResults

Conclusions and Future Work

Thank you for your attention.Any questions?