The Design Challenges for

Unmanned Vehicular Video Streaming

The Design Challenges for

Unmanned Vehicular Video Streaming

Hong Xuan Qian

GenieView Inc

Reno NV 89503

USA

hong.qian@genie

view.com

Jun Steed Huang

School of

Information

Technology

and Engineering

University of Ottawa

Canada

steedhuang@ujs.edu.

cn

Lin Lin Ma

School of Computer

Science and

Telecommunication

Engineering

Jiangsu University

Zhenjiang 212013

P.R.China

mll.gly@hotmail.co

m

Presented by

Mary Opokua

Ansong

Computer Science

Section

Kumasi Polytechnic.

Ghana

ansongm@yahoo.c

om

2011 IEEE International Conference on Vehicular

Electronics and Safety July 12, 2011,

Beijing, P.R.China

Where we from?Where we from?

ContentContent

1.1.1.1. INTRODUCTION1.1.1.1. INTRODUCTION

2. LOW POWER FAST SOLUTION2. LOW POWER FAST SOLUTION

3. CAMERA DESIGN ANALYSIS 3. CAMERA DESIGN ANALYSIS

4. CONCLUSION & FUTURE WORK4. CONCLUSION & FUTURE WORK

1. INTRODUCTION1. INTRODUCTION

• This paper studies the design challenges for unmanned

vehicular video streaming.

• The major challenge in this area is providing fast image

processing with low latency, under limited space, limited

weight, limited power and limited link bandwidth

constrains. This paper offers the fundamental design

choices and rule of thumb.

• And situational awareness with UXV platforms imposes

some requirements on the video handling sub-system.

• This paper studies the design challenges for unmanned

vehicular video streaming.

• The major challenge in this area is providing fast image

processing with low latency, under limited space, limited

weight, limited power and limited link bandwidth

constrains. This paper offers the fundamental design

choices and rule of thumb.

• And situational awareness with UXV platforms imposes

some requirements on the video handling sub-system.

In order to decrease power

consumption ,we adopted

96 small Micro Processors,

as shown in Figure , each

one runs at 96MHz, drain

1mW, total 96mW; however,

the amount of computation

that can be done is almost

equivalent to

96×96=9216MHz single

high speed CPU, which

would otherwise drain

96×96×96= 884736mW

power, by theory!

In order to decrease power

consumption ,we adopted

96 small Micro Processors,

as shown in Figure , each

one runs at 96MHz, drain

1mW, total 96mW; however,

the amount of computation

that can be done is almost

equivalent to

96×96=9216MHz single

high speed CPU, which

would otherwise drain

96×96×96= 884736mW

power, by theory!

2. LOW POWER FAST SOLUTION2. LOW POWER FAST SOLUTION

A. Main Issues of Our

Industry

A. Main Issues of Our

Industry

DLL Power Mgnt JTAG

Memory &

Peripheral IF

AUDIO

USART

16 GPIO

2 Timers

Video IF

Camera

interface

Array

Processor

96 CPU

Sys Memo

ARM 9

B. Main Challenge for the Vehicle

• In this chapter, we have done a number of

tests near an intersection where a fatal

accident occurred - a high school girl was

killed by a speeding car, slipped through the

traffic light.• The following figures show a car-accident-cyclists,

percentage of victims killed in speed crashes by

crash type and percentage of pedestrians killed in

intersection crashes by age.

B. Main Challenge for the Vehicle

• In this chapter, we have done a number of

tests near an intersection where a fatal

accident occurred - a high school girl was

killed by a speeding car, slipped through the

traffic light.• The following figures show a car-accident-cyclists,

percentage of victims killed in speed crashes by

crash type and percentage of pedestrians killed in

intersection crashes by age.

PROBLEMSPROBLEMS

1) a car-accident-cyclists

1) a car-accident-cyclists

WHY THE RESEARCH?WHY THE RESEARCH?

2) percentage of victims killed 3) percentage of pedestrians

in speed crashes by crash type killed in intersection by age

crashes

2) percentage of victims killed 3) percentage of pedestrians

in speed crashes by crash type killed in intersection by age

crashes

WHO GETS KILLED WHEREWHO GETS KILLED WHERE

In general, we have something to do to save life. For that , we have done a number of tests to make a difference between the progressive scan and the interlaced scan, the horizontal interlaced scan and the vertical interlaced scan.

The following figures show the difference among horizontal scan, vertical scan and horizontal-vertical scan,

In general, we have something to do to save life. For that , we have done a number of tests to make a difference between the progressive scan and the interlaced scan, the horizontal interlaced scan and the vertical interlaced scan.

The following figures show the difference among horizontal scan, vertical scan and horizontal-vertical scan,

FAST IMAGE SOLUTIONFAST IMAGE SOLUTION

• horizontal interlaced scan vertical interlaced scan

1 2 3 4

9 10 11 12

5 6 7 8

13 14 15 16

13 5 9 1

14 6 10

117

2

315

16 8 12 4

6 CPU handles 1 block within 2ms, detect the object

48 CPU handles 8 blocks within 16 ms, detect the people

96 CPU handles 16 Blocks within 32 ms, update the frame

• Horizontal-Vertical Scan

1 15 2 13

9 7 10 5

3 16 4 14

11 128 6

O E O

OE

E

EO

O E

EO

E O E O

L R

U

D

O-Odd, E-Even, U-Up, D-Down, L-Left, R-Right.

ROAD TEST RESULTS

1. Figure 1 is Picture Took with Vehicle Still .

2. Figure 2 is Picture with Vehicle in Motion by

Horizontal Scan.

3. Figure 3 is Picture with Vehicle by Vertical Scan

Moving the Same Way.

4. Figure 4 is Picture with Vehicle by Vertical Scan the

Opposite Way.

5. Figure 5 is Picture with Vehicle by Horizontal-

Vertical Scan.

1) Picture Took with Vehicle Still 2) Picture with Vehicle in Motion by Horizontal Scan

3) Picture with Vehicle by Vertical Scan Moving the Same Way

4) Picture with Vehicle by Vertical Scan the Opposite Way

• 5) Picture with Vehicle by Horizontal-Vertical Scan

From detail comparisons, we can see that the best picture among the different scan is when both horizontal and vertical scan is used.

3. FAST CAMERA DESIGN 3. FAST CAMERA DESIGN

• GenieView camera detailed structure of the system:

Low Power SRAM

2Mbit*16

CY62138CV25

Audio Codec

TLV320AIC26

FLASH 8Mbit*16

RC28F800C3BD7

J2210 VIDEO

PROCESSORNTSC/PAL Converter

TVP 5150AMI

RF Module interface

PWR

JACK

BATTERY

CELL

UART

TL16C55

0DRHB

Audio BUS

Video BUS

USART

Power Supply

12V/5V/3.5V/2.5V/

1.8V/1.2V

RS232/485

Transceiver

MAX3160

Button

Battery

Tamper Ecryption

key Keep NVRAM

M41S787WMX6

USART

12C

DESIGN FLEXIBLE ANALYSISDESIGN FLEXIBLE ANALYSIS

• Flexibility is shown below：

• According to the table in the paper, GenieView offers the lowest power consumption for vehicular application.

4. CONCLUSION 4. CONCLUSION

• Due to the green environment pressure, the big,

heavy and power hungry rear, side or front view

cameras are becoming less acceptable.

• The challenges for the on-board cameras is providing

fast image processing with low latency, under limited

space, limited weight, limited power and limited link

bandwidth constrains.

• GenieView offers the lowest power consumption for

vehicular application. And the solution of GenieView

deployed on the field for Unmanned Ford and GM

vehicles was revealed.

FUTURE WORKFUTURE WORK

• For future work, combining image recognition

function, on-board cameras should be used to

identify the animals and human-beings

suddenly appear around manned cars to avoid

accident. By using the on-board cameras, we

can save life.