- 1 - Embedded Systems Assoc. Prof.Dr. Oğuzhan Urhan E-mail: [email protected] Resarch Interests:...

45
- 1 - Embedded Systems Assoc. Prof.Dr. Oğuzhan Urhan E-mail: [email protected] Resarch Interests: Image / Signal Processing and Embedded Systems

Transcript of - 1 - Embedded Systems Assoc. Prof.Dr. Oğuzhan Urhan E-mail: [email protected] Resarch Interests:...

Page 1: - 1 - Embedded Systems Assoc. Prof.Dr. Oğuzhan Urhan E-mail: urhano@ieee.org Resarch Interests: Image / Signal Processing and Embedded Systems.

- 1 -

Embedded Systems

Assoc. Prof.Dr. Oğuzhan Urhan

E-mail: [email protected]

Resarch Interests: Image / Signal Processing and Embedded Systems

Page 2: - 1 - Embedded Systems Assoc. Prof.Dr. Oğuzhan Urhan E-mail: urhano@ieee.org Resarch Interests: Image / Signal Processing and Embedded Systems.

- 2 -

Embedded System Hardware

Embedded system hardware is frequently used in a loop(„hardware in a loop“):

Embedded system hardware is frequently used in a loop(„hardware in a loop“):

actuators

Page 3: - 1 - Embedded Systems Assoc. Prof.Dr. Oğuzhan Urhan E-mail: urhano@ieee.org Resarch Interests: Image / Signal Processing and Embedded Systems.

- 3 -

Sensors

Processing of physical data starts with capturing this data.

Sensors can be designed for virtually every physical and

chemical quantity• including weight, velocity, acceleration, electrical current,

voltage, temperatures etc.• chemical compounds.

Many physical effects used for constructing sensors.

Examples:• law of induction (generation of voltages in an electric field),• light-electric effects.

Huge amount of sensors designed in recent years.

Processing of physical data starts with capturing this data.

Sensors can be designed for virtually every physical and

chemical quantity• including weight, velocity, acceleration, electrical current,

voltage, temperatures etc.• chemical compounds.

Many physical effects used for constructing sensors.

Examples:• law of induction (generation of voltages in an electric field),• light-electric effects.

Huge amount of sensors designed in recent years.

Page 4: - 1 - Embedded Systems Assoc. Prof.Dr. Oğuzhan Urhan E-mail: urhano@ieee.org Resarch Interests: Image / Signal Processing and Embedded Systems.

- 4 -

A/D Conversion

Sampled signal

Quantized signal

Page 5: - 1 - Embedded Systems Assoc. Prof.Dr. Oğuzhan Urhan E-mail: urhano@ieee.org Resarch Interests: Image / Signal Processing and Embedded Systems.

- 5 -

- Computers

- Microprocessor based systems

- Microcontrollers (MCU)

- DSPs

- FPGAs

- Custom Logic, ASIC

- Computers

- Microprocessor based systems

- Microcontrollers (MCU)

- DSPs

- FPGAs

- Custom Logic, ASIC

Information Processing

- Programming with assembly, C/C++ and Java languages, Verilog, VHDL

- Programming with assembly, C/C++ and Java languages, Verilog, VHDL

Memory

OutputInput Processor

Page 6: - 1 - Embedded Systems Assoc. Prof.Dr. Oğuzhan Urhan E-mail: urhano@ieee.org Resarch Interests: Image / Signal Processing and Embedded Systems.

- 6 -

Future of IT?

According to forecasts charac-terized by the terms such as

Post-PC era

Disappearing computer

Ubiquitous computing

Pervasive computing

Ambient intelligence

Embedded systems

According to forecasts charac-terized by the terms such as

Post-PC era

Disappearing computer

Ubiquitous computing

Pervasive computing

Ambient intelligence

Embedded systems

preface

Page 7: - 1 - Embedded Systems Assoc. Prof.Dr. Oğuzhan Urhan E-mail: urhano@ieee.org Resarch Interests: Image / Signal Processing and Embedded Systems.

- 7 -

Embedded Systems

Main reason for buying is not information processingMain reason for buying is not information processing

Embedded systems (ES) = information processing systems embedded into a larger product

Embedded systems (ES) = information processing systems embedded into a larger product

Page 8: - 1 - Embedded Systems Assoc. Prof.Dr. Oğuzhan Urhan E-mail: urhano@ieee.org Resarch Interests: Image / Signal Processing and Embedded Systems.

- 8 -

Embedded systemsand ubiquitous computing

Ubiquitous computing: Information anytime, anywhere.Embedded systems provide fundamental technology.

Ubiquitous computing: Information anytime, anywhere.Embedded systems provide fundamental technology.

Ist.gif

UMTS,

Page 9: - 1 - Embedded Systems Assoc. Prof.Dr. Oğuzhan Urhan E-mail: urhano@ieee.org Resarch Interests: Image / Signal Processing and Embedded Systems.

- 9 -

Application areas (1)

• Automotive electronics

• Aircraft electronics

• Trains

• Telecommunication

• Automotive electronics

• Aircraft electronics

• Trains

• Telecommunication

1.2 Application areas

Page 10: - 1 - Embedded Systems Assoc. Prof.Dr. Oğuzhan Urhan E-mail: urhano@ieee.org Resarch Interests: Image / Signal Processing and Embedded Systems.

- 10 -

Application areas (2)

• Medical systemse.g. “artificial eye”

• Blood Pressure Monitors

• Medical systemse.g. “artificial eye”

• Blood Pressure Monitors

[www.dobelle.com]

Page 11: - 1 - Embedded Systems Assoc. Prof.Dr. Oğuzhan Urhan E-mail: urhano@ieee.org Resarch Interests: Image / Signal Processing and Embedded Systems.

- 11 -

Application areas (3)

• Authentication• Authentication

• Military applications• Military applications

http://www.submarine.co.mp/wallpaper/submarine_640.jpg

Page 12: - 1 - Embedded Systems Assoc. Prof.Dr. Oğuzhan Urhan E-mail: urhano@ieee.org Resarch Interests: Image / Signal Processing and Embedded Systems.

- 12 -

Application areas (4)

•Consumer Electronics•Consumer Electronics

Page 13: - 1 - Embedded Systems Assoc. Prof.Dr. Oğuzhan Urhan E-mail: urhano@ieee.org Resarch Interests: Image / Signal Processing and Embedded Systems.

- 13 -

Application areas (5)

• Smart buildings• Smart buildings

• Fabrication equipment• Fabrication equipment

Show movie http://www.date-conference.com/conference/ 2003/keynotes/index.htm

Page 14: - 1 - Embedded Systems Assoc. Prof.Dr. Oğuzhan Urhan E-mail: urhano@ieee.org Resarch Interests: Image / Signal Processing and Embedded Systems.

- 14 -

Application areas (6)

• Robotics• Robotics

„Pipe-climber“ Robot „Johnnie“ (Courtesy and ©: H.Ulbrich, F. Pfeiffer, TU München)

Show movie of 2-legged robot(s)

Page 15: - 1 - Embedded Systems Assoc. Prof.Dr. Oğuzhan Urhan E-mail: urhano@ieee.org Resarch Interests: Image / Signal Processing and Embedded Systems.

- 15 -

Application areas (7)

• Credit Cards, E-wallet applications• Credit Cards, E-wallet applications

Show movie of 2-legged robot(s)

“AKBİL”

Page 16: - 1 - Embedded Systems Assoc. Prof.Dr. Oğuzhan Urhan E-mail: urhano@ieee.org Resarch Interests: Image / Signal Processing and Embedded Systems.

Examples

Some embedded systems from

real life

Page 17: - 1 - Embedded Systems Assoc. Prof.Dr. Oğuzhan Urhan E-mail: urhano@ieee.org Resarch Interests: Image / Signal Processing and Embedded Systems.

Info

rmati

on T

ech

nolo

gy

Department of Information Technology | www.it.uu.se

Smart Beer Glass

8-bit, 8-pin 8-bit, 8-pin PIC processorPIC processor

Capacitive sensor Capacitive sensor for fluid levelfor fluid level

Inductive coil for RF Inductive coil for RF ID activation & ID activation &

powerpower

CPU and reading coil in the table. Reports the level of fluid in the glass, alerts servers when close to empty

Contact less Contact less transmission transmission of power and of power and

readingsreadings

© Jakob Engblom

Page 18: - 1 - Embedded Systems Assoc. Prof.Dr. Oğuzhan Urhan E-mail: urhano@ieee.org Resarch Interests: Image / Signal Processing and Embedded Systems.

Info

rmati

on T

ech

nolo

gy

Department of Information Technology | www.it.uu.se

Smart Beer Glass Typical embedded solution Integrates several technologies:

Radio transmissions Sensor technology Magnetic inductance for power Computer used for calibration

Impossible without the computer Meaningless without the electronics

© Jakob Engblom

Page 19: - 1 - Embedded Systems Assoc. Prof.Dr. Oğuzhan Urhan E-mail: urhano@ieee.org Resarch Interests: Image / Signal Processing and Embedded Systems.

Info

rmati

on T

ech

nolo

gy

Department of Information Technology | www.it.uu.se

Pedometer Obvious computer

work: Count steps Keep time Averages etc.

Hard computer work: Actually identify when a

step is taken Sensor feels motion of

device, not of user feet

© Jakob Engblom

Page 20: - 1 - Embedded Systems Assoc. Prof.Dr. Oğuzhan Urhan E-mail: urhano@ieee.org Resarch Interests: Image / Signal Processing and Embedded Systems.

Info

rmati

on T

ech

nolo

gy

Department of Information Technology | www.it.uu.se

Mobile phones Multiprocessor

8-bit/32-bit for UI DSP for signals 32-bit in IR port 32-bit in Bluetooth

8-100 MB of memory All custom chips Power consumption &

battery life depends on software

© Jakob Engblom

Page 21: - 1 - Embedded Systems Assoc. Prof.Dr. Oğuzhan Urhan E-mail: urhano@ieee.org Resarch Interests: Image / Signal Processing and Embedded Systems.

Info

rmati

on T

ech

nolo

gy

Department of Information Technology | www.it.uu.se

Mobile base station Massive signal processing

Several processing tasks per connected mobile phone

Based on DSPs Standard or custom 100s of processors

© Jakob Engblom

Page 22: - 1 - Embedded Systems Assoc. Prof.Dr. Oğuzhan Urhan E-mail: urhano@ieee.org Resarch Interests: Image / Signal Processing and Embedded Systems.

Info

rmati

on T

ech

nolo

gy

Department of Information Technology | www.it.uu.se

Telecom Switch Rack-based

Control cards IO cards DSP cards ...

Optical & copper connections

Digital & analog signals

© Jakob Engblom

Page 23: - 1 - Embedded Systems Assoc. Prof.Dr. Oğuzhan Urhan E-mail: urhano@ieee.org Resarch Interests: Image / Signal Processing and Embedded Systems.

Info

rmati

on T

ech

nolo

gy

Department of Information Technology | www.it.uu.se

Smart Welding Machine Electronics control voltage

& speed of wire feed Adjusts to operator

kHz sample rate 1000s of decisions/second

Perfect weld even for quite clumsy operators

Easier-to-use product, but no obvious computer

© Jakob Engblom

Page 24: - 1 - Embedded Systems Assoc. Prof.Dr. Oğuzhan Urhan E-mail: urhano@ieee.org Resarch Interests: Image / Signal Processing and Embedded Systems.

Info

rmati

on T

ech

nolo

gy

Department of Information Technology | www.it.uu.se

Sewing Machine User interface

Embroidery patterns Touch-screen control

”Smart” Sets pressure of foot

depending on task Raise foot when stopped

New functions added by upgrading the software

© Jakob Engblom

Page 25: - 1 - Embedded Systems Assoc. Prof.Dr. Oğuzhan Urhan E-mail: urhano@ieee.org Resarch Interests: Image / Signal Processing and Embedded Systems.

Info

rmati

on T

ech

nolo

gy

Department of Information Technology | www.it.uu.se

Cars Multiple networks

Body, engine, telematics, media, safety

Multiple processors Up to 100 Networked together

© Jakob Engblom

Page 26: - 1 - Embedded Systems Assoc. Prof.Dr. Oğuzhan Urhan E-mail: urhano@ieee.org Resarch Interests: Image / Signal Processing and Embedded Systems.

Info

rmati

on T

ech

nolo

gy

Department of Information Technology | www.it.uu.se

Cars Functions by embedded processing:

ABS: Anti-lock braking systems ESP: Electronic stability control Airbags Efficient automatic gearboxes Theft prevention with smart keys Blind-angle alert systems ... etc ...

© Jakob Engblom

Page 27: - 1 - Embedded Systems Assoc. Prof.Dr. Oğuzhan Urhan E-mail: urhano@ieee.org Resarch Interests: Image / Signal Processing and Embedded Systems.

Info

rmati

on T

ech

nolo

gy

Department of Information Technology | www.it.uu.se

Cars Large diversity in processor types:

8-bit – door locks, lights, etc. 16-bit – most functions 32-bit – engine control, airbags

Form follows function Processing where the action is Sensors and actuators distributed all

over the vehicle

© Jakob Engblom

Page 28: - 1 - Embedded Systems Assoc. Prof.Dr. Oğuzhan Urhan E-mail: urhano@ieee.org Resarch Interests: Image / Signal Processing and Embedded Systems.

Info

rmati

on T

ech

nolo

gy

Department of Information Technology | www.it.uu.se

Extremely Large Functions requiring

computers: Radar Weapons Damage control Navigation basically everything

Computers: Large servers 1000s of processors

© Jakob Engblom

Page 29: - 1 - Embedded Systems Assoc. Prof.Dr. Oğuzhan Urhan E-mail: urhano@ieee.org Resarch Interests: Image / Signal Processing and Embedded Systems.

Info

rmati

on T

ech

nolo

gy

Department of Information Technology | www.it.uu.se

Inside your PC Custom processors

Graphics, sound 32-bit processors

IR, Bluetooth Network, WLAN Harddisk RAID controllers

8-bit processors USB Keyboard, mouse

© Jakob Engblom

Page 30: - 1 - Embedded Systems Assoc. Prof.Dr. Oğuzhan Urhan E-mail: urhano@ieee.org Resarch Interests: Image / Signal Processing and Embedded Systems.

Info

rmati

on T

ech

nolo

gy

Department of Information Technology | www.it.uu.se

If you want to play Lego mindstorms robotics kit

Standard controller 8-bit processor 64 kB of memory

Electronics to interface to motors and sensors

Good way to learn embedded systems

© Jakob Engblom

Page 31: - 1 - Embedded Systems Assoc. Prof.Dr. Oğuzhan Urhan E-mail: urhano@ieee.org Resarch Interests: Image / Signal Processing and Embedded Systems.

- 31 -

Concept of ES Education

Provides motivation and context of other work in the area Mix of students and courses from CS and EE departments

Provides motivation and context of other work in the area Mix of students and courses from CS and EE departments

programmingprogramming algorithmsalgorithms computerorganization

computerorganization

matheducation

matheducation

electrical networks& digital circuits

electrical networks& digital circuits

first courseon embedded systemsfirst courseon embedded systems

lablab

controlsystems

controlsystems

DSPDSP machine vision

machine vision

real-timesystems

real-timesystems

project group

project group

applicationsapplications …

Page 32: - 1 - Embedded Systems Assoc. Prof.Dr. Oğuzhan Urhan E-mail: urhano@ieee.org Resarch Interests: Image / Signal Processing and Embedded Systems.

- 32 -

Growing importance of embedded systems (1)

Growing economical importance of embedded systemsTHE growing market according to forecasts, e.g.:

• Worldwide mobile phone sales surpassed 156.4 mln units in Q2 2004, a 35% increase from Q2 2003, according to Gartner [www.itfacts.biz]

• The worldwide portable flash player market exploded in 2003 and is expected to grow from 12.5 mln units in 2003 to over 50 mln units in 2008 [www.itfacts.biz]

• Global 3G subscribers will grow from an estimated 45 mln at the end of 2004 to 85 mln in 2005, according to Wireless World Forum. [www.itfacts.biz]

Growing economical importance of embedded systemsTHE growing market according to forecasts, e.g.:

• Worldwide mobile phone sales surpassed 156.4 mln units in Q2 2004, a 35% increase from Q2 2003, according to Gartner [www.itfacts.biz]

• The worldwide portable flash player market exploded in 2003 and is expected to grow from 12.5 mln units in 2003 to over 50 mln units in 2008 [www.itfacts.biz]

• Global 3G subscribers will grow from an estimated 45 mln at the end of 2004 to 85 mln in 2005, according to Wireless World Forum. [www.itfacts.biz]

1.3 … importance

Page 33: - 1 - Embedded Systems Assoc. Prof.Dr. Oğuzhan Urhan E-mail: urhano@ieee.org Resarch Interests: Image / Signal Processing and Embedded Systems.

- 33 -

Growing importance of embedded systems (2)

• The number of broadband lines worldwide increased by almost 55% to over 123 mln in the 12 months to the end of June 2004, according to Point-Topic. [www.itfacts.biz]

• Today's DVR (digital video recorders) users - 5% of households - will grow to 41% within five years, according to Forrester. [www.itfacts.biz]

• The automotive sector … ensures the employment of more than 4 million people in Europe. Altogether, some 8 million jobs in total depend on the fortunes of the transport industry and related sectors - representing around 7 per cent of the European Union’s Gross National Product (GNP) [OMI bulletin]

• The number of broadband lines worldwide increased by almost 55% to over 123 mln in the 12 months to the end of June 2004, according to Point-Topic. [www.itfacts.biz]

• Today's DVR (digital video recorders) users - 5% of households - will grow to 41% within five years, according to Forrester. [www.itfacts.biz]

• The automotive sector … ensures the employment of more than 4 million people in Europe. Altogether, some 8 million jobs in total depend on the fortunes of the transport industry and related sectors - representing around 7 per cent of the European Union’s Gross National Product (GNP) [OMI bulletin]

Page 34: - 1 - Embedded Systems Assoc. Prof.Dr. Oğuzhan Urhan E-mail: urhano@ieee.org Resarch Interests: Image / Signal Processing and Embedded Systems.

- 34 -

Growing importance of embedded systems (3)

• .. but embedded chips form the backbone of the electronics driven world in which we live ... they are part of almost everything that runs on electricity[Mary Ryan, EEDesign, 1995]

• 79% of all high-end processors are used in embedded systems

The future is embedded, Embedded is the future!Foundation for the „post PC era“ES hardly discussed in other CS and EE courses

• .. but embedded chips form the backbone of the electronics driven world in which we live ... they are part of almost everything that runs on electricity[Mary Ryan, EEDesign, 1995]

• 79% of all high-end processors are used in embedded systems

The future is embedded, Embedded is the future!Foundation for the „post PC era“ES hardly discussed in other CS and EE courses

1.3 … importance

Page 35: - 1 - Embedded Systems Assoc. Prof.Dr. Oğuzhan Urhan E-mail: urhano@ieee.org Resarch Interests: Image / Signal Processing and Embedded Systems.

- 35 -

Characteristics of Embedded Systems (1)

Must be dependable,• Reliability R(t) = probability of system working

correctly provided that is was working at t=0• Maintainability M(d) = probability of system working

correctly d time units after error occurred.• Availability A(t): probability of system working at time t• Safety: no harm to be caused• Security: confidential and authentic communication

Even perfectly designed systems can fail if the assumptions about the workload and possible errors turn out to be wrong.Making the system dependable must not be an after-thought, it must be considered from the very beginning

Must be dependable,• Reliability R(t) = probability of system working

correctly provided that is was working at t=0• Maintainability M(d) = probability of system working

correctly d time units after error occurred.• Availability A(t): probability of system working at time t• Safety: no harm to be caused• Security: confidential and authentic communication

Even perfectly designed systems can fail if the assumptions about the workload and possible errors turn out to be wrong.Making the system dependable must not be an after-thought, it must be considered from the very beginning

1.1 terms and scope

Page 36: - 1 - Embedded Systems Assoc. Prof.Dr. Oğuzhan Urhan E-mail: urhano@ieee.org Resarch Interests: Image / Signal Processing and Embedded Systems.

- 36 -

Characteristics of Embedded Systems (2)

Must be efficient

– Energy efficient

– Code-size efficient(especially for systems on a chip)

– Run-time efficient

– Weight efficient

– Cost efficient Dedicated towards a certain application

Knowledge about behavior at design time can be used to minimize resources and to maximize robustness

Dedicated user interface(no mouse, keyboard and screen)

Must be efficient

– Energy efficient

– Code-size efficient(especially for systems on a chip)

– Run-time efficient

– Weight efficient

– Cost efficient Dedicated towards a certain application

Knowledge about behavior at design time can be used to minimize resources and to maximize robustness

Dedicated user interface(no mouse, keyboard and screen)

Page 37: - 1 - Embedded Systems Assoc. Prof.Dr. Oğuzhan Urhan E-mail: urhano@ieee.org Resarch Interests: Image / Signal Processing and Embedded Systems.

- 37 -

Processor Technology

Desired functionality

Single-purpose processor

Application-specific processor

General-purpose processor

Page 38: - 1 - Embedded Systems Assoc. Prof.Dr. Oğuzhan Urhan E-mail: urhano@ieee.org Resarch Interests: Image / Signal Processing and Embedded Systems.

- 38 -

General-purpose processors

IR PC

Registerfile

GeneralALU

DatapathController

Program memory

Assembly code for:

total = 0 for i =1 to …

Control logic and

State register

Datamemory

Programmable device used in a variety of applications

Also known as “microprocessor”

Features

Program memory

General datapath with large register file and general ALU

User benefits

Low time-to-market and NRE costs

High flexibility

“Pentium” the most well-known, but there are hundreds of others

Programmable device used in a variety of applications

Also known as “microprocessor”

Features

Program memory

General datapath with large register file and general ALU

User benefits

Low time-to-market and NRE costs

High flexibility

“Pentium” the most well-known, but there are hundreds of others

Page 39: - 1 - Embedded Systems Assoc. Prof.Dr. Oğuzhan Urhan E-mail: urhano@ieee.org Resarch Interests: Image / Signal Processing and Embedded Systems.

- 39 -

Single-purpose processors

Digital circuit designed to execute exactly one program

a.k.a. coprocessor, accelerator or peripheral

Features

Contains only the components needed to execute a single program

No program memory

Benefits

Fast

Low power

Small size

DatapathController

Control logic

State register

Datamemory

index

total

+

Page 40: - 1 - Embedded Systems Assoc. Prof.Dr. Oğuzhan Urhan E-mail: urhano@ieee.org Resarch Interests: Image / Signal Processing and Embedded Systems.

- 40 -

Application-specific processors

IR PC

Registers

CustomALU

DatapathController

Program memory

Assembly code for:

total = 0 for i =1 to …

Control logic and

State register

Datamemory

Programmable processor optimized for a particular class of applications having common characteristics

Compromise between general-purpose and single-purpose processors

Features

Program memory

Optimized datapath

Special functional units

Benefits

Some flexibility, good performance, size and power

Programmable processor optimized for a particular class of applications having common characteristics

Compromise between general-purpose and single-purpose processors

Features

Program memory

Optimized datapath

Special functional units

Benefits

Some flexibility, good performance, size and power

Page 41: - 1 - Embedded Systems Assoc. Prof.Dr. Oğuzhan Urhan E-mail: urhano@ieee.org Resarch Interests: Image / Signal Processing and Embedded Systems.

- 41 -

Job Opportunities

Page 42: - 1 - Embedded Systems Assoc. Prof.Dr. Oğuzhan Urhan E-mail: urhano@ieee.org Resarch Interests: Image / Signal Processing and Embedded Systems.

- 42 -

Job Opportunities

Page 43: - 1 - Embedded Systems Assoc. Prof.Dr. Oğuzhan Urhan E-mail: urhano@ieee.org Resarch Interests: Image / Signal Processing and Embedded Systems.

- 43 -

Job Opportunities

Page 44: - 1 - Embedded Systems Assoc. Prof.Dr. Oğuzhan Urhan E-mail: urhano@ieee.org Resarch Interests: Image / Signal Processing and Embedded Systems.

- 44 -

Job Opportunities

Page 45: - 1 - Embedded Systems Assoc. Prof.Dr. Oğuzhan Urhan E-mail: urhano@ieee.org Resarch Interests: Image / Signal Processing and Embedded Systems.

- 45 -

Job Opportunities