Vlad Estivill-Castro (2016)vladestivill-castro.net/teaching/robotics.d/... · Vlad Estivill-Castro...

22
1 Vlad Estivill-Castro (2016) Robots for People --- A project for intelligent integrated systems

Transcript of Vlad Estivill-Castro (2016)vladestivill-castro.net/teaching/robotics.d/... · Vlad Estivill-Castro...

Page 1: Vlad Estivill-Castro (2016)vladestivill-castro.net/teaching/robotics.d/... · Vlad Estivill-Castro (2016) Robots for People--- A project for intelligent integrated systems. IIIS What

1

Vlad Estivill-Castro (2016)Robots for People

--- A project for intelligent integrated systems

Page 2: Vlad Estivill-Castro (2016)vladestivill-castro.net/teaching/robotics.d/... · Vlad Estivill-Castro (2016) Robots for People--- A project for intelligent integrated systems. IIIS What

IIIS

What is the courseabout?

◗ textbook◗ Introduction to Autonomous Mobile

Robots

◗ second editionRoland Siegwart, Illah R. Nourbakhsh, and Davide Scaramuzza

© V. Estivill-Castro 2

Page 3: Vlad Estivill-Castro (2016)vladestivill-castro.net/teaching/robotics.d/... · Vlad Estivill-Castro (2016) Robots for People--- A project for intelligent integrated systems. IIIS What

IIIS

The three key questions in Mobile Robotics ◗ Where am I ?◗ Where am I going ?◗ How do I get there ?

• To answer these questions the robot has• to have a model of the environment (given or

autonomously built)• perceive and analyze the environment• find its position/situation within the environment• plan and execute the movement

© V. Estivill-Castro 3

Page 4: Vlad Estivill-Castro (2016)vladestivill-castro.net/teaching/robotics.d/... · Vlad Estivill-Castro (2016) Robots for People--- A project for intelligent integrated systems. IIIS What

IIIS

This course will deal with Locomotion and Navigation◗ Perception ◗ Localization and Mapping ◗ Planning◗ Motion Generation

© V. Estivill-Castro 4

Page 5: Vlad Estivill-Castro (2016)vladestivill-castro.net/teaching/robotics.d/... · Vlad Estivill-Castro (2016) Robots for People--- A project for intelligent integrated systems. IIIS What

IIIS

Course Content◗ Introduction◗ Locomotion (little)◗ Mobile Robot Kinematics◗ Perception◗ Mobile Robot Localization and Mapping◗ Planning and Navigation

◗ - a spin to useful techniques for Humanoid Robots, RoboCup, Nao

© V. Estivill-Castro 5

Page 6: Vlad Estivill-Castro (2016)vladestivill-castro.net/teaching/robotics.d/... · Vlad Estivill-Castro (2016) Robots for People--- A project for intelligent integrated systems. IIIS What

IIIS

General Control Scheme for Mobile Robot Systems◗ (Roland Siegwart, Illah Nourbakhsh, Davide Scaramuzza )

© V. Estivill-Castro 6

Real WorldEnvironment

Sensing

InformationExtraction

LocalizationMap Building

Perc

eptio

n

CognitionPath Planning

Acting

PathExecution

Mot

or C

ontro

l

Raw data

“position”Global Map

map

Actuator Commands

Environment ModelLocal Map

MissionCommands

KnowledgeData Base

Page 7: Vlad Estivill-Castro (2016)vladestivill-castro.net/teaching/robotics.d/... · Vlad Estivill-Castro (2016) Robots for People--- A project for intelligent integrated systems. IIIS What

IIIS

Control loop◗ dynamically changing◗ no compact model available◗ many sources of uncertainties

© V. Estivill-Castro 7

Real WorldEnvironment

Sensing

InformationExtraction

LocalizationMap Building

Perc

eptio

n

CognitionPath Planning

Acting

PathExecution

Mot

or C

ontro

l

Raw data

“position”Global Map

map

Actuator Commands

Environment ModelLocal Map

MissionCommands

KnowledgeData Base

Page 8: Vlad Estivill-Castro (2016)vladestivill-castro.net/teaching/robotics.d/... · Vlad Estivill-Castro (2016) Robots for People--- A project for intelligent integrated systems. IIIS What

IIIS

Two approaches◗ Classical AI

• complete modeling• function based

◗ New AI• sparse or no model• behavior based

◗ Solution• combine approaches

© V. Estivill-Castro 8

LocalizationMap Building

Perception

CognitionPath Planning

Motor Control

sensors

actuators

LocalizationMap Building

Perception

CognitionPath Planning

Motor Control

sensors

actuators

Page 9: Vlad Estivill-Castro (2016)vladestivill-castro.net/teaching/robotics.d/... · Vlad Estivill-Castro (2016) Robots for People--- A project for intelligent integrated systems. IIIS What

IIIS

The Key for Autonomous Navigation◗ Environment Representation

• continuous metric -> x, y Θ• Discrete metric -> metric grid• Discrete Topological-> topological grid

◗ Environment Modeling• Raw sensor data

• large volume, low distinctiveness• Low level features

• medium volume of data, some distinctiveness• High level features

• low volume data high distinctiveness

© V. Estivill-Castro 9

Page 10: Vlad Estivill-Castro (2016)vladestivill-castro.net/teaching/robotics.d/... · Vlad Estivill-Castro (2016) Robots for People--- A project for intelligent integrated systems. IIIS What

IIIS

Environment representation◗ Odometry

• follow directions/commands like Navigator• follow a treasure

◗ Modified Environments• very specific/encoded information

◗ Feature based• Landmarks, Affordances of the environment

© V. Estivill-Castro 10

Page 11: Vlad Estivill-Castro (2016)vladestivill-castro.net/teaching/robotics.d/... · Vlad Estivill-Castro (2016) Robots for People--- A project for intelligent integrated systems. IIIS What

IIIS

Human navigation

◗ Topological and conceptual maps• the dimensions of Australia, and what is close,

north, south• number of buildings vs name of buildings

◗ Relations at different scales

© V. Estivill-Castro 11

Page 12: Vlad Estivill-Castro (2016)vladestivill-castro.net/teaching/robotics.d/... · Vlad Estivill-Castro (2016) Robots for People--- A project for intelligent integrated systems. IIIS What

IIIS

The Map Categories1. recognizable landmarks2. topological maps (graph model)

• games like snakes and ladders

3. metric topological maps• edges have weight equal to distance

4. Full metric maps• nodes are geo-positioned

© V. Estivill-Castro 12

Page 13: Vlad Estivill-Castro (2016)vladestivill-castro.net/teaching/robotics.d/... · Vlad Estivill-Castro (2016) Robots for People--- A project for intelligent integrated systems. IIIS What

IIIS

Understanding --- Probabilistic reasoning (Bayesian inference) ◗ Reasoning in the presence of uncertainties

and incomplete information◗ Combining preliminary information and

models with learning from observed data

◗ P(A|B) = P(B|A) P(A)/P(B)• the probability that the new situation is A once

I observed B is related to the chances of noticing B when in situation A and the ratio of oberving A with the chances of observing B

© V. Estivill-Castro 13

Page 14: Vlad Estivill-Castro (2016)vladestivill-castro.net/teaching/robotics.d/... · Vlad Estivill-Castro (2016) Robots for People--- A project for intelligent integrated systems. IIIS What

IIIS

Reducing Uncertainties◗ Where can I be?

◗ Anywhere

◗ Observe a door

© V. Estivill-Castro 14

Page 15: Vlad Estivill-Castro (2016)vladestivill-castro.net/teaching/robotics.d/... · Vlad Estivill-Castro (2016) Robots for People--- A project for intelligent integrated systems. IIIS What

IIIS

Reducing Uncertainties◗ Observe a door

◗ Walk a bit

◗ Observe a door again

© V. Estivill-Castro 15

Page 16: Vlad Estivill-Castro (2016)vladestivill-castro.net/teaching/robotics.d/... · Vlad Estivill-Castro (2016) Robots for People--- A project for intelligent integrated systems. IIIS What

IIIS

Metric Navigation: Probabilistic Position Estimation (Kalman Filter)

◗ Continuous, recursive and very compact• ACT PHASE

• state prediction via a motion model– obtain x(k+1 | k) and P(k+1 | k) given x(k|k) P(k|k)

• SEE PHASE• Balance the advice of where I am (result of the

motion model) and the advice of where I am (result of the sensor)

• Depending on how much I trust each

© V. Estivill-Castro 16

Page 17: Vlad Estivill-Castro (2016)vladestivill-castro.net/teaching/robotics.d/... · Vlad Estivill-Castro (2016) Robots for People--- A project for intelligent integrated systems. IIIS What

IIIS

State prediction: odometry◗ Incrementally (dead reckoning)

• There is a discrepancy into the real trajectory and the belief of where I have been

• DRIFT• cumulative error

◗ Under no error, current position is accurate

© V. Estivill-Castro 17

Page 18: Vlad Estivill-Castro (2016)vladestivill-castro.net/teaching/robotics.d/... · Vlad Estivill-Castro (2016) Robots for People--- A project for intelligent integrated systems. IIIS What

IIIS

Methods for Localization :Quantitative Metric Approach

1. A priori, know your environment• in graph, map

2. Extract features (line segments, landmarks)3. Match them with location in map4. Estimate your position

• Kalman filter, Markov filters (particle filters)• Balance observations with your belief• issues:

• estimation of uncertainties• weights to prior statistics

© V. Estivill-Castro 18

Page 19: Vlad Estivill-Castro (2016)vladestivill-castro.net/teaching/robotics.d/... · Vlad Estivill-Castro (2016) Robots for People--- A project for intelligent integrated systems. IIIS What

IIIS

Belief Representation◗ Well known probability models

• mixture of multi-variate normal distribution

◗ Descriptive statistics• Histograms

© V. Estivill-Castro 19

Page 20: Vlad Estivill-Castro (2016)vladestivill-castro.net/teaching/robotics.d/... · Vlad Estivill-Castro (2016) Robots for People--- A project for intelligent integrated systems. IIIS What

IIIS

Probabilistic SLAM◗ Simultaneous localization and mapping

(SLAM) • first characteristic question, What does the

world look like?• second characteristic question, Where am I?

◗ The robotics community claims to have solved the SLAM problem• lots of variations on the assumptions / sensors/ motions• issues of complexity• quality

© V. Estivill-Castro 20

Page 21: Vlad Estivill-Castro (2016)vladestivill-castro.net/teaching/robotics.d/... · Vlad Estivill-Castro (2016) Robots for People--- A project for intelligent integrated systems. IIIS What

IIIS © V. Estivill-Castro 21

Summary• Mobile robotics

• the most challenging type of robotics– robots are anywhere in the world

• Many architectures, some well accepted but found insufficient, new approaches discussed

• Large body of techniques• feature extraction• sensor fusion• mapping, tracking and/or localization

Page 22: Vlad Estivill-Castro (2016)vladestivill-castro.net/teaching/robotics.d/... · Vlad Estivill-Castro (2016) Robots for People--- A project for intelligent integrated systems. IIIS What

IIIS © V. Estivill-Castro 22