Non-Euclidean manifolds in robotics and computer vision ...

Non-Euclideanmanifolds

Jose LuisBlanco Claraco

Basic concepts

Normalizedhistograms

RRT planning

PCA onmanifolds

Averaging 2Drotations

Derivativesandoptimization

The Lagrangemultipliermethod

The tangentspace method

References

Non-Euclidean manifolds inrobotics and computer vision:

why should we care?

Jose Luis Blanco Claraco

Universidad de Almerıahttp://www.ual.es/∼jlblanco/

March 18th, 2013Universidad de Zaragoza

Basic concepts

RRT planning

PCA onmanifolds

References

Short answer for the impatient

Non-Euclidean manifolds in robotics and computer vision: whyshould we care? → Because we can’t ignore the real geometryof the mathematical spaces!

“What is the distance from Madrid to Miami?”

Basic concepts

RRT planning

PCA onmanifolds

References

Contents

1 Basic concepts

2 Normalized histograms

3 RRT planning

4 PCA on manifolds

5 Averaging 2D rotations

7 Derivatives and optimizationThe Lagrange multiplier methodThe tangent space method

8 References

Basic concepts

RRT planning

PCA onmanifolds

References

Contents

1 Basic concepts

3 RRT planning

4 PCA on manifolds

8 References

Basic concepts

RRT planning

PCA onmanifolds

References

Concept: topological spaces

The topology of an object defines its “shape” in the coarsestsense: no geometric (“metric”) details.

Two objects are topologically the same if we can morph oneinto another just streching, without creating new holes(tearing) or closing existing ones.

Classic example: a coffee mug and a torus.

Basic concepts

RRT planning

PCA onmanifolds

References

Concept: topological spaces

The topology of an object defines its “shape” in the coarsestsense: no geometric (“metric”) details.

Two objects are topologically the same if we can morph oneinto another just streching, without creating new holes(tearing) or closing existing ones.

Classic example: a coffee mug and a torus.

Basic concepts

RRT planning

PCA onmanifolds

References

Topological spaces: examples

The line of real numbers R.

The infinite plane of R2.

Basic concepts

RRT planning

PCA onmanifolds

References

Topological spaces: examples

The circle S1.

The torus is the Cartesian product of two circles: S1 × S1

The sphere is the different space S2.

Basic concepts

RRT planning

PCA onmanifolds

References

Concept: What is a manifold?

An N-dimensional manifold M is a topological space whereevery point p ∈ M is endowed with local Euclidean structure.

Informally: a manifold is built by “gluing” together small piecesof RN . However, the “global” structure is not Euclidean.

Example

A sphere is a 2D manifold (surface) embedded in R3:

Basic concepts

RRT planning

PCA onmanifolds

References

Concept: manifold tangent space

The tangent space of the N-dimensional manifold M at x ∈ M canbe seen as the local Euclidean space at x . Also called the“linearization” of the manifold.

Denoted as TxM, is the vector space of all possible “velocities” of x :

Basic concepts

RRT planning

PCA onmanifolds

References

Concept: manifold tangent space

The tangent space of the N-dimensional manifold M at x ∈ M canbe seen as the local Euclidean space at x . Also called the“linearization” of the manifold.

Denoted as TxM, is the vector space of all possible “velocities” of x :

Basic concepts

RRT planning

PCA onmanifolds

References

Concept: Lie group

A Lie group is a (non-empty) subset G of RN that fulfills:

1 G is a group.

2 G is a manifold in RN .

3 Both, the group product operation (· : G 7→ G ) and itsinverse (·−1 : G 7→ G ) are smooth functions.

Matrix Lie groups

1 Lie groups of our interest are matrix spaces.

2 A theorem due to Von Newman and Cartan [Bla10]:

A closed subgroup G of GL(N,R) is a linear Liegroup → is also a smooth manifold in RN2

Basic concepts

RRT planning

PCA onmanifolds

References

Concept: Lie group

A Lie group is a (non-empty) subset G of RN that fulfills:

1 G is a group.

2 G is a manifold in RN .

3 Both, the group product operation (· : G 7→ G ) and itsinverse (·−1 : G 7→ G ) are smooth functions.

Matrix Lie groups

1 Lie groups of our interest are matrix spaces.

2 A theorem due to Von Newman and Cartan [Bla10]:

A closed subgroup G of GL(N,R) is a linear Liegroup → is also a smooth manifold in RN2

Basic concepts

RRT planning

PCA onmanifolds

References

Concept: Lie algebra

For any Lie group, its Lie algebra m is the set of base vectorsof its tangent space at the identity I: m = TIM

Basic concepts

RRT planning

PCA onmanifolds

References

Concept: Lie algebra

For any Lie group, its Lie algebra m is the set of base vectorsof its tangent space at the identity I: m = TIM

Basic concepts

RRT planning

PCA onmanifolds

References

An example: the Lie group SE(3) (I)

SE(3) is the group of all 4× 4 matrices for rigid translations + rotations:

SE(3) =

∣∣∣∣∣∣∣∣M =

R3×3 yz

0 0 0 1

,with R3×3 ∈ SO(3)

Basic concepts

RRT planning

PCA onmanifolds

References

SE(3) =

∣∣∣∣∣∣∣∣M =

R3×3 yz

0 0 0 1

,with R3×3 ∈ SO(3)

Basic concepts

RRT planning

PCA onmanifolds

References

SE(3) =

∣∣∣∣∣∣∣∣M =

R3×3 yz

0 0 0 1

,with R3×3 ∈ SO(3)

Clarifying the number of dimensions

Environment space dimensions = 4× 4 = 16

Manifold dimensions = 6 (DOFs)

Basic concepts

RRT planning

PCA onmanifolds

References

SE(3) =

∣∣∣∣∣∣∣∣M =

R3×3 yz

0 0 0 1

,with R3×3 ∈ SO(3)

Its Lie algebra se(3) is a vector base, whose elements are 6 matrices:

Gse(3)1 =

0 0 0 00 0 −1 00 1 0 00 0 0 0

Gse(3)2 =

0 0 1 00 0 0 0−1 0 0 00 0 0 0

Gse(3)3 =

0 −1 0 01 0 0 00 0 0 00 0 0 0

Gse(3)4 =

0 0 0 10 0 0 00 0 0 00 0 0 0

Gse(3)5 =

0 0 0 00 0 0 10 0 0 00 0 0 0

Gse(3)6 =

0 0 0 00 0 0 00 0 0 10 0 0 0

Basic concepts

RRT planning

PCA onmanifolds

References

An example: the Lie group SE(3) (II)

OK, but... WHY? Where do those skew symmetric matrices come from?!

Remember: Lie algebra is a vector base (“matrix base”, actually) of the tangentspace, which is the space of all possible “velocities” on the manifold.

Take derivatives of the transformation matrix with respect to x , y , z, yaw φ, pitchχ and roll ψ at the identity and you’re there!

R(φ, χ, ψ) = Rz (φ)Ry (χ)Rx (ψ)

cosφ cosχ cosφ sinχ sinψ − sinφ cosψ cosφ sinχ cosψ + sinφ sinψsinφ cosχ sinφ sinχ sinψ + cosφ cosψ sinφ sinχ cosψ − cosφ sinψ− sinχ cosχ sinψ cosχ cosψ

∣∣∣∣φ=0,χ=0,ψ=0

0 −1 01 0 00 0 0

Basic concepts

RRT planning

PCA onmanifolds

References

∣∣∣∣φ=0,χ=0,ψ=0

0 −1 01 0 00 0 0

Basic concepts

RRT planning

PCA onmanifolds

References

∣∣∣∣φ=0,χ=0,ψ=0

0 −1 01 0 00 0 0

Basic concepts

RRT planning

PCA onmanifolds

References

Concept: Charts

A chart is the bijective parameterization of (part of) aN-dimensional manifold into RN . They enable doing calculus(e.g. derivatives) on manifolds.Example: two overlapping charts of a double torus:

(Image credits: [GHQ06])

Basic concepts

RRT planning

PCA onmanifolds

References

Concept: Charts

A chart is the bijective parameterization of (part of) aN-dimensional manifold into RN . They enable doing calculus(e.g. derivatives) on manifolds.Example: two overlapping charts of a double torus:

Basic concepts

RRT planning

PCA onmanifolds

References

Concept: Atlas

An atlas is a collection of charts that covers the entiremanifold – nomenclature as in “real-world” Cartography!.

Basic concepts

RRT planning

PCA onmanifolds

References

Concept: Exponential & logarithm maps

Maps for a Lie group M

Exponential map: A map from the local tangent space Tx M → themanifold M.

Logarithm map: Inverse map, from the manifold M → Tx M .

Note: The projections of Lie algebra’s vector base through the exponential aretangent to the geodesics on the manifold at x .

(Image credits: [Lui12])

Basic concepts

RRT planning

PCA onmanifolds

References

Contents

1 Basic concepts

3 RRT planning

4 PCA on manifolds

8 References

Basic concepts

RRT planning

PCA onmanifolds

References

Normalized histograms

Topology

If x ∈ RM+ is a normalized histogram, the set of all of them:

PM−1 =

{x1, ..., xM

∣∣∣∣∣M∑

xm = 1, xm ≥ 0

is the simplex PM−1, a manifold with corners.

Basic concepts

RRT planning

PCA onmanifolds

References

How are distances defined over normalized histograms

Geodesics are good-old straight lines! → L1, L2 normsand alike are OK.

But... from machine learning there is much more to say:learning significative χ2 distances, etc. [AS11].

Optimizing / derivatives over histograms?

Here, the topology does matter. Let’s see it graphically...

Basic concepts

RRT planning

PCA onmanifolds

References

How are distances defined over normalized histograms

Geodesics are good-old straight lines! → L1, L2 normsand alike are OK.

But... from machine learning there is much more to say:learning significative χ2 distances, etc. [AS11].

Optimizing / derivatives over histograms?

Here, the topology does matter. Let’s see it graphically...

Basic concepts

RRT planning

PCA onmanifolds

References

Normalized histograms: M=2

For M=2, (x1, x2), we have a 1-simplex (a segment):

0 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 10

Basic concepts

RRT planning

PCA onmanifolds

References

For M=3, (x1, x2, x3), we have a 2-simplex (a triangle):

Basic concepts

RRT planning

PCA onmanifolds

References

The Jacobian for some targetfunction f:

d{x1, x2, x3}=

]may give us a gradient direction/∈ the manifold.

We’ll see how to properly dealwith optimizations on manifoldsin a few minutes...

Basic concepts

RRT planning

PCA onmanifolds

References

Contents

1 Basic concepts

3 RRT planning

4 PCA on manifolds

8 References

Basic concepts

RRT planning

PCA onmanifolds

References

Sampling for Rapidly-Exploring Random Trees(RRTs)

A graph can be built to represent the topology of the atlas(remember: atlas=collection of charts) ofkinematically-constrained problems:

Basic concepts

RRT planning

PCA onmanifolds

References

Contents

1 Basic concepts

3 RRT planning

4 PCA on manifolds

8 References

Basic concepts

RRT planning

PCA onmanifolds

References

Principal Component Analysis (PCA)

The standard PCA method:

Given a set of N-dimensional samples, determine the qdirections of “principal variation“.

It can be solved by finding the eigenvectors of the covariance ofdata points, and keeping those with the q largest eigenvalues.

It works fine for Euclidean spaces, but couldn’t handle non-linearmanifolds:

Works OK Does not Does not(Image credits: [Ihl03])

Basic concepts

RRT planning

PCA onmanifolds

References

Principal Component Analysis (PCA)

The standard PCA method:

Given a set of N-dimensional samples, determine the qdirections of “principal variation“.

It can be solved by finding the eigenvectors of the covariance ofdata points, and keeping those with the q largest eigenvalues.

It works fine for Euclidean spaces, but couldn’t handle non-linearmanifolds:

Works OK Does not Does not(Image credits: [Ihl03])

Basic concepts

RRT planning

PCA onmanifolds

References

PCA on manifolds

The key difference

In PCA we want to maximize the variance of the largestcomponents → an implicit metric for distances (Euclideannorm).

On manifolds, distances → distances along geodesics.

Use methods like IsoMap [TdSL00], to ”unroll“ manifolds:

(Image credits: [Ihl03])

Basic concepts

RRT planning

PCA onmanifolds

References

PCA on manifolds

The key difference

In PCA we want to maximize the variance of the largestcomponents → an implicit metric for distances (Euclideannorm).

On manifolds, distances → distances along geodesics.

Use methods like IsoMap [TdSL00], to ”unroll“ manifolds:

(Image credits: [Ihl03])

Basic concepts

RRT planning

PCA onmanifolds

References

Contents

1 Basic concepts

3 RRT planning

4 PCA on manifolds

8 References

Basic concepts

RRT planning

PCA onmanifolds

References

Averaging in SO(2)

Motivation

We may need to average, for example:

Orientations of image gradients, blob-like features, etc.

Estimating the most-likely heading from a set of particlesin Monte-Carlo localization.

(Image credits: [XHJF12])

Basic concepts

RRT planning

PCA onmanifolds

References

Averaging in SO(2)

The Special Orthogonal Group in 2D: SO(2)

From all 2× 2 invertible matrices GL(2), only a fewrepresent rigid, pure rotations in the 2D plane.

Orthonormal matrices R =

(a cb d

)→ we need two

numbers to unequivocally define a rotation, since(a, b) · (c , d) = 0 (and |R| > 0)⇒ (c, d) = (−b, a), so:

R(a, b) =

(a −bb a

Basic concepts

RRT planning

PCA onmanifolds

References

Averaging in SO(2)

From all 2× 2 invertible matrices GL(2), only a fewrepresent rigid, pure rotations in the 2D plane.

Orthonormal matrices R =

(a cb d

)→ we need two

numbers to unequivocally define a rotation, since(a, b) · (c , d) = 0 (and |R| > 0)⇒ (c, d) = (−b, a), so:

R(a, b) =

(a −bb a

Basic concepts

RRT planning

PCA onmanifolds

References

Averaging in SO(2)

This group of matrices is isomorphic to S1: a circle, with 1DOF:

R(φ) =

(cosφ − sinφsinφ cosφ

→ SO(2) =

{A manifold with 1 DOF,but needs 2 different numbers for representing!

Think it this way: there is no way to map S1 to a segment ofR1 and preserve the circular topology.

Basic concepts

RRT planning

PCA onmanifolds

References

Averaging in SO(2)

This group of matrices is isomorphic to S1: a circle, with 1DOF:

R(φ) =

(cosφ − sinφsinφ cosφ

→ SO(2) =

{A manifold with 1 DOF,but needs 2 different numbers for representing!

Think it this way: there is no way to map S1 to a segment ofR1 and preserve the circular topology.

Basic concepts

RRT planning

PCA onmanifolds

References

Example 1

Put it clear:

Orientations in 2D︸︷︷︸A manifold with S1 topology

6= Values for the parameter φ︸︷︷︸This parameter lives in R1

Let’s see the practical implications...

Basic concepts

RRT planning

PCA onmanifolds

References

Example 1

Put it clear:

Orientations in 2D︸︷︷︸A manifold with S1 topology

6= Values for the parameter φ︸︷︷︸This parameter lives in R1

Let’s see the practical implications...

Basic concepts

RRT planning

PCA onmanifolds

References

Example 1

What is the mean orientation of 0◦ and 80◦?

−1.5 −1 −0.5 0 0.5 1 1.5

−0.8

−0.6

−0.4

−0.2

Arithmetic mean of 0◦ and 80◦ = 40◦ (the correct mean)→ Intuitive!

...but is only correct “by accident” for averages of only two values.

Basic concepts

RRT planning

PCA onmanifolds

References

Example 1

What is the mean orientation of 0◦ and 80◦?

−1.5 −1 −0.5 0 0.5 1 1.5

−0.8

−0.6

−0.4

−0.2

Arithmetic mean of 0◦ and 80◦ = 40◦ (the correct mean)→ Intuitive!...but is only correct “by accident” for averages of only two values.

Basic concepts

RRT planning

PCA onmanifolds

References

But... what is actually the mean or average of a set of values?

Common definition:

N∑i=1

It turns out that this is just a special case for Euclidean spaces!Everything depends on the metric for defining distances.

Basic concepts

RRT planning

PCA onmanifolds

References

Common definition:

N∑i=1

Basic concepts

RRT planning

PCA onmanifolds

References

Common definition:

N∑i=1

Basic concepts

RRT planning

PCA onmanifolds

References

Meaning of “mean”

A generic (invariant) definition of “mean”

Given a metric d(x, y), the average of {p1, ...,pN} is:

p = arg minp

N∑i=1

d(p− pi )2

On manifolds, distances are measured over geodesics, the“straight lines” of curved spaces.

Note: In Euclidean RM , geodesics are good-old straight lines!

Basic concepts

RRT planning

PCA onmanifolds

References

Meaning of “mean”

A generic (invariant) definition of “mean”

Given a metric d(x, y), the average of {p1, ...,pN} is:

p = arg minp

N∑i=1

d(p− pi )2

On manifolds, distances are measured over geodesics, the“straight lines” of curved spaces.

Note: In Euclidean RM , geodesics are good-old straight lines!

Basic concepts

RRT planning

PCA onmanifolds

References

Metrics for matrix spaces

The point is: distances are not measured for values of theparameter φ, but on the manifold SO(2).

A standard metric for matrix spaces → Frobenius norm:

||A||2F =∑

a2ij = tr(AA>)

Basic concepts

RRT planning

PCA onmanifolds

References

Metrics for matrix spaces

The point is: distances are not measured for values of theparameter φ, but on the manifold SO(2).

A standard metric for matrix spaces → Frobenius norm:

||A||2F =∑

a2ij = tr(AA>)

Basic concepts

RRT planning

PCA onmanifolds

References

Metrics on SO(2)

It’s clear both metrics are different for the distance betweenorientations φ1 and φ2:

Operating, one gets:

d(φ1, φ2)2F = 4 [1− cos(φ1 − φ2)]

Basic concepts

RRT planning

PCA onmanifolds

References

Metrics on SO(2)

It’s clear both metrics are different for the distance betweenorientations φ1 and φ2:

Basic concepts

RRT planning

PCA onmanifolds

References

Example 2

Let’s show this with a new example:

−1 −0.5 0 0.5 1 1.5 2

−0.5

−20.0deg

20.0deg

150.0deg

Basic concepts

RRT planning

PCA onmanifolds

References

Example 2

The (WRONG) average from arithmetic mean of φ is 50◦...

−1 −0.5 0 0.5 1 1.5 2

−0.5

−20.0deg

20.0deg

150.0deg

Arith. mean: 50.0deg

Basic concepts

RRT planning

PCA onmanifolds

References

Example 2

Instead: (1) evaluate the centroid of all 2× 2 matrices,

−1 −0.5 0 0.5 1 1.5 2

−0.5

−20.0deg

20.0deg

150.0deg

Centroid

Basic concepts

RRT planning

PCA onmanifolds

References

Example 2

and (2) project the point onto the manifold. 26.3◦ 6= 50◦!!

−1 −0.5 0 0.5 1 1.5 2

−0.5

−20.0deg

20.0deg

150.0degTrue mean: 26.3deg

Basic concepts

RRT planning

PCA onmanifolds

References

Example 2

and (2) project the point onto the manifold. 26.3◦ 6= 50◦!!

−1 −0.5 0 0.5 1 1.5 2

−0.5

−20.0deg

20.0deg

150.0degTrue mean: 26.3deg

Why the centroid of 2D points? → think of the first column inSO(2) matrices...

Basic concepts

RRT planning

PCA onmanifolds

References

Contents

1 Basic concepts

3 RRT planning

4 PCA on manifolds

8 References

Basic concepts

RRT planning

PCA onmanifolds

References

Two important manifolds

The Lie group of 3D rotations:

SO(3) ={

R ∈ GL(3,R)∣∣∣R>R = I, |R| = 1

The Lie group of 3D rigid transformations (4× 4 matrices):

SE (3) = SO(3)︸︷︷︸Rotation

× R3︸︷︷︸Translation

Basic concepts

RRT planning

PCA onmanifolds

References

The meaning of mean (once more)

Means and metrics

The variational definition of mean involves a definition ofdistances on the manifold:

p = arg minp

N∑i=1

d(p− pi )2

Advantage wrt the x = 1N

∑Ni=1 xi definition: it is invariant.

The notion of “mean” is not obvious for manifolds andthere exist as many different “means” as metrics.

Basic concepts

RRT planning

PCA onmanifolds

References

The meaning of mean (once more)

Means and metrics

The variational definition of mean involves a definition ofdistances on the manifold:

p = arg minp

N∑i=1

d(p− pi )2

Advantage wrt the x = 1N

∑Ni=1 xi definition: it is invariant.

The notion of “mean” is not obvious for manifolds andthere exist as many different “means” as metrics.

Basic concepts

RRT planning

PCA onmanifolds

References

Two means for SO(3)

(1) Euclidean mean

Using the Frobenius norm:dF (R− Ri ) = ||R− Ri ||F = tr(R>Ri )

Can be shown to be equivalent to the previous 2D example: (1)“centroid” of SO(3) matrices, then (2) project to SO(3) – e.g.doable via Singular Value Decomposition (SVD).

(2) Riemannian mean

Using the Riemannian distance dR (R− Ri ) = 1√2|| log(R>Ri )||F

It stands for the length of the shortest geodesic between twomatrices.

(See [Moa02] for more details and closed-form formulas)

Basic concepts

RRT planning

PCA onmanifolds

References

Two means for SO(3)

(1) Euclidean mean

(2) Riemannian mean

Basic concepts

RRT planning

PCA onmanifolds

References

Two means for SO(3)

(1) Euclidean mean

(2) Riemannian mean

Basic concepts

RRT planning

PCA onmanifolds

References

What about SE(3)?

Unlike for SO(3), there exists no bi-invariant metric inSE(3)

Still, good metrics for computing means exist: [SWR10]

Basic concepts

RRT planning

PCA onmanifolds

References

Contents

1 Basic concepts

3 RRT planning

4 PCA on manifolds

8 References

Basic concepts

RRT planning

PCA onmanifolds

References

Independent vs. dependent coordinates

Problem

Integrate or minimize:f (q)

for q ∈ Rn, restricted to q ∈ M , with M an m-dimensionalmanifold (m < n), defined as Φ(q) = 0.

Coordinates

Dependent coordinates (dims=n): q.

Independent coordinates (dims=m < n):z ∈ TxM.

Basic concepts

RRT planning

PCA onmanifolds

References

(1) The Lagrange multiplier method

Augmented problem with n −m new unknowns λ (Lagrangemultipliers):

f (q)Φ(q) = 0

}→ f (q) +

∂Φ(q)

Basic concepts

RRT planning

PCA onmanifolds

References

f (q)Φ(q) = 0

}→ f (q) +

∂Φ(q)

>λ︸︷︷︸

This should be zero

Idea: Lagrange multipliers can always be found that make thesecond term vanish.

Basic concepts

RRT planning

PCA onmanifolds

References

f (q)Φ(q) = 0

}→ f (q) +

∂Φ(q)

>λ︸︷︷︸

This should be zero

Idea: Lagrange multipliers can always be found that make thesecond term vanish.This method is widely-used in dynamical simulations ofkinematically-constrained robots, mechanisms, etc.

Basic concepts

RRT planning

PCA onmanifolds

References

(2) The tangent space method

Basic idea

Replace “global” optimizations with local solutions on thetangent space.

Basic concepts

RRT planning

PCA onmanifolds

References

Least-squares optimization

δ?k ←∂F (xk−1 + δk )

∂δk

∣∣∣∣δk

= 0 ⇒ xk ← xk−1 + δ?k

where δ ∈ ambient space, “+” is the standard Euclidean addition.

On-manifold least-squares

ε?k ←∂F (xk−1 � εk )

∂εk

∣∣∣∣ε=0

= 0 ⇒ xk ← xk−1 � ε?k

where ε ∈ manifold, � the Lie group operation (i.e. matrixmultiplication)

Basic concepts

RRT planning

PCA onmanifolds

References

Least-squares optimization

δ?k ←∂F (xk−1 + δk )

∂δk

∣∣∣∣δk

= 0 ⇒ xk ← xk−1 + δ?k

where δ ∈ ambient space, “+” is the standard Euclidean addition.

On-manifold least-squares

ε?k ←∂F (xk−1 � εk )

∂εk

∣∣∣∣ε=0

= 0 ⇒ xk ← xk−1 � ε?k

where ε ∈ manifold, � the Lie group operation (i.e. matrixmultiplication)

Basic concepts

RRT planning

PCA onmanifolds

References

Example:

Given an observation model h(p) for p ∈ R3 the relative location of alandmark, in SLAM we find:

h(p) = h(L x) →{

L ∈ R3 : landmark coordinates,x ∈ SE (3) : camera pose.

During optimization, we find the Jacobian:

∂h(L (x + ∆x ))

∂∆x(Euclidean)

∂h(L (x⊕ ε))

∂ε(On-manifold SE(3))

Trick: Apply the chain rule representing poses and points ashomogeneous 4× 4 matrices → compositions become matrixmultiplications → simple Jacobians!!

Basic concepts

RRT planning

PCA onmanifolds

References

Example:

h(p) = h(L x) →{

∂h(L (x + ∆x ))

∂∆x(Euclidean)

∂h(L (x⊕ ε))

Basic concepts

RRT planning

PCA onmanifolds

References

Example:

h(p) = h(L x) →{

∂h(L (x + ∆x ))

∂∆x(Euclidean)

∂h(L (x⊕ ε))

Basic concepts

RRT planning

PCA onmanifolds

References

Example:

h(p) = h(L x) →{

∂h(L (x + ∆x ))

∂∆x(Euclidean)

∂h(L (x⊕ ε))

Basic concepts

RRT planning

PCA onmanifolds

References

Historical remarks

∼1820?: Could be traced to Gauss’ works on survey

1994: Taylor & Kriegman proposal for SO(3) [TK94]

(Re?–)Introduction in the SLAM community (AFAIK):

2006: Mentioned in a German work by Udo Frese et al.[FSH+].2008: First work in English is [Her08], a Bachelor’s thesisby Christoph Hertzberg, adviced by Udo Frese.

Basic concepts

RRT planning

PCA onmanifolds

References

Historical remarks

∼1820?: Could be traced to Gauss’ works on survey

1994: Taylor & Kriegman proposal for SO(3) [TK94]

(Re?–)Introduction in the SLAM community (AFAIK):

2006: Mentioned in a German work by Udo Frese et al.[FSH+].2008: First work in English is [Her08], a Bachelor’s thesisby Christoph Hertzberg, adviced by Udo Frese.

Basic concepts

RRT planning

PCA onmanifolds

References

Applications to EKF

Applicability

Has been introduced in graph-SLAM, but is a general framework!

Motivation

EKF with quaternions has been quite common and successful in visualSLAM.

but the filter does not respect the normalization of the quaternion → needto renormalize after each step.

In theory, it’s sub-optimal (though, I haven’t tested this numerically!)

EKF with on-manifold derivatives

Required changes:

Choose a parameterization (quaternion is OK here!)

Replace all Jacobians ( ∂·∂∆x→ ∂·

∂ε)

Use manifold Jacobian to update the EKF mean,

Apply chain rule to get the correct Jacobian that updates the covariance inparameterization space, not the manifold.

See detailed formulas, etc. [Bla10, FMB12]

Basic concepts

RRT planning

PCA onmanifolds

References

Applications to EKF

Motivation

Required changes:

∂ε)

Basic concepts

RRT planning

PCA onmanifolds

References

Applications to EKF

Motivation

Required changes:

∂ε)

Basic concepts

RRT planning

PCA onmanifolds

References

Applications to EKF

Motivation

Required changes:

∂ε)

Basic concepts

RRT planning

PCA onmanifolds

References

Contents

1 Basic concepts

3 RRT planning

4 PCA on manifolds

8 References

Basic concepts

RRT planning

PCA onmanifolds

References

References I

Vitaly Ablavsky and Stan Sclaroff, Learning parameterized histogram kernelson the simplex manifold for image and action classification, ComputerVision (ICCV), 2011 IEEE International Conference on, IEEE, 2011,pp. 1473–1480.

Jose-Luis Blanco, A tutorial on se (3) transformation parameterizations andon-manifold optimization, Tech. report, Technical report, University ofMalaga, 2010.

Juan-Antonio Fernandez-Madrigal and Jose-Luis Blanco, Simultaneouslocalization and mapping for mobile robots: Introduction and methods, IGIGlobal, sep 2012.

Udo Frese, Lutz Schroder, Christoph Hertzberg, Janosch Machowinski, andRene Wagner, Theorie der sensorfusion.

Xianfeng Gu, Ying He, and Hong Qin, Manifold splines, Graphical Models68 (2006), no. 3, 237–254.

Christoph Hertzberg, A framework for sparse, non-linear least squaresproblems on manifolds, 2008.

A. Ihler, Nonlinear Manifolds Learning (Part one), Tech. report, MIT, 2003.

Basic concepts

RRT planning

PCA onmanifolds

References

References II

Yui Man Lui, Advances in matrix manifolds for computer vision, Image andVision Computing 30 (2012), no. 6, 380–388.

Maher Moakher, Means and averaging in the group of rotations, SIAMjournal on matrix analysis and applications 24 (2002), no. 1, 1–16.

Inna Sharf, Alon Wolf, and M.B. Rubin, Arithmetic and geometric solutionsfor average rigid-body rotation, Mechanism and Machine Theory (2010).

Tenenbaum, de Silva, and Langford, Isomap, 2000.

Camillo J Taylor and David J Kriegman, Minimization on the lie group so(3) and related manifolds, Yale University (1994).

Yong Xu, Sibin Huang, Hui Ji, and Cornelia Fermuller, Scale-space texturedescription on sift-like textons, Computer Vision and Image Understanding(2012).

Basic concepts

RRT planning

PCA onmanifolds

References

Non-Euclidean manifolds inrobotics and computer vision:

why should we care?

Jose Luis Blanco Claraco

Universidad de Almerıahttp://www.ual.es/∼jlblanco/

March 18th, 2013Universidad de Zaragoza

Thank you for your attention!

Non-Euclidean manifolds in robotics and computer vision ...

Documents

Transcript of Non-Euclidean manifolds in robotics and computer vision ...

Isometric Embedding of Riemannian Manifolds in Euclidean ...isometric embedding of Riemannian manifolds in Euclidean spaces; these include the Janet-Cartan Theorem and Nash Embedding

Ryan Euclidean and Non-Euclidean

10 Advanced Euclidean Geometry - UNC Charlottemath2.uncc.edu/~frothe/3181alleuclid1_10.pdf · 10 Advanced Euclidean Geometry 10.1 A Euclidean egg Figure 10.1: How the Euclidean egg

Euclidean versus Non-Euclidean Geometry - Wikispacesversus+Non... · Euclidean versus Non-Euclidean Geometry ... Compare and contrast Euclidean and taxicab geometry by writing a brief

Hessian Operators on Constraint Manifolds Petre Birtea and ... · and the Weingarten map for a general submanifold embedded in an Euclidean space. Another con-struction of a Hessian

Non-Euclidean Geometry Topics to Accompany Euclidean and ...

Euclidean Space and its Isometry Group - University of New ...bmonson/cuern/eucproblems.pdf · [3] J. Ratcliﬀe, Foundations of Hyperbolic Manifolds, Graduate Texts in Mathe-matics,

Manifolds, Geometry, and Robotics · Ideas and methods from differential geometry and Lie groups have played a crucial role in establishing the scientific foundations of robotics,

Locally homogeneous geometric manifoldsindico.ictp.it/event/a09156/material/4/0.pdf · 2014-05-05 · Locally homogeneous geometric manifolds 3 class of Euclidean structures, and

HODGE COHOMOLOGY OF GRAVITATIONAL INSTANTONS · locally Euclidean manifolds, the (known types of) gravitational instantons, and also Poincare metrics on´ Q-rank 1 ends of locally

Supplement for Manifolds and Diﬁerential Geometry · Supplement for Manifolds and Diﬁerential Geometry ... Calculus on Euclidean coordinate spaces ... Poisson Brackets and Hamiltonian

Euclidean m-Space & Linear Equations Euclidean m-space.

Spatial Reasoning with Applications to Mobile Robotics · 2018. 9. 25. · Spatial Reasoning with Applications to Mobile Robotics 435 Example 1 Assume a unit grid on the Euclidean

Fast Approximate Nearest Neighbor Methods for Non ...rizwanch/papers/ChaudhryECCV10.pdfFast Approximate Nearest Neighbor Methods for Non-Euclidean Manifolds with Applications to Human

Contentsmath.uchicago.edu/~may/REU2019/REUPapers/Smith,Zoe.pdf · ZOE SMITH Abstract. Manifolds can be de ned as subsets of Euclidean space by immer-sions and embeddings. The dimension

Euclidean and Non Euclidean

Manifolds, Geometry, and Roboticsrss2017.lids.mit.edu/docs/invitedtalks/park-manifolds...Manifolds, Geometry, and Robotics Frank C. Park Seoul National University Ideas and methods

MATH 3210: Euclidean and Non-Euclidean Geometryszendrei/Geom_S20/lec-04-06.pdf · Hilbert Planes with (P) and Euclidean Planes MATH 3210: Euclidean and Non-Euclidean Geometry. Propositions

Strauss conjecture on asymptotically Euclidean …xyu/research/11_GSU_StraussConjectureO...Strauss conjecture on asymptotically Euclidean manifolds Xin Yu (Joint with Chengbo Wang)

MA232A: Euclidean and non-Euclidean Geometry Michaelmas ...