Euclidean Distance Matrices · Euclidean Distance Matrices: A Short Walk Through Theory, Algorithms...

26

Transcript of Euclidean Distance Matrices · Euclidean Distance Matrices: A Short Walk Through Theory, Algorithms...

Page 1: Euclidean Distance Matrices · Euclidean Distance Matrices: A Short Walk Through Theory, Algorithms and Applications Ivan Dokmani c, Reza Parhizkar, Juri Ranieri and Martin Vetterli
Page 2: Euclidean Distance Matrices · Euclidean Distance Matrices: A Short Walk Through Theory, Algorithms and Applications Ivan Dokmani c, Reza Parhizkar, Juri Ranieri and Martin Vetterli

Euclidean Distance Matrices:A Short Walk Through Theory, Algorithms and Applications

Ivan Dokmanic, Reza Parhizkar, Juri Ranieri and Martin Vetterli

Page 3: Euclidean Distance Matrices · Euclidean Distance Matrices: A Short Walk Through Theory, Algorithms and Applications Ivan Dokmani c, Reza Parhizkar, Juri Ranieri and Martin Vetterli

Overview:

I Motivation

I Euclidean Distance Matrices (EDM) and their properties

I Algorithms for EDMs

I Applications of EDMs

I Conclusions and open problems

1

Page 4: Euclidean Distance Matrices · Euclidean Distance Matrices: A Short Walk Through Theory, Algorithms and Applications Ivan Dokmani c, Reza Parhizkar, Juri Ranieri and Martin Vetterli

Motivation

I We land at the GVA airport and we have lost our map of Switzerland...

I We have only a train schedule!

Lausanne Geneva Zurich Neuchatel Bern

Lausanne 0 33 128 40 66

Geneva 33 0 158 64 101

Zurich 128 158 0 88 56

Neuchatel 40 64 88 0 34

Bern 66 101 56 34 0

Distances in minutes between five swiss cities

SwitzerlandSwitzerland

Geneva

Lausanne

NeuchatelBern

Zurich

Locations (red) and estimated locations (black) ofthe cities.

2

Page 5: Euclidean Distance Matrices · Euclidean Distance Matrices: A Short Walk Through Theory, Algorithms and Applications Ivan Dokmani c, Reza Parhizkar, Juri Ranieri and Martin Vetterli

Sensor network localization problem

Sensor network deployed on a rock glacier

I We measure the distances between the sensornodes,

I The distances are noisy and some are missing,

I How do we reconstruct the locations of thesensors?

3

Page 6: Euclidean Distance Matrices · Euclidean Distance Matrices: A Short Walk Through Theory, Algorithms and Applications Ivan Dokmani c, Reza Parhizkar, Juri Ranieri and Martin Vetterli

Molecular conformation problem

Density map and structure of a

molecule [10.7554/elife.01345]

I We measure the distances between the atoms,

I The distances are given as intervals, and some are missing,

I How do we reconstruct the molecule?

4

Page 7: Euclidean Distance Matrices · Euclidean Distance Matrices: A Short Walk Through Theory, Algorithms and Applications Ivan Dokmani c, Reza Parhizkar, Juri Ranieri and Martin Vetterli

Euclidean Distance Matrix

I Consider a set of n points X ∈ Rd×n,

I edm(X) contains the squared distances between the points,

I Equivalently, edm(X) = 1diag(XTX)T − 2XTX + diag(XTX)1T.

5

Page 8: Euclidean Distance Matrices · Euclidean Distance Matrices: A Short Walk Through Theory, Algorithms and Applications Ivan Dokmani c, Reza Parhizkar, Juri Ranieri and Martin Vetterli

EDM properties: rank and essential uniqueness

I The rank of an EDM depends only on the dimensionality of the points:

Theorem (Rank of EDMs)

Rank of an EDM corresponding to points in Rd is at most d + 2.

I EDMs are invariant to rigid transformations (translation, rotations, reflections):

edm(X) = edm(RX + b1T).

6

Page 9: Euclidean Distance Matrices · Euclidean Distance Matrices: A Short Walk Through Theory, Algorithms and Applications Ivan Dokmani c, Reza Parhizkar, Juri Ranieri and Martin Vetterli

Counting the degrees of freedom

I Consider n points in Rd , then we have #X = nd degrees of freedom (DoF).

I If we describe the points with a symmetric rank-(d + 2) matrix, we have

#DOF = n(d + 1)− (d+1)(d+2)2 DoF.

I For large n and fixed d , #DOF#X∼ d+1

d : the rank property is not a tight description of anEDM.

7

Page 10: Euclidean Distance Matrices · Euclidean Distance Matrices: A Short Walk Through Theory, Algorithms and Applications Ivan Dokmani c, Reza Parhizkar, Juri Ranieri and Martin Vetterli

Forward and inverse problem related to EDMs

Forward problem

Inverse problem

I Forward problem: given the points X, find the EDM edm(X).

I Inverse problem: given the distances ‖xi − xj‖2, find the points X.• Distances may be noisy,

• Some distances may be missing,

• We may loose the naming of the distances.

• Significantly harder than the forward problem.

8

Page 11: Euclidean Distance Matrices · Euclidean Distance Matrices: A Short Walk Through Theory, Algorithms and Applications Ivan Dokmani c, Reza Parhizkar, Juri Ranieri and Martin Vetterli

Examples of inverse problems

9

Page 12: Euclidean Distance Matrices · Euclidean Distance Matrices: A Short Walk Through Theory, Algorithms and Applications Ivan Dokmani c, Reza Parhizkar, Juri Ranieri and Martin Vetterli

Algorithms: multidimensional scaling

10

Page 13: Euclidean Distance Matrices · Euclidean Distance Matrices: A Short Walk Through Theory, Algorithms and Applications Ivan Dokmani c, Reza Parhizkar, Juri Ranieri and Martin Vetterli

Algorithms: alternating descent of the s-stress function

11

Page 14: Euclidean Distance Matrices · Euclidean Distance Matrices: A Short Walk Through Theory, Algorithms and Applications Ivan Dokmani c, Reza Parhizkar, Juri Ranieri and Martin Vetterli

Other algorithms

12

Page 15: Euclidean Distance Matrices · Euclidean Distance Matrices: A Short Walk Through Theory, Algorithms and Applications Ivan Dokmani c, Reza Parhizkar, Juri Ranieri and Martin Vetterli

Algorithms: performance comparison

13

Page 16: Euclidean Distance Matrices · Euclidean Distance Matrices: A Short Walk Through Theory, Algorithms and Applications Ivan Dokmani c, Reza Parhizkar, Juri Ranieri and Martin Vetterli

Applications of EDM

14

Page 17: Euclidean Distance Matrices · Euclidean Distance Matrices: A Short Walk Through Theory, Algorithms and Applications Ivan Dokmani c, Reza Parhizkar, Juri Ranieri and Martin Vetterli

Applications: Multidimensional unfolding of echoes

Microphones Acoustic events

1

32

4 1

2

3

??

??

??

??

??

????

??

??

I Multidimensional unfolding:• Divide the points in two sets,

• Measure the distances between the points belonging to different subsets,

• Other distances are unknown.

I Example: calibration of a microphones with sources at unknown locations.

I Many distances are missing, the measured ones are noisy.15

Page 18: Euclidean Distance Matrices · Euclidean Distance Matrices: A Short Walk Through Theory, Algorithms and Applications Ivan Dokmani c, Reza Parhizkar, Juri Ranieri and Martin Vetterli

Applications: Calibration in ultrasound tomography

A B

I (A) Ultrasound transceivers deployed on a circle, their location is unknown.

I Each transceiver can measure the distance w.r.t. the transceivers in front.

I (B) We can fill the EDM, with structured missing entries.

I Problem: estimate the locations of the transceiver to improve the imaging performance.

16

Page 19: Euclidean Distance Matrices · Euclidean Distance Matrices: A Short Walk Through Theory, Algorithms and Applications Ivan Dokmani c, Reza Parhizkar, Juri Ranieri and Martin Vetterli

Applications: Can you hear the shape of a room?

17

Page 20: Euclidean Distance Matrices · Euclidean Distance Matrices: A Short Walk Through Theory, Algorithms and Applications Ivan Dokmani c, Reza Parhizkar, Juri Ranieri and Martin Vetterli

Applications: Sparse Phase Retrieval

18

Page 21: Euclidean Distance Matrices · Euclidean Distance Matrices: A Short Walk Through Theory, Algorithms and Applications Ivan Dokmani c, Reza Parhizkar, Juri Ranieri and Martin Vetterli

Open problems

I Distance matrices on manifolds

I Projections of EDMs on lower dimensional subspaces

I Efficient algorithms for distance labeling

I Analytical local minimum of s-stress

19

Page 22: Euclidean Distance Matrices · Euclidean Distance Matrices: A Short Walk Through Theory, Algorithms and Applications Ivan Dokmani c, Reza Parhizkar, Juri Ranieri and Martin Vetterli

Conclusions

I Definition of EDMs

I Properties of EDMs

I Inverse problems with EDMs

Application missing distances noisy distances unlabeled distances

Wireless sensor networks * 4 4 ×Molecular conformation 4 4 ×

Hearing the shape of a room * × 4 4

Indoor localization × 4 4

Calibration 4 4 ×Sparse phase retrieval * × 4 4

20

Page 23: Euclidean Distance Matrices · Euclidean Distance Matrices: A Short Walk Through Theory, Algorithms and Applications Ivan Dokmani c, Reza Parhizkar, Juri Ranieri and Martin Vetterli

Literature

I

I

I

I

21

Page 24: Euclidean Distance Matrices · Euclidean Distance Matrices: A Short Walk Through Theory, Algorithms and Applications Ivan Dokmani c, Reza Parhizkar, Juri Ranieri and Martin Vetterli

Acknowledgments

I Farid Movahedi Naini for helping with the numerical experiments.

I Funding resources:

• Swiss National Science Foundation, Grant 200021 138081

• European Research Council SPARSAM, Grant 247006

• Google ?

22

Page 25: Euclidean Distance Matrices · Euclidean Distance Matrices: A Short Walk Through Theory, Algorithms and Applications Ivan Dokmani c, Reza Parhizkar, Juri Ranieri and Martin Vetterli

Thanks for the attention!

AB

C

D

E

FG

HI J

K

L

M

NO

P

Q

R

ST

U

V

W

X

Y

Z

Q W E R T Y U I O P

A S D F G H J K L

Z X C V B N M

QWERTY Keyboard EDM Keyboard

23

Page 26: Euclidean Distance Matrices · Euclidean Distance Matrices: A Short Walk Through Theory, Algorithms and Applications Ivan Dokmani c, Reza Parhizkar, Juri Ranieri and Martin Vetterli